KR101360215B1 - Mobile terminal and operation control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal and a method for operating the mobile terminal for recognizing the surrounding situation by analyzing a frequency of the surrounding noise and informing the user of the surrounding situation, the method comprising: collecting the surrounding noise when a call or multimedia playback is started; Recognizing the surrounding situation by analyzing the frequency of the collected noise; And informing the user of the recognized surrounding situation according to the situation notification setting and controlling an operation (internal volume) of the mobile terminal.

Description

MOBILE TERMINAL AND OPERATION CONTROL METHOD THEREOF}

The present invention relates to a mobile terminal and a method of operating the same for recognizing a surrounding situation by analyzing a frequency of surrounding noise and informing a user of the situation.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

In general, the mobile terminal is provided with an audio signal output function to ring a phone or output a sound associated with executing the function when a phone call or a specific function (music playback or video playback) is executed. However, when the above function is executed through the mobile terminal, since the sound is output to the outside, it may be inconvenient to others in a place where many people are gathered (meeting room, subway, library and the like).

Therefore, the users reduce the volume of the mobile terminal or connect the earphones to perform music or video playback. The earphones are often used to answer calls while driving or doing other things as well as playing music or video.

However, when listening to music with earphones or making phone calls through earphones while driving as described above, however, you may not hear various noises (car horns, development and warning announcements) indicating ambient noise (construction machinery, excavators) or dangerous situations. There is a concern that they may not be able to respond appropriately to the situation or may be in danger.

Accordingly, an aspect of the present invention is to provide a mobile terminal and a method of operating the mobile terminal capable of improving the recognition rate and accuracy of the surrounding situation through the frequency analysis of the surrounding sound.

Another object of the present invention is to provide a mobile terminal and a method of operating the same so that a user can recognize the recognized surrounding situation well.

In order to achieve the above object, an operation control method of a mobile terminal according to an embodiment of the present invention includes: collecting ambient noise when a call or multimedia playback is started; Recognizing the surrounding situation by analyzing the frequency of the collected noise; And notifying the user of the recognized ambient situation according to the situation notification setting and adjusting the internal volume.

The surrounding situation includes a dangerous situation, a quiet situation and a general situation.

The surrounding situation is recognized as a dangerous situation when the frequency characteristic of the ambient noise detected in the frequency domain corresponds to a warning frequency, and is recognized as a quiet situation when it corresponds to a Quiet frequency, and when it is the same as the frequency characteristic of a specific sound previously stored, It is recognized.

The situation notification setting includes a notification method, a volume adjustment value, a situation detection time, a level, and a place for each surrounding situation.

The method for controlling an operation of the mobile terminal may further include setting a surrounding situation, a notification method related thereto, and an operation method of the mobile terminal through a context notification setting menu.

In the step of adjusting the notification and volume, if the user is wearing the earphone when the surrounding situation is a dangerous situation, the internal volume is reduced to reduce the sound output to the earphone and the dangerous situation is notified according to a preset notification method.

The volume is reduced for a certain time and then returned to its original state. The notification method is one of a pop-up window, a notification sound, a message, and a vibration.

If the user is wearing earphones when the surrounding situation is a Quiet situation, the maximum volume limit is applied. If the user is not wearing the earphones, the volume is reduced. Return to the previous volume setting.

In the step of adjusting the notification and volume, if the surrounding situation is a general situation, if the user is wearing the earphone, the internal volume is reduced to reduce the sound output to the earphone and the general situation is notified according to a preset notification method.

In order to achieve the above object, a mobile terminal according to an embodiment of the present invention includes a memory for storing a situation notification setting; An output unit for outputting an ambient situation; And a controller for analyzing a frequency of ambient noise during call or multimedia playback to recognize the surrounding situation, and notifying the user of the recognized surrounding situation according to the situation notification setting stored in the memory and controlling the operation of the terminal.

The surrounding situation includes a dangerous situation, a quiet situation and a general situation.

If the frequency characteristic of the ambient noise detected in the frequency domain corresponds to the warning frequency, the controller recognizes it as a dangerous situation, and if it corresponds to the Quiet frequency, recognizes it as a Quiet situation. do.

The situation notification setting is input through a situation notification setting menu, and the situation notification setting menu includes a notification method, a volume adjustment value, a situation detection time, a level and a place for each surrounding situation.

The memory stores a surrounding situation input by the user through the context notification setting menu, a notification method related thereto, and an operation method of the mobile terminal.

When the user is wearing the earphone when the surrounding situation is a dangerous situation, the controller decreases the volume of the earphone and outputs the sound to the earphone and notifies the dangerous situation according to a preset notification method.

The volume is reduced for a certain time and then returned to its original state. The notification method is one of a pop-up window, a notification sound, a message, and a vibration.

The controller applies the maximum volume limit when the user is wearing the earphone when the surrounding situation is the Quiet situation, and decreases the total volume when the user is not wearing the earphone, and returns to the previous volume setting value when the user leaves the Quiet region.

The present invention can prevent a safety accident by informing a user of a dangerous situation by recognizing a surrounding sound, a warning sound or a warning situation through frequency analysis when a phone call or playing multimedia through the earphone while the earphone is mounted. In particular, the present invention can improve the recognition rate and accuracy than simply analyzing the noise through the noise in the frequency domain.

In addition, the present invention can minimize the situation that other people avoid by ringtones, alarm sounds and song sounds by limiting some functions of the mobile terminal through frequency analysis in public places such as libraries and conference rooms.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
3 is an example of an ambient sound collecting device capable of collecting ambient sounds in the present invention.
4 is a flowchart of setting various situation notifications in a situation notification setting menu according to an embodiment of the present invention.
5 is a diagram illustrating an example of a situation notification setting menu according to an embodiment of the present invention.
6 is a flowchart illustrating a method of operating a mobile terminal according to a dangerous situation detection according to an embodiment of the present invention.
7 is an example of analyzing the frequency characteristics of the detected ambient noise.
8 shows an example of radiating a warning frequency in a hazardous area.
9 is an example of setting an associated sound of a specific situation in a general situation.
10 is a diagram showing an example of radiating a Quiet frequency in a public place.
11 is a flowchart illustrating an example of controlling the operation of a mobile terminal by detecting a Quiet frequency in the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the current technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating a moving direction when a user moves, a gyro sensor for calculating a rotating direction, and an acceleration sensor.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention provides a way to notify the user by recognizing the surrounding situation through the frequency analysis of the ambient sound or to perform a predetermined operation (volume adjustment) by the user.

The ambient sound includes both nurturing (warning sound, announcement broadcasting) and machine sound (construction noise, car horn, various vehicle sounds).

The frequency analysis includes the frequency distribution of the detected ambient sound as well as the spectral distribution for each frequency. For example, the horn of a vehicle is about 500Hz or about 405 ~ 420Hz, and in the case of dangerous areas (construction sites, areas with frequent accidents), various frequencies of 20Hz ~ 20000Hz are generated. Accordingly, the present invention recognizes a dangerous situation when a certain amount or more of frequencies indicative of a beep characteristic is included in the frequency domain.

Therefore, after recognizing various surrounding conditions using a frequency analysis method, it is necessary to preset how to notify a dangerous situation and control the operation of the mobile terminal according to the recognized situation and whether the earphone is worn. The preset is performed in the context notification setting menu of the user menu.

3 is an example of an ambient sound collecting device capable of collecting ambient sounds in the present invention.

As shown in FIG. 3, the ambient sound may be recognized through a microphone / sub microphone mounted in a mobile terminal or an audio device, or may be recognized through a noise cancellation sensor or an earphone microphone built in an earphone or a terminal. In addition, the ambient sound may be recognized through a sound sensor, RFID, or earphone that recognizes a specific frequency. In particular, the earphone has an average length of about 1m and can recognize a frequency of about 150Mhz. 4 is a flowchart illustrating setting various situation notifications in a situation notification setting menu according to an embodiment of the present invention.

As illustrated in FIG. 4, a user sets various dangerous situations, a related operation of a mobile terminal, and a notification method through a situation notification setting menu.

For example, when the situation notification menu is displayed on the screen (S10), the user may input a dangerous situation and a related operation and sound (sound) through the user-defined setting item (S11), and the user-defined setting item. Through the type of the announcement, the operation of the terminal associated with it and the pattern of the announcement can be input (S12). Then, the user sets whether to detect earphone danger or Quiet state through the situation notification setting items and sets detailed detection information (detection frequency, detection time zone, detection place, etc.) (S14). The set status notification, operation and sound characteristics of the terminal are stored in the memory 160.

5 illustrates an example of a situation notification setting menu according to an embodiment of the present invention.

As shown in FIG. 5, the user may set a function (eg, volume reduction) and a notification method (alarm, vibration, message, popup, notification window) in which the mobile terminal operates according to surrounding conditions. In addition, the user can set whether to detect warning wnvktn or quiet frequency through the situation notification item, and set the dangerous situation detection value, detection time zone and detection location through the detection sensitivity control item. Can hang. In addition, the user may select whether to share the situation notification set by the user with another person through the terminal or through the web through a data sharing item. In particular, the user can input a sound for each situation (car sound, announcement, clock alarm sound, telephone ringtone, door ringtone, etc.) and the input sound is analyzed by the controller 180 and the frequency characteristic is stored in memory. Stored at 160.
The surrounding situation may include a dangerous situation indicating that the user is accessing or in a dangerous area, a quiet situation indicating that the user is in an area where quietness is required, and a general situation indicating that the user excludes a dangerous and quiet situation. It includes;

Hereinafter, preferred embodiments of the present invention will be described.

6 is a flowchart illustrating a method of operating a mobile terminal according to a dangerous situation detection according to an embodiment of the present invention.

When the user makes a phone call or plays a multimedia (music or video) (S20), the controller 180 detects the noise around the mobile terminal through the ambient sound collecting device (S21), and the frequency of the corresponding noise alerts a certain amount or more. In other words, whether the frequency (150Mhz or 500Hz) is included, it is checked whether the detected ambient noise frequency corresponds to the warning frequency band (S23). As a result of the check, if the frequency of the ambient noise does not correspond to the warning frequency, it is recognized as noise and the corresponding frequency is removed (S24).

When the dangerous situation is recognized, the controller 180 checks the wearing state of the earphone (S25), and when the user wears the current earphone, adjusts the internal volume of the terminal to adjust the output level of the sound (call or play sound) output to the earphone. After reducing (S26), a pop-up window, a notification sound or a vibration is generated according to the situation notification setting preset in FIGS. 4 and 5 to notify the user of a dangerous situation (S27). At this time, the volume may be continuously reduced while the warning frequency is detected, or may be briefly reduced and returned to its original state.

On the other hand, if the user is not wearing the earphone immediately displayed in a pop-up window or a notification sound or vibration to inform the user of a dangerous situation, return to the process (S21) continues to detect the ambient noise.

7 is an example of analyzing the frequency characteristics of the detected ambient noise.

When the user makes a phone call or plays a multimedia (music or video), the controller 180 detects the ambient noise over time (periodically or continuously) (measured in the time domain), and then detects the ambient noise. Analyze the frequency spectrum (analysis in the frequency domain). As a result of analysis, when a specific frequency (150 mHZ, 500 Hz) indicating a warning sound is distributed over a predetermined amount (constant band), the controller 180 recognizes a dangerous situation. As described above, the noise analysis in the frequency domain has an advantage in that the recognition rate and accuracy of the noise are higher than simply analyzing through the magnitude.

The present invention recognizes a dangerous situation through frequency analysis and informs the user and controls the operation of a preset mobile terminal. Therefore, it is possible to recognize a dangerous situation by analyzing the frequency of the ambient noise, it may be radiated by setting a warning frequency (Warning frequency) in a specific hazardous area. In the case of hazardous areas (construction, frequent accidents, crosswalks), it is possible to emit a specific unified hazard frequency above the audible frequency (20 Hz to 20000 Hz) indicating that the area is a hazardous area.

8 shows an example of radiating a warning frequency in a hazardous area.

As shown in Figure 8, in the danger zone (construction, crosswalk and manhole) radiates a warning frequency of 150Mhz as a warning frequency to indicate that the area is a dangerous area. The warning frequency of 150Mhz is a frequency that can be recognized as an earphone, and when the user approaches the corresponding area while wearing the earphone, the warning frequency is detected through the earphone to reduce the volume of the earphone and notify the user that the danger zone is dangerous.

The present invention may allow a mobile terminal to respond to a specific sound in a general situation as well as in a dangerous situation to perform an operation set by a user. The specific sounds include not only announcements of public transportation (buses, subways) related to a plurality of users, but also alarm clocks, telephone ring tones and door bells associated with each user.

9 is an example of setting a related sound of a specific situation in a general situation.

Inputting and storing a related sound of a specific situation may be performed through the user defined setting item of FIG. 5. The user can select a specific sub-item, such as a bus announcement, from among the user-defined setting items and enter "This station is ####". When the sound of a specific situation is input, the controller 180 analyzes the frequency characteristic of the sound and stores the analyzed frequency characteristic in the memory 160.

Then, when the ambient sound is detected through the noise collecting device of the mobile terminal, the controller 180 compares the frequency characteristic of the corresponding sound with the frequency characteristic of the stored announcement and executes an operation set by the user when the two frequency characteristics are the same. In particular, in the case of a notification sound that is widely used, such as announcements of public transport, it is built in the mobile terminal in advance so that it can be immediately recognized. On the other hand, the clock alarm sound, phone ringtone, and door ringtone associated with each user can be set and used as necessary.

In general, when a user fails to mute in a place such as a library or a conference room, a mobile device rings or an alarm sounds, which often causes damage to others. In addition, even when the user listens to a song or plays a video through the earphone at the same place, the sound may leak out of the ear tone and cause damage to others. This unexpected situation can also be conveniently solved through the frequency analysis of the present invention.

10 shows an example of emitting Quiet frequency in a public place.

Public places such as libraries and conference rooms are relatively quiet. Therefore, it is better to radiate a certain quiet frequency than the announcement because the announcement in a public place may adversely affect people. The Quiet function and the Quiet frequency value may be set in the situation notification setting item of FIG. 5. In particular, the Quiet function will be able to control more precisely if set with the detection time or location.

When the Quiet frequency is radiated in the public place, the Quiet frequency is detected through the antenna or earphone of the mobile terminal. Therefore, when the Quiet frequency is detected, the controller 180 reduces the total volume to a predetermined size or less before reproducing a ringtone or an alarm sound. In particular, when using a earphone, when the Quiet frequency is detected, the maximum volume is fixed below a certain size.

FIG. 11 is a flowchart illustrating an example of controlling the operation of a mobile terminal by detecting a quiet frequency.

As shown in FIG. 11, first, the user sets the total volume reduction level when setting the Quiet function, and sets the maximum volume limit value when the earphone is worn. Then, when the user makes a phone call or plays a multimedia (music or video) (S30), the controller 180 detects ambient noise through the ambient sound collection device before playing the ringtone or the multimedia (S21).

The controller 180 analyzes the frequency of the detected noise and checks if the frequency of the quiet band is detected by a predetermined amount or more, that is, the frequency of the noise corresponds to the quiet frequency (S33). As a result of the check, if the frequency of the ambient noise does not correspond to the Quiet frequency, ringing or playing multimedia (S37), and if the Quiet frequency corresponds to the Quiet situation.

When the Quiet situation is recognized, the controller 180 performs different operations according to the wearing state of the earphone (S25). When the user wears the current earphone, the controller controls the maximum volume limit of the sound (call tone or playback sound) output to the earphone. If not applied (S36), if the earphone is not wearing the overall volume is reduced (S36).

After the adjustment of the volume, the controller 180 rings the ringtone or plays the multimedia (S37), and returns to the process 9S31 to continuously detect the ambient noise. In addition, when the user no longer detects the Quiet frequency out of the public place where the Quiet frequency is emitted, that is, the Quiet area, the controller 180 restores the previous volume setting value.

In addition, the present invention has been described using an example of reducing the internal volume as an example of controlling the operation of the mobile terminal according to the surrounding situation, but the present invention is not limited thereto, and provides information related to the corresponding dangerous situation and information that can escape the dangerous area. You may.

As described above, the present invention effectively identifies safety situations by informing a user of a dangerous situation by recognizing a surrounding sound, a warning sound, or a warning situation through frequency analysis when a phone call or playing multimedia through the earphone while the earphone is mounted. It can be prevented.

The present invention can minimize the situation that other people avoid by ringtones, alarm sounds and song sounds by limiting some functions of the mobile terminal through frequency analysis in public places such as libraries and conference rooms.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113; Wireless Internet Module
140; Sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (20)

Storing frequency characteristics of sounds generated in a plurality of surrounding situations;
Collecting ambient sounds during a call or multimedia playback;
Calculating a frequency characteristic of the sound by analyzing the frequency spectrum of the collected sound; And
Recognizing a surrounding situation in which the collected sound is generated by comparing the calculated frequency characteristic with a plurality of pre-stored frequency characteristics; And
And controlling an operation of a preset mobile terminal according to the recognized surrounding situation. delete The method of claim 1, wherein the sounds generated in the plurality of surrounding situations are
A method for controlling the operation of a mobile terminal, comprising a sound generated from dangerous goods, a sound generated from a dangerous area and a sound generated from a specific place, a guide broadcast sound of a means of transportation, a clock alarm sound, a telephone ring tone or a door ring. delete delete The method of claim 1, further comprising: storing an operation and a notification method of the mobile terminal for each surrounding situation; Further,
The above circumstances
Dangerous situations indicating that the user has access to or is in a hazardous area;
A quiet situation indicating that the user is in an area where quietness is required; And
And a general situation indicating that the user has a situation excluding a dangerous situation and a quiet situation. The method of claim 1, wherein controlling the operation of the mobile terminal comprises:
Checking whether the earphone is installed when the surrounding situation is recognized as a dangerous situation; And
Reducing the volume of the sound output to the earphone when the earphone is mounted, and notifying a dangerous situation according to a preset notification method. The method of claim 7, wherein the volume is reduced for a predetermined time and then returned to its original state, wherein the notification method is one of a pop-up window, a notification sound, a message, and a vibration. The method of claim 1, wherein controlling the operation of the mobile terminal comprises:
Checking whether or not the earphone is installed when the surrounding situation is recognized as a quiet situation;
Applying a maximum volume limit when the earphone is mounted, and decreasing the total volume when the earphone is not mounted; And
And returning to a previous volume setting value when the user leaves a region requiring a quiet situation. The method of claim 1, wherein controlling the operation of the mobile terminal comprises:
Checking whether or not the earphone is installed when the surrounding situation is recognized as a general situation; And
Reducing the volume of the sound output to the earphone when the earphone is mounted and notifying the general situation according to a preset notification method. A memory for storing frequency characteristics of sounds generated in a plurality of surrounding situations;
An output unit for outputting a surrounding situation; And
Analyze the frequency spectrum of the ambient sound collected during a call or multimedia playback to calculate the frequency characteristic of the corresponding sound, and compare the calculated frequency characteristic with a plurality of pre-stored frequency characteristics to determine the surrounding situation in which the collected sound is generated. And a controller configured to control an operation of a preset mobile terminal according to the recognized surrounding situation after the recognition. The method of claim 11, wherein the sound generated in the plurality of surrounding situations is
A mobile terminal including a sound generated from a dangerous goods, a sound generated from a hazardous area and a sound generated from a specific place, an announcement sound of a vehicle, a clock alarm sound, a telephone ring tone or a door ring. delete delete delete The method of claim 11, wherein the memory is
Saves the operation and notification method of the mobile terminal for each situation,
The above circumstances
Dangerous situations indicating that the user has access to or is in a hazardous area;
A quiet situation indicating that the user is in an area where quietness is required; And
A mobile terminal, comprising: a general situation indicating that a user has a situation except a dangerous situation and a quiet situation. 12. The apparatus of claim 11, wherein the control unit
When the surrounding situation is recognized as a dangerous situation, if the user is wearing the earphone, the mobile terminal, characterized in that the volume is reduced by reducing the sound output to the earphone and notifying the dangerous situation according to a preset notification method. The mobile terminal of claim 17, wherein the volume is reduced for a predetermined time and then returned to its original state, wherein the notification method is one of a pop-up window, a notification sound, a message, and a vibration. 12. The apparatus of claim 11, wherein the control unit
If the surrounding situation is recognized as a quiet situation, the user applies the maximum volume limit if the user is wearing the earphone, and decreases the overall volume if the user is not wearing the earphone. A mobile terminal, characterized in that for returning. 12. The apparatus of claim 11, wherein the control unit
When the surrounding situation is recognized as a general situation, if the user is wearing the earphone, the mobile terminal, characterized in that the volume is reduced by reducing the sound output to the earphone and the general situation according to a preset notification method.

Images