JP2010124365A - Mobile terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal device notifying a user of predetermined information while more considering the environment surrounding the user. <P>SOLUTION: A selector 5 selects which of a notifier 3a or 3b is caused to notify a user of predetermined information on the basis of not simple surrounding sound but human voice and background sound volumes. Thus, a user can be notified of the predetermined information while more considering the environment surrounding the user. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a portable terminal device having a function of notifying a user of predetermined information.

  When a mobile terminal device having a communication function such as a mobile phone is used, a ring tone may sound in an environment where it is not appropriate to make a sound such as in a train or during a meeting, which may be annoying to the surroundings. As a countermeasure against this, the current portable terminal device is set with a manner mode in which a ringtone at the time of an incoming call is stopped or a vibrator is driven instead of the ringtone. However, since the manner mode is set or canceled depending on the user, there is a case where the manner mode is not set because the user can not answer the incoming call by forgetting the setting or cancellation.

  For this reason, for example, when the sound pressure of ambient noise is detected by a microphone and the sound pressure is larger than a reference value, such as when the surroundings of the mobile terminal device are noisy, a ring tone is sounded and the surroundings of the mobile terminal device are quiet. It has been proposed to drive the vibrator when the sound pressure is smaller than a reference value (for example, see Patent Document 1).

Japanese Patent Laid-Open No. 10-341464

  However, in Patent Document 1, since it is determined whether to ring the ring tone or to drive the vibrator only by sound pressure, for example, in a train or the like, where it is not desired to ring the ring tone even if noisy. Even the ringtone could sound.

  Accordingly, an object of the present invention is to provide a mobile terminal device that can notify a user of predetermined information in consideration of the surrounding environment.

  In order to solve the above-described problems, a mobile terminal device according to the present invention includes a microphone unit that detects ambient sounds, a plurality of notification units that notify a user of predetermined information using different methods, and a microphone unit. Detecting a sound volume of a human voice and a sound volume of a background sound from the sound detected by, and when a predetermined signal is input, the sound volume of a human voice and a background sound detected by the detection section And a selection unit that selects a notification unit that notifies predetermined information from a plurality of notification units based on the volume.

  According to the present invention, since the notification unit for notifying the predetermined information is selected from the plurality of notification units based on the voice of the person and the volume of the background, not just the surrounding sounds, the surrounding environment of the sound In consideration of this, it is possible to notify the user of predetermined information.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
First, a first embodiment of the present invention will be described.

<Configuration of mobile terminal device>
As shown in FIG. 1, a mobile terminal device 1 according to the present embodiment includes a microphone unit 2 that detects sounds around the mobile terminal device 1, and notification units 3a and 3b that notify a user of predetermined information. The detection unit 4 detects the volume of the human voice and the volume of the background sound from the sound detected by the microphone unit 2, and when a predetermined signal is input, the detection unit 4 detects the human voice detected by the detection unit 4. Based on the volume and the volume of the background sound, the selection unit 5 selects which of the notification units 3a and 3b is to notify predetermined information. Here, the notification units 3a and 3b leave predetermined information by a different method such as vibrating or making a sound.

<Operation of mobile terminal device>
First, the microphone unit 2 detects sounds around the mobile terminal device 1 at predetermined time intervals or continuously. Such a detection result by the microphone unit 2 is input to the detection unit 4. The detection unit 4 separates the detection result of the microphone unit 2 from the sound of a human voice and the background sound, and detects the respective sound volumes.

  When a predetermined signal is input, such as when an incoming call comes in from the outside or when a timer such as an alarm is set, the selection unit 5 causes the volume and background of the human voice detected by the detection unit 4 to be detected. Based on the volume of the sound, it is selected which of the notification units 3a and 3b is to notify the predetermined information. As an example, a case will be described in which the notification unit 3a outputs a sound from a speaker, and the notification unit 3b notifies the user that an incoming call has arrived or that a predetermined time has been reached by applying vibration by a vibrator.

  For example, when there is a certain volume of human voice, such as during a meeting, but the background sound is low, the selection unit 5 causes the notification unit 3b to notify the predetermined information, that is, does not output the sound from the speaker. Only the vibrator is driven. Thereby, it is possible to prevent annoying the surroundings. Even when the voice of the person is small but the background sound is loud, such as in a train, the selection unit 5 notifies the predetermined information by the notification unit 3b and gives vibration by the vibrator. Thereby, it can prevent inconvenience to the person on the train. In addition, when the volume of a human voice and the background sound are high, such as in a street, the selection unit 5 causes the notification unit 3a to notify predetermined information, that is, causes the speaker to output sound. Thereby, predetermined information can be conveyed to the user. In this case, both the notification units 3a and 3b may be driven. In this case, predetermined information can be transmitted to the user more reliably.

  As described above, according to the present embodiment, the selection unit 5 causes the notification units 3a and 3b to notify the predetermined information based on the voice of the person and the volume of the background, not just the surrounding sounds. Therefore, it is possible to notify the user of predetermined information in consideration of the surrounding environment.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

<Configuration of communication system>
As shown in FIG. 2, the communication system according to the present embodiment includes a base station 10, a mobile terminal device 20 that performs voice and data communication via the base station 10, and an external device 30. .

<< Configuration of Base Station 10 >>
The base station 10 includes a known base station, and controls communication between the mobile terminal device 20 and the external device 30.

<< Configuration of Mobile Terminal Device 20 >>
The mobile terminal device 20 includes a communication circuit 21 for exchanging voice and data with the base station 10 via an antenna AT, a publicly known device such as an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence), and an FED (Field Emission Display). A display device 22 including a display device, an input device 23 including a known input device such as a numeric keypad, jog shuttle, and keyboard, a vibrator 24 that vibrates when driven, a microphone 25 that detects external sound, and a sound Is provided, a control unit 27 that controls the operation of the mobile terminal device 20, and a memory 28 that stores various information necessary for the operation of the mobile terminal device 20.

  Here, the control unit 27 includes a microprocessor such as a CPU and its peripheral circuits, and reads and executes the operation program 28e stored in the memory 27, thereby causing the hardware and the operation program 28e described later to cooperate. The function processing unit 27a, the sampling unit 27b, the volume detection unit 27c, the determination unit 27d, the condition setting unit 27e, and the ringing determination unit 27f are realized.

  The function processing unit 27 a is a functional unit that implements various operations of the mobile terminal device 20 including voice and data communication with the external device 30.

  The sampling unit 27b separates the sound around the mobile terminal device 20 detected by the microphone 25 into a human voice component and a background sound component of the voice (surrounding) at predetermined time intervals. This separation is performed by using a known technique such as CELP (Code Excited Linear Prediction coding).

  The volume detector 27c detects the volume of the human voice component and the surrounding sound components separated by the sampling unit 27b.

  The determination unit 27d determines which pattern stored in the background sound pattern 28a described later is approximate to the surrounding sound component separated by the sampling unit 27b. The determined pattern is stored in the memory 28 as sampling voice analysis information 28b together with the voice and background volume measured by the volume detector 27c.

  The condition setting unit 27e sets conditions regarding an incoming call sounding operation that informs the user of an incoming call, such as whether or not to ring a ringtone or whether or not to drive a vibrator when an incoming call is received. This condition is stored in the memory 28 as a ringing tone ringing condition 28c.

  The ring determination unit 27f generates a ringtone or drives the vibrator 24 to notify the user that an incoming call has been received based on the sampled sound analysis information 28b and the ringtone ringing condition 28c. Determine the content of the incoming ringing action that evokes.

  The memory 28 also stores a background sound pattern 28a, the above-described sampling sound analysis information 28b, the above-described ringing tone ringing condition 28c, normal ringing tone information 28d, and an operation program 28e.

  Here, the background sound pattern 28a is a sample of background sound in any environment where the mobile terminal device 20 is used, such as a train, a car, a conference room, and a downtown area, and patterns 1 to m are provided for each environment. Yes. Such a background sound pattern 28a is composed of a waveform of a volume, such as a sound obtained by detecting a background sound of each environment in advance or an average of the sounds. The normal ring tone information 28d is information related to a ringing operation for a normal incoming call. The operation program 28e is a program for realizing each functional unit of the control unit 27 described above.

<< Configuration of External Device 30 >>
The external device 30 can perform voice and data calls with the mobile phone 2 via the base station 10, and can be a fixed telephone device, a mobile phone device, a PHS (Personal Hady-phone System), a PDA (Personal Digital Assistant), It is composed of a communication device such as a PC (Personal Computer).

<Operation of communication system>
Next, each operation of the communication system according to the present embodiment will be described in detail.

≪Sampling operation≫
First, a sampling operation by the sampling unit 27b of the control unit 27 will be described with reference to FIG.

  First, when the time t has elapsed (step S1: YES), the sampling unit 27b detects sounds around the mobile terminal device 20 with the microphone 25 (step S2). Note that the function processing unit 27a may check the presence or absence of a paging signal at the timing when the time t elapses.

  When the sound around the mobile terminal device 20 is detected, the sampling unit 27b decomposes the sound into voice and background sound (step S3).

 When the sound is separated into the voice and the background sound, the sound volume detector 27c detects the respective sound volumes (step S4).

  When the sound volume is detected, the determination unit 27d compares the detected background sound with each pattern stored in the background sound pattern 28a, and determines which pattern is closest to the background sound. (Step S5). Thereby, it can be detected in which environment the portable terminal device 20 exists.

  When the pattern is determined, the determination unit 27d analyzes information (hereinafter referred to as sampling information) including the volume of the voice and background detected by the volume detection unit 27c and the determined pattern, and performs sampling audio analysis of the memory 28. The information is stored in the information 28b (step S6). In the sampling voice analysis information 28b, for example, sampling information is stored as shown in FIG. In this sampling information described as “sampling 1” in FIG. 4, the value of the voice volume is “3”, the value of the background volume is “2”, and the pattern similar to the background sound is “pattern 5”. ".

  Such a sampling operation is performed every time t as shown in FIG. As a result, the sampling audio analysis information 28b in the memory 28 stores the sampling information every time the time t elapses, and the number of sampling information that can be stored is set to n. For this reason, when sampling is started and n pieces of sampling information are stored in the sampled sound analysis information 28b, the determination unit 27d removes the oldest sampling information from the next generated sampling information, and then performs sampling. Stored in the voice analysis information 28b. Thereby, only the latest sampling information is stored in the sampling sound analysis information 28b.

≪Ringing ringing condition setting operation≫
Next, with reference to FIG. 6 and FIG. 7, the ring tone ringing condition setting operation by the condition setting unit 27 e of the control unit 27 will be described.

  The condition setting unit 27e sets a ringing sound ringing condition indicating a ringing ringing operation condition at the start of use of the mobile terminal device 20, when the power is turned on, or when a setting change is requested. When this setting is requested, the condition setting unit 27e displays each item of the ringing tone ringing condition on the display device 22, as shown in FIG. 6, for example. The user sets each item via the input device 23 based on this display. As the items, as shown in FIG. 6, “voice volume” relating to the voice volume condition, “background volume” relating to the background sound volume, and background sound approximate to any of the background sound patterns 28a. The “approximate pattern” indicating the above, the “ring tone” regarding whether or not to ring the ring tone, the “vibrator” regarding whether or not the vibrator 24 is driven, and the like are provided. In the case of FIG. 6, “voice volume” is set to 2 or less, “background volume” is set to 1 or less, “approximate pattern” is set to pattern 3, “ring tone” is set to OFF, and “vibrator” is set to ON. This is to drive only the vibrator without ringing the ringtone when there is an incoming call when the voice volume is 2 or less, the background volume is 1 or less, and the background sound is similar to pattern 3. It means that

  When each item is set in this way, the condition setting unit 27e stores them as one condition in the incoming call ringing condition 28c of the memory 28. A plurality of conditions can be set. For example, in the case of the incoming call ringing condition 28c shown in FIG. 7, conditions from 1 to o are set. Thereby, an incoming call ringing operation can be set according to various situations around the mobile terminal device 20.

≪Incoming ringing action≫
Next, an incoming call ringing operation will be described with reference to FIG.

  When the communication circuit 21 detects that an incoming call has arrived from the external device 30 to the mobile terminal device 20 via the base station 10 (step S11), the ring determination unit 27f of the control unit 27 reads the sampling voice analysis information 28b in the memory 28. It is confirmed whether or not one or more sampling information is stored in (step S12).

  When the sampling information is not stored (step S12: NO), the ring determination unit 27f sets the information stored in the normal ring tone information 28d of the memory 28 as the ringing operation for the current incoming call (step S12). S21).

  On the other hand, when one or more pieces of sampling information are stored (step S12: YES), the ring determination unit 27f checks whether one or more conditions are stored in the ring tone ringing condition 28c (step S13).

  When the condition is not stored in the ringing tone ringing condition 28c (step S13: NO), the ringing determination unit 27f proceeds to the process of step S21, and sets the normal ringing tone information 28d as the ringing ringing operation for the current incoming call. To do.

  On the other hand, when one or more conditions are stored in the ringing tone ringing condition 28c (step S13: YES), the ringing determination unit 27f performs the voice and background volume of each sampling information stored in the sampling voice analysis information 28b. Are averaged (steps S14 and S15), and the most approximate pattern is extracted from the approximate patterns included in the sampling information stored in the sampling sound analysis information 28b (step S16). Then, m representing the identification number of the condition included in the incoming call ringing condition 28c is set to 1 (step S17), the voice volume, background volume and pattern set in the condition m of the incoming call ringing condition 28c, and steps S14 to S16. It is confirmed whether or not the average value of the voice, the average value of the background, and the mode pattern generated in the above match (step S18).

  If they match (step S18: YES), the ring determination unit 27f sets the condition m included in the incoming ringing condition 28c as the incoming ringing operation for this incoming call (step S23).

  If they do not match (step S18: NO), the ringing determination unit 27f sets m = m + 1 in order to make a non-comparison with the next condition (step S19), and confirms whether the next condition exists. Next, it is confirmed whether or not the quantity of the condition included in the incoming call ringing condition 28c is smaller than m (step S20). If not smaller (step S20: NO), the ringing determination unit 27f returns to the process of step S18 and compares the following conditions with the values generated in steps S14 to S16. On the other hand, if small (step S20: YES), the ring determination unit 27f proceeds to the process of step S21, and sets the normal ring tone information 28d as the ring ring operation for this incoming call.

  When the incoming ringing operation for this incoming call is set, the function processing unit 27a performs the incoming ringing operation based on the setting (step S22).

  Thereby, in the present embodiment, the response determination unit 27d controls the driving of the vibrator 24 and the ringing of the speaker 26 based on the voice of the person, the volume of the background, and the background pattern, not just the surrounding sounds. The user can be notified of predetermined information in consideration of the surrounding environment.

<Specific example>
Specific examples of the ring tone ringing condition 28c and the normal ring tone information 28d will be described with reference to FIG.

  In the incoming call ringing condition 28c of the memory 28 shown in FIG. 9, three conditions 1 to 3 are stored. These priorities are set to have the highest condition 1 and the lowest condition 3. Therefore, when the conditions are overlapped for conditions 1 to 3, the incoming call ringing operation is performed with the setting of the high priority condition.

  The volume of the voice and background can be divided into five levels, can be set to be higher or lower, or can be set to “no condition” regardless of the volume. As a result, it is possible to realize an incoming ringing operation that corresponds in more detail to the situation around the mobile terminal device 20.

  Further, the approximate pattern is set by assigning specific names such as “no condition”, “train”, “car”, and “business center” rather than a simple identification number. Thereby, the user can set an approximate pattern more easily. In accordance with this setting, the background sound pattern 28a stores a pattern that can be selected in the “approximate pattern” item.

  Also, the ring volume can be set in stages such as “small”, “medium”, and “large” as well as simple ON / OFF.

  As the normal ring tone information 28d, it is possible to set ON / OFF of the ring volume and ON / OFF of the vibrator.

  More specific examples of such ringing tone ringing conditions 28c and normal ringing tone information 28d will be described with reference to FIGS. 10A and 10B.

  First, as the normal ring tone information 28d, the ring volume is set to “2” and the vibrator is set to “OFF”.

  Although conditions 1 to 3 are set in the incoming call ringing condition 28c of the memory 28 shown in FIG. 10A, Condition 1 assumes an incoming call in a relatively quiet environment such as an indoor work or a meeting. ing. Therefore, in the condition 1, when the “voice volume” and the “background volume” are 2 or less, the ring tone is not sounded and only the vibrator is driven. On the other hand, Condition 2 assumes an incoming call in a relatively noisy environment such as when going out. Therefore, in the condition 2, when the “background volume” is 4 or more, the ringtone of the “ring volume” of 3 is sounded and the vibrator is driven. Based on these conditions, as shown in FIG. 10B, the ringing determination unit 27f is configured to perform Condition 1 when the voice volume is 2 or less and the background volume is 2 or less, Condition 2 when the background volume is 4 or more, and Condition When 1 and 2 are not satisfied, the normal ring tone information 28d is applied.

  Another specific example is shown in FIGS. 11A and 11B.

  First, as the normal ring tone information 28d, the ring volume is set to “2” and the vibrator is set to “OFF”.

  Although the conditions 1 to 3 are set in the incoming call ringing condition 28c of the memory 28 shown in FIG. . Accordingly, in the condition 1, when the “voice volume” is 2 or less and the “background volume” is 1 or less, the ring tone and the vibrator are not driven. Condition 2 assumes an incoming call on the train. Therefore, in condition 2, when the “background sound volume” is 4 or more and the approximate pattern is a train, the vibrator is driven without ringing the ringtone. Condition 3 assumes an environment where there is a voice in a quieter environment. Therefore, in condition 3, when “voice volume” is 4 or less and “background volume” is 2 or less, “ring volume” is set to 1 and the vibrator is set to ON so as not to disturb the conversation. Has been. Based on these conditions, as shown in FIG. 11B, the ringing determination unit 27f has an approximate pattern regardless of the condition 1 when the voice volume is 2 or less and the background volume is 1 or less, regardless of the voice volume and the background volume. In the case of a train, condition 2, when the voice volume is 4 or less and the background volume is 2 or less, condition 3 is applied, and when the conditions 1 to 3 are not satisfied, the normal ringing tone information 28d is applied.

  The ring determination unit 27f analyzes the surrounding space such as indoors or outdoors based on the sampling information, and detects the direction of the voice or background sound, such as whether it is a certain treasure or multi-way. Also good. As a result, for example, it is possible to automatically detect the presence in a predetermined place such as a movie theater or a theater, and to perform more detailed control of the incoming ringing operation such as automatically shifting to the manner mode.

  Further, the background sound pattern 28a may be arbitrarily sampled by the user so that the pattern can be added. Thereby, a more accurate incoming call ringing operation can be realized.

  INDUSTRIAL APPLICABILITY The present invention can be applied to various devices that notify a user of an incoming call or the arrival of time by sounding a sound or driving a vibrator, such as a telephone or an alarm.

It is a block diagram which shows the structure of the portable terminal device which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the communication system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows sampling operation. It is a figure which shows the data structure stored in the memory 28 relevant to a sampling operation. It is a figure for demonstrating sampling operation | movement. It is an example of the display apparatus 22 in the case of an incoming call ring condition setting operation. It is a figure which shows the data structure stored in the memory 28 relevant to an incoming ringing condition setting operation | movement. It is a flowchart which shows an incoming call ringing operation. It is a figure which shows the data structure stored in the memory 28 relevant to a ringing operation. It is a figure which shows an example of the data structure stored in the memory 28 relevant to an incoming call ringing operation. It is a figure which shows the voice of each condition in FIG. 10A, and the volume of a background. It is a figure which shows an example of the data structure stored in the memory 28 relevant to an incoming call ringing operation. It is a figure which shows the voice of each condition in FIG. 11A, and the volume of a background.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile terminal device, 2 ... Microphone part, 3a, 3b ... Notification part, 4 ... Detection part, 5 ... Selection part, 10 ... Base station, 20 ... Mobile terminal device, 21 ... Communication circuit, 22 ... Display apparatus, 23 ... input device, 24 ... vibrator, 25 ... microphone, 26 ... speaker, 27 ... control unit, 27a ... function processing unit, 27b ... sampling unit, 27c ... volume detection unit, 27d ... determination unit, 27e ... condition setting unit, 27f ... Response judgment unit 28... Memory 28 a. Background sound pattern 28 b. Sampling voice analysis information 28 c Ring alert condition 28 d Normal ring tone information 28 e Operation program 30 External device

Claims (5)

A microphone that detects ambient sounds;
A plurality of notification units that notify the user of predetermined information by different methods; and
A detection unit for detecting a volume of a human voice and a volume of a background sound from the sound detected by the microphone unit;
When a predetermined signal is input, a notification that notifies the predetermined information from the plurality of notification units based on the volume of the human voice and the volume of the background sound detected by the detection unit A portable terminal device comprising: a selection unit that selects a unit. The detection unit further detects the background sound pattern,
The notification unit is configured to notify the predetermined information from the plurality of notification units based on a volume of the human voice, a volume of the background sound, and a pattern of the background sound. A mobile terminal device characterized by selecting. For each of the notification units, a storage unit that stores in advance the volume of the human voice, the volume of the background sound, and the background sound pattern when the predetermined information is notified by the notification unit Prepared,
The selection unit selects the notification unit that notifies the predetermined information from the plurality of notification units by comparing the detection result of the sampling unit and the condition stored in the storage unit. The portable terminal device according to claim 2. The notification unit includes a speaker unit that outputs sound and a vibrator that generates vibration,
The portable terminal according to any one of claims 1 to 3, wherein the selection unit selects whether to output sound from the speaker unit and whether to vibrate the vibrator. apparatus. It further includes a communication unit that realizes a call with another device,
The said selection part selects the alerting | reporting part which alert | reports the said predetermined information from the said some alerting | reporting part, when an incoming call comes from the said other apparatus. The any one of Claim 1 thru | or 4 characterized by the above-mentioned. The mobile terminal device according to 1.

Images