JP6000587B2 - Terminal device and program - Google Patents

Description

The present invention relates to a terminal equipment your good beauty program.

  When a general mobile phone receives an incoming call, the user is notified of the incoming call by sound or vibration. When the user notices the notification, the user performs an operation for responding to the notification. The response operation when there is an incoming call is, for example, pressing a call key.

  By the way, when the user does not notice the incoming call and does not perform a response operation to the incoming call, the state where the user does not notice the incoming call may continue. Patent Document 1 (Japanese Patent Application Laid-Open No. 2008-227639) discloses a sensor for detecting whether a user carrying a mobile phone is in a walking state or in a stopped state. When the user is unaware of the incoming call and when it is detected that the sensor has changed from the walking state to the stopped state, the user is notified again of the incoming call or incoming mail. This is because the user is more likely to notice the re-notification when the user has changed from the walking state to the stopped state.

JP 2008-227639 A

  The technique described in Patent Document 1 has a problem that it is necessary to newly provide a sensor.

  The present invention has been made to solve such a problem, and an object in one aspect is to provide information to be recognized by a user such as an incoming call without providing a sensor or the like. To provide a terminal device, a notification method, and a program capable of re-notifying the information even when the user is not aware.

  A terminal device according to an aspect of the present invention includes a notification unit that notifies information to be recognized by a user, a response reception unit that receives a response operation for notification, a feature amount acquisition unit that acquires a feature amount of ambient sound of the terminal device, And a notification control unit that causes the notification unit to re-notify information based on the feature amount of the ambient sound when the response reception unit does not receive a response operation.

Preferably, the feature amount includes sound pressure.
Preferably, the notification control unit causes the notification unit to re-notify information when the sound pressure acquired by the feature amount acquisition unit is equal to or less than a predetermined threshold value.

  Preferably, the notification control unit causes the notification unit to re-notify information with a sound having a predetermined amount and a larger sound pressure than the sound pressure acquired by the feature amount acquisition unit.

Preferably, the feature amount includes a frequency.
Preferably, the notification control unit causes the notification unit to re-notify information when the frequency acquired by the feature amount acquisition unit changes by a predetermined amount or more.

  Preferably, it includes a first storage unit that stores a first table in which the frequency band and the frequency of the sound of re-notification are associated, and the notification control unit includes the frequency band to which the frequency acquired by the feature amount acquisition unit belongs The information is re-notified to the notification means with the sound of the corresponding frequency.

  Preferably, the notification control unit causes the notification unit to re-notify the information every predetermined time.

Preferably, the notification control unit gradually increases the strength and causes the notification unit to re-notify information.
Preferably, the notification control unit causes the notification unit to re-notify information in a mode different from the mode of the first notification.

Preferably, the information includes at least one of mail incoming and telephone incoming.
Preferably, the notification control unit causes the notification unit to re-notify information when a response operation from the user to at least one of an incoming mail and a telephone call from a predetermined transmission source is not accepted.

  Preferably, the information processing apparatus further includes a second storage unit that stores a second table in which a transmission source and a re-notification mode are associated with each other, and the notification control unit includes at least one of a mail incoming call and a telephone incoming call. Information is re-notified to the notification means in a corresponding re-notification mode.

  Preferably, the information processing device further includes position information acquisition means for acquiring position information indicating the position of the terminal device, and conversion means for converting the position information acquired by the position information acquisition means into a feature value. The feature amount converted by the means is acquired.

  Preferably, position information receiving means for receiving input of position information is further included. The position information acquisition unit acquires the position information received by the position information reception unit.

  According to another aspect of the present invention, there is provided a notification method using a terminal device, a step of notifying information to be recognized by a user, a step of receiving a response operation for the notification, and a feature amount of ambient sound of the terminal device. There is provided a notification method comprising: an acquiring step; and a step of causing the notification unit to re-notify information based on a feature amount of ambient sound when the response reception unit has not received a response operation.

  According to another aspect of the present invention, a program executed by a computer, the program notifying the computer of information to be recognized by the user, a step of accepting a response operation to the notification, and a surrounding sound of the terminal device There is provided a program for causing a computer to execute a step of acquiring a feature amount, and a step of causing a notification means to re-notify information based on a feature amount of ambient sound when a response operation is not accepted.

  In one aspect, the information can be re-notified without providing the walking sensor, even when the user is not aware of the information that the user recognizes, such as an incoming call.

  The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the present invention taken in conjunction with the accompanying drawings.

It is the figure which showed the hardware structural example of the terminal device of Embodiment 1. FIG. It is the figure which showed the function structural example of the principal part of the terminal device of Embodiment 1. FIG. It is the figure which showed the processing flow of the terminal device of Embodiment 1. FIG. It is the figure which showed the function structural example which further detailed the notification control part of Embodiment 1. FIG. FIG. 5 is a diagram illustrating a more detailed processing flow of the first embodiment. FIG. 5 is a diagram illustrating a concept of processing according to the first embodiment. It is the figure which showed the function structural example of the terminal device of Embodiment 2. FIG. It is the figure which showed the processing flow of the terminal device of Embodiment 2. FIG. It is the figure which showed the function structural example of the terminal device of Embodiment 3. FIG. It is the figure which showed the processing flow of the terminal device of Embodiment 3. It is the figure which showed an example of the graph of the frequency which the 3rd judgment part plotted. It is the figure which showed the function structural example of the terminal device of Embodiment 4. FIG. It is the figure which showed the processing flow of Embodiment 4 terminal device. It is the figure which showed an example of the 1st table. It is the figure which showed the 1st table at the time of setting a frequency band to two. It is the figure which showed the function structural example of the terminal device of Embodiment 5. FIG. It is the figure which showed the processing flow of the terminal device 100 of Embodiment 5. FIG. It is the figure which showed an example of the aspect table of the aspect of notification, and the aspect of re-notification. It is the figure which showed the aspect table of another embodiment of Embodiment 6. FIG. It is the figure which showed the aspect table of another embodiment of Embodiment 6. FIG. It is the figure which showed the processing flow of the terminal device of Embodiment 7. It is the figure which showed an example of the transmission source identification information table. FIG. 10 is a diagram illustrating a functional configuration example of a terminal device according to an eighth embodiment. FIG. 10 is a diagram illustrating a processing flow of a terminal device according to an eighth embodiment. It is the figure which showed an example of the 2nd table. It is the figure which showed the function structural example of the terminal device of Embodiment 9. FIG. It is the figure which showed the processing flow of the terminal device of Embodiment 9. It is the figure which showed an example of the positional information table which matched positional information and sound pressure. It is the figure which showed the function structural example of the terminal device of Embodiment 10. FIG. It is the figure which showed the input screen for a user to input positional information.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. The terminal device is, for example, a mobile phone, a smartphone, a tablet, or a notebook PC (Personal Computer). The terminal device may be a size that can be carried by the user, or may be a stationary size.

[Embodiment 1]
<Hardware configuration>
First, the hardware configuration of the terminal device of this embodiment will be described. FIG. 1 is a hardware configuration example of the terminal device 100 according to the first embodiment. The terminal device 100 includes an antenna unit 108, a communication unit 102, a CPU 110, an operation I / F unit 120, a camera 140, a flash memory 144 (storage unit 144), a RAM (Random Access Memory) 146, a display 150, VRAM (Video RAM) 147, ROM (Read Only Memory) 148, audio signal processor 170, microphone (sound collector) 172, speaker 174, LED (Light Emitting Diode) 176, network A communication I / F unit (Interface) 178, a memory card driving unit 180, a vibrator 184, a clock 186, and a timer 187 are included.

  The antenna unit 108 receives a signal transmitted from another communication device 200. The signal is subjected to reception processing by the communication unit 102, and the processed signal is transmitted to the CPU 110. The signal includes a telephone call signal, a call sound signal, a mail incoming signal, a mail content signal, and the like.

  The incoming call signal is a signal indicating that an incoming call has been received. The call sound signal is a signal in which a call sound generated by a telephone is encoded. The incoming mail signal is a signal indicating that an incoming mail has been received. The mail content signal is a signal indicating the content of the mail (for example, text data or image data). Further, the mail includes SMS (Short Message Service).

  CPU 110 transmits a call sound signal from the other party to voice signal processing section 170. The audio signal processing unit 170 executes preset signal processing on the call sound signal, and transmits the processed call sound signal to the speaker 174. The speaker 174 outputs sound based on the call sound signal.

  The microphone 172 receives the user's utterance to the terminal device 100 and transmits a signal corresponding to the utterance to the audio signal processing unit 170. The audio signal processing unit 170 performs signal processing specified in advance based on the signal and transmits the signal processing to the CPU 110. CPU 110 converts the signal into a signal for transmission and transmits the signal to communication unit 102. The communication unit 102 transmits the signal to the other communication device 200 via the antenna unit 108. Thereby, the user of the terminal device 100 can talk with another party.

  In addition, the microphone 172 collects sounds around the device (terminal device 100) (hereinafter referred to as “ambient sound”).

  The operation I / F unit 120 receives an input of a command to the terminal device 100 from the user. The operation I / F unit 120 includes, for example, a hard key type, a dial type, a touch panel type, and the like.

  The camera 140 executes a photographing operation based on an operation on the operation I / F unit 120, and sends an image signal acquired by the operation to the CPU 110. The camera 140 is realized by, for example, a complementary metal-oxide semiconductor (CMOS) element, a charge coupled device (CCD) element, or another imaging element.

  The flash memory 144 stores data transmitted from the CPU 110. The CPU 110 can read data stored in the flash memory 144 and execute a predetermined process using the data.

  The RAM 146 temporarily holds data generated by the CPU 110. The ROM 148 stores data or a program for causing the terminal device 100 to execute a predetermined operation. The CPU 110 reads the data or program from the ROM 148 and executes the processing.

  The memory card driving unit 180 accepts attachment of the memory card 182. The memory card driving unit 180 reads data stored in the memory card 182 and transmits it to the CPU 110. Further, the memory card driving unit 180 stores the data output by the CPU 110 in the storage area of the memory card 182.

  As described above, the audio signal processing unit 170 executes processing for generating a signal used for a call. In another aspect, the CPU 110 and the audio signal processing unit 170 may be integrated.

  The display 150 displays an image defined by the data based on the data output from the CPU 110. More specifically, the CPU 110 writes display data in the VRAM 147. A driver (not shown) of the display 150 reads data stored in the VRAM 147 and executes a drawing process on the display 150.

  Further, if the display 150 is a touch panel type, the display 150 and the operation I / F unit 120 are integrated.

  The LED 176 performs a predetermined light emission operation based on a signal from the CPU 110. For example, when the LED 176 can display a plurality of colors, the LED 176 emits light in a color associated with the data based on data included in a signal output from the CPU 110.

  Network I / F unit 178 is connected to an external network (not shown). Vibrator 184 performs a vibration operation at a predetermined frequency and pattern based on a signal output from CPU 110.

  The clock 186 gives a time for defining the execution of the instruction by the CPU 110. The clock 186 may be included in the CPU 110. In addition, the timer 187 acquires time.

  1 is the same as the hardware configuration example of the embodiment described below.

  FIG. 2 is a diagram illustrating a functional configuration example of a main part of the terminal device 100 illustrated in FIG. 1. In the example of FIG. 2, the communication unit 102, the storage unit 144, the incoming call data generation unit 1102, the incoming mail data generation unit 1106, the notification unit 1120, the speaker 174, the vibrator 184, the LED 176, and the display 150. An operation I / F unit 120, a first determination unit 1116, a microphone 172, a feature amount acquisition unit 1114, and a notification control unit 1117.

  The communication unit 102 includes a telephone call incoming unit 1022 and a mail incoming call unit 1024. The notification unit 1120 includes an incoming call notification unit 1104, an incoming mail notification unit 1110, and a schedule notification unit 1112.

  Storage unit 144 includes mail storage unit 1462, incoming call data storage unit 1464, incoming mail data storage unit 1466, and schedule data storage unit 1468.

  CPU 110 includes an incoming call data generation unit 1102, an incoming mail data generation unit 1106, a notification unit 1120, a first determination unit 1116, a feature amount acquisition unit 1114, and a notification control unit 1117.

  The telephone receiving unit 1022 accepts an incoming call from another communication device 200 (see FIG. 1) to the terminal device 100 via the antenna unit 108 (see FIG. 1). The incoming call data generation unit 1102 stores the received data related to incoming calls in the incoming call data storage unit 1464 as incoming call data. The incoming call data includes, but is not limited to, data such as the telephone number of the caller, the name of the caller, and the date and time of incoming call.

  When the incoming call is received by the incoming call unit 1022, the incoming call notification unit 1104 notifies the user of the incoming call. The incoming call notification unit 1104 notifies the user of an incoming call by a mode (method) such as sound notification, vibration notification (vibration notification), screen display notification, or LED notification.

  The incoming call notification unit 1104 performs sound notification by outputting sound (for example, a melody) from the speaker 174. In addition, the incoming call notification unit 1104 performs vibration notification by operating the vibrator 184. Further, the incoming call notification unit 1104 displays a screen display notification by displaying on the display 150 that there has been an incoming call. When the incoming call notification unit 1104 notifies that there is an incoming call by a screen display notification, the display 150 displays, for example, the telephone number of the transmission source, the name, the incoming date and time of the call. As described above, the telephone number of the transmission source, the name, the incoming date and time of the telephone, and the like are stored in the telephone incoming data storage unit 1464. In addition, the incoming call notification unit 1104 performs LED notification by turning on (or flashing) the LED 176.

  Further, the incoming call notification unit 1104 may perform notification according to other modes. In addition, the incoming call notification unit 1104 may perform notification by combining at least two of these modes. The same applies to the notification modes of the incoming mail notification unit 1110 and the schedule notification unit 1112 described later.

  The mail receiving unit 1024 receives an incoming email (mail incoming) to the terminal device 100. The incoming mail data generation unit 1106 generates data related to the received incoming electronic mail as incoming mail data and stores it in the incoming mail data storage unit 1466. The incoming mail data includes, for example, data such as an electronic mail address of the electronic mail sender, a name of the electronic mail sender, an incoming date and time of the electronic mail, but is not limited thereto.

  In addition, the mail receiving unit 1024 stores the email received by the mail receiving unit 1024 in the mail storage unit 1462.

  The incoming mail notification unit 1110 notifies that there is an incoming mail in the above-described four modes or other modes. When the mail incoming notification unit 1110 notifies the user with a screen display notification, the display 150 displays, for example, the name of the transmission source, the incoming date and time of the electronic mail, and the like. As described above, the sender's name and the e-mail are stored in the incoming mail data storage unit 1466.

  The schedule data storage unit 1468 stores schedule data indicating the user's schedule. The schedule is input from the operation I / F unit 120 by the user. The schedule notification unit 1112 notifies the user of the schedule based on the schedule data stored in the schedule data storage unit 1468.

  For example, when schedule data “Meeting starts at 10:00 AM” is stored in the schedule data storage unit 1468, when the timer 187 (see FIG. 1) measures AM 10:00, the schedule notification unit 1112 The schedule is notified by the above-described four modes. In a case where the schedule notification unit 1112 performs a screen display notification, the schedule 150 is displayed on the display 150.

  Incoming telephone calls, incoming mails, user schedules, and the like are information to be recognized by the user, and are hereinafter referred to as “user recognition information”. The user recognition information may be information other than incoming phone calls, incoming emails, and user schedules.

FIG. 3 is a processing flow of the terminal device 100 according to the first embodiment. 2 will be described with reference to FIG.
In step S2, CPU 110 determines whether there is user recognition information. CPU 110 stands by until it is determined that there is user recognition information (NO in step S2).

  When CPU 110 determines that there is user recognition information (YES in step S2), the process proceeds to step S4. In step S4, the notification unit 1120 notifies the user of user recognition information. The notification unit 1120 notifies the user recognition information in the above-described four notification modes.

  In step S <b> 6, the first determination unit 1116 determines whether or not the user's response operation for the notification of the user recognition information has been accepted.

  Here, the user's response operation will be described. The user's response operation when the user identification information is an incoming call means that the user performs an operation such as pressing a call button (telephone response button) in order to make a call with the other party. In addition, the user's response operation also includes that the user did not notice when the incoming call was notified, but recognized that there was an incoming call after an arbitrary time and performed a predetermined operation. The predetermined operation is performed from the response reception unit 1202 by the user, for example, operating any one of a plurality of keys of the operation I / F unit 120. The operation I / F unit 120 includes a response reception unit 1202.

  Moreover, the response reception part 1202 may be the microphone 172, and a voice may be input from the user. When the user inputs voice to the response receiving unit 1202, the response receiving unit 1202 may receive a response operation.

  In addition, when the user identification information is an incoming mail, the user's response operation is a predetermined operation for viewing the transmitted mail. The predetermined operation is performed from the response reception unit 1202 by the user, for example, operating a mail browsing button.

  When the user recognition information is a user's schedule, the user's response operation is to perform a predetermined operation for recognizing the notified schedule. The predetermined operation is performed by the user from the response reception unit 1202, for example, operating a schedule browsing button.

  When the first determination unit 1116 determines that a response to the notification of the user recognition information has been received from the response reception unit 1202 (YES in step S6), the user has recognized the user recognition information (for example, noticed the incoming call) The process ends.

  On the other hand, when first determination unit 1116 determines that a response to the notification of the user recognition information is not received from response reception unit 1202 (NO in step S6), the process proceeds to step S7.

  In step S <b> 7, the feature amount acquisition unit 1114 acquires feature information of ambient sounds of the terminal device 100 (self device) collected by the microphone 172. In step S12, the notification control unit 1117 causes the notification unit 1120 to re-notify the user recognition information based on the acquired ambient sound feature information.

  Although there are various types of feature information of ambient sounds, in the first embodiment, the feature information is sound pressure (the unit is Pascal Pa or decibel dB).

  FIG. 4 is a block diagram illustrating a notification control unit 1117-1 that further details the notification control unit 1117 of the first embodiment. FIG. 5 is a flowchart showing step S7-1 in which step S7 is further detailed.

  As illustrated in FIG. 4, the notification control unit 1117-1 includes a second determination unit 1118. Also, as shown in FIG. 5, step S7-1 includes steps S8 and S10. In step S8, the feature amount acquisition unit 1114 acquires the sound pressure of the ambient sound. In step S10, the second determination unit 1118 determines whether or not the sound pressure of the ambient sound is equal to or less than a predetermined first threshold value Th.

  Here, the first threshold value Th may be settable by the user, or may be set as a default of the terminal device 100. The first threshold value Th is stored in the storage unit 144.

  When the second determination unit 1118 determines that the sound pressure of the ambient sound is equal to or lower than the first threshold value (YES in step S10), the ambient sound is small (that is, the environment of the terminal device 100 is quiet). ) And the process proceeds to step S12.

  In step S12, the notification control unit 1117-1 causes the notification unit 1120 to notify the user recognition information again. As the re-notification mode, at least one of the above-described four notification modes may be used. Moreover, about the preferable aspect of re-notification, sound notification or vibration notification is preferable. More preferably, sound notification is preferable. This is because the ambient sound of the terminal device 100 is small, so that the user can easily notice the re-notification by using the sound notification.

  When the re-notification process in step S12 ends, the process returns to step S6. In step S <b> 6, the first determination unit 1116 determines whether response processing for re-notification is being performed. Since the subsequent processing is as described above, description thereof will not be repeated.

  On the other hand, if the second determination unit 1118 determines in step S10 that the sound pressure of the ambient sound is greater than the first threshold value (NO in step S10), the process returns to step S6 without performing re-notification. . The reason for not performing the re-notification is that the sound pressure of the ambient sound is larger than the first threshold value, so that the environment of the terminal device 100 is noisy, and the user is difficult to notice.

  That is, the notification control unit 1117-1 repeats the re-notification until the user performs a response operation for the re-notification. Further, the notification may be the first notification, and the re-notification may be the second and subsequent notifications.

  In step S12, the notification control unit 1117-1 may gradually increase the strength of re-notification as time elapses. Further explanation will be given on “increasing the strength of re-notification”. When the notification mode is sound notification, the notification control unit 1117-1 gradually increases the sound pressure of the sound. When the notification mode is vibration notification, the notification control unit 1117-1 gradually increases the vibration intensity. When the notification mode is LED notification, the notification control unit 1117-1 gradually increases the light quantity of the LED 176. When the notification mode is a screen display notification, the notification control unit 1117-1 gradually increases the size of the screen display.

  Further, the notification control unit 1117-1 may increase the strength of re-notification as the number of re-notifications increases. For example, the notification control unit 1117-1 makes the sound pressure of the second re-notification sound larger than the sound pressure of the first re-notification sound.

  Moreover, the sound pressure measurement start timing of the ambient sound in step S8 may be the time when the user recognition information in step S4 is notified. Moreover, the sound pressure measurement start timing of the ambient sound in step S8 may be a time when a predetermined time has elapsed since the user recognition information was notified in step S4.

  FIG. 6 is a conceptual diagram showing a processing flow of the first embodiment. (1) When the terminal device 100 notifies the user recognition information and (2) when the user does not notice, (3) the terminal device 100 measures the sound pressure of the ambient sound. (4) When the measured sound pressure is equal to or lower than the first threshold (that is, when the periphery of the terminal device 100 is quiet), (5) the terminal device 100 re-notifies the user recognition information. I do. (6) If the user does not notice, the terminal device 100 (3) measures the sound pressure of the ambient sound and repeats the process.

  On the other hand, (7) when the sound pressure of the ambient sound is greater than the first threshold, the terminal device 100 measures the sound pressure of (3) without performing re-notification.

  According to the terminal device of the first embodiment, when the sound pressure of the ambient sound is equal to or lower than the first threshold value (that is, when the environment of the terminal device 100 is quiet), the notification control unit 1117-1 notifies The unit 1120 is notified of the user recognition information again. Therefore, the user recognition information can be re-notified to the user without providing the pedometer sensor in the terminal device, and the user recognition information can be easily noticed by the user.

  Further, the notification control unit 1117-1 repeats the re-notification process until a response operation is performed by the user. Therefore, the user can surely easily notice the re-notification.

  In addition, when the sound pressure of the ambient sound is larger than the first threshold value (that is, when the environment of the terminal device 100 is noisy), the notification control unit 1117-1 does not notice the re-notification. Do not do. Therefore, the processing cost for re-notification can be reduced.

  Further, when the user recognition information is an incoming call or an incoming mail, the user notices the re-notified user identification information, and the user of the terminal device of the transmission source (the user who sent the mail or the user who made the call) In return, contact can be made. Therefore, it is not necessary for the user of the transmission source terminal device to repeat outgoing calls.

[Embodiment 2]
Next, Embodiment 2 will be described. In the second embodiment, the notification unit 1120 performs sound notification by outputting sound from the speaker 174. In addition, the feature amount is a sound pressure. Then, the acquisition unit acquires the sound pressure of the ambient sound, and the notification control unit causes the notification unit to re-notify with a predetermined amount larger than the sound pressure. Thereby, for example, when the user is in a quiet place (for example, a library), notification can be made again with a small notification sound, and other people in the library can be prevented from being disturbed. In addition, when the user is in a noisy place, the user can be notified again with a loud notification sound, so that the user can easily notice the notification.

  FIG. 7 is a diagram illustrating a functional configuration example of the terminal device 100-2 according to the second embodiment. FIG. 8 is a diagram illustrating a processing flow of the terminal device 100-2. FIG. 7 differs from FIG. 2 in that the notification control unit 1117 is replaced with a notification control unit 1117-2. 8 differs from FIG. 3 in that step S7 is replaced with step S7-2.

  The notification control unit 1117-2 according to the second embodiment includes a sound pressure setting unit 1124. Step S7-2 includes Step S8 and Step S14.

  If the first determination unit 1116 determines NO in step S6, the feature amount acquisition unit 1114 acquires the sound pressure of the ambient sound in step S8. In step S14, the sound pressure setting unit 1124 sets a sound pressure (= P + ΔP) obtained by adding a predetermined amount ΔP to the sound pressure P acquired by the feature amount acquisition unit 1114. Then, in step S12, the notification control unit 1117-2 causes the notification unit 1120 to re-notify with the set sound pressure P + ΔP. About ΔP, the user may be able to freely set, or a default value may be used.

  According to the second embodiment, the feature amount acquisition unit 1114 acquires the sound pressure P of the ambient sound, and the notification control unit 1117-2 has a sound pressure P + ΔP that is larger than the sound pressure by a predetermined amount ΔP. Then, the notification unit 1120 is notified again. Thereby, for example, when the user is in a quiet place (for example, a library), notification can be made again with a small notification sound, and other people in the library can be prevented from being disturbed. In addition, when the user is in a noisy place, the user can be notified again with a loud notification sound, so that the user can easily notice the notification.

[Embodiment 3]
Next, Embodiment 3 will be described. In general, when the user's environment changes greatly, the main frequency (hereinafter simply referred to as “frequency”) of the ambient sound of the terminal device held by the user changes greatly, and thus it is easy to notice notification of user recognition information. . As a specific example, if the user moves from inside a train (location where ambient sounds are high frequency) to outside the train (location where ambient sounds are low frequency), the user will be notified because the environment changes significantly. Easy to notice. In the third embodiment, re-notification is performed when the frequency of the ambient sound of the terminal device changes greatly.

  The notification unit 1120 according to the third embodiment performs sound notification by outputting sound from the speaker 174. The feature amount of the ambient sound is set as the frequency of the ambient sound. The feature amount acquisition unit 1114 acquires the frequency of the ambient sound by measuring the frequency of the ambient sound.

  FIG. 9 is a diagram illustrating a functional configuration example of the terminal device 100-3 according to the third embodiment. FIG. 10 is a diagram illustrating a processing flow of the terminal device 100-3. FIG. 9 is different from FIG. 2 in that the notification control unit 1117 is replaced with a notification control unit 1117-3. FIG. 10 differs from FIG. 3 in that step S7 is replaced with step S7-3.

  The notification control unit 1117-3 of the third embodiment includes a third determination unit 1128. Step S7-3 includes Step S20 and Step S22.

  If NO is determined in step S6, in step S20, the feature amount acquisition unit 1114 acquires the frequency by measuring the frequency of the ambient sound. In step S22, the third determination unit 1128 determines whether the frequency of the ambient sound has changed by a predetermined amount Δf or more. If YES is determined in step S22, the notification control unit 1117-3 causes the notification unit 1120 to notify the sound in step S12. On the other hand, if NO is determined in step S22, the process returns to step S6.

  The feature amount acquisition unit 1114 measures the frequency every short time (for example, 10 msec). Then, the third determination unit 1128 plots the frequency value measured by the feature amount acquisition unit 1114 as needed. Then, the third determination unit 1128 determines that the frequency has changed by a predetermined amount Δf when the amount of change in the plotted frequency value is equal to or greater than a predetermined amount Δf.

FIG. 11 is an example of a frequency graph plotted by the third determination unit 1128. In FIG. 11, the horizontal axis is the time axis and the vertical axis is the frequency. In the example of FIG. 11, the frequency value measured by the feature amount acquisition unit 1114 at time t ₁ is f ₁ . Also, the value of the frequency measured by the feature amount acquisition unit 1114 at time t ₂ is set as f ₂ . In this case, when the third determination unit 1128 determines that | f ₂ −f ₁ | ≧ Δf, the third determination unit 1128 has changed the frequency of the ambient sound by a predetermined amount Δf or more. Judge.

  According to the third embodiment, when the feature amount acquisition unit 1114 acquires the frequency f of the ambient sound and it is determined that the frequency f has changed by a predetermined amount Δf or more, the notification control unit 1117-3 The notification unit 1120 is notified again. Thereby, when a user's environment changes, user recognition information can be notified again.

[Embodiment 4]
Next, Embodiment 4 will be described. In the fourth embodiment, the notification unit 1120 performs sound notification by outputting sound from the speaker 174. In the fourth embodiment, notification is performed again with a sound having a frequency corresponding to the frequency acquired by the feature amount acquisition unit 1114. For example, if the frequency acquired by the feature amount acquisition unit 1114 is higher than the reference value, the notification control unit causes the notification unit to re-notify with a low-frequency sound. If the frequency acquired by the feature amount acquisition unit 1114 is lower than the reference value, the notification control unit re-notifies the notification unit with a high-frequency sound. Therefore, by outputting a sound having a frequency different from the frequency of the ambient sound, the user can easily notice the re-notification.

  FIG. 12 is a diagram illustrating a functional configuration example of the terminal device 100-4 according to the fourth embodiment. FIG. 13 is a diagram illustrating a processing flow of the terminal device 100-4. Compared with FIG. 2 in FIG. 12, the notification control unit 1117 is replaced with a notification control unit 1117-4, and a first storage unit 1130 is further added. The first storage unit 1130 is included in the storage unit 144.

  The notification control unit 1117-4 of the fourth embodiment includes a frequency setting unit 1126. FIG. 13 differs from FIG. 3 in that step S7 is replaced with step S7-4. Step S7-4 includes step S20 and step S24. The first storage unit 1130 stores a first table.

FIG. 14 is an example of the first table. In the example of FIG. 14, the frequency band and the set frequency set by the frequency setting unit 1126 are associated with each other. In the example of FIG. 14, a frequency band F _AB where the frequency f _A ≦ F _AB <f _B is associated with the set frequency f ₁ . Further, a frequency band F _BC satisfying the frequency f _B ≦ F _BC ≦ f _C is associated with the set frequency f ₂ . Here, f _A <f _B <f _C ... And f ₁ > f ₂ . In the example of FIG. 13, only the frequency band F _AB and the frequency band F _CD are described, and other frequency bands are not illustrated, but other frequency bands may be determined.

  That is, as the frequency acquired by the feature amount acquisition unit 1114 is higher, the frequency setting unit 1126 sets a frequency lower than the reference value. On the other hand, as the frequency acquired by the feature amount acquisition unit 1114 is lower, the frequency setting unit 1126 sets a higher frequency than the reference value.

  If NO is determined in step S6, in step S20, the feature amount acquisition unit 1114 acquires the frequency by measuring the frequency of the ambient sound. In step S24, the frequency setting unit 1126 refers to the first table and sets a frequency corresponding to the frequency band to which the acquired frequency belongs.

For example, when the frequency acquired by the feature amount acquisition unit 1114 is f _μ and f _A <f _μ <f _B , the frequency f _μ belongs to the frequency band F _AB . Therefore, the frequency setting unit 1126 sets the frequency f ₁ corresponding to the frequency band F _AB . Then, the notification control unit 1117-4 is a sound of a frequency _{f 1,} and re-notify the notification unit 1120.

In order to simplify processing, it is preferable to set two frequency bands. FIG. 15 is a first table when two frequency bands are set. In the example of FIG. 15, if the frequency f acquired by the feature amount acquisition unit 1114 is less than f _B (f <f _B ), the frequency setting unit 1126 sets as the frequency f ₁ . If the frequency f acquired by the feature amount acquisition unit 1114 is equal to or higher than f _B (f ≧ f _B ), the frequency setting unit 1126 sets the frequency f ₂ . Further, as described above, f ₁ > f ₂ .

  According to the fourth embodiment, the feature amount acquisition unit 1114 acquires the frequency f of the ambient sound, and the frequency setting unit 1126 sets it as a frequency corresponding to the frequency band to which the acquired frequency f belongs. The notification control unit 1117-4 causes the notification unit 1120 to notify the sound with the set frequency. Therefore, the user can easily notice the re-notification.

[Embodiment 5]
Next, Embodiment 5 will be described. The notification control unit according to the fifth embodiment causes the notification unit to perform re-notification at predetermined time intervals. Preferably, the notification control unit causes a re-notification to be performed when a predetermined time has elapsed since the most recent notification or the most recent re-notification (second and subsequent notifications). Accordingly, the notification control unit can reduce the burden of re-notification on the user by performing re-notification at regular intervals.

  FIG. 16 is a diagram illustrating a functional configuration example of the terminal device 100-5 according to the fifth embodiment. FIG. 17 is a diagram illustrating a processing flow of the terminal device 100-5. FIG. 16 is different from FIG. 2 in that the notification control unit 1117 is replaced with the notification control unit 1117-5 and a timer 187 is added. The notification control unit 1117-5 according to the fifth embodiment receives time information from the timer 187. Further, FIG. 17 is different from FIG. 3 in that S30 is added between steps S7 and S12, step S4 is replaced with step S104, and step S12 is replaced with step S112. Different.

Notification control unit 1117-5, for each predetermined time _{t s} has elapsed, and re-notify the notification unit 1120. Predetermined time (hereinafter,. As "predetermined time") t _s may be user configurable, may be determined by default.

In the example of FIG. 17, after determining YES in step S <b> 2, in step S <b> 104, the notification unit 1120 notifies the user recognition information, and the timer 187 starts measuring time. Finished processing NO → step S7 in the step S6, in step S30, the notification control unit 1117-5, at the time the time measurement starts the last notice (i.e., when the processing in step S104) whether the predetermined time _{t s} has elapsed from It is determined whether or not (whether or not a trigger signal has been received).

Notification control unit 1117-5, a predetermined time has passed _{t s} from the previous notification, and it is determined, at step S112, the notification control unit 1117-5 together with re notifies the notification unit 1120, a timer 187 for measuring time To start. The timer 187 resets the time measured in the past.

Thereafter, the process returns to step S6. When the process of NO → step S7 is completed in step S6, the process proceeds to step S30 again. In step S30, the notification control unit 1117-5 is at the time measurement start of the most recent re-notification (i.e., when the processing in step S112) whether or not a predetermined time t _s has elapsed from (whether or not it has received a trigger signal) Judging.

Furthermore, notification control unit 1117-5, not the predetermined time _{t s} has elapsed since the previous notification, and if it is determined, is not shifted in step S112, the process returns to step S6.

Thus, the notification control unit 1117-5 until the user responds to the re-notification, for each predetermined time _{t s,} repeated re-notification of the notification unit 1120. In the example of FIG. 17, the timing at which the timer 187 starts time measurement is when the user recognition information is notified (step S104) and when the user recognition information is re-notified (second and subsequent notifications) (step S112). ). That is, the notification control unit 1117-5 causes re-notification when a predetermined time has elapsed from the previous notification or the previous re-notification (second and subsequent notifications). Further, the start timing of time measurement by the timer 187 is not limited to these.

  According to the fifth embodiment, the notification control unit 1117-5 causes the notification unit 1120 to re-notify every predetermined time. Therefore, the burden of re-notification to the user can be reduced.

[Embodiment 6]
Next, Embodiment 6 will be described. In the sixth embodiment, the notification control unit 1117 causes the notification unit 1120 to re-notify the user recognition information by changing the notification mode. For example, the developer or user of the mobile terminal stores the notification mode and the re-notification mode in the storage unit 144 (see FIG. 1). In the terminal device 100-6 of the sixth embodiment, the functional configuration example is the same as that in FIG. 2, and the processing flow is the same as that in FIG.

  FIG. 18 is an example of a mode table of the first notification mode and the re-notification mode. In the example of FIG. 18, the first notification mode is “vibration notification”, and the re-notification mode is “sound notification”. Thus, the mode of the first notification is different from the mode of the re-notification, so that the user can easily notice the re-notification.

  In the case where the aspect table is FIG. 18, in step S4, the notification unit 1120 notifies the user recognition information by a vibration notification. In addition, the notification control unit 1117 causes the notification unit 1120 to re-notify the user recognition information by sound notification.

  FIG. 19 is an aspect table of another embodiment of the sixth embodiment. As shown in FIG. 19, the first notification, the first re-notification, the second re-notification, and the third and subsequent re-notification modes may be different. In the example of FIG. 19, the notification mode may be increased as the first notification, the first re-notification, the second re-notification, and the third and subsequent re-notifications. Thereby, as the number of re-notifications increases, the user becomes more aware of the re-notification.

FIG. 20 is an aspect table according to another embodiment of the sixth embodiment. In the example of FIG. 20, the notification mode is sound notification, and melody M ₁ is set as the _first notification sound, and melody M ₂ is set as the re-notification sound. Thus, by making the first notification sound melody different from the melody of the re-notification sound, the user can easily notice the re-notification.

  Moreover, the aspect table shown in FIGS. 18-20 is an example, and you may make it use another aspect table. Moreover, it is preferable that the mode table can be set freely by the user. The user setting is performed from the operation I / F unit 120. In addition, the mode tables illustrated in FIGS. 18 to 20 are stored in the storage unit 144.

  According to the sixth embodiment, the first notification mode and the re-notification mode can be made different. Therefore, it is possible to make the user easily notice the re-notification.

[Embodiment 7]
Next, Embodiment 7 will be described. In the seventh embodiment, it is assumed that the user identification information is at least one of an incoming call and an incoming mail. In the description of the seventh embodiment, it is assumed that the user identification information is an incoming call, but the user identification information may be an incoming mail. The terminal device 100-7 of Embodiment 7 is the same as that of FIG.

  The notification control unit according to the seventh embodiment performs re-notification when a response operation for an incoming call from a predetermined transmission source (terminal device) is not accepted. If re-notification is performed for incoming calls from all transmission sources, a burden of re-notification is imposed on the user. That is, re-notification can be performed for incoming calls from sources that are important to the user (for example, business partners), and re-notification can be prevented for incoming calls from sources that are not important to the user.

  FIG. 21 is a processing flow of the terminal device according to the seventh embodiment. FIG. 21 differs from FIG. 3 in that step S46 is added between step S6 and step S7. In addition, the user recognition information in steps S2 and S4 is set to incoming mail or telephone incoming call, so that steps S42 and S44 are performed.

FIG. 22 is an example of a transmission source identification information table used in the seventh embodiment. The transmission source identification information table is stored in the storage unit 144. In the transmission source identification information table, transmission source identification information and a re-notification flag are associated with each other. The transmission source identification information is information for identifying the transmission source terminal device, and is, for example, the telephone number, mail address, IP address, or MAC address of the transmission source terminal device. In addition, terminal devices whose transmission source identification information is α, β, and γ are 100 _α , 100 _β , and 100 _γ , respectively. The transmission source identification information table is stored in the storage unit 144.

  In the example of FIG. 22, the re-notification flag is “1” for the transmission source identification information α. For the transmission source identification information β, the re-notification flag is “0”.

  If NO in steps S42, S44, and S6, in step S46, the notification control unit 1117 extracts terminal device identification information from the incoming call data storage unit 1464 for the incoming call in step S42. The notification control unit 1117 refers to the transmission source identification information table and acquires a re-notification flag corresponding to the extracted terminal device identification information.

If the re-notification flag acquired by the notification control unit 1117 is “1”, the notification control unit 1117 determines that the incoming call is from a predetermined transmission source, and YES is determined in step S46. In the example of FIG. 22, if the incoming call is from the terminal device 100 _α or 100 _γ , the notification control unit 1117 determines YES. If YES is determined in the step S46, the process proceeds to a step S7.

On the other hand, when the re-notification flag acquired by the notification control unit 1117 is “0”, the notification control unit 1117 determines that the call is not received from a predetermined transmission source, and NO is determined in step S46. In the example of FIG. 22, when the incoming call is from the terminal device 100 _β , the notification control unit 1117 determines NO. If NO is determined in step S46, the process proceeds to step S6.

  The transmission source identification information table can be freely set by the user. For example, the user sets the re-notification flag to “1” for the transmission source (for example, the business partner of the user or the terminal device of the manager) to be notified again. Further, the user sets the re-notification flag to “0” for the transmission source that should not be re-notified.

  In addition, when the terminal device has an electronic phone book, the re-notification flag is set to “1” for the sender registered in the phone book and registered in the phone book. For a transmission source that has not been set, the re-notification flag may be set to “0”.

  According to the seventh embodiment, when there is an incoming call from a predetermined transmission source and no response operation is performed, the terminal device performs re-notification. Furthermore, when there is an incoming call from a transmission source other than the predetermined transmission source, the terminal device does not perform re-notification even when a response operation is not performed. Therefore, the terminal device according to the present embodiment can perform re-notification for incoming calls or incoming mails from only important transmission sources for the user, and can reduce the burden of re-notification for the user.

[Embodiment 8]
Next, an eighth embodiment will be described. In the eighth embodiment, it is assumed that the user recognition information is at least one of an incoming call and an incoming mail. In the description of the eighth embodiment, it is assumed that the user identification information is an incoming call, but the present invention can be applied even if the user identification information is an incoming mail.

  In the eighth embodiment, a second table in which a transmission source is associated with a re-notification mode is used. Then, re-notification is performed in the form of re-notification corresponding to the transmission source of the telephone call. Thereby, the user can specify the transmission source only by recognizing the mode of re-notification.

  FIG. 23 is a functional configuration example of the terminal device 100-8 according to the eighth embodiment, and FIG. 24 is a processing flow of the terminal device 100-8. FIG. 25 is an example of the second table. FIG. 23 is different from FIG. 2 in that the notification control unit 1117 is replaced with a notification control unit 1117-8 and a second storage unit 1132 is added. Further, in FIG. 24, step S48 is added between step S7 and step S12 as compared to FIG. The second table is stored in the second storage unit 1132. In addition, the user recognition information in steps S2 and S4 is set to incoming mail or telephone incoming call, so that steps S42 and S44 are performed.

In the example of FIG. 25, the transmission source identification information and the re-notification mode are associated with each other. In the example of FIG. 25, the transmission source identification information α and the vibration notification are associated with each other. Further, the transmission source identification information β and sound notification (melody M ₁ ) are associated with each other. Further, the transmission source identification information γ and the sound notification (melody M ₂ ) are associated with each other. The correspondence between the transmission source identification information and the re-notification mode in FIG. 25 can be freely set by the user.

  In step S48, the notification control unit 1117-8 extracts the transmission source identification information in the incoming call data storage unit 1464. The notification control unit 1117-8 refers to the second table, acquires a re-notification mode corresponding to the extracted transmission source identification information, and sets the re-notification mode. For example, when the notification control unit 1117-8 extracts the transmission source identification information α from the incoming call data storage unit 1464, a vibration notification corresponding to the transmission source identification information is set. The notification control unit 1117-8 causes the notification unit 1120 to re-notify in the set notification mode (that is, vibration notification).

In the example of FIG. 25, the re-notification mode of the transmission source identification information β is the sound notification of the melody M ₁ , and the re-notification mode of the transmission source identification information γ is the sound notification of the melody M ₂ . Therefore, the user can specify the transmission source by listening to the melody.

  According to the eighth embodiment, re-notification can be performed in a manner corresponding to the transmission source. Therefore, the user can identify the transmission source by recognizing the mode of re-notification.

[Embodiment 9]
Next, Embodiment 9 will be described. Generally, the sound pressure and frequency of the ambient sound are roughly determined depending on the location. For example, the sound pressure of ambient sounds is low in a library, and the sound pressure of ambient sounds is high in a downtown area. Therefore, the terminal device according to the ninth embodiment uses the position information indicating the position of the terminal device to convert the position information into a feature amount. The notification control unit re-notifies the notification unit based on the converted feature amount.

  FIG. 26 is a diagram illustrating a functional configuration example of the terminal device 100-9 according to the ninth embodiment, and FIG. 27 is a diagram illustrating a processing flow of the terminal device 100-9. FIG. 28 is a position information table in which position information is associated with sound pressure. The position information table is stored in the storage unit 144.

  26 differs from FIG. 2 in that a conversion unit 1134, a GPS unit 1135 (GLOBAL Positioning System), and a position information acquisition unit 1136 are added. FIG. 27 is different in that step S7 is replaced with step S7-9. Step S7-9 includes steps S50, S52, and S54.

In the example of FIG. 28, the position information L ₁ and the sound pressure P ₁ is associated. Further, the positional information L ₂ and the sound pressure P ₂ is associated. And position information L ₃ and the sound pressure P ₃ is associated.

In the example of FIG. 28, the position information L ₁ indicates the position of the library, the position information L ₂ indicates the position of the downtown area, and the position information L ₃ indicates the other positions. It shows that there is.

Moreover, the sound pressure in the library are those defined for short large, those obtained by adding ΔP sound pressure defined the (described in the second embodiment) becomes the P _1. In the same manner, P ₂ corresponding to the downtown area (position information L ₂ ) is obtained. Further, P ₃ corresponding to the other position (position information L ₃ ) is obtained. The value of P ₃ may be a mean value _{P 1} and _{P 2.}

  In the example of FIG. 28, the number of items is three for the sake of simplification of the description. In the example of FIG. 28, the position information and the sound pressure are associated with each other, but other feature amounts (for example, frequency) may be associated with each other. Further, position information may be associated with sound pressure and frequency.

  If NO is determined in step S6, the position information acquisition unit 1136 acquires position information in step S50. Here, the position information acquisition unit 1136 may acquire the position information acquired by the GPS unit 1135.

In step S52, the conversion unit 1134 converts the position information into a feature amount using the position information table (see FIG. 28). If the position information position information obtaining unit 1136 has obtained is the position information _{L 1,} the conversion unit 1134 converts the sound pressure _{P 1,} and acquires the _{P 1.}

  In step S54, the feature amount acquisition unit 1114 acquires the sound pressure converted by the conversion unit 1134. Then, the process of step S12 is performed.

  According to the ninth embodiment, even if the microphone 172 is not provided, the same effects as those of the above-described embodiment can be obtained.

[Embodiment 10]
Next, Embodiment 10 will be described. In the ninth embodiment, the GPS unit 1135 acquires position information. In the tenth embodiment, the user is caused to input position information. As a result, the GPS unit 1135 becomes unnecessary.

  FIG. 29 is a diagram illustrating a terminal device 100-10 according to the tenth embodiment. FIG. 30 is an input screen for the user to input position information. The processing flow of the terminal device 100-10 is the same as that in FIG. The position information table referred to by the conversion unit 1134 is the same as that in FIG.

  29, the GPS unit 1135 is omitted, and the operation I / F unit 120 includes a position information receiving unit 1204, as compared with FIG. Further, the input screen of FIG. 30 is displayed on the display 150. In the example of FIG. 30, the user can select the current location. In the example of FIG. 30, a library, a downtown area, and others can be selected as the current position. In the example of FIG. 30, a check box 150a is displayed, and the user checks the check box at the current position. The position information input screen is not limited to FIG.

  The position information reception unit 1204 transmits the input position information to the position information acquisition unit 1136. In step S50, the position information acquisition unit 1136 acquires the input position information. The subsequent processing is the same as in the ninth embodiment.

  According to the tenth embodiment, the same effects as those of the ninth embodiment can be achieved without a GPS unit.

[Others]
The components described in the above first to tenth embodiments can be implemented in combination as long as there is no technical contradiction.

  The terminal device of the present invention is realized by a CPU and a program executed on the CPU. The program for realizing the present invention can be stored in a computer-readable recording medium such as a semiconductor memory, a hard disk, a CD-ROM, a DVD, or the like, provided by being recorded on these recording media, or a communication interface. It is provided by transmission / reception using a network.

  In addition, the embodiment disclosed this time is illustrative in all points and is not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  100 terminal device, 102 communication unit, 108 antenna unit, 182 memory card, 120 operation I / F unit, 140 camera, 144 flash memory (storage unit), 146 RAM, 148 ROM, 150 display, 150a check box, 170 audio signal Processing unit, 172 Microphone (sound collecting unit), 174 speaker, 180 memory card drive unit, 184 vibrator, 186 clock, 187 timer, 1022 telephone incoming unit, 1024 mail incoming unit, 1102 telephone incoming data generation unit, 1104 telephone incoming notification Unit, 1106 mail incoming data generation unit, 1110 mail incoming notification unit, 1112 schedule notification unit, 1114 feature amount acquisition unit, 1116 first determination unit, 1117 notification control unit, 1118 second determination unit, 1120 notification 1124 Sound pressure setting unit, 1126 Frequency setting unit, 1128 Third determination unit, 1130 First storage unit, 1132 Second storage unit, 1134 Conversion unit, 1136 Position information acquisition unit, 1202 Response reception unit, 1204 Position information reception unit 1462, mail storage unit, 1464 incoming call data storage unit, 1466 incoming mail data storage unit, 1468 schedule data storage unit.

Claims (4)

A terminal device,
A notification means for notifying information to be recognized by the user;
Response accepting means for accepting a response operation to the notification;
Feature quantity acquisition means for acquiring a feature quantity including the frequency of ambient sound of the terminal device;
Notification control for re-notifying the notification unit of the information when the frequency acquired by the feature amount acquisition unit changes by a predetermined amount or more when the response reception unit has not received the response operation. A terminal device. A first storage means for storing a first table in which the frequency band and the frequency of the sound of re-notification are associated with each other;
The terminal device according to claim 1, wherein the notification control unit causes the notification unit to re-notify the information with a sound having a frequency corresponding to a frequency band to which the frequency acquired by the feature amount acquisition unit belongs. The notification control unit causes the notification unit to re-notify the information every predetermined time when the frequency acquired from the feature amount acquisition unit changes by more than the predetermined amount. The terminal device according to 1 or 2 . A program executed on a computer,
The program is stored in the computer.
Notifying the user of information to be recognized;
Receiving a response operation to the notification;
Obtaining a frequency of ambient sound of the computer;
And a step of re-notifying the information when the acquired frequency changes by a predetermined amount or more when the response operation is not accepted.

Images