JP6688160B2 - Communication terminal device and program - Google Patents

Description

  The present invention relates to a technique for responding to an incoming call without a user operating an operator.

  A technique for recognizing a movement of a user, that is, a gesture to activate a specific function has been conventionally proposed (for example, Patent Document 1). In the technique of Patent Document 1, the movement of the user is recognized by observing the movement of the terminal device and calculating the movement parameter.

  On the other hand, human movement has a peculiarity to each individual. Patent Documents 2 and 3 describe techniques for reducing an authentication error caused by a habit of reading biometric information of a user. In Patent Document 2, among fingerprint images (failure images) that have been input until the authentication succeeds, a fingerprint image in which the number of authentication errors (failure number) is relatively large is registered. It is described that the fingerprint image for authentication is replaced. In Patent Document 3, authentication is performed by collating input data with already registered authentication target data, and input data that matches the authentication target data is stored as reference data, and the number of collations exceeds a reference value and authentication is performed. It is described that reference data whose success rate exceeds the authentication target data is replaced with the authentication target data and stored.

Re-table 2006/43581 JP, 2008-217442, A JP2012-83857A

Here, consider a case in which the movement of the user is recognized when the communication terminal device receives an incoming call and the incoming call is answered. In this case, since the movements of a person when receiving a call are not uniform, the following problems may occur.
When the communication terminal device is put in the bag or pocket of the walking user, the communication terminal device may respond to the incoming call at a timing that the user does not notice, depending on the movement of the communication terminal device. Further, even if the user notices the incoming call and takes a motion to respond to the incoming call, the communication terminal device may not be able to correctly recognize the operation at the time of the incoming call due to the habit of the user's movement. If it is dealt with by expanding the range of motion of the user who responds to an incoming call, the possibility of responding at a timing that the user does not notice becomes even higher.
Therefore, an object of the present invention is to provide a technique for recognizing a movement of a call, which includes a user's habit, at the time of receiving a call and responding to the call.

  In order to solve the above-mentioned problems, a communication terminal device of the present invention is a portable communication terminal device, and a response unit that responds to an incoming call, and a posture that measures the posture or displacement of the communication terminal device. / A displacement measuring unit, a proximity detecting unit that detects that the user's head has approached the communication terminal device, and the posture and / or displacement measured before or while the proximity is detected. And a recording unit that records posture / displacement data indicating that the response is received by the response unit when the proximity is detected and the posture or displacement according to the posture / displacement data is measured. Respond to

In the communication terminal device of the present invention, the attitude / displacement data is data indicating the attitude when the proximity is detected, and the response unit is configured to perform the attitude / displacement when the proximity is detected. When the attitude according to the data is measured, the incoming call may be answered.
In the communication terminal device of the present invention, the posture / displacement data is data indicating a temporal change in the posture and / or displacement before or while the proximity is detected, and the response unit is If the time change of the posture and / or the displacement according to the posture / displacement data is measured before or while the proximity is detected, it responds to the incoming call. May be.

In the communication terminal device of the present invention, based on the recorded posture / displacement data, a response condition specifying unit that specifies one or a plurality of conditions of the posture and / or displacement for responding to the incoming call is provided, The response unit may respond to the incoming call when the posture and / or the displacement satisfying any one or more of the specified conditions are measured.
In this communication terminal device, the response condition specifying unit may change one or a plurality of conditions according to the recorded posture / displacement data.
In the communication terminal device of the present invention, the recording unit records situation data indicating a situation of the communication terminal device or the user when the posture and / or displacement is measured, in association with the posture / displacement data. However, the response unit controls whether to respond to the incoming call according to the posture and / or displacement data recorded in association with the situation data indicating the situation when the incoming call is received. May be.
In this communication terminal device, the situation data may indicate time, position, vibration acting on the communication terminal device, level or brightness of voice around the communication terminal device or the user.

  A program of the present invention comprises: a computer of a portable communication terminal device; measuring a posture and / or displacement of the communication terminal device; and detecting a user's head approaching the communication terminal device. A step of recording posture / displacement data indicating the posture or displacement measured before or while the proximity is detected, and the posture in which the proximity is detected and corresponding to the posture / displacement data And / or when a displacement is measured, a program for executing a step of responding to the incoming call.

  According to the present invention, it is possible to provide a technique for recognizing a movement of a call, which includes a user's habit, when the call arrives and responding to the call.

The front view of the communication terminal device which concerns on 1st Embodiment of this invention. The block diagram which shows the hardware constitutions of the communication terminal device which concerns on the same embodiment. Explanatory drawing of the identification method of the attitude | position of the communication terminal device which concerns on the same embodiment. The figure which shows the structure which concerns on the same embodiment, and the response condition data. The block diagram which shows the function structure of the control part which concerns on the same embodiment. The flowchart which shows the process regarding the automatic response function which the communication terminal device which concerns on the same embodiment performs. Explanatory drawing of an example of the state of a communication terminal device and a user at the time of incoming call. Explanatory drawing of an example of the identification method of the response condition which concerns on the same embodiment. FIG. 6 is an explanatory diagram showing a difference in the presence or absence of a response by the automatic response function before and after the change of the response condition regarding the first attitude data according to the embodiment. The figure which shows the table which concerns on 2nd Embodiment of this invention, and the structure of response condition data. The flowchart which shows the process regarding the automatic response function which the communication terminal device which concerns on the same embodiment performs. Explanatory drawing of an example of the state of a communication terminal device and a user at the time of incoming call. The block diagram which shows the function structure of the control part which concerns on the modification 2 of this invention. The block diagram which shows the function structure of the control part which concerns on the same modified example. The flowchart which shows the process regarding the automatic response function which the communication terminal device which concerns on the same modification performs. The flowchart which shows the process regarding the automatic response function which the communication terminal device which concerns on the modification 3 of this invention performs.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a front view of a communication terminal device 10 according to the first embodiment of the present invention. The communication terminal device 10 is a portable communication terminal device that a user holds and uses. The communication terminal device 10 is a smartphone in the present embodiment. The communication terminal device 10 is formed in a substantially rectangular parallelepiped shape. When the communication terminal device 10 is viewed from the front, the up-down direction is the long direction and the left-right direction is the short direction. The communication terminal device 10 has an automatic response function of recognizing a user's movement when an incoming call is received and responding to the incoming call even if the user does not operate the operation element.

  The communication terminal device 10 transmits and receives voice for calling. The communication terminal device 10 includes a microphone 14 and a speaker 15 on the front side. The microphone 14 is a device for inputting transmitted voice. The microphone 14 is arranged so as to be located near the mouth of the user who is talking. The speaker 15 is a device for outputting a received voice. The speaker 15 is arranged so as to be located near the head (more specifically, the ear) of the user who is talking.

  The communication terminal device 10 further includes a display area 121A and a proximity sensor 18 on the front side. The display area 121A is an area in which an image (screen) of the display unit 121 described later is displayed. The proximity sensor 18 is provided adjacent to the speaker 15 and is a sensor for detecting the proximity of the user's head.

FIG. 2 is a block diagram showing the hardware configuration of the communication terminal device 10. As illustrated in FIG. 2, the communication terminal device 10 includes a control unit 11, a touch screen unit 12, a wireless communication unit 13, a microphone 14, a speaker 15, an acceleration sensor 16, a gyro sensor 17, and a proximity sensor. 18, a storage unit 19, and a sensor group 20.
The control unit 11 is a processor including a CPU (Central Processing Unit) 11A as a processing unit, a ROM (Read Only Memory) 11B, and a RAM (Random Access Memory) 11C as a work area. The CPU 11A controls each unit of the communication terminal device 10 by reading a program stored in the ROM 11B or the storage unit 19 into the RAM 11C and executing the program. The control unit 11 controls, for example, a call.

  The touch screen unit 12 includes a display unit 121 and a touch sensor 122. The display unit 121 is a liquid crystal display, for example, and displays an image in the display area 121A (see FIG. 1). The touch sensor 122 is a sensor provided in a planar shape so as to be overlapped with the display area 121A, and allows a user operation performed on the display area 121A to be performed according to a predetermined method (for example, a resistive film method or a capacitance method). Detect.

  The wireless communication unit 13 has a wireless communication circuit and an antenna, and performs wireless communication. The wireless communication unit 13 is a communication unit that is connected to a telephone line (not shown) and at least performs communication for a call. The wireless communication unit 13 receives, for example, an incoming call and makes a call to the other party of the call.

  The microphone 14 converts a voice input by the user into a voice signal. The speaker 15 converts the supplied audio signal into audio and outputs it.

  The acceleration sensor 16 is, for example, a triaxial acceleration sensor, and is a sensor that measures the acceleration applied to the communication terminal device 10. The acceleration sensor 16 is used to measure the posture and / or displacement (movement) of the communication terminal device 10. The gyro sensor (angular velocity sensor) 17 is, for example, a triaxial angular velocity sensor, and is a sensor that measures the angular velocity acting on the communication terminal device 10. The gyro sensor 17 is used to measure the attitude of the communication terminal device 10.

FIG. 3 is a diagram illustrating a method of identifying the attitude of the communication terminal device 10. FIG. 3 shows a state in which the user U puts the communication terminal device 10 on his right ear. The posture of the communication terminal device 10 is represented by a posture angle θ in the present embodiment. The attitude angle θ is defined by a reference line L1 that extends vertically downward from the center of gravity O of the communication terminal apparatus 10 and a vertical line upward from the center O of the communication terminal apparatus 10 and from below to above (here It represents the size of the angle formed by the straight line L2 extending in the longitudinal direction). The posture angle θ is a positive value when the communication terminal device 10 is tilted counterclockwise with respect to the reference line L1 about the center of gravity O in the state of being applied to the right ear of the user U, and the clockwise direction. It shall take a negative value when leaning to. Further, the posture angle θ satisfies the condition of −180 degrees ≦ θ <180 degrees. For example, when the direction in which the reference line L1 extends and the vertical direction of the communication terminal device 10 match, the posture angle θ = 0 degree.
The displacement of the communication terminal device 10 is specified by the change in the position of the communication terminal device 10 from the reference position. The reference position is, for example, the position when the communication terminal device 10 receives an incoming call.

  The proximity sensor 18 is a sensor for detecting the proximity of the user's head. The proximity sensor 18 is, for example, an inductive type or capacitance type proximity sensor, and detects that an object approaches within a predetermined distance. “Proximity” in the present embodiment includes both a state where an object is in contact with the proximity sensor 18 and a state where the object is not in contact with the proximity sensor 18.

  The storage unit 19 has, for example, an EEPROM (Electronically Erasable and Programmable ROM) or a flash memory, and stores various data. The storage unit 19 stores an OS (Operating System) installed in the communication terminal device 10 and various programs operating on the OS. The storage unit 19 further stores a table 191 and response condition data 192. The table 191 and the response condition data 192 are data used for the processing relating to the automatic response function.

FIG. 4 is a diagram showing the configurations of the table 191 and the response condition data 192.
The table 191 is a table in which the attitude / displacement data of the communication terminal device 10 when a call is received is recorded. In this embodiment, the posture / displacement data includes first posture data and second posture data. The first attitude data indicates the attitude of the communication terminal device 10 when the proximity of the user's head is changed from a state in which the proximity of the head of the user is not detected to a state in which the proximity of the user's head is detected. The second attitude data indicates the attitude of the communication terminal device 10 when responding to an incoming call (for example, when a call is started) after detecting the proximity. In the table 191, a set of the first attitude data and the second attitude data is recorded in the same record (row) according to the movement taken by the user at the time of one incoming call. That is, in the table 191 shown in FIG. 4, a plurality of sets of first attitude data and second attitude data are recorded according to the movement of the user when receiving a plurality of calls.

The response condition data 192 indicates posture / displacement data that is a condition for responding to an incoming call. In the present embodiment, the response condition data 192 indicates the response condition including the posture angle θ corresponding to the first posture data and the posture angle θ corresponding to the second posture data. In the example of FIG. 4, the response condition corresponding to the first attitude data is θth1 ≦ θ ≦ θth2, and the response condition corresponding to the second attitude data is θth3 ≦ θ ≦ θth4.
Note that θth1, θth2, θth3, and θth4 indicating the range of the response condition based on the posture angle θ are initial setting values. The values of θth1, θth2, θth3, and θth4 are updated according to the movement of the user when receiving a call. This update will be described later.

  Returning to FIG. 2, the sensor group 20 is composed of a plurality of sensors. The sensor group 20 is composed of sensors other than a touch sensor, an acceleration sensor, a gyro sensor, and a proximity sensor here. The sensor group 20 is, for example, a sensor for measuring the position of the communication terminal device 10 (for example, a GPS (Global Positioning System) sensor) or a sensor for measuring the brightness around the communication terminal device 10 (for example, an illuminance sensor). ) Etc. are included.

FIG. 5 is a block diagram showing a functional configuration of the control unit 11. By executing the program, the control unit 11 realizes the functions corresponding to the posture / displacement measurement unit 111, the proximity detection unit 112, the recording unit 113, the response condition identification unit 114, and the call control unit 115. .
The posture / displacement measuring unit 111 measures the posture and / or displacement of the communication terminal device 10 based on the acceleration measured by the acceleration sensor 16 and the angular velocity measured by the gyro sensor 17.

  The proximity detector 112 detects that the user's head has approached the communication terminal device 10 based on the detection result of the proximity sensor 18. In the present embodiment, the proximity detection unit 112 detects that the user's head has approached the communication terminal device 10 when the proximity sensor 18 detects the proximity of an object.

  The recording unit 113 stores posture / displacement data indicating the posture and / or the displacement measured by the posture / displacement measuring unit 111 before or while the proximity detector 112 detects the proximity of the user's head. , In the storage unit 19. In the present embodiment, the recording unit 113 records the above-mentioned first posture data and second posture data.

  The response condition identifying unit 114 identifies the response condition based on the posture / displacement data recorded by the recording unit 113. In the present embodiment, it is assumed that the response condition specifying unit 114 specifies only one response condition based on the first attitude data and the second attitude data. The response condition identification unit 114 causes the storage unit 19 to store the response condition data 192 indicating the identified response condition. Furthermore, the response condition specifying unit 114 changes the specified response condition according to the posture / displacement data recorded by the recording unit 113.

The call control unit 115 uses the wireless communication unit 13, the microphone 14, and the speaker 15 to control the call. The call control unit 115 further includes a response unit 1151.
The response unit 1151 has a function of responding to an incoming call by an automatic response function. When the proximity sensor 18 detects the proximity of the user's head and the posture and / or displacement corresponding to the posture / displacement data recorded by the storage unit 19 is measured, the automatic response function receives an incoming call. Respond to. In the present embodiment, the response unit 1151 responds to the incoming call when the posture is measured by the proximity sensor 18 and the posture satisfying the response condition represented by the response condition data 192 is measured. . That is, the response unit 1151 does not respond by the automatic response function when the posture satisfying the response condition is not measured.

Next, the operation of the communication terminal device 10 regarding the automatic response function will be described.
FIG. 6 is a flowchart showing processing relating to the automatic response function executed by the communication terminal device 10. The control unit 11 of the communication terminal device 10 repeatedly executes the processing illustrated in FIG. 6 while the power of the communication terminal device 10 is turned on. FIG. 7 is a diagram illustrating an example of the states of the communication terminal device 10 and the user when a call is received.
The control unit 11 of the communication terminal device 10 determines whether an incoming call has been accepted via the wireless communication unit 13 (step S1). During this time, the control unit 11 turns on the acceleration sensor 16 and the gyro sensor 17, and turns off the proximity sensor 18, for example.

When it is determined that the incoming call is accepted (step S1; YES), the control unit 11 uses the acceleration sensor 16 and the gyro sensor 17 to measure the attitude and displacement of the communication terminal device 10 (step S2).
The control unit 11 outputs a ring tone via the speaker 15 while the incoming call is accepted. Alternatively or in combination, the control unit 11 may vibrate the communication terminal device 10 based on the vibration function.

  Next, the control unit 11 determines whether or not the measured posture and displacement satisfy the condition when the communication terminal device 10 is held by the user's hand (step S3). Here, the control unit 11 determines that the communication terminal device 10 is held by the user's hand when the posture of the communication terminal device 10 is temporally changed or displaced.

Here, as shown in FIG. 7A, consider a case where an incoming call is received when the communication terminal device 10 is placed on a horizontal desk T with the face down. In this case, the user U who wants to make a call first grips the communication terminal device 10 from the back side. Next, as shown in FIG. 7B, the user U lifts the gripped communication terminal device 10. Next, as shown in FIG. 7 (C), the user U faces the front side of the communication terminal device 10 to himself. Thus, when the communication terminal device 10 is held by the user's hand, acceleration or angular velocity acts on the communication terminal device 10 to change the posture of the communication terminal device 10 with time, or the communication terminal device 10 is changed. Will be displaced.
The condition when the communication terminal device 10 is held by the user's hand is not limited to this example. The condition may be, for example, that the posture of the communication terminal device 10 at a certain point in time is a predetermined posture (for example, an upright posture and / or a posture close thereto). The front surface of the communication terminal device 10 in the upright posture is parallel or substantially parallel to the vertical direction.

The control unit 11 determines whether or not the incoming call is continued until it is determined that the communication terminal device 10 is held by the user's hand (step S3; NO) (step S4). When it is determined that the incoming call is continuing (step S4; YES), the process returns to step S2.
When determining "YES" in step S3, the control unit 11 turns on the proximity sensor 18 to detect the proximity of the user's head (step S5).

Next, the control unit 11 determines whether or not the proximity sensor 18 has detected the proximity of the user's head (step S6). When the proximity of the user's head is not detected (step S6; NO), the control unit 11 determines whether the incoming call is continuing (step S7). When it is determined that the incoming call is continuing (step S7; YES). The control unit 11 returns to the process of step S5.
For example, after the front side of the communication terminal device 10 is turned to the user U (FIG. 7C), the user U brings the communication terminal device 10 close to his / her head as shown in FIG. 7D. To move. When the state shown in FIG. 7D is reached, the control unit 11 determines that the proximity sensor 18 has detected the proximity of the user's head (step S6; YES). Then, the control unit 11 measures the attitude of the communication terminal device 10 using the gyro sensor 17 (step S8). Here, the control unit 11 measures the posture when the state in which the proximity of the user's head is not detected is changed to the state in which the proximity of the user's head is detected.

  Next, the control unit 11 determines whether the posture measured during the detection of the proximity of the user's head satisfies the response condition indicated by the response condition data 192 (step S9). The control unit 11 determines that the posture angle θ of the posture at the time of transition from the state in which the proximity of the user's head is not detected to the state in which the proximity is detected satisfies the condition of the posture angles θth1 ≦ θ ≦ θth2, and further Based on the attitude measured during the detection, it is determined whether the attitude angle θ satisfies the condition of θth3 ≦ θ ≦ θth4. When it is determined to be "NO" in step S9, the control unit 11 proceeds to step S7 to determine whether the incoming call is continuing, and when it is determined that the incoming call is continuing (step S7; YES). , And returns to the process of step S5.

  When the control unit 11 determines that the posture measured in step S8 satisfies the response condition represented by the response condition data 192 (step S9; YES), it controls the wireless communication unit 13 to respond to the incoming call ( Step S10). Then, the control unit 11 starts control for a call.

Next, the control unit 11 measures the posture measured in step S8, and the first posture data indicating the posture at the time of transition from the state in which the proximity is not detected to the state in which the proximity is detected, and after responding to the incoming call. The second attitude data indicating the attitude (for example, when the call is started) is recorded in the storage unit 19 (step S11).
Note that, as shown in FIG. 7E, the user U will talk in a state where the communication terminal device 10 is close to the ear. Therefore, the control unit 11 may record the second attitude data based on the attitude after the call is started, instead of the attitude when the call is started.

Next, the control unit 11 determines whether to update the response condition data 192 (step S12). The control unit 11 responds, for example, when the number of sets of the first posture data and the second posture data recorded in the table 191 reaches a threshold value (for example, 5) or when there is a user instruction. It is determined to update the data 192. When determining “YES” in step S12, the control unit 11 specifies the response condition based on the first attitude data and the second attitude data recorded in the table 191 (step S13).
In addition, when it determines with "NO" in step S12, the control part 11 complete | finishes the process of FIG.

FIG. 8 is a diagram illustrating an example of a method of identifying a response condition.
In the upper graph of FIG. 8, the horizontal axis represents the posture angle θ, and the vertical axis represents the number of times each posture angle θ is detected based on the first posture data (the number of incoming calls). Focusing on the distribution of the posture angles θ in this graph, it can be seen that the posture angles in which the number of detections is “1” or more are within a certain range. An attitude angle θ in which the number of times of detection is “1” or more means that the user makes a movement at the time of incoming call in an attitude having the attitude angle θ. Therefore, the control unit 11 specifies the response condition based on the range of the posture angle θ in which the number of detections is “1” or more. For example, the control unit 11 sets θth5, which is a value obtained by subtracting a predetermined value from the value of the minimum posture angle θ for which the number of detections is “1” or more, as the minimum posture angle that satisfies the response condition regarding the first posture data, Θth6, which is a value obtained by adding a predetermined value to the value of the maximum posture angle θ for which the number of detections is “1” or more, is set as the maximum posture angle that satisfies the response condition regarding the first posture data. Here, the reason that the predetermined value is added or subtracted is to prevent the range of the posture angle θ that satisfies the response condition from becoming too narrow, and this addition / subtraction may not be performed if not necessary. Further, the control unit 11 may limit this range to be less than a predetermined angle range so that the range of the posture angle θ that satisfies the response condition does not become too wide.

The response condition regarding the second attitude data is also specified by the same method as the first attitude data. In the lower graph of FIG. 8, the horizontal axis represents the posture angle θ, and the vertical axis represents the number of times each posture angle θ is detected based on the second posture data. Here, the control unit 11 sets θth7, which is a value obtained by subtracting a predetermined value from the value of the minimum posture angle θ for which the number of detections is “1” or more, as the minimum posture angle that satisfies the response condition regarding the second posture data. .Theta.th8, which is a value obtained by adding a predetermined value to the value of the maximum posture angle .theta. For which the number of detections is "1" or more, is set as the maximum posture angle that satisfies the response condition regarding the second posture data.
As can be seen from the graphs in FIG. 8, by updating the response condition data 192 for each of the first posture data and the second posture data, the range of the posture angle θ that satisfies the response condition is changed from the initial setting value.

  In this case, the control unit 11 specifies the response condition based on the first attitude data and the second attitude data when it is determined that it is the response intended by the user when the incoming call is answered. You may. For example, the control unit 11 may check whether the response is the user's intended response by inquiring the user, or may make the determination based on whether the user's utterance is detected after the response. Further, the control unit 11 responds to the incoming call according to the operation of the operator by the user until a predetermined number or more of the first attitude data and the second attitude data are recorded in the table 191, and at the time of this incoming call. The response condition data 192 may be updated by specifying the response condition based on the movement of the user.

  When the response condition is specified, the control unit 11 updates the response condition data 192 indicating the response condition (step S14). Then, the control unit 11 ends the process of FIG.

FIG. 9 is a diagram for explaining the difference in the presence or absence of a response by the automatic response function before and after the change of the response condition regarding the first attitude data. The posture angle θA shown in FIG. 9 is assumed to satisfy the relationship of θth6 <θA <θth2 as shown in the upper graph of FIG. The posture angle θB satisfies the relationship of θth5 <θB <θth6 as shown in the upper graph of FIG.
Before updating the response condition data 192, the response condition regarding the first attitude data is specified by θth1 ≦ θ ≦ θth2. Therefore, as shown in the upper diagram of FIG. 9, the control unit 11 responds to the incoming call regardless of whether the communication terminal device 10 has the attitude angles θA and θB. On the other hand, after the response condition data 192 is updated, the response condition regarding the first attitude data is changed to θth5 ≦ θ ≦ θth6. Therefore, as shown in the lower diagram of FIG. 9, the control unit 11 does not respond to the incoming call when the communication terminal device 10 has the attitude angle θA, and has the attitude angle θB. Will continue to respond. Accordingly, the inclination of the communication terminal device 10 becomes relatively small, and the response condition reflects the habit of the user U who puts the communication terminal device 10 on his ear. Although illustration is omitted, the response condition regarding the second posture data is similarly changed to the response condition reflecting the habit of the user U.

The change of the response condition described with reference to FIGS. 8 and 9 narrows the range of the posture angle θ. However, the range of the posture angle θ that satisfies the response condition is changed according to the user's actual operation during a call, and therefore the range of the posture angle θ that is the initial setting value is not necessarily narrower. For example, the control unit 11 may change the range of the posture angle θ while keeping the size of the range of the posture angle θ the same as the initial setting value. For example, when the initial setting value of the posture angle θ is −45 ° ≦ θ ≦ 45 °, the response ga is changed to −10 ° ≦ θ ≦ 80 °, which is ga. In the case of a user who performs various actions during a call, the size of the range of the posture angle θ may be wider than the initial setting value. For example, when the initial setting value of the posture angle θ is −45 degrees ≦ θ ≦ 45 degrees, it may be changed to the range of −30 degrees ≦ θ ≦ 70 degrees by changing the response condition.
The algorithm for updating the response condition data 192 according to the present embodiment is merely an example, and another algorithm may be adopted.

  As described above, the response condition data 192 is updated from the initial setting value so as to indicate the posture angle θ according to the movement taken by the user at the time of incoming call, as the communication terminal device 10 is used. That is, the response condition data 192 is updated so as to reflect the habit of the movement that the user took when receiving the call. Therefore, when the user tries to answer the call using the communication terminal device 10, the possibility that the call is received by the automatic answering function and the call is answered at a timing not intended by the user is reduced. Therefore, according to the communication terminal device 10, it is possible to recognize the movement of the call including the user's habit when the call arrives and respond to the call arrival at an appropriate timing.

[Second Embodiment]
As can be seen from the movement of the user described with reference to FIG. 7, not only the posture of the communication terminal device 10 but also the movement trajectory of the communication terminal device 10 is considered to be a trajectory that reflects the habit of the movement of the user. In the present embodiment, the trajectory of movement of the communication terminal device 10 is specified by a combination of the distance traveled by the communication terminal device 10, the direction of movement, and the change in posture. Therefore, the communication terminal device 10 makes a response by the automatic response function based on the trajectory of the movement of the communication terminal device 10 before or when the proximity sensor 18 detects the proximity of the user's head. Good.
In the present embodiment, elements given the same reference numerals as those in the above-described first embodiment function in the same manner as in the above-described first embodiment. The hardware configuration of the communication terminal device 10 of this embodiment may be the same as that of the first embodiment described above. Also in the functional configuration of the communication terminal device 10, the first embodiment described above except that locus data indicating a locus of movement of the communication terminal device 10 is used instead of the first posture data and the second posture data. The same as

FIG. 10 is a diagram showing the configuration of the table 191 of this embodiment.
The table 191 is a table in which locus data indicating a locus of movement of the communication terminal device 10 is recorded. In the example of FIG. 10, locus data indicating the locus of movement of the communication terminal device 10 when a call is received once is recorded in one record (row). The trajectory data is composed of a set of posture / displacement data indicating the posture and the displacement of the communication terminal device 10 measured at a plurality of respective time points. The posture / displacement data includes data on the displacement (Xi, Yi, Zi) in the three-axis directions and the posture angle θi (i is a natural number).

  The response condition data 192 is data indicating the condition of the locus of movement of the communication terminal device 10 that responds to an incoming call. The “◯” mark shown in FIG. 10 corresponds to the data forming the response condition data 192, and the solid line connecting the “◯” s shows an example of the locus of movement of the communication terminal device 10 that satisfies the response condition. As shown in FIG. 10, the response condition data 192 is data in which the displacement (Xi, Yi, Zi) and the attitude angle θi (i is a natural number) are arranged in time series.

FIG. 11 is a flowchart showing a process related to the automatic response function executed by the communication terminal device 10. Descriptions of the processing steps common to those in the above-described first embodiment will be appropriately omitted or simplified.
When determining that the incoming call is accepted (step S1; YES), the control unit 11 of the communication terminal device 10 measures the posture and displacement of the communication terminal device 10 (step S2). When the control unit 11 determines that the communication terminal device 10 is held by the user's hand (step S3; YES), the proximity sensor 18 is turned on to detect the proximity of the user's head (step S5). .

  Next, the control unit 11 determines whether or not the proximity sensor 18 has detected the proximity of the user's head (step S6). When the proximity of the user's head is not detected (step S6; NO), the control unit 11 determines whether the incoming call is continuing (step S7). When it is determined that the incoming call is continuing (step S7; YES), the posture and displacement of the communication terminal device 10 are measured (step S21), and the process returns to step S5. That is, the control unit 11 measures the posture and displacement of the communication terminal device 10 even before the proximity sensor 18 detects the proximity of the user's head. The reason is that the trajectory before the detection of proximity as described with reference to FIGS. 7A to 7C is also specified.

  When determining that the proximity of the user's head is detected by the proximity sensor 18 (step S6; YES), the control unit 11 measures the posture and displacement of the communication terminal device 10 when this proximity is detected ( Step S22).

Next, the control unit 11 determines whether the trajectory of the movement of the communication terminal device 10 satisfies the response condition indicated by the response condition data 192 based on the posture and the displacement measured in steps S21 and S22 (step S23). ). For example, the control unit 11 calculates the degree of similarity between the locus indicated by the response condition and the locus of movement of the communication terminal device 10 based on a predetermined algorithm, and if the calculated degree of similarity is greater than or equal to a threshold value, the response condition is satisfied. (Step S23; YES). On the other hand, the control unit 11 determines that the response condition is not satisfied if the similarity is less than the threshold value (step S23; NO). The similarity calculation algorithm includes Angular Metrics for Shape Similarity (AMSS) and Dynamic Time Warping (DTW), but various similarity calculation algorithms can be adopted.
The control unit 11 may determine whether the response condition is satisfied without calculating the similarity. The control unit 11 may determine that the response condition is satisfied when the degree of approximation between the movement trajectory of the communication terminal device 10 and the response condition indicated by the response condition data 192 satisfies a predetermined condition.

  When determining “YES” in step S23, the control unit 11 controls the wireless communication unit 13 to respond to the incoming call (step S10). Then, the control unit 11 starts control for a call. Next, the control unit 11 records the trajectory data indicating the trajectory of the movement of the communication terminal device 10 in the storage unit 19 (step S24).

  Next, the control unit 11 determines whether to update the response condition data 192 (step S12). For example, the control unit 11 determines to update the response condition data 192 when the total number of pieces of locus data recorded in step S24 reaches a threshold value (for example, 4) or when there is an instruction from the user. When it determines with "NO" in step S12, the control part 11 complete | finishes the process of FIG.

  When determining “YES” in step S12, the control unit 11 specifies the response condition based on the trajectory data recorded in the table 191 (step S25). The control unit 11 specifies a trajectory (for example, an average trajectory) that reflects the result of the statistical processing by, for example, performing statistical processing on the recorded plurality of trajectory data, and specifies the response condition based on the trajectory. When the response condition is specified, the control unit 11 stores the response condition data 192 indicating the response condition in the storage unit 19 and updates it (step S26).

  In the present embodiment as well, the response condition data 192 is updated from the initial setting value so as to indicate a trajectory according to the movement taken by the user when receiving a call, as the communication terminal device 10 is used. Therefore, according to the communication terminal device 10 of the present embodiment, it is possible to recognize the movement of the call, which includes the user's habit, when the call arrives, and respond to the call.

[Modification]
The present invention can be implemented in a mode different from the above-described embodiment. The present invention can also be implemented in the following modes, for example. In addition, the modified examples described below may be combined as appropriate.
(Modification 1)
The control unit 11 of the communication terminal device 10 may specify a plurality of response conditions instead of one. This is because the movement that the user takes when receiving a call is not limited to a certain pattern. For example, the movement of the user is greatly different depending on whether the user performs the incoming call operation with the right hand as shown in FIG. 7 and the incoming call operation with the left hand as shown in FIGS. 12 (A) to (E). . When there are a plurality of response conditions, the control unit 11 responds to the incoming call when the measured posture and displacement satisfy at least one of the response conditions.

(Modification 2)
The communication terminal device 10 may selectively use the response condition depending on the situation of the communication terminal device 10 or the user when the call is received. For example, when the user is in a place such as home, it is considered that the user takes a movement when receiving a call due to a relatively large movement. However, when the user is in a place such as a company or a public place, it is annoying to the surroundings. This is because it is considered that the movement at the time of receiving a call is taken by a relatively small movement so that it does not occur. The movement of the user may change according to various other situations.
Hereinafter, a case where the present modification is applied to the above-described second embodiment will be described.

  FIG. 13 is a diagram showing the configurations of the table 191 and the response condition data 192 of this modification. In the table 191, the locus data is associated with the situation data indicating the situation of the communication terminal device 10 or the user when the operation at the time of receiving an incoming call is performed on the locus indicated by the locus data. The situation data is, for example, the time, position, vibration acting on the communication terminal device 10, the level of voice around the communication terminal device 10 or the user (eg, noise level), or the brightness around the communication terminal device 10 or the user. Shows the situation. The response condition data 192 includes one or more pieces of locus data indicating the response condition in association with situation data indicating the situation of the communication terminal device 10 or the user when the response condition is applied.

FIG. 14 is a block diagram showing a functional configuration of the control unit 11. The control unit 11 realizes a function corresponding to the situation specifying unit 116 in addition to the functions described in the second embodiment described above.
The situation identifying unit 116 identifies the situation of the communication terminal device 10 or the user when the posture and / or the displacement of the communication terminal device 10 are measured. The situation specifying unit 116 specifies the position and brightness based on the measurement result of the sensors of the sensor group 20. The situation identifying unit 116 identifies the time using the timekeeping function and identifies the vibration using the acceleration sensor 16. The situation identifying unit 116 identifies the sound level based on the data acquired using the microphone 14.

The recording unit 113 records the situation data indicating the situation of the communication terminal device 10 or the user when the call is received in the table 191 in association with the trajectory data. The response unit 1151 controls the presence / absence of a response to the incoming call in accordance with the trajectory data recorded in the table 191 in association with the situation data indicating the situation at the time of the incoming call.
The other functions of the control unit 11 may be the same as those of the second embodiment described above.

FIG. 15 is a flowchart showing processing relating to the automatic response function executed by the communication terminal device 10. The description of the processing steps common to the above-described second embodiment will be appropriately omitted or simplified.
When determining that the incoming call is accepted (step S1; YES), the control unit 11 of the communication terminal device 10 specifies the situation of the communication terminal device 10 or the user (step S31). After that, the control unit 11 determines whether or not the trajectory of the movement of the communication terminal device 10 satisfies the response condition corresponding to the situation specified in step S31 (step S32).

  For example, when the situation data indicates the time, the control unit 11 determines that the situation of the user estimated from the time is a situation in which the user can make a large movement (for example, the time before going to work or the time after coming home), The response condition is made different when the situation is such that the movement cannot be taken (for example, when the time is within the working hours). In addition, when the situation data indicates a position, when the situation of the user estimated from the position is a situation in which a large movement can be made (for example, when the position indicates a home), the control unit 11 detects such movement. The response condition may be different when the situation is such that the position indicates a company. In addition, when the situation data indicates a vibration acting on the communication terminal device 10, the control unit 11 determines that the situation of the user estimated from the vibration or the voice level is a situation in which the user can make a large movement (for example, the amplitude of the vibration is The response condition may be different depending on whether it is less than the threshold value or not (such as when the vibration or voice level is equal to or higher than the threshold value). When the situation data indicates the ambient brightness, the control unit 11 determines whether the situation of the user estimated from the brightness is a situation in which the user can take a large movement (for example, during the daytime), and The response condition may be different when the situation is such that the person cannot take a proper movement (for example, when the person is sleeping).

When determining "YES" in step S32, the control unit 11 responds to the incoming call (step S10). Then, the control unit 11 records the trajectory data in the table 191 in association with the situation data indicating the situation identified in step S31 (step S33). When the control unit 11 determines to update the response condition data 192 (step S12; YES), the response condition corresponding to the situation identified in step S31 is recorded in the table 191 in association with the situation data indicating the situation. It is specified based on the trajectory data. This specifying method may be the same as that of the second embodiment described above, except that the trajectory data used for specifying the response condition is narrowed down according to the situation data. When the response condition is specified, the control unit 11 updates the locus data indicating the response condition to the response condition data 192 associated with the situation data indicating the situation of the communication terminal device 10 or the user when the response condition is applied. (Step S26).
In this way, the communication terminal device 10 selects the response condition according to the situation of the self-communication terminal device or the user at that time, and thus recognizes the movement at the time of receiving a call including the user's habit in each situation. Thus, the incoming call can be answered.

(Modification 3)
The communication terminal device 10 may update the response condition data 192 at a timing other than when a call is received. The communication terminal device 10 may update the response condition data 192, for example, at the timing when the user instructs the registration of the response condition. In this case, the user holds the communication terminal device 10 in his hand and simulates the movement of the incoming call.
Hereinafter, a case where this modification is applied to the above-described first embodiment will be described.

Next, the operation of the communication terminal device 10 regarding the automatic response function will be described.
FIG. 16 is a flowchart showing the processing relating to the automatic response function executed by the communication terminal device 10.
The control unit 11 of the communication terminal device 10 determines whether or not the user has instructed the registration of the response condition data 192 by an operation using the touch screen unit 12 (step S41). When determining “YES” in step S41, the control unit 11 uses the acceleration sensor 16 to measure the posture and displacement of the communication terminal device 10 (step S42). Next, the control unit 11 causes the proximity sensor 18 to detect the proximity of the user's head (step S43).

  Next, the control unit 11 determines whether or not the proximity sensor 18 has detected the proximity of the user's head (step S44). When the control unit 11 does not detect the proximity of the user's head (step S44; NO), the control unit 11 returns to step S42 and measures the posture of the communication terminal device 10. When determining that the proximity sensor 18 has detected the proximity of the user's head (step S44; YES), the control unit 11 measures the posture of the communication terminal device 10 (step S45). That is, the posture of the communication terminal device 10 measured in step S42 is the posture when the state in which the proximity of the user's head is not detected is changed to the state in which the proximity of the user's head is detected. The attitude of the communication terminal device 10 measured in step S45 indicates the attitude of the communication terminal device 10 when responding to an incoming call (for example, when a call is started) after detecting the proximity of the user's head. .

Then, the control unit 11 records the first attitude data and the second attitude data in the table 191 based on the measured attitude (step S46). Then, the control unit 11 specifies the response condition based on the first attitude data and the second attitude data recorded in the table 191, in the same procedure as in the above-described first embodiment (step S47), and the response condition data. 192 is updated (step S48). In this modification as well, the communication terminal device 10 causes the user to simulate the movement of the incoming call a plurality of times, and obtains a plurality of sets of the first attitude data and the second attitude data before specifying the response condition. Is desirable.
In this modification as well, the communication terminal device 10 can update the response condition data 192 by learning the habit of movement of the user when receiving a call. Further, by updating the response condition data 192 in advance, the communication terminal device 10 can accurately recognize the movement of the user when the call comes in, even when the call comes in for the first time.

(Modification 4)
Some of the configurations and operations described in the above-described embodiments may be omitted. For example, in the above-described first embodiment, only one of the first attitude data and the second attitude data may be used to change the response condition and control the presence / absence of an incoming call. Further, the communication terminal device 10 may measure only one of the posture and / or the displacement of its own device to realize the automatic response function. In this case, the posture / displacement measuring unit 111 measures one of the posture and / or the displacement of the communication terminal device 10. Further, the control unit 11 may determine whether or not the response condition is satisfied by referring to the table 191 when an incoming call is received without specifying the response condition.

(Modification 5)
The communication terminal device 10 is not limited to a smartphone, and may be another portable communication terminal device such as a feature phone that performs communication for a call.
INDUSTRIAL APPLICABILITY The communication terminal device of the present invention is also applicable to a communication terminal device that causes the user's body to generate bone-conducted sound indicating a received voice. The communication terminal device is configured so that the user can talk even if the user makes contact with a part of the head other than the user's ear.
Further, the communication terminal device of the present invention does not have to be a communication terminal device that a user holds and uses when receiving a call. The communication terminal device of the present invention may be, for example, a so-called wearable terminal such as a headphone type or an earphone type that is used by being worn on the head of a user. This is because when a call is received while the user is not wearing the communication terminal device, the user starts the call after holding the communication terminal device in his hand and mounting it on his / her head. The operation of the communication terminal device when an incoming call is received may be the same as that in each of the above-described embodiments, and thus the description thereof is omitted.

(Modification 6)
The function realized by the control unit 11 of the communication terminal device 10 in each of the above-described embodiments may be realized by a combination of a plurality of programs or a cooperation of a plurality of hardware resources. When the function of the control unit 11 is realized by using a program, the program is a magnetic recording medium (magnetic tape, magnetic disk (HDD (Hard Disk Drive), FD (Flexible Disk), etc.)), optical recording medium (optical disk). Etc.), may be provided in a state of being stored in a computer-readable recording medium such as a magneto-optical recording medium or a semiconductor memory, or may be distributed via a network. The present invention can also be understood as an incoming call control method.

10 ... Communication terminal device, 11 ... Control part, 111 ... Posture / displacement measurement part, 112 ... Proximity detection part, 113 ... Recording part, 114 ... Response condition specifying part, 115 ... Call control part, 1151 ... Response part, 116 ... Situation specifying unit, 12 ... Touch screen unit, 121 ... Display unit, 121A ... Display area, 122 ... Touch sensor, 13 ... Wireless communication unit, 14 ... Microphone, 15 ... Speaker, 16 ... Acceleration sensor, 17 ... Gyro sensor, 18 ... Proximity sensor, 19 ... Storage unit, 191 ... Table, 192 ... Response condition data, 20 ... Sensor group.

Claims (2)

A portable communication terminal device,
A response unit that responds to incoming calls,
And attitude meter measuring unit for measuring the attitude of the communication terminal device,
A proximity detection unit that detects that the user's head has approached the communication terminal device,
First attitude data indicating a first attitude measured when the first proximity is not detected and the first proximity is detected; and the first attitude data after detecting the first proximity. A recording unit for recording second attitude data indicating a second attitude measured when a call is answered .
The response unit is
When the second proximity is not detected and the second proximity is detected, the first attitude indicated by the first attitude data is measured, and the second proximity is detected. A communication terminal device that later responds to an incoming call of a second call when the second attitude indicated by the second attitude data is measured . In the computer of the portable communication terminal device,
A step of measuring the attitude of the communication terminal device,
Detecting the proximity of the user's head to the communication terminal device;
First attitude data indicating a first attitude measured when the first proximity is not detected and the first proximity is detected; and the first attitude data after detecting the first proximity. Recording second attitude data indicating a second attitude measured when the call is answered.
When the second proximity is not detected and the second proximity is detected, the first attitude indicated by the first attitude data is measured, and the second proximity is detected. And a step of responding to an incoming call of a second call when the second attitude indicated by the second attitude data is measured .

Images