JP2012169824A - Portable terminal and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal and a control method therefor capable of avoiding contact with others while maintaining the convenience of the portable terminal.SOLUTION: A portable terminal 1 of the present invention includes: a display part 11; a camera 12; a face recognition processing part 13; a control part 14; and a notification part 15. The camera 12 covers the front zone in a travelling direction of a portable terminal 1 holder as an imaging area. Based on the processing on the output data from the camera 12, the face recognition processing part 13 detects a human face in a subject image acquired by the camera 12. While the portable terminal 1 is moving, the control part 14 detects an image displayed in the display part 11 accompanied by the activation of an application, and instructs the face recognition processing part 13 to perform face recognition processing. The notification part 15 notifies the holder that there is a person in front of the portable terminal 1 in the travelling direction according to the face detection of the face recognition processing 13 based on the instruction of the control part 14.

Description

  The present invention relates to a mobile terminal and a control method thereof, and more particularly to a mobile terminal including a camera and a control method thereof.

  In recent years, functions of mobile terminals (email function, game function, Internet function, etc.) have been developed. Therefore, even when the user of the mobile terminal is walking in a public place, the user may be absorbed in these functions. At this time, since the user is gazing at the display unit of the mobile terminal, the user may not notice a person approaching from the front of the user. Therefore, the user may come into contact with a person approaching from the front.

  In Patent Document 1, using an imaging device arranged on the same surface as the display device, a moving state detection unit that detects any one or more of vibration, acceleration, or a voltage accompanying the mobile terminal, and detected information, Detecting a face from an image captured by the imaging device, a moving state determination unit that determines that the mobile device is in a moving state when a predetermined reference value is satisfied, a camera activation instruction unit that transmits an activation instruction for the imaging device, and To determine the danger state of the owner, and when it is determined that the person is in the dangerous state, the risk determination time to send a control instruction to notify the owner to that effect A mobile terminal having a processing unit is disclosed.

JP 2008-85510 A

  In the portable terminal described in Patent Literature 1, even if there is no person who may be in contact with the front of the user, the portable terminal notifies the user of the danger if a predetermined condition is satisfied. For this reason, since an unnecessary danger notification is performed, the user cannot recognize the image displayed on the display device, and the convenience of the mobile terminal may be impaired.

  The present invention has been made to solve such a problem, and an object thereof is to provide a measure for avoiding contact with another person while ensuring the convenience of the mobile terminal.

  A portable terminal according to the present invention is a portable terminal including a display unit that displays an image to be displayed in accordance with execution of an application, and an imaging unit having an imaging range in front of a traveling direction of a holder of the portable terminal; In a situation where the mobile terminal is moving, and a face recognition processing means for detecting that a subject image acquired by the imaging means includes a human face based on processing on output data from the imaging means. , Detecting that an image is displayed on the display unit as the application is executed, and instructing the face recognition processing unit to execute face recognition processing; and Informing means for informing the holder that there is a person in front of the holder in the advancing direction in response to detection of the person's face by the face recognition processing means based thereon.

  A portable terminal control method according to the present invention includes: a display unit that displays an image to be displayed in accordance with execution of an application; and an imaging unit that has an imaging range in front of a traveling direction of a holder of the portable terminal. In the situation where the mobile terminal is moving, it is detected that an image is displayed on the display unit as the application is executed, and a person is included in the subject image acquired by the imaging unit. Is included, and in response to detection of the person's face, the holder is informed that there is a person ahead in the direction of travel of the holder.

  According to the present invention, it is possible to provide a contact avoidance measure with another person while ensuring the convenience of the mobile terminal.

1 is a block diagram of a mobile terminal according to a first exemplary embodiment. 3 is a flowchart illustrating an operation of the mobile terminal according to the first exemplary embodiment. It is a block diagram of the portable terminal concerning Embodiment 2. FIG. 10 is a flowchart illustrating an operation of the mobile terminal according to the second exemplary embodiment. It is a figure for demonstrating the operation state of the holder | retainer of the portable terminal concerning Embodiment 2. FIG. (A) is a figure which shows the case where a holder | retainer is a stationary state. (B) is a figure which shows the case where a holder | retainer is a walking state. (C) is a figure which shows the case where the other party approaches. FIG. 10 is a diagram for explaining a transition of a display unit of the mobile terminal according to the second exemplary embodiment. (A) is a figure which shows a display part in case a holder | retainer is a stationary state. (B) is a figure which shows a display part in case a holder | retainer is a walking state. (C) is a figure which shows a display part when an other party approaches. FIG. 6 is a block diagram of a mobile terminal according to a third exemplary embodiment. 10 is a flowchart showing the operation of the mobile terminal according to the third exemplary embodiment. It is an example of the operation state determination table concerning Embodiment 3.

<Embodiment 1>
Embodiments of the present invention will be described below with reference to the drawings. A block diagram of the mobile terminal 1 according to the present embodiment is shown in FIG. The mobile terminal 1 includes a display unit 11, a camera 12, a face recognition processing unit 13, a control unit 14, and a notification unit 15. Here, the mobile terminal 1 is, for example, a mobile phone, a mobile audio player, a tablet PC (Personal Computer), a game machine, or the like.

  The display unit 11 displays an image to be displayed as the application is executed. The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display. Here, the application means an application that exhibits a function by being displayed on the display unit 11 such as a menu, e-mail, the Internet, a television, and a moving image reproduction. Normally, the application includes an application that does not display an image on the display unit 11 and functions inside the mobile terminal 1, but in the following description, an application that displays an image on the display unit 11 is simply referred to as an application. Call it.

  The camera 12 (imaging means) performs an imaging process with the forward direction of the holder of the mobile terminal 1 in the imaging range. Therefore, it is preferable that the camera 12 is disposed on a surface opposite to the surface on which the display unit 11 is disposed. The camera 12 includes a lens, an A / D conversion function, an image processing function, and the like, and generates image data necessary for face recognition processing.

  The face recognition processing unit 13 detects that a human face is included in a subject image acquired by the camera 12 based on image data generated by the camera 12. Since the technology for recognizing a face in image data is a known technology, detailed description thereof is omitted.

  The control unit 14 detects that the mobile terminal 1 is moving (the user is moving while holding the mobile terminal 1). And the control part 14 detects that the image is displayed on the display part 11 with execution of an application in the condition where the portable terminal 1 is moving, and performs the face recognition process with respect to the face recognition process part 13. Instruct execution. Note that the movement of the mobile terminal 1 can be detected using the position information of the mobile terminal 1 acquired by the GPS device, the detection result of the acceleration sensor, or the like. Further, the control unit 14 may detect the movement of the mobile terminal 1 based on a change in the position of the object in a plurality of images continuously captured by the camera 12.

  The notification unit 15 notifies the presence of a person in the forward direction of the holder of the mobile terminal 1 in accordance with the detection of the human face by the face recognition processing unit 13 based on an instruction from the control unit 14. As the notification method, for example, warning display, sound, or vibration in the display unit 11 is used.

  Next, the operation of the mobile terminal 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. First, the control unit 14 detects that an image is displayed on the display unit 11 while the mobile terminal 1 is moving (step S101). When it is detected that the image is displayed on the display unit 11 while the mobile terminal 1 is moving (step S101: Yes), the control unit 14 instructs the face recognition processing unit 13 to execute the face recognition processing. To do. In addition, the control unit 14 instructs the camera 12 to take an image in front of the holder of the mobile terminal 1 in the traveling direction.

  Then, the camera 12 images the front of the holder in the traveling direction (step S102). The camera 12 outputs the image data generated according to the imaging process to the face recognition processing unit 13. Note that the timing of the imaging process of the camera 12 is not limited to the timing of step S102. For example, the camera 12 may perform an imaging process before detection by the control unit 14.

  The face recognition processing unit 13 performs face recognition processing based on the image data input from the camera 12 (step S103). When a human face is included in the subject image (step S103: Yes), the face recognition processing unit 13 notifies the control unit 14 to that effect.

  When receiving a notification that a human face is included, the control unit 14 instructs the notification unit 15 to perform notification. And the alerting | reporting part 15 alert | reports that a person exists ahead of the advancing direction of the holder | retainer of the portable terminal 1 (step S104).

  In addition, when the portable terminal 1 is not moving, or when an image displayed with the execution of the application is not displayed on the display unit 11 (step S101: No), or in the subject image captured by the camera 12 If there is no person's face (step S103: No), the control unit 14 determines again that an image is displayed on the display unit 11 while the mobile terminal 1 is moving (step S101).

  As described above, according to the configuration of the mobile terminal 1 according to the present embodiment, the control unit 14 displays an image displayed along with the execution of the application on the display unit 11 while the mobile terminal 1 is moving. When it is detected that the image is displayed, the face recognition processing unit 13 executes face recognition processing. And when a person's face is recognized, the alerting | reporting part 15 alert | reports that there is a person ahead of the advancing direction. Accordingly, when an image is displayed on the display unit 11 while the mobile terminal 1 is moving, that is, the holder of the mobile terminal 1 watches the image displayed on the display unit 11 while moving. Even if it is a case, a holder | retainer can recognize that a person exists ahead of the advancing direction based on the alerting | reporting of the alerting | reporting part 15. Therefore, the holder can avoid contact with others. In addition, it is possible to prevent the holder from causing trouble to others.

  Furthermore, the camera 12 images the front of the holder of the mobile terminal 1 in the traveling direction, and the notification unit 15 notifies that there is a person ahead of the holder in the traveling direction. In other words, when there is no person in the forward direction of the holder (when a person's face is not recognized in the captured image), an image is displayed on the display unit 11 while the mobile terminal 1 is moving. Even if it exists, the alerting | reporting part 15 does not alert | report. Therefore, the convenience of the portable terminal 1 can be ensured.

  Specifically, for example, when there is no person in front of the holder, the possibility that the holder contacts with another person is low. Therefore, in such a situation, when a notification operation (for example, a pop-up of a warning message on the display screen) is performed, the holder feels that extra notification has been performed. That is, an unpleasant feeling is given to the holder. However, according to the present embodiment, the notification operation is not performed in an environment where there is no person who may contact the holder. As a result, the holder can recognize an image displayed as the application is executed, and thus does not feel uncomfortable or inconvenient.

<Embodiment 2>
A second embodiment according to the present invention will be described. FIG. 3 shows a block diagram of the mobile terminal 2 according to the present embodiment. The portable terminal 2 includes a display unit 11, a camera 12, a face recognition processing unit 13, a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a work memory 23, a key input unit 24, The display control unit 25 and the GPS receiver 26 are provided. Note that the display unit 11, the camera 12, and the face recognition processing unit 13 are the same as those of the mobile terminal 1, and thus description thereof will be omitted as appropriate.

  CPU21 respond | corresponds to the control part 14 of FIG. 1, and is connected with each part of the portable terminal 2 via the bus | bath. The CPU 21 is a central control device that executes various processes and instructions for each unit based on an execution program and input data.

  The ROM 22 stores a program executed by the CPU 21 (for example, a program for controlling the camera 12, the face recognition processing unit 13, the display control unit 25, etc.). In addition, a program for determining whether or not an application is executed, a program for detecting movement of the mobile terminal 2 based on a received signal of the GPS receiver 26, and the like are also stored. It should be noted that detection of an image being displayed on the display unit 11 as the application is executed is performed by, for example, storing information specifying the application in the ROM 22 in advance, such as the file name and path of the application to be displayed on the display unit 11. Store it. Then, the CPU 21 can detect by detecting whether the file name, path, etc. of the application being executed matches the file name, path, etc. of the application stored in the ROM 22.

  The work memory 23 is composed of, for example, a RAM (Random Access Memory), and stores data temporarily required when the CPU 21 executes a program. The key input unit 24 is an input circuit that receives input from various keys provided in the mobile terminal 2. The display control unit 25 controls the display on the display unit 11.

  The GPS receiver 26 (movement detection means) detects information indicating that the mobile terminal 2 is moving. More specifically, the GPS receiver 26 receives a GPS signal and acquires position information of the mobile terminal 2 (information for specifying the position of the mobile terminal 2).

  Next, the operation of the mobile terminal 2 according to the present embodiment will be described with reference to the flowchart of FIG. First, the CPU 21 determines whether an image is displayed as the application is executed (step S201).

  When the image is displayed (step S201: Yes), the CPU 21 instructs the GPS receiver 26 to receive a GPS signal. The GPS receiver 26 receives a GPS signal based on an instruction from the CPU 21 and acquires position information of the mobile terminal 2 (step S202).

  And CPU21 determines whether the portable terminal 2 is moving based on the positional information which the GPS receiver 26 acquired (step S203). That is, the CPU 21 determines whether or not the position information of the mobile terminal 2 has changed.

  When the portable terminal 2 is moving (step S203: Yes), the CPU 21 instructs the camera 12 to execute an imaging process. Based on the instruction from the CPU 21, the camera 12 captures an image in front of the holder of the portable terminal 2 in the traveling direction (step S204). The camera 12 outputs the generated image data to the face recognition processing unit 13.

  The CPU 21 issues an instruction to the camera 12 and instructs the face recognition processing unit 13 to execute face recognition processing on the image data generated by the camera 12. The face recognition processing unit 13 executes face recognition processing based on an instruction from the CPU 21 (step S205).

  When the face recognition processing unit 13 detects a human face (step S205: Yes), the face recognition processing unit 13 notifies the CPU 21 to that effect. When receiving a notification that a human face is included, the CPU 21 instructs the display control unit 25 to notify. Then, the display control unit 25 causes the display unit 11 to display a warning message that there is a person in front of the holder of the portable terminal 2 in the traveling direction (step S206). Thereby, since the holder of the portable terminal 2 can recognize that there is a person ahead in the traveling direction, contact with the person can be avoided.

  In addition, when there is no image display accompanying execution of an application (step S201: No), when the portable terminal 2 is not moving (step S203: No), or when a human face is not included in image data (step S205). : No), the CPU 21 determines again whether or not an image is displayed on the display unit 11 (step S201).

  Here, the operation of the portable terminal 2 will be described in detail with reference to FIGS. FIG. 5 is a diagram illustrating a movement operation of the holder 100 of the mobile terminal 2. FIG. 6 is a diagram illustrating transition of the display screen of the display unit 11 of the mobile terminal 2. At this time, the display state of the display unit 11 in FIGS. 5A to 5C corresponds to the display state of the display unit 11 illustrated in FIGS.

  In FIG. 5A, the holder 100 executes the application, stops and looks at the display unit 11 of the mobile terminal 2. At this time, an image (an application screen such as a mail screen or an Internet screen) corresponding to the application currently being executed is displayed on the display unit 11 (see FIG. 6A).

  Next, the holder 100 starts walking while executing the application (see FIG. 5B). When the holder 100 walks, the mobile terminal 2 moves. At this time, CPU21 detects that the image is displayed on the display part 11 with execution of an application in the condition where the portable terminal 2 is moving. Then, the CPU 21 instructs the camera 12 to execute the imaging process and also instructs the face recognition processing unit 13 to execute the face recognition process.

  At this time, even if the camera 12 is capturing an image ahead of the holder 100 in the direction of travel based on an instruction from the CPU 21, a preview image of the captured subject image is not displayed on the display unit 11. That is, the image displayed on the display unit 11 does not change when the holder 100 is stationary and walking (see FIGS. 6A and 6B). Therefore, the convenience of the portable terminal 2 can be ensured.

  When the opponent 200 walks from the front of the holder 100 in the traveling direction, the human face is included in the image data captured by the camera 12. When the face recognition processing unit 13 detects that a human face is included in the image data, the display control unit 25 causes the display unit 11 to pop up a warning message 300 (see FIG. 6C). Thereby, the holder | retainer 100 which was gazing at the display part 11 can recognize that the other party 200 exists ahead (refer FIG.5 (c)). As a result, it is possible to avoid contact with another person.

  Thereafter, when the holder 100 stops or the execution of the application is finished, the CPU 21 instructs the camera 12 to stop activation and instructs the face recognition processing unit 13 to stop the face recognition processing. When the execution of the application is completed, the CPU 21 instructs the GPS receiver 26 to stop receiving the GPS signal.

  As described above, according to the configuration of the mobile terminal 2 according to the present embodiment, the GPS receiver 26 acquires the position information of the mobile terminal 2. Therefore, the CPU 21 can detect the movement of the mobile terminal 2 based on the position information of the mobile terminal 2. Of course, since a warning message is displayed on the display unit 11, the holder can avoid contact with another person and does not bother others.

  Here, when the holder of the portable terminal 2 is on a vehicle such as a train or a car, the position information of the portable terminal 2 acquired by the GPS receiver 26 changes. Therefore, when the holder executes the application in the train, the camera 12 executes an imaging process, and the face recognition processing unit 13 executes the face recognition process. However, when riding on a train or the like, the holder is likely to stop or sit, so the possibility of contact with others is low. Therefore, the need for warning messages is low.

  Therefore, the CPU 21 detects the moving speed of the portable terminal 2 based on the position information of the portable terminal 2, and when the moving speed of the portable terminal 2 exceeds a predetermined speed, the imaging process of the camera 12 is stopped and the standby is performed. It is good also as a structure made to be in a state. Specifically, for example, information indicating a predetermined speed is stored in the ROM 22 in advance. Then, the CPU 21 compares the moving speed of the mobile terminal 2 with a predetermined speed to determine whether or not the moving speed of the mobile terminal 2 has exceeded a predetermined speed. When the moving speed of the portable terminal 2 exceeds a predetermined speed, the CPU 21 causes the camera 12 to enter a standby state. The predetermined speed means a speed exceeding the walking speed or the traveling speed of the holder. Thereby, when the portable terminal 2 is moving at a speed faster than the predetermined speed, the imaging process is not performed, and the warning message is not displayed on the display unit 11. That is, the warning message is not displayed when the holder is on a vehicle such as a train or a car. As a result, an unnecessary warning message can be prevented from being displayed on the display unit 11. Therefore, it is possible to further suppress discomfort to the holder. In particular, when riding on a train, there is a very high possibility that the face of another person in the train will be captured, so that a remarkable effect can be obtained.

<Embodiment 3>
A third embodiment according to the present invention will be described. FIG. 7 shows the configuration of the mobile terminal 3 according to the present embodiment. The mobile terminal 3 includes an acceleration sensor 31 instead of the GPS receiver 26 of the mobile terminal 2. The ROM 22 stores an operation state determination table in addition to various programs. Since other configurations are the same as those of the mobile terminal 2, the description thereof will be omitted as appropriate.

  The acceleration sensor 31 is, for example, a sensor that detects acceleration in three orthogonal axes, and detects vibration that occurs when the holder of the mobile terminal 3 walks.

  Next, the operation of the mobile terminal 3 according to the present embodiment will be described with reference to the flowchart shown in FIG. First, the CPU 21 determines whether an image is displayed on the display unit 11 as the application is executed (step S301). When the image is displayed (step S301: Yes), the CPU 21 instructs the acceleration sensor 31 to detect vibration. And the acceleration sensor 31 detects the vibration which arises in the portable terminal 3 (step S302).

  The CPU 21 refers to the operation state determination table stored in the ROM 22 (step S303), and determines whether or not the mobile terminal 3 is moving based on the vibration cycle detected by the acceleration sensor 31 (step S304). .

  Here, the operation state determination table will be described in detail. An example of the operation state determination table is shown in FIG. In the operation state determination table, a period of vibration (up and down movement by walking of the holder) detected by the acceleration sensor 31 and an interval of the imaging process of the camera 12 are stored in association with each other. Note that, as shown in FIG. 9, the period of vibration and the operating state of the holder of the mobile terminal 3 may be further stored in association with each other.

  Specifically, when the period of vibration detected using the acceleration sensor 31 is 2 seconds (first threshold) or more, that is, 2 seconds from the first vertical movement to the next vertical movement. When the above interval is available, the CPU 21 places the camera 12 in a standby state. Further, the CPU 21 determines that the operation state of the holder at this time is a stationary or quasi-stationary state. Note that the quasi-static state means a state in which the holder hardly moves and is unlikely to come into contact with a person.

  When the period of vibration detected using the acceleration sensor 31 is less than 2 seconds to 0.5 seconds or more, the CPU 21 causes the camera 12 to perform imaging processing at intervals of 3 seconds. At this time, the CPU 21 determines that the holder is in a walking state. Similarly, when the period of vibration detected using the acceleration sensor 31 is less than 0.5 seconds to 0.1 seconds or more, the CPU 21 causes the camera 12 to execute imaging processing at intervals of 1 second. At this time, the CPU 21 determines that the holder is in the traveling state.

  In the normal operation of the holder of the mobile terminal 3, it is unlikely that the vibration period will be less than 0.1 seconds. In this case, the CPU 21 determines that an error has occurred. Therefore, when the period of vibration detected using the acceleration sensor 31 is less than 0.1 second (second threshold), the CPU 21 places the camera 12 in a standby state. Note that an average value of vibration periods in a predetermined time may be used as the vibration period. Further, the vibration period and imaging interval parameters are not limited to the values shown in FIG.

  That is, in step S304, when the period of vibration detected by the acceleration sensor 31 is less than 2 seconds to 0.1 seconds or more, the CPU 21 determines that the mobile terminal 3 is moving. On the other hand, when the period of vibration detected by the acceleration sensor is 2 seconds or more or less than 0.1 seconds, the CPU 21 determines that the mobile terminal 3 is not moving.

  When the mobile terminal 3 is moving (step S304: Yes), the CPU 21 instructs the camera 12 to execute the imaging process and also instructs the face recognition processing unit 13 to execute the face recognition process. And the camera 12 performs an imaging process based on the instruction | indication of CPU21 (step S305). The camera 12 outputs the image data generated according to the imaging process to the face recognition processing unit 13.

  The face recognition processing unit 13 determines whether or not a human face is included in the image data (step S306). When a human face is included in the image data (step S306: Yes), the display control unit 25 displays a warning message on the display unit 11 (step S307). Thereby, the holder can avoid contact with the opponent.

  On the other hand, when there is no image display accompanying the execution of the application (step S301: No), when the portable terminal 3 is not moving (step S304: No), or when the human face is not included in the image data (step) S306: No), the CPU 21 determines again whether an image is displayed (step S301).

  As described above, in the configuration of the mobile terminal 3 according to the present embodiment, the acceleration sensor 31 detects vibration generated in the mobile terminal 3. Therefore, the CPU 21 can detect that the mobile terminal 3 is moving based on the vibration period detected using the acceleration sensor 31. Of course, since a warning message is displayed on the display unit 11, the holder can avoid contact with another person and does not bother others.

  Further, the CPU 21 controls the imaging interval of the camera 12 according to the operating state of the holder. Specifically, when the holder is in a stationary state or in an error state, the camera 12 is not activated and is placed in a standby state. That is, when the holder is not in contact with a person, the camera 12 does not perform an imaging process. Therefore, power consumption required for the imaging process can be reduced.

  On the other hand, when the holder is moving, the camera 12 performs the imaging process continuously, and performs the imaging process intermittently. Therefore, even when the camera 12 is activated, the power consumption required for the imaging process can be reduced. Furthermore, usually, the faster the holder moves, the faster the distance between the holder and the opponent. For this reason, in order to avoid contact with a person when the moving speed of the holder is high, the camera 12 needs to capture images at short intervals. In the present embodiment, the CPU 21 adjusts the imaging interval of the camera 12 according to the moving speed (walking or running) of the holder. Therefore, power consumption can be reduced while avoiding contact with a person.

  The display control unit 25 may display a warning message on the display unit 11 when the area of the human face with respect to the image captured by the camera 12 exceeds a predetermined size. Here, the predetermined size means, for example, a region area of a person's face imaged in a state where the distance between the holder and the opponent is so far as to avoid contact. If the face area of the person included in the captured image data is less than a predetermined size, that is, if there is an opponent at a position away from the mobile terminal 3, the possibility that the holder and the opponent are in contact with each other is Low. Therefore, even if a human face is recognized, no warning message is displayed on the display unit 11.

  On the other hand, when the face area of the person included in the image data exceeds a predetermined size, that is, when there is an opponent at a position near the mobile terminal 3, the possibility that the holder and the opponent are in contact with each other is high. Therefore, a warning message is displayed on the display unit 11. As a result, when the opponent is present at a sufficiently distant position, the warning message is not displayed even if the face of the opponent is recognized. As a result, the convenience of the mobile terminal 3 can be ensured. At this time, the holder of the mobile terminal 3 may arbitrarily set a predetermined size.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed and combined without departing from the spirit of the present invention. For example, the determination of the presence / absence of image display by the CPU 21, the determination of the presence / absence of movement of the mobile terminal, and the processing order are not limited to the above-described embodiment.

1-3 Mobile terminal 11 Display unit 12 Camera 13 Face recognition processing unit 14 Control unit 15 Notification unit 21 CPU
22 ROM
23 Work Memory 24 Key Input Unit 25 Display Control Unit 26 GPS Receiver 31 Acceleration Sensor 100 Holder 200 Opponent 300 Warning Message

Claims (10)

A portable terminal comprising display means for displaying an image to be displayed in accordance with execution of an application,
An imaging means having an imaging range in front of the traveling direction of the holder of the mobile terminal;
Face recognition processing means for detecting that a human face is included in a subject image acquired by the imaging means based on processing on output data from the imaging means;
Control that detects that an image is displayed on the display unit as the application is executed while the mobile terminal is moving, and instructs the face recognition processing unit to execute face recognition processing Means,
Informing means for informing the holder that there is a person ahead in the direction of travel of the holder in response to detection of the person's face by the face recognition processing means based on the instruction of the control means;
A mobile terminal comprising:   The mobile terminal according to claim 1, wherein the imaging unit is disposed on a surface opposite to a surface on which the display unit is disposed. A movement detecting means for detecting information indicating that the portable terminal is moving;
The mobile terminal according to claim 1, wherein the control unit detects that the mobile terminal is moving based on information detected by the movement detection unit. The movement detection means includes an acceleration sensor,
The control means detects the movement of the mobile terminal based on a vibration cycle detected using the acceleration sensor, and the shorter the vibration cycle detected using the acceleration sensor, the shorter the interval. The portable terminal according to claim 3, wherein an instruction to execute an imaging process is given to the imaging unit. A memory in which the period of the vibration detected using the acceleration sensor and the imaging interval of the imaging unit are stored in association with each other;
The portable terminal according to claim 4, wherein the control unit refers to the memory and instructs the imaging unit to perform an imaging process at the imaging interval corresponding to a detection result of the acceleration sensor.   The control means determines whether or not the period of vibration detected using the acceleration sensor is equal to or greater than a first threshold, and waits for the imaging means when the period of vibration is equal to or greater than the first threshold. The mobile terminal according to claim 4 or 5, which is put into a state.   The control means determines whether or not a vibration cycle detected using the acceleration sensor is less than a second threshold value, and waits for the imaging means when the vibration cycle is less than the second threshold value. The mobile terminal according to claim 4 or 5, which is put into a state. The movement detection means includes a GPS receiver that receives GPS signals,
The control means detects the movement of the portable terminal based on the position information of the portable terminal specified from the GPS signal, calculates the movement speed of the portable terminal, and the movement speed of the portable terminal is The portable terminal according to any one of claims 3 to 7, wherein when the speed is higher than a predetermined speed, the imaging unit is placed in a standby state.   The portable terminal according to any one of claims 1 to 8, wherein the control unit does not display a preview screen on the display unit during an imaging process of the imaging unit. A display method for displaying an image to be displayed in accordance with execution of an application, an image pickup unit having an image pickup range in front of a traveling direction of a holder of the mobile terminal, and a control method for a mobile terminal comprising:
In the situation where the mobile terminal is moving, it is detected that an image is displayed on the display means as the application is executed,
Detecting that a human face is included in the subject image acquired by the imaging means;
A method for controlling a portable terminal that notifies the holder that a person is in front of the holder in the traveling direction in response to detection of the face of the person.

Images