JP2013172360A - Portable terminal device, operation control method of portable terminal device, and operation control program of portable terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To effectively suppress use of a portable terminal device such as a portable telephone terminal when the portable terminal device is used only by a driver of a vehicle.SOLUTION: When an operation state detection unit 151 detects that a portable terminal device is being used, and a movement detection unit 151 detects that the portable terminal device is on the move in a vehicle, a restriction execution unit 153 shifts the portable terminal device to a sleep mode to stop a predetermined function. The inside of the vehicle is subsequently photographed via a camera unit 127, and then a camera video image analysis unit 155 analyzes a photographed video image and determines whether or not a user of the portable terminal device is a driver. When the camera video image analysis unit 155 determines that the user of the portable terminal device is not the driver, a restriction releasing unit 156 restores the stopped predetermined function.

Description

  The present invention relates to an apparatus, a method, and a program for suppressing the use of a driver of an automobile, but not using a driver other than the driver for a mobile terminal device such as a mobile phone terminal.

  An increasing number of people are driving cars while using mobile phone terminals. For example, in the case of a conventional mobile phone terminal, e-mail is referred to, created, transmitted / received, and in a high-function mobile phone terminal called a smart phone, an SNS (Social Networking Service) is used. ing. There are also many people who drive a car while making a phone call using a mobile phone terminal. The use of mobile phone terminals while driving a car is an illegal act, but the reality is that it cannot be adequately controlled. Many traffic accidents have occurred due to the use of mobile phone terminals while driving.

  Under such a background, an invention has been made to suppress dangerous use of a mobile phone terminal while driving a car. Patent Document 1 described later discloses an invention in which a detection transmission unit 200 having a driving state detection unit is provided on the automobile side, and the use of the mobile phone terminal 100 is restricted based on the detection result. Further, in Patent Document 2 described later, a mobile phone that can make a response impossible to an incoming call to a mobile phone terminal during operation by using a radio signal at the time of opening and closing a door sent out by a keyless entry key. An invention relating to a terminal is disclosed. These provide an effective means for suppressing the use of mobile phone terminals while driving a car.

JP 2005-236655 A JP 2002-009902 A

  However, in the case of the invention described in Patent Document 1 described above, the detection transmission unit 200 must be provided also on the automobile side, which cannot be realized only by the mobile phone terminal. In the case of Patent Document 2 described above, although it is possible not to respond to an incoming call while driving, use of the e-mail function, use of an SNS or a Web page through the Internet cannot be suppressed. Even if the use of the technology described in Patent Document 1 and Patent Document 2 described above can be used to suppress the use of the e-mail function or the Internet, it is desirable to suppress the use of the mobile phone terminal of the car operator. I would like to avoid restraining passengers' use of mobile phone terminals. This is because it is inconvenient for taxi and bus passengers to lose access to email and the Internet.

  In view of the above points, the present invention suppresses, for example, the use of a mobile terminal device such as a mobile phone terminal while driving by a driver of an automobile, and does not suppress the use if it is used by a person other than the driver. Objective.

In order to solve the above-mentioned problem, the mobile terminal device of the invention described in claim 1 is:
A use detecting means for detecting whether or not it is in use;
Movement detection means for detecting whether or not the vehicle is moving when it is detected that the vehicle is in use;
Limiting execution means for stopping a predetermined function when it is detected that the vehicle is moving,
Imaging means;
A discriminating means for analyzing a video photographed through the imaging means after stopping a predetermined function and discriminating whether or not the user of the own machine is a driver;
And a restriction releasing means for recovering the predetermined function that has been stopped when it is determined that the user of the device is not a driver.

  According to the portable terminal device of the first aspect of the present invention, when the use detection unit detects that the mobile terminal device is in use, and the movement detection unit detects that the vehicle is moving. First, the restriction execution unit stops the predetermined function. Thereafter, when photographing inside the vehicle is performed through the image pickup means, the determination means analyzes the captured image and determines whether or not the user of the own device is a driver. When it is determined by the determination means that the user of the own device is not a driver, the restriction release means resumes (recovers) the predetermined function stopped by the restriction execution means.

  As described above, when being used, the mobile terminal device that has detected that the vehicle is moving is temporarily stopped by stopping a predetermined function. Then, when it is determined that the user of the mobile terminal device is not a driver by analyzing the video taken through the imaging means of the mobile terminal device, the predetermined function that has been stopped is restored. When the portable terminal device is used by the driver, the predetermined function that has been stopped is not recovered. Therefore, although the use of the portable terminal device used by the driver of the car can be effectively suppressed, it can be prevented from being suppressed if it is used by other than the driver.

  According to the present invention, it is possible to effectively suppress the use of a mobile terminal device such as a mobile phone terminal during driving by a car driver. In addition, it is possible to prevent unnecessary use of a portable terminal device other than the driver while traveling in an automobile.

It is a block diagram for demonstrating the structural example of the mobile telephone terminal 1 of embodiment. 4 is a flowchart for explaining use restriction implementation / cancellation processing performed in the mobile phone terminal 1; 6 is a flowchart for explaining a sleep mode release confirmation process executed in step S107 of FIG. It is a figure which shows the example of the image | video in a vehicle image | photographed through the camera part 127. FIG. It is a figure which shows the example of the image | video in a vehicle image | photographed through the camera part 127. FIG.

  Hereinafter, embodiments of the apparatus, method, and program of the present invention will be described with reference to the drawings. The present invention is applicable to various portable terminal devices having a camera function such as a cellular phone terminal, a tablet terminal, a portable game machine, and a PDA (Personal Digital Assistants). However, in the embodiment described below, in order to simplify the description, a case where the present invention is applied to a mobile phone terminal with a camera function that is widely used will be described as an example.

[Configuration example of mobile phone terminal 1]
FIG. 1 is a block diagram for explaining a configuration example of the mobile phone terminal 1 of this embodiment. First, each part which comprises the mobile telephone terminal 1 is demonstrated.

[Basic components of mobile phone terminal 1]
The control unit 100 controls each unit of the cellular phone terminal 1, and is a computer in which a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected through a CPU bus 104. Device. The storage device 110 includes a nonvolatile memory as a recording medium, and performs writing / recording holding / reading / deleting various application programs and data obtained by various processes to the nonvolatile memory. In this embodiment, the storage device 110 includes, for example, map data provided from a map server on the Internet or a pattern for determining whether the user of the mobile phone terminal 1 is a driver. Recognition video data and the like are also stored and held.

  The transmission / reception antenna 111 and the wireless communication unit 112 realize a function of performing communication through a wide area network such as a mobile phone network or the Internet. A handset (speaker) 113 and a handset (microphone) 114 are for making a call. That is, the wireless communication unit 112 connects a call line to the other party through the mobile phone network, and enables a call through the handset (speaker) 113 and the handset (microphone) 114. In addition, the wireless communication unit 112 is connected to the Internet, enables transmission / reception of data through the Internet, transmission / reception of electronic mail, browsing of Web pages disclosed on the Internet, and the like.

  The key operation unit 121 includes hardware keys provided in the mobile phone terminal 1 and accepts operation inputs from the user. The display processing unit 122 and the display unit 123 are for displaying display information such as various videos (images) and display messages. The touch panel 124 is affixed to the display screen of the display unit 123, detects a contact position (contact coordinates) by an indicator such as a user's finger, and notifies the control unit 100 of this. Therefore, the touch panel 124 constitutes an input interface together with display information displayed on the display screen of the display unit 123 whose display position is controlled by the control unit 100. The audio output unit 125, the speaker 126A, and the audio output terminal 126B are for outputting various audio information. The audio output terminal 126B is used with an earphone or a headphone connected thereto.

  The camera unit 127 includes an imaging lens, an imaging device, a camera signal processing circuit, and the like, and has a function of capturing an image of a subject and capturing the image as video (image) data of a digital signal. At the time of shooting, the video data captured through the camera unit 127 is supplied to the display processing unit 122 through the control unit 100. The display processing unit 122 forms a video signal to be supplied to the display unit 123 from the video data supplied thereto, and supplies this to the display unit 123. Thus, the video captured by the camera unit 127 is displayed on the display unit 123, and the user can take a picture while confirming the display image on the display unit 123.

  The microphone 128 and the audio input unit 129 have a function of collecting audio and capturing it as a digital signal, for example, when shooting a video through the camera unit 127. When a video recording instruction (recording instruction) is input through the key operation unit 121 or the touch panel 124, video data captured through the camera unit 127 and audio captured through the microphone 128 and the audio input unit 129 are displayed. For example, the data can be recorded (recorded or recorded) in a nonvolatile memory of the storage device 110.

  The vibrator 131 notifies the user of the occurrence of an incoming call or a warning by generating a vibration. The ringer 132 notifies the user of the occurrence of an incoming call or warning by generating a predetermined ringing tone or warning sound. The acceleration sensor 141 detects, for example, the inclination of the mobile phone terminal 1 to determine the vertical direction of the display unit 123, or detects vibration to realize the pedometer function provided in the mobile phone terminal 1. The GPS unit 142 and the GPS antenna 143 are for measuring the current position of the own device.

  The cellular phone terminal 1 having these configurations can make and receive calls. It is also possible to create and refer to an e-mail, access the Internet to send and receive e-mails, browse web pages, and use SNS. Further, for example, the video / audio content stored and held in the storage device 110 is reproduced and viewed through the display processing unit 122, the display unit 123, the audio output unit 125, and the speaker 126A, and the game is executed in the same manner. And can have fun. Of course, the music content stored and held in the storage device 110 can be reproduced through the audio output unit 125 and the audio output terminal 126B and listened to using an earphone or the like.

[About the part that realizes the function to suppress use while driving]
The cellular phone terminal 1 according to this embodiment includes an operation state detection unit 151, a movement detection unit 152, a warning control unit 153, and a restriction as a part that realizes a function of suppressing use when the user is driving a car. An implementation unit 154, a camera image analysis unit 155, and a restriction release unit 156 are provided.

  The operation state detection unit 151 detects whether or not the operation state detection unit 151 is being used by the user based on the control state of each unit by the control unit 100. Specifically, during a call, during processing such as e-mail reference, creation, transmission / reception, browsing a web page, using an SNS, executing various applications, playing back audio / video content, audio content, etc. It is detected that it is in use during the execution of the process. Further, for example, when receiving input of information for executing a predetermined process such as receiving input of a telephone number or receiving input of setting information, it is detected that it is being used. In other words, it is detected that the mobile phone terminal 1 is not in use when it is in a standby state or when the power is turned off.

  The movement detection unit 152 determines whether the user using the own device is moving in the car when the operation state detection unit 151 determines that the own device is being used under the control of the control unit 100. Detect whether or not. The detection process is performed based on one or more of the detection output of the acceleration sensor 141, the change in the current position measured by the GPS unit 142, and whether or not the video captured through the camera unit 127 is a video in a car. For example, when the acceleration sensor 141 detects vibration that can be detected when the vehicle is moving by an automobile, and can detect that the vehicle is moving at high speed based on the change in the current position from the GPS unit 142. Can be detected as moving in an automobile. In addition, information such as whether or not the video taken through the camera unit 127 is taken from inside the automobile and whether or not the moving route is on a road may be considered. Whether or not the travel route is on a road is confirmed based on the current position from the GPS unit 142, for example, by map matching with map data obtained from a map server on the Internet and stored in the recording device 110. Can do.

  The warning control unit 153 may use the mobile phone terminal 1 while driving a car when the movement detecting unit 152 detects that the user using the mobile device is moving in a car. Therefore, a process of warning that the use of the mobile phone terminal 1 is suppressed is performed. The warning control unit 153 vibrates the vibrator 131 through the control unit 100, supplies display message data for warning to the display processing unit 122 through the control unit 100, and displays a warning message on the display unit 123. Make a warning. In addition, the warning control unit 153 performs an operation for certifying that the person who is not the driver takes a picture of the driver's seat (driver) and is not the driver when the person who is not the driver wants to continue using the mobile phone terminal 1 in the warning. Output including a message prompting you to do it.

  Note that the warning message can be displayed in various display modes such that a balloon message is displayed, for example. In addition, the warning control unit 153 emits a warning sound from the ringer 132, supplies warning voice message data to the voice output unit 125 through the control unit 100, and gives a voice warning message through the speaker 126A and the voice output terminal 126B. Can be warned.

  After the warning process by the warning control unit 153, the restriction execution unit 154 performs a process of transitioning the own apparatus to a sleep mode that is a power-saving standby power supply mode. In this embodiment, the sleep mode basically stops processing other than reception of radio waves. Therefore, it is impossible to make a phone call, use an electronic mail function, use the Internet, or execute various applications. However, as will be described in detail later, the power is supplied to the control unit 100, and the camera unit 127, the camera image analysis unit 155, the restriction release unit 156, and the like can be operated by receiving an operation input from the user. Maintains a possible state.

  The camera video analysis unit 155 has a function of analyzing video data obtained by shooting through the camera unit 127 and determining whether or not the user of the own device is a driver based on the analysis result. Specifically, if the vehicle handle and the left and right hands touching the handle can be photographed, it can be determined that the user of the mobile phone terminal 1 who is the photographer is not a driver. Therefore, the camera video analysis unit 155 compares the video data from the camera unit 127 with the video data for pattern matching prepared in advance in the storage device 110 as described above. Then, the camera video analysis unit 155 drives the user of the mobile phone terminal 1 depending on whether or not the video based on the video data from the camera unit 127 includes a car handle and left and right hands touching the handle. It is discriminated whether it is a person.

  The restriction release unit 156 shifts from the sleep mode to the normal operation mode when the camera image analysis unit 155 determines that the user of the mobile phone terminal 1 is not a driver after the restriction execution unit 154 shifts to the sleep mode. A process for returning (restriction release process) is performed. Thereby, when the user of the mobile phone terminal 1 is a driver, use during driving is suppressed, but when the user is not a driver, use of the mobile phone terminal 1 can be prevented from being suppressed more than necessary.

  As described above, when the cellular phone terminal 1 according to this embodiment detects that the mobile phone terminal 1 is moving by an automobile when the mobile phone terminal 1 is in use, the mobile phone terminal 1 transits to the sleep mode once. When it can be confirmed that the user of the mobile phone terminal 1 is not a driver based on video data obtained by photographing through the camera unit 127, the normal operation mode is restored. However, when the user of the mobile phone terminal 1 is a driver, the use of the mobile phone terminal 1 is suppressed because it cannot be proved that the user is not a driver based on video data obtained by photographing. Is done. That is, the use of the mobile phone terminal 1 while the driver is driving can be effectively suppressed, and the use of the mobile phone terminal 1 when moving in a car other than the driver can be prevented from being suppressed more than necessary.

[About processing of the mobile phone terminal 1 to suppress use while driving a car]
Next, when the user is a car driver, use restriction (suppression) is performed in the mobile phone terminal 1 of this embodiment having the configuration shown in FIG. A process (usage restriction implementation / cancellation process) for releasing the restriction (suppression) of use will be described. FIG. 2 is a flowchart for explaining the use restriction implementation / cancellation process. The process shown in FIG. 2 is mainly executed in the control unit 100 at predetermined timings when the mobile phone terminal 1 is powered on.

  When the process shown in FIG. 2 is executed, the control unit 100 controls the operation state detection unit 151 to detect its own operation state (step S101). And the control part 100 discriminate | determines whether it is in the state currently used by the user based on the detection result of step S101 (step S102). When it is determined in step S102 that the user is not in use, that is, when the mobile phone terminal 1 is in a standby state, there is no need to restrict use, so the process shown in FIG. And wait for the next execution timing.

  Also, in the determination process of step S102, when it is determined that the user is in use, the control unit 100 controls the movement detection unit 152 to detect whether or not the own device is moving in a car. Is executed (step S103). Then, based on the detection result of step S103, control unit 100 determines whether or not the own device is moving in a car (step S104). If it is determined in step S104 that the own device is not moving in a car, it is not necessary to suppress the use, so the processing shown in FIG. 2 is terminated and the next execution timing is awaited. For example, as described above, as a result of map matching between the current position from the GPS unit 142 and map data acquired from a map server on the Internet, for example, the current position is on the train track and is on the train. If this is obvious, the processing shown in FIG. 2 ends.

  In the determination process of step S104, when it is determined that the own device is moving in a car, the control unit 100 controls the warning control unit 153, and there is a possibility that the car is in operation. A warning or the like is output (step S105). In step S105, as described above, a warning or the like is given by vibration by the vibrator 131 or message display on the display unit 123. For example, the message “Change to sleep mode because there is a possibility of driving a car. If you are not a driver, please take a picture of the driver ’s seat (driver) if you continue to use.” The image is displayed on the display unit 123 through the display processing unit 122. A voice message having the same content may be emitted from the speaker through the voice output unit 125.

  Thereafter, the control unit 100 controls each unit to shift the own device to the sleep mode (step S106). Specifically, the process that has been executed is stopped, and only the incoming call to the own device is detected. In this embodiment, in the sleep mode, as described above, power is supplied to the control unit 100 and an operation input from the user is received, and the camera unit 127, the camera image analysis unit 155, and the restriction release unit 156 are received. Etc., so that they can be operated.

  In addition, in the cellular phone terminal 1 of this embodiment, when the control unit 100 detects an incoming call to the own device in the sleep mode, the control unit 100 automatically responds and operates the answering function to record the voice message of the other party. It records in 110 non-volatile memory. When the communication partner releases the communication line, the control unit 100 also releases the communication line and returns to the standby state. As described above, the control unit 100 also has a function as an execution unit for the answering machine function.

  Then, after the process of step S106, the control unit 100 performs a sleep mode release confirmation process (step S107). In the release confirmation process in step S107, a video in the vehicle is captured through the camera unit 127, and the captured video is analyzed to determine whether the user of the mobile phone terminal 1 is a driver or not. This is a process for specifying whether or not cancellation is possible. The details of the sleep mode cancellation confirmation process performed in step S107 will be described later.

  Thereafter, the control unit 100 determines whether or not the sleep mode can be canceled (whether or not the cancellation is OK) based on the cancellation confirmation process in step S107 (step S108). In this embodiment, whether or not the sleep mode can be canceled is determined based on a cancellation flag whose on / off is controlled in a cancellation confirmation process described later. If it is determined in step S108 that the sleep mode cannot be canceled, the control unit 100 controls the movement detection unit 152 in the same manner as in the above-described step S103, so that the own device is moving in a car. A process of detecting whether or not is executed (step S109). Then, based on the detection result of step S109, control unit 100 determines whether or not the own device is moving in a car (step S110). If it is determined in step S110 that the vehicle is moving, the control unit 100 repeats the processing from step S107 because the sleep mode cannot be canceled.

  Further, when it is determined in the determination process of step S108 that the sleep mode can be canceled (can be canceled), and in the determination process of step S110, it is determined that the own device is not moving by a car. Is a state in which the sleep mode can be canceled. In these cases, the control unit 100 controls the restriction release unit 156 to release the sleep mode, return the state of the own device to the normal operation mode, and stop the operation by transitioning to the sleep mode in step S106. The currently executed process is resumed (step S111). Thereafter, the control unit 110 controls the operation state detection unit 151 to determine whether or not the process resumed in step S111 is completed (step S112).

  If it is determined in the determination process in step S112 that the restarted process has not been completed, the determination process in step S112 is repeated to wait for the restarted process to end. The reason for waiting for the restarted processing to end is to secure the use of the mobile phone terminal 1 in an appropriate range while moving in a car for a user who is not a driver. Then, in the determination process of step S112, when it is determined that the resumed process is completed, the process from step S101 is repeated.

  In this way, in the cellular phone terminal 1 of this embodiment, the use of a user who may be driving a car is suppressed, and when it is proved that the user is not a driver, the use restriction is released. To do. Thereby, although the use of the user while driving a car is suppressed, the use of a user who is not a driver can be prevented from being suppressed.

[Sleep mode release confirmation process]
Next, the sleep mode cancellation confirmation process executed in step S107 of FIG. 2 will be described. FIG. 3 is a flowchart for explaining the release confirmation process, and FIGS. 4 and 5 are diagrams illustrating examples of in-vehicle images taken through the camera unit 127.

  The sleep mode of the cellular phone terminal 1 according to this embodiment is a mode in which the processing that has been executed so far is stopped and only the incoming call to the own device is detected. However, as described above, power is supplied to the control unit 100, and an operation input from the user is received, and the camera unit 127, the camera image analysis unit 155, the restriction release unit 156, and the like can be operated. State.

  For this reason, the control unit 100 first initializes a release FLG indicating whether or not the sleep mode can be released (release OK) to zero (step S201). Thereafter, the control unit 100 receives an activation operation of the camera unit 127 through the key operation unit 121, for example (step S202). In step S202, the control unit 100 determines whether an activation operation of the camera unit 127 from the user has been received (step S203).

  When it is determined in the determination process in step S203 that the activation operation of the camera unit 127 from the user has not been accepted, the video is not captured, and thus the process for canceling the sleep mode is not performed. Therefore, the process shown in FIG. 3 is terminated, the process returns to step S107 shown in FIG. 2, and the process from step S108 is performed. In this case, since the release FLG remains zero, it is determined that the sleep mode cannot be released.

  On the other hand, when it is determined in the determination process of step S203 that the activation operation of the camera unit 127 from the user has been accepted, the control unit 100 activates the camera unit 127 to make it ready for photographing (step S204). Thereby, video data of video captured through the camera unit 127 is supplied to the display processing unit 122 through the control unit 100, where it is converted into a video signal and supplied to the display unit 123. Thereby, it is possible to take a picture while confirming the video captured by the camera unit 127 through the display unit 123.

  Then, the control unit 100 receives an operation input such as a shooting instruction from the user through the key operation unit 121 or the like (step S205), and determines whether or not the shooting instruction is received (step S206). If it is determined in step S206 that no shooting instruction has been received, the control unit 100 determines whether an end instruction has been received (step S207). If it is determined in the determination process in step S207 that an end instruction has not been received, the received operation input is not a valid operation input, and the process from step S205 is repeated. If it is determined in the determination process in step S207 that an end instruction has been accepted, the process for canceling the sleep mode is not performed, so the camera unit 127 is stopped (step S208), and the process shown in FIG. To do. And it returns to the process of step S107 shown in FIG. 2, and the process from step S108 is performed. In this case, since the release FLG remains zero, it is determined that the sleep mode cannot be released.

  If it is determined in step S206 that the shooting instruction has been received, the control unit 100 controls each unit and executes the shooting process (step S209). In order to prove that the user is not a driver, the user of the mobile phone terminal 1 shoots an image in which the driver's left and right hands are in the vicinity of the steering wheel of the automobile. In step S208, either a still image or a moving image may be taken. In this embodiment, a moving image is taken. In this case, the video data captured through the camera unit 127 is recorded in the nonvolatile memory of the storage device 110 through the control unit 100.

  Then, the control unit 100 controls the camera video analysis unit 155 to analyze the video data from the camera unit 127 and perform processing for specifying whether or not the user of the mobile phone terminal 1 is a driver (step S210). ). In the process of step S210, as described above, if the left and right hands of the driver who touches the steering wheel of the automobile can be photographed, it is determined that the user of the mobile phone terminal 1 who is the photographer is not the driver. Can do.

  For example, when the user of the mobile phone terminal 1 sitting in the passenger seat of a car photographs the driver so as to include the handle of the car, as shown in FIG. 4A, as shown in FIG. The left and right hands can be taken. By performing pattern matching between the video data of the video shown in FIG. 4A and the video data of the driver's video prepared in advance, the camera's steering wheel and the left and right hands of the driver are captured in the camera video analysis unit 155. It can be recognized that In this case, since the driver is shown, it can be specified that the user of the mobile phone terminal 1 is not the driver.

  In addition, when the user of the mobile phone terminal 1 sitting on the back seat of the vehicle photographs the driver so as to include the handle of the vehicle, as shown in FIG. 4B, The left and right hands can be taken. By performing pattern matching between the video data of the video shown in FIG. 4B and the video data of the driver's video prepared in advance, the camera's steering wheel and the left and right hands of the driver are captured in the camera video analysis unit 155. It can be recognized that In this case, since the driver is shown, it can be specified that the user of the mobile phone terminal 1 is not the driver.

  In addition, when the user of the mobile phone terminal 1 is on the bus, if the inside of the bus is photographed, for example, as shown in FIG. 5, a plurality of seats, a plurality of passengers, right and left large windows, etc. Can be taken. By performing pattern matching between the video data of the video shown in FIG. 5 and the video data of the video in the bus prepared in advance, the camera video analysis unit 155 can recognize that the video is in the bus. In this case, since the video in the bus car is taken, it is possible to specify that the user of the mobile phone terminal 1 is not a driver.

  In addition, when it is not possible to confirm that the steering wheel of the car and the left and right hands of the driver are reflected in the video taken through the camera unit 127, or when it is not possible to recognize that the video is taken from inside the bus passenger seat Can not be specified unless the user of the mobile phone terminal 1 is a driver.

  Then, the control unit 100 determines whether or not the user of the mobile phone terminal 1 that has taken a picture through the camera unit 127 is a driver other than the driver based on the analysis result of the shot video in step S208 (step S211). In the determination process of step S211, when it is determined that the user of the mobile phone terminal 1 is other than the driver, the sleep mode can be canceled, so “1” is set in the cancellation flag (step S212). Thereafter, photographing through the camera unit 127 is terminated, the camera unit 127 is stopped (step S213), and the release confirmation process shown in FIG. 3 is terminated. Then, the processing returns to step S107 shown in FIG. 2 and the processing from step S108 is performed. In this case, since the value of the release flag is “1”, it is determined in step S108 shown in FIG. 2 that the sleep mode can be released (cancel OK).

  If it is determined in step S210 that the user of the mobile phone terminal 1 is not a driver, the process proceeds to step S213, the shooting through the camera unit 127 is terminated, and the camera unit 127 is stopped. In step S213, the release confirmation process shown in FIG. Then, the process returns to the process shown in FIG. In this case, since the release FLG remains zero, it is determined that the sleep mode cannot be released.

  In this way, by analyzing the video taken through the camera unit 127 of the mobile phone terminal 1, it is possible to reliably determine whether the user of the mobile phone terminal 1 is a driver. And when it can discriminate | determine that it is not a driver | operator, it specifies that the sleep mode can be cancelled | released, and returns to the process shown in FIG. In this case, in step S111 of the process shown in FIG. 2, the sleep mode is canceled and the mobile phone terminal 1 can be used. In addition, if it is not possible to specify that the sleep mode can be canceled by the process shown in FIG. 3, the sleep mode is canceled if the movement in the car is not stopped even if the process returns to the process shown in FIG. 2. Absent. Therefore, when the user of the mobile phone terminal 1 is a driver, the use of the mobile phone terminal 1 during driving is suppressed.

[Effect of the embodiment]
As described above, when it is detected that the mobile phone terminal 1 is moving in a car during use, the mobile phone terminal 1 forcibly shifts to the sleep mode and the use is suppressed. When the user of the mobile phone terminal 1 can determine that he / she is not a driver by analyzing the video captured through the camera unit 127, the sleep mode is canceled and the mobile phone terminal 1 can be used. Therefore, when there is no time when it cannot be determined that the user of the mobile phone terminal 1 is not a driver, the user is likely to be a driver, and thus the use of the mobile phone terminal 1 is suppressed. Thus, the cellular phone terminal 1 of this embodiment can reliably suppress the use of only the driver who is driving the car.

[Modifications, etc.]
In the above-described embodiment, when the mobile phone terminal 1 is used and it is detected that the mobile phone terminal 1 is moving in an automobile, the mode is changed to the sleep mode that detects only incoming calls. However, it is not limited to this. For example, at least the information display function on the display means may be stopped. In this way, at least the display information on the display unit 123 of the mobile phone terminal 1 need not be viewed by the user, and attention can be returned to the front or the like.

  However, it may be considered that there is a case where the user listens to music using an earphone or the like using the music playback function of the mobile phone terminal 1. Since such use is not preferable during driving of the automobile, in addition to the vibration by the vibrator 131 and the warning message to the display unit 123, the voice warning message is emitted through the voice output unit 125 and the voice output terminal 126B. In addition, a transition to the sleep mode can be made.

  Further, as described above, the mobile phone terminal 1 can suppress the use of the driver while driving a car. However, if the user of the mobile phone terminal 1 repeats the act of using the mobile phone terminal 1 while driving a car, the use of the mobile phone terminal 1 may be suppressed, In some cases, it is better to take some measures.

  For this reason, a transition is made to the sleep mode through the processes of FIGS. 2 and 3 described above, and the case where the sleep mode is not released is counted through the release confirmation process shown in FIG. The count may be performed in the control unit 100. Specifically, a counter (register) is provided in the nonvolatile memory of the storage device 110. Then, when the count value of the counter is “+1 (add 1)” in the process of step S106 shown in FIG. 2, and it is determined that the counter can be canceled (cancel release) in the determination process of step S108 shown in FIG. The count value of the counter may be “−1 (1 subtraction)”. That is, the control unit 100 and the storage device 110 can realize a counting unit. In this way, it is possible to make a transition to the sleep mode and count the case where the sleep mode is not released through the release confirmation process shown in FIG.

  Then, when the count value reaches a predetermined number or more, for example, the count value is automatically reported to an appropriate organization such as a support center such as a sales company of the mobile phone terminal 1. The report may be performed through the wireless communication unit 112 based on the report destination information stored in the nonvolatile memory of the storage device 100 by the control unit 100. And, the person in charge of the support center frequently uses the mobile phone terminal 1 to use the mobile phone terminal 1 while driving a car with respect to the user of the mobile phone terminal 1 using a telephone, an e-mail, a letter or the like. Warning that the possibility of traffic accidents is high, so attention is required.

  Thus, by receiving a warning from the outside, the user of the mobile phone terminal 1 can objectively recognize his / her actions (use mode of the mobile phone terminal 1). Thereby, it can be urged not to perform the act of using the mobile phone terminal 1 while driving a car. In addition to simply reporting, it is possible to restrict the use of the mobile phone terminal 1 so that the restriction cannot be lifted unless it is brought into an appropriate organization such as the support center of the mobile phone terminal 1 sales company. . That is, the control unit 100, the storage device 110, and the wireless communication unit 112 can cooperate to configure a restriction control unit.

  Further, in the sleep mode release confirmation process shown in FIG. 3, the processes in steps S202, 203, 205, and 206 may be omitted, and the shooting through the camera unit 127 may be started immediately after the transition to the sleep mode. Then, it automatically starts to determine whether or not the user of the mobile phone terminal 1 is a driver. In this way, even if the driver of the car uses the mobile phone terminal 1, the state can be photographed and recorded. In the unlikely event that an accident occurs, the captured video provides evidence or clues to investigate the cause of the accident. At the time of shooting, not only video but also audio data captured through the microphone 128 and the audio input unit 129 may be recorded. In this case, audio data can be used as evidence and clues together with video data.

  With the mobile phone terminal 1 according to the above-described embodiment, it is possible to recognize that the mobile phone terminal is not used as a manner when driving a car. Also, it is desirable to incorporate the function for performing the processing shown in FIGS. 2 and 3 into a mobile phone terminal at the time of shipment from a mobile phone company or a mobile phone manufacturer. Of course, it is also possible to enhance the functions of existing mobile phone terminals by providing a program for performing the processing shown in FIGS. 2 and 3 through the Internet or the like. That is, the functions of the operation state detection unit 151, the movement detection unit 152, the warning control unit 153, the restriction execution unit 154, the camera image analysis unit 155, and the restriction release unit 156 are realized as functions of the control unit 100 by software. Is possible.

[Others]
As can be seen from the description of the above-described embodiment, the function as the use detection unit of the mobile terminal device is realized by the operation state detection unit 151 of the mobile phone terminal 1, and the function as the movement detection unit of the mobile terminal device is The movement detection unit 152 of the mobile phone terminal 1 is realized. In addition, the function as the restriction execution unit of the mobile terminal device is realized by the restriction execution unit 154 of the mobile phone terminal 1, and the function as the imaging unit of the band terminal device is realized by the camera unit 127 of the mobile phone terminal 1. Yes. In addition, the function as the determination unit of the mobile terminal device is realized by the camera video analysis unit 155, and the function as the restriction release unit of the mobile terminal device is realized by the restriction release unit 156 of the mobile phone terminal 1. Further, the control unit 100 of the mobile phone terminal 1 realizes the functions as the counting means and the limit control means of the mobile terminal device.

  2 and FIG. 3 corresponds to the operation control method for the portable terminal device of the present invention. Moreover, the program which performs the process according to the flowchart of FIG. 2, FIG. 3 is an operation control program of the portable terminal device of this invention. Therefore, by forming a program for executing the processing shown in FIGS. 2 and 3 and mounting the program on the mobile terminal device so that the mobile terminal device can execute the program, the mobile terminal device of the present invention can be easily implemented. Can be realized.

  DESCRIPTION OF SYMBOLS 1, 1A ... Cell-phone terminal, 100 ... Control part, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... CPU bus, 110 ... Memory | storage device, 111 ... Transmission / reception antenna, 112 ... Wireless communication part, 113 ... Handset, 114 ... Speaker 121 ... Key operation unit 122 ... Display processing unit 123 ... Display unit 124 ... Touch panel 125 ... Audio output unit 126A ... Speaker 126B ... Audio output terminal 127 ... Camera unit 128 ... Microphone, 129 ... voice input unit, 131 ... vibrator, 132 ... ringer, 141 ... acceleration sensor, 142 ... GPS unit, 143 ... GPS antenna, 151 ... operating state detection unit, 152 ... movement detection unit, 153 ... warning control unit, 154 ... Restriction execution unit, 155 ... Camera image analysis unit, 156 ... Limit release unit

Claims (5)

A use detecting means for detecting whether or not it is in use;
Movement detection means for detecting whether or not the vehicle is moving when it is detected that the vehicle is in use;
Limiting execution means for stopping a predetermined function when it is detected that the vehicle is moving,
Imaging means;
A discriminating means for analyzing a video photographed through the imaging means after stopping a predetermined function and discriminating whether or not the user of the own machine is a driver;
A portable terminal device comprising: restriction release means for recovering the predetermined function that has been stopped when it is determined that the user of the device is not a driver. The mobile terminal device according to claim 1,
The predetermined function to be stopped includes at least a function of displaying information on a display unit. The mobile terminal device according to claim 1 or 2,
Counting means for counting a case where the predetermined function is stopped by the restriction control means and the predetermined function that has been stopped is not recovered by the restriction releasing means;
Restriction control means for controlling to perform one or both of restriction of executable functions and notification of the situation to a predetermined engine when the count value in the counting means reaches a predetermined value. The portable terminal device characterized by this. An operation control method used in a portable terminal device provided with an imaging means,
A use detecting step of detecting whether or not it is being used through a use detecting means;
A movement detection step of detecting whether or not the vehicle is moving through the movement detection means when it is detected that it is in use;
A limit control step of stopping a predetermined function through the limit control means when it is detected that the vehicle is moving;
After the predetermined function is stopped, the determination unit analyzes the video imaged through the imaging unit, and determines whether the user of the own device is a driver;
An operation control method for a mobile terminal device, comprising: a restriction release step of recovering the predetermined function that has been stopped through a restriction release means when it is determined that the user of the device is not a driver. An operation control program executed by a computer mounted on a portable terminal device including an imaging unit,
A use detecting step for detecting whether or not the device is being used through the use detecting means;
A movement detection step for detecting whether or not the vehicle is moving through movement detection means when it is detected that the vehicle is in use;
A limit control step for stopping a predetermined function through the limit control means when it is detected that the vehicle is moving;
After the predetermined function is stopped, the determining unit analyzes the video imaged through the imaging unit and determines whether the user of the own device is a driver;
When it is determined that the user of the device is not a driver, a restriction release step for recovering the predetermined function that has been stopped is executed through a restriction release unit. .

Images