JP2015133593A - Portable terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal device capable of further certainly restricting the operation of a portable terminal device.SOLUTION: If a suppression releasing button 24a is depressed and an instruction for releasing suppression is inputted, a first camera 12 is operated to image a subject and generate first image data. If an operator is not a driver at that time, the first camera 12 is turned to the driver to image the driver. A suppression releasing determining portion 11 determines whether the driver is included in the generated first image data as a subject, and if the driver is included, operates a second camera 13 to image the operator operating a portable terminal device at the present time. If a person is included in second image data generated by the second camera 13, considering that the operator is not the driver, the suppression releasing determining portion 11 releases a suppression state of the portable terminal device, and operates an operating portion and a display portion whose actions are suppressed.

Description

  The present invention relates to a mobile terminal device.

  Mobile terminal devices such as smartphones equipped with a wireless communication function and a touch panel function have begun to spread widely due to their ease of use.

  Such a portable terminal device can perform wireless communication freely without being restricted by the place of use and time of use, for example, by wirelessly connecting to a mobile communication network.

  Wireless communication allows you to send and receive e-mails on mobile terminal devices, access websites on the Internet, browse web pages, download music data, stream video data, and so on. Can be used.

  While it becomes convenient in this way, there are increasing dangerous ways of using the mobile terminal device while walking, such as colliding with others or crawling and falling. In particular, if a driver of a car operates a mobile terminal device while driving, it may cause a major traffic accident, so it is prohibited by law, but it is impossible to control everything, so a mobile terminal device by a driving driver A technology has been developed to forcibly limit the operation.

  When the mobile terminal device with a camera function described in Patent Document 1 is used while the car is moving, the predetermined function is stopped, and then the video captured by the mobile terminal device is analyzed and the user can drive If it is determined that the user is not a person, the stopped function is restored.

  When the moving speed exceeds the threshold, the mobile phone terminal device described in Patent Document 2 regulates incoming calls and transmissions, and if the user is not a driver but a passenger, the incoming call response, transmission operation, and execution of the call mode are performed. to enable. If two switches provided at positions that can be operated only with both hands can be operated with both hands, it is determined that the operator is not a driver but a passenger.

  The portable device described in Patent Document 3 is wirelessly connected to the in-vehicle device, captures the operator's face image when operated, and acquires the driver's face image previously captured by the camera in the vehicle interior from the in-vehicle device. If these face images are compared and matched, the operation of the portable device is limited.

JP 2013-172360 A JP 2004-15728 A JP 2011-172195 A

  In the portable terminal device described in Patent Document 1, there is a possibility that the driver may use it after it is determined that the user is not the driver and the stopped function is recovered. In the mobile phone terminal device described in Patent Document 2, it is possible for a driver to operate with both hands, and in order to operate the mobile phone terminal device, if both hands are separated from the steering wheel during driving, a traffic accident occurs. The possibility becomes higher. The portable device described in Patent Document 3 requires an in-vehicle device that captures and registers the driver's face and communicates with the portable device, and the operation of the portable terminal device by the driver cannot be restricted only by the portable device. .

  The objective of this invention is providing the portable terminal device which can restrict | limit operation of a portable terminal device more reliably.

The present invention is a mobile terminal device operated by a user,
A display for displaying an image;
An operation unit operated by a user;
A first imaging unit that images a subject and generates first image data;
A second imaging unit that images a subject and generates second image data;
A deterrence unit for deterring operations of the display unit and the operation unit;
A deterrence canceling unit for executing a deterrence canceling process for canceling the state in which the operation of the display unit and the operation unit is suppressed by the deterring unit;
An instruction input unit for inputting a start instruction for causing the suppression cancellation unit to start execution of the suppression cancellation process,
The first imaging unit and the second imaging unit are provided such that the incident direction of the light beam with respect to the first imaging unit and the incident direction of the light beam with respect to the second imaging unit are opposite to each other,
When the start instruction is input by the instruction input unit when the operation of the display unit and the operation unit is suppressed by the suppression unit,
First image data is generated by the first imaging unit, and the inhibition canceling unit operates the portable terminal device on the first image data generated by the first imaging unit based on a predetermined criterion. To determine if there are people that should be
If it is determined that the generated first image data includes a person to be prevented from operating the portable terminal device, the second image data is generated by the second imaging unit, and the inhibition is canceled. The unit determines whether the second image data generated by the second imaging unit includes information that can identify a person based on a predetermined criterion;
If it is determined that information that can identify a person is included in the generated second image data, the suppression cancellation unit cancels the state in which the operations of the display unit and the operation unit are suppressed. This is a characteristic mobile terminal device.

  Further, according to the present invention, if the first image data includes a person and a steering wheel of a vehicle as the predetermined reference, the suppression release unit operates the portable terminal device on the first image data. It is judged that the driver who drives a vehicle is included as a person who should suppress this.

According to the present invention, when the state where the operation of the display unit and the operation unit is inhibited is released, the storage unit stores the second image data used in the inhibition release process;
When the operation unit is operated by the user after the state where the operations of the display unit and the operation unit are suppressed is released, second image data is generated by the second imaging unit, and the generated second image data is generated. By comparing the two image data and the second image data stored in the storage unit, it is possible to specify the same person as the information that can specify the person included in the second image data stored in the storage unit If such information is not included in the generated second image data, it further includes a deterrence confirmation unit that causes the deterrence unit to deter the operations of the display unit and the operation unit.

The present invention further includes a suppression state determination unit that determines whether the operation of the display unit and the operation unit is to be suppressed according to the state of the mobile terminal device output by the suppression state determination device. ,
According to the determination result of the suppression state determination unit, the suppression unit determines whether to suppress the operations of the display unit and the operation unit, and the suppression cancellation unit determines whether to execute a suppression cancellation process. It is characterized by judging.

  Further, in the present invention, the suppression state determination unit causes the suppression state determination device to output the movement speed of the mobile terminal device, and the suppression state determination unit determines that the output movement speed is equal to or less than a predetermined movement speed. Canceling the state in which the operation of the display unit and the operation unit is suppressed without executing the suppression release process, and executing the suppression release process if the detected moving speed exceeds a predetermined moving speed. Features.

  According to the present invention, the suppression unit suppresses the operation of the display unit and the operation unit, and the suppression release unit cancels the state in which the operation of the display unit and the operation unit is suppressed by the suppression unit. Execute. In addition, a first imaging unit and a second imaging unit are provided so that the incident direction of the light beam is reversed.

  When the operation of the display unit and the operation unit is suppressed by the suppression unit, when a start instruction is input by the instruction input unit, first image data is generated by the first imaging unit, and the suppression cancellation is performed. The unit determines whether the first image data generated by the first imaging unit includes a person who should be prevented from operating the mobile terminal device based on a predetermined criterion. If it is determined that the generated first image data includes a person to be prevented from operating the portable terminal device, the second image data is generated by the second imaging unit, and the inhibition is canceled. The unit determines whether the second image data generated by the second imaging unit includes information that can identify a person based on a predetermined criterion.

  If it is determined that the generated second image data includes information that can identify a person, the inhibition cancellation unit cancels the state where the operations of the display unit and the operation unit are inhibited.

  Since the first imaging unit and the second imaging unit are provided so as to be opposite to each other, the first imaging unit generated by the first imaging unit when imaging is performed simultaneously or continuously at an extremely short time interval. The same person cannot be included in both the image data and the second image data generated by the second imaging unit. Therefore, if the first image data includes a person who should be prevented from operating the mobile terminal device, and if the second image data includes information that can identify the person, the first image data includes the second image data. It can be determined that the person specified by the information to be controlled is not the person who should be prevented from operating the portable terminal device. Since the person included in the second image data is an operator of the mobile terminal device, if it can be determined that the operator is not a person who should be prevented from operating the mobile terminal device, the display unit and the operation unit are operated. The deterrence state can be released. Thereby, it is possible to restrict the operation of the mobile terminal device by a person who should suppress the operation of the mobile terminal device more reliably.

  Further, according to the present invention, the deterrence canceling unit deters operation of the portable terminal device on the first image data if the first image data includes a person and a steering wheel of a vehicle. It is determined that a driver who drives the vehicle is included as a person to be driven.

  According to the invention, when the state where the operations of the display unit and the operation unit are suppressed is canceled, the second image data used in the suppression cancellation process is stored in the storage unit. The suppression confirmation unit generates second image data by the second imaging unit when the operation unit is operated by the user after the state where the operation of the display unit and the operation unit is suppressed is released. The generated second image data is compared with the second image data stored in the storage unit, and is identical to the information that can identify the person included in the second image data stored in the storage unit If the information that can identify the person is not included in the generated second image data, the suppression unit is configured to suppress the operations of the display unit and the operation unit.

  When an operator different from the operator who is determined not to be a driver as a person who should be prevented from operating the portable terminal device in the suppression release process, the operator Since it cannot be determined that the driver is not a driver as a person who should be prevented from operating the portable terminal device, there is a possibility that the driver who is a person who should be prevented from operating the portable terminal device is operating. Then, the operation of the display unit and the operation unit is suppressed again. As a result, when the driver who is the person who should suppress the operation of the mobile terminal device after the suppression is released, the operation of the display unit and the operation unit is suppressed. It is possible to restrict the operation of the mobile terminal device by the driver who is the person who should surely suppress the operation of the mobile terminal.

  Moreover, according to this invention, a suppression state determination part determines whether it is a state which should suppress operation | movement of a display part and an operation part according to the state of the portable terminal device output by the suppression state determination device. According to the determination result of the suppression state determination unit, the suppression unit determines whether to suppress the operations of the display unit and the operation unit, and the suppression cancellation unit determines whether to execute a suppression cancellation process. to decide. Depending on the state of the mobile terminal device, it is not always necessary to suppress the operation of the display unit and the operation unit, so it is determined whether to suppress or cancel the suppression according to the state. As a result, it is possible to avoid unnecessarily suppressing or releasing the suppression of the operations of the display unit and the operation unit.

  Further, according to the present invention, the suppression state determination unit determines a movement speed of the mobile terminal device that is a condition for determining whether or not the operation of the mobile terminal device should be suppressed by the suppression state determination device. If the output movement speed is less than or equal to a predetermined movement speed, the state where the operation of the display unit and the operation unit is suppressed is canceled without executing the suppression release process, and the output movement speed is If the predetermined moving speed is exceeded, the inhibition release process is executed.

  Thereby, when it is not necessary to suppress, suppression can be cancelled | released quickly, without performing the suppression cancellation | release process.

It is a block diagram which shows the apparatus structure of the portable terminal device 20 which is embodiment of this invention. It is a functional block diagram functionally showing the structure of the terminal operation suppression apparatus 1 with which the portable terminal device 20 is provided. 2 is an external view of a mobile terminal device 20. FIG. It is an example of the image displayed on the display 14 at the time of suppression cancellation | release process execution. 10 is a flowchart showing a deterring cancellation process by the mobile terminal device 20. It is a flowchart which shows the suppression cancellation determination process by the suppression cancellation determination part 11. FIG. 5 is a flowchart illustrating an operator determination process by an operator determination unit 15. 10 is a flowchart showing a deterring release process when a deterring state determination unit is added to the mobile terminal device 20.

  FIG. 1 is a block diagram showing a device configuration of a mobile terminal device 20 according to an embodiment of the present invention. FIG. 2 is a functional block diagram functionally representing the configuration of the terminal operation suppression device 1 included in the mobile terminal device 20.

  The mobile terminal device 20 is configured by a mobile terminal device such as a smartphone or a tablet PC. Below, the case where the portable terminal device 20 is a smart phone is demonstrated to an example.

  The portable terminal device 20 includes a main control unit 21, a storage unit 22, a temporary storage unit 23, an operation unit 24, a display unit 25, a communication unit 26, a speaker unit 27, a vibration unit 28, a GPS reception unit 29, a microphone unit 30, and a camera. The unit 31 is configured.

  The main control unit 21 is configured by, for example, a CPU (Central Processing Unit), and executes various programs stored in the storage unit 22, thereby operating the operation unit 24, the display unit 25, the communication unit 26, the speaker unit 27, and vibration. The unit 28, the GPS receiving unit 29, the microphone unit 30, and the camera unit 31 are controlled.

  The storage unit 22 is configured by a nonvolatile large-capacity storage device, for example, a semiconductor memory such as an SSD or a flash memory, or an HDD. The storage unit 22 stores a program executed by the main control unit 21 and information necessary for the main control unit 21 to execute the program. Information stored in the storage unit 22 is written and read by the main control unit 21.

  The temporary storage unit 23 is configured by a volatile storage device having a writing speed and a reading speed higher than those of the storage unit 22, for example, a semiconductor memory such as a DRAM, and stores information necessary for the main control unit 21 to execute a program. This is a work memory that is temporarily stored. Information stored in the temporary storage unit 23 is written and read by the main control unit 21.

  The operation unit 24 includes a plurality of keys for inputting information such as letters, numbers, and symbols. The operation unit 24 sends information associated with the operated key to the main control unit 21. The operation unit 24 may be a mechanical key or a soft key, and preferably includes a touch panel for realizing the soft key.

  The display unit 25 is configured by a display device such as a liquid crystal display. The display unit 25 displays an image based on the image data generated by the main control unit 21. Image data can be generated by an OS (Operating System) or by an application. An image that can be displayed on the display unit 25 based on the image data stored in the storage unit 22 and according to the specifications of the display unit 25. Data is generated.

  The communication unit 26 is connected to a communication line network such as a mobile communication network through communication equipment of a base station by wireless data communication, and other devices connected to the network, such as a content distribution server device, an electronic mail server device, Various information is transmitted / received to / from the SNS server device, the bulletin board server device, and the like. It is also possible to connect to a mobile communication network by the communication unit 26 and perform telephone communication with other telephone devices.

  The communication unit 26 is connected to the communication line network, transmits information received from the main control unit 21 to other devices instructed by the main control unit 21, and receives information received from other devices via the communication line network. This is sent to the control unit 21. The communication unit 26 uses, for example, a communication system such as a W-CDMA system or a PHS (Personal Handy-phone System) system compliant with the IMT-2000 (International Mobile Telecommunication 2000) standard defined by the International Telecommunication Union (ITU). To communicate.

  The communication unit 26 can also perform medium-distance and short-distance wireless communication. For example, the communication unit 26 is a medium-distance or short-distance communication by wireless communication such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or Zigbee (registered trademark). Wireless communication with relay devices and electronic devices can also be performed.

  The speaker part 27 is comprised by the audio | voice output apparatus containing a speaker, for example. The speaker unit 27 outputs a sound based on the sound data generated by the main control unit 21. The sound data can handle various sound data such as music data and synthesized sound data. During telephone communication, voice based on voice data received from the other party's telephone device is output. The vibration unit 28 is configured by, for example, a vibration device such as a vibrator, and notifies the user together with or instead of voice by so-called vibration.

  The GPS receiving unit 29 is composed of a GPS receiver corresponding to a user segment of the Global Positioning System, and it is only necessary to be able to measure at least latitude and longitude, and performs three-dimensional positioning including altitude, You can also get

  The microphone part 30 is comprised by the audio | voice input apparatus containing a microphone, for example. The microphone unit 30 outputs the input voice as an electrical signal to the main control unit 21, and the main control unit 21 converts it into audio data. The converted voice data is stored in the storage unit 22, thereby realizing a voice recorder function. Further, during telephone communication, the voice input from the microphone unit 30 can be transmitted as voice data to the other party's telephone device.

  The camera unit 31 is configured by a digital camera device such as a CCD camera or a CMOS camera that images a subject and generates image data. The camera unit 31 can generate both image data of still image data and moving image data.

  The mobile terminal device 20 according to the present embodiment includes the terminal operation suppression device 1 so that, for example, a driver who is driving a car operates the mobile terminal device 20 as a person who should suppress the operation of the mobile terminal device 20. Can be deterred.

  The terminal operation suppression device 1 includes an operation suppression unit 10, a suppression cancellation determination unit 11, an operator determination unit 15, a suppression state determination unit 16, a main control unit 21, a storage unit 22, a suppression cancellation button 24a, a display unit 25, and a camera unit. 31 and the suppression state determination device 40. The main control unit 21, the storage unit 22, the display unit 25, and the camera unit 31 are the same as the parts described in FIG. The inhibition release button 24 a is a button to which a function for inputting an instruction to release inhibition is assigned among the buttons included in the operation unit 24. Therefore, even when the operation of the mobile terminal device 20 is inhibited, the function of inputting the inhibition release instruction of the inhibition release button 24a is not inhibited.

  The display unit 25 includes a display 14 having a display surface for displaying an image and a display control unit 14a for causing the display 14 to display an image. The camera unit 31 includes two cameras, and the first camera 12 of one of the two cameras captures a subject to generate first image data, and is controlled by the first camera control unit 12a. The other second camera 13 images a subject to generate second image data, and is controlled by the second camera control unit 13a.

  The operation deterring unit 10 deters the operation of the mobile terminal device 20. Specifically, the operation deterring unit 10 deters the operation unit 24 and the display unit 25 from operating. In the suppression state in which the operation suppression unit 10 suppresses the operation, even if the user operates the operation unit 24, the process according to the operation content is not executed, and the display unit 25 does not display an image. Even if the driver tries to operate the mobile terminal device 20 in the inhibited state, no image is displayed and no processing is performed. Therefore, as long as the driver is in the inhibited state, the driver has to give up operating, It is possible to prevent the mobile terminal device 20 from being operated during driving.

  There are passengers in the automobile other than the driver, but if the passenger's portable terminal device 20 is in a deterred state, the usability of the portable terminal device 20 will deteriorate. Therefore, in the present invention, when the suppression cancellation determination unit 11 of the terminal operation suppression device 1 executes the suppression cancellation process and satisfies a predetermined condition, it is determined that the operator is not a driver and the display unit 24 and the display unit The operation inhibition state 25 is released so that the mobile terminal device 20 can be operated.

  FIG. 3 is an external view of the mobile terminal device 20. As shown in FIG. 3A, the display 14 on one main surface side, the touch panel of the operation unit 24 provided to overlap the display 14, the deactivation release button 24a, and the second camera 13 are arranged. As shown, the first camera 12 is disposed on the opposite main surface side. In the first camera 12 and the second camera 13, the incident directions of the light rays incident on the first camera 12 and the second camera 13 are opposite to each other. In normal use, the operator operates the mobile terminal device 20 with his / her finger touching the touch panel while looking at the image displayed on the display 14 with one main surface side of the mobile terminal device 20 facing toward himself / herself. To do. At this time, since the second camera 13 faces the operator side, when the second camera 13 is operated while being operated, the operator is included in the captured image data. Further, when the operator is operating the mobile terminal device 20, the first camera 12 is facing away from the operator, and therefore when the first camera 12 is operated, the mobile terminal device 20 is sandwiched. Thus, the subject on the opposite side of the operator is imaged. When the first camera 12 and the second camera 13 capture images simultaneously at the same time or continuously at an extremely short time interval (several milliseconds to several tens of milliseconds), the first image data generated by the first camera 12 and the first image data The same person cannot be included in both of the second image data generated by the two cameras 13. In other words, if a person is included in both image data, the person is not the same person.

  By using the two cameras having such an arrangement, it is possible to determine that the operator of the mobile terminal device 20 is not the driver, and it is possible to cancel the operation suppression state according to the determination result.

  When it is desired to operate the mobile terminal device 20 after canceling the inhibited state of the mobile terminal device 20 in the inhibited state, the operator presses the inhibition release button 24 a of the mobile terminal device 20. The inhibition release button 24a is included in the operation unit 24, but only the function for inputting the inhibition release instruction as described above is enabled without being inhibited.

  When the suppression cancellation button 24a is pressed and a suppression cancellation instruction is input, the first camera 12 operates to capture a subject and generate first image data. At this time, if the operator is not the driver, the first camera 12 is pointed at the driver and the driver is imaged.

  The inhibition cancellation determination unit 11 determines whether or not a driver is included as a subject in the generated first image data. If the driver is included, the second camera 13 is operated, and the current mobile terminal device The operator who is operating 20 is imaged. If a person is included in the second image data generated by the second camera 13, the deterrence cancellation determination unit 11 cancels the deterrence state of the mobile terminal device 20 and determines that the operator is not a driver and the operation is deterred The operation unit 24 and the display unit 25 that have been operated are operated.

  FIG. 4 is an example of an image displayed on the display 14 when the suppression release process is executed. On the left side of the display 14, a driver image 50 captured by the first camera 12 is displayed. On the right side of the display 14, an operator image 51 captured by the second camera 13 is displayed. In such a case, since it can be determined that the operator is not a driver, the suppression state is released.

  If an image captured by the first camera 12 does not show a person, or even if a person is shown, that person is not a driver, or if an image captured by the second camera 13 does not show a person, the operator can drive Since it cannot be determined that the user is not a person, the suppression cancellation determination unit 11 does not cancel the suppression state of the mobile terminal device 20.

  When the mobile terminal device 20 is operated after the suppression state is released, the operator determination unit 15 determines whether the operating operator is the same as the operator when the suppression state is subsequently released. If the operator is the same, the state where the suppression is released is continued and the operator can operate the mobile terminal device 20. If the operators are different, it is unclear whether or not the current operator is a driver, so the operation deterring unit 10 puts the operation of the mobile terminal device 20 into a deterred state.

  In order to determine the operator, the suppression cancellation determination unit 11 stores the second image data including the operator when it is determined to cancel the suppression state in the storage unit 22 after the determination. When the mobile terminal device 20 is operated in a state where the second image data is stored in the storage unit 22 after the suppression state is released, the operator determination unit 15 operates the second camera 13 to capture an image. The person included in the second image data and the person included in the second image data stored in the storage unit 22 are compared. If the person is the same person, the derepression state is continued and the person must be the same person. For example, the operation deterring unit 10 causes the operation of the mobile terminal device 20 to be deterred.

  If the operator does not confirm after the suppression state of the operation of the mobile terminal device 20 is released, the driver receives the mobile terminal device 20 from the operator when the suppression state is released. It becomes possible to operate the portable terminal device 20 inside. As described above, if the operator determination unit 15 confirms that the operator who is operating the mobile terminal device 20 is not the driver until after the suppression state is released, the driver determines that the mobile terminal device The possibility of operating 20 can be reduced.

  FIG. 5A is a flowchart showing the deterrence canceling process by the mobile terminal device 20. For safety, this flow is started when at least the operation unit 24 and the display unit 25 are not operated so that the driver cannot operate the portable terminal device 20 in the vehicle while driving. When the moving speed of the mobile device exceeds a predetermined speed by a device capable of detecting the moving speed of the mobile terminal device 20 provided in the mobile terminal device 20, the mobile terminal device is assumed to be moving at least by a vehicle or the like The operations of the operation unit 24 and the display unit 25 may be suppressed, and after the power is turned on or the lock is released, the operation unit 24 and the display unit 25 are in an initial state regardless of the moving speed of the own device. The operation may be suppressed.

  In order to notify the user that the operation of the mobile terminal device 20 is inhibited in step A1, the operation inhibition unit 10 displays a message or the like on the display unit 25 so that it can be seen that the operation is being inhibited. Do.

  In step A <b> 2, the operation suppression unit 10 is in a state of not operating with respect to at least the operation unit 24 and the display unit 25. In step A3, the suppression cancellation determination unit 11 executes a suppression cancellation determination process. Details of the inhibition release determination process will be described later.

  In step A4, based on the processing result of the suppression cancellation determination process, the suppression cancellation determination unit 11 determines whether to cancel the suppression state. If it is determined that the inhibition state is to be released based on the result of the inhibition release determination process, the process proceeds to step A5, and the operation inhibition state is released. If it is determined not to release the suppression state based on the processing result of the suppression release determination process, the process returns to step A3 and the suppression release determination process is performed again.

  In step A6, a message or the like is displayed on the display unit 25 so that it can be seen that the suppression has been canceled in order to notify the operator that the suppression state of the operation of the mobile terminal device 20 has been canceled.

  In step A7, after the suppression state of the operation of the mobile terminal device 20 is released, the operator determination unit 15 determines that the operator operating the mobile terminal device 20 determines to release the suppression state. An operator determination process for determining whether the user is an operator is executed. Details of the operator determination process will be described later.

  In step A8, based on the processing result of the operator determination process, it is determined whether or not to continue the operable state, that is, the state where the operation is not suppressed. When the operable state is continued, the process returns to step A7, and an operator determination process is executed while the portable terminal device 20 is being operated. When the operable state is not continued, the process returns to step A1, and a message or the like is displayed on the display unit 25 so that it can be understood that the operation is being inhibited. In step A2, the operation inhibiting unit 10 again displays at least the operation unit. 24 and the display unit 25 are set in a non-operational state.

  FIG. 5B is a flowchart illustrating the suppression release determination process performed by the suppression release determination unit 11. In step B1, it is determined whether or not the suppression release button 24a has been pressed. If not, the process ends. At this time, the processing result is a result of not releasing the inhibition state, and it is determined in step A4 in FIG. 5A that the inhibition state of the mobile terminal device 20 is not released. When the inhibition release button 24a is pressed, the process proceeds to step B2 to activate the first camera 12 and the second camera 13. In step B3, it is determined whether or not the suppression release button 24a has been pressed. When the suppression release button 24a is pressed, in step B4, the first camera 12 images the subject. In step B5, it is determined whether or not the first image data generated by the first camera 12 includes an object person whose operation is to be suppressed, that is, a vehicle driver. If the driver is not included in the first image data, the process proceeds to step B10, the first camera 12 and the second camera 13 are stopped, and the process is terminated. At this time, the processing result is a result of not releasing the inhibition state, and it is determined in step A4 in FIG. 5A that the inhibition state of the mobile terminal device 20 is not released. If the driver is included in the first image data, the process proceeds to step B6 and the second camera 13 images the subject.

  Here, if the person is not included in the first image data, it is determined that the driver is not included in the first image data. Even if the person is included in the first image data, the person is not driving. If it is not a driver, it is determined that the driver is not included in the first image data. When a person is included in the first image data, whether or not the person is a driver is determined based on whether or not the steering wheel is included together with the person. If a steering wheel is included with a person, the person is determined to be a driver.

  In step B7, it is determined whether or not a person is included in the second image data generated by the second camera 13. If a driver is included in the generated first image data captured by the first camera 12, and if a person is included in the generated second image data captured by the second camera 13, The person is not a driver. Therefore, if a person is included in the second image data, it can be determined that the person is not a driver but an operator.

  If no person is included in the second image data, the process proceeds to step B10, the first camera 12 and the second camera 13 are stopped, and the process is terminated. At this time, the processing result is a result of not releasing the inhibition state, and it is determined in step A4 in FIG. 5A that the inhibition state of the mobile terminal device 20 is not released.

  If a person is included in the second image data, the process proceeds to step B8 and the second image data is stored in the storage unit 22. In step B9, the first camera 12 and the second camera 13 are stopped and the process is terminated. At this time, the processing result is a result of releasing the inhibition state, and it is determined in step A4 in FIG. 5A that the inhibition state of the mobile terminal device 20 is released.

  In step B8, the second image data stored in the storage unit 22 is image data used in an operator determination process, which will be described later. In the operator determination process, the operator who operates after canceling the cancellation and the suppression are canceled. This is for determining whether or not the operator at the time of determination is the same person. Therefore, it is not necessary to store the second image data generated by the second camera 13, and if it can be determined whether or not they are the same person, the person included in the second image data is selected. For example, only the face portion may be extracted and the image data of the face portion may be stored, or only the iris portion of the human eye may be extracted and the image data of the iris portion stored. Also good.

  FIG. 5C is a flowchart illustrating an operator determination process performed by the operator determination unit 15. This flow is executed in order to confirm the operator when the operator of the mobile terminal device 20 operates the operation unit 24.

  In step C1, the second camera 13 is activated, and in step C2, the second camera 13 images the subject. In step C3, the second image data stored in advance in the storage unit 22 is read. In step C4, the read second image data is compared with the second image data generated by imaging in step C2. And determining whether or not the generated second image data includes information that can identify the same person as the information that can identify the person included in the second image data stored in the storage unit 22. . If the information that can identify the same person is not included, the processing is terminated assuming that the processing result is not continued. In Step A8 of FIG. 5A, it is determined that the mobile terminal device 20 does not continue to be operable, and the operation is suppressed again. If the same person is not included, the processing ends as the processing result is continued. In step A8 of FIG. 5A, it is determined that the mobile terminal device 20 is kept operable, and waits until the operation unit 24 is operated next.

  If a person is included in the generated second image data and the person is not the same as the person included in the second image data stored in the storage unit 22, it is considered that the operator has changed. Therefore, since it cannot be determined that the changed operator is not the driver, the operation of the mobile terminal device 20 is suppressed again in consideration of the possibility that the driver is operating. In addition, even when no person is included in the generated second image data, it is impossible to determine that the current operator is not a driver. The operation of the terminal device 20 is suppressed.

  Next, as another embodiment, the necessity determination of the operation suppression of the mobile terminal device 20 is performed according to the output of the suppression state determination device 40. FIG. 5D is a flowchart illustrating the suppression release process when a suppression state determination unit is added to the mobile terminal device 20. In the present embodiment, the necessity determination as to whether or not the operation should be inhibited is added to the inhibition release process shown in FIG. 5A. The necessity determination is performed by the suppression state determination unit 16 based on the output of the suppression state determination device 40. The suppression state determination device 40 is realized by, for example, a speed detection sensor that detects the moving speed of the own apparatus.

  When this flow is started, first, in step D1, the suppression state determination unit 16 determines whether it is necessary to suppress the operation of the mobile terminal device 20. For example, if the moving speed exceeds a predetermined speed, it is determined that the user who is in the traveling vehicle or the like has the mobile terminal device 20 and needs to be suppressed for safety. . If the speed is equal to or lower than a predetermined speed, it is determined that the user who is walking is carrying the mobile terminal device 20 and does not require any particular suppression.

  If it is determined in step D1 that it is not necessary to suppress the operation, the process is terminated. If it is determined that the operation is required to be suppressed, the process proceeds to step D2. The operation deterring unit 10 displays a message or the like on the display unit 25 so that it can be seen that the operation is being inhibited in step D2.

  In step D <b> 3, the operation suppression unit 10 is in a state of not operating at least with respect to the operation unit 24 and the display unit 25. In step D <b> 4, the suppression state determination unit 16 determines whether it is necessary to suppress the operation of the mobile terminal device 20. The criteria for determination in step D4 are the same as in step D1.

  If it is determined in step D4 that it is not necessary to suppress the operation, the process proceeds to step D12, the operation suppression state is canceled, and a message or the like is displayed on the display unit 25 in step D13 so that it can be seen that the suppression is canceled. To finish the process. If it is determined that the operation needs to be suppressed, the process proceeds to step D5, and the suppression release determination unit 11 executes the suppression release determination process.

  In step D6, based on the processing result of the suppression cancellation determination process, the suppression cancellation determination unit 11 determines whether to cancel the suppression state. If it is determined that the inhibition state is to be released based on the result of the inhibition release determination process, the process proceeds to step D7, and the operation inhibition state is released. If it is determined not to cancel the suppression state based on the processing result of the suppression cancellation determination process, the process returns to step D4 to determine the necessity for suppression. In step D8, a message or the like is displayed on the display unit 25 so that it can be seen that the suppression is released.

  In step D <b> 9, the suppression state determination unit 16 determines whether it is necessary to suppress the operation of the mobile terminal device 20. The judgment criteria at step D9 are the same as those at steps D1 and D4. If it is determined in step D9 that it is not necessary to suppress the operation, the process proceeds to step D14, and the second image data including the operator stored in the storage unit 22 when it is determined to cancel the suppression is deleted. To finish the process. If it is determined that it is necessary to suppress the operation, the process proceeds to step D10, where the operator determination unit 15 executes an operator determination process.

  In step D11, it is determined whether or not to continue the operable state based on the processing result of the operator determination process. When continuing the operable state, the process returns to step D9 to determine the necessity of operation suppression. If the operable state is not continued, the process returns to step D1 to determine the necessity of operation suppression.

  In the above description, the driver of the car is described as an example of the person who should suppress the operation of the mobile terminal device 20. However, the present invention is not limited to this, and the child operates the mobile terminal device 20 without parental permission as parental control. In order not to do this, the person who should be prevented from operating can be a child or the like. An image of a child whose operation is to be suppressed is captured and registered in advance, and the suppression cancellation determination unit 11 determines whether or not the child registered in the image is included in the first image data as a person to be suppressed. It may be determined.

DESCRIPTION OF SYMBOLS 1 Terminal operation suppression apparatus 10 Operation suppression part 11 Inhibition cancellation determination part 12 1st camera 12a 1st camera control part 13 2nd camera 13a 2nd camera control part 14 Display 14a Display control part 15 Operator determination part 16 Inhibition state determination part DESCRIPTION OF SYMBOLS 20 Portable terminal device 21 Main control part 22 Memory | storage part 23 Temporary memory | storage part 24 Operation part 24a Inhibition cancellation button 25 Display part 26 Communication part 27 Speaker part 28 Vibration part 29 GPS receiving part 30 Microphone part 31 Camera part 40 Inhibition state determination device

Claims (5)

A mobile terminal device operated by a user,
A display for displaying an image;
An operation unit operated by a user;
A first imaging unit that images a subject and generates first image data;
A second imaging unit that images a subject and generates second image data;
A deterrence unit for deterring operations of the display unit and the operation unit;
A deterrence canceling unit for executing a deterrence canceling process for canceling the state in which the operation of the display unit and the operation unit is suppressed by the deterring unit;
An instruction input unit for inputting a start instruction for causing the suppression cancellation unit to start execution of the suppression cancellation process,
The first imaging unit and the second imaging unit are provided such that the incident direction of the light beam with respect to the first imaging unit and the incident direction of the light beam with respect to the second imaging unit are opposite to each other,
When the start instruction is input by the instruction input unit when the operation of the display unit and the operation unit is suppressed by the suppression unit,
First image data is generated by the first imaging unit, and the inhibition canceling unit operates the portable terminal device on the first image data generated by the first imaging unit based on a predetermined criterion. To determine if there are people that should be
If it is determined that the generated first image data includes a person to be prevented from operating the portable terminal device, the second image data is generated by the second imaging unit, and the inhibition is canceled. The unit determines whether the second image data generated by the second imaging unit includes information that can identify a person based on a predetermined criterion;
If it is determined that information that can identify a person is included in the generated second image data, the suppression cancellation unit cancels the state in which the operations of the display unit and the operation unit are suppressed. A portable terminal device.   If the first image data includes a person and a steering wheel of a vehicle as a predetermined reference, the inhibition release unit should inhibit operation of the portable terminal device on the first image data. The mobile terminal device according to claim 1, wherein it is determined that a driver who drives the vehicle as a person is included. When the state in which the operations of the display unit and the operation unit are suppressed is canceled, a storage unit that stores the second image data used in the suppression cancellation process;
When the operation unit is operated by the user after the state where the operations of the display unit and the operation unit are suppressed is released, second image data is generated by the second imaging unit, and the generated second image data is generated. By comparing the two image data and the second image data stored in the storage unit, it is possible to specify the same person as the information that can specify the person included in the second image data stored in the storage unit 2. A deterrence confirmation unit that causes the deterrence unit to deter the operations of the display unit and the operation unit if no such information is included in the generated second image data. Or the portable terminal device of 2. A deterrence state determination unit that determines whether the operation of the display unit and the operation unit is to be deterred according to the state of the mobile terminal device output by the deterrence state determination device;
According to the determination result of the suppression state determination unit, the suppression unit determines whether to suppress the operations of the display unit and the operation unit, and the suppression cancellation unit determines whether to execute a suppression cancellation process. The mobile terminal device according to claim 1, wherein the mobile terminal device is determined.   The inhibition state determination unit causes the inhibition state determination device to output the movement speed of the mobile terminal device, and the inhibition state determination unit executes inhibition release processing if the output movement speed is equal to or less than a predetermined movement speed. The state in which the operations of the display unit and the operation unit are suppressed without being performed is released, and if the detected moving speed exceeds a predetermined moving speed, the suppression releasing process is executed. The portable terminal device as described in any one of 1-4.