JP5750068B2 - Mobile terminal device, mobile terminal device operation control method, and mobile terminal device operation control program - Google Patents

Description

  The present invention relates to an apparatus, a method, and a program that can suppress the use of a mobile terminal device such as a mobile phone terminal while walking or driving a bicycle or a motorcycle.

  An increasing number of people are walking or riding bicycles while operating mobile phone terminals. Using a mobile phone terminal while driving a vehicle is illegal, but using a mobile phone terminal while walking is in the category of manners. In addition, although there are some local governments where the use of mobile phone terminals while riding bicycles is prohibited by ordinances etc., the actual situation is that sufficient measures have not been taken. Of course, 80% of the information received from the human senses is 80% of the total, and it goes without saying that it is dangerous if you do not move by looking forward.

  From such a background, Patent Document 1 described later discloses an invention relating to a mobile phone terminal device that prevents a user from operating while walking or driving. When the mobile phone terminal device according to the invention described in Patent Document 1 detects a user's walking vibration and is operated, the mobile phone terminal device locks the operation and disables the operation. Therefore, a message notifying that the operation cannot be performed is output. The present invention provides one means for effectively preventing the use of a mobile phone terminal device while walking.

JP 2008-53988 A

  By the way, the mobile phone terminal device of the invention described in Patent Document 1 described above detects that it is operated when the user is moving and disables the operation. Therefore, when an operation is performed on the mobile phone terminal device in a state where the user is stopped and some processing is executed in the mobile phone terminal device, even if the user moves after that, as long as no operation is performed The executed process is never stopped. For example, in recent years, smartphones and the like that are rapidly spreading are capable of playing back audio and video content. However, operations are rarely performed during playback of content, so use during walking with danger is sufficient. May not be suppressed. Moreover, it is desirable not only to suppress the use of the mobile phone terminal device while moving, but also to ensure the safety of the user and surrounding people as much as possible when the mobile phone terminal device is used while moving.

  In view of the above, the present invention effectively suppresses the use of a mobile terminal device such as a mobile phone terminal device while walking or driving a bicycle or a motorcycle, and is safe for the user and the surrounding people. It aims to be able to secure.

In order to solve the above-mentioned problem, the mobile terminal device of the invention described in claim 1 is:
Imaging means;
Display means;
Detecting means for detecting whether or not a process involving information display on the display means is being executed;
Detecting means for detecting whether or not the own device is in a moving state when it is detected by the detecting means that a process involving information display on the display means is being executed;
Limiting execution means for causing the display means to display the video imaged by the imaging means when the detection means detects that the own device is in a moving state ;
When it is detected by the restriction execution unit that the own device has stopped after switching from the information display to the image captured through the imaging unit and causing the display unit to display the video, And restriction release means for resuming the information display that has been performed until immediately before switching to the image display being picked up .

  According to the portable terminal device of the first aspect of the present invention, it is detected by the detecting means that the process accompanied by the information display on the display means is being executed, and the detecting means detects that the own device is in a moving state. Is detected. In this case, the restriction execution unit functions to display the video imaged through the imaging unit on the display unit.

  Thereby, the use of the portable terminal device can be effectively suppressed while walking or driving a bicycle or a motorcycle. In addition, the user can visually recognize the video of his / her traveling direction (front) through the display unit, and can promote the recovery of the user's line of sight toward the front, thereby ensuring the safety of the user and the surrounding people.

  According to the present invention, it is possible to effectively suppress the use of a mobile terminal device such as a mobile phone terminal device while walking or driving a bicycle or a motorcycle. And the safety | security of the user of a portable terminal device and the people around it can be ensured.

It is a block diagram for demonstrating the structural example of the mobile telephone terminal 1 of 1st Embodiment. It is a flowchart for demonstrating the process which suppresses use of the mobile telephone terminal 1 during a walk. FIG. 6 is a diagram for explaining an example of a display video (display image) displayed on the display unit 123 of the mobile phone terminal 1. It is a block diagram for demonstrating the structural example of 1 A of mobile telephone terminals of 2nd Embodiment. It is a flowchart for demonstrating the process which suppresses use of the mobile telephone terminal 1A during driving | running | working of a bicycle or a motorbike. It is a figure for demonstrating the example of the display image (display image) displayed on the display part 123 of 1 A of mobile telephone terminals. It is a flowchart for demonstrating the process which suppresses the use during the driving | running | working of the bicycle in the modification of 2nd Embodiment.

  Hereinafter, embodiments of the apparatus, method, and program of the present invention will be described with reference to the drawings. In the present invention, various portable terminal devices having a camera unit and a display screen of a display unit on opposite surfaces, for example, a cellular phone terminal, a tablet terminal, a portable game machine, a PDA (Personal Digital Assistants) ) Etc. However, in the embodiment described below, in order to simplify the description, a case where the present invention is applied to a mobile phone terminal with a camera function that is widely used will be described as an example. Moreover, in embodiment described below, the mobile phone terminal which suppresses the use during a walk is demonstrated as 1st Embodiment, and it uses during driving of a bicycle or a motorcycle as 2nd Embodiment. A mobile phone terminal for suppressing the above will be described.

[First embodiment: Mobile phone terminal for suppressing use while walking]
[Configuration example of mobile phone terminal 1]
FIG. 1 is a block diagram for explaining a configuration example of the mobile phone terminal 1 according to the first embodiment. First, each part which comprises the mobile telephone terminal 1 is demonstrated.

[Basic components of mobile phone terminal 1]
The control unit 100 controls each unit of the cellular phone terminal 1, and is a computer in which a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected through a CPU bus 104. Device. The storage device 110 includes a nonvolatile memory as a recording medium, and performs writing / recording holding / reading / deleting various application programs and data obtained by various processes to the nonvolatile memory.

  The transmission / reception antenna 111 and the wireless communication unit 112 realize a function of performing communication through a wide area network such as a mobile phone network or the Internet. A handset (speaker) 113 and a handset (microphone) 114 are for making a call. That is, the wireless communication unit 112 connects a call line to the other party through the mobile phone network, and enables a call through the handset (speaker) 113 and the handset (microphone) 114. In addition, the wireless communication unit 112 is connected to the Internet, enables transmission / reception of data through the Internet, transmission / reception of electronic mail, browsing of Web pages disclosed on the Internet, and the like.

  The key operation unit 121 includes hardware keys provided in the mobile phone terminal 1 and accepts operation inputs from the user. The display processing unit 122 and the display unit 123 are for displaying display information such as various images (images) and display messages. The touch panel 124 is affixed to the display screen of the display unit 123, detects a contact position (contact coordinates) by an indicator such as a user's finger, and notifies the control unit 100 of this. Therefore, the touch panel 124 constitutes an input interface together with display information displayed on the display screen of the display unit 123 whose display position is controlled by the control unit 100. The audio output unit 125, the speaker 126A, and the audio output terminal 126B are for outputting various audio information. The audio output terminal 126B is used with an earphone or a headphone connected thereto.

  The camera unit 127 includes an imaging lens, an imaging device, a camera signal processing circuit, and the like, and has a function of capturing an image of a subject and capturing the image as video (image) data of a digital signal. At the time of shooting, the video data captured through the camera unit 127 is supplied to the display processing unit 122 through the control unit 100. The display processing unit 122 forms a video signal to be supplied to the display unit 123 from the video data supplied thereto, and supplies this to the display unit 123. Thus, the video captured by the camera unit 127 is displayed on the display unit 123, and the user can take a picture while confirming the display image on the display unit 123.

  The microphone 128 and the audio input unit 129 have a function of collecting audio and capturing it as a digital signal, for example, when shooting a video through the camera unit 127. When an image recording instruction (recording instruction) is input through the key operation unit 121 or the touch panel 124, video data captured through the camera unit 127 and audio captured through the microphone 128 and the audio input unit 129 are displayed. For example, the data can be recorded (recorded or recorded) in a nonvolatile memory of the storage device 110.

  The vibrator 131 notifies the user of the occurrence of an incoming call or a warning by generating a vibration. The ringer 132 notifies the user of the occurrence of an incoming call or warning by generating a predetermined ringing tone or warning sound. The acceleration sensor 141 detects, for example, the inclination of the mobile phone terminal 1 to determine the vertical direction of the display unit 123, or detects vibration to realize the pedometer function provided in the mobile phone terminal 1. The GPS unit 142 and the GPS antenna 143 are for measuring the current position of the own device.

  The cellular phone terminal 1 having these configurations can make and receive calls. It is also possible to create and refer to an e-mail, access the Internet to send and receive e-mail, browse a web page, and use SNS (Social Networking Service). Further, for example, the video / audio content stored and held in the storage device 110 is reproduced and viewed through the display processing unit 122, the display unit 123, the audio output unit 125, and the speaker 126A, and the game is executed in the same manner. And can have fun. Of course, the music content stored and held in the storage device 110 can be reproduced through the audio output unit 125 and the audio output terminal 126B and listened to using an earphone or the like.

[About the part that realizes the function to suppress the use while walking]
The mobile phone terminal 1 according to the first embodiment has an operation state detection unit 151, a movement detection unit 152, and a warning control unit 153 as a part that realizes a function of suppressing use when the user is walking. , A restriction implementation unit 154 and a restriction release unit 155 are provided.

  Based on the control state of each unit by the control unit 100, the operation state detection unit 151 detects whether or not a process involving display information display on the display unit 123 other than call processing and music content playback processing is being executed. . Processes that include display information display on the display unit 123 include, for example, creation and reference of e-mails, browsing of Web pages, use of SNS, reproduction of video and audio content, execution of games, maintenance processing of setting information, and display. It is execution processing of various applications accompanying it. That is, the process involving display information display on the display unit 123 is various processes involving display information to be confirmed by the user.

  The movement detection unit 152 uses its own device when the operation state detection unit 151 detects that the process involving display of display information on the display unit 123 is being executed under the control of the control unit 100. Detects whether the user is walking. The detection process is performed based on the detection output of the acceleration sensor 141 or a change in the current position measured by the GPS unit 142.

  The warning control unit 153 warns the user of the mobile phone terminal 1 that the user is using the mobile phone terminal 1 when the movement detecting unit 152 detects that the user using the device is walking. I do. The warning control unit 153 vibrates the vibrator 131 through the control unit 100, supplies the display message data for warning to the display processing unit 122 through the control unit 100, displays the warning message on the display unit 123, and walks. Warn of use inside. Note that the warning message can be displayed in various display modes such that a balloon message is displayed, for example. In addition, the warning control unit 153 emits a warning sound from the ringer 132, supplies warning voice message data to the voice output unit 125 through the control unit 100, and outputs a voice warning message from the speaker 126A. Can be used to warn of use while walking.

  After the warning process by the warning control unit 153, the restriction execution unit 154 performs a process of switching the video (image) to be displayed on the display unit 123 to the video from the camera unit 127. In this case, the restriction execution unit 154 activates the camera unit 127 through the control unit 100, and supplies video data from the camera unit 127 to the display processing unit 122 through the control unit 100. As a result, an image corresponding to the image data from the camera unit 127 is displayed on the entire display screen of the display unit 123.

  Usually, in a mobile phone terminal, the camera unit and the display screen of the display unit are provided on opposite surfaces. This is because the video captured by the camera unit is displayed on the display unit so that the user can take a picture while confirming the video captured through the camera unit. Therefore, when the mobile phone terminal 1 is used by the user, the camera unit 127 captures an image in front of the user, that is, a traveling direction of the user. For this reason, when the user using the mobile phone terminal 1 starts walking, the image captured by the camera unit 127 is displayed on the entire display screen of the display unit 123 of the mobile phone terminal 1. Thereby, the user can recognize the state of his / her traveling direction from the video displayed on the display unit 123 of the mobile phone terminal 1. In addition, it is possible to visually avoid the obstacle in the traveling direction of the user and to promote the recovery of the line of sight in the traveling direction (forward) of the user.

  The restriction release unit 155 displays the video corresponding to the video data from the camera unit 127 on the display unit 123 by the restriction execution unit 154, and then detects that the user has stopped walking by the movement detection unit 152. Then, a process of displaying the original display information on the display unit 123 is performed. In this case, the restriction release unit 155 stops the operation of the camera unit 127 through the control unit 100. The restriction release unit 155 displays display data for displaying the display information displayed on the display unit 123 until immediately before switching to the video corresponding to the video data from the camera unit 127 through the control unit 100. The process of supplying to is resumed. Thus, the display information displayed on the display unit 123 is returned to the display immediately before switching to the video corresponding to the video data from the camera unit 127.

[About processing of the mobile phone terminal 1 to suppress use during walking]
Next, a process for suppressing the use of the mobile phone terminal 1 while walking performed by the mobile phone terminal 1 of the first embodiment having the configuration shown in FIG. 1 will be described. FIG. 2 is a flowchart for explaining processing for suppressing use of the mobile phone terminal 1 during walking. FIG. 3 is a diagram for explaining an example of a display video (display image) displayed on the display unit 123 of the mobile phone terminal 1. The process shown in FIG. 2 is mainly executed in the control unit 100 at predetermined timings when the mobile phone terminal 1 is powered on.

  When the process shown in FIG. 2 is executed, the control unit 100 controls the operation state detection unit 151 to detect its own operation state (step S101). Then, based on the detection result in step S101, the control unit 100 determines whether or not the process associated with the display information display on the display unit 123 is being executed in the own device (step S102). When it is determined in the determination process in step S102 that the process with display information display is not being executed, there is no need to restrict the use, so the process shown in FIG. 2 is terminated and the next execution timing is waited for. become. That is, when the telephone call process, the voice reproduction process, the standby process, etc. are performed and the process accompanied by the display information display is not performed, the process shown in FIG. 2 ends.

  Further, in the cellular phone terminal 1, processing involving display of display information such as e-mail reference, e-mail creation, e-mail transmission / reception, Web page browsing, SNS use, video / audio content reproduction, and the like is performed. Suppose. In this case, after receiving the detection process in step S101, it is determined in the determination process in step S102 that a process involving display information display is being executed. Specifically, as shown in FIG. 3A, it is assumed that an e-mail addressed to the user is received and displayed on the display unit 123 for browsing. In this case, after receiving the detection process in step S101, it is determined in the determination process in step S102 that a process involving display information display is being executed.

  In this case, the control unit 100 controls the movement detection unit 152 to execute a process of detecting whether or not the user using the own device is walking (step S103). And the control part 100 discriminate | determines whether the user who is using the own apparatus is walking based on the detection result of step S103 (step S104). If it is determined in step S104 that the user using the own device is not walking, it is not necessary to suppress the use, and the processing from step S101 is repeated.

  When it is determined in step S104 that the user using the device is walking, the control unit 100 controls the warning control unit 153, and the use of the mobile phone terminal 1 while walking is dangerous. A warning to that effect is output (step S105). In step S105, as described above, a warning that the walking while the mobile phone terminal 1 is in use is dangerous by the vibration by the vibrator 131 and the message display on the display unit 123.

  Thereafter, the control unit 100 controls the restriction execution unit 154 to activate the camera unit 127 and switch the display video to a video corresponding to the video data from the camera unit 127 (step S106). In this case, instead of the video shown in FIG. 3A, for example, as shown in FIG. 3B, the user's image captured by the camera unit 127 provided on the surface opposite to the display screen 123G of the display unit 123 is displayed. A forward (traveling direction) image is displayed on the entire surface of the display screen 123G of the display unit 123. As a result, the user of the mobile phone terminal 1 can check his / her traveling direction from the video displayed on the display unit 123, and as shown in FIG. And the existence of things. In other words, it is possible to secure a field of view of the user in the traveling direction, and to visually avoid the obstacle in the traveling direction, and to restore the user's line of sight in the traveling direction (forward).

  And similarly to the process of step S103, the control part 100 controls the movement detection part 152, and performs the process which detects whether the user who is using the own apparatus is walking (step S107). Based on the detection result of step S107, the control unit 100 determines whether or not the user using the own device has stopped (step S108). When it is determined that the user has not stopped, the processing from step S107 is performed. repeat. That is, it waits for the user to stop walking and stop.

  Also, in the determination process of step S108, when it is determined that the user has stopped walking and stopped, the control unit 100 controls the restriction release unit 155 to return the display image on the display unit 123 to the image before switching. Is performed (step S109). Specifically, the restriction release unit 155 stops the operation of the camera unit 127 through the control unit 100. Then, the restriction release unit 155 resumes the supply of the display data supplied to the display processing unit 122 until immediately before switching from the control unit 100 to the video display from the camera unit 127, and the display video on the display unit 123 is restored to the original. Process to return to video. Thereafter, the processing from step S101 is repeated.

  As described above, in the cellular phone terminal 1 according to the first embodiment, when it is detected that the user is walking while executing the process with the display information displayed on the display unit 123. The use of the mobile phone terminal 1 can be appropriately suppressed. When the user of the mobile phone terminal 1 stops walking, the display on the display unit 123 is returned to the state before walking. Therefore, the user can use the mobile phone terminal 1 without any restriction when walking is stopped.

[Effect of the first embodiment]
As described above, when the mobile phone terminal 1 according to the first embodiment detects that the user is walking while executing a process involving display of display information on the display unit 123, the camera 1 The use of the mobile phone terminal 1 can be appropriately suppressed in an unprecedented manner in which the video captured by the unit 127 is displayed on the display unit 123. In addition to simply suppressing the use of the mobile phone terminal 1 while walking, it is possible to visually avoid the obstacle in the traveling direction of the user and restore the line of sight in the traveling direction (forward) of the user. That is, the safety of the user and the surrounding people can be ensured.

[Modification of First Embodiment]
In the mobile phone terminal 1, for example, the detection output of the acceleration sensor 141 is constantly monitored, and walking in consideration of the magnitude (level) of the detection output, the change pattern of the detection output (movement and stop pattern), and the like. You may make it detect whether it is inside. Further, as described above, based on the current position from the GPS unit 142, the moving speed is calculated from the distance between the two points and the time taken to move the distance between the two points. If it is 4 km / h or less, it can be determined that the person is walking.

  In addition, when video corresponding to video data from the camera unit 127 is displayed on the display unit 123, the video data can be recorded in the storage device 110 and used as evidence in the event of a trouble. Of course, not only video data but also audio data collected through the microphone 128 may be recorded.

[Second embodiment: Mobile phone terminal for suppressing use while driving a bicycle or motorcycle]
Mobile phone terminals can be used not only while walking, but also while driving bicycles and motorcycles. However, when driving a bicycle or a motorcycle, the acceleration sensor 141 may not be able to obtain a significant detection output as during walking. Even if the current position from the GPS unit 142 is also taken into consideration, it may be indistinguishable from the case of riding on a vehicle such as a bus, car, or train. Therefore, the mobile phone terminal 1A according to the second embodiment detects the moving speed of the mobile phone terminal 1A by analyzing the video from the camera unit, and also considers this moving speed, so that a bicycle or motorcycle can be used. Whether or not the vehicle is in operation is detected. The mobile phone terminal 1A according to the second embodiment appropriately suppresses the use of the mobile phone terminal 1A while driving a bicycle or a motorcycle.

[Configuration example of mobile phone terminal 1A]
FIG. 4 is a block diagram for explaining a configuration example of the cellular phone terminal 1A according to the second embodiment. The cellular phone terminal 1A according to the second embodiment is different from the cellular phone terminal 1 according to the first embodiment shown in FIG. 1 in that a camera video analysis unit 156 is provided. As will be described later, the control unit 100 also takes into account the function as an imaging control unit that activates the camera unit 127 when the movement of the user is detected, and the analysis result of the camera image analysis unit 156. A function as driving detection means for detecting whether or not a bicycle or a motorcycle is being driven is realized. The other parts are configured in substantially the same manner as the cellular phone terminal 1 of the first embodiment shown in FIG. For this reason, in the mobile phone terminal 1A of the second embodiment shown in FIG. 4, the same reference numerals are given to the same parts as those of the mobile phone terminal 1 of the first embodiment shown in FIG. In addition, the description of that part is omitted because it overlaps.

[About the part that realizes the function to suppress use while driving a bicycle or motorcycle]
The mobile phone terminal 1A according to the second embodiment does not suppress the use by simply detecting whether the user is moving, and is driving a bicycle or a motorcycle in consideration of the moving speed of the own device. It is discriminated whether or not it is used, and the use is suppressed when driving. For this reason, also in the mobile phone terminal 1A of the second embodiment, the operation state detection unit 151 detects whether or not a process involving display information display on the display unit 123 is being executed. When it is detected by the operation state detection portion 151 that a process involving display information display on the display unit 123 is being executed, the movement detection unit 152 detects the current output from the acceleration sensor 141 or the current GPS unit 142. Based on the position information, it detects whether or not the aircraft is moving.

  When the movement detection unit 152 detects that the own device is moving, the control unit 100 activates the camera unit 127 to start shooting, and analyzes video data of the shot video. Analysis is performed by the unit 156 to calculate the moving speed of the own device. Specifically, the camera video analysis unit 156 analyzes video data sequentially captured through the camera unit 127 and obtains a moving speed. The moving speed can be obtained by analyzing how fast the video based on the video data from the camera unit 127 is changing.

  Then, based on the analysis result of the camera video analysis unit 156, the control unit 100 detects that the user of the mobile phone terminal 1A is driving a bicycle or a motorcycle if the moving speed is 5 km / h or more, for example. In this case, the control unit 100 first controls the warning control unit 153, and in the same manner as in the case of the mobile phone terminal 1 of the first embodiment described above, the mobile phone terminal 1A during driving a bicycle or a motorcycle. Warning that using is dangerous. Thereafter, the control unit 100 controls the restriction execution unit 154 to switch the video displayed on the entire display screen of the display unit 123 to the video from the camera unit 127.

  As a result, similarly to the case of the mobile phone terminal 1 of the first embodiment described above, the obstacle in the user's traveling direction is visually avoided and the line of sight in the traveling direction (forward) of the user is restored. Thereafter, it is assumed that the control unit 100 detects that the user has stopped (stopped the bicycle or the motorcycle) based on the analysis result from the camera image analysis unit 156. In this case, the control unit 100 controls the restriction release unit 155 to restore the video displayed on the display unit 123 to the video before switching to the video from the camera unit 127. Thereby, the user of the mobile phone terminal 1A can use the mobile phone terminal 1 without any restrictions when the bicycle or the motorcycle is stopped.

[Treatment of the mobile phone terminal 1A to suppress use while driving a bicycle or motorcycle]
Next, processing for suppressing the use of the mobile phone terminal 1A while driving a bicycle or a motorcycle performed by the mobile phone terminal 1A according to the second embodiment having the configuration shown in FIG. 4 will be described in detail. FIG. 5 is a flowchart for explaining a process of suppressing the use of the mobile phone terminal 1A while driving the bicycle or motorcycle. FIG. 6 is a diagram for explaining an example of a display video (display image) displayed on the display unit 123 of the mobile phone terminal 1A. The process shown in FIG. 5 is a process that is mainly executed in the control unit 100 at predetermined timings when the mobile phone terminal 1A is powered on.

  When the process shown in FIG. 5 is executed, the control unit 100 controls the operation state detection unit 151 to detect its own operation state (step S201). Then, based on the detection result of step S201, the control unit 100 determines whether or not the process associated with the display information display on the display unit 123 is being executed in the own device (step S202). If it is determined in the determination process in step S202 that the process involving display of display information is not being executed, there is no need to limit the use, so the process shown in FIG. 5 is terminated and the next execution timing is awaited. become.

  Also, in the cellular phone terminal 1A of the second embodiment, for example, as shown in FIG. 3A, an e-mail addressed to itself is received and displayed on the display unit 123 for browsing. To do. In this case, after receiving the detection process in step S201, it is determined in the determination process in step S202 that a process involving display information display is being executed. In this case, the control unit 100 controls the movement detection unit 152 to execute processing for detecting whether or not the user using the own device is moving (step S203).

  In step S203, when the detection output from the acceleration sensor 141 detects vibrations to the extent that they are generated when they are placed on a vehicle such as a bicycle or a motorcycle, it is detected that the aircraft is moving. Further, the moving speed is obtained based on the distance between the two points determined by the current position sequentially provided from the GPS unit 142 and the time taken to move between the two points, and the movement is made according to the speed. It is also possible to detect whether or not Of course, you may use these together.

  Then, the control unit 100 determines whether or not the user using the own device is moving based on the detection result of Step S103 (Step S204). If it is determined in step S204 that the user using the own device is not moving, there is no need to suppress the use, and the processing from step S201 is repeated. If it is determined in step S204 that the user using the device is moving, the control unit 100 activates the camera unit 127 and the voice input unit 129 to start recording and recording. (Step S205). In this case, the video data of the video captured through the camera unit 127 and the audio data of the audio collected through the microphone 128 are stored in the storage device 110 through the control unit 100.

  Next, the control unit 100 controls the camera image analysis unit 156, analyzes the video data sequentially taken in through the camera unit 127 as described above, and starts calculation processing of the moving speed of the own device (step S206). ). Then, the control unit 100 determines whether the user of the own device is driving a bicycle or a motorcycle based on the moving speed obtained by the camera image analysis unit 156 (step S207).

  Assume that in the determination processing in step S207, it is determined that the user of the own device is driving a bicycle or a motorcycle. In this case, the control unit 100 controls the warning control unit 153 to output a warning that the use of the mobile phone terminal 1A while driving a bicycle or motorcycle is dangerous (step S208). In this step S208, the vibrator 131 is vibrated, or a display message is displayed on the display unit 123 through the control unit 100 and the display processing unit 122 to indicate that it is dangerous to use the mobile phone terminal 1A while driving a bicycle or motorcycle. Or

  Thereafter, the control unit 100 controls the restriction execution unit 154 to switch the display video displayed on the entire display screen of the display unit 123 to the video from the camera unit 127 (step S209). In this case, if the original display is, for example, the video shown in FIG. 3A, the video is changed to a video in front of the user (traveling direction) captured by the camera unit 127 as shown in FIG. Thereby, the field of view of the user's traveling direction is secured, the obstacle of the user's traveling direction is visually avoided, and the user's line of sight in the traveling direction (forward) is restored. Then, the control unit 100 refers to the moving speed obtained by the camera image analysis unit 156 and determines whether or not the user has stopped (whether or not the bicycle or the motorcycle is stopped) (step S210). If it is determined in step S210 that the operation has not been stopped, the processing from step S210 is repeated. That is, it waits for the user to stop and stop the bicycle or motorcycle.

  Further, in the determination process of step S210, when it is determined that the user has stopped driving and stopping the bicycle or motorcycle, the control unit 100 controls the restriction release unit 155 to change the display on the display unit 123 before switching. Processing for returning to display is performed (step S211). Specifically, the restriction release unit 155 stops the operation of the camera unit 127 through the control unit 100. Then, the restriction release unit 155 resumes the supply of the display data supplied to the display processing unit 122 until immediately before switching from the control unit 100 to the video display from the camera unit 127, and the display video on the display unit 123 is restored to the original. Process to return to video. Thereafter, the control unit 100 stops the functions of the camera unit 127, the audio input unit 129, and the camera video analysis unit 156, ends the calculation of the moving speed (step S212), and repeats the processing from step S201. To do.

  Also, in the determination process of step S207, it is assumed that it is determined that the user of the own device is not driving a bicycle or a motorcycle. In this case, for example, it is considered that the user is using a transportation system that he / she is not driving, such as a bus, car, train, etc., so the process proceeds to step S213, and the calculation of the moving speed is terminated (step S212). Thereafter, the processing from step S201 is repeated.

  As described above, when the mobile phone terminal 1A according to the second embodiment detects that the user is moving by driving a bicycle or a motorcycle, the use of the mobile phone terminal 1A by the user is suppressed, The safety of users and those around them can be improved.

[Effect of the second embodiment]
As described above, the mobile phone terminal 1A according to the second embodiment compulsorily performs a process involving display of display information on the display unit 123 while the user is driving a bicycle or motorcycle. Thus, it is possible to appropriately suppress the use of the mobile phone terminal 1 </ b> A in an unprecedented manner in which the video captured by the camera unit 127 is displayed on the display unit 123. And not only restraining the use of the mobile phone terminal 1A while driving a bicycle or a motorcycle, but also visually avoiding the obstacle in the traveling direction of the user and restoring the line of sight in the traveling direction (forward) of the user. be able to. That is, it effectively suppresses the use of the mobile phone terminal 1A while driving a bicycle or motorcycle, which is very dangerous because it is moving at a higher speed than when walking, and ensures the safety of the user and the people around them. be able to.

[Modification of Second Embodiment]
[Modification 1]
In the mobile phone terminal 1A according to the modification of the second embodiment, image recognition technology is used to detect the presence of an obstacle present in the image captured by the camera unit 127, and to alert the surroundings. Do. Note that the mobile phone terminal 1A of the modification of the second embodiment also has the same configuration as the mobile phone terminal 1A of the second embodiment shown in FIG. The unit 156 also performs recognition processing for obstacles present in the video from the camera unit 127.

  FIG. 7 is a flowchart for explaining processing for suppressing use of a bicycle or motorcycle while driving in the mobile phone terminal 1A according to the modification of the second embodiment. The process shown in FIG. 7 is a process that is mainly executed in the control unit 100 at predetermined timings when the mobile phone terminal 1A is powered on.

  In FIG. 7, the processing from step S301 to step S305 is performed in the same manner as the processing from step S201 to step S205 shown in FIG. After the process of step S305, the control unit 100 controls the camera image analysis unit 156 and analyzes the image from the camera unit 127, thereby calculating the moving speed and recognizing the obstacle using the image recognition technology. Processing is started (step S306). Specifically, in step S306, as in the process of step S206 shown in FIG. 5, the moving speed calculation process is performed, and obstacles existing in the moving direction of the video user from the camera unit 127 are patterned. It also performs recognition processing using recognition technology.

  Then, the control unit 100 determines whether the user of the own device is driving a bicycle or a motorcycle based on the moving speed obtained by the camera image analysis unit 156 (step S307). Assume that it is determined in the determination process in step S307 that the user of the own device is driving a bicycle or a motorcycle. In this case, the control unit 100 controls the warning control unit 153 to output a warning that the use of the mobile phone terminal 1A while driving a bicycle or motorcycle is dangerous (step S308). Thereafter, the control unit 100 controls the restriction execution unit 154 to switch the display video to the video from the camera unit 127 (step S309). Thereby, the field of view of the user's traveling direction is secured, the obstacle of the user's traveling direction is visually avoided, and the user's line of sight in the traveling direction (forward) is restored. These processes in steps S307 to S309 are performed in the same manner as the processes in steps S207 to S209 shown in FIG.

  Thereafter, the control unit 100 determines whether or not there is an obstacle in the traveling direction of the user based on the obstacle recognition result by the camera image analysis unit 156 (step S310). For example, as shown in FIG. 6, it is assumed that a toy car that a child plays and pushes is placed on the road ahead (traveling direction) of the user. In this case, based on the result of the obstacle recognition process in step S306, in the determination process in step S310, it is determined that there is an obstacle ahead of the user.

  Assume that it is determined in the determination process in step S310 that an obstacle exists in the direction of travel of the user. In this case, the control unit 100 controls the warning control unit 153 to emit an alarm sound with a large volume through the ringer 132, or emits an alarm sound with a large volume from the audio output unit 125 and the speaker 126A. (Step S311). As a result, the danger is notified to a person existing in the vicinity. In the example shown in FIG. 6, the case where an object (a toy car) is present in front of the user of the mobile phone terminal 1 </ b> A is shown, but there are of course cases where the obstacle is a person or an animal. Therefore, when there are obstacles such as people, animals, and objects in the direction of travel of the user, there is a possibility that the user will be in danger by using the mobile phone terminal 1A while driving the user's bicycle or motorcycle. An alarm is also issued to a certain person around.

  Then, after the alarm process of step S311, or when it is determined in the determination process of step S310 that there is no obstacle in the traveling direction, the control unit 100 proceeds to the determination process of step S312. In this case, the control unit 100 determines whether or not the user has stopped (whether self-transfer or motorbike driving has been stopped) based on the moving speed obtained by the camera image analysis unit 156 (step S312). ). When it is determined in step S312 that the vehicle is not stopped, the control unit 100 determines the direction of travel of the user based on the obstacle recognition result obtained by the camera image analysis unit 156, as in the process of step S310 described above. It is determined whether or not there is an obstacle (step S313). If it is determined that there is an obstacle in the determination process in step S313, a loud alarm sound is emitted as in the process in step S311, and it is dangerous for people in the vicinity. Is notified (step S314). After the process of step S314, and in the determination process of step S313, if it is determined that there is no obstacle, the process from step S312 is repeated.

  Further, in the determination process of step S2312, when determining that the user has stopped driving and stopping the bicycle or motorcycle, the control unit 100 controls the restriction release unit 155 before switching the display image on the display unit 123. The process of returning to the video is performed (step S315). The process of step S315 is a process performed in the same manner as step S212 illustrated in FIG. Then, the restriction release unit 155 resumes the supply of the display data supplied to the display processing unit 122 until immediately before switching from the control unit 100 to the video display from the camera unit 127, and the display video on the display unit 123 is restored to the original. Process to return to video. Thereafter, the control unit 100 stops the functions of the camera unit 127, the voice input unit 129, and the camera video analysis unit 156, and ends the movement speed calculation process and the obstacle recognition process (step S316). The processing from step S301 is repeated.

  Further, it is assumed that in the determination process in step S307, it is determined that the user of the own device is not driving a bicycle or a motorcycle. In this case, for example, it is considered that the user is using a transportation system that he / she does not drive, such as a bus, a car, or a train. The recognition process is terminated (step S316), and then the process from step S301 is repeated.

  As described above, the mobile phone terminal 1A in the modification of the second embodiment is used by the user of the mobile phone terminal 1A when it is detected that the user is moving by driving a bicycle or a motorcycle. It can be suppressed and the safety of users and those around them can be improved. Furthermore, when it is confirmed that there is an obstacle in the traveling direction of the user, the danger can be notified to surrounding people by a warning sound or the like.

[Modification 2]
In the mobile phone terminal 1A according to the second embodiment described above, the moving speed obtained by analyzing the video from the camera unit 127 is also taken into consideration, and the moving speed is less than that during walking. It was determined whether or not fast bicycles and motorcycles are being driven. However, it is not limited to this. By analyzing the video from the camera unit 127, the orientation and movement direction of the user may also be detected, and it may be determined whether or not the bicycle or motorcycle is being driven in consideration of this.

  For example, the orientation of the user is usually the same as the orientation of the camera unit 127 of the mobile phone terminal 1A. Further, the moving direction can be specified by the direction in which the video flows (change direction). For this reason, for example, when the video of the mode shown in FIG. 6 can be taken, it can be determined that the direction of the user is the front and the moving direction is from the rear to the front of the user. As described above, when the user's direction matches the moving direction and the moving speed is faster than that when walking, it can be determined that the bicycle or motorcycle is being driven. Thus, by taking into account the user's direction and moving direction, it is possible to effectively distinguish, for example, a case where the user is riding on a bus or a train in a landscape orientation and a case where a bicycle or a motorcycle is being driven.

  Of course, when getting on a car or a bus, the user may sit in the direction of travel, but in that case, it can be determined by image recognition whether the vehicle is in a vehicle such as a car or a bus. Further, when the bicycle or motorcycle is moving at a certain speed, it is difficult to use the mobile phone terminal 1A anymore. For this reason, when the moving speed is equal to or higher than a predetermined value, it is possible to determine that the vehicle is not in a bicycle or a motorcycle and is in a vehicle such as an automobile or a bus. When the upper limit value of the moving speed is used, it is desirable to use it together with other discrimination methods such as using image recognition.

[Restricting the use of mobile phone terminals while walking and driving bicycles and motorcycles]
In the first embodiment described above, the use of the mobile phone terminal during walking can be suppressed, and in the second embodiment described above, the use of the mobile phone terminal during driving of a bicycle or motorcycle can be suppressed. I made it. However, it is of course possible to have these together. The configuration of the mobile phone terminal in this case is the same as that of the mobile phone terminal 1A of the second embodiment shown in FIG.

  Then, the cellular phone terminal may perform processing that combines FIG. 2 and FIG. 5 or processing that combines FIG. 2 and FIG. Basically, the processing from step S101 to step S104 in FIG. 2, the processing from step S201 to step S204 in FIG. 5, and the processing from step S301 to step S304 in FIG.

  Therefore, a detection process is performed to determine whether or not a process involving display of display information on the display unit 123 is being executed in the own device (steps S101, 201, and 301), and based on this, the display information on the display unit 123 is displayed. Assume that it is determined that a process involving display is being executed (steps S102, 202, 302). In this case, the movement state of the user of the own device is detected (steps S103, 203, 203), and it is determined whether the user is moving by walking, moving other than walking, or stopped (steps S104, 204, 304). ). In the detection processing of steps S103, 203, and 203, whether the detection output of the acceleration sensor 141 is a detection output peculiar to the user's walking, or is a detection output indicating movement but not a peculiar detection output during walking, Alternatively, the movement state of the user can be detected depending on whether the detection output is extremely small. Further, the moving speed obtained using the current position from the GPS unit 142 may be considered.

  When it is determined in steps S104, 204, and 304 that the process is stopped based on the detection processes in steps S103, 203, and 203, steps S101 and 201 are performed in the same manner as shown in FIGS. , 301 is repeated. When it is determined in steps S104, 204, and 304 that the vehicle is moving by walking, the processes in steps S105 to S109 shown in FIG. 2 are executed. Further, when it is determined in steps S104, 204, and 304 that the vehicle is moving other than walking, the processing from step S205 to step S212 shown in FIG. 5 or the processing from step S305 to step S316 shown in FIG. Run. In addition, after the process of step S109, 223, 316, the process from step S101, 201, 301 is repeated.

  In this way, by performing the process of combining FIG. 2 and FIG. 5 or the process of combining FIG. 2 and FIG. 7, even when the user is walking, or when the user is driving a bicycle or motorcycle, In addition, the use of the mobile phone terminal can be appropriately suppressed.

[Effects of the embodiment, etc.]
With the mobile phone terminals 1 and 1A of the above-described embodiment, the user of the mobile phone terminals 1 and 1A recognizes that it is dangerous to use the mobile phone terminal while walking or driving a bicycle or motorcycle. Can do. Therefore, it is not prohibited by law or the like, and it can be recognized as a manner not to use a mobile phone terminal when moving.

  In addition, it is desirable to incorporate the function of performing the processing shown in FIGS. 2, 5, and 7 into a mobile phone terminal at the time of shipment from a mobile phone company or a mobile phone manufacturer. Of course, functions can also be enhanced by providing programs for performing the processes shown in FIGS. 2, 5, and 7 to the existing mobile phone terminals through the Internet or the like. That is, the functions of the operation state detection unit 151, the movement detection unit 152, the warning control unit 153, the restriction execution unit 154, the restriction release unit 155, and the camera image analysis unit 156 are realized as functions of the control unit 100 by software. Is possible.

[Others]
As can be seen from the description of the above-described embodiment, the function as the imaging unit of the mobile terminal device is realized by the camera unit 127 of the mobile phone terminal 1 and 1A, and the function as the display unit of the mobile terminal device is displayed. The unit 123 is realized. The function as the detection means of the mobile terminal device is realized by the operation state detection unit 151 of the mobile phone terminals 1 and 1A, and the function as the detection means of the mobile terminal device is the movement detection unit of the mobile phone terminals 1 and 1A. 152 is realized. In addition, the function as the restriction enforcement unit of the portable terminal device is realized by the restriction enforcement unit 154 of the cellular phone terminal 1 or 1A.

  The functions of the vibration detection means and the current position positioning means of the mobile terminal device are realized by the acceleration sensor 141 and the GPS unit 142 of the mobile phone terminal 1 and 1A. In addition, the function as the imaging control unit of the mobile terminal device is realized by the control unit 100 of the mobile phone terminal 1A, and the function as the speed detection unit of the mobile terminal device is realized by the camera video analysis unit 156 of the mobile phone terminal 1A. doing. The operation detection means of the mobile terminal device is realized by the control unit 100 of the mobile phone terminal 1A, and the function as the restriction release means of the mobile terminal device is realized by the restriction release unit 155 of the mobile phone terminal 1, 1A. Yes.

  The processing shown in the flowcharts of FIGS. 2, 5, and 7 corresponds to the operation control method of the portable terminal device of the present invention. Moreover, the program which performs the process according to the flowchart of FIG.2, FIG.5, FIG.7 is the operation control program of the portable terminal device of this invention. Therefore, the portable terminal of the present invention is formed by forming a program for executing the processes shown in FIGS. 2, 5, and 7 and mounting the program on the portable terminal apparatus so that the portable terminal apparatus can execute the program. The apparatus can be easily realized.

  DESCRIPTION OF SYMBOLS 1, 1A ... Cell-phone terminal, 100 ... Control part, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... CPU bus, 110 ... Memory | storage device, 111 ... Transmission / reception antenna, 112 ... Wireless communication part, 113 ... Handset, 114 ... Speaker 121 ... Key operation unit 122 ... Display processing unit 123 ... Display unit 124 ... Touch panel 125 ... Audio output unit 126A ... Speaker 126B ... Audio output terminal 127 ... Camera unit 128 ... Microphone, 129 ... voice input unit, 131 ... vibrator, 132 ... ringer, 141 ... acceleration sensor, 142 ... GPS unit, 143 ... GPS antenna, 151 ... operating state detection unit, 152 ... movement detection unit, 153 ... warning control unit, 154 ... Restriction execution unit, 155 ... Restriction release unit, 156 ... Camera image analysis unit

Claims (6)

Imaging means;
Display means;
Detecting means for detecting whether or not a process involving information display on the display means is being executed;
Detecting means for detecting whether or not the own device is in a moving state when it is detected by the detecting means that a process involving information display on the display means is being executed;
Limiting execution means for causing the display means to display the video imaged by the imaging means when the detection means detects that the own device is in a moving state ;
When it is detected by the restriction execution unit that the own device has stopped after switching from the information display to the image captured through the imaging unit and causing the display unit to display the video, A portable terminal device comprising: restriction release means for resuming the information display that has been performed until immediately before switching to the image display being picked up . The mobile terminal device according to claim 1,
One or both of vibration detection means and current position positioning means,
The mobile terminal device according to claim 1, wherein the detection means detects whether or not the own device is in a moving state based on output information from one or both of the vibration detection means and the current position positioning means. The mobile terminal device according to claim 2,
An imaging control means for operating the imaging means when it is detected that the own device is in a moving state based on output information from one or both of the vibration detection means and the current position positioning means;
A speed detecting means for detecting a moving speed of the own machine by analyzing a video imaged by the imaging means;
Driving detection means for detecting whether or not the user of the aircraft is driving a bicycle or a motorcycle in consideration of the moving speed of the aircraft,
The restriction control unit is configured to display an image captured by the imaging unit when the own unit is in a moving state and the user of the own unit is driving a bicycle or a motorcycle. A portable terminal device characterized by being displayed on the screen. Imaging means;
Display means;
Detecting means for detecting whether or not a process involving information display on the display means is being executed;
When it is detected by the detection means that a process involving information display on the display means is being executed , the own device is based on output information from one or both of the vibration detection means and the current position positioning means. A detection means for detecting whether or not the vehicle is in a moving state;
An imaging control means for operating the imaging means when the detection means detects that the device is in a moving state;
A speed detecting means for detecting a moving speed of the own machine by analyzing a video imaged by the imaging means;
Driving detection means for detecting whether or not the user of the own machine is driving a bicycle or a motorcycle in consideration of the moving speed of the own machine detected by the speed detecting means;
When the detection unit detects that the own device is in a moving state and the driving detection unit detects that the user of the own device is driving a bicycle or a motorcycle, the imaging unit And a restriction implementing means for causing the display means to display the displayed video. An operation control method performed in a mobile terminal device including an imaging unit and a display unit,
A detection step of detecting whether or not a process involving information display on the display means is being executed through the detection means;
In the detection step, when it is detected that a process involving information display on the display unit is being executed, a detection step of detecting whether or not the own device is in a moving state through the detection unit;
In the detection step, when it is detected that the device is in a moving state, a restriction execution step for causing the display means to display the video imaged by the imaging means through the restriction execution means ;
In the restriction implementing step, after switching from the information display to a video imaged through the imaging unit and causing the display unit to display the image, imaging is performed through the imaging unit when it is detected that the own device has stopped. And a restriction canceling step of resuming the information display that was performed until immediately before switching to the video display being performed . A program executed by a computer mounted on a portable terminal device including an imaging unit and a display unit,
A detection step of detecting whether or not a process involving information display on the display means is being executed through the detection means;
In the detection step, when it is detected that a process involving information display on the display means is being executed, the detection step detects whether the own device is in a moving state through the detection means;
In the detection step, when it is detected that the device is in a moving state, a restriction execution step for causing the display means to display the video imaged by the imaging means through the restriction execution means ;
In the restriction execution step, after switching from the information display to a video imaged through the imaging unit and displaying the video on the display unit, imaging is performed through the imaging unit when it is detected that the own device has stopped. An operation control program for a portable terminal device, comprising: executing a restriction release step of resuming the information display that has been performed until immediately before switching to the current video display .

Images