JP2005051427A - Portable terminal device, control method therefor, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable terminal device which can realize the maintenance and enhancement of a manner at the time of using the portable terminal device. <P>SOLUTION: The portable terminal device is characterised in that it detects the moving state of a user and at least partially limits the usable functions on the basis of the detected moving state. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a portable terminal device such as a cellular phone or a portable computer.
[0002]
[Prior art]
In recent years, mobile phones and the like have become highly functional, and many functions requiring an operation while looking at the screen have been installed. Among them, e-mail is particularly popular, and walking (here, walking means that the user is traveling as a pedestrian or in a similar manner, such as running or using a light vehicle such as a bicycle). There are often cases where e-mail is used.
[0003]
[Problems to be solved by the invention]
However, such a method of using the portable terminal device is not preferable at all. In other words, it is pointed out that the manners are decreasing for such users, such as other passersby must pay attention to the direction of travel.
[0004]
OBJECT OF THE INVENTION
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a mobile terminal device capable of maintaining and improving manners of using a mobile terminal.
[0005]
[Means for Solving the Problems]
The present invention for solving the problems of the above-described conventional example is a portable terminal device, and at least a part of functions that can be used based on the detection means for detecting the movement state of the user and the detected movement state And a control means for limiting.
[0006]
Here, the detection means detects that the user is walking, and the control means restricts at least a part of available functions when it is detected that the user is walking. It is good. In this case, the detection means may detect that the user is walking based on at least one of the moving speed and the moving position of the mobile terminal device.
[0007]
Furthermore, it is good also as providing the imaging means which images the periphery image of a portable terminal device, and the said detection means is good also as detecting a user's movement state based on the periphery image imaged by the said imaging means. In addition, in the case of including an imaging unit that captures a peripheral image of the mobile terminal device as described above, the detection unit detects a moving state of the user based on a series of peripheral images intermittently captured by the imaging unit. It is good to do.
[0008]
Furthermore, a method for controlling a mobile terminal device according to an aspect of the present invention includes a step of detecting a movement state of a user, and a step of restricting at least a part of available functions based on the detected movement state. It is supposed to include.
[0009]
In addition, a program according to another aspect of the present invention executes a procedure for detecting a movement state of a user on a computer and a procedure for restricting at least a part of available functions based on the detected movement state. I am going to let you.
[0010]
DETAILED DESCRIPTION OF THE INVENTION
[0011]
[Embodiment 1]
A first embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1, the mobile terminal device according to the present embodiment includes a control unit 11, a storage unit 12, a communication control unit 13, a display unit 14, an operation unit 15, and a GPS receiving unit (Global Positioning). System) 16.
[0012]
The control unit 11 operates according to a program stored in the storage unit 12, and based on the coordinate information output from the GPS receiving unit 16, a detection process for detecting the moving state of the user of the mobile phone, and the detected The process based on the movement state is executed. The specific contents of these processes will be described in detail later. In addition, the control unit 11 performs normal processing as a mobile terminal device, such as sending and receiving voices and e-mails via the communication control unit 13, receiving television images and displaying them on the display unit 14. .
[0013]
The storage unit 12 stores a program executed by the control unit 11. In addition, the storage unit 12 stores and holds various data generated during the processing of the control unit 11. The communication control unit 13 transmits a signal according to an instruction input from the control unit 11, receives a signal coming from the outside, and outputs the signal to the control unit 11. The display unit 14 is a display that displays information according to instructions input from the control unit 11. The operation unit 15 is a keypad or the like, and accepts a key input from a user and outputs it to the control unit 11.
[0014]
The GPS receiver 16 receives a signal from an artificial satellite and outputs coordinate information representing the current position (latitude, longitude, altitude). Since this GPS operation is widely known, a detailed description thereof is omitted here.
[0015]
Here, the specific contents of the movement state detection process by the control unit 11 and the process based on the detection result will be described.
[0016]
As the movement state detection process, the control unit 11 acquires coordinate information P output from the GPS receiving unit 16 at a predetermined timing (for example, a fixed time), and acquires the coordinate information P ′ acquired last time and the coordinate information acquired this time. When the magnitude | P−P ′ | of the difference from P exceeds a predetermined threshold value, it is detected that the user is moving.
[0017]
In addition, when the control unit 11 detects that the user is moving, as a process based on the detection result, a process of restricting a part of the functions that can be used as the mobile terminal device from being temporarily unavailable. Do. Specifically, when it is detected that the user is moving, for example, when the user gives an instruction to start processing of the e-mail, the control unit 11 indicates that the e-mail cannot be used during the movement. The user is notified that the function is limited, such as displaying a message on the display unit 14, and processing of the e-mail is not performed. Further, in this case, when the user starts moving while using the e-mail, the control unit 11 displays a message on the display unit 14 that the e-mail cannot be used during the movement. The user may be notified that the function is limited, and the processing of the e-mail may be interrupted.
[0018]
In addition, when the control unit 11 detects that the user is moving, the control unit 11 warns the user that a part of the functions as the mobile terminal device should be refrained from using during the movement. It may be.
[0019]
Further, while the control unit 11 detects that the user is moving, the control unit 11 acquires the coordinate information P output from the GPS receiving unit 16 at regular intervals, and the previous time from the previous GPS receiving unit 16. When the magnitude | P−P ′ | of the difference between the acquired coordinate information P ′ and the currently acquired coordinate information P falls below a predetermined threshold value, it is detected that the user has stopped moving and used. For a function set so that it cannot be used, it is returned to normal processing such as setting it to be usable.
[0020]
[Walking detection]
In this case, when the user is moving, some of the functions are restricted and / or additional processing (such as warning display) is performed for some of the functions. As a moving state, the case where it is moving by the car etc. can be considered, and it may not be preferable to restrict the use to such a case.
[0021]
Then, the control part 11 of this Embodiment is the state which the user walks as a process which detects a user's movement (Here, walking is a user as a pedestrian or the method according to it. For example, it may be detected that the vehicle is running, and may include a case where a light vehicle such as a bicycle is used.
[0022]
In this case, specifically, the control unit 11 performs the following processing. That is, the control unit 11 acquires the coordinate information P output from the GPS receiving unit 16 at a constant time Δt, and the difference | P− between the previously acquired coordinate information P ′ and the currently acquired coordinate information P Based on P ′ | and the like, information related to the moving speed is generated, and based on this information, it is determined whether or not the user is walking and moving.
[0023]
For example, suppose that the user is walking and moving when | P−P ′ | / Δt <vth, where vth is a threshold speed. Note that a speed vlth <vth serving as a second threshold value is set, and it is determined that the user is walking and moving when vlth <| P−P ′ | / Δt <vth. Good. By doing so, the restriction can be applied only when the user is walking, and the function is prevented from being restricted during movement in a vehicle or the like.
[0024]
The control unit 11 may determine whether or not the user is walking and moving using information on the moving position instead of / in addition to the moving speed. In this case, the control unit 11 checks the position on the map corresponding to the coordinate information output by the GPS receiving unit 16, and if it is on a highway, for example, it may not be moved by walking. Thereby, for example, when the vehicle is moving on a highway at a speed equivalent to the walking speed during a traffic jam, it can be determined that the vehicle is moving instead of walking.
[0025]
Here, the position on the map may be obtained by the control unit 11 acquiring map information from a server on the Internet or the like via the communication control unit 13, for example.
[0026]
In this way, only when it is detected that the user is walking using information on the moving speed or position based on the coordinate information output by the GPS receiver 16 and the user is detected to be walking, Processing such as limiting some of the functions may be performed.
[0027]
According to the mobile terminal device of the present embodiment, while the user is not moving, the coordinate information output one after another by the GPS receiving unit 16 is substantially constant, so it is determined that the user is not moving. Thus, functions such as e-mail can be used as usual.
[0028]
At this time, when the user starts walking and moving, the coordinate information output by the GPS receiving unit 16 changes every moment, and the control unit 11 determines that the user is moving, e-mail or the like. Is temporarily unavailable.
[0029]
When the user stops moving, the coordinate information output one after another by the GPS receiving unit 16 becomes constant again, so that it is detected that the user has stopped moving, and the e-mail can be used again.
[0030]
[Embodiment 2]
In addition, the mobile terminal device according to the second embodiment of the present invention includes a camera instead of a GPS receiver, and detects the movement state of the user based on information captured by the camera. Also good. That is, as shown in FIG. 2, the mobile terminal device according to the present embodiment includes a control unit 11, a storage unit 12, a communication control unit 13, a display unit 14, an operation unit 15, and a camera unit 17. It is comprised including. Note that the storage unit 12, the communication control unit 13, the display unit 14, and the operation unit 15 are the same as those in the first embodiment, and will not be described again here.
[0031]
The control unit 11 operates according to a program stored in the storage unit 12, and based on the image data output from the camera unit 17, a detection process for detecting the moving state of the user, and based on the detected moving state. Processing and executing. The camera unit 17 captures an image in accordance with an instruction input from the control unit 11 and outputs image data obtained by the imaging to the control unit 11.
[0032]
Here, the specific contents of the movement state detection process by the control unit 11 and the process based on the detection result will be described.
[0033]
As the movement state detection processing, the control unit 11 outputs an imaging instruction to the camera unit 17 at a predetermined timing (for example, a fixed time), and the image data output from the camera unit 17 are different from each other. If it is different, it is detected that the user is moving.
[0034]
In addition, when the control unit 11 detects that the user is moving, as a process based on the detection result, a process of restricting a part of the functions that can be used as the mobile terminal device from being temporarily unavailable. Do. Specifically, when it is detected that the user is moving, for example, when the user gives an instruction to start processing of the e-mail, the control unit 11 indicates that the e-mail cannot be used during the movement. The user is notified that the function is limited, such as displaying a message on the display unit 14, and processing of the e-mail is not performed. Further, in this case, when the user starts moving while using the e-mail, the control unit 11 displays a message on the display unit 14 that the e-mail cannot be used during the movement. The user may be notified that the function is limited, and the processing of the e-mail may be interrupted.
[0035]
In addition, when the control unit 11 detects that the user is moving, the control unit 11 warns the user that a part of the functions as the mobile terminal device should be refrained from using during the movement. It may be.
[0036]
Further, the control unit 11 may perform the following process as a process for determining whether or not image data obtained by imaging at predetermined timings are different from each other. That is, for a series of input image data, information regarding the characteristics of the pixel values included therein is obtained, and when the information regarding the characteristics changes sequentially, it is determined that the user is moving.
[0037]
For example, the average value of at least one of the brightness, saturation, and hue of the pixel values included in each image data is calculated as information relating to the characteristics of the pixel values, and the first image data that is captured three times in succession. The difference in the average brightness value between the second image data and the second image data is less than a predetermined threshold value, and the difference in the average brightness value between the second and third image data. May be determined that the user is not moving when the value is below a predetermined threshold, and otherwise, it may be determined that the user is moving.
[0038]
In addition, regarding the image data captured three times in succession, the difference in the average value of brightness between the first image data and the second image data is ΔB1, and the second and third image data. When the difference between the average values of brightness at ΔB2 is ΔB2, if | ΔB1 | and | ΔB2 | (where | * | represents the absolute value of *) are larger than a predetermined threshold value, Recognizing that the brightness is continuously changing, it is determined that the user is moving. In addition, if either one of | ΔB1 | and | ΔB2 |, or each of | ΔB1 | and | ΔB2 | is smaller than a predetermined threshold value, it is recognized that the brightness does not change continuously. , It may be determined that the user has not moved.
[0039]
Further, the control unit 11 divides each image data into blocks as shown in FIG. 3, and information regarding the characteristics of the pixel values in the corresponding block in any block among the image data continuously captured. When they are different from each other, it may be determined that the user is moving. For example, when divided into 3 × 3 blocks as shown in FIG. 3, the average value of the brightness of the pixel values in each block of the first image data is B (1,1), B (1,2), ... B (1, 9), and the average brightness of the pixel values in each block of the second image data is B (2, 1), B (2, 2),. 9) (that is, B (a, b) represents the average value of the brightness of pixels included in the b-th block of the image data obtained by the a-th imaging) When | B (1, i) −B (2, i) | is greater than a predetermined threshold value for all i (i = 1 to 9), it is determined that the user is moving.
[0040]
The control unit 11 may determine whether the user has moved based on one piece of image data. For example, image data captured during movement causes blurring (camera blurring), and therefore the presence or absence of movement can be detected based on the degree of blurring. Specifically, when the contour detection process is applied to the image data and the blur width of the contour portion detected by the contour detection process is larger than the threshold value, the user is moving as blurring. It can be judged as a thing.
[0041]
According to the mobile terminal device of the present embodiment, while the user is not moving, the image captured by the camera unit 17 is constant (for example, approximately the same part of the road is captured). It is determined that the user has not moved, and functions such as electronic mail can be used as usual.
[0042]
At this time, when the user starts walking and moving, various objects on the road (for example, striped patterns on pedestrian crossings, manhole covers, etc.) will be captured one after another, and the brightness of the pixels included in the image data Or the hue is changed and the control unit 11 detects that the user is moving, and temporarily disables functions such as e-mail.
[0043]
When the user stops moving, the image captured by the camera unit 17 becomes constant again, so that it is detected that the user has stopped moving, and the e-mail can be used again. In this embodiment, in the case of use in an automobile or the like, as long as an in-vehicle image is captured, a series of image data is constant, and functions such as e-mail are not restricted.
[0044]
[Embodiment 3]
In the description so far, the embodiment in which the device provided in the existing mobile phone or the like such as the GPS receiver 16 or the camera is used as the movement detecting means has been described. However, the embodiment of the present invention is not limited to this. It is not limited to. For example, like a pedometer, a user walks and moves by using an elastic body (for example, a spring) that expands and contracts due to vertical movement vibration during each step and a weight attached to the same as a pedometer. It may be detected whether or not. When walking, the vibration of the weight attached to the elastic body becomes substantially periodic. Therefore, the dispersion of the vibration period is examined, and the user walks when the dispersion exceeds a predetermined threshold. May be determined to be moving. The control unit 11 records the step value counted by the same sensor as the pedometer, and when the predetermined operation is received from the user via the operation unit 15, the recorded step value is recorded. May be displayed on the display unit 14, or may be performed by resetting the step value to “0” by another operation.
[0045]
Further, the control unit 11 may detect the movement state of the user by combining information based on the sensors similar to those of the GPS receiving unit 16, the camera, and the pedometer.
[0046]
Furthermore, in the first and second embodiments, e-mail is given as an example of a restricted function. However, the present invention is not limited to this, and a function for displaying a received image in a web browser function, a videophone, etc. May be restricted. In addition, as a method of restricting the function, the control unit 11 may stop the execution of the program corresponding to the function, or the control unit 11 displays the content displayed on the display unit 14 on a predetermined screen ( For example, the screen may be changed to a standby screen or a warning screen. Further, the display unit 14 itself may stop displaying information, and the display unit 14 may be hidden.
[0047]
Furthermore, in the description so far, when it is detected that the user has stopped moving, the function restriction or the like is released, but once the function is restricted, the control unit 11 receives a predetermined request from the user. When the operation (restriction release operation) is performed, it is possible to detect whether or not the object is moving, and to release the restriction on the function when it is determined that the object is not moving. If it does in this way, after detecting a user's movement and performing a restriction | limiting of a function, the detection of a user's movement state can be stopped, and power consumption can be reduced.
[0048]
【The invention's effect】
As described above, according to the present invention, it is possible to provide a mobile terminal device capable of maintaining and improving manners for using mobile terminals.
[Brief description of the drawings]
FIG. 1 is a configuration block diagram of a mobile terminal device according to a first embodiment of the present invention.
FIG. 2 is a configuration block diagram of a mobile terminal device according to a second embodiment of the present invention.
FIG. 3 is an explanatory diagram illustrating an example of block division of image data according to a second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 11 Control part, 12 Storage part, 13 Communication control part, 14 Display part, 15 Operation part, 16 GPS receiving part, 17 Camera part.

Claims (7)

Detection means for detecting the movement state of the user;
Control means for restricting at least a part of available functions based on the detected movement state;
A portable terminal device comprising: The mobile terminal device according to claim 1,
The detection means detects that the user is walking,
The control means restricts at least a part of available functions when it is detected that the user is walking. The mobile terminal device according to claim 2,
The said detection means detects that the user is walking based on at least one of the movement speed of the said portable terminal device, and a movement position, The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1 or 2,
Furthermore, an image pickup means for picking up a peripheral image of the mobile terminal device is provided,
The mobile terminal device, wherein the detection unit detects a moving state of a user based on a peripheral image captured by the imaging unit. The mobile terminal device according to claim 1 or 2,
Furthermore, an image pickup means for picking up a peripheral image of the mobile terminal device is provided,
The mobile terminal apparatus according to claim 1, wherein the detection unit detects a moving state of the user based on a series of peripheral images intermittently captured by the imaging unit. Detecting the user's movement state;
Based on the detected movement state, at least partially limiting available functions;
A control method for a mobile terminal device, comprising: On the computer,
A procedure to detect the movement status of the user;
A procedure that at least partially restricts available functions based on the detected movement state;
A program characterized by having executed.

Images