JP2015022712A - Portable equipment and its control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide portable equipment to be used while being worn on the arm of a user in which display information is plainly displayed even when the user is running.SOLUTION: When a user U views a display screen 15 of a portable terminal 10 worn on the left arm AL in a state that the user U is traveling by running or the like, a travel direction F(travel angle α) of the user U with respect to a terminal vertical direction Y is detected by a three-dimensional acceleration sensor, and it is detected that the user U has visually recognized the display surface 15 when the user U raises the left arm AL on the basis of the detection result of the three-dimensional acceleration sensor or the imaging of a user face image by an image imaging part 17. Then, display information P of the display surface 15 is rotated, displaced, and displayed in accordance with a difference (β-α) between the travel angle α of the user U with respect to the terminal vertical direction Y and a visual line angle β of the user U preliminarily set with respect to the travel direction F.

Description

  The present invention relates to a portable device used by being worn on a user's body and a control program thereof.

  Conventionally, in wristwatch-type portable devices equipped with various sensor functions and running information processing functions used on the user's arm, when viewing the display information on the screen in a stationary state, the direction and angle of the arm are appropriate. Instead, the orientation of the display information matches the user's line of sight.

  It is a technology that makes it easy to see the orientation of the display, and a clock device that can keep the position of a specific character on the dial at a fixed position even when the face of the dial is tilted or rotated with respect to the plane is considered. (For example, refer to Patent Document 1).

  In addition, an image reproducing apparatus is conceivable in which an image is rotated and displaced so that a displayed image is horizontal even when the apparatus main body is tilted (see, for example, Patent Document 2).

JP 2011-017698 A JP 2006-129101 A

  In the conventional timepiece device and image reproduction device, even if the display surface of the device is tilted from the horizontal, the display content is adjusted to be always horizontal.

  On the other hand, as described above, in a wristwatch-type portable device, when there is little movement of the user's body, such as in a stationary state, the direction of the display information is changed to the user's line of sight by appropriately changing the direction and angle of the arm. Although it can be matched, it is difficult to appropriately change the orientation and angle of the arm so that the orientation of the display information matches when running by running or the like.

  In other words, to see the screen of the information terminal device worn on the arm while the user is running, temporarily stop when the arm wearing the terminal device is swung up from the steady arm swinging motion. As will be seen, the screen orientation at that time opens more than the user's line of sight in the advancing direction, so the display information becomes oblique and difficult to see.

  Therefore, a running wristwatch in which a display screen is provided with an oblique angle in advance with respect to the apparatus main body has been put into practical use, but there is a problem that it is difficult to see except when running.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a portable device and a control program thereof that can display display information in an easy-to-read manner even when a user is running. .

  The portable device according to the present invention detects a user's visual recognition operation on the display unit, a display unit that displays information, a traveling direction detection unit that detects a traveling direction of the user while worn on the user's arm. And a visual motion detection means that detects the user's visual motion by the visual motion detection means, and displaces the display position of the information according to the travel direction of the user detected by the travel direction detection means. Displacement display control means for displaying on the display unit is provided.

  A program according to the present invention is a program for controlling a computer of a portable device having a display unit for displaying information, and the computer is mounted on the user's arm in a state where the device is mounted on the user's arm. A traveling direction detection means for detecting a traveling direction, a visual movement detection means for detecting a visual movement of the user with respect to the display unit, and when the visual movement of the user is detected by the visual movement detection means, is detected by the traveling direction detection means. The display position of the information is displaced according to the traveling direction of the user, and the display unit functions as a displacement display control unit.

  According to the present invention, it is possible to display display information in an easy-to-read manner even when the user is running.

The block diagram which shows the structure of the electronic circuit of the wristwatch-type portable terminal 10 which concerns on embodiment of the wrist terminal display apparatus of this invention. FIG. 3 is a front view showing an external configuration of the wristwatch type mobile terminal 10. 5 is a flowchart showing display control processing of the wristwatch type mobile terminal 10; 5 is a flowchart showing a line-of-sight direction setting process of the wristwatch type mobile terminal 10; The figure which shows the display operation at the time of left arm AL mounting | wearing according to the display control process of the said wristwatch-type portable terminal. The figure which shows the display operation at the time of right arm AR mounting according to the display control process of the said wristwatch-type portable terminal.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an electronic circuit of a wristwatch-type mobile terminal 10 according to an embodiment of the mobile device of the present invention.

  FIG. 2 is a front view showing an external configuration of the wristwatch-type mobile terminal 10.

  The wristwatch-type mobile terminal 10 is used by being worn on a user's left or right arm A with a band B, and the mobile terminal 10 includes a CPU 11 that is a computer.

  This CPU 11 is a terminal control program stored in advance in the memory 12, or a terminal control program read into the memory 12 from the Web server 20 on the communication network (Internet, etc.) N via the communication unit 13, or the communication network. The operation of each part of the circuit is controlled in accordance with a terminal control program read into the memory 12 via the communication unit 13 by short-range wireless communication W with the multi-function mobile phone 30 connectable to N.

  The CPU 11 is connected to the memory 12 and the communication unit 13, an operation unit 14 having various operation buttons, a color liquid crystal screen display unit 15 having an electrostatic touch panel, a three-dimensional acceleration sensor 16, and an image capturing unit. 17 is connected.

  The terminal control program stored in the memory 12 includes a communication processing program for performing communication processing with an external wired / wireless line or various communication devices via the communication unit 13, time measurement processing, timer processing, step count / movement distance. Various application programs 12b for performing measurement processing such as the above and gaze detection processing based on the captured face image, and a display control processing program 12a for controlling display in accordance with the user's movement are stored.

  Further, in the memory 12, data 12c of an angle (travel angle) α (see FIGS. 5 and 6) formed by the user travel direction F detected by the acceleration sensor 16 with respect to the vertical direction Y of the main body of the mobile terminal 10. The data 12d of the angle (gaze angle) β (see FIGS. 5 and 6) formed by the user's gaze direction y determined based on the user setting or the gaze detection with respect to the traveling direction F is stored.

  In the wristwatch type portable terminal 10 configured in this way, the processor (CPU) 11 controls the operation of each part of the circuit in accordance with the instructions described in the terminal control programs 12a and 12b, and the software and hardware cooperate. The display control function described in the operation description to be described later is realized.

  Next, a display control operation of the wristwatch type mobile terminal 10 having the above-described configuration will be described.

  FIG. 3 is a flowchart showing display control processing of the wristwatch-type mobile terminal 10.

  FIG. 4 is a flowchart showing the line-of-sight direction setting process of the wristwatch-type mobile terminal 10.

  FIG. 5 is a diagram showing a display operation when the left arm AL is mounted in accordance with the display control process of the wristwatch type mobile terminal 10.

  FIG. 6 is a diagram showing a display operation when the right arm AR is mounted in accordance with the display control process of the wristwatch-type mobile terminal 10.

  When the display control process of the wristwatch-type portable terminal 10 is activated, the traveling direction F accompanying the running such as the running of the user U is detected based on the direction of the acceleration applied to the terminal body detected by the three-dimensional acceleration sensor 16. Then, an angle (travel angle) α formed by the travel direction F with respect to the vertical direction Y of the main body is detected (step S1). The data 12c of the traveling angle α of the user U is stored in the memory 12.

  Further, based on the acceleration detected by the acceleration sensor 16, it is determined whether or not the user U is in a stopped state (step S2).

  When the traveling direction F of the user U is detected in step S1 and the traveling angle α is detected, it is determined in step S2 that the vehicle is not stopped (step S2 (No)).

  Here, if it is determined that the user U is not in a stopped state (step S2 (No)), whether or not the acceleration sensor 16 has detected that the terminal body has been moved upward, or an image capturing unit. It is determined whether or not the movement of the user U to raise the arm A wearing the terminal and visually recognize the terminal 10 is detected based on whether or not the face image of the user U is captured in step S3 (step S3).

  Then, in step S3, when it is determined that the operation of visually recognizing the terminal 10 by the user U is not detected (step S3 (No)), or when it is determined in step S2 that the user U is in a stopped state. (Step S2 (Yes)), the normal display direction control is executed to display the display information P of the display unit 15 by rotating and displaying the display information P in units of 90 degrees according to the inclination of the screen (step S4). . For example, when the terminal 10 is tilted in the left direction when viewing the screen, the display information P is rotated 90 degrees to the right and displayed, and conversely, the terminal 10 is tilted in the right direction when viewing the screen. If the terminal 10 is tilted upside down, the display information P is rotated 180 degrees and displayed.

  On the other hand, when it is determined that the user U has detected the movement of raising the arm A while wearing the terminal and visually recognizing the terminal 10 (step S3 (Yes)), the line-of-sight direction y with respect to the traveling direction F of the user U It is determined whether or not the data 12d of the angle (line-of-sight angle) β is registered in the memory 12 (step S5).

  Here, when it is determined that the angle (line-of-sight angle) β (12d) formed by the line-of-sight direction y with respect to the traveling direction F of the user U is not registered in the memory 12 (step S5 (No)), An initial value (for example, β = 20 degrees) preset as the line-of-sight angle β is set as a display control use target (step S6).

  If it is determined that the angle (line-of-sight angle) β (12d) formed by the line-of-sight direction y with respect to the traveling direction F of the user U is registered in the memory 12 (step S5 (Yes)), The registered line-of-sight angle β is set as a display control use target (step S7).

  Then, it is determined whether or not the traveling direction F (traveling angle α) of the user U with respect to the vertical direction Y of the terminal body is shifted leftward (step S8).

  Here, as shown in FIG. 5, when it is determined that the traveling direction F (traveling angle α) of the user U with respect to the vertical direction Y of the terminal body is shifted to the right instead of the left ( Step S8 (No)), it is determined that the portable terminal 10 is in a state of being worn on the left arm AL. Then, the display information P to be displayed on the screen of the display unit 15 is the difference angle (β−α) [between the travel angle α and the line-of-sight angle β as shown by the solid line X to the dotted line x in FIG. [Absolute value] is rotated rightward and displaced for display (step S9a).

  Thereby, even when the user U is running or the like and the mobile terminal 10 attached to the left arm AL is viewed as the left arm AL is swung up, it is possible to display the display information so that the user can easily see the display information. .

  In addition, as shown in FIG. 6, when it is determined that the traveling direction F (traveling angle α) of the user U with respect to the vertical direction Y of the terminal body is shifted to the left (step S8 (Yes)). ), It is determined that the mobile terminal 10 is attached to the right arm AR. Then, the display information P to be displayed on the screen of the display unit 15 is the difference angle (β−α) [β between the advance angle α and the line-of-sight angle β, as shown by the solid line X to the dotted line x in FIG. [Absolute value] is rotated to the left and displaced for display (step S9b).

  Thereby, even when the user U is running or the like, and the mobile terminal 10 attached to the right arm AR is viewed as the right arm AR is swung up, it is possible to display display information that is easy to see for the user. .

  Here, a process of registering the data 12d of the angle (gaze angle) β formed by the gaze direction y with respect to the traveling direction F of the user U in the memory 12 (gaze direction setting process: see FIG. 4) will be described.

  When the line-of-sight direction setting process is activated, it is determined whether or not the image pickup unit (camera) 17 is provided in the terminal body 10 (step T1).

  When it is determined that the terminal body 10 is provided with the image capturing unit (camera) 17 (step T1 (Yes)), the user U moves the terminal body 10 attached to the arm AL (or AR) when traveling. Is detected when the image photographing unit 17 captures the face image of the user U, and the direction in which the user U views the screen of the display unit 15 is detected based on the face image according to the line-of-sight detection processing program. (Step T2c).

  Here, when the direction in which the user U views the screen of the display unit 15 is detected, the display information P for the screen of the display unit 15 is rotated and displayed in accordance with the detected direction (step T3).

  Then, data 12d of an angle (line-of-sight angle) β formed by the line-of-sight direction y detected with respect to the traveling direction F of the user U is registered in the memory 12 (step T4).

  On the other hand, when it is determined that the image pickup unit (camera) 17 is not provided in the terminal body 10 (step T1 (No)), the display information P is rotated or displayed according to the button operation of the operation unit 14. By rotating the display information P according to the touch operation on the screen of the unit 15, the display information P is manually set in a direction that is easy for the user U to see when traveling (step T2m).

  Then, the display information P for the screen of the display unit 15 is rotated and displayed in accordance with the manually set direction (step T3).

  Then, data 12d of an angle (line-of-sight angle) β formed by the manually set easy-to-see direction with respect to the traveling direction F of the user U is registered in the memory 12 (step T4).

  Therefore, according to the display control function of the wristwatch-type mobile terminal 10 having the above-described configuration, when the user U is running by running or the like, the display screen of the mobile terminal 10 worn on the arm A is three-dimensional. The acceleration sensor 16 detects the traveling direction F (traveling angle α) of the user U with respect to the terminal vertical direction Y, and the user U visually recognizes the display screen (15) as the arm A swings up. Detection is based on imaging of a user face image by the sensor 16 or the image capturing unit 17. Then, according to the difference (β−α) between the traveling angle α of the user U with respect to the terminal vertical direction Y and the viewing angle β of the user U preset with respect to the traveling direction F, the display screen (15) Display information P is rotated and displayed so that the vertical direction of the display information P matches.

  For this reason, even when the user U is traveling by jogging or the like, when viewing the display screen (15) of the mobile terminal 10 worn on the arm A, the display information P can be appropriately rotated and displaced so that it can be displayed easily. .

  Further, according to the display control function of the wristwatch-type mobile terminal 10 having the above-described configuration, when the traveling direction F of the user U with respect to the vertical direction Y of the mobile terminal 10 is shifted to the right, the display screen (15) When the display information P is rotated and displaced in the right direction according to the difference (β−α) between the traveling angle α and the viewing angle β, and the traveling direction F is shifted to the left. The display information P is rotated and displaced in the left direction according to the difference (β−α) to be displayed.

  For this reason, even if this portable terminal 10 is worn on either the left arm AL or the right arm AR of the user U, the display information P can be appropriately rotated and displaced so that it can be displayed easily.

  Further, according to the display control function of the wristwatch-type mobile terminal 10 having the above configuration, when it is determined that the user U is not in the running state based on the acceleration detected by the three-dimensional acceleration sensor 16, the display screen (15 The display information P is rotated in the reverse direction, for example, in units of 90 degrees according to the inclination of (), and is displaced and displayed.

  For this reason, when the user U is at rest, for example, regardless of the orientation of the portable terminal 10 removed from the arm A, the display information P can be appropriately rotated and displaced to be displayed easily.

  In addition, according to the display control function of the wristwatch-type mobile terminal 10 having the above-described configuration, the preset line-of-sight angle β of the user U with respect to the user traveling direction F is displayed by a touch operation on the operation button 14 or the display screen (15). Information P is rotated and displayed at an angle set arbitrarily by the user, or by detecting the line of sight from the face image captured by the image capturing unit 17 when the display screen (15) is viewed in the running posture of the user U. It is registered based on the angle.

  For this reason, when the user U looks at the display screen (15) of the mobile terminal 10 during running such as jogging, the display information P can be rotated and displaced at a more appropriate angle that is easy for the user to view.

  In the embodiment described above, the center of the display information P is rotated by a predetermined angle. However, the display information P is rotated while moving around the point outside the display information P within the display range. May be displaced.

  Each processing method by the wrist terminal display device (watch type portable terminal 10) described in the embodiment, that is, each of the display control process shown in the flowchart of FIG. 3, the line-of-sight direction setting process shown in the flowchart of FIG. All of the methods are programs that can be executed by a computer, such as a memory card (ROM card, RAM card, etc.), magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. Can be stored and distributed on an external recording medium (not shown). Then, the computer of the wristwatch type electronic device having the three-dimensional acceleration sensor (16) and the display unit (15) reads the program recorded on the external recording medium into the storage device (12) and operates according to the read program. Is controlled, the display information rotation display function in the user running state described in the above embodiment can be realized, and the same processing by the method described above can be executed.

  The program data for realizing each of the above methods can be transmitted as a program code form on the network, and the program data is provided with a three-dimensional acceleration sensor (16) and a display unit (15). The display information rotation display function in the user running state described above can also be realized by importing into the computer of the wristwatch type electronic device by communication.

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in each embodiment or some constituent elements are combined in different forms, the problems described in the column of the problem to be solved by the invention If the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

  Hereinafter, the invention described in the scope of claims of the present application will be appended.

[1]
A display for displaying information;
Traveling direction detection means for detecting the traveling direction of the user in a state of being worn on the body of the user;
Visual operation detecting means for detecting the visual operation of the user with respect to the display unit;
Displacement display in which the display position of the information is displaced and displayed on the display unit according to the traveling direction of the user detected by the traveling direction detection unit when the visual recognition operation of the user is detected by the visual recognition operation detecting unit. Control means;
A portable device comprising:

[2]
The displacement display control means has a rotation display control means for rotating and displaying the display position of the information at a preset angle from the user's traveling direction detected by the traveling direction detecting means.
The portable device according to [1], which is characterized in that

[3]
The rotation display control means includes
When the traveling direction of the user detected by the traveling direction detection unit is on the right with respect to the vertical direction of the display unit, the vertical direction of the information is adjusted so that the vertical direction of the information matches a preset angle from the traveling direction. A right rotation display control means for displaying the information by rotating it to the right with respect to the display unit;
When the traveling direction of the user detected by the traveling direction detection unit is on the left with respect to the vertical direction of the display unit, the vertical direction of the information is adjusted so that the vertical direction of the information matches a preset angle from the traveling direction. Left-rotation display control means for displaying the information by rotating it to the left with respect to the display unit,
The portable device according to [2], which is characterized in that

[4]
The traveling direction detection means includes a traveling operation detection unit that detects the traveling operation of the user in a state of being worn on the user's arm, and in a state where the traveling operation of the user is detected by the traveling operation detection unit, Detect the direction of travel of the user,
The portable device according to any one of [1] to [3].

[5]
With a three-dimensional acceleration sensor,
The advancing direction detecting means detects a advancing direction of the user based on the 3D acceleration detected by the 3D acceleration sensor;
The portable device according to any one of [1] to [4].

[6]
The visual motion detection means detects the visual motion of the user with respect to the display unit based on the three-dimensional acceleration detected by the three-dimensional acceleration sensor;
The portable device according to [5], which is characterized in that

[7]
The preset angle is set according to a user operation.
The portable device according to [2] or [3], wherein

[8]
An imaging unit having an imaging direction as a direction facing the display screen of the display unit,
The preset angle is an angle set by detecting a line of sight based on a face image of the user captured by the imaging unit in a posture when the user is traveling.
The portable device according to [2] or [3], wherein

[9]
A program for controlling a computer of a portable device having a display unit for displaying information,
The computer,
A traveling direction detection means for detecting a traveling direction of the user in a state where the portable device is mounted on the body of the user;
Visual recognition operation detecting means for detecting the visual operation of the user with respect to the display unit;
Displacement display in which the display position of the information is displaced and displayed on the display unit according to the traveling direction of the user detected by the traveling direction detection unit when the visual recognition operation of the user is detected by the visual recognition operation detecting unit. Control means,
A computer-readable program that allows it to function as a computer.

10 ... wristwatch type portable terminal 11 ... CPU
DESCRIPTION OF SYMBOLS 12 ... Memory 12a ... Display control program 12b ... Various application programs 12c ... Data of user advancing direction F (advance angle [alpha]) with respect to main body up-down direction Y 12d ... Data of user gaze direction y (visual angle [beta]) with respect to user advancing direction F ... Communication part 14 ... Operation buttons 15 ... Display part (touch panel type)
16 ... Acceleration sensor 17 ... Image pickup unit (camera)
20 ... Web server 30 ... Multi-function mobile phone AL ... Left arm AR ... Right arm P ... Display information

Claims (9)

A display for displaying information;
Traveling direction detection means for detecting the traveling direction of the user in a state of being worn on the body of the user;
Visual operation detecting means for detecting the visual operation of the user with respect to the display unit;
Displacement display in which the display position of the information is displaced and displayed on the display unit according to the traveling direction of the user detected by the traveling direction detection unit when the visual recognition operation of the user is detected by the visual recognition operation detecting unit. Control means;
A portable device comprising: The displacement display control means has a rotation display control means for rotating and displaying the display position of the information at a preset angle from the user's traveling direction detected by the traveling direction detecting means.
The portable device according to claim 1. The rotation display control means includes
When the traveling direction of the user detected by the traveling direction detection unit is on the right with respect to the vertical direction of the display unit, the vertical direction of the information is adjusted so that the vertical direction of the information matches a preset angle from the traveling direction. A right rotation display control means for displaying the information by rotating it to the right with respect to the display unit;
When the traveling direction of the user detected by the traveling direction detection unit is on the left with respect to the vertical direction of the display unit, the vertical direction of the information is adjusted so that the vertical direction of the information matches a preset angle from the traveling direction. Left-rotation display control means for displaying the information by rotating it to the left with respect to the display unit,
The portable device according to claim 2. The traveling direction detection means includes a traveling operation detection unit that detects the traveling operation of the user in a state of being worn on the user's arm, and in a state where the traveling operation of the user is detected by the traveling operation detection unit, Detect the direction of travel of the user,
The portable device according to any one of claims 1 to 3, wherein the portable device is a device. With a three-dimensional acceleration sensor,
The advancing direction detecting means detects a advancing direction of the user based on the 3D acceleration detected by the 3D acceleration sensor;
The portable device according to any one of claims 1 to 4, characterized in that: The visual motion detection means detects the visual motion of the user with respect to the display unit based on the three-dimensional acceleration detected by the three-dimensional acceleration sensor;
The portable device according to claim 5. The preset angle is set according to a user operation.
The portable device according to claim 2 or claim 3, wherein An imaging unit having an imaging direction as a direction facing the display screen of the display unit,
The preset angle is an angle set by detecting a line of sight based on a face image of the user captured by the imaging unit in a posture when the user is traveling.
The portable device according to claim 2 or claim 3, wherein A program for controlling a computer of a portable device having a display unit for displaying information,
The computer,
A traveling direction detection means for detecting a traveling direction of the user in a state where the portable device is mounted on the body of the user;
Visual recognition operation detecting means for detecting the visual operation of the user with respect to the display unit;
Displacement display in which the display position of the information is displaced and displayed on the display unit according to the traveling direction of the user detected by the traveling direction detection unit when the visual recognition operation of the user is detected by the visual recognition operation detecting unit. Control means,
A computer-readable program that allows it to function as a computer.

Images