JP2015039472A - Posture detection method, portable terminal device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a posture detection method which can achieve a technique for detecting the posture of a user and a distance between a screen and eyes of the user from a portable terminal, a portable terminal device, and a program.SOLUTION: By using inclination of a terminal calculated by terminal angle calculation means 2 on the basis of acceleration acquired from an acceleration sensor 1, posture determination means 3 determines goodness of the posture of a user by comparing inclination information stored in a posture information DB 4 and the inclination of the terminal. Then, information presentation means 5 presents the goodness of the posture to the user on the basis of the determination result.

Description

  The present invention relates to a posture detection method, a portable terminal device, and a program for detecting a posture when a user browses content on a portable terminal.

  Mobile terminals such as mobile phones, smartphones, and tablet devices are widespread. When browsing content such as websites and e-books using these portable terminals, it is said that use in a state where the user's attitude has deteriorated causes damage to the neck and shoulders such as a straight neck (for example, (See Non-Patent Document 1.) In addition, it is said that a short distance from the screen increases eye fatigue (see, for example, Non-Patent Document 2).

  As a method for solving such a problem, conventionally, a technique using a stationary camera has been used (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 11-313799

Numbness of arm is a danger signal Dangerous “neck stiffness” measures, Nikkei Health & Premiere, April 2011 Nikkei Health & Premiere, April 2011

However, in the prior art, it is possible to measure only at a predetermined position such as a seat, and it is difficult to use it regardless of location. In the prior art, the distance between the screen and the eyes can be detected, but the posture cannot be detected.
An object of the present invention is based on such a background, and a posture detection method, a portable terminal device, and a program capable of realizing a technique for detecting a posture of a user from a portable terminal or a distance between a user's screen and eyes. Is to provide.

  In order to achieve the above object, a posture detection method according to the present invention is a posture detection method used in a portable terminal possessed by a user, wherein a table associating the inclination of the portable terminal with the posture information of the user is provided. Storing in a memory, calculating an inclination of the mobile terminal when the user operates the mobile terminal, comparing the calculation result with the table stored in the memory, and based on the comparison result, The user's posture is determined, and the determination result of the user's posture is presented to the user.

One aspect of the posture detection method according to the present invention includes the following aspects.
In the first aspect, in calculating the tilt of the mobile terminal, the tilt of the mobile terminal is calculated based on the acceleration measured by the acceleration sensor.
In the second aspect, in calculating the inclination of the mobile terminal, the mobile terminal is calculated by calculating a distance between the screen of the mobile terminal and the eyes of the user based on a measurement result by a distance measuring sensor or a camera. Calculate the tilt of the terminal.

  In a third aspect, in calculating the tilt of the mobile terminal, the tilt of the mobile terminal is calculated based on a measurement result by the acceleration sensor and the distance measurement sensor or a measurement result by the acceleration sensor and the camera.

According to the present invention, the table in which the inclination of the portable terminal and the user's posture information are associated with each other is stored in the memory and managed, and the inclination of the portable terminal when the user operates the portable terminal is calculated. It is possible to compare the calculation result with a table stored in the memory and determine the user's posture based on the comparison result.
Therefore, by detecting and presenting the occurrence or continuation of a bad posture of the user, it is possible to maintain a good posture during content browsing and to improve the quality of life as a result.

  According to the first aspect, it is possible to detect and present the occurrence or continuation of a bad posture of the user without being limited to a place by using the acceleration sensor provided in the mobile terminal. In addition, the user's neck posture can be determined by using the acceleration sensor.

  According to the second aspect, by using the distance measuring sensor provided in the mobile terminal, the viewing state is not limited to a place, and the viewing state increases eye fatigue because the distance between the eye and the screen is short. Can be determined. In addition, when using a camera equipped with a mobile terminal, the existing measurement system is used, and the viewing is not limited to a place, and the viewing distance increases the eye fatigue due to the close distance between the eyes and the screen. The state can be determined.

  According to the third aspect, since the user's neck posture and the distance between the eyes and the screen are close, it is possible to determine a viewing state that increases eye fatigue.

1 is a block diagram showing a configuration of an attitude detection apparatus according to a first embodiment of the present invention. The block diagram which shows the structure of Example 1 of the attitude | position detection apparatus concerning the 2nd Embodiment of this invention. The block diagram which shows the structure of Example 2 of the attitude | position detection apparatus concerning the 2nd Embodiment of this invention. 9 is a flowchart illustrating processing when the screen-eye distance detection unit according to the second embodiment calculates a distance between a user's eye and a terminal screen from a head image captured by a camera. The figure which shows the detailed processing content of step ST4 shown in the said FIG. The block diagram which shows the structure of the attitude | position detection apparatus concerning the 3rd Embodiment of this invention. The block diagram which shows the structure of the attitude | position detection apparatus concerning the 4th Embodiment of this invention.

[First Embodiment]
FIG. 1 shows the configuration of an attitude detection apparatus according to the first embodiment of the present invention. The posture detection device includes an acceleration sensor 1, a terminal angle calculation unit 2, a posture determination unit 3, a posture information DB 4, and an information presentation unit 5. Further, the posture detection device is provided in, for example, a mobile terminal. The terminal angle calculation unit 2, the posture determination unit 3, and the posture information DB (database) 4 are provided in a control unit including, for example, a CPU, a memory, and a hard disk. The information presentation unit 5 is provided in, for example, an input / output unit of a mobile terminal. The input / output unit is used to input various operation instructions to the mobile terminal, accepts keyword input by the user, inputs data sent from a web (not shown), and browses content Is to do.

The acceleration sensor 1 detects acceleration information acting on the user's mobile terminal based on the acceleration information. As a method of detecting acceleration by the acceleration sensor 1, for example, the movement direction and movement acceleration of the portable terminal in the x-axis, y-axis, and z-axis in FIG.
The terminal angle calculation unit 2 calculates the angle of the mobile terminal based on the acceleration acquired by the acceleration sensor 1. Here, as a method for calculating the angle from the acceleration, for example, the following calculation formula can be given.
θ = arccos (Az / g) (1)

Here, θ is an angle, Az is an acceleration applied in the z-axis direction of the acceleration sensor 1 of the terminal, and g is a gravitational acceleration.
The attitude information DB 4 stores a table in which an angle formed by the Z axis of the mobile terminal and gravity and information indicating the user's attitude of the mobile terminal are associated with each other in advance. Here, when the angle between the Z axis of the mobile terminal and gravity is between 60 deg and 90 deg, the user's eyes of the mobile terminal are in a state of facing the screen of the mobile terminal. On the other hand, when the angle between the Z axis of the mobile terminal and gravity is between 0 deg and 60 deg, the user of the mobile terminal browses the content on the screen of the mobile terminal in a posture of bending the neck and looking down from above. It is in a state of being.

The posture determination unit 3 compares the terminal angle calculated by the terminal angle calculation unit 2 with the angle information table held by the posture information DB 4 to determine the current user posture.
The information presentation unit 5 presents the result determined by the posture determination unit 4 to the user. Here, as a presentation method, an icon or the like indicating that the posture is deteriorated may be presented on a part of the screen of the mobile terminal.

  As described in detail above, in the first embodiment, the tilt information held by the posture determination unit 3 in the posture information DB 4 using the tilt of the terminal calculated by the terminal angle calculation unit 2 based on the acceleration acquired from the acceleration sensor 1. And the inclination of the terminal to determine the good posture of the user, and based on the result, the information presentation means 5 presents the good posture to the user. Therefore, the user's posture can be determined and presented in a situation where the user is browsing the content using the mobile terminal, and deterioration of the user's posture can be prevented.

  Moreover, according to the said 1st Embodiment, generation | occurrence | production and continuation of a bad posture of a user can be detected and shown using the acceleration sensor 1 with which a portable terminal is equipped, without being limited to a place. Further, by using the acceleration sensor 1, the user's neck posture can be determined.

[Second Embodiment]
Example 1
FIG. 2 shows the configuration of Example 1 of the posture detection apparatus according to the second embodiment of the present invention. The posture detection device includes a distance measuring sensor 6, posture determination means 3, posture information DB 4, and information presentation means 5. Further, the posture detection device is provided in, for example, a mobile terminal. The posture determination unit 3 and the posture information DB 4 are provided in a control unit including a CPU, a memory, and a hard disk, for example. The information presentation unit 5 is provided in, for example, an input / output unit of a mobile terminal. The input / output unit is used to input various operation instructions to the mobile terminal, accepts keyword input by the user, inputs data sent from a web (not shown), and browses content Is to do.

  The distance measuring sensor 6 measures the distance between the screen of the portable terminal and the user's eyes using a known technique. As a method in this case, a method using infrared rays can be considered, but the method is not limited to this. The timing at which the distance measuring sensor 6 is activated may be, for example, once per minute while the user is browsing content such as a website, email, video, or electronic book, but is not limited thereto.

The posture determination means 3 compares the distance between the screen measured by the distance measuring sensor 6 and the user's eyes and the information held in the posture information DB 4 to determine the current browsing state. When the distance between the screen and the user's eyes is “0 to a”, the posture of the user is “bad”, and the distance between the screen and the user's eyes is “a to d (d> a)”. In this case, the user's attitude is “good”.
In this way, in the first embodiment, the browsing state is determined based on the angle of the terminal using the acceleration sensor 1, whereas in the second embodiment, the distance measuring sensor 6 is used. By using the distance between the terminal and the eye, even when the neck angle is appropriate, it is possible to determine the viewing state that increases eye fatigue due to the close distance between the eye and the screen become.

(Example 2)
FIG. 3 is a diagram showing a configuration of Example 2 of the posture detection apparatus according to the second embodiment of the present invention. This posture detection apparatus includes a camera 7, a screen-eye distance detection unit 8, a template DB 9, a posture determination unit 3, a posture information DB 4, and an information presentation unit 5. Further, the posture detection device is provided in, for example, a mobile terminal. The screen-eye distance detection unit 8, the template DB 9, the posture determination unit 3, and the posture information DB 4 are provided in a control unit including, for example, a CPU, a memory, and a hard disk. The information presentation unit 5 is provided in, for example, an input / output unit of a mobile terminal. The input / output unit is used to input various operation instructions to the mobile terminal, accepts keyword input by the user, inputs data sent from a web (not shown), and browses content Is to do.

The camera 7 captures a user's head image. The timing of shooting may be, for example, a frequency of once per minute while a user is browsing content such as a website, email, video, or electronic book, but is not limited thereto.
The screen-eye distance detection means 8 calculates the distance between the user's eyes and the terminal screen based on the image taken by the camera 7.

The posture determination unit 3 determines the current browsing state by comparing the distance between the screen and the eye calculated by the screen-eye distance detection unit 8 and the information held in the posture information DB 4. When the distance between the screen and the user's eyes is “0 to a”, the posture of the user is “bad”, and the distance between the screen and the user's eyes is “a to d (d> a)”. In this case, the user's attitude is “good”.
Next, processing when the screen-eye distance detection unit 8 calculates the distance between the user's eyes and the terminal screen from the head image captured by the camera 7 will be described.

FIG. 4 is a flowchart showing processing when the screen-eye distance detection unit 8 calculates the distance between the user's eyes and the terminal screen from the head image captured by the camera 7. Hereinafter, the processing performed by this flowchart will be described in detail.
When the screen-eye distance detection means 8 captures the user's head image with the camera 7 (step ST1), it initializes variables c, d, and cmax, respectively (step ST2). Here, c is an image enlargement coefficient, d is an error variable, cmax represents an upper limit value that can be taken by c, and a predetermined sufficiently large value is stored.

The screen-eye distance detecting means 8 multiplies the size of the template previously stored in the template DB 9 by c (step ST3).
The screen-eye distance detection means 8 arranges a template on coordinates (x, y) on the captured image, calculates an overlay error for all possible values of x and y, and can take the smallest possible value Is held as dmin (step ST4). Here, the overlay error may be normalized by adding the absolute values of the pixel value differences in the common area between the template and the captured image and dividing them by the number of pixels present in the common area. However, the present invention is not limited to this.

Then, the screen-eye distance detection means 8 compares the values of dmin and d, and if dmin takes a value smaller than d, d is replaced with dmin (step ST5 and step ST6).
Subsequently, the screen-eye distance detection unit 8 compares the values of c and cmax (step ST7), and if c is smaller than cmax, the process proceeds to step ST8.

In step ST8, the screen-eye distance detection means 8 adds a constant e to c, and proceeds to step ST3. Here, since e changes the size of the template little by little, it is conceivable to put a small value such as 0.1, but is not limited to this.
In step ST9, the screen-eye distance detecting unit 8 compares the value stored in the variable d with the posture information DB 4 and ends the calculation.

FIG. 5 is a diagram showing the detailed processing contents of step ST4.
When the user's head image is captured by the camera 7 (step ST41), the screen-eye distance detection means 8 increases the size of the template stored in advance in the template DB 9 by c times, and places the image above the captured image. A template is placed on the coordinates (x, y), an overlay error is calculated for all possible values of x and y, and the smallest possible value is held as dmin. Then, the screen-eye distance detection means 8 compares the values of dmin and d, and if dmin takes a value smaller than d, d is replaced with dmin (step ST42).

  Subsequently, the screen-eye distance detection unit 8 compares the values of c and cmax. If c is smaller than cmax, the constant e is added to c, and the process proceeds to step ST43. In the process of step ST43, an enlarged template is arranged on the coordinates (x, y) on the captured image, and an overlay error is calculated for all possible values of x and y. Hold the value as dmin. Then, the screen-eye distance detection unit 8 compares the values of dmin and d, and when dmin takes a value smaller than d, replaces d with dmin.

  Subsequently, the screen-eye distance detection means 8 compares the values of c + e and cmax, and if c + e is smaller than cmax, the constant e is further added, and the process proceeds to step ST44. In the process of step ST44, a further enlarged template is arranged on the coordinates (x, y) on the captured image, and an overlay error is calculated for all possible values of x and y. Is held as dmin. Then, the screen-eye distance detection unit 8 compares the values of dmin and d, and when dmin takes a value smaller than d, replaces d with dmin.

Subsequently, the screen-eye distance detection unit 8 compares the values of c + e + e and cmax, and ends the process when it is determined that cmax or more.
In this way, in the second embodiment, the distance between the eyes and the screen can be calculated using the camera 7 even when the distance measuring sensor 6 required in the first embodiment is not provided in the portable terminal. become. In particular, by using an existing measurement system such as the camera 7 provided in the mobile terminal, it is not limited to a place, and a viewing state that increases eye fatigue due to the short distance between the eye and the screen is determined. be able to.

  As described above, in the first embodiment, the browsing state is determined based on the angle of the terminal, whereas in the second embodiment, the angle of the neck is appropriate by using the distance between the terminal and the eye. Even in some cases, since the distance between the eyes and the screen is short, it is possible to determine a browsing state that increases eye fatigue.

[Third Embodiment]
FIG. 6 is a diagram showing a configuration of an attitude detection apparatus according to the third embodiment of the present invention. This posture detection apparatus includes a primary information acquisition unit 21, a posture detection unit 22, and an information presentation unit 5. The primary information acquisition unit 21 includes a distance measuring sensor 211 and an acceleration sensor 212. The posture detection unit 22 includes a terminal angle detection unit 221, a matching unit 222, and a posture information DB 223.

The distance measuring sensor 211 measures the distance between the screen of the portable terminal and the user's eyes using a known technique. The acceleration sensor 212 detects acceleration information acting on the user's mobile terminal based on the acceleration information.
The terminal angle calculation unit 221 calculates the angle of the mobile terminal based on the acceleration acquired by the acceleration sensor 212.

When the terminal angle calculated by the terminal angle calculation unit 221 and the measurement result by the distance measuring sensor 211 match, the matching unit 222 compares the angle information table held in the posture information DB 223 and compares the current user's Determine posture.
The information presenting means 5 presents the result determined by the matching means 222 to the user. In addition, the matching unit 222 displays, for example, a message indicating a failure of the distance measuring sensor 211 or the acceleration sensor 212 when the terminal angle calculated by the terminal angle calculating unit 221 and the measurement result by the distance measuring sensor 211 do not match. To present.

  As described above, according to the third embodiment, since both the distance measuring sensor 211 and the acceleration sensor 212 are used, the posture of the user's neck and the distance between the eyes and the screen are close, and thus eye fatigue occurs. It is possible to determine the browsing state that increases

[Fourth Embodiment]
FIG. 7 is a diagram showing a configuration of an attitude detection apparatus according to the fourth embodiment of the present invention. This posture detection device includes primary information acquisition means 31, posture detection means 32, and information presentation means 5. The primary information acquisition unit 31 includes a camera 311 and an acceleration sensor 312. The posture detection unit 32 includes a distance calculation unit 321, a terminal angle detection unit 322, a template DB 323, a matching unit 324, and a posture information DB 325.

The camera 311 captures a user's head image. The acceleration sensor 312 detects acceleration information acting on the user's mobile terminal based on the acceleration information.
The distance calculation unit 321 calculates the distance between the user's eyes and the terminal screen based on the image captured by the camera 311 using the template stored in the template DB 323.

The terminal angle calculation unit 322 calculates the angle of the mobile terminal based on the acceleration acquired by the acceleration sensor 312.
When the calculation result by the distance calculation unit 321 and the calculation result by the terminal angle calculation unit 322 match, the matching unit 324 compares the angle information table held in the posture information DB 325 to determine the current user posture. judge.

  The information presenting means 5 presents the result determined by the matching means 324 to the user. Further, the matching unit 324 presents, for example, a message indicating a failure of the camera 311 or the acceleration sensor 312 to the user when the calculation result by the distance calculation unit 321 and the calculation result by the terminal angle calculation unit 322 do not match. To do.

  As described above, even in the fourth embodiment, by using both the camera 311 and the acceleration sensor 312, the posture of the user's neck and the distance between the eyes and the screen are close, and thus eye fatigue is caused. The browsing state that increases can be determined.

[Other Embodiments]
The apparatus of the present invention can be realized by a computer and a program, and can be recorded on a recording medium or provided through a network.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  1, 212, 312 ... Acceleration sensor, 2 ... Terminal angle calculation means, 3 ... Posture determination means, 4 ... Posture information DB, 5 ... Information presentation means, 6, 211 ... Distance sensor, 7, 311 ... Camera, 8 ... Screen-eye distance detection means, 9,323 ... template DB, 21 ... primary information acquisition means, 22 ... posture detection means, 222, 324 ... matching means.

Claims (9)

In the attitude detection method used by the mobile terminal possessed by the user,
Storing a table in which the inclination of the mobile terminal and the posture information of the user are associated with each other in a memory;
Calculating the inclination of the mobile terminal when the user operates the mobile terminal;
Compare the calculation result with the table stored in the memory, and based on the comparison result, determine the posture of the user,
A posture detection method comprising presenting a determination result of the user posture to the user.   The attitude detection method according to claim 1, wherein calculating the inclination of the portable terminal calculates the inclination of the portable terminal based on an acceleration measured by an acceleration sensor.   Calculating the inclination of the portable terminal calculates the inclination of the portable terminal by calculating the distance between the screen of the portable terminal and the user's eyes based on the measurement result by the distance measuring sensor or the camera. The posture detection method according to claim 1.   The calculating of the inclination of the portable terminal is based on a measurement result obtained by an acceleration sensor and a distance measuring sensor or a measurement result obtained by an acceleration sensor and a camera. The posture detection method according to 1. In the mobile terminal device possessed by the user,
Storage means for storing a table in which the inclination of the mobile terminal is associated with the posture information of the user;
Calculating means for calculating an inclination of the mobile terminal when the user operates the mobile terminal;
A determination unit that compares the calculation result of the calculation unit with the table stored in the storage unit, and determines the posture of the user based on the comparison result;
A portable terminal device comprising: presentation means for presenting the determination result of the user's posture to the user.   The mobile terminal device according to claim 5, wherein the calculating unit calculates an inclination of the mobile terminal based on an acceleration measured by an acceleration sensor.   The said calculating means calculates the inclination of the said portable terminal by calculating the distance of the screen of the said portable terminal, and the said user's eyes based on the measurement result by a ranging sensor or a camera. Item 6. The mobile terminal device according to Item 5.   6. The portable terminal device according to claim 5, wherein the calculating means calculates the inclination of the portable terminal based on a measurement result obtained by an acceleration sensor and a distance measuring sensor or a measurement result obtained by an acceleration sensor and a camera. . A storage unit that stores a table in which the mobile terminal device is associated with the inclination of the mobile terminal and the posture information of the user, the program being executed by the mobile terminal device;
Calculating means for calculating an inclination of the mobile terminal when the user operates the mobile terminal;
A determination unit that compares the calculation result of the calculation unit with the table stored in the storage unit, and determines the posture of the user based on the comparison result;
A program for operating the determination result of the user's posture as a presenting means for presenting to the user.

Images