JP7174525B2 - Display device, display control program, and display control method that encourage posture opposite to inertial force - Google Patents

Description

The present invention relates to a display control technique for a device used inside a mobile object or on a mobile object.

2. Description of the Related Art Currently, it is common for users who get into mobile objects such as automobiles, trains, and ships to enjoy various services using terminals such as smartphones and tablet computers.

In this case, the occurrence of motion sickness, so-called motion sickness, has become a big problem. For example, when using a handheld mobile terminal or seat back monitor terminal while riding in a vehicle, the user's field of view is typically fixed on the screen of such terminal, and the scenery outside the car window is not included in the field of view. As a result, the body is unconsciously braced to respond to the next behavior of the moving vehicle, and unnecessary burden is placed on the body. contradictions may occur. This makes motion sickness more likely to occur.

As a technique for preventing motion sickness or recovering from motion sickness, for example, in Patent Document 1, while viewing images such as TV on a vehicle, vestibular information and somatosensory information based on visual information and vehicle movement are disclosed. A video display device intended to match information is disclosed. Specifically, this device comprises acceleration/deceleration detection means, background image generation means for generating a background image based on the vehicle acceleration detected by the acceleration/deceleration detection means, foreground image generation means for generating a foreground image, and A display control means for synthesizing and displaying the background image and the foreground image is intended to provide the viewer with a visually-induced self-motion sensation.

Patent Document 2 also includes a tubular container that is impermeable, transparent or translucent, and contains at least two substances that differ in state and/or mass, at least one of which is visible. An anti-motion sickness visual locking device is disclosed having a configuration such that the interface serves as a visual field marker when placed in the peripheral vision of one or both eyes of the device user.

Furthermore, Patent Document 3 discloses an acceleration sensor that detects the acceleration of a vehicle, and generates a moving image in which the image moves from a predetermined radiation point toward the front of the screen. and an information processing device for controlling the radiant point and the direction of the moving image generated by the motion image and outputting the generated moving image to a display. The document states that by using this device, it is possible to sufficiently prevent motion sickness or recover from motion sickness without causing side effects or drowsiness.

In addition, as a measure for reducing motion sickness, Non-Patent Document 1 discloses that the motion of the driver's head has the effect of reducing motion sickness in the sense of the SVC (Subjective Vertical Conflict) hypothesis. Mimicking head movements is disclosed to reduce motion sickness.

JP 2009-251687 A JP 2012-66091 A JP 2008-230575 A

Ritsumeikan University Seeds Collection "Technology for Improving Vehicle Motion Comfort", [online], [searched on March 1, 2018], Internet <URL: http://www.ritsumei-seeds.jp/568>

However, even with the above-described conventional technology, it is still difficult to sufficiently suppress the occurrence of motion sickness in a user who enjoys images and videos on a terminal screen while riding a mobile object.

For example, in the technology disclosed in Cited Document 1, acceleration and deceleration in the forward and backward directions related to movement are presented in a visually recognizable form, but this occurs when the moving object turns a curve, for example. No indication of apparent force is made. Therefore, not all causes of motion sickness have been addressed.

Further, for example, in the technology disclosed in Cited Document 2, it is possible to combine a spirit level indicating the direction of gravity with the frame of the display. It's becoming Conversely, however, this technology cannot visually present acceleration/deceleration in the forward/backward direction associated with the vehicle's progress.

Furthermore, with the technology disclosed in Document 3, only computer graphics showing the movement of the vehicle are displayed on the display screen, and in the first place, the user cannot enjoy images and videos such as content. It's closed.

Therefore, the present invention provides a method that can prevent or reduce the occurrence of motion sickness or alleviate the symptoms of motion sickness in a user viewing displayed images or videos inside a mobile object or while riding on a mobile object. An object of the present invention is to provide a display device, and a control program and control method for the display device.

According to the present invention, a display device having an image display section capable of displaying an image,
The display device is a handheld terminal, a mobile terminal or a wearable terminal,
an acceleration measuring unit that measures the acceleration received by the display device;
inertial force acceleration determination means for determining an amount of acceleration related to inertial force from the measured acceleration;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. display control means for deforming and displaying the predetermined graphic image according to the direction , and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
has
The above-described display control means generates and displays the predetermined graphic image in which the degree of vertical displacement accompanying the deformation of itself is a monotonically increasing function of the magnitude of acceleration associated with the determined inertial force. and
The above-described display control means generates a horizontally stretched graphic image as the predetermined graphic image, and the determined inertial force is an angle formed with respect to the horizontal direction of the screen of the image display unit. A display device is provided in which the horizontally stretched graphic image is tilted and displayed at an angle that is a monotonically increasing function of the magnitude of the acceleration .

Furthermore, as one embodiment, the display control means controls the laterally elongated graphic image so that the length of the laterally elongated portion of the laterally elongated graphic image is a monotonically increasing function of the magnitude of the measured acceleration. is also preferably displayed.

Further, the acceleration determination means related to the inertial force of the display device according to the present invention determines the reference acceleration from the acceleration when the standard deviation of the acceleration measured during the predetermined time is small enough to satisfy the predetermined condition, and the measured acceleration is determined. It is also preferred to determine the amount of acceleration associated with the inertial force from the acceleration and the determined reference acceleration.

Further, when the display device is in a state corresponding to the stationary state of the moving object with a predetermined attitude, the display control means receives an instruction to the device or according to a preset setting to change the measured acceleration to the position where the moving object is stopped. It is also preferable to display the predetermined graphic image at a reference position and orientation corresponding to a state corresponding to the state corresponding to the time when the moving object is stopped, with the reference acceleration corresponding to the state corresponding to the hour.

Further, as an embodiment of the display control of the present invention, the display control means superimposes the predetermined graphic image on the image related to the content displayed on the image display unit and allows at least part of the image to be transparent. It is also preferable to display

According to the present invention, there is also provided a program for causing a computer installed in a device having an image display unit with a screen capable of displaying an image to function,
The above device is a handheld terminal, a mobile terminal or a wearable terminal, further comprising an acceleration measuring unit for measuring the acceleration received by itself ,
This program is
inertial force acceleration determination means for determining an amount of acceleration related to inertial force from the measured acceleration;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. display control means for deforming and displaying the predetermined graphic image according to the direction , and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
to make the computer work ,
The above-described display control means generates and displays the predetermined graphic image in which the degree of vertical displacement accompanying the deformation of itself is a monotonically increasing function of the magnitude of acceleration associated with the determined inertial force. and
The above display control means generates a horizontally stretched graphic image as the predetermined graphic image, and an angle formed with respect to the horizontal direction of the screen of the image display unit, which is the determined inertia A display control program is provided for tilting and displaying the horizontally stretched graphic image at an angle that is a monotonically increasing function of the magnitude of the acceleration associated with the force .

According to the present invention, there is further provided a method implemented by a computer installed in a device having an image display capable of displaying an image, comprising:
The above device is a handheld terminal, a mobile terminal or a wearable terminal, further comprising an acceleration measuring unit for measuring the acceleration received by itself ,
The method includes:
a first step of determining from the measured acceleration a quantity associated with the acceleration associated with the inertial force;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. a second step of deforming and displaying the predetermined graphic image with a direction, and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
has
In a second step, generating and displaying the predetermined graphic image in which the degree of vertical displacement accompanying the deformation of the graphic image is a monotonically increasing function of the magnitude of the acceleration associated with the determined inertial force;
In the second step, a horizontally stretched graphic image that is stretched in the horizontal direction is generated as the predetermined graphic image, and the angle formed with the horizontal direction of the screen of the image display unit is the determined inertia force. There is provided a display control method characterized by tilting and displaying the horizontally stretched graphic image at an angle that is a monotonically increasing function of the magnitude of acceleration .

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to prevent or reduce the occurrence of motion sickness, or to alleviate the symptoms of motion sickness, in a user viewing displayed images or videos inside a mobile object or while riding on a mobile object. A display device and a control program and control method for the display device are provided.

1 is a functional block diagram showing a functional configuration in one embodiment of a display device according to the present invention; FIG. FIG. 4 is a schematic diagram showing an example of display control for a predetermined graphic image according to the present invention; FIG. 4 is a schematic diagram showing an example of display control for a predetermined graphic image according to the present invention; 4 is a table summarizing values of acceleration components and angles related to display control of the cross marker for each typical state of the display device. FIG. 4 is a schematic diagram illustrating various embodiments of a given graphical image according to the present invention; FIG. 4 is a schematic diagram showing another embodiment of the display device according to the present invention; 1 is a flow chart schematically showing an embodiment of a display control method according to the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[Functional Configuration of Display Device]
FIG. 1 is a functional block diagram showing the functional configuration in one embodiment of the display device according to the invention.

According to FIG. 1, the smartphone 1 is a display device having an image display unit (the touch panel display 102 in FIG. 1) capable of displaying images. The user browses/views images displayed on the smartphone 1 while in the car 2 or while riding in the car 2 . Hereafter, unless otherwise specified, "image" includes video (moving image).

Although this smart phone 1 will be described later in detail, a predetermined graphic image, for example, the cross image shown in FIGS. It is a display device that encourages tilting in the opposite direction of the force. As a result, the display device 1 can prevent or reduce the occurrence of motion sickness in the user, or can alleviate the symptoms of motion sickness.

By the way, the display device according to the present invention is of course not limited to a smartphone as long as it has an image display unit. A wearable terminal such as (Head Mounted Display) may be used. Alternatively, the device can be configured by a dedicated monitor device such as a seatback monitor device or a personal computer (PC) installed in a moving object.

Specifically, the smartphone 1 is characterized by:
(A) an acceleration measurement unit 101 that measures the acceleration received by itself;
(B) an inertial force acceleration determination unit 111 that determines an amount related to "acceleration related to inertial force" (apparent acceleration) from the measured acceleration;
(C) The "predetermined graphic image" is displayed so as to encourage the user to tilt in the direction opposite to the direction of the "acceleration related to inertial force" when viewing the image displayed on the image display unit (touch panel display 102). Transform and display in a direction of deformation corresponding to the direction opposite to the direction of acceleration related to inertial force, and/or display the “predetermined graphic image” in the direction opposite to the direction of acceleration related to inertial force and a display control unit 112 for tilting in a direction corresponding to the direction.

Here, “acceleration related to inertial force” is acceleration related to inertial force (apparent force) that the user who gets into the automobile 2 receives. For example, when the automobile 2 accelerates forward and travels forward, the user and the smartphone 1 experience not only the gravitational acceleration, but also the rearward "acceleration related to inertial force" that tries to stay in place against the acceleration of the automobile 2. will receive As a result, the received acceleration is increased, and the direction of the received acceleration is tilted backward from the vertically downward direction of the gravitational acceleration, which is opposite to the traveling direction. Furthermore, when the automobile 2 turns a curve at a constant speed, the user and the smartphone 1 try to continue the uniform linear motion, so they receive acceleration due to centrifugal force in the direction opposite to the direction of the curve. As a result, in this case as well, the received acceleration increases, and the direction of the received acceleration is tilted from the vertically downward direction of the gravitational acceleration to the direction opposite to the direction of the curve. Incidentally, the "acceleration related to inertial force" includes the "reference acceleration" (gravitational acceleration) determined when the smartphone 1 is stationary in a predetermined posture (or is in uniform linear motion), and (currently ) is determined as the difference from the acceleration received.

According to Non-Patent Document 1, the reason why a driver is generally less likely to get motion sickness than a fellow passenger is that, for example, when an automobile curves to the left, the driver's head also tilts to the left. In other words, it is known that the driver usually tilts his/her head in the opposite direction to the "acceleration related to inertial force" (rightward acceleration related to centrifugal force when turning left), which makes motion sickness less likely to occur. there is On the other hand, the passenger's head usually follows the received "acceleration related to inertial force" (centrifugal force when curving) and tilts in the same direction as the "acceleration related to inertial force". Motion sickness is more likely to occur.

Based on these facts, the smartphone 1 is designed to encourage the user viewing the image while riding in the automobile 2 to tilt in the direction opposite to the direction of the "acceleration related to inertial force".
(a) display the "predetermined graphic image" by deforming it in a deformation direction corresponding to the direction opposite to the "direction of acceleration related to inertial force"; and/or (b) display the "predetermined graphic image". It is made to tilt in the direction corresponding to the direction opposite to the direction of the "acceleration due to inertial force".

As a result, it is possible to prevent or reduce the occurrence of motion sickness in such users, or to alleviate the symptoms of motion sickness that has developed. The "predetermined graphic image" will be specifically described later with reference to FIGS.

In addition, as yet another embodiment, the display control unit 112, as described later in detail using FIG.
(C′) The image display unit (touch panel display 102) is changed so as to encourage the user to tilt in the direction opposite to the direction of the “acceleration related to inertial force” when viewing the image displayed on the image display unit (touch panel display 102). It is also preferable to tilt in a direction corresponding to the direction opposite to the direction of "acceleration due to inertial force". This also makes it possible to prevent or reduce the occurrence of motion sickness in the user viewing the displayed image while riding in the automobile 2, or to alleviate the symptoms of motion sickness that has developed. .

In addition, in the smartphone 1, the acceleration may be acquired from outside the device, for example, from an inertial measurement unit (IMU, Inertial Measurement Unit) installed in the automobile 2, via the communication interface unit 103. In this case, the acceleration measurement unit An acceleration data acquisition unit may be provided instead of 101 . However, in order to accurately grasp the "acceleration related to the inertial force" that it receives, it is preferable that it has its own acceleration measuring means.

Furthermore, of course, the mobile object in which (the user who owns the smartphone 1 ) gets into is not limited to the automobile 2 . For example, large vehicles such as buses and trucks, railway vehicles including linear cars, monorails, ships, elevators, aircraft including airships, mega floats, submarines, spacecraft, space stations, etc., inside or on them If the smart phone (display device) 1 can be used while riding, various things are applicable.

Hereinafter, the functional configuration of the smartphone 1 according to the present embodiment will be described in detail using the functional block diagram similarly shown in FIG. According to the functional block diagram, the smartphone 1 has an acceleration measurement unit 101, a touch panel display 102, a communication interface unit 103, and a processor memory. Incidentally, FIG. 1 shows only the functional configuration related to the display control function of the smartphone 1. As shown in FIG.

Here, the processor memory stores an embodiment of the display control program according to the present invention, has a computer function, and executes display control processing by executing this display control program. do. For this reason, the display device according to the present invention is of course not limited to the smartphone 1, and various forms of devices including a computer equipped with the display control program according to the present invention can be used for the display. It can be adopted as a device.

Further, the processor memory includes an inertial force acceleration determination unit 111 including a reference acceleration determination unit 111a, a display control unit 112 including a display figure generation unit 112a and a stop reference setting unit 112b, an input/output control unit 113, an application and a part 121 . Note that these functional configuration units can be regarded as functions of the display control program stored in the processor memory. Further, the flow of processing in which the functional components of the display device 1 are connected by arrows in FIG. 1 can also be understood as an embodiment of the display control method according to the present invention.

The acceleration measuring unit 101 is measuring means for measuring the acceleration received by the smartphone 1 itself and outputting the measured value related to the acceleration to the inertial force acceleration determining unit 111. For example, the acceleration measuring unit 101 is provided with a known triaxial acceleration sensor. be able to. Here, when the smartphone 1 is stationary with a predetermined posture (or is in uniform linear motion), the measurement value related to the acceleration vector measured by (the three-axis acceleration sensor of) the acceleration measurement unit 101 is It is output to the inertial force acceleration determination unit 111 as a value related to the reference acceleration. Here, the reference acceleration actually corresponds to gravitational acceleration.

Note that the acceleration measurement unit 101 performs LPF (Low-Pass Filter) processing on the output signal of the acceleration sensor to remove and reduce sensor noise, and then transfers the acceleration measurement value to the inertial force acceleration determination unit 111. Output is also preferred. In this case, it is also preferable to use a digital LPF such as an exponential moving average filter as the LPF.

Moreover, as a modification, the acceleration measurement unit 101 preferably also includes a gyroscope so that changes in the device orientation of the smartphone 1 can also be measured. In this case, for example, the acceleration measurement unit 101 includes a triaxial acceleration sensor and a triaxial gyroscope, and is an inertial measurement unit (IMU) capable of outputting measurement results of three-dimensional acceleration and three-dimensional angular velocity (or angular acceleration). can be

Similarly in FIG. 1, the inertia force acceleration determination unit 111
(a) When the smartphone 1 is stationary with a predetermined posture (or is in uniform linear motion), the acceleration (reference acceleration) measurement value input from the acceleration measurement unit 101 is used to obtain the reference acceleration (gravitational acceleration) in the device coordinate system. acceleration),
(b) Using the determined reference acceleration, determine the amount of "acceleration related to inertial force" from the input acceleration measurement value.

In the device coordinate system of (a) above, the x-axis is the horizontal direction of the display screen of the touch panel display 102, the y-axis is the vertical direction of the display screen, and the z-axis is the depth direction of the display screen. An xyz Cartesian coordinate system is set up (Figs. 2 and 3 show the coordinate axes of the coordinate system). In other words, the determination of the reference acceleration in the device coordinate system is based on the degree of inclination of the smartphone 1 (device orientation ). Note that the inertial force acceleration determination unit 111 also receives an angular velocity measurement value from the acceleration measurement unit 101 equipped with a gyroscope, and determines from changes in the orientation of the smartphone 1 (direction and magnitude of the angular velocity) of the smartphone 1 at the time of measurement. It is also preferable to determine the degree of tilt (device orientation).

Further, the inertia force acceleration determination unit 111 measures the acceleration for a predetermined time (for example, 3 seconds) as “when the smartphone 1 is stopped with a predetermined posture (or is in uniform linear motion)” in (a) above. A case where the standard deviation SD of the applied acceleration is small enough to satisfy a predetermined condition, for example, a case where SD is a predetermined threshold Th _SD (for example, 0.03 m/s ² ) or less (SD≦Th _SD ) can be employed.

Similarly, in FIG. 1, the display graphic generation unit 112a of the display control unit 112 generates a "predetermined graphic image", and furthermore, this "predetermined graphic image" is used as the direction of the determined "acceleration related to inertial force". is deformed with a direction of deformation corresponding to the opposite direction, and/or the "predetermined graphic image" is tilted in a direction corresponding to the direction opposite to the direction of the "acceleration due to inertial force". A specific example of this deformation/tilt will be described later in detail with reference to FIGS. The display control unit 112 displays the “predetermined graphic image” deformed and tilted in this manner so as to prompt the user viewing the image to tilt in the direction opposite to the direction of the “acceleration related to the inertial force”. of.

The input/output control unit 113 receives the command to display the “predetermined graphic image” from the display control unit 112 and causes the touch panel display 102 to display the “predetermined graphic image” related to the command.

At this time, the input/output control unit 113 causes the touch panel display 102 to display the image of the content acquired via the communication interface unit 103 and the image related to the execution of the application received the display command from the application unit 121. It is also preferable to display the "predetermined graphic image" in such a manner as to be superimposed on the image display. As a result, the "predetermined graphic image" is concurrently presented to the user who enjoys the image of the content or application on the screen of the touch panel display 102, thereby preventing, reducing, or mitigating motion sickness. becomes possible.

[Example of display control]
FIG. 2 is a schematic diagram showing an embodiment of display control for a predetermined graphic image according to the present invention.

According to FIG. 2, the screen of the touch panel display 102 of the smartphone 1 displays a cross marker 3 as a predetermined graphic image according to the present invention. At each acceleration and deceleration, the display is transformed into a shape corresponding to the situation.

Specifically, the cross marker 3 is a cross-shaped graphic image having a vertical line 3v as a vertical extension and a horizontal line 3h as a horizontal extension. is displayed in Here, the cross marker 3 has a predetermined color, but it is also preferable to display it translucent so as not to visually block the world map image.

In other words, the display control unit 112 (FIG. 1) superimposes a predetermined graphic image (the cross marker 3 in FIG. 2) on the image related to the similarly displayed content, etc., and allows at least part of the image to be transparent. Display is also preferred. Specifically, by multi-process processing of the smartphone 1, it is possible to perform display control processing for displaying the cross marker 3 in parallel while executing display processing of an image related to content, etc., and overlay the cross marker 3. It becomes possible.

As a result, the cross marker 3 does not interfere with the image display of the content or the like, and the user can visually recognize the cross marker 3 while enjoying the image of the content or the like.

Similarly, in FIG. 2, the cross marker 3 is displayed in the center of the screen in a state where the horizontal line 3h and the vertical line 3v intersect each other so as to form perpendicular bisectors of each other when the automobile 2 is stopped. Here, the horizontal line 3h and the vertical line 3v extend in the x-axis direction and the y-axis direction of the screen, respectively, and the length of the vertical line 3v is lv0. In the present embodiment, such a display state of the cross marker 3 is a reference state, which prompts the user to maintain the posture. For example, even if the user holds the smartphone 1 tilted and the x-axis of the screen is not horizontal, the horizontal direction is determined from the direction of the acceleration received, and this direction is set as the direction of the horizontal line 3h. The cross marker 3 is displayed so that the horizontal line 3h is horizontal.

Next, in this embodiment, the automobile 2 travels in the traveling direction (forward) within the yz plane of the device coordinate system. Here, when the vehicle 2 is accelerating, the vertical line 3v of the cross marker 3 increases its length and shifts upward (in the +y direction) on the screen. 3v and the horizontal line 3h intersect each other at the midpoint of each other, but the vertical line 3v extends and deforms upward on the screen. This deformation encourages the user to lean forward instead of maintaining the current posture. Furthermore, when the acceleration is further accelerated, the degree of deformation, that is, the increase in the length of the vertical line 3v and the amount of upward shift of the screen increase, prompting the user to take a more forward leaning posture. On the other hand, during deceleration, the vertical line 3v of the cross marker 3 increases its length and shifts downward (-y direction) on the screen. , and urges the user to take a backward leaning posture.

Specifically, in this embodiment, first, the length lh of the horizontal line 3h is, for example, the following equation (1) lh=Ch1×a
is represented by Here, a is the magnitude of the acceleration (vector) measured by the acceleration measurement unit 101, and is a value calculated by (Equation a) described later. Ch1 is a coefficient for adjusting the acceleration (unit is m/s ² , for example) to the length unit of the display figure (pixel number, for example). The user can intuitively recognize the total acceleration that the user receives from the length lh of the horizontal line 3h.

Of course, the length lh of the horizontal line 3h is not limited to the form of the above formula (1). It may have a constant size that does not depend on the measured acceleration, or various forms can be adopted as long as the length is a monotonically increasing function of the measured acceleration. .

On the other hand, the length lv of the perpendicular 3v is, for example, the following equation (2) lv=lv0+Cv1×|af|
is represented by Here, af is the difference between the measured acceleration and the reference acceleration (acceleration in the traveling direction), that is, the y-axis projection component of the "acceleration related to the inertia force" (the y-projection component of the acceleration related to the inertia force), Cv1 is a coefficient for matching the acceleration to the length unit of the display figure (for example, the number of pixels). Incidentally, af can be calculated using (formula f) described later.

In this embodiment, the shift amount dv of the vertical line 3v toward the screen upward (+y direction) is, for example, the following formula (3) dv=Cv2×af
is represented by Here, Cv2 is also a coefficient for adjusting the acceleration to the length unit of the display figure (for example, the number of pixels). Note that dv in the above equation (3) becomes a negative value (similar to af) during deceleration, and represents the amount of deviation downward (-y direction) on the screen.

Of course, the relationship between the length lv and the amount of deviation dv described above and the acceleration (y projected component af) related to the inertial force is not limited to the formulas (2) and (3), respectively. and the amount of deviation dv, various relationships can be adopted as long as they are monotonically increasing functions of the acceleration (y-projection portion af) associated with the inertial force.

As described above, the vertical line 3v deforms (extends upward on the screen) in the upward direction of the screen (in the direction of +y) at the time of acceleration, so that the user viewing the screen can adjust his/her posture, especially the head, to the screen. It can be urged to lean forward and downwards corresponding (equivalent) to upwards. Here, the upward direction of the screen corresponds to the direction opposite to the direction of the acceleration (y projected component af) associated with the inertial force acting in the opposite direction to the traveling direction of the automobile 2 .

On the other hand, when decelerating, the vertical line 3v deforms (extends downward on the screen) in the downward direction of the screen (-y direction), so that the user viewing the screen can adjust his or her posture, especially the head, to correspond to the downward direction of the screen. You can be encouraged to lean forward and upward to do (correspond). Here, the downward direction of the screen corresponds to the direction opposite to the direction of the acceleration (y projected component af) associated with the inertial force acting in the traveling direction of the automobile 2 .

By displaying the cross marker 3 as described above, at least the user's head is urged to tilt in the direction opposite to the acceleration related to the inertial force, and by tilting the user's posture, the occurrence of motion sickness is prevented or reduced. Or it can be reduced.

Incidentally, as a modification, the length lv of the perpendicular 3v may be constant (lv=lv0) independent of the acceleration, unlike the above equation (2). Even in this case, since the vertical line 3v shifts in the vertical direction according to the acceleration, it is possible to encourage the user to tilt the posture, especially the head, in the direction opposite to the direction of the acceleration related to the inertial force.

FIG. 3 is a schematic diagram showing an embodiment of display control for a predetermined graphic image according to the present invention. The embodiment shown in FIG. 3 relates to the display state of the cross marker 3 in the smartphone 1 shown in FIG. It is.

First, during uniform linear motion, the cross marker 3 is in the same display state as the stop state in FIG. 2, that is, the reference state. Next, when the automobile 2 curves to the left, the cross marker 3 rotates counterclockwise (counterclockwise) around the intersection of the cross and is displayed tilted to the left, thereby giving the user a left tilting posture. encourage you to take On the other hand, the cross marker 3 rotates clockwise (right-handedly) about the intersection of the crosses and is tilted to the right during a right curve, thereby prompting the user to lean to the right.

Specifically, in the present embodiment, the angle θh formed by the horizontal line 3h with respect to the x-axis is expressed by the following formula (4) θh=arctan((ay ² +az ² ) ^0.5 /ax) where the counterclockwise direction is positive.
is represented by Here, ax, ay, and az are the x component, y component, and z component of the acceleration (vector) measured by the acceleration measurement unit 101, respectively. Here, θh takes a positive value when ax>0 during a left curve, and takes a negative value when ax<0 during a right curve.

In any case, the cross marker 3 is tilted in a direction opposite to the direction of the acceleration (in this case, centrifugal force) related to the inertial force based on the tilt angle θh. The user can be encouraged to tilt their posture, especially their head, in a direction opposite to the centrifugal force (to the left when turning left and to the right when turning to the right). Thereby, the occurrence of motion sickness can be prevented, reduced, or mitigated by changing the user's posture so that at least the user's head is tilted in the direction opposite to the acceleration associated with the inertial force.

Of course, the inclination angle θh of the horizontal line 3h is not limited to the form of the above formula (4). Various forms can be adopted as long as the angle is a monotonically increasing function of the magnitude of the acceleration (acceleration x component ax) related to the inertial force.

Next, the display control of the cross marker 3 at the time of ascent and descent will be described, although it will be assumed that the mobile object that the user is boarding is not the automobile 2 but an airplane or the like. Similarly, as shown in FIG. 3, the length lh (=Ch×a: formula (1)) of the horizontal line 3h of the cross marker 3 during ascent is longer as the measured acceleration a increases. On the other hand, during descent, the length lh of the horizontal line 3h becomes shorter than that during uniform linear motion (stopping) due to the decrease in the measured acceleration a. In particular, during a free-fall motion where the acceleration is zero, the length lh of the horizontal line 3h is also zero (lh=0), which makes it possible to present to the user that there is no point in changing the posture. .

By displaying the cross marker 3 in this manner, the user can recognize the upward/downward movement of the moving object while looking at the screen, and can cope with the movement, thereby preventing or suppressing the occurrence of motion sickness. It becomes possible to do.

As described above with reference to FIGS. 2 and 3, the cross marker 3 is deformed/deformed in response to not only the acceleration/deceleration of the moving object, but also the movement of turning left and right curves, and the upward/downward movements. Since it can be presented to the user in a tilted (rotated) state, it is possible to appropriately deal with various movements of moving objects that may cause motion sickness.

When the user tilts the smartphone 1 held by the user together with the head in accordance with the movement of the cross marker 3 as described above, the user should move the cross marker 3 to a cross in the standard state. By tilting the head and the smartphone 1, it is possible to cope with the occurrence of motion sickness.

Calculation formulas (Formula a) to (Formula h) for displaying the cross marker 3 that can be employed in the display control program according to the present invention are listed below.

(Formula a) Magnitude of measured acceleration vector av which is the acceleration vector measured by acceleration measuring unit 101: a=(ax ² +ay ² +az ² ) ^0.5
(Formula b) Angle formed by measured acceleration vector av with respect to x-axis: sx = arctan ((ay ² +az ² ) ^0.5 /ax)
(Formula c) Angle formed by measured acceleration vector av with respect to y-axis: sy=arctan((ax2 ^{+ az2} ) ^0.5 /ay)
(Formula d) Angle formed by measured acceleration vector av with respect to z-axis: sz = arctan ((ax ² + ay ² ) ^0.5 / az)

(Equation e) Let the start position coordinates of the horizontal line 3h on the screen (xy plane) be (hx1, hy1), the end position coordinates be (hx2, hy2), and the screen center position be (cx, cy),
hx1 = cx - dx, hy1 = cy - dy, hx2 = cx + dx, hy2 = cy + dy
where, dx = Ch2 x a x cos(sx), dy = Ch3 x a x sin(sx) (Ch2, Ch3: coefficients for screen display alignment)

(Formula f) Let base_sy be the angle formed by the reference acceleration (measured acceleration vector av at the time of stopping) with respect to the y-axis. Quantity related to "acceleration"): af = a x sin (sy - base_sy) (where sy is a value within the range of 0 to 90 degrees)

(Formula g) Let the length of the vertical line 3v be lv (= lv0 + Cv1 × |af|: the above formula (2)), the acceleration component related to the inertial force in the length of the displayed vertical line 3v: mpv = lv × (0.5- af/Cv3) (Cv3: Coefficient for screen display alignment)
(Formula h) Let the start position coordinates of the vertical line 3v on the screen (xy plane) be (vx1, vy1), the end position coordinates be (vx2, vy2), and the screen center position be (cx, cy),
vx1 = cx - fx, vy1 = cy + fy, vx2 = cx + bx, vy2 = cy - by
where fx＝mpv×sin(sx), fy＝mpv×cos(sx),
bx＝(lv－mpv)×sin(sx)，by＝(lv－mpv)×cos(sx)

Incidentally, a method for deriving base_sy, which is necessary when calculating af using (formula f), will be described later in detail using the flowchart of FIG. 7(B).

In addition, mpv calculated using (formula g) is the amount that is half of lv (= lv0) when af is zero, and fy is the vertical line 3v (viewed from the horizontal line 3h) will be the length of the upper side, while by will be the length of the lower side. Therefore, the deviation amount dv represented by the above formula (3) is given by the following formula (5) dv = (fy-by) / 2
is calculated as

Furthermore, the values taken by the acceleration components ax, ay and az and the angles sx, sy and sz described above for each typical state of the smartphone 1 are summarized in the table of FIG. In this table, the units of angles are degrees (°). Also, G in the value of the acceleration component represents the magnitude of gravitational acceleration (reference acceleration).

According to the table in FIG. 4, for example, when the smartphone 1 is in the “holding fixed” state (with an inclination of 45 degrees), the acceleration components ax, ay and az, and the angles sx, sy and sz are respectively 0, G It can be seen that it takes values of xcos(45°) and Gxcos(45°) and 0, 45 and 45.

[Acceleration marker example]
FIG. 5 is a schematic diagram illustrating various embodiments of a given graphical image according to the present invention.

FIG. 5A shows a cross marker 3' as a predetermined graphic image according to the present invention. The cross marker 3' has a horizontal line 3h' and a vertical line 3v'. The vertical line 3v' has an arrow on the upper side of the screen (+y side) during acceleration, and an arrow on the lower side of the screen (-y side) during deceleration. It has the same shape and length as the cross marker 3 shown in FIGS. Here, by displaying such an arrow, it is possible to more clearly prompt the user to take a posture that can suppress the occurrence of motion sickness, particularly to move the head.

Also, FIG. 5B shows a diamond-shaped marker 4 as a predetermined graphic image according to the present invention. The rhombic marker 4 is a laterally elongated graphic image elongated in the horizontal direction (x-axis direction), and is a quadrilateral having a horizontal line 3h and a vertical line 3v of the cross marker 3 shown in FIGS. there is That is, the diamond-shaped marker 4 assumes a deformed/tilted (rotated) state that completely corresponds to that of the cross marker 3 in accordance with the acceleration associated with the inertial force. Therefore, even with such a diamond-shaped marker 4, it is possible to encourage the user to take a posture that can suppress the occurrence of motion sickness, particularly to move the head.

Incidentally, the coordinates (hx1, hy1) and coordinates (hx2, hy2) shown in (Equation e) of the cross marker 3 and the coordinates (vx1 , vy1) and coordinates (vx2, vy2) can be employed.

Furthermore, FIG. 5(C) shows a dumbbell-shaped marker 5 as a predetermined graphic image according to the present invention. The dumbbell-shaped marker 5, like the cross marker 3 shown in FIGS. Then, it assumes a deformed/tilted (rotated) state that completely corresponds to the cross marker 3 according to the acceleration associated with the inertial force. Therefore, even with such a dumbbell-shaped marker 5, it is possible to encourage the user to take a posture that can suppress the occurrence of motion sickness, particularly to move the head.

Specifically, in the dumbbell-shaped marker 5, for example,
(a) During acceleration, the vertical line 3v of the cross marker 3 shifts upward (in the +y direction), so that the diameter of the dumbbell weight on the upper side (+y side) increases and the dumbbell weight on the lower side (-y side) increases. The diameter of the weight is reduced,
(b) During deceleration, the vertical line 3v of the cross marker 3 shifts downward (in the -y direction). The diameter of the weight portion is reduced. Here, as the upper extension amount fy' and the lower extension amount by' in the dumbbell-shaped marker 5, fy and by shown in (formula h) of the cross marker 3 can be employed, respectively.

[Another embodiment of display control]
FIG. 6 is a schematic diagram showing another embodiment of the display device according to the present invention.

6A1 and 6A2 show a display device 6 according to the invention. Here, FIG. 6A1 is a front view of the display device 6, and FIG. 6A2 is a side view of the display device 6. As shown in FIG.

6A1 and 6A2, the display device 6 includes an image display unit (for example, a touch panel display) in the device main body, and further,
(a) a fixing portion fixed to the ceiling surface of the moving body 2;
(b) a mounting portion (panhead) to which the device main body can be mounted while the screen of the image display portion is exposed;
(c) a driving section for moving and/or rotating the device main body attached to the mounting section relative to the fixed section; Of these, the drive section of (c) is, in the embodiment of FIGS. It is a servo motor part.

In addition, the display device 6 has the same functional components as the smartphone 1 shown in FIG. The image display unit (for example, a touch panel display) is tilted in a direction corresponding to the direction opposite to the direction of acceleration related to inertial force. Therefore, it is of course possible to use the smartphone 1 attached to the attachment portion as the display device 6 .

For example, when the moving body 2 is accelerating, the display device 6 drives the pitch servomotor section in FIG. You can rotate the screen of the main unit in the opposite direction. Here, such a pitch angle of rotation is, for example, an angle sy calculated by (formula c) or a monotonically increasing function of the acceleration component af related to the inertial force calculated by (formula f), for example, a positive linear function It is also preferable to

Further, for example, when the moving body 2 curves to the left, in FIG. 6A1, the roll servomotor unit is driven to rotate the screen of the main body of the apparatus counterclockwise (counterclockwise). The screen of the device main body may be rotated clockwise (right). Here, it is also preferable that such a roll angle of rotation be a monotonically increasing function, eg, a positive linear function, of the angle sx calculated by (Equation b), for example.

By driving the screen display unit of the device main body as described above, the user can tilt his or her posture, particularly his head, in accordance with the movement of the screen itself, thereby preventing or suppressing the occurrence of motion sickness. It is possible. In addition, since the driving of the device body as described above is similar to the movement of the steering wheels of an aircraft, the user can see the driving of the device body and feel the movement of the vehicle through the corresponding steering wheels. can be easily guessed as caused by the movement of Also, the user can predict the acceleration that the user will receive in the future based on the movement of the vehicle estimated in this way.

The manner of fixing the display device 6 is, of course, not limited to those shown in FIGS. 6A1 and 6A2. For example, as shown in FIG. It is also possible to adopt a mode in which the fixing portion is fixed to a wall surface, for example, the back portion of the seat (back side portion). In any case, when the user is looking at an image such as content displayed on the screen by pitch rotation or roll rotation of the screen (apparatus main body) as described above, the posture of the user, particularly the head, may be changed. It is possible to prevent or suppress the occurrence of motion sickness by urging the user to tilt in a direction corresponding to the direction opposite to the direction of acceleration related to the inertial force.

Further, a display device 7 is shown in FIGS. 6C1 and 6C2 as another embodiment of the display device having a fixing portion and a mounting portion. Here, FIG. 6(C1) is a front view of the display device 7, and FIG. 6(C2) is a side view of the display device 7. As shown in FIG.

6C1 and 6C2, the display device 7 also includes an image display unit (for example, a touch panel display) in the device main body, and the fixing portion and the device main body are attached in the same manner as the display device 6 described above. It has a possible mounting part (head) and a drive part. Here, in the display device 7, the main body of the device is attached to the mounting portion with movable shafts orthogonal to each other that are capable of pitch rotation and roll rotation, and is further biased by a spring so as to be placed in a fixed position when not driven. It has become. Further, the drive units are a pitch servomotor unit and a roll servomotor unit having servomotors capable of linear driving in mutually orthogonal axial directions.

In such a display device 7 as well, the display control section in the device main body drives these drive sections, and the image display section (for example, the touch panel display) is controlled by the acceleration caused by the inertial force, as in the display device 6 described above. It can be tilted in a direction corresponding to the direction opposite to the direction. As a result, the user can tilt his or her posture, particularly his head, in accordance with the movement of the screen itself, thereby preventing or suppressing the occurrence of motion sickness.

By the way, since the servo motors used in the display device 6 and the display device 7 described above have limits on the range of rotational driving and linear driving, the display control section of the device can be operated within the drivable range. different pitch rotations and roll rotations. Further, the driving means of the driving section is of course not limited to the servomotor, and it is also possible to adopt, for example, a pneumatic actuator or a hydraulic actuator as this driving means.

Furthermore, by driving the screen display unit (apparatus main body) of the display device 6 or the display device 7 by combining not only rotation but also translational movement, the direction of the acceleration related to the inertial force is opposite to the direction corresponding to the direction. , can be tilted more appropriately. It is also preferable to display the "predetermined graphic image" (for example, the cross marker 3) displayed on the display device 1 on the display device 6 or the display device 7 to further improve the effect of preventing or suppressing the occurrence of motion sickness.

[Display control method]
FIG. 7 is a flow chart schematically showing an embodiment of a display control method according to the invention.

First, the flowchart of FIG. 7A shows the process of determining the "reference acceleration (gravitational acceleration)" required to determine the amount of "acceleration related to inertial force".
(S101) Acceleration measured for a predetermined time (for example, 3 seconds) is acquired and buffered.
(S102) Calculate the standard deviation SD of the acquired acceleration for the predetermined time.

(S103) It is determined whether or not the calculated standard deviation SD is equal to or less than a predetermined threshold value Th _SD (for example, 0.03 m/s ² ) (SD≦Th _SD ). Here, if a false determination (SD>Th _SD ) is made, the process returns to step S101 to acquire the acceleration again.
(S104) On the other hand, when a true determination (SD≤Th _SD ) is made in step S103, the acceleration measured at this time is obtained, and the acceleration is defined as a "reference acceleration (gravitational acceleration)", and the xyz apparatus coordinate system Calculate and store its orientation (base_sy) in .

It should be noted that the "reference acceleration" (orientation in the xyz device coordinate system) determined as described above will be becomes invalid. Therefore, such a "reference acceleration" determination process can be performed by presetting (for example, periodically) or by receiving a reset command from the user (for example, information when the user taps the reset icon displayed on the touch panel display). received) is preferably carried out as appropriate.

In addition, the stop time reference setting unit 112b (FIG. 1) of the display control unit 112 sets the "reference acceleration (gravitational acceleration)" determined or reset as described above to the stop state (or uniform linear motion state). It is also preferable to display the cross marker 3 at a reference position and in a direction corresponding to the stopped state (or the state of uniform linear motion) (for example, in a horizontal state at the center of the screen).

Next, the flowchart of FIG. 7(B) shows processing for performing display control of the cross marker 3 using the determined "reference acceleration".
(S201) Acquire the measured acceleration.
(S202) LPF processing is performed on the acquired acceleration to remove sensor noise.
(S203) Calculate the orientation (sy) of the acquired acceleration in the xyz device coordinate system.

(S204) Calculate the difference between the direction of the acquired acceleration (sy) and the determined direction of the "reference acceleration" (base_sy), and calculate the amount (af=a×sin(sy - base_sy)).
(S205) The shape and orientation of the cross marker 3 are determined based on the determined "acceleration related to inertial force".
(S206) The cross marker 3 having the determined shape and orientation is displayed on the touch panel display 102. FIG.

The above steps S201 to S206 are repeated each time the acceleration is measured or at a preset cycle. becomes possible. Note that it is also preferable that the above-described "reference acceleration" determination processing of steps S101 to S104 is appropriately performed at a point in between.

As described in detail above, according to the present invention, the posture of the user viewing an image inside a moving body or while riding on the moving body is encouraged to tilt in the direction opposite to the direction of the "acceleration related to inertial force". Thus, it is possible to display a "predetermined graphic image" and to rotate and move the display screen (apparatus main body). This makes it possible to prevent or reduce the occurrence of motion sickness in such users, or to alleviate the symptoms of motion sickness that has developed.

By the way, in the future, not only in transportation such as automobiles and trains, but also in various medium- and large-scale mobile bodies, and in mobile bodies that navigate in various environments such as on the sea, under the sea (under the sea), and even in outer space. , it is expected that opportunities for viewing and browsing images displayed on devices will further increase. The present invention is considered to be an effective preventive medicine and cure for motion sickness, which becomes a serious problem in such situations.

In the various embodiments of the present invention described above, various changes, modifications and omissions within the scope of the technical ideas and aspects of the present invention can be easily made by those skilled in the art. The above description is merely an example and is not intended to limit the invention in any way. The invention is to be limited only as limited by the claims and the equivalents thereof.

1 Smartphone (display device)
101 Acceleration measurement unit 102 Touch panel display 103 Communication interface unit 111 Inertial force acceleration determination unit 111a Reference acceleration determination unit 112 Display control unit 112a Display graphic generation unit 112b Stop reference setting unit 113 Input/output control unit 121 Application unit 2 Automobile (moving body)
3, 3' cross marker 3h, 3h' horizontal line 3v, 3v' vertical line 4 diamond marker 5 dumbbell-shaped marker 6, 7 display device

Claims (7)

A display device having an image display unit capable of displaying an image,
The display device is a handheld terminal, a mobile terminal or a wearable terminal,
an acceleration measuring unit that measures the acceleration received by the display device;
inertial force acceleration determination means for determining an amount of acceleration related to inertial force from the measured acceleration;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. display control means for deforming and displaying the predetermined graphic image according to the direction , and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
has
The display control means generates and displays the predetermined graphic image in which the degree of displacement in the vertical direction accompanied by the deformation of itself is a monotonically increasing function of the magnitude of acceleration associated with the determined inertial force. can be,
The display control means generates a horizontally stretched graphic image as the predetermined graphic image, and the determined inertial force is an angle formed with respect to the horizontal direction of the screen of the image display unit. A display device characterized in that the laterally stretched graphic image is tilted and displayed at an angle that is a monotonically increasing function of the magnitude of the acceleration . The display control means displays the horizontally stretched graphic image such that the length of the horizontally stretched portion of the horizontally stretched graphic image is a monotonically increasing function of the magnitude of the measured acceleration. The display device according to claim 1. The inertial force acceleration determination means determines a reference acceleration from the acceleration when the standard deviation of the acceleration measured during a predetermined time is small enough to satisfy a predetermined condition, and determines the measured acceleration and the determined reference acceleration. 3. The display device according to claim 1, wherein the quantity related to the acceleration related to the inertial force is determined from . When the display device has a predetermined attitude and is in a state equivalent to the state where the moving object is stopped, the display control means receives an instruction to the device or according to a preset setting, and converts the measured acceleration to the moving object. 4. The predetermined graphic image is displayed at the reference position and orientation corresponding to the state equivalent to the stop of the moving object. The display device according to any one of items 1 and 2. 2. The display control means superimposes the predetermined graphic image on the image related to the content displayed on the image display unit and displays the image with at least part of the image being transparent. 5. The display device according to any one of 4. A program that causes a computer installed in a device having an image display unit capable of displaying an image to function,
The device is a handheld terminal, a mobile terminal or a wearable terminal, further comprising an acceleration measuring unit for measuring the acceleration received by itself ,
The program
inertial force acceleration determination means for determining an amount of acceleration related to inertial force from the measured acceleration;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. display control means for deforming and displaying the predetermined graphic image according to the direction , and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
to make the computer work ,
The display control means generates and displays the predetermined graphic image in which the degree of displacement in the vertical direction accompanied by the deformation of itself is a monotonically increasing function of the magnitude of acceleration associated with the determined inertial force. can be,
The display control means generates a horizontally stretched graphic image as the predetermined graphic image, and the determined inertial force is an angle formed with respect to the horizontal direction of the screen of the image display unit. A display control program characterized by tilting and displaying the horizontally stretched graphic image at an angle that is a monotonically increasing function of the magnitude of the acceleration . A method implemented by a computer installed in a device having an image display capable of displaying an image, comprising:
The device is a handheld terminal, a mobile terminal or a wearable terminal, further comprising an acceleration measuring unit for measuring the acceleration received by itself ,
The method includes
a first step of determining from the measured acceleration a quantity associated with the acceleration associated with the inertial force;
A predetermined graphic image is deformed in a direction opposite to the direction of acceleration related to the inertial force so that the posture of the user viewing the image is inclined in the direction opposite to the direction of the acceleration related to the inertial force. a second step of deforming and displaying the predetermined graphic image with a direction, and tilting the predetermined graphic image in a direction corresponding to a direction opposite to the direction of acceleration related to the inertial force ;
has
In the second step, generating and displaying the predetermined graphic image in which the degree of vertical displacement accompanying the deformation of the graphic image is a monotonically increasing function of the magnitude of the acceleration associated with the determined inertial force;
In the second step, a horizontally stretched graphic image that is horizontally stretched is generated as the predetermined graphic image, and an angle formed with respect to the horizontal direction of the screen of the image display unit, which is the determined inertia A display control method, characterized in that the laterally stretched graphic image is tilted and displayed at an angle that is a monotonically increasing function of the magnitude of acceleration associated with a force .

Images