JP2018004756A - Information display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display system which can increase the visibility of auxiliary information by automatically installing the auxiliary information in an appropriate position.SOLUTION: An information display system 500 includes: region determination means 30 for determining a region 31 where auxiliary information 120 can move in a vision 110 of a display device 100 displaying the auxiliary information 120 in the same vision 110 as the vision for main information 130 that a user A watches; rotation information acquisition means for detecting the rotation of the display device 100 and acquiring rotation information B, θ; position detection means for acquiring the position of the auxiliary information 120 in the vision 110; and position control means for correcting the position so that the position is located in the region 31, using the rotation information B, θ.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information display system.

  An eyeglass-type image display device is known in which a transmissive or non-transmissive display is arranged in front of the user's eyes, and displays images related to various types of information existing in the user's field of view (for example, Patent Documents). 1 etc.).

In such an image display device, auxiliary information related to the main information may be displayed in addition to the main information that the user is most interested in.
However, since the user pays attention to the main information, the position where the auxiliary information is displayed is covered by the main information in a state in which the main information is chased by the rotational movement of the neck so as not to remove the main information from the field of view. Or there was a concern that problems such as falling out of sight occurred.

  The present invention has been made in view of the above problems, and it is an object of the present invention to provide an information display system in which the visibility of auxiliary information is improved by automatically installing auxiliary information at an appropriate position. And

  In order to solve the above-described problem, an information display system according to the present invention provides an area in which the auxiliary information can move within the visual field in the display device that displays the auxiliary information within the same visual field as the main information that the user watches. Region determining means for determining; turning information acquiring means for detecting rotation of the display device to acquire turning information; position detecting means for acquiring the position of the auxiliary information within the field of view; and the turning Position control means for correcting the position so as to enter the region using information.

  According to the information display system of the present invention, the auxiliary information is automatically installed at an appropriate position, thereby improving the visibility of the auxiliary information.

It is a figure showing an example of the whole composition of the information display system concerning the embodiment of the present invention. It is a figure which shows an example of a structure of the display apparatus shown in FIG. It is a figure which shows the example of mounting | wearing of the display apparatus shown in FIG. It is a figure which shows an example of the display area and display limit area which an area | region determination means determines. It is a figure which shows an example of how it looks when it sees from the user's visual field shown in FIG. It is a figure which shows typically the operation | movement which rotates a neck so that a user may follow an object. It is a figure which shows the change of the visual field at the time of the operation | movement shown in FIG. It is a flowchart which shows an example of operation | movement of an information display system. It is a figure which shows another example of an information display system.

As an example of the first embodiment of the present invention, FIG. 1 shows a schematic configuration of an information display system 500 including a display device 100 as a head-mounted display which is a transmissive image display device.
In the following description, the front direction of the user A is the Z direction, and among the directions perpendicular to the Z direction, the vertical direction is the Y direction, and the horizontal direction that is perpendicular to the Z direction and the Y direction is the X direction. And

  The information display system 500 is mounted on the head of the user A and displays the information to the user A, the gyro sensor 20 as turning information acquisition means for detecting the rotation of the display device 100, and the display device 100. And a control unit 9 that performs the above control.

In this embodiment, the display device 100 is a visual device worn on the head of the user A, and experiences so-called augmented reality that adds information to the actual visual information visually recognized by the user A. It is a head mounted display.
As shown in FIG. 2, the display device 100 is a case 101 that is a spectacle-shaped case attached to the head of the user A, and a transmissive display for displaying an image in front of the user A's eyes. An image display unit 3 and an image output unit 1 serving as a projection unit that outputs an image are included.

  The casing unit 101 is attached to the transparent front part 101a formed in front of the left and right eyes of the user A and the front part 101a, and at least a part of the casing part 101 abuts on the head of the user A to support the front part 101a. Side surface portion 101b.

  The image output unit 1 is an image projection device that is attached to the housing unit 101 and includes a projection optical system for projecting an image 120.

As shown in FIG. 3, the image display unit 3 includes a reflecting plate 50 that reflects the image 120 emitted from the image output unit 1 toward the eyes of the user A.
The user A recognizes the image 120 reflected by the reflecting plate 50 as a virtual image existing within the range of the visual field 110 shown in FIG. Therefore, the image display unit 3 has a function as a virtual image forming unit.
In the present embodiment, a transmissive half mirror is used as the reflecting plate 50, but other configurations may be used.

  The image 120 displayed on the image display unit 3 may be image data including character information, as shown in FIG.

The gyro sensor 20 is attached inside the housing unit 101 of the display device 100 and detects the rotation of the display device 100. Specifically, the gyro sensor 20 detects inertial force generated by the rotation of the display device 100, and detects the turning direction B of the display device 100 main body and the turning angle θ described later with reference to FIG. 6 as turning information.
The gyro sensor 20 is a “yaw axis” that is a vertical axis centering on a rotation axis parallel to the Y axis, a “pitch (pitching) axis” that is a horizontal axis parallel to the X axis, and a longitudinal axis that is parallel to the Z axis. The turning information of each of the three axes of the “roll axis” can be acquired.
Further, in the following description, for the three axes of “yaw axis”, “pitch axis”, and “roll axis”, the directions of rotation about each axis are defined as “yaw direction”, “pitch direction”, and “roll direction”. ".

As shown in FIG. 3, the control unit 9 is a region determination unit for determining a display region 31 of an image 120 as auxiliary information, which will be described later, within the same field of view 110 as the object 130 as the main information to be watched by the user A. 30.
The control unit 9 is a position control unit that adjusts the position of the image 120 using the image position recognition unit 40 that is a position detection unit that acquires the position of the image 120 in the visual field 110 and the turning information output from the gyro sensor 20. And a correction unit 41.

As shown in FIG. 4, the region determining unit 30 determines a displayable position of the image 120 in the visual field 110. In the present embodiment, the area determination unit 30 includes a display area 31 that is an area in which the image 120 is movable, and an area outside the center of the field of view of the display area 31. A display limit area 32 for moving the image when touched is determined.
In the following description, when particularly necessary, the coordinates of the left end portion of the display area 31 located on the right side of the visual field 110, that is, the central end portion of the visual field 110 are φ _s1 and the right end side of the display area 31 The coordinates of the boundary portion with the display limit region 32 are described as φ _s2 , the outer end of the visual field 110, and the end of the display limit region 32 outside the visual field 110 is described as φ _s3 .

  It is most desirable that the display limit area 32 is arranged at the outer edge in the horizontal direction in the visual field range that is visible when the user A gazes at the object 130. However, the present invention is not limited to this configuration, and the display limit region 32 may be arranged at a free position in the visual field 110.

The image position recognition unit 40 is a recording means for recognizing and storing the position of the image 120 and the position of the object 130 by polar coordinate display centered on the display device 100.
Image position recognition unit 40 recognizes the position of the image 120 position (r, phi _x1) of the upper left portion 120a and the upper right position of 120b (r, φ _x2) and the basis. At this time, r represents the distance from the user A or the display device 100 to the image 120.
It should be noted that such position recognition is desirably performed at any one of the four corners, but is not limited to such a configuration. For example, when the image 120 is a rectangle, one of the four sides is recognized. The position may be used as a reference.

  The correction unit 41 uses the turning direction B detected by the gyro sensor 20 and the turning angle θ to determine the position of the image 120 based on the change in the visual field 110 when the user A turns the neck in the horizontal direction. It is a correction means as a position control means for correcting.

A method in which the user A reads the image 120 that is auxiliary information displayed on the display device 100 while checking the state of the object 130 that is external gaze information using the display device 100 will be described.
In the display device 100 as shown in the present embodiment, it is considered that the turning by the left and right movement of the user A's neck is the most remarkable turning. Therefore, in the present embodiment, the turning direction is the yaw direction that is the direction of rotation about the Y axis shown as θ in FIG. 6, that is, the turning on the ZX plane, and the turning direction is the direction shown in FIGS. The case of moving will be described.

FIG. 5 is a diagram in which the display area 31 set by the area determining unit 30 and the display limit area 32 are projected onto the visual field 110 of the user A.
Thus, the area inside the visual field 110 with respect to the display area 31 has a function as the main information display unit 133 on which the object 130 as main information is displayed when the object 130 is watched.
In an initial state in which the user A is staring straight at the stationary object 130, the image 120 is displayed in the display area 31 and / or the display limit area 32 determined by the area determination unit 30.

The image position recognition unit 40 stores the display position of the image 120 in the initial state as the initial positions (r, φ _x1 ) and (r, φ _x2 ) of the upper left portion 120a and the upper right portion 120b, respectively.
In such a display device 100, since it is desirable to display the image 120 so that the distance r is adjusted according to the position of the object 130, the position is determined by being converted into an orthogonal coordinate system in the real space.
Therefore, the positional relationship between the visual field 110 and the image 120 of the user A is variable, and the position of the image 120 needs to follow the change of the visual field 110.

From such an initial state, there may be a case where the user A suddenly moves to the left or right, and the user A turns his / her neck to the left or right to watch the object 130.
FIG. 7 schematically shows the change of the visual field when the user A performs the turning operation of the neck in the B direction as shown in FIG.
By simply determining the position where the image 120 is to be displayed, the image 120 may not follow the sudden movement as shown in FIG. 6 and FIG. Or, it may be put on the object 130 to be watched.
Such a problem related to the position of the image 120 is a serious problem even when the display position of the image 120 is simply determined when the image is displayed near the center of the field of view 110 as in the prior art. I didn't.
However, when the auxiliary information that supplements the attention information that is the main information is displayed as in the present embodiment, the auxiliary information may be displayed in the peripheral portion of the field of view 110. Since it is desirable, ensuring the visibility of the image 120 has been a problem.

In view of the above problems, in the present embodiment, by performing processing according to the flow shown in FIG. 8, the image 120 is always displayed on the periphery of the field of view 110 without impairing the visibility of the image 120. To do.
First, when the gyro sensor 20 detects that the user A has turned his / her neck from the initial state, the gyro sensor 20 stores the rotation angle θ of the neck (step S549).
At this time, the area determination unit 30 redefines the coordinates φ _s1 , φ _s2 , and φ _s3 of the display area 31 and the display limit area 32 by adding the rotation angle θ, respectively (step S550).
The image position recognition unit 40 compares the redefined coordinate φ _s2 with the initial position (r, φ _x1 ) of the image 120 to check whether φ _s2 <φ _x1 (step S551).
Step S551 is a display position confirmation step for confirming whether the image 120 is not included in the display limit area 32 after the neck is turned.

When it is confirmed in step S551 that the image 120 satisfies φ _s2 <φ _x1 , the correction unit 41 uses φ _x1 and φ _s2 to obtain the difference in declination dφ = necessary for correcting the image 120. φ _x1 −φ _s2 is calculated (step S552).
Such step S552 is a declination calculating step for calculating the declination used for correcting the image 120.

Correcting unit 41 uses the difference dφ deflection angle calculated in step _{S552, φ x1 '= φ x1} -dφ, φ x2' = φ newly obtained phi _x1 as _{x2 -dφ} ', φ _x2' Is updated to φ _x1 and φ _x2 to newly update the position of the image 120 (step S553).

In this manner, by updating the position of the image 120 using the difference dφ in the declination, the position of the image 120 is corrected so as to be within the display area 31 adjacent to the display limit area 32.
Therefore, it is possible to suppress the image 120 from going outside the visual field 110 or to cover the object 130 being watched, and as a result, it is possible to suppress the deterioration of visibility caused by the cause.

Next, consider a case where the object 130 stops and the user A stops turning left and turns right to bring the object 130 to the center of the field of view 110.
At this time, the image position recognition unit 40 first determines whether the width x _{120 of the} image 120 to be displayed is longer or shorter than the width x ₃₁ of the display area 31 (step S554).
In step S554, when x ₃₁ <(φ _x2 −φ _x1 ) is satisfied, the correction unit 41 sets the position of the image 120 to an arbitrary position within the range of the display area 31, and the upper left of the image 120. It is determined whether or not the position coordinates of the part 120a satisfy φ _x1 <φ _s1 (step S555).
When φ _x1 <φ _s1 is satisfied, the difference dφ = φ _s1 −φ _x1 is calculated as in step S552 (step S556).
The declination difference dφ obtained in step S556 represents the declination difference between the boundary on the center side in the visual field 110 of the display area 31 and the image 120. Accordingly, the declination difference is equal to the declination difference. If the image 120 is shifted leftward, the distance between the image 120 and the object 130 can be reduced.
That is, the correction unit 41 updates φ _x1 ′ = φ _x1 + dφ as a new φ _x1 , so that the image 120 always moves so that the position of φ _S1 coincides with the left side of the image 120 (step S557). .
With this configuration, when the width _{x 120} image 120 is shorter than the width _{x 31} in the display area 31, the correction unit 41, the boundary of the image 120 is always a main information display unit 133 and the display region 31 in contact with Correct it so that it is displayed.
With this configuration, since the distance between the object 130 to be watched and the image 120 that is auxiliary information is not unnecessarily separated, the user A can easily visually recognize the object 130 and the image 120 at the same time. Improves.

On the other hand, when the width _{x 120} image 120 is longer than the width _{x 31} in the display area 31, the correction unit 41, the position of the image 120, so that the position of the outer peripheral edge of the display area 31, the image 120 It is determined whether or not the position coordinates of the upper right portion 120b satisfy φ _x2 <φ _s3 (step S558).
In step S558, when φ _x2 <φ _s3 is satisfied, the image 120 is in a state of protruding into the display limit region 32, and thus the correction unit 41 calculates the deviation dφ = φ _s3 −φ _x2 (step S559). .
Correcting unit 41 uses the difference d.phi deflection angle calculated in step _{S559, φ x1 '= φ x1} + dφ, φ x2' = φ x2 + φ newly obtained as dφ _x1 ', φ _x2' a phi _x1, newly updates the position of the image 120 as a phi _x2 (step S560).
With this configuration, the position of the image 120 is always displayed such that the + X side end of the image 120 matches the + X side end of the field of view 110.
With this configuration, when displaying a wide image 120, the overlapping portion of the main information display unit 133 and the image 120 is minimized while preventing the image 120 from going to an invisible position outside the visual field 110. Therefore, the visibility of the image 120 is improved.

  Hereinafter, whenever the gyro sensor 20 detects rotation, the update process as described above is performed.

In the present embodiment, the display device 100 that displays the image 120 in the same field of view 110 as the object 130 that the user A gazes at has the region determination means 30 that determines the region in which the image 120 can move within the field of view 110. doing.
In the present embodiment, the gyro sensor 20 for detecting the rotation of the display device 100 and acquiring the turning information and the image position recognition unit 40 for acquiring the position of the image 120 in the visual field 110 are provided. doing.
Moreover, in this embodiment, it has the correction _| amendment part 41 for correct | _amending position (phi) _x1 , (phi) _x2 so that it may enter in the visual field 110 using turning information.
With this configuration, even when the user A turns his neck and follows the movement of the object 130, the image 120 is prevented from moving out of the field of view and contributes to an improvement in visibility.
That is, in the information display system 500, the auxiliary information is automatically installed at an appropriate position, so that the visibility of the auxiliary information is improved.

In the present embodiment, the gyro sensor 20 acquires the rotation direction of rotation in the three-dimensional coordinate space and the rotation angle θ of rotation as the rotation information.
With this configuration, the correction unit 41 corrects the display positions φ _x1 and φ _x2 of the image 120 in accordance with the rotation angle θ of the neck of the user A, so that the visibility between the object 130 and the image 120 is improved.

In the present embodiment, the gyro sensor 20 acquires turning information for each direction of roll, pitch, and yaw in the three-dimensional coordinate space.
With such a configuration, the display position of the image 120 can be followed even for rotations other than in the horizontal direction, so that the visibility between the object 130 and the image 120 is improved.

In the present embodiment, the display device 100 is a transmissive head mounted display.
With this configuration, the auxiliary information is automatically installed at an appropriate position, so that the user A can simultaneously view the information on the image 120 while looking at the object 130 in the real world, thereby improving the visibility of the auxiliary information. .

Further, as a modification of the information display system 500 of the present embodiment, an example in which a display device 200 that is a non-transmissive head mounted display is used as a display device will be described as shown in FIG.
The display device 200 is an immersive head-mounted display whose main purpose is to allow a user A to wear a virtual reality (VR) that is different from the real world.

In the present embodiment, the display device 200 displays a main image 140 that is main information and an auxiliary image 150 that is auxiliary information.
Also in the present embodiment, the display device 200 can display the auxiliary image 150 in the same field of view as the main image 140 that the user A wants to pay attention to by performing the same processing as in the flowchart shown in FIG. it can.

  The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the specific embodiments, and the present invention described in the claims is not specifically limited by the above description. Various modifications and changes are possible within the scope of the above.

For example, in the above embodiment, the information display system includes a display device. However, the information display software may be configured to instruct only an image position to be displayed on an arbitrary display device. Alternatively, the display device may include an area determination unit, a turn information acquisition unit, a position detection unit, and a position control unit.
In addition, the area determination unit, the turning information acquisition unit, the position detection unit, and the position control unit may be provided in the form of a program stored in an external information processing apparatus or an external storage medium.

In the above embodiment, the spectacle-type display device has been described. However, other configurations may be used.
Further, the auxiliary information may be an image or information such as a symbol or a character, and its form is not particularly limited.

  The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

3 Image display unit 20 Turning information acquisition means (gyro sensor)
30 area determining means 31 movable area (display area)
40 Position detection means (image position recognition unit)
41 Position control means (correction unit)
DESCRIPTION OF SYMBOLS 100 Display apparatus 101 Case part 110 View field 120 Auxiliary information (image)
130 Main information (object)
140 Main information (main image)
150 Auxiliary information (auxiliary image)
500 Information display system A User B Turning direction (turning information)
θ Turning angle (turning information)

Japanese Patent Laid-Open No. 2015-150063

Claims (6)

A region determining means for determining a region in which the auxiliary information is movable within the visual field in the display device that displays the auxiliary information within the same visual field as the main information that the user gazes;
Turning information acquisition means for detecting rotation of the display device and acquiring turning information;
Position detecting means for acquiring the position of the auxiliary information in the visual field;
Position control means for correcting the position so as to enter the region using the turning information;
An information display system. The information display system according to claim 1,
The turning information acquisition means acquires the turning direction of the rotation and the turning angle of the rotation in the three-dimensional coordinate space as the turning information. The information display system according to claim 2,
The turning information acquisition means acquires the turning information for each direction of roll, pitch, and yaw in a three-dimensional coordinate space. The information display system according to any one of claims 1 to 3,
The information display system, wherein the display device displays the main information and the auxiliary information. The information display system according to claim 4,
The information display system, wherein the display device is a non-transmissive head mounted display. The information display system according to any one of claims 1 to 3,
The information display system, wherein the display device is a transmissive head mounted display.

Images