JP2016075923A - Image presentation device, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image presentation device and method capable of presenting an index image easy to view for a viewer while precisely superimposing an index image over a landscape.SOLUTION: An image presentation device 1 presents a landscape which a viewer 100 is viewing while superimposing an index image (for example, an arrow head) representing a target position etc. The measurement section 12 measures vibrations of the image presentation device 1 which is generated from movement of the viewer 100. When a control unit 132 determines the period of the measured vibrations satisfies a predetermined condition, the control unit controls to change the visibility of the index image, which is generated by a generation part 11 to be lower, and controls a presentation section 14 to present the changed index image for a certain period of time.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to an image presentation apparatus, a method, and a program.

There are image presentation apparatuses such as a head-up display (HUD) and a head-mounted display (HMD) that superimpose and present an index image indicating a target position or the like on a landscape viewed by an observer. In such an image presentation device, it is desirable to reduce the blurring of the index image due to vibrations that occur when the observer moves (when walking, driving the vehicle, etc.) and present the index image with high accuracy.

Some conventional image presentation apparatuses attempt to reduce blurring of an index image by blurring the index image or erasing part of the index image when vibration is detected. However,
Since it often vibrates during movement, there is a problem that it becomes difficult to see the index image.

JP 2005-215879 A

The problem to be solved by the invention is to provide an image presentation apparatus, method, and program capable of accurately superimposing an index image on a landscape and presenting an index image that is easy to see for an observer.

In order to solve the above problems, an image presentation apparatus for presenting an image according to an embodiment of the present invention includes:
In accordance with the vibration of the image presentation device, the form of the image is changed within a time when the image is perceived as a manifestation motion.

1 is a block diagram illustrating an image presentation device 1 according to a first embodiment. 4 is a flowchart showing processing of the image presentation device 1. An example figure of a measurement graph of time change of inclination of observer's 100 head. The figure showing the coordinate system on the basis of the observer's 100 head. 5 is a flowchart showing processing of a determination unit 131. An example figure showing the experimental result of a manifestation exercise. Explanatory drawing of an index image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

In the present specification and drawings, the same elements as those described above with reference to the previous drawings are denoted by the same reference numerals, and detailed description thereof is omitted as appropriate.

(First embodiment)
The image presentation apparatus 1 according to the first embodiment is suitable for a head mounted display (HMD) that can be mounted on the head of the observer 100, AR (augmented reality) glasses, and the like.

The image presenting apparatus 1 presents an index image (for example, an arrow) indicating a target position and the like superimposed on the scenery that the observer 100 is viewing. The image presentation device 1 sequentially generates and presents the index images so that the index image advances to the target position as viewed from the observer 100.

The image presentation device 1 estimates the vibration period when the observer moves, and when the vibration period is within a predetermined range, the visibility of the index image to be presented is reduced for a certain period of time. Thereby, the blurring of the index image felt by the observer 100 can be reduced.

FIG. 1 is a block diagram showing an image presentation device 1. The image presentation device 1 includes an estimation unit 10,
A generation unit 11, a measurement unit 12, a change unit 13, a presentation unit 14, and a storage unit 51 are provided.

  The storage unit 51 stores geographic information such as a map.

The estimation unit 10 estimates the current position of the observer 100. For example, the estimation unit 10 includes the storage unit 5
1 and GPS (Global Positioning Sy)
stem), the current position may be estimated.

The estimation unit 10 determines whether or not the observer 100 has approached the target position based on the estimated current position and map information. For example, the observer 100 may set the target position in advance.

When the observer 100 approaches the target position, the generation unit 11 sequentially generates index images that are perceived to advance to the target position. At this time, the generation unit 11 estimates the eye position and the line-of-sight direction of the observer 100. The generation unit 11 generates an index image so as to be superimposed on the target position from the eye position and the line-of-sight direction.

The measurement unit 12 measures the vibration of the image presentation device 1 generated by the movement of the observer 100.
In the present embodiment, the measurement unit 12 measures vibration by detecting a temporal change in the tilt of the observer 100 head in the lateral direction. The measurement unit 12 uses an acceleration sensor or the like, for example,
You may detect the time change of the inclination of the observer's 100 head.

The change unit 13 includes a determination unit 131 and a control unit 132. The determination unit 131 determines whether the measured vibration period satisfies a predetermined condition. Details will be described later.

When it is determined that the measured vibration period does not satisfy the predetermined condition, the control unit 132 controls the presentation unit 14 so that the index image generated by the generation unit 11 is presented.

When it is determined that the measured vibration period satisfies the predetermined condition, the control unit 132 changes the index image generated by the generation unit 11 so that the visibility is low. The control unit 132 controls the presentation unit 14 so as to present the changed index image for a certain period of time. Details will be described later.

The presentation unit 14 presents the index image by projecting a light beam in the shape of the index image toward the eyes of the observer 100.

The presentation unit 14 includes a light source 141, a light beam limiting unit 142, a diffusion unit 143, and an image forming unit 14.
4, a first lens 145, an opening 146, a second lens 147, and a reflector 148.

When the focal length of the first lens 145 is f1 and the focal length of the second lens 147 is f2, the opening 146 is disposed at a distance of f1 from the first lens 145 and at a distance of f2 from the second lens 147. It is desirable to be done.

The light beam emitted from the light source 141 is in a state where the traveling direction is limited by the light beam limiting unit 142,
The light enters the image forming unit 144 including the diffusing unit 143. The light beam is diffused by the diffusing unit 143 and can uniformly enter the image forming unit 144. The image forming unit 144 forms a light beam having the shape of an index image by partially transmitting or blocking the light beam.

The light flux that has passed through the image forming unit 144 is the first lens 145, the opening 146, and the second lens 14.
Pass 7 The light beam is reflected by the reflector 14 in a state where the divergence angle (the angle at which the light beam spreads) is controlled.
8 is incident. The reflector 148 reflects the light beam toward the eyes of the observer 100.

Since the image forming unit 144 is closer to the light source 141 than the opening 146, the opening 146 is provided.
As compared with the case where is located on the light source 141 side with respect to the image forming unit 144, the transmittance of the light beam passing through the image forming unit 144 can be increased. Therefore, the power consumption of the light source 141 can be suppressed.

As the light source 141, a light emitting diode, a high-pressure mercury lamp, a halogen lamp, a laser, or the like is used. A taper light guide is used for the light beam limiting unit 142, a diffusion filter or a diffusion plate is used for the diffusion unit 143, and a liquid crystal display or a digital mirror device is used for the image forming unit 144.

The estimation unit 10, the generation unit 11, the measurement unit 12, and the change unit 13 are a central processing unit (C
PU) and a memory used by the CPU. The storage unit 52 may be realized by a memory used by the CPU or an auxiliary storage device.

  The configuration of the image presentation device 1 has been described above.

FIG. 2 is a flowchart showing processing of the image presentation device 1. The estimation unit 10 estimates the current position (S101). Based on the estimated current position and map information, the estimation unit 10
It is determined whether or not the observer 100 has approached the target position (S102). For example, the estimation unit 10
When the distance from the viewer 100 to the target position is equal to or less than a predetermined threshold, the viewer 10
It may be determined that 0 has approached the target position.

When the observer 100 has not approached the target position (S102: NO), the determination in step S102 is continued until the observer 100 approaches the target position.

When the observer 100 approaches the target position (S102: YES), the generation unit 11 sequentially generates index images that are perceived to advance to the target position (S103).

The measurement unit 12 measures the period of vibration of the image presentation device 1 generated by the movement of the observer 100 (S104).

The determination unit 131 determines whether or not the measured vibration period satisfies a predetermined condition (S1).
05).

When it is determined that the measured vibration period does not satisfy the predetermined condition (step S105)
: NO), the control unit 132 controls the presentation unit 14 so that the index image generated by the generation unit 11 is presented (S106).

When it is determined that the measured vibration period satisfies a predetermined condition (step S105: Y
ES), the control unit 132 changes the index image generated by the generation unit 11 so that the visibility is low. The control unit 132 controls the presentation unit 14 to present the changed index image for a certain time (S107).

The presentation unit 14 presents the index image by projecting the luminous flux in the shape of the index image toward the eyes of the viewer 100 (S108), and ends the process.

  The processing of the image presentation device 1 has been described above.

  Hereinafter, this embodiment will be described in detail.

The measurement unit 12 includes a sensor (tilt sensor) that can measure a temporal change in the tilt of the head of the observer 100. As the tilt sensor, for example, an acceleration sensor can be applied. That is, the measurement unit 12 may measure the temporal change of the rotation angle in the horizontal direction (left-right direction) of the head of the observer 100 using an inclination sensor.

FIG. 3 is an example of a measurement graph of the temporal change in the tilt of the head of the observer 100. In FIG. 3, the horizontal axis represents time. The vertical axis represents the rotation angle in the horizontal direction (left-right direction) of the head of the observer 100. FIG. 4 shows a coordinate system based on the head of the observer 100. When a coordinate system as shown in FIG. 4 is defined, the vertical axis of the measurement graph shown in FIG. 3 represents the rotation angle of the y axis.

Using the y-axis rotation angle obtained from the tilt sensor, the measurement unit 12 obtains a change time ts that is a time at which the direction of the time change of the rotation angle changes. In other words, the change time ts is shown in FIG.
The time corresponding to “mountain” and “valley” in the waveform of the measurement graph shown in FIG. The measurement unit 12 uses the change time ts as the start time when the control unit 132 changes the form of the index image for a certain time. For example, the measurement unit 12 may obtain a time satisfying Equation 1 as the change time ts.

Here, r (ts) represents the rotation angle of the head of the observer 100 at the change time ts.
Δt represents a preset minute time.

Note that a time after a predetermined time from the obtained change time ts may be set as a new change time ts. A change point of an axis other than the y axis may be set as the change time ts. In addition, the measurement unit 12
In addition to the tilt sensor, a motion sensor that can detect the movement of the foot of the observer 100 may be used. In this case, the measurement unit 12 may obtain the time when the viewer's 100 foot has landed as the change time ts.

The measurement unit 12 calculates the period T from the difference between the change time ts and the change time ts of the immediately preceding time.
The measurement unit supplies the change time ts and the period T to the determination unit 131 and the control unit 132.

FIG. 5 is a flowchart showing processing of the determination unit 131. The determination unit 131 determines whether or not the degree of time change (time change amount) of the period T is equal to or less than a predetermined threshold (S201). When the determination in step S201 is NO, the determination unit 131 determines to delete the indicator image display (S202).

When the determination in step S201 is YES, the determination unit 131 determines whether the cycle T is equal to or less than a predetermined threshold (S203). If the determination in step S203 is yes, the process transitions to step S202.

When the determination in step S203 is NO, the determination unit 131 determines whether or not the elapsed time from the change time ts to the current time is equal to or less than a predetermined threshold (S204).

When the determination in step S204 is NO, the determination unit 131 determines not to change the form of the index image (S205). When the determination in step S204 is YES, the determination unit 131 determines to change the form so as to reduce the visibility of the index image (S206).
).

Processing performed by the control unit 132 when the determination unit 131 determines to change the form so as to reduce the visibility of the index image will be described below.

The control unit 132 changes the form of the index image so that the visibility of the index image is lowered for a predetermined time from the change time ts. For example, the control unit 132 may reduce the visibility of the index image by reducing the brightness of the index image. Alternatively, the control unit 132 may reduce the visibility of the index image by eliminating a part of the index image.

The set fixed time may be set within a range where the apparent movement occurs. The apparent motion is a motion in which an object appears to move due to an illusion of human eyes even if the object (an index image in the present embodiment) disappears. It is generally said that the limit time for the apparent movement to occur is about 200 milliseconds.

FIG. 6 is an example diagram showing experimental results of the apparent movement. In this figure, when the display of the moving index image is erased for “display erasure time”, the position where the observer 100 has the illusion that there is an index image and the actual position when the index image is not erased are shown. This is an experimental result obtained by measuring the error of a plurality of subjects. From this figure, it can be seen that by deleting the index image between 0 ms and 200 ms, there is little error from the position of the index image illusioned by the observer 100.

The control unit 132 supplies the indicator image whose form has been changed for a certain period of time so that the visibility is lowered to the presentation unit 14 and controls the presentation unit 14. In addition, the control part 14 supplies to the presentation part 14 without changing the form of the supplied parameter | index image after a fixed time. In addition, when the cycle is smaller than the threshold, the control unit 132 may supply the presentation unit 14 with an index image whose form has been changed so as to reduce the visibility of the index image. In addition, the control unit 132 stores the period in time series, and when the time when the time series difference is equal to or less than the threshold does not continue for a certain time or longer, the index whose form is changed so as to reduce the visibility of the index image An image may be supplied to the presentation unit 14.

FIG. 7 is an explanatory diagram showing the index images presented with low visibility in time series. For example, by deleting for a certain period from the time when the left foot or the right foot has landed, an index image that is easy to see can be presented to the observer.

According to the present embodiment, the index image can be accurately superimposed on the landscape and the index image that is easy to see for the observer can be presented.

Although the present embodiment has been described on the assumption that an index image using an object to be displayed for navigation is used, it may be an object that is displayed in an augmented reality at a specific position in the real world, such as an electronic pet or play equipment for entertainment. If applicable.

Note that the image presentation device 1 according to each of the above-described embodiments can be realized, for example, by using a general-purpose computer device as basic hardware. That is, the components that the image presentation device 1 should have can be realized by causing a processor mounted on the computer device to execute a program. At this time, the image presentation device 1
The above program may be realized by installing it in a computer device in advance, or it may be stored in a storage medium such as a CD-ROM or distributed through a network and the program may be distributed to the computer device. You may implement | achieve by installing suitably. Further, it can be realized by appropriately using a memory, a hard disk, or a storage medium such as a CD-R, a CD-RW, a DVD-RAM, a DVD-R, or the like, which is built in or externally attached to the computer device.

Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Image presentation apparatus 10 ... Estimation part 11 ... Generation part 12 ... Measurement part 13 ... Change part 14 ... Presentation part 131 ... Determination part 132 ... Control part 141 ... Light source 142 ... Flux limiting part 143 ... Diffusion part 144 ... Image forming part 145 ... First lens 146 ... Opening part 147 ... Second lens 148 ... Reflecting plate

Claims (9)

An image presentation device for presenting an image,
In response to the vibration of the image presentation device, the form of the image is changed within a time when the image is perceived as a manifestation motion.
Image presentation device. Changing the form of the image within a time when the image is perceived as an apparent motion when the vibration satisfies a predetermined condition;
The image presentation apparatus according to claim 1. Changing the form of the image for a certain period of time so that the visibility of the image is reduced within the time when the image is perceived as an apparent motion;
The image presentation apparatus according to claim 1 or 2. A measurement unit for measuring the vibration;
The image presentation apparatus according to claim 1. An image presentation unit for presenting the image;
The image presentation apparatus according to claim 1. The presenting unit presents an image indicating a target position to an observer;
The image presentation apparatus according to claim 5. An image presentation method for presenting an image by an image presentation device,
In response to the vibration of the image presentation device, the form of the image is changed within a time when the image is perceived as a manifestation motion.
Image presentation method. An image presentation program for presenting an image by an image presentation device,
Computer
In response to vibration of the image presentation device, the image functions as a means for changing the form of the image within a time period that is perceived as a manifestation motion.
Image presentation program. A generator for generating an image to be presented to the observer;
A measurement unit for measuring the vibration of the observer;
A determination unit for determining whether or not the vibration satisfies a predetermined condition;
When the vibration satisfies the predetermined condition, a control unit that changes the form of the image for a certain period of time within a time when the image is perceived as an apparent motion;
An image presentation device comprising:

Images