JP6731376B2 - Aerial image projection device and aerial image projection method - Google Patents

Description

The present invention relates to an aerial image projection device and an aerial image projection method.

For example, as a device to be mounted on a display device such as a smartphone, a technology has been proposed that can change the depth of a virtual image seen by an observer without changing the distance between the display device and an optical element that forms a virtual image. .. (Patent Document 1)
Further, a technique has been proposed in which two vibrators attached to the abdomen and the back give a time lag to vibrate them so that the wearer perceives apparent motion such as passing through the abdomen. (Non-patent document 1)

WO2017/038091

Atsushi Watanabe, Kyo Fukuzawa, Hiroyuki Kajimoto, Hideki Ando "Presence of Penetration Sensation Using Apparent Movement through the Abdomen" Transactions of Information Processing Society Vol. 49, No. 10, pp. 3542-3545, 2008.

The light emitted from the display surface of a display device such as a smartphone or a tablet terminal is displayed on the display surface by being reflected by an optical element such as a half mirror or a transparent plate that is inclined with respect to the display surface. There is an aerial image display device that projects a virtual image of a display image into a space.

FIG. 10 is a diagram showing an example of the basic configuration of this type of space image projection apparatus. In the figure, the display surface of the smartphone SP as the display device faces downward, and the opening side of the casing CS of the aerial image projection device is abutted so as to face the display surface. In this casing CS, two half mirrors HM1 and HM2 are installed with an inclination with respect to the display surface of the smartphone SP so that the cross section has an inverted C shape.

An end point (side) of the half mirror HM1 arranged on the side of the viewer AD, which is the user, on the side opposite to the smartphone SP is a base point BP, and is parallel to the display surface of the smartphone SP so that the end point is in contact with the base point BP. The full mirror FM is installed so as to face the half mirror HM1.

As described above, the display surface of the smartphone SP, which is the display device, and the opening side of the casing CS of the aerial image projection device are brought into contact with each other. The display images DI1 and DI2 displayed in the plane are also shown separated from the smartphone SP.

The display image DI1 passes through the half mirror HM1, is reflected by the full mirror FM, is reflected by the half mirror HM1, and is perceived by the viewer AD, whereby the distance D from the display surface of the smartphone SP to the base point BP. Based on the above, the virtual image VI1 can be visually recognized at the position of the depth D by the distance D from the base point BP.

Further, the display image DI2 is reflected by the half mirror HM2, then transmitted through the half mirror HM1, and perceived by the viewer AD, whereby the virtual image VI1 based on the distance dif between the half mirrors HM1 and HM2. Further, it can be visually recognized as a virtual image VI2 at a position further back by a distance dif.

Accordingly, even if the distance dif between the half mirrors HM1 and HM2 is set to be equal to or less than the height D of the virtual images VI1 and VI2, the two virtual images VI1 and VI2 can be visually recognized by the viewer AD without interfering with each other.

However, in the above-described aerial image display device, the only clue for presenting the position of the aerial image such as the virtual images VI1, VI2 and the like is visual information, and the aerial image including the depth direction is displayed to the viewer AD. It was insufficient to show the spatial position and presence.

The present invention has been made in view of the above circumstances, and an object thereof is to aerial images capable of emphasizing the position and existence of a projected aerial image, not only by visual information. A projection device and an aerial image projection method are provided.

According to one embodiment of the present invention, a display portion having a two-dimensional display surface and an optical element in the housing in contact with the display surface are provided, and a virtual image corresponding to an image displayed on the display surface is formed in the housing. An aerial image projection unit that visibly projects from a window provided on one surface of the body, a plurality of first vibrators distributed in the housing, and a position of a virtual image projected by the aerial image projection unit. Accordingly, a vibration control unit that drives the plurality of first vibrators is provided.

According to the present invention, it is possible to emphasize the position and the presence of a projected aerial image without depending only on visual information.

FIG. 1 is a perspective view showing an external configuration of an aerial image projection device according to an embodiment of the present invention. The block diagram which shows the structure of the functional circuit of the smart phone which concerns on the same embodiment. FIG. 6 is a diagram showing an example of generating a sense of localization of a virtual image inside the casing according to the embodiment. FIG. 4 is a diagram showing an example of generating a sense of localization of a virtual image in which a position in the depth direction is also added inside the casing according to the same embodiment. The figure which shows the operation|movement which presents the motion feeling of the 1st Example which concerns on the same embodiment. The figure which shows the operation|movement which presents the localization feeling and the force feeling of the 2nd Example which concerns on the same embodiment. The figure which shows the operation|movement which presents the moving feeling of the depth direction of 3rd Example which concerns on the same embodiment. The figure which shows the operation|movement which presents the feeling of localization and force of several virtual image of 4th Example which concerns on the same embodiment. The figure which shows the operation|movement which presents the feeling of localization and the feeling of force also including the depth direction of the some virtual image of 5th Example which concerns on the same embodiment. The figure which illustrates the basic composition of a general space image projection device.

Hereinafter, the present invention will be described with reference to the drawings by exemplifying a case where a smartphone and a viewer device dedicated to the smartphone are combined to form an aerial image projection device.

[Constitution]
FIG. 1 is a perspective view showing an external configuration of an aerial image projection device according to this embodiment. In the figure, the viewer device 10 is installed by abutting the opening surface of the bottomed cylindrical casing 11 with the display of the smartphone 20 in the figure. Although not shown, the viewer device 10 may be fixed to the smartphone 20 by, for example, a hook-shaped dedicated locking tool provided on the opening side below the casing 11.

The window portion 12 is provided on one side surface on the long side of the four side surfaces of the casing 11. The window portion 12 is made of, for example, a transparent material such as polycarbonate, so that the inside of the casing 11 can be viewed.

Further, transducers 13 and 14 are fixed to the two side surfaces on the short side, which sandwich the side surface of the casing 11 on which the window portion 12 is provided, and are connected to the headphone jack of the smartphone 20 by a cable 15 as described later. It

Similar to the structure shown in FIG. 10, a pair of half mirrors 16 and 17 fixed at an angle inclined to the display surface of the smartphone 20 and one half mirror 16 are sandwiched inside the casing 11. Thus, the full mirror 18 facing the display surface of the smartphone 20 is provided.
Although FIG. 1 illustrates the case where the inside of the smartphone 20 is viewed from the window portion 12 in a state where the display of the smartphone 20 is set to be horizontally long, the window portion 12 is provided on the short side of the side surface of the casing 11 and the two long sides are provided. The vibrators 13 and 14 may be fixedly installed on the side surface. In that case, it is suitable for projecting an image that emphasizes the localization and stereoscopic effect in the depth direction.

Next, the configuration of the functional circuit of the smartphone 20 will be described with reference to FIG. The CPU 21 controls the operation of the entire smartphone 20, and is connected to the main memory 22 and SSD (Solid State Drive) 23 via the bus B.

The CPU 21 expands and stores the OS (operating system) and application programs read out from the SSD 23, various fixed data, and the like on the main memory 22, and then executes the processing according to these programs, whereby the smartphone 20 Control the operation in.

The bus B also includes an imaging unit 24, a voice input/output unit 25, a display unit 26, a touch input unit 27, a vibrator 28, an acceleration sensor 29, a communication unit 30, and a GPS (Global Positioning System) receiving unit. 31 and the external input/output unit 32 are connected.

The imaging unit 24 includes a lens optical system, a solid-state imaging device such as a CMOS imaging device, and an image processing circuit, captures a still image or a moving image, and files the captured image data.

The voice input/output unit 25 decompresses the transmitted voice data as needed, converts the voice data into an analog signal, and causes the speaker unit 33 to raise and emit a sound, while digitizing the voice signal input from the microphone unit 34, and Compress to the audio data file that is needed at the time.

The display unit 26 includes a color liquid crystal panel with a backlight that constitutes the display of the smartphone 20, and a drive circuit for the same. A touch input unit 27 including a transparent electrode plate is provided so as to be integrated with the display unit 26 and outputs coordinate data according to a user's touch operation.

The vibrator 28 is constructed by attaching an eccentric weight to the rotation shaft of the motor, and generates vibration by rotation. The intensity and timing of the vibration by the vibrator 28 are controlled by the CPU 21.

The acceleration sensor 29 detects external force applied to the smartphone 20, for example, by detecting acceleration information in directions of three axes that are orthogonal to each other, and also detects the attitude angle of the smartphone 20 at that time from the direction of gravitational acceleration. ..

The communication unit 30 is compatible with, for example, a third-generation mobile communication system and a fourth-generation mobile communication system, and a wireless LAN system of the IEEE802.11a/11b/11g/11n standard. Sends and receives data to and from LAN routers.

The GPS receiver 31 receives incoming radio waves from a plurality of GPS satellites (not shown) via the GPS antenna 38, and calculates the three-dimensional coordinates of the current position and the current time.

The external input/output unit 32 is connected to, for example, a headphone jack 39, a micro USB (Universal Serial Bus) terminal 40, and a memory card slot 41.

The headphone jack 39 is capable of outputting a stereo analog audio signal, for example, by inserting a plug compatible with a stereo minijack. Further, in the present embodiment, by connecting the cable 15 of the viewer device 10 to the headphone jack 39, it is possible to drive and vibrate the vibrators 13 and 14.

The micro USB terminal 40 performs serial data communication and power supply with an externally connected USB device.

For example, a micro SD card is mounted in the memory card slot 41, and various data is written to and read from the card.

[motion]
Next, the operation of the above embodiment will be described.
In the operation described below, the CPU 21 calculates the position of the virtual image projected in the casing 11 of the viewer device 10 from the position of the display image in the image displayed on the display unit 26, and based on the calculated position. The vibration intensity and pattern (vibration frequency, vibration duration, intermittent time, etc.) of the vibrators 13 and 14 are set, and the vibrators 13 and 14 are connected via the external input/output unit 32, the external input/output unit 32, and the cable 15. 14 is driven.

The control operation by the CPU 21 is realized by reading an application program for aerial image projection stored in the SSD 23, expanding and storing the application program in the main memory 22, and then sequentially executing the program according to the program.

First, a feeling of localization and a feeling of force given to a virtual image in the casing 11 seen from the window 12 of the viewer device 10 will be described.
Basically, the vibration intensity of each of the vibrators 13 and 14 is determined based on the position of the virtual image in the casing 11. The vibration intensity is determined based on the distances from the right and left side surfaces (as viewed from the window 12 side) of the casing 11 in which the vibrators 13 and 14 are installed to the virtual image.

Further, in the vibrator installed on the plane parallel to the moving direction of the virtual image, the vibration intensity is not changed or the vibration intensity is set to “0 (zero)”.

Further, regarding the vibration pattern, particularly the intermittent time of the vibration, the vibration may be continuously performed without providing the intermittent time, or may be performed by providing the predetermined intermittent time.
Furthermore, it is also possible to variably set each parameter of the vibration pattern according to the characteristics of the image itself, for example, how the image moves if it is a living thing, and if it is an animal, audio data such as its footsteps and barks.

When the intermittent time is set, it is possible to emphasize the motion of the image by shortening the intermittent time as the speed of the movement of the image, specifically, the speed or the acceleration of the movement in the image is larger.

Furthermore, in order to emphasize the position of the virtual image, in the case of a virtual image that is separated from the wall surface provided with the vibrator by a certain distance or more, the vibration intensity at the vibrator may be set to “0 (zero)”.

FIG. 3 shows an example of generating a sense of localization of the virtual image BD inside the casing 11.

In the figure, when the vibration intensity of the vibrator 14 is A ₁ , the vibration intensity of the vibrator 13 is A ₂ , and the vibration intensity of the vibrator 28 of the smartphone 20 is A ₃ , the vibration intensity A _n (n=1, n=1, 2, 3) is the following formula
A _n =Σ(w _i /L _n,i (t)) (1)
(However, w _i : reference vibration intensity of the image i (arbitrarily set based on the size of the image, etc.),
L _n,i (t): The distance from the side surface on which the vibrator having the vibration intensity A _n is installed to the image i at a certain time t. )
Given in.

Here, the reference vibration intensity of the virtual image BD is w ₁ , the lateral length of the casing 11 of the viewer device 10 is L _W , the distance from the left side surface of the virtual image BD in the casing 11 is L _1,1 , _Assuming that the distance from the display surface of the smartphone 20 to the virtual image BD is L _3,1 , the required vibration intensities A _{1 to} A ₃ are
A ₁ =w ₁ /L _{1,1
A 2 = w 1 / (L} W -L 1,1)
A ₃ =w ₁ /L _3,1
Becomes

Further, in addition to the arrangement shown in FIG. 4A similar to FIG. 3 above, in order to consider the depth in the casing 11, the side surface provided with the window portion 12 without the vibrators 13 and 14 attached. We also consider the vibration intensity according to the distance from the back side opposite to.

FIG. 4B is a diagram showing the depth direction of the casing 11 as viewed from above, and the distance from the back surface of the virtual image BD is z ₁ . Here, the vibration intensity A _n (n=1, 2, 3) is calculated by the following equation from the above equation (1).
A _n =Σ{z _i (t)w _i /L _D L _n,i (t))} (2)
(However, z _i (t): distance from the back surface of the image i at a certain time point (t),
L _W : lateral length of the casing 11,
L _D : Depth of casing 11. )
Given instead of.

Here, the required vibration intensities A _{1 to} A ₃ are
A ₁ =z ₁ w ₁ /L _D L _{1,1
A 2 = z 1 w 1 /} L D (L W -L 1,1)
A ₃ =z ₁ w ₁ /L _D L _3,1
Becomes

In this way, including the vibrator function of the smartphone 20, the vibration intensity and the pattern are adjusted by at least two or more vibrators, for example, the vibrators 13 and 14, in accordance with the position and the direction of movement of the virtual image. Let In this case, the plurality of vibrators may not only vibrate at the same time, but may vibrate with a certain time difference, and the drive patterns thereof can be appropriately selected.

As a result, a feeling of orientation in the casing 11 of the viewer device 10, a feeling of presence of something at a certain position inside the casing 11, a feeling of exertion of force, and something inside the casing 11 moved. The sense of motion is generated in any direction and at any position. By combining these tactile sensations with the visual image, the position and presence of the virtual image can be emphasized.

(First embodiment)
Next, some examples of more specific vibration intensity and vibration pattern will be described.
FIG. 5 uses the principle of “tactile apparent motion” in which when two points are subjected to a tactile stimulus with a certain time difference, the motion between them is perceived, and the instantaneous inside of the casing 11 is synchronized with the motion of the visual image. The case where a sense of movement is presented is shown.

In FIG. 5A, the vibration timing T=0 [seconds] in the left vibrator 14 and the vibration timing T=0.2 [seconds] in the right vibrator 13 are used to vibrate with the same vibration intensity. Exemplifies a case where the virtual image moves from the left side to the right side as indicated by the arrow in the figure.

In FIG. 5B, two vibration timings T=0 [seconds] and 0.1 [seconds] on the left vibrator 14, and vibration timing T=0.2 [seconds] on the right vibrator 13 are shown. As a result, by vibrating with the same vibration intensity, the left side vibrator 14 is vibrated twice in succession to emphasize the left side more, and from the second vibration in the vibrator 14, the vibrator 13 is vibrated. The case where the virtual image moves from the left side to the right side as illustrated by the arrow in the figure during the vibration in FIG.

In FIG. 5C, the vibration timing T=0 [seconds] is set for both the left-side vibrator 14 and the right-side vibrator 13, and the same vibration timing T=0.2 [seconds] is set by the vibrator 28 of the smartphone 20. The case where the virtual image is moved from above to below the left and right neutral position as shown by the arrow in the drawing by vibrating with the vibration intensity is illustrated.

FIG. 5D shows that the vibration timing T=0 [seconds] by the vibrator 28 of the smartphone 20 and the vibration timing T=0.2 [seconds] of the vibrator 13 on the right side are used to vibrate with the same vibration intensity. , The case where the virtual image moves diagonally upward from the lower left to the upper right as indicated by the arrow in the figure.

As shown in these figures, by successively vibrating multiple points with the same vibration intensity with a certain time difference, it is possible to perceive the planar movement of the image by the haptic apparent motion, so By vibrating with a time difference between the two points due to the above-mentioned time difference in conjunction with the movement of the image, the position and existence of the projected image can be emphasized.

(Second embodiment)
Fig. 6 uses the principle of "phantom sensation" in which when two points are simultaneously subjected to tactile stimulation with a constant intensity difference, they are localized at a position corresponding to the difference in intensity. 11 shows a case where a sense of localization and a sense of power are presented inside 11.

6A, the vibrator 14 on the left side, the vibrator 13 on the right side, and the vibrator 28 of the smartphone 20 are simultaneously vibrated with a vibration intensity of 5 at a vibration timing T=0 [seconds]. An example is shown in which by giving the seismic intensity at the same point and at the same vibration intensity at three points, a sense of localization is generated at the lower center of the screen between the three points as shown in the virtual image BD. ..

On the other hand, in FIG. 6B, from the state of FIG. 6A, the vibration timing T=0 [sec] is set for the left vibrator 14 and the right vibrator 13, respectively, and the vibration strength is 5 at the same time. The case where it is vibrated is shown. Compared to the case shown in FIG. 6A, the vibration of the vibrator 28 of the smartphone 20 below is not applied. Therefore, a feeling of weight is given, and the virtual image BD has a low feeling of localization toward the bottom of the screen, and a case where a feeling of localization slightly raised is generated.

Further, FIG. 6C shows a state in which the vibrator 14 on the left side and the vibrator 13 on the right side are simultaneously vibrated at a vibration intensity of 5 with the vibration timing T=0 [seconds] from the state of FIG. 6B. , A case where the vibrator 28 of the smartphone 20 vibrates at a vibration intensity of 2 with a time difference of vibration timing T=0.2 [seconds].

Compared with the case shown in FIG. 6(B), a weak vibration is given to the vibrator 28 of the smartphone 20 below with a time lag. Therefore, for example, when a character appears in the image, when landing by jumping, or the like, a sense of localization is generated when expressing downward movement with respect to the virtual image BD as indicated by an arrow in the figure. It is illustrated.

In the subsequent FIG. 6D, from the state of FIG. 6C, the vibration intensity of the left vibrator 14 is vibration timing T=0 [seconds], and the vibration of the right vibrator 13 is vibration timing T=0 [seconds]. ] As the vibration intensity of 5, and the vibrator 28 of the smartphone 20 vibrates at the vibration intensity of 4 with a time difference of vibration timing T=0.1 [sec].

Compared with the case shown in FIG. 6C, the vibrator 13 on the right side has a larger vibration intensity at the vibration timing T=0 [seconds], and the smartphone 20 below has a time difference thereafter. The vibrator 28 also vibrates with a value greater than the vibration intensity of the left vibrator 14. Therefore, a sense of localization is generated such that the virtual image BD, which is located slightly to the right of the center in the left and right, further moves in the lower right direction as indicated by the arrow in the figure.

As shown in these figures, when two points are simultaneously subjected to tactile stimuli with a constant intensity difference, they are localized at positions corresponding to the intensity difference, and a sense of localization and a sense of force of the virtual image BD can be presented. ..

(Third embodiment)
FIG. 7 shows a case where a sense of movement in the depth direction is presented.

When the vibration intensity is reduced as the projected virtual image BD becomes smaller while generating intermittent vibrations at fixed time intervals, the virtual image BD moves from the near side to the far side by the perspective method. You can get the spacing as you are doing.

On the contrary, when the vibration intensity is increased as the projected virtual image BD becomes larger while generating intermittent vibration at constant time intervals, the virtual image BD moves from the back to the front by the perspective method. You can get the distance as if you were moving towards you.

FIG. 7 shows a presentation example of the former case in which the virtual image BD moves from the front to the back. In the initial case of FIG. 7A, both the left-side vibrator 14 and the right-side vibrator 13 are set to have a vibration intensity of 5 at the vibration timing T=0 [seconds] and the vibrator 28 of the smartphone 20 does not vibrate. An example of projection of the virtual image BD is shown. The virtual image BD is largely projected on the center of the screen of the window unit 12.

After that, as shown in FIG. 7B, both the left-side vibrator 14 and the right-side vibrator 13 have a vibration intensity of 3 at the vibration timing T=0.2 [sec], and the vibration of the vibrator 28 of the smartphone 20 is None At this time, the virtual image BD in the window portion 12 is projected in the center of the screen smaller than in the case of FIG. 7A.

Further, as shown in FIG. 7C, both the left-side vibrator 14 and the right-side vibrator 13 have a vibration intensity of 1 at the vibration timing T=0.4 [seconds], and there is no vibration in the vibrator 28 of the smartphone 20. And At this time, the virtual image BD in the window portion 12 is projected in the center of the screen to be smaller than that in the case of FIG. 7B.

In this way, by controlling the size of the projected virtual image BD and the vibration intensity in association with each other, a sense that the virtual image BD moves toward the front side or the back side along the depth direction is presented by the perspective method. it can.

Further, when performing projection such that the virtual image BD moves to the front side or the back side along the depth direction, not only the signal intensity but also the vibration frequency when the virtual image BD approaches the front side, for example, It is possible to more strongly present the sense of localization in the perspective by controlling the vibration frequency according to the direction, such as setting the vibration frequency to be high, and to set the vibration frequency to be low when moving away from the interior.

(Fourth embodiment)
FIG. 8 shows a case where a feeling of localization and a feeling of force within a casing 11 of a plurality of virtual images are presented. When a plurality of virtual images are projected in the casing 11, the weight parameter w that is the reference vibration intensity of each virtual image is set, and the vibration intensity is set in consideration of the distance from the side surface of the casing 11 to obtain a plurality of virtual images. Present a sense of localization.

Here, the weight parameter w may be determined from the size of the virtual image or the amplitude level of the sound emitted from the virtual image.

If possible, the vibration frequencies corresponding to each of the virtual images should be different so that changes in the vibration pattern when the virtual images move differently can be identified and perceived as tactile stimuli. Is desirable.

FIG. 8 is a diagram illustrating the respective vibration intensities of the vibrators 13 and 14 and the vibrator 28 of the smartphone 20 when the two virtual images BD1 and BD2 are simultaneously projected. As shown in the figure, the weight parameter of the virtual image BD1 projected on the left side of the window portion 12 is w ₁ , the weight parameter of the virtual image BD projected on the right side thereof is w _2, and the lateral length of the casing 11 is set. Is L _W , the distance from the left side surface of the casing 11 to the virtual image BD1 is L ₁ , and the distance to the virtual image BD2 is L ₂ . The vibration intensity of the vibrator 28 of the smartphone 20 is “w ₁ +w ₂ ”as illustrated.

In this case, the vibration intensity A ₁ on the left side of the vibrator 14, vibration intensity A ₂ in the right transducer 13 is expressed by the following equation
A ₁ =w ₁ /L ₁ +w ₂ /L _{2
A 2 = w 1 / (L} W -L 1) + w / (L W -L 2)
It is represented by.

In this way, also in the plurality of virtual images BD1 and BD2, the vibration intensity that gives the optimum sense of localization is calculated and set from the weight parameter that is the reference vibration intensity and the positional relationship in the lateral direction thereof. can do.

(Fifth embodiment)
By multiplying the weight parameter w, which is the reference vibration intensity in the fourth embodiment, by a coefficient based on the position of the casing 11 in the depth direction, it is reflected in the vibration intensity of each transducer in consideration of the position in the front-rear direction. Then, it is possible to present a sense of localization that matches the virtual images BD1 and BD2.

That is, in addition to the arrangement shown in FIG. 9A similar to FIG. 8 above, in order to consider the depth in the casing 11, a side surface provided with the window portion 12 without the vibrators 13 and 14 attached. We also consider the vibration intensity according to the distance from the back side opposite to.

FIG. 9B is a diagram showing the depth direction of the casing 11 as viewed from above, where the distance from the back surface of the virtual image BD1 is d ₁ and the distance from the back surface of the virtual image BD2 is d ₂ . From the weight parameters w ₁ and w ₂ of the virtual images BD1 and BD2,
W ₁ =w ₁ d ₁ /(d ₁ +d ₂ )
W ₂ =w ₂ d ₂ /(d ₁ +d ₂ )
Can be derived.

From these W ₁ and W ₂ , the required vibration intensities A ₁ and A ₂ are
A ₁ =W ₁ /L ₁ +W ₂ L _{2
A 2 = W 1 / (L} W -L 1) + W 2 / (L W -L 2)
Can be calculated by

As described above, in the plurality of virtual images BD1 and BD2, the vibration intensity that gives the optimum sense of localization in the three-dimensional space from the weight parameter that is the reference vibration intensity, the position in the lateral direction, and the position in the depth direction. Can be calculated and set.

[Effect of Embodiment]
As described above in detail, according to the present embodiment, it is possible to emphasize the position and the presence of the projected aerial image, not only the visual information.

Further, in the above-described embodiment, not only the pair of vibrators 13 and 14 provided in the casing 11 but also the vibrator 28 of the smartphone 20 is used as a vibrator, so that the virtual image BD(, It is possible to more reliably present the sense of localization and the sense of force by BD1 and BD2).

In addition, although the said embodiment demonstrated the case where a smart phone and the viewer apparatus for the said smart phone are combined and it comprises an aerial image projection apparatus, this invention is not limited to such a structure, and an aerial image projection for exclusive use. It can be realized by various configurations such as a device, an aerial image projection device in which a portable game terminal device and a viewer device are combined.

In addition, the present invention is not limited to the above-described embodiment, and can be variously modified in an implementation stage without departing from the scope of the invention. Further, the respective embodiments may be appropriately combined and implemented, in which case the combined effects can be obtained. Further, the above-described embodiment includes various inventions, and various inventions can be extracted by a combination selected from a plurality of disclosed constituent features. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, if the problem can be solved and the effect can be obtained, the structure in which the constituent elements are deleted can be extracted as the invention.

10... Viewer device, 11... Casing, 12... Window part, 13, 14... Oscillator, 15... Cable, 16, 17... Half mirror, 18... Full mirror, 20... Smartphone, 21... CPU, 22... Main memory, 23 ...SSD, 24... Imaging section, 25... Voice input/output section, 26... Display section, 27... Touch input section, 28... Vibrator, 29... Acceleration sensor, 30... Communication section, 31... GPS receiving section, 32... External input Output part, 33... Speaker part, 34... Microphone part, 35-37... Antenna, 38... GPS antenna, 39... Headphone jack, 40... Micro USB terminal, 41... Memory card slot, B... Bus, BD, BD1, BD2 … Virtual image.

Claims (8)

A display unit having a two-dimensional display surface,
An aerial image projection unit, in which an optical element is provided in the housing in contact with the display surface, and a virtual image corresponding to an image displayed on the display surface is projected visibly through a window provided on one surface of the housing. When,
A plurality of first vibrators distributed in the housing,
An aerial image projection device comprising: a vibration control unit that drives the plurality of first vibrators according to the position of a virtual image projected by the aerial image projection unit. The display unit has a second vibrator,
The vibration control unit drives the plurality of first vibrators and the second vibrator according to the position of the virtual image projected by the aerial image projection unit.
The aerial image projection device according to claim 1. The aerial image projection device according to claim 1, wherein the vibration control unit drives the vibrators with mutually different vibration intensities according to a position of a virtual image projected by the aerial image projection unit. 3. The aerial image projection device according to claim 1, wherein the vibration control unit drives each of the vibrators by changing its vibration intensity with time according to the moving direction of the virtual image projected by the aerial image projection unit. .. The vibration control unit drives each of the vibrators by changing at least one of the vibration intensity and the vibration frequency according to the vibration intensity and the position of the reference of the virtual image projected by the aerial image projection unit. 1. The aerial image projection device according to 1 or 2. 3. The vibration control unit drives each of the vibrators by changing at least one of vibration intensity and vibration frequency according to attribute information preset on the virtual image projected by the aerial image projection unit. The aerial image projection device described. The vibration control unit drives the respective vibrators with different vibration intensities in accordance with at least one of a reference vibration intensity and a positional relationship of each of the plurality of virtual images projected by the aerial image projection unit. Item 3. The aerial image projection device according to item 3. A window having a display unit having a two-dimensional display surface, an optical element provided in the housing in contact with the display surface, and a virtual image corresponding to an image displayed on the display surface provided on one surface of the housing. An aerial image projection method executed by an apparatus including an aerial image projection unit for visibly projecting from a unit, and a plurality of transducers distributed in the housing,
An aerial image projection method comprising a vibration control step of driving the plurality of transducers according to the position of a virtual image projected by the aerial image projection unit.