JP2019061058A - Stereoscopic display device, stereoscopic display method, and stereoscopic display program - Google Patents

Abstract

To provide a stereoscopic display device, a stereoscopic display method, and a stereoscopic display program that allow viewers to observe with naked eye and do not generate aberration.SOLUTION: A stereoscopic display device includes at least an imaging optical element for forming an image on one surface side in a space on another surface side; a transmission type display capable of displaying a plurality of images for at least a right eye and a left eye displaced on the one surface side; and a plurality of light sources capable of separating so as to optically correspond to positions of left and right eyes disposed on the one surface side. Thereby, the stereoscopic display device switches and images different images for the right eye and left eye on the other surface side and generates binocular parallax.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a stereoscopic display device, a stereoscopic display method, and a stereoscopic display program.

  Conventionally, there has been proposed a display device in which a real image (real mirror image) of an object to be observed is formed in the air by using an imaging optical element so that an observer can view.

  For example, in Patent Documents 1 and 2, a flat panel display is disposed on one surface side of an imaging optical element such as a micro mirror array, and is obtained as a planar spatial image rising obliquely in the space on the other surface side. A display for imaging is disclosed.

  In addition, Non-Patent Document 1 discloses an aerial projection autostereoscopic display capable of presenting motion parallax with the naked eye using a Fresnel lens, an LCD, and a transparent liquid crystal display.

Unexamined-Japanese-Patent No. 2014-126863 JP 2014-106354 A

Nii, Hideaki, et al. “Fuwa-Vision: an auto-stereoscopic floating-image display.” SIGGRAPH Asia 2012 Emerging Technologies. ACM, 2012.

  However, display devices using conventional imaging optical elements such as Patent Documents 1 and 2 only form a planar image of a display disposed on one surface side in many planes, It had the problem that it was not a display.

  In addition, although conventional stereoscopic display devices such as Non-Patent Document 1 can generate parallax to enable stereoscopic display with the naked eye, when attempting to increase the size, distortion of the image is caused by the aberration of the lens mechanism such as the Fresnel lens. And there is a problem that seamless three-dimensional display can not be performed.

  The present invention has been made in view of the above problems, and provides a stereoscopic display, a stereoscopic display method, and a stereoscopic display program that can be observed with the naked eye and in which no aberration occurs.

  In order to achieve such an object, in the stereoscopic display device of the present invention, an imaging optical element for forming an image on one surface side in a space on the other surface side, and at least for right eye and left eye disposed on the one surface side At least a transmissive display capable of displaying a plurality of images, and a plurality of light sources disposed on the one surface side and capable of being separated so as to correspond optically to the positions of the left and right eyes. Thus, different images for the right eye and for the left eye are switched and imaged on the other surface side to generate binocular parallax.

  In the stereoscopic display according to the present invention, in the above-mentioned stereoscopic display, the imaging optical element is a micro mirror array.

  The stereoscopic display device of the present invention is characterized in that the stereoscopic display device described above further includes a motion capture device for measuring the positions of the left and right eyes.

  In the 3D display device according to the present invention, in the above 3D display device, an image formed on the other surface side of the light source may be incident on one eye but incident on the other eye. It is characterized in that it has a width that does not

  Further, in the stereoscopic display device according to the present invention, in the above-mentioned stereoscopic display device, the width is narrowed when the position of the eye is separated from the focus that can be imaged in the space on the other surface side. .

  Further, according to the stereoscopic display device of the present invention, in the above-described stereoscopic display device, the plurality of light sources are three-dimensionally disposed as a multilayer structure.

  Further, according to the three-dimensional display method of the present invention, an imaging optical element for forming an image on one surface side in a space on the other surface side, a transmissive display arranged on the one surface side and capable of displaying a plurality of images. A three-dimensional display method implemented in a three-dimensional display device further comprising a plurality of light sources disposed on the one surface side and capable of being spaced apart so as to correspond optically to the positions of the left and right eyes. In the case where the light source optically corresponding to the position of one of the eyes is turned on, the step of displaying an image for one eye on the transmissive display, and the step of optically corresponding to the position of the other eye In the case where the light source is turned on, the method further comprises the step of displaying the image for one eye and the image for the other eye having binocular parallax.

  The three-dimensional display program according to the present invention comprises an imaging optical element for forming an image on one surface in a space on the other surface, and a transmissive display disposed on the one surface and capable of displaying a plurality of images. Furthermore, a stereoscopic display program for causing a stereoscopic display device provided with a plurality of light sources, which is disposed on the one surface side and can be separated to optically correspond to the positions of the left and right eyes. In the case where the light source optically corresponding to the position of one of the eyes is turned on, the step of displaying an image for one eye on the transmissive display and the position of the other eye are optically corresponded When the light source is turned on, a step of displaying an image for one eye and an image for the other eye having binocular parallax is performed.

  According to the present invention, since it is possible to observe with the naked eye and generate no aberration, and stereoscopic display is performed, there is an effect that seamless stereoscopic display can be performed even when the size is enlarged.

FIG. 1 is a view showing an example of a configuration devised by the present inventors as an embodiment of the present invention. FIG. 2 is a block diagram showing an example of the configuration of the stereoscopic display 100 to which the present embodiment is applied. FIG. 3 is a flowchart showing an example of processing in the stereoscopic display device 100 of the present embodiment. FIG. 4 is a view showing the appearance of an example implemented as an example of the present embodiment. FIG. 5 is a view showing a photograph in which two mounted prototypes are arranged side by side, and a 3D image across these two units is displayed. FIG. 6 is a photograph showing an experimental environment in the configuration of the present embodiment. FIG. 7 is a schematic view from above of the experimental environment in the configuration of the present embodiment. FIG. 8 is a diagram showing experimental results in the configuration of the present embodiment.

  Hereinafter, embodiments of a stereoscopic display device, a stereoscopic display method, a stereoscopic display program, and a recording medium according to the present embodiment of the present invention will be described in detail based on the drawings. The present invention is not limited by the embodiment. For example, in the following embodiment, although an example using a micro mirror array as an imaging optical element may be described, the present invention is not limited to this, and any other optical element that forms an image in the air may be used. An optical element may be used. As an example, it is also possible to use a recursive projection technique or AIRR or the like using a half mirror and a retroreflecting material (for example, for AIRR, Hirotsugu Yamamoto, Shiro Suyama “Aerial imaging by retro-reflection (AIRR) ”See SID 2013 DIGEST 895, https://www.researchgate.net/publication/264687832_Aerial_imaging_by_retro-reflection_AIRR etc. For example, for recursive projection technology,“ Develop a multi-view autostereoscopic display “RePro3D that touches” —projected in real space Three-dimensional display that can be touched with the October 12, 2002, see http://www.jst.go.jp/pr/announce/20101012/index.html etc.).

  Hereinafter, first, the background and outline of the embodiment of the present invention will be described, and then the configuration, processing, and the like of the present embodiment will be described in detail.

[Background and Summary of this Embodiment]
In the world such as science fiction, large 3D images are projected onto a real space from the wall of a building or a shop's show window, and a world where users interact with the 3D images directly by hand is often depicted. In recent years, while studies on a large number of existing three-dimensional displays have introduced three-dimensional displays to movies and games, few have been introduced to the walls of showcases and buildings, and a general approach has not been established yet . In addition to being a large three-dimensional display, introduction to public spaces such as store showcases and building walls can realize autostereoscopic viewing and cost reduction by facilitating design and construction. Is desirable.

  Here, considering digital signage, which is a 2D display that is actually introduced to the display wall of a storefront or a showcase, it is not a single large display installed on the storefront or the wall, but a large amount By tiling multiple small displays produced, it is often constructed and used as one large display. This not only reduces costs by using mass produced small displays that can also be used in other applications, but also eases transportation to reduce installation costs, and tiling according to purpose and location There are merits such as design and ease of implementation that can be changed in shape and size simply by changing the number of displays.

  Therefore, the inventors of the present application have keenly studied to realize an airborne projection type autostereoscopic display having extensibility by applying this digital signage design method to the air projection type autostereoscopic display. As a result of intensive studies, the inventors of the present invention came to devise an embodiment according to the present invention such as design and implementation of an airborne projection type autostereoscopic display having extensibility.

  Here, the conventional aerial projection type naked-eye 3D display will be described. Conventionally, there are many studies of autostereoscopic displays focusing on direct interaction between the user and the stereoscopic image. For example, Kaketani et al. Succeeded in projecting an autostereoscopic image into the air using an LCD, a Fresnel lens, and a polarizing filter ([1]: Kakeya, Hideki. “P-65: FLOATS V: Real- Image-Based Autostereoscopic Display with TFT-LC Filter. "SID Symposium Digest of Technical Papers. Vol. 35. No. 1. Blackwell Publishing Ltd, 2004.).

  Furthermore, in 2010, RePro3D was developed by Yoshida et al. For the purpose of direct interaction of 3D images with the user's hand ([2]: Yoshida, Takumi, et al. “RePro3D: Full- parallel 3D display with haptic feedback using retro-reflective projection technology. "VR Innovation (ISVRI), 2011 IEEE International Symposium on. IEEE, 2011.). This is a system that generates an autostereoscopic image that can be superimposed and displayed in real space by applying a recursive projection technique, and is a visual tactile display that also performs tactile presentation at the same time.

  Also, in 2011, Yoshida et al. Developed fVisiOn, which uses a multi-projector and a mortar-like screen to aerially project an naked-eye 3D image that can be observed from the entire periphery at the center of the table ([3]: Yoshida, Shunsuke. “FVisiOn: Glasses-free tabletop 3-d display-its design concept and prototype.” Digital Holography and Three-Dimensional Imaging. Optical Society of America, 2011.).

  Furthermore, in 2012, newcomers and others proposed an aerial projection autostereoscopic display Fuwa-Vision capable of presenting motion parallax without lowering the resolution using a Fresnel lens, an LCD, and a transparent liquid crystal display ([4 ]: Nii, Hideaki, et al. “Fuwa-Vision: an auto-stereoscopic floating-image display.” SIGGRAPH Asia 2012 Emerging Technologies. ACM, 2012.).

  In addition, as a tiling 3D display for enlargement, a large image beyond the size that one Defanti, who developed CAVE in 1992, can display a single display by connecting multiple stereoscopic displays Has developed an extensible 3D display that can display ([5]: DeFanti, Thomas A., et al. “The future of the CAVE.” Central European Journal of Engineering 1.1 (2011): 16-37.). This is an array of a plurality of commercially available shutter glass type stereoscopic displays or a plurality of lenticular type autostereoscopic displays.

  Furthermore, HaptoMIRAGE was developed by Ueda et al. In 2014 ([6]: Ueda, Yuta, et al. “HaptoMIRAGE: mid-air autostereoscopic display for seamless interaction with mixed reality environments.” ACM SIGGRAPH 2014 Posters. ACM, 2014.). This can be handled by multiple people by connecting three modules that display an autostereoscopic image in the air, achieving a wide viewing angle. In 2014, Takagi et al. Succeeded in projecting an autostereoscopic image of a large size which can not be displayed on one by combining a plurality of autostereoscopic display modules into the air ([7]: Takaki, Yasuhiro, Masayuki Tokoro, and Kenji Hirabayashi. "Tiled large-screen three-dimensional display consistent of frameless multi-view display modules." Optics express 22.6 (2014): 6210-6221.).

  As described above, although various three-dimensional displays have been developed, none of the conventional techniques have been able to realize an aerial projection autostereoscopic three-dimensional display having the extensibility for enlargement as described above. was there.

  That is, as a result of intensive studies, the inventors of the present invention have considered that there are several requirements for realizing the above-proposed aerial projection autostereoscopic display with extensibility. 1. First, in order to be used for advertising display in public spaces, it is desirable for the observer to use a system with a low barrier. That is, an autostereoscopic display that can be observed without wearing special glasses is desired. 2. Next, in order for the user to directly interact with the displayed 3D object by hand, it is desirable that there is less visual discomfort between the user's hand and the 3D image. Although many autostereoscopic displays provide binocular parallax and convergence, there are few studies that achieve lens adjustment. 3. However, in order to reduce visual discomfort between the user's hand and the 3D image, it is necessary to reduce the positional relationship between the 3D image and one's hand if the lens adjustment is not taken into consideration. It is thought that there is.

  4. Next, in order to have extensibility as a module, it is desirable that images across multiple modules be connected seamlessly. Specifically, The image is displayed up to the end of the module, or 5. The image at the end of the module is not distorted. Furthermore, tiling modules means that the user sees the modules being tiled at an angle. 6. That is, a wide viewing angle of the module is also included as a requirement.

7. Finally, in order to use as one large display by tiling a plurality of apparatuses, it is included as a requirement to display an image of a large size which is difficult to display in one. The following is a summary of these requirements.
1. Being an autostereoscopic display There is no sense of discomfort in convergence and adjustment of stereoscopic video. Being able to display an image to a position where the user can reach The image is displayed up to the end of the module No distortion of the image at the end of the module Having a wide viewing angle that can be viewed obliquely Being able to display large size video that is difficult to display with one

  In the existing research, Fuwa-Vision [3] and HaptoMIRAGE [6] have been realized up to elements 1 and 2 above. In the study of Defanti et al. [5], elements 1, 5, 6 and 7 were realized. Takagi et al.'S study [7] realized elements 1, 2, 4 and 7. With regard to the elements 4, 5 and 6, the design of the module is changed for each tiling position, so that the module of the same design could not be realized. Therefore, the inventors of the present application conducted earnest studies and came to design and implement a system as an embodiment satisfying all the above-mentioned elements.

  A major issue for this realization was the coexistence of element 3 and elements 5, 6 and 7. Elements 1 and 2 have been shown in many studies to be achievable using lenses. However, the use of a lens causes optical aberrations. It is known that the strength of the main aberration largely depends on the angle of incident light and the size of the effective aperture, and in order to construct an expandable system for enlargement, the image up to the end of the module of the extended building unit When the lens size is displayed, the effective aperture of the lens increases and aberrations inevitably occur. Also, realizing a wide viewing angle of the module means that the angle of incident light becomes large, and further, the user does not exist on the optical axis of the module.

  That is, if the lens is used to realize the elements 1 and 2, the elements 4 and 6 cause strong aberrations. At this time, since a plurality of aberrations occur, it is very difficult to correct distortion in real time according to the user's dynamically changing viewpoint position. Therefore, it becomes difficult for the video to meet the distortion requirement 5.

  Here, in the conventional research described above, the function of the lens is to project the real image of the display into the air and to control the light emitted from the display to reach only a single eye of the user. Two. In order to replace this function, the inventors of the present invention have as an embodiment a micro mirror array which can be mass-produced by the recent MEMS technology as an optical element having a function of projecting a real image of a display into the air. I thought about using it.

  The micro mirror array is composed of mirrors rather than lenses, and thus has the great advantage that no aberration occurs. As a result of intensive studies, the inventors of the present invention use the micro mirror array as one embodiment to not only produce a real image of the display but also to allow the light emitted from the display to reach only the user's monocular It came to devise the composition which can be controlled. Here, FIG. 1 is a view showing an example of a configuration devised by the present inventors as an embodiment of the present invention.

  As shown in FIG. 1, the system configuration of the present embodiment includes a motion capture device 112 performing motion tracking, a micro mirror array 111, a transmissive display 114 such as a transparent liquid crystal display, and a light source 116. The micro mirror array 111 is an optical element having a function of imaging light emitted from a certain spatial point to a spatially symmetric spatial point. That is, in the micro mirror array 111, real images of the transmissive display 114 and the light source 116 are imaged at positions in the air like the 3D object of FIG. At this time, if the light generated from the light source 116 is a minute area, the emitted light from the light source 116 passes through the transmissive display 114 and converges to a point that is axisymmetric. If the image is displayed on the transmissive liquid crystal display 114, the image displayed on the transmissive display can not be viewed if the user's eyes do not exist on the light beam.

  Here, a device may be used to fix the head of the user such that the left and right eyes are positioned at the focal point on the light beam, which is axisymmetric to the micro mirror array 111 from the light source 116. In this embodiment, as an example, the motion capture device 112 is used to acquire the position of the user's eyes and calculate and irradiate the irradiation area of the light source according to the position of the user's right eye. The display 114 displays an image for the right eye. As a result, the right-eye image displayed by the transmissive display 114 is imaged in the air and is incident only on the user's right eye. Thereafter, similarly, the irradiation area of the light source 116 adjusted to the position of the left eye is calculated and irradiated, and the image for the left eye is displayed on the transmissive display 114, so that the left eye image imaged in the air is only for the user's left eye. Incident to For example, as shown in FIG. 1, the light emitting surface of the light source 116 may have a width such that the image to be formed is incident on one eye but not the other. In the present embodiment, by switching and displaying these at high speed, binocular parallax is generated to realize autostereoscopic viewing of an aerial image.

  As described above, in the present embodiment, since a mirror is used for aerial imaging of an image, there is an effect that aberration does not occur in an image at a module end, and images between modules are seamlessly connected. This makes it possible to seamlessly connect and expand an aberration-free autostereoscopic display, for example, to reduce use barriers in public space etc., and allow direct interaction between a user and a virtual object by aerial projection. The extensibility, which is a digital signage design method, makes it possible to reduce the introduction cost.

  In the outline of the embodiment of the present invention described above, the explanation is given on the premise that the user is one person, but the present invention is not limited to this, and the positions of the left and right eyes of a plurality of n users The light source 116 may be switched n × 2 times to correspond. Further, although the light source 116 is illustrated to be a panel-like planar light source in the description using FIG. 1, the present invention is not limited to this, and the light sources may be three-dimensionally arranged. For example, a transmissive planar light source may be stacked in multiple layers to form a three-dimensional structure. By arranging in this way, even if the user's face is not directly facing the micro mirror array, and is observed from an oblique direction, it is located in line symmetry with respect to the left and right eyes that are inclined. It is possible to turn on the corresponding light source to perform autostereoscopic display. In addition, since there is a limit in the arrangement of the light source, the viewpoint of the user is not necessarily located at a line symmetrical position from the light source. In such a case, it may be possible to prevent both eyes from being incident by narrowing the width of the light emitting surface of the light source.

[Configuration of the present embodiment]
Subsequently, the configuration of an embodiment according to the present invention will be described below. First, the configuration of the stereoscopic display device 100 and the like of the present embodiment will be described. FIG. 2 is a block diagram showing an example of the configuration of the stereoscopic display 100 to which the present embodiment is applied, and conceptually shows mainly the part related to the present embodiment in the configuration.

  In FIG. 2, the stereoscopic display device 100 is schematically connected to a control unit 102 such as a CPU that generally controls the entire stereoscopic display device 100, a motion capture device 112, a transmissive display 114, and a light source 116. An output control interface unit 108 and a storage unit 106 for storing various databases, tables, and the like are provided. These units are communicably connected via an arbitrary communication path.

  Various types of databases and tables (for example, 3D object file 106 a and the like) stored in the storage unit 106 are configured with a small-capacity high-speed memory (for example, cache memory) using a static random access memory (SRAM) or the like. A storage unit such as a fixed disk drive such as a hard disk drive (HDD) or a solid state drive (SSD) stores various programs, tables, files, databases, etc. used for various processes.

  Among these, the 3D object file 106 a is a price storage unit that stores image data (3D object data and the like) for the left and right eyes having at least binocular parallax. For example, the 3D object file 106a may store a pair of image data for the left and right eyes, and may store 3D object data that can be displayed from any viewing direction. The data stored in the 3D object file 106a may be data downloaded in a timely manner through a network such as the Internet.

  In addition, the storage unit 106 may store, for example, a table or the like associated with the light source 116 at a position that is in line symmetry with the position of the user's eyes, for example, the micromirror array 111. It is a thing.

  Further, in FIG. 2, the input / output control interface unit 108 controls the motion capture device 112, the transmissive display 114, the light source 116 and the like.

  The motion capture device 112 is motion recognition means for tracking the position of the user's face or eye. For example, the motion capture device 112 may detect the position of the user's eyes using a known face recognition technology using a camera or the like, a known viewpoint position recognition technology, or the like. Motions or gestures can be derived from the user's position and motion in physical space, including any dynamic or static user motion, such as eye or face motion, or a static pose. it can. As an example of the present embodiment, in the motion capture device 112, a capture device such as a camera captures user image data, and recognizes the motion or gesture (one or more) of the user from the user image data. May be More specifically, the motion capture device 112 uses the computer environment to recognize, analyze, and interpret the motion of the face or eye performed by the user in the user's three-dimensional physical space, and the user's action Data, attribute data or the like or raw data before analysis may be transmitted to the control unit 102 of the stereoscopic display device 100.

  As an example of known face recognition means and viewpoint position recognition means, a Kinect sensor of a motion sensor for Xbox One manufactured by Microsoft Corporation may be used. According to the Kinect technology, it is possible to obtain skeleton motion data of a whole body skeleton and position data of a face. In the known motion sensor, the movement and the attribute of the person are analyzed by using the control means built in the sensor, or the movement and the attribute of the person are analyzed by the control means of the connected computer. Any of the embodiments may be used. For example, these analysis functions may be realized by the control means (the viewpoint position measurement unit 102 a or the like) of the stereoscopic display device 100, and realized by the control means in the motion capture device 112. The analysis function may be realized by sharing both control means.

  In addition, the transmissive display 114 is a display means capable of performing display by modulating transmitted light, and for example, a transmissive liquid crystal display, a transparent liquid crystal display, a liquid crystal panel, a transmissive liquid crystal display (LCD), etc. It is. In the present embodiment, in order to switch the image to the eyes of one or more persons, a display having a short response time and a high driving frequency and a high frame rate is desirable. For example, if a display of 480 Hz is used, 120 Hz can be allocated per person, and autostereoscopic display can be realized by up to 4 people.

  Also, the light sources 116 are a plurality of light sources that can be spaced to correspond optically to the positions of the left and right eyes. For example, when there is only one user, there are at least two point light sources. In that case, a head fixing device or the like is desirable in order to position the user's eyes at positions symmetrical with respect to the micro mirror array 111 from two point light sources. Here, the light source 116 may be a surface light source such as an organic EL panel, and in this case, the user can obtain a planar degree of freedom in which the user can move vertically and horizontally. Furthermore, the light source 116 may be arranged such that the light source LEDs and the like are in a three-dimensional array, in which case the user can move in the front and back direction in addition to the planar freedom in the upper and lower, right and left directions. You can get the degree of freedom and the freedom to rotate the face.

  Further, in FIG. 2, the control unit 102 has a control program such as an operating system (OS), a program defining various processing procedures and the like, and an internal memory for storing required data. , And a processor such as a CPU that performs information processing to execute various processing. In the present embodiment, the control unit 102 functionally and conceptually includes a viewpoint position measurement unit 102 a, a transmissive display control unit 102 b, and a light source control unit 102 c.

  Among these, the viewpoint position measurement unit 102a is viewpoint position measurement means that measures or estimates the positions of the left and right eyes of the user. For example, when the position of the face is obtained by face recognition by the motion capture device 112 described above, the viewpoint position measuring unit 102a measures or estimates the positions of the left and right eyes based on the position and the direction of the face. Good. In addition, when the viewpoint position itself is obtained by the viewpoint recognition by the motion capture device 112 described above, the viewpoint position measurement unit 102a may acquire it as the positions of the left and right eyes of the user. In addition, when the image data of one or more users is obtained by the motion capture device 112 such as a camera, the viewpoint position measurement unit 102a uses a known face recognition method or a known eye recognition method. The positions of the left and right eyes of each user may be recognized.

  The transmissive display control unit 102b is a display control unit that switches and displays an image for each of the left and right eyes of the user. Here, when a pair of image data (video data and the like) corresponding to the left and right eyes are stored in advance in the 3D object file 106a, the transmissive display control unit 102b switches and displays the image. On the other hand, when three-dimensional object data is stored in the 3D object file 106a, the transparent display control unit 102b displays an image that should be visible according to the left and right eye positions acquired by the viewpoint position measurement unit 102a. It may be extracted from object data and switched and displayed. Note that the transmissive display control unit 102b may assign the operating frequency of the transmissive display 114 to a plurality of persons so that a plurality of persons can simultaneously view them by time division display, and may switch and display the corresponding images. is there.

  The light source control unit 102b is a light source control unit that controls the plurality of light sources 116 that can be separated to optically correspond to the positions of the left and right eyes of the user. For example, when the transmissive display control unit 102b displays an image corresponding to the position for the right eye, the light source control unit 102b turns on the light source corresponding to the position for the right eye, while supporting the position for the left eye When an image to be displayed is displayed, the light source corresponding to the position of the left eye may be turned on. It is preferable that the light emitting surface when the light source 116 is turned on has such a width that the image formed on the other surface side is incident to one eye but not to the other eye. Here, when the head of the user is not fixed, light sources corresponding to the positions of the left and right eyes obtained by the motion capture device 112 described above may be selected and lighted. Note that if there is no corresponding light source and the position of the eye is farther than the focus that can be imaged in space due to the limitation of the arrangement of light sources, the width of the light emitting surface described above may be narrowed. As a result, even when the eye is not in focus and the image is blurred, it is possible to prevent the same image from being incident on both eyes. Note that the light source control unit 102c may assign the operating frequency of the transmissive display 114 to a plurality of persons and switch and display the corresponding images so that a plurality of persons can simultaneously view the time-division display. .

  The stereoscopic display device 100 may be configured to be communicably connected to an external device that provides an external program or the like such as 3D object data or a stereoscopic display object program via a network such as the Internet. The stereoscopic display device may be communicably connected to the network via a communication device such as a router and a wired or wireless communication line such as a dedicated line.

  This is the end of the description of the components of the stereoscopic display device according to the present embodiment.

[3D display processing]
Next, an example of the stereoscopic display process according to the present embodiment configured as described above will be described in detail below with reference to FIG. Here, FIG. 3 is a flowchart showing an example of processing in the stereoscopic display device 100 of the present embodiment.

  As shown in FIG. 3, first, the stereoscopic display device 100 measures the viewpoint positions of the left and right eyes of the user under the control of the viewpoint position measuring unit 102 a (step SA-1). Here, when there are a plurality of users, the viewpoint position measurement unit 102a may measure the viewpoint position of each user.

  The stereoscopic display device 100 controls the transmissive display control unit 102b to display the right-eye image on the transmissive display 114 (step SA-2).

  Then, the stereoscopic display device 100 performs control such that the light source 116 optically corresponding to the position of the right eye measured by the viewpoint position measurement unit 102 a is lit by the control of the light source control unit 102 c (step SA-3).

  Then, the stereoscopic display device 100 controls the transmissive display 114 to display the image for the left eye under the control of the transmissive display control unit 102b (step SA-4).

  Then, the stereoscopic display device 100 controls the light source 116 optically corresponding to the position of the left eye measured by the viewpoint position measurement unit 102a to light up under the control of the light source control unit 102c (step SA-5).

  By the above-described processes of steps SA-2 to SA-5, light of different images with binocular parallax is incident on the left and right eyes of the user. In addition, when the viewpoint position of a several user is recognized in step SA-1, you may repeat the process similar to step SA-2-SA-5 for the 2nd user.

  When the stereoscopic display device 100 does not determine the end (step SA-6: NO), the above process is repeated so that an image or video is continuously formed in the eyes of the user, and the end instruction is given. In the case where there is no video or the like or the like, it is determined that the processing is ended (step SA-6: YES) and the processing is ended.

  The above is an example of processing of the stereoscopic display device 100 in the present embodiment. As a result, stereoscopic display that can be observed with the naked eye and does not generate aberration is performed, so that even if the display is enlarged for a large screen, seamless stereoscopic display can be realized for each user.

  This is the end of the description of an example of the process of the stereoscopic display device 100 according to the present embodiment.

[Example]
Next, an example implemented as an example of the present embodiment will be described. Here, FIG. 4 is a view showing an appearance of an example implemented as an example of the present embodiment. As a prototype implemented based on the design described above in the overview of the embodiment, Kinect v2 manufactured by Microsoft Corporation was used as a motion tracking system. As a light source constituting the aerial projection autostereoscopic display module, VG248QE 24 inch 1920 × 1080 made by ASUS Inc. was used. As for the transparent liquid crystal display, the VG248QE 24 inch 1920 x 1080 of the same company, Inc. was disassembled to take out only the liquid crystal for use.

  As the micro mirror array, Aspanet AIP-B488S05G was used, and two display modules were mounted. FIG. 4 shows the appearance of one module. In addition, in order to prevent cross talk due to deviation of scanning timing of the transparent liquid crystal display and the liquid crystal display used as a light source, the display of the transparent liquid crystal display and the light source inserts a full black screen every frame, right eye screen → black screen → Draw for left eye screen → black screen → right eye screen →. FIG. 5 is a view showing a photograph in which two mounted prototypes are arranged side by side, and a 3D image across these two units is displayed.

1. Purpose of Experiment Under the configuration of the above example, in this experiment, it was confirmed whether the proposed autostereoscopic display module had extensibility. If it has extensibility, when displaying an image across two modules, the user should be able to recognize it as a 3D image. Therefore, two modules were connected horizontally and 3D images were projected on various parts of the module.

  The 3D image displayed at the center of the display can be perceived binocularly, but the depth can be perceived, but the 3D image displayed at the end of the module is displayed in a place where it can be seen especially by one eye but can not be seen by the other eye It is expected that the perceived image will have lower depth perception than the 3D image displayed at the center. On the other hand, in the image displayed on the expanded module end side, it is expected that binocular stereoscopic vision will be established with the help of the next module, and depth perception will be less likely to be reduced. The above was demonstrated in this experiment, and it was confirmed that the proposed method has extensibility.

2. Experimental Environment and Experimental Procedure FIG. 6 is a photograph showing the experimental environment in the configuration of the present example. The subject mounts the head on the jaw base of FIG. 6 and fixes the head position. The head position was set so that the space between the eyelids was at the center of the left display module so that the left display could be viewed from the front. The distance between the front of the display on the left and the subject's eyelid is 977 mm.

  FIG. 7 is a schematic view from above of the experimental environment in the configuration of the present embodiment. As shown in FIG. 7, a plate of 15 mm long, 350 mm wide and 2 mm thick which is a real object was placed at a distance of 345 mm from the front of the display. The display displays a cubic 3D image of about 2 mm. The subject answers whether the 3D image is in front of or behind the real object.

  The experimental conditions are: 2 types of 3D image display positions in the depth direction (positions of 335 and 355 mm from the front of the display) and 5 types of angles when the vertical direction of the front of the display module is 0 ° (-12 °,- 6 °, 0 °, 6 °, 12 °) were prepared, and experiments were conducted under 10 conditions in total for each combination. Each condition was performed 5 times, for a total of 50 runs. In addition, when the size of the 3D image changes depending on the display position, it becomes a clue to depth perception, so control was performed so that it does not change depending on the display position.

3. Experimental Results and Discussion The experiment was conducted with five men and women in their twenties as subjects. FIG. 8 is a diagram showing experimental results in the configuration of the present embodiment. As a result of comparing the rate of correct answer, the rate of correct answer is the lowest at -12 °, which is 58%, and the rate of correct answers at the other four points exceeded 80%. It is the module end which is not expanded at -12 °, and it was as presumed for the purpose of this experiment that the correct answer rate was lowered only at this point. The present experimental result means that when presenting an image across two modules, the adjacent modules reduce the decrease in depth perception, and the stereoscopic display system according to the present embodiment has extensibility. That was confirmed.

4. Summary According to this embodiment, the tiling of multiple aerial projection autostereoscopic displays enables design and implementation of an autostereoscopic display module having extensibility that can be constructed as a large aerial projection autostereoscopic display. That was confirmed. As a result of conducting experiments, it was possible to demonstrate that the tiling of modules improves the depth resolution at the module end, and that tiling of multiple modules can be used as one large display. Since it is considered possible to display a larger aerial stereoscopic image at the user's hand, it has been confirmed that it is also possible to expand the viewing angle and reduce the spatial gap between each component.

Other Embodiments
Now, although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various other embodiments within the scope of the technical idea described in the claims. It may be implemented.

  For example, in the stereoscopic display device 100, the control function and the like via the transmissive display 114 and the point light source 116 are described in the same housing together with the operation recognition function of the motion capture device 112 or the like. It may be realized in separate housings that realize these functions. That is, systems such as the motion capture device, the transmissive display 114 and the light source 116, and the functions of the control unit for performing calculations etc. are functionally or physically dispersed or integrated according to the functional load or in any unit. Can be configured.

  For example, although the stereoscopic display device 100 is described to perform processing in a stand-alone mode, the stereoscopic display device 100 performs processing in response to a request from a client terminal such as an external device through a network, and the processing result is It may be returned to the client terminal, and may be configured to perform stereoscopic display on the client terminal.

  Further, among the processes described in the embodiment, all or part of the process described as being automatically performed can be manually performed, or the process described as manually performed. All or part of them can be performed automatically by known methods.

  In addition, information including the processing procedures, control procedures, specific names, registered data of each processing, parameters such as search conditions shown in the above documents and drawings, screen examples, and database configurations are not described otherwise. Can be changed arbitrarily.

  Further, with regard to the stereoscopic display device 100, each component shown in the drawings is functionally conceptual, and does not necessarily have to be physically configured as shown.

  For example, with regard to processing functions provided in each device of the stereoscopic display device 100, in particular, each processing function performed by the control unit 102, all or any part thereof may be processed by a processor such as a central processing unit (CPU) and the processor. It may be realized by a program that is interpreted and executed, or may be realized as a wired logic hardware processor. The program is recorded in a non-temporary computer-readable recording medium including a programized instruction for causing a computer to execute the method according to the present invention, which will be described later, and the stereoscopic display device as needed. It is mechanically read by 100 or the external device 200. That is, in the storage unit 106 such as the ROM or HDD (Hard Disk Drive), a computer program for giving instructions to the CPU in cooperation with the OS (Operating System) and performing various processes is recorded. The computer program is executed by being loaded into the RAM, and cooperates with the CPU to configure the control unit.

  Also, the computer program may be stored in an application program server connected to the stereoscopic display device 100 via an arbitrary network, and it is possible to download all or a part of the computer program as needed. is there.

  Further, the program according to the present invention may be stored in a computer readable recording medium, or may be configured as a program product. Here, the "recording medium" is a memory card, USB memory, SD card, flexible disk, magneto-optical disk, ROM, EPROM, EEPROM, CD-ROM, MO, DVD, and Blu-ray (registered trademark). It includes any "portable physical media" such as Disc.

  The “program” is a data processing method described in any language or description method, and may be in any format such as source code or binary code. The “program” is not necessarily limited to a single program, but may be distributed as a plurality of modules or a library, or in cooperation with a separate program represented by an OS (Operating System). Also includes those that achieve the function. In addition, as a specific configuration for reading the recording medium in each device shown in the embodiment, a reading procedure, an installation procedure after reading, and the like, a known configuration and procedure can be used. The present invention may be configured as a program product recorded in a non-transitory computer readable recording medium.

  Various types of databases (3D object file 106a etc.) stored in the storage unit 106 are memory devices such as RAM and ROM, fixed disk devices such as hard disk, flexible disks, storage means such as optical disks, etc. And stores various programs, tables, databases, files for web pages, etc. used to provide web sites.

  Further, the stereoscopic display device 100 may be configured as an information processing device such as a known personal computer, a work station, or the like, and any peripheral device may be connected to the information processing device. The stereoscopic display device 100 may be realized by implementing software (including a program, data, and the like) that causes the information processing device to realize the method of the present invention.

  Furthermore, the specific form of device distribution and integration is not limited to that shown in the drawings, and all or part thereof may be functionally or physically in any unit depending on various additions or according to functional load. Can be distributed and integrated. That is, the embodiments described above may be implemented in any combination, and the embodiments may be implemented selectively.

  As described above in detail, according to the present invention, since stereoscopic display is performed that can be observed with the naked eye and does not generate aberration, it is possible for each user to expand even if the screen is enlarged or the like. A three-dimensional display device, a three-dimensional display method, and a three-dimensional display program capable of realizing seamless three-dimensional display can be provided.

Reference Signs List 100 stereoscopic display device 102 control unit 102a viewpoint position measurement unit 102b transmissive display control unit 102c light source control unit 106 storage unit 106a 3D object file 108 input / output control interface unit 111 micro mirror array 112 motion capture device 114 transmissive display 116 light source

Claims (8)

An imaging optical element for forming an image on one side in a space on the other side;
A transmissive display capable of displaying a plurality of images for at least a right eye and a left eye, disposed on the one side;
A plurality of light sources disposed on the one surface side and capable of being separated so as to optically correspond to the positions of the left and right eyes;
A three-dimensional display device characterized in that different images for the right eye and for the left eye are switched and imaged on the other surface side to generate binocular parallax. In the three-dimensional display device according to claim 1,
The imaging optical element is
A three-dimensional display device characterized in that it is a micro mirror array. In the stereoscopic display device according to claim 1 or 2,
A three-dimensional display device, further comprising a motion capture device for measuring the positions of the left and right eyes. The three-dimensional display device according to any one of claims 1 to 3.
The light emitting surface of the light source is
A stereoscopic display device characterized in that the image formed on the other surface side has a width such that it is incident on one eye but not incident on the other eye. In the three-dimensional display device according to claim 4,
The stereoscopic display device characterized in that the width is narrowed when the position of the eye is farther than the focusable point in the space on the other surface side. In the three-dimensional display device according to any one of claims 1 to 5,
The plurality of light sources are
A three-dimensional display device characterized in that it is three-dimensionally arranged as a multilayer structure. An imaging optical element for forming an image on one surface in a space on the other surface, a transmissive display disposed on the one surface capable of displaying a plurality of images, and left and right disposed on the one surface A three-dimensional display method implemented in a three-dimensional display device comprising: a plurality of light sources, which can be spaced to correspond optically to the position of the eye
Displaying the image for one eye on the transmissive display when the light source optically corresponding to the position of one of the eyes is turned on;
Displaying the image for the one eye and the image for the other eye having binocular parallax when the light source optically corresponding to the position of the other eye is turned on;
A three-dimensional display method comprising: An imaging optical element for forming an image on one surface in a space on the other surface, a transmissive display disposed on the one surface capable of displaying a plurality of images, and left and right disposed on the one surface A stereoscopic display program to be executed by a stereoscopic display device provided with a plurality of light sources that can be separated to correspond optically to the position of the eye
Displaying the image for one eye on the transmissive display when the light source optically corresponding to the position of one of the eyes is turned on;
Displaying the image for the one eye and the image for the other eye having binocular parallax when the light source optically corresponding to the position of the other eye is turned on;
3D display program to execute.