JP5317706B2 - Display device - Google Patents

Abstract

[PROBLEMS] To realize a display suitable for five-sense presentation of absorption type, to present five-sense stimulation as if perfume were given off from an object in the screen, sound were reverberated, and wind were sensed, quickly to change the perfume to another of various perfumes, to pinpoint-present perfume to the observer, and to present five-sense stimulation correspondingly to the movement of the observer. [MEANS FOR SOLVING PROBLEMS] Invisible small holes are made in a screen, and sense-stimulating media such as perfume, air streams, and sound are given off from the holes. The screen is made up of LEDs, organic EL elements, or the like as pixels and has a thin shape. The holes are arranged in the spaces between the pixels. It is preferable that the diameters of the holes are 0.1 mm or more, and the angles of subtense are 0.5 degrees or less. A gas can be given off in the form of a block by bringing some holes together into a virtual barrel. Many kinds of perfume can be mixed into the air. By controlling air give-off/discharge means provided to screens, an air stream in an arbitrary direction can be produced. By providing user position detecting means such as a near-infrared camera inside the screens, high-accuracy three-dimensional display (visual presentation) and presentation of senses of smell, touch, and hearing is possible.

Description

The present invention presents an image in conjunction with an olfactory stimulus (scent), skin tactile stimulus (wind, etc.), auditory stimulus (sound, etc.), or presents an image based on gazing point information. The present invention relates to a display device that produces a sense of reality or comfort (healing). Mainly relates to a large screen display device capable of presenting the five senses.

In recent years, display devices have been developed with large screens and high definition technology, and can display powerful or realistic video images. In addition, the acoustic device can express a powerful sound by a configuration such as 5.1 channel. In this way, in the visual and auditory fields, technologies for presenting high-quality information to users have advanced, but in order to further improve the sense of reality, the sense of smell, touch, somatic sensation, etc. are combined. A technique that can be presented is desired. In the visual field, binocular stereoscopic display is known to have a great effect on spatial recognition, and for a long time, it is desired to realize a large-screen display device capable of binocular stereoscopic viewing without wearing special glasses. Yes. The prior art related to the present invention will be described below.

Examples of the display device capable of presenting an olfaction include the following inventions.
Japanese Patent Laid-Open No. 10-10987 discloses a multi-function electronic display that detects the passage of a person and outputs a visual message, an olfactory message, and a voice message for the purpose of attracting customers. The display uses an LED display.

Japanese Patent Application Laid-Open No. 2007-108299 discloses a display device including a scent generating unit capable of generating a scent related to an image.

Japanese Patent Laid-Open No. 2006-295321 selects and prepares a predetermined scent based on scent presentation information, and uses an air cannon to release a gas containing the scent as a lump toward the nose of an observer. Means for presenting are disclosed.

Japanese Patent Application Laid-Open No. 11-244384 discloses an apparatus that stabilizes the mind by filling the inside of the head housing with light of a blue light emitting element and emitting negative ions, water sound, and scent into the housing. . Polished glass is provided in front of the light-emitting element array, and is devised to scatter light and fill it with uniform light. Liquid fine particles containing negative ions are released from a small hole in the head of the housing. In addition, a small display device is provided in front of the user.

Table 01-089590 discloses a fragrance generating means for impregnating a perfume or the like into a porous material and applying the vibration, heat and wind pressure to vaporize the perfume.

However, any of the scent generating devices disclosed in the above-mentioned documents or the display device capable of presenting scents has a configuration in which a scent generating device is provided on the side of the display device (outside the screen). That is, the visual presentation means and the olfactory presentation means are provided separately. This method has the following problems.

As the screen becomes larger, a sense of incongruity tends to occur in the direction of the scent drifting with the display object. For example, if a flower image is presented on the right side of the large screen and the scent drifts from the left side, the sense of incongruity is great and the sense of reality is impaired. Moreover, if it is installed on the side of the display screen, the space is obstructive. Even if the system uses an air cannon, the scent discharge angle to the user (observer) becomes obtuse when the screen becomes large, so it is difficult to control the scent of the nasal cavity to aim and release it. Become.

In order to link the display device and the scent generating device, calibration for determining parameters for coordinate system conversion is necessary, but it is troublesome if these devices are separated. As a result, there are problems such as poor scent presentation accuracy and little scent presentation effect.

In addition, when releasing a scent in conjunction with an image, it is necessary to switch many scents at high speed. However, in a conventional scent generating device, there are only about 10 types that can be switched and few. In addition, there is a problem that the previous fragrance remains, and there is a problem that it is difficult to switch the fragrance.

Therefore, for large-screen display, a technique for switching and releasing various types of fragrance from the screen at high speed is desired. For example, the realization of a display device in which the scent of an apple pops out of the screen when an observer approaches the apple to be displayed is a problem. However, it is common sense that there is no conventional example from the viewpoint that if such a fragrance generating means is provided in the screen, it impedes vision and falls down at the end.

Next, a display device capable of tactile presentation will be described. When displaying natural images such as mountains and the sea on a large screen, various winds hitting the cheeks, such as warm, cold, damp, dry, and scented winds, are used to improve the sense of reality. It is an important issue to express such as the video. In particular, with an immersive display, a wide area around the observer becomes the screen, so instead of applying airflow from the outside of the screen, gas is emitted from the inside of the screen toward the user (observer), and the tactile sense The technology that presents is desirable. However, such a conventional example is not seen.

Next, there are the following invention examples of display devices capable of binocular stereoscopic viewing. In large-screen display, the user often observes while moving the body and head. Especially, the tendency is high in the immersive type, so it is possible to realize binocular stereoscopic vision and motion vision by allowing the movement of the head. Display devices are an important issue.

Japanese Patent No. 2774370 discloses an apparatus that realizes a large-screen binocular stereoscopic display by measuring a viewpoint movement in real time and driving a lenticular lens. However, no means for accurately and simply measuring the movement of the viewpoint is disclosed. In addition, the light projection control mechanism is complicated, and there is a problem that it cannot cope with a plurality of observers.

FIG. 28 shows an example of an immersive large screen display device that can be stereoscopically viewed in both eyes. In the figure, 27 is a screen, and 29 is a projector for projecting an image on the screen. Five high-intensity projectors are used because it is necessary to project the back onto a large screen. If the place where the projector is installed is included, a considerably large space is required, and the adjustment of the optical system becomes complicated and large-scale equipment.

In the figure, the viewpoint position measurement of the observer P1 necessary for motion vision and stereoscopic display is obtained by a method in which a plurality of cameras 84 provided around the screen are used to photograph the optical markers 83 provided on the glasses as feature points. . However, it is troublesome to attach the camera to the periphery of the screen, and it is difficult to reliably capture the feature points because the camera installed around the screen captures a person from an angle. Moreover, although the operation | work which converts the feature point position measured with the camera coordinate system to the coordinate system of a display apparatus is required, since the position shift of a camera and a display apparatus tends to arise, it is difficult to obtain high accuracy. Furthermore, the binocular stereoscopic vision with the liquid crystal shutter glasses 82 is troublesome.

Next, a method of arranging a plurality of speakers around a display device is conventionally known for sound presentation. However, in a large screen display device, a distance is likely to occur between a speaker around the screen and a display target in the screen. There is a technique for localizing a sound image by controlling the phase and volume of a plurality of speakers, but it is difficult to control for faithful reproduction as if sound is emitted from a display target.

JP 10-10987 JP2007-108299A JP 2006-295321 A JP-A-11-244384 Table 01-089590 Japanese Patent No. 2774370

The present invention realizes a highly realistic display device capable of presenting a user with a sensory stimulation medium composed of fragrance, gas, sound, or a combination thereof through a hole provided on a screen, together with an image. The major issues are as follows.

(1) A screen structure in which holes provided on the screen are not easily perceived (high visibility) and the quality of the image is high.
(2) The sensory stimulation medium is released through the hole as if it is emitted from the object being watched by the user, or is released toward the user.
(3) Aroma and gas can be controlled and presented with high spatial and temporal accuracy. In addition, as many scents as possible can be switched and presented.
(4) Make the structure easy to maintain so that the holes can be cleaned if they become dirty.
(5) The display device is thin and can be installed anywhere without taking up space. In addition, an immersive display device that can surround the user with a screen is realized in a compact manner.

Corresponding to claims 1 to 8, the problem solving means 1 to 8 will be described, and then the configuration and operation of each means will be described in detail.

<Problem solving means 1>
The display device of the present invention will be described with reference to FIGS.
Display screen (10) using a self-luminous body (11 or 18 in FIGS. 1, 9, 23, 24, etc.), or a video projection screen (28 in FIG. 12) provided with a reflective material on the front surface Are provided with a plurality of holes (02 in FIG. 1, FIG. 9, FIG. 23, FIG. 24, etc.) or cuts (st in FIG. 12 (F), 02 in FIG. 15). A sensory stimulation medium presentation device (01 in FIG. 1, FIG. 9, FIG. 23, FIG. 24, etc., 60 in FIG. 23, etc.) is provided on the back side, and the sensory stimulation medium passes through the hole or notch and is used. In the display device presented to the user,
The hole or notch is configured so that the sensory stimulation medium passes in a direction perpendicular or oblique to the screen (see FIGS. 1, 9D, 23, and 24), and the sensory stimulation medium The presentation device is connected to or provided close to the back side of the screen, and the sensory stimulation medium is released through the hole or the notch by changing the air pressure on the back side of the screen.

<Problem solving means 2>
The display device of the present invention will be described with reference to FIGS. 1, 9, 11, 23, and 24.
In the problem solving means 1, the screen or the projection screen is configured to be thin, and the hole (02) or notch is wider in width or diameter than the depth length of the hole (corresponding to the screen thickness). Or configured to have a degree of freedom in passing through the sensory stimulation medium (see 02 in FIG. 9D, FIG. 23, and FIG. 24), and the directivity of the sensory stimulation medium is controlled with respect to the screen. It is characterized by being released.

<Problem solving means 3>
The display device of the present invention will be described with reference to FIGS. 9, 16, 19, 20, and 23 to 27.
In the problem solving means 1 or the problem solving means 2, the user in front of the screen is detected by a sensor (72, 77 in FIGS. 9, 16, 20, 26, 27, and DT in FIG. 19). Based on the detection result, the sensory stimulation medium is released toward the user through the hole or cut in the screen, or the gaze target on the user's screen is detected by the sensor, and the detection result The sensory stimulation medium related to the gaze target is released toward the user through the hole or cut in the screen.

<Problem solving means 4>
The display device of the present invention will be described with reference to FIGS. 9, 11, 18, 20, 24, and 27.
In any one of the problem solving means 1 to the problem solving means 3, the self-luminous body (11 or 18) is mounted on the screen between two thin plates (12B and 12C) composed of the back side and the front side. In addition, a hole (02) or a cut is provided so as to penetrate the both plates between the pixels, and the hole or the cut allows the scent or gas that is a sensory stimulation medium to pass through with directivity. In the periphery of the hole or notch, sealing is performed to prevent the sensory stimulation medium from entering between both plates (SL in FIGS. 9, 11, 24, 02a in FIG. 27). It is characterized by being.

<Problem solving means 5>
The display device of the present invention will be described with reference to FIGS. 9, 11, 19, 20, 26, and 27.

In any one of the problem solving means 1 to the problem solving means 4, the gas, the temperature, or the humidity is controlled from the hole or notch provided on the screen so as to relate to the image displayed on the screen. It is characterized by being released (see FIGS. 19 and 26).

<Problem solving means 6>
The display device of the present invention will be described with reference to FIGS.

In any one of the problem solving means 1 to the problem solving means 5 , the gas or scent in the sensory stimulation medium is released toward the user through a hole or cut in the screen, and the gas or , Fragrance is discharged through holes or cuts in other screens, and airflow (FIG. 26 (A or D), FIG. 27 (A) alternate long and short dash line Air, Frg) in the space consisting of the discharge and discharge It is characterized by generating.

<Problem solving means 7>
The display device of the present invention will be described with reference to FIGS. 1, 5, 6, 7, 12, 14, 15, 17, and 21.

In any one of the problem solving means 1 to the problem solving means 6, the aperture ratio YAS, which is the ratio of the total area (ΣOpen02i) of the hole tip to the screen area (Area 05) provided with the hole, is 10% or more. It is configured as described above, and a mass of gas that is part of the sensory stimulation medium is released from the screen by applying instantaneous atmospheric pressure to the plurality of holes almost simultaneously.

<Problem solving means 8>
The display device of the present invention will be described with reference to FIGS. 12, 20, 24, 25, and 27.
In any one of the SUMMARY 1 SUMMARY 7, wherein the screen is configured to show a stereoscopic image, gas or smell of a stereoscopic image which is part of the organoleptic medium related to the stereoscopic video It is discharged from the hole or notch nearby.

<Detailed description of device configuration>
As shown in FIGS. 1, 5 to 21, and 23 to 27, the display device of the present invention has a plurality of holes (02) that are difficult to be seen on the screen (10 or 28) beyond the shortest viewing distance. ) is provided, organoleptic medium the hole, or can be configured to sense stimulation medium presenting site (the user's eyes, nose, ears, faces, a reference medium for detecting a hand or the like) to pass through.

<Description of holes that are difficult to see>
In the present invention, the plurality of holes (02), which are provided between the pixels and are hardly visible, are provided so as not to alienate the visual organization of the user. That is, the hole diameter or hole density is set in a range that does not destroy the intended meaning of the image. The video includes characters, pictures, symbols, advertisements, moving images (movies), and the like. For example, if the hole is too large to transmit this information with the intended meaning, it is outside the scope of the present invention, but even if the hole is visible, the information is generally intended. If it is accepted by an observer on the street, it is a range of holes that are hardly visible. The pixels can be arranged regularly.

As shown in FIG. 17, the plurality of holes (02) are provided between the display elements (11) or between the illumination elements, the hole diameter is 0.1 mm or more, and the viewing angle is 0. 0 at the shortest viewing distance. It is desirable to be 5 degrees or less, or 0.25 degrees or less at normal viewing distance.

The display element (11) can be composed of three color (red, green and blue) light emitters (18). In the case of a color screen, the shortest viewing distance is a mixed color distance in which the three colors are mixed to look almost a single color, or a distance at which the size of the display element (11) is observed at a viewing angle of about 0.1 degree. Can do. Therefore, the hole diameter can be increased to about 5 times that of the display element. The normal viewing distance can usually be the distance most frequently observed or about twice the shortest viewing distance.

It is desirable that the aperture ratio (YAS) of the hole assembly is 10% or more (see FIG. 5). Thereby, sensory stimulus media, such as gas which passes through each hole, mutually interfere, and it can discharge efficiently towards a user.

The reason why the hole diameter range is desirable is shown in FIG. In summary: If a hole is provided in the screen, the hole is easily contaminated, but if the hole diameter is 0.1 mm or more, the cleaning liquid can be passed through and cleaning is possible.

The display element (pixel) interval at which the display object (object) targeted by the present invention, such as characters, pictures, symbols, advertisements, and moving images, can be displayed without great discomfort is about 0.5 degrees in view angle. The maximum hole diameter in this case is 0.5 degrees. When a light emitting element (such as an LED) is used for the display element (11), light is emitted forward and the display element portion is bright, so the hole (02) behind it is difficult to see. In particular, if a black color that absorbs light is used for the substrate on which the light-emitting element is provided, the presence of the hole does not hinder perception. In the case of a display element in which the illuminant is enlarged by a lens, it is more effective (FIGS. 9E and 16).

However, if the hole diameter is made larger than 0.5 degrees, the pixel interval is widened, and the presence of holes is also a concern, so that the image quality is extremely deteriorated. Therefore, the above range is desirable.

The shape of the display element (pixel) is preferably a square or a circle. The hole (02) is preferably circular, but may be matched to the shape between the display elements (see FIG. 15). That is, a shape like 02 in FIG. 15A may be used, or a notch through which air passes as shown in FIG. The hole can act as a sensory stimulation medium or a guide for the reference medium (see FIGS. 1 and 11) .

The holes (02) are preferably provided between the display elements so that the display element array is not disturbed as shown in FIGS. 1, 7, 16 and the like. However, as shown in FIG. When the element spacing is small, an area for several pixels can be allocated to the hole (02) within a range satisfying the above condition .

<Explanation of sensory stimulation medium passing through hole>
The sensory stimulation medium is a gas for olfactory presentation (fragrance, smell, chemical substance, pharmaceutical), a gas for skin tactile presentation, or a gas for airflow (air, mist), visual presentation (mist, smoke). ), Gas for auditory presentation, or sound waves. Alternatively, a sensory stimulation medium combining these can be used. Further, the sensory stimulation medium can be presented so as to be interlocked with the video displayed on the screen.

In the case of olfactory stimulation, for example, the scent of the flower can be presented from the scent discharge device near the screen on which the flower field (object) is displayed. Further, it is possible to use a means for guiding the user to a predetermined position in the screen (FIG. 19). Using the audio information and the visual information, for example, the user can be guided to the screen area where the flower is displayed, and the scent can be presented from the screen.

In the case of skin tactile stimulation, for example, wind can be presented from a screen on which an electric fan (object) is displayed or an airflow generation device near a screen on which a state in which trees (objects) are shaking is displayed. Moreover, the fog which reminds of a splash can be discharge | released from the screen where the waterfall (object) is displayed.

At this time, it is possible to produce attention by increasing the image brightness of the screen that emits scent or gas, changing the color, or flashing.

In the case of auditory stimulation, a plurality of speakers are arranged on the back side of the screen, and a speaker near the sound generating object can be selected and driven. For example, as shown in FIG. 25B, a life-size object (Obj-P) of an orchestra member can be displayed on the screen, and the sound of the instrument can be presented from each instrument part position. In the case of a motion video, when the position of the user changes, the position of the instrument part on the screen also changes, so that the sound can be presented by switching the speaker in accordance with the change in position.

<Description of the technology to detect the reference medium passing through the hole and the user in front of the screen>
As shown in FIGS. 20, 21, 24, 26, and 27, the reference medium is used for detecting a feature point position for displaying a sensory stimulation medium or a stereoscopic image including motion vision to the user. it can. The feature points are the user's viewpoint, nasal cavity, ears, and the like. As the reference stimulation medium, light, ultrasonic waves, or the like can be used. In order to make it difficult for humans to detect, it is desirable to use near infrared light and ultrasonic waves in a pulsed manner. In the case of ultrasonic waves, it is possible to detect ultrasonic waves that are reflected by collision with the user and detect the position of the user from the reflection time. The case of using light will be described in detail later .

As shown in FIGS. 9 (C), 16 (B), 20, 21, 24, 26 (A), (B), (C), and FIG. 27 (B), in the hole (02) on the screen. A small camera (72 to 75) is provided, the reference light (LGR) is irradiated from the vicinity of the camera lens (74), the reflected light (LGA) is captured by the camera, and the user (P1) sensory stimulation medium A presentation site (eye (viewpoint), nose, ear, face, hand, etc.) or gaze point can be detected.

Here, the viewpoint means the position of the user's eye, and the gaze point means the point where the line of sight intersects the screen. Near infrared light can be used as the reference light. A plurality of near-infrared light sources can be arranged in the screen so as to surround the camera lens, and can be used as a lighting device for photographing feature points. The near-infrared light source may be an element having the same driving principle as the visible light source or a different driving principle element. Specifically, a high-intensity LED, EL element, SED element, or the like can be used .

9B, FIG. 20, FIG. 21, FIG. 26B, and FIG. 27B, the light source (77) is symmetrical around the optical axis of the camera lens (74). It is desirable to arrange in. Further, the near infrared light source can be intermittently driven in accordance with the photographing timing of the camera. By using a near-infrared band-pass filter, the camera can take only an image of near-infrared reflected light and extract feature points.

Since the user faces the screen, in the conventional method, the light of the image is irradiated on the face and it is difficult to extract the feature points. In particular, an immersive large screen is greatly affected by image light. However, in the present invention, since the face is irradiated with the reference light from the screen, the reflected light is captured by a camera installed near the light source, and the spectrum of the reference light is separated from the image light, so that the feature point photographing efficiency is high. In particular, it is suitable for photographing pupil images, corneal reflection images, and retroreflection marks by retinal reflection, and feature points are clearly photographed.

Pupil images or corneal reflection images can be used as eye feature points. For the nose, ear, face, and hand feature points, a retroreflective mark may be attached to the corresponding part. Alternatively, the positions of both eyes may be detected, and the positions of the nose, ears, and face (cheek) may be estimated from a head model prepared in advance.

As shown in FIG. 24C, a hole provided in the substrate (12B, 12C) may be used as a pinhole lens (74a) of the camera (72). In this case, it can be realized by opening a hole in the substrate and applying a light shielding material to the edge of the hole. Further, as shown in FIG. 9E, a camera lens (74b) for focusing and passing the reference light is formed on the front substrate (12D), and the camera (72) provided with the reference light passing through the lens in the hole. ).

The camera can detect the feature point position in a feature point measurement coordinate system (camera coordinate system). Here, the relative position relationship between the feature point measurement coordinate system and the display coordinate system is obtained in advance, and the feature point position can be detected in the display coordinate system.

In the present invention, the relative relationship between the feature point measurement coordinate system (camera coordinate system) and the display coordinate system can be fixed by installing a camera in a predetermined hole on the screen. Therefore, if the relative relationship, that is, the coordinate conversion parameter is obtained by calibration when manufacturing the display device, the feature point position can be obtained directly in the display coordinate system.

Similarly, since a sensory stimulation medium presentation device (gas release device, acoustic device, etc.) can be mounted in the screen, the display coordinate system and the coordinate system of these devices can be converted at the time of manufacture. Therefore, the sensory stimulus medium presentation device can be directly controlled in the display coordinate system.

As described above, the perspective projection conversion video based on the viewpoint position of the user (observer) can be generated. That is, it is possible to realize a motion display. In addition, sensory stimulation media such as fragrance, airflow, and sound waves can be presented to the user so as to be synchronized with the video. Furthermore, it is possible to detect that a user has approached the screen and present a sensory stimulation medium to the user.

Also, as shown in FIGS. 20A and 20B, if the positions of both eyes (17L, 17R) are detected and light rays (LG1 to LG6) for perceiving an object toward both eyes are presented. Stereoscopic video display without using special glasses is possible.

In the present invention, as shown in FIG. 21, a small camera (72 Zoom) capable of controlling the shooting direction or enlarging the image is provided in the hole of the thin screen (10), and the sensory stimulation medium presentation site (eye, nose, ear) is provided. , A face, a hand, etc.), a position of the part or a gazing point is detected, and an image or a sensory stimulation medium can be presented based on the information .

In the present invention, since the screen can be made thin, the camera lens can be rotatably mounted in a hole provided in the screen as shown in FIG. The screen (10) can be equipped with a standard or wide-angle lens camera (72) and a telephoto lens camera (72Zoom). At 72, the approximate position of the sensory stimulation medium presentation site (eye, nose, ear, face, hand, etc.) is detected, and the shooting direction of 72Zoom is controlled using the location information, and the site can be enlarged and photographed. If the feature point is enlarged and photographed, the detection accuracy is improved. Therefore, it is possible to detect the position of the sensory stimulation medium presentation site or the gazing point in a wide range with high accuracy.

A gaze point detection method will be described. If the eye can be magnified, the pupil and cornea reflection image can be extracted. The rotation angle of the eyeball can be detected using the distance between both feature points and the eyeball model. A gaze point on the screen can be detected using the eye position (viewpoint position) and the eyeball rotation angle information. In addition, the position of the three feature points of the pupil and the face can be detected to obtain the point of interest on the screen .

Since cameras can be provided at various locations on the screen, as shown in FIG. 21 or FIG. 26 (F), the pupils are magnified and photographed with each camera, and the pupils are photographed in a circle. In this case, since the line of sight is in the direction of the camera, it can be determined that an object near the camera is being watched. If the pupil image is an ellipse, the line-of-sight angle can be estimated from the ratio of the major axis to the minor axis. Thus, a simple algorithm for estimating the gaze direction from the pupil shape can be applied. Although it is difficult to achieve high accuracy with a conventional display device in which the camera installation location is limited, since many cameras can be arranged in the screen, it is possible to detect a gaze point with high accuracy.

<Description of screen applicable to the present invention>
The screen (for example, 10 in FIG. 1) can be configured by arranging display elements (11) serving as pixels on a substrate (12). A large screen that provides an immersive feeling is desirable. As the substrate material, glass, glass fiber board, FRP, plastic resin, light metal, wood, or a combination thereof can be applied. The shape of the substrate may be a board shape or a flexible sheet shape. For example, a substrate material used in a paper display or the like can be applied .

A light emitting type is suitable for the display element, but a backlight type (FIGS. 10 and 11) may be used. Examples of the light emitting element include a light emitting diode (LED; 18 in FIG. 16), an EL element including an organic EL element (OLED; EL in FIG. 9), a plasma discharge element (PDP), a plasma tube array (PTA), and a small CRT. Arrays can be applied. Further, it utilizes an electrophoretic phenomenon in a liquid used in a field emission display (FED), a fluorescent element used in a surface conduction electron emission display (SED) (18 in FIG. 18), and an electronic pepper display (EPD). A display element can also be applied. As the backlight element, liquid crystal (LC in FIGS. 10A and 11G) or the like can be used .

The screen may be a light reflective screen (28 in FIG. 12) or a light transmissive screen (12C in FIG. 11), and a hole may be provided in the screen .

An image can be projected on the screen from the front (front surface) or the rear (back surface). In addition, it can print an image on the screen and illuminate it. In this case, a large number of holes can be intensively provided in an inconspicuous place in the image. As an inconspicuous place, an image area having a high spatial frequency can be used .

A cylindrical guide (02a) is provided behind the hole provided in the screen so that the sensory stimulation medium or the reference medium for detecting the user's sensory stimulation medium presenting portion passes through, or in front of the hole. Airflow passing material (mes) such as mesh material can be provided. The cylindrical guide or the airflow passing material has an effect of allowing the medium to pass in a predetermined direction and an effect of equalizing the brightness between the hole and the surroundings. That is, when a hole is made in the screen and illumination is simply performed from behind, the illumination light leaks from the hole and causes a sense of incongruity. However, the provision of the cylindrical guide can prevent light leakage .

The screen (28 in FIG. 12) can be configured by laying a retroreflecting material (83) on a substrate such as a board, sheet, or cloth (FIG. 12D). A hole (02) is provided between the retroreflective materials, and the sensory stimulation medium or the reference medium can be passed therethrough. A light reflecting material may be provided inside the hole or inside the cylindrical guide (02a). As the retroreflecting material, a fine reflecting sphere (particle), a minute glass sphere, a minute right-angle reflecting mirror, or the like can be used. The reflected light may spread over a predetermined visual field range .

The screen may be formed of a flexible sheet, and the hole diameter may be changed when passing through the sensory stimulation medium. The hole diameter can be increased by wind pressure, sound pressure, or the like.

<Description of technology for manufacturing self-luminous thin screen with holes>
As shown in FIGS. 9 (C), 10 (A), 11 (B), (G), 18, 24, and 27 (C), the screen (10) is composed of a back side and a front side. A display element (11) or a lighting element (11) is provided between the two substrates (12B, 12C), and a hole (02) penetrating both substrates is provided between the display element or the lighting elements, You may comprise so that the hole of the said hole may be sealed (SL, 02a) .

The front substrate (12C) means a substrate provided on the user side, and can be formed of a transparent member such as glass or resin that allows light to pass through. A sheet-like member may be used. The display element and the driver circuit can be formed on the front substrate (12C) or the back substrate (12B). A display element or a driver circuit is formed on any substrate, and the other substrate can be configured to cover and protect the display element. Note that the two substrates mean elements necessary for this screen, and it is natural that another substrate, a film, a sheet, and the like can be provided to reinforce the substrate and the like can be multilayered.

Light emitting elements such as LEDs and EL elements can be applied to the display element (11). For example, as shown in FIG. 9A, a top emission type organic EL element and a TFT drive circuit can be provided on the back substrate (12B), and tempered glass can be used for the front substrate. As the light emitting layer of the EL element, SOLED (Stacked OLED) stacked vertically can be applied in addition to a system in which R, G, and B pixels are arranged side by side. The element is preferably driven by an active matrix method, but may be driven by a passive matrix method .

Further, as shown in FIG. 9E, the lens (19) may be molded in an array at a portion where the display element (EL) of the front substrate (12C) is located. The hole (02) can be provided on the side of the lens. That is, a sheet-like transparent member with a lens and a hole (12D) can be used as a front substrate.

The size of one side of the organic EL element or the diameter of the hole can be 0.1 mm to several mm. The screen can be manufactured with a thickness of 2 mm or less. By providing many small holes in the screen, a sensory stimulation medium such as an air current can be passed. In order to increase the degree of freedom of the airflow discharge angle, it is desirable that the screen is thin. If it is thin, the airflow can be passed from an oblique direction.

In the example of the screen using LEDs, as shown in FIG. 27C, a display element (11; LED) is provided on the back side substrate (12B), and the transparent front side substrate (12C) is covered so as to cover the display element. And a hole (02) penetrating the two substrates may be provided, and the flange of the hole may be sealed with a tube (02a). Tempered glass, reinforced resin, etc. can be used for the transparent substrate (12C). You can walk on the screen.

The display element may be a non-light emitting display element such as a liquid crystal. For example, as shown in FIG. 10A, the screen (10) is an element that controls the passage or blocking of light between the front substrate (12C) and the back substrate (12B), for example, a liquid crystal display device. (11; LC) may be provided, and a hole (02) penetrating the two substrates may be provided between the display elements of the two substrates, and the hole ridges may be sealed. Can be manufactured extremely thin. Of course, the periphery may be hermetically sealed so as to include the ridges of the holes.

Light can be irradiated (backlit) from the back side of the screen, and an image can be displayed on the surface. The image may be formed by a set of light passing elements or a set of light blocking elements. In the case of forming with a set of light blocking elements, natural light is used for the backlight, and a shadow pattern can be displayed on the wall and floor on the user side (FIG. 10C). At this time, outside air can be taken from the set of holes. Moreover, as shown to FIG. 11 (A) (B), you may comprise so that a printing sheet screen (10) may be illuminated.

The display element may be a light emitting display element that irradiates a phosphor with electrons. For example, as shown in FIG. 18, the screen (10) includes an electron emission portion (DEN) and a phosphor (KEI) between a front substrate (12C; front substrate with lens 12D) and a back substrate (12B). A display element (11) is provided, and a hole (02) penetrating the two substrates is provided between the display elements, so that the hole can be sealed. In this figure, 12C and 12B are bonded together in order to make the light emitting portion (18) vacuum. Therefore, parts other than the hole ridges are also sealed.
Thus, the display device can be applied to a field emission display (FED) or a surface conduction electron emission display (SED).

The function of the sealing part (SL) of the hole ridge will be described. As shown in FIG. 9A, this structure acts so that air, moisture, dust and the like do not enter between the two substrates from the hole. Thereby, the reliability of an element improves and cleaning is also easy. An adhesive may be used for the sealing. An ultraviolet curable adhesive can be used. The hole ridges may be dissolved and bonded. Further, after bonding the front substrate and the back substrate, a hole may be formed in the bonding portion between the display element or the pixels.

Moreover, when the backlight (11 (LED)) is used, the sealed structure of the hole (02) in the hole (02) using the tube (02a) shown in FIG. 11 (B) leaks light to the outside. Acts not to. Light irradiates only the front substrate (12C). The picture (Img) drawn on the front substrate is illuminated. A light absorbing material may be applied in the vicinity of the hole, or a light diffusing reflector for reducing the luminance change in the vicinity of the hole may be applied.

As described above, the present invention has a feature that a screen having many holes can be configured to be thin. Thereby, the sensory stimulation medium or the reference medium can be appropriately passed .

<Description of Technology for Manufacturing Thin Screen with Hole Using Arrayed Display Element with Lens>
As shown in FIGS. 9E, 14 to 18, 20, 21, and 27, the screen (10) is a display element (11) provided in an array on a substrate (12, 12B, 12C). The display element has a structure in which the light emitter (18) is enlarged by the lens (19), and the hole (02) can be provided between the lenses.

As shown in FIG. 16B, the lens (19) has a light main emission surface (19k), and the hole (02) can be provided on the substrate so as to avoid the light main emission surface. That is, the tip of the hole can be provided behind the main light emission surface. Alternatively, as shown in FIG. 27C, a hole (02) or a tube (02a) connected to the hole in a cone (Light) connecting the light emitter (18) and the light main emission surface (19k). Can be configured not to enter. The light main emission surface can be formed by the structures of 18 and 19 and the concave mirror Ref.

As shown in FIGS. 9E, 16 and 18A, the display element (11) integrates a plurality of light emitters corresponding to colors, and enlarges the integrated light emitter (18). A lens (19) can be provided. That is, the light emitter with a lens can be a pixel. The light main emission surface (19k) means a surface on which the illuminant appears enlarged.
As the display element, a type that emits light itself such as LED and EL, or a type that does not emit light itself but emits light by a backlight, such as liquid crystal, can be applied. The driver circuit for the display element may be provided at a location away from the element.

As shown in FIGS. 9E and 18, the substrate is composed of a front substrate (12C) and a back substrate (12B). A light emitter (18) is provided between the substrates, and the light emitter is enlarged so that the light emitter is enlarged. Lenses (19) can be formed in an array on the substrate. That is, a sheet-like lens array (12D) or a lenticular lens may be used.

In the case where the cross section of the front side substrate is composed of a mountain (lens portion) and a valley, a hole can be provided in a portion corresponding to the valley. Moreover, when it does not have the said peak and trough, a hole can be provided between optical main emission surfaces (19k). A screen using the front substrate and the sheet rear substrate of the sheet lens array can be configured with a thickness of several mm. The screen structure can efficiently pass the sensory stimulation medium while maintaining fine visual characteristics.
Here, the lens tip may not necessarily be spherical. As shown in FIG. 16D, the lens (11) has a cylindrical structure, and the tip of the cylinder becomes the optical main emission surface (19k) by the concave reflecting mirror (Ref) provided behind the light emitter (18). It may be a structure. Further, a structure in which a light diffusing material (88) is provided around the light emitter and the light main emission surface is formed by the diffusing material may be used.

In any case, since the illuminator (18) is magnified by the lens, the illuminator area can be made sufficiently smaller than the optical main emission surface of the lens. That is, the light emitters are discretely arranged on the substrate, and the holes can be provided away from the light emitters. Therefore, the formation of holes does not adversely affect the light emitter. Further, the hole ridge can be tightly sealed so that outside air does not enter between the two substrates (FIGS. 9E, 16A, and 18).

When an LED is used for the display element, as shown in FIG. 16, it is easy to provide a hole in the substrate, and the degree of freedom of the screen configuration is high. A large screen can be configured by arranging several tens to several hundreds of LEDs on a single substrate (12) to form a screen unit and connecting them side by side in the vertical and horizontal directions. Since the screen can be used for a wall or a partition according to the shape of the room, it is suitable for an immersive display device.

<Description of technology that presents various airflows with controlled temperature and humidity>
In the present invention, as shown in FIG. 26 and FIG. 27, the gas that is an olfactory stimulus or skin tactile stimulus medium is released from the back side of the screen to the front side (user side) through the hole of the screen, and from the front side. It may be designed to be discharged to the back side .

As shown in FIG. 27 (A), the screen can be configured to surround the user by bending or plural, and gas is released from a hole provided in a part of the screen and used gas from other screens. Can be discharged. Therefore, an airflow can be created between the screens. Moreover, the atmospheric pressure generating means (01 or 65) using the impeller can switch between the airflow emission and the exhaust. Therefore, the air flow direction can be freely and accurately controlled. If the position of the user is detected and an airflow is generated where the user is standing, the expression of the wind (tactile presentation) is possible.

In the immersive large screen display device, the user's work space is surrounded by the screen, so that odors and air are easily contaminated. If the scent presented before remains, it is difficult to switch the scent, but in the present invention, the gas released from one screen can be sucked and discharged on another screen, so the scent and atmosphere can be switched at high speed it can.

The gas can be released by heating, cooling, humidification, or dehumidification. Indoor air can be sucked (discharged) from the screen and released as hot air, or released as cold air. As shown in FIG. 26G, the gas discharge part (01) and the exhaust part (65) of the air conditioner (Aircon) can be brought into close contact with the back side of the screen (10).

<Explanation of technology for releasing gas from the screen>
A plurality of small holes can be provided on the display screen, and a cylinder (for example, 06 in FIG. 6) or an airflow tube (02a to 02e in FIG. 1) for allowing the sensory stimulation medium to pass therethrough can be provided behind the holes. . The sensory stimulation medium can be released from the hole in a predetermined direction by increasing the pressure of the tube or the airflow tube. A virtual gun barrel (for example, 05 in FIG. 1) can be formed by providing the airflow tube in a plurality of holes and causing the airflow passing through the tube to interfere with each other. That is, as shown in FIGS. 1, 4, 5 (A, C), 6, 7, 12 (B), 14, 15, and 19, the assembly of airflow tubes is a cannon. The gas can be released as a mass (04). Moreover, you may provide a cylinder so that a some hole may be surrounded. An airflow passage material such as a mesh material (mes in FIGS. 11 (F) and 27 (D)) may be provided in front of the hole .

The chemical substance-containing gas may be released from the hole or a part of the airflow tube. It can be released as a mass of gas by interfering with the gas emitted from the surrounding holes or tubes (FIG. 6). The gas masses fly near the user without diffusing chemicals.
If different scents are emitted from the plurality of holes or airflow tubes, they are mixed in the air. From the screen, various kinds of scents can be switched at high speed or mixed and presented to the user.

By combining the means for measuring the user's position, the means for guiding the user to the virtual barrel position on the screen, and the means for detecting or predicting the user's inhalation, the user can be contacted, scented, Chemical substances (including pharmaceuticals) can be quantified and presented or ingested (FIG. 19). With regard to user guidance, it is possible to display a highly attractive and interesting image at the position of the virtual cannon, or to emit a sound that draws interest from the position.

Since holes or airflow tubes can be provided at various locations on the screen, as shown in FIGS. 26 (D) and (F), by changing the combination of holes or airflow tubes used, the virtual cannon The position of (05a, 05b, 05c) can be changed. In the screen, the airflow release location can be changed.

The hole (02) or the airflow pipe (02a, 02b,...) Is preferably configured so that the aperture ratio (YAS) is 10% or more (FIG. 5D). The length of the hole (airflow tube) is preferably at least twice the diameter of the hole (FIG. 1).

As described above, since the gas coming out of each hole interferes with each other (FIG. 5C), the airflow can be applied to the user on a large surface, and the gas can be heated or cooled. It can realize skin touch like natural wind.

When YAS is 20% or more, the gas in the cannon is instantaneously compressed, so that the center portion of the cannon is fast and the peripheral portion is slow, so that a vortex is generated around the cannon and a vortex ring is formed (FIG. 4A). ). The vortex ring has the property of flying forward without breaking its shape. When a scent is mixed into the vortex ring, efficient olfactory presentation is possible. The scent can be pinpointed to remote users. From the screen, you can get a mysterious feeling of the fragrance popping out.

As shown in FIGS. 1C and 1D, the compression plate (51) is driven by a method of rapidly pushing and pulling slowly (K1) and a method of pushing and then quickly pulling (K2). . In K1, a vortex ring in the rotational direction shown in FIG. 4 is generated, and in K2, a vortex ring in the opposite direction is generated. K2 is less prone to residual gas bands.

As shown in FIGS. 1, 2, 3, 6, and 7, a chemical substance supply means (30, 36 </ b> A, 36 </ b> B, 36 </ b> D) and the supply are provided in the hole or the airflow pipe provided in the hole. Means for controlling A fog generator can be used for the chemical substance supply means. You may provide directly in the said hole and may provide in the pipe wall of an airflow pipe.

As a fog generating device, a method of atomizing a liquid by ultrasonic vibration (ultrasonic atomization method; FIGS. 6B and 6C), a method of atomizing a liquid by tearing it with a high electric field (static) Electromist atomization method), a method in which a liquid is put into a narrow gap and a pressure is applied to the liquid by a piezo element (piezoelectric element) to discharge a droplet from the gap (piezo method; FIG. 6 (D)). A method in which a liquid is put into the gap and an instantaneous pressure is applied to the liquid by an electrostatic pressure element to discharge a droplet from the gap (electrostatic pressure method). A method (thermal method) that evaporates the mist and releases mist from the gap by the pressure can be used.

As means for releasing the mist, in addition to the method of extruding with an air flow as described above, an ultrasonic traveling wave may be generated in the air flow tube or the gun barrel, and the fine mist particles may be extruded with the sound pressure.

<Description of technology for releasing fragrance from the three-dimensionally displayed image>
As shown in FIG. 9C, FIG. 19, FIG. 25, FIG. 26, and FIG. 27, a plurality of means (01, 60, 61, 63) for releasing the sensory stimulation medium from the holes in the screen are provided, and the object (FIG. 25 By selectively driving the sensory stimulus medium emitting means in the vicinity of the position where Obj) is visually perceived, the sensory stimulus medium corresponding to the object can be presented .

The object is a virtual thing created by video. Objects that generate scent, wind and sound can be used. Further, it may be an abstract concept that causes attractiveness, such as an image in which ripples spread around a predetermined place or an image in which a color changes. Specific examples will be described later.

As the object display means, two-dimensional video display means and three-dimensional (stereoscopic) video display means can be used. As the latter, there are computer graphics (CG) means (FIG. 25 (B)) that displays a perspective image by perspective projection conversion of a three-dimensional world model, and binocular stereoscopic means that displays parallax images on the left and right eyes. Available. As specific examples of the binocular stereoscopic means, a lenticular lens method (FIG. 20), a polarized glasses method, a time-division glasses method (82 in FIG. 25B), and the like can be used. Alternatively, display means (FIG. 25C) for direct drawing by converging and irradiating a laser in a space to generate plasma discharge may be used. In either case, the sensory stimulation medium is released from the screen near the position where the object (Obj) is visually perceived.

A means for detecting the position of the user (observer) (70 in FIG. 26) can be used in combination. It is possible to select and drive the sensory stimulation medium discharge means having a short distance from the line segment connecting the position where the object is visually perceived (Obj in FIG. 25) and the observer position (P1). The position at which the object is visually perceived is a space in the case of binocular stereoscopic vision and on the screen in the case of monocular vision. In the case of monocular vision, it is possible to select a sensory stimulus medium emitting means near the object on the screen.

In the case of binocular stereoscopic vision, the object appears to be localized in the space before and after the screen (Obj-P in FIG. 25B). That is, the object is perceived at a position different from the right eye image and the left eye image displayed on the actual screen. Therefore, when a speaker near the image position on the screen is selected, the sound generation position may be shifted from the visual perception position of the object. Therefore, in the case of binocular stereoscopic vision, a speaker near the object position perceived in space can be selected, or a line segment (broken line 58) connecting the object position (Obj-P1) and the user position (P1) is displayed. A speaker (63-2 in FIG. 25B) near the position where it intersects the screen can be selected.

The angle may be controlled so that the sound wave is emitted toward the user. A directional speaker such as an ultrasonic speaker can be used as the speaker. By providing a hole in the thin screen, sound waves can be presented not only in the direction perpendicular to the screen but also from an oblique direction (FIG. 23).

Of course, in order to change the perceived direction of the sound, it is possible to change the phase of the sound emitted from a plurality of speakers or adjust the volume. For example, as shown in FIG. 25 (B), when the speaker cannot be arranged in the immediate vicinity of the object (Obj-P2), the relatively nearby speaker (63-3) and the surrounding speaker (63-4) are selected. The sound image can be reproduced by adjusting the phase or volume of a plurality of speaker sounds and moving the sound image. Even in this case, a much higher sense of realism can be obtained as compared with the case where a speaker is arranged outside the screen as in a conventional display device.

<Effects mainly related to claims 1 to 3 and 5>
Since holes that are difficult to see on the screen are provided, means for releasing the sensory stimulation medium from the back side of the screen to the front side can be provided at various locations on the screen. Therefore, the video display as if sensory stimulation media such as olfactory stimulus (fragrance), skin tactile stimulus (wind, fog), auditory stimulus (acoustic), visual stimulus (mist, smoke), etc. pops out from the object displayed on the screen. A device can be realized. The presence effect is high (FIG. 13).

By providing a plurality of small holes on the screen and providing a tube or tube for passing the sensory stimulation medium behind the holes, the non-visibility of the hole and releasing the sensory stimulation medium in a predetermined direction The characteristics to be improved. If an airflow passage material such as a mesh material is provided in front of the hole, the invisibility is further increased. As a result, the presence effect is further improved.

Reference medium discharge means for detecting the user's sensory stimulation medium presentation site can be provided at various locations on the screen. Conventionally, on a large screen, it is difficult to detect the position of the user in front of the screen, but in the present invention, the position of the part is detected using a reference medium that passes through a hole in the screen, and therefore the position detection accuracy is high. There is an effect that the sensory stimulation medium can be appropriately presented to the user.
For example, based on the user's detection position, the user can be guided to a predetermined location on the screen by video or audio, and the scent can be presented from the screen in front of him. Further, according to the movement of the user, it is possible to continue to present the scent by switching a plurality of scent discharge devices provided on the back of the screen so as to follow the user.

As described above, the distance between the user and the scent discharge device is significantly shortened in the display device in which the scent discharge device is provided in the screen of the present invention as compared with the display device in which the scent generation device is provided beside the conventional screen. Because it is possible, the scent presentation accuracy to the user is much higher. In addition, since the scent can be presented to the user without diffusing, the rising characteristic of the olfactory stimulus is very clear. Similarly, with respect to skin tactile stimulation, the rising characteristics are clear with high precision. The larger the screen, the higher the effect.

When the diameter of the hole provided in the screen is 0.1 mm or more and the viewing angle is within a range of 0.5 degrees or less (at a normal viewing distance of 0.25 degrees or less) at the shortest viewing distance, an image (character, picture, There is an effect that a sensory stimulation medium such as a fragrance (olfactory stimulation) and air flow (skin tactile stimulation) can be appropriately presented to the user without breaking the intended meaning of symbols, advertisements, movies, and the like (FIG. 17). (E)). Further, since a cleaning liquid such as water can be passed through the hole, the hole can be cleaned, and there is an effect of good maintainability. Furthermore, when the aperture ratio of the hole assembly portion is 10% or more, there is an effect that it can be appropriately presented to a user who has left the scent or the wind, or the direction can be determined (FIG. 5D). )).

As shown in FIGS. 9C, 16, 20, 21, 26, and 27, in a situation where the user faces the screen, the user irradiates the face with reference light from the screen, and reflects the reflected light. Is captured by a camera in the vicinity of the light source. In addition, since the camera is fixed in the screen, conversion between the camera coordinate system for measuring the feature point position and the display coordinate system can be performed at the time of manufacture. Therefore, the position of the user's sensory stimulation medium presentation site (eye, nose, ear, face, hand, etc.) can be easily detected with high accuracy.

For this reason, it is possible to accurately realize kinematic display without wearing a three-dimensional position sensor or the like. By combining the present invention with a lenticular lens, binocular stereoscopic display can be accurately realized without wearing special glasses. In addition, there is an effect that a sensory stimulation medium such as fragrance, airflow, and sound wave can be accurately presented to the user.

In an environment where the user is facing a large screen, the gaze point can be detected with high accuracy over a wide range. A gaze target (object) can be estimated using the gaze point information (FIG. 21 or FIG. 26F). In addition, psychological information such as interest in videos can be extracted. By presenting a video or a sensory stimulation medium based on the information, the realistic effect effect is extremely large.

Since the sensory stimulus medium is released from the screen in the vicinity of the position where the object is visually perceived, the understanding of the object is deepened and the sense of reality is also improved (FIG. 13).
As an application of the present invention, for example, a scene of a plum tree swaying in the wind is expressed as a spring landscape image, and when approaching that plum, the scent of the plum is presented from the flower, the spring wind is presented tactilely, and the tree stops on the tree. It is possible to realize a display device in which the voice of the frog is presented from the place. Moreover, the image of the coffee cup is displayed on the screen, and when the observer approaches the coffee cup, the scent of coffee can be presented.

Since the screen using the screen is thin, the same effect as the display device in which the screen with holes is thin is obtained. Since it is easy to provide many small holes on the screen, the non-visibility of the holes and the passage characteristics of the sensory stimulation medium are particularly excellent. Moreover, since it is inexpensive, there is an effect that the screen can be replaced or disposable according to the purpose.

<Effect mainly related to claim 4>
The screen is configured by providing a display element or illumination element between two substrates consisting of the back side and the front side, and providing a hole penetrating both substrates between the display element or illumination element. It is thin. Since the screen with holes is thin, the resistance when the sensory stimulation medium passes through the holes is small, and the sensory stimulation medium can be released in various directions from the back side (FIG. 9D, FIG. 23, FIG. 24). There is an effect that the sensory stimulation medium can be aimed and presented in a direction in which the user is present. For example, scent, wind, fog, smoke, etc. can be presented to follow a person passing in front of the screen.

Since the resistance is small, a small and low-output airflow generating means can be applied, and airflows coming out of a plurality of holes easily interfere with each other, and there is an effect that gas can be released as a mass. It can carry a lump of fragrance far away.

Since the hole ridge is sealed, the display element or the lighting element is highly reliable without being exposed to the outside air. In addition, a screen using a light-emitting element tends to generate heat in the element or the drive circuit, but the screen is thin and the air holes have good heat dissipation characteristics, so that there is little deterioration of the element and high durability.
When the sensory stimulus passes through the hole in the screen, the hole may become dirty. However, since the screen is thin, the hole can be easily cleaned, and the maintainability is good.

When an airflow tube or a tube is provided in a hole penetrating the back substrate and the front substrate, light from the display element or the lighting element can be prevented from leaking from the hole (02a in FIG. 11B). This structure has an effect of displaying an image with high visibility in a display device using a backlight (FIG. 11D).

Since light is emitted in a predetermined direction by the lens, it is dark without being illuminated between the lenses, and the hole provided therebetween is difficult to perceive. Further, since the light emitter (18) is enlarged by the lens, the light emission surface can be enlarged even if small light emitters are discretely arranged (FIGS. 16B and 18). Therefore, it is possible to sufficiently secure the hole and the area for sealing the periphery of the hole without affecting the display element. In addition, there is a feature that an airflow tube or the like is easily provided in the hole.

The above features have an effect of appropriately passing the sensory stimulation medium while realizing a bright, fine and reliable screen. Moreover, since the degree of freedom is large in the shape and size of the hole, there is an effect that various sensory stimulation media such as fragrance, fog, smoke, and sound wave can be accurately presented to the user.
Further, the screen can be made thin by using a lens array sheet on the front substrate. The effect that the screen is thin is the same as the effect of the above means. In other words, both the visual characteristics and the passage characteristics of the sensory stimulation medium are excellent, the discharge direction of the medium can be controlled, the gas can be released as a mass, easy to clean, easy to maintain, reliable and durable. A high display device can be realized.

<Effect mainly related to claim 6>
As shown in FIG. 26 and FIG. 27, sensory stimulation media such as scent, wind, and fog can be released from various locations on the screen to the user, and the used media can be discharged. The atmosphere can be switched at high speed. In movies and other story-like videos, the expression (scene) changes frequently, but it is possible to follow the changes in the scene and change the atmosphere of the scene, so that the content of the story can be understood, and the sense of reality Has the effect of improving.

As shown in FIG. 27, when the user is surrounded by the screen of the present invention, airflow can be accurately presented from various directions such as front and rear, left and right, and up and down. By detecting the place where the user is standing and presenting the airflow, there is an effect that a high sense of presence such as a feeling of being blown by the wind can be obtained.

As shown in FIG. 26G, since air in a room can be taken in (exhausted), heated, cooled, humidified, or dehumidified and released, it can be used as an air conditioner that can display an image. Since the walls, ceiling, and floor of the room are display devices and atmosphere control devices, the space can be used effectively.

<Effect mainly related to claim 7>
As shown in FIGS. 1, 2, 3, and 6, the plurality of holes provided on the screen constitute a virtual barrel, that is, the barrel is not shaped when viewed from the front of the display surface, Since there is an action of a cannon that discharges gas as a mass, or an action of discharging after rectification, the gas is transported far. There is an effect that fragrance, wind, etc. can be efficiently presented to a user away from the screen. Less fragrance is used and it is economical, and there is an effect of less residual fragrance.

Since a scent discharge device can be provided in the hole in the virtual cannon or the airflow tube provided in the hole, extremely many kinds of scents can be switched and discharged. For example, if tens to hundreds of scent discharge tubes are provided in the hole, thousands of scents can be presented by changing the combination of selections. In addition, the scent can be switched at high speed. Therefore, the presence effect is high.

Since the position of the virtual cannon can be changed by recombination of the hole or the airflow tube, there is an effect that the scent can be presented so as to follow the movement of the user (FIGS. 9C and 26E). )).

In addition, the present invention can guide the user to the gas discharge location in the screen and release the gas mass at the time of inhalation, so that it is possible to realize a device for quantifying and ingesting fragrances, medicines, chemical substances, etc. without contact . There is an effect that pharmaceuticals can be administered simply and hygienically. If healing images and high-concentration oxygen are administered, fatigue can be removed, and if influenza vaccine is administered, there is a disease prevention effect.

<Effect mainly related to claim 8>
Further, the following effects are obtained in the stereoscopic image display.
In the motion video, the position of the object changes as the user moves, but the sensory stimulus medium emitting means near the image is always selected. In the binocular stereoscopic image and the space drawing image, the sensory stimulus medium emitting means near the object position perceived in space is selected. Therefore, there are few contradictions in the plurality of presented sensory stimuli. If the sensory stimulus is different from the actual sense in the five senses, it may cause discomfort and fatigue, but the present invention has few contradictions, so it has a natural, high sense of realism, little fatigue, and no fatigue even after long use. is there.

In 1st Example of this invention, it is a display apparatus with a fragrance presentation function. It is sectional drawing of a fragrance supply part by the component of the said 1st Example. It is the other structural example of the said fragrance supply part. It is a figure explaining the vortex ring production | generation principle and the mixing method of fragrance. It is a figure explaining the gas rectification effect | action of the gun barrel comprised with many holes provided in the screen. In 2nd Example of this invention, it is a display apparatus with a fragrance presentation function. In 3rd Example of this invention, it is a display apparatus with a fragrance presentation function. 4 shows a display device with an exhaust function according to a fourth embodiment of the present invention. The fifth embodiment of the present invention is a display device with a sensory stimulation medium presentation function using an EL element. In the sixth embodiment of the present invention, there is provided a display device with a sensory stimulation medium presentation function using a liquid crystal element. In the 7th Example of this invention, it is an experimental result explaining the display apparatus with a sensory stimulus medium presentation function which irradiates a screen back, and an effect. The eighth embodiment of the present invention is a display device with a scent presentation function using a projector screen. It is an experimental result explaining the effect of this invention which presents a sensory stimulus medium from a screen. In the ninth embodiment of the present invention, a display device with a scent presentation function, which constitutes a display element (pixel) using a light emitter and a lens. The tenth embodiment of the present invention is a display device with a scent presentation function that constitutes a display element (pixel) using a light emitter and a lens. In the eleventh embodiment of the present invention, a display device with a sensory stimulus medium presenting function which constitutes a display element (pixel) using an LED and a lens. It is a simulation experiment result which determines the tolerance | permissible_range of the hole diameter provided in a screen. In a twelfth embodiment of the present invention, a display device with a sensory stimulus medium presenting function, which comprises a display element (pixel) using an electron emission phosphor. A thirteenth embodiment of the present invention is a display device with a sensory stimulus medium presentation function used as an electronic signboard. In a fourteenth embodiment of the present invention, a display device for detecting a sensory stimulation medium presentation site or a gaze point of a user using a near-infrared reference light and presenting the sensory stimulation medium, and a motion CG image Are a display device and a binocular stereoscopic display device. It is a front view of the 14th embodiment. It is an example of the display element drive circuit of the said 14th Example. A fifteenth embodiment of the present invention is a display device with a sound presentation function. In the sixteenth embodiment of the present invention, the display device presents a three-dimensional sound from a hole provided in a thin screen. In the seventeenth embodiment of the present invention, there is provided a display device in which a plurality of sensory stimulation medium discharge means provided on a screen are selectively driven. In an eighteenth embodiment of the present invention, an immersive display device using a plurality of screens for detecting a user's sensory stimulation medium presentation site or a gazing point and presenting a scent, airflow, and sound. In the nineteenth embodiment of the present invention, an immersive display device using a plurality of screens for detecting a user's sensory stimulation medium presenting portion or gaze point and presenting a scent, air current, and sound from the front, back, left, and top and bottom It is. It is a conventional immersive display device.

01, 01A, 01B ... Gas discharge device, fragrance discharge device 02 ... Tubes 02a, 02b, 02c, 02d, 02e provided on the screen (gas release tubes, etc.)
02S ··· Air discharge tube 04 ··· Vortex ring 05 ··· Opening or virtual gun tube 06 · · · Gun tube 07 ··· Pressure generating means 08 ··· ..Air tank 09... Instantaneous pressure generation mechanism 10, 10-1, 10-2, 10-3, 10-4, 10-5 .. Screen 11... Display element or pixel Or, lighting element 12... Substrate 12B... Back substrate 12C... Front substrate (transparent member)
12D... Lens-side front substrate 13... 11 drive controller 14... 40 drive controller (fragrance supply control)
15 ... Heating control device (vaporization acceleration control)
16 ... Drive control device (atmospheric pressure control)
17, 17L, 17R ..Viewpoint position 18 ... Light emitter (LED, EL element, etc.)
DESCRIPTION OF SYMBOLS 19 ... Lens 19k ... Optical main emission surface 20 ... Bimorph type piezoelectric element 21 ... Metal plate 22 ... Piezoelectric plate 27 ... Screen 28 ... Projector screen
29... Projector 30... Fragrance supply unit 31. Fragrance storage mechanism 32... Tube 33 with a hole in the side surface. Magnetic material)
34 ... Tube-type air flow control plate with closed end (magnetic material)
35... Spring 36, 36 </ b> A, 36 </ b> B, 36 </ b> D... Fragrance supply unit 37 for supplying fragrance into the discharge pipe 02 fragrance discharge pipe 38 provided with a fragrance intake hole (Hol 1) ..Scent transport pipe 39 ... Electromagnetic drive mechanism 40 ... Electromagnet 41 ... Magnetic body pipe 43 ... Exhaust pipe 45 ... Mesh mechanism (electromagnetic drive mechanism Mounting part)
46 ... Air collection mechanism 47 ... Fan
48 ... Exhaust device 49 ... Pressure reducing means 50 ... Instantaneous pressure generating mechanism 51 ... Compression plate 52 ... Electromagnet core 53 ... Electromagnet 54... Bellows mechanism 55... Servo motor 56... Link mechanism 57 .. columns 58 and 59 .. straight lines 60, 60-1 and 60 connecting the object and the observer -2 ・ ・ Sound presentation device (ultrasonic speaker)
61... Sound presentation device (small directional speaker)
62... Rotation control mechanism 63... Spherical integrated speaker 64... Small speakers 65, 65-1, 65-2 .. Gas discharge device 66. 68..Communication device 69 ... Slit 70 ... Stereo image measuring device 71 ... Feature point extraction device 72 ... Camera 73 ... Image sensor (CCD , CMOS, etc.)
74... Camera lens 74 a... Pinhole lens 74 b... Camera lens 75 provided on the substrate 12 D. ... Near-infrared light emitting element 78 ... Drive circuit (wiring)
79 ... Observation camera 81 ... Fragrance container 82 ... Stereoscopic glasses (liquid crystal shutter glasses or polarized glasses)
83 ... Retroreflective material 84 ... Camera 85 ... Motor 86 ... Front side substrate support 87 ... Air tank 88 ... Light diffusion Material 89... Air flow switch 90... Porous material cores 91 and 92... Piezoelectric vibrator 93... Atomization head 94. .... Fine nozzle 96 ... Holding mechanism 97 of piezoelectric vibrator ... Blower 98 ... Hole 99 ... Display element drive circuit or video control device Air ...・ Air Aki, Yoshi ・ ・ ・ Passers with mobile terminals a, b, c, d, e ・ ・ Perfume CN ・ Connector Cooler ・ Cooler Dis ・ ・ ・ ・ Distance between display elements DEN ・ ・・ ・ Electron emitting part DT ・ Directional signal generator E ・ ・ ・ ・ ・ ・ Power supply EL (IR) ・ Organic EL Or, OLED (near-infrared)
EL (R) ·· Organic EL or OLED (red)
EL (G) ·· Organic EL or OLED (green)
EL (B) ·· Organic EL or OLED (blue)
End ... End of tube Frg ... Perfume-containing gas (fragrance)
F1, F2, ... Airflow Gaz1, Gaz2, ... Gaze GD ... Grounding HT, Heater ... Electric heaters Hol1, Hol2, Hol3 ... Hole Ins ... Insert Img ... Images ( Video)
ImgSD ·· Shadow K1, K2 ·· Compression plate operation mode KEI ··· Phosphor Kaori ·· Light generating device Light, LG1 to LG6 ··· LC ··· Liquid crystal display element LGR ··· Reference light LGA ··· Photography light ma · Fog mes containing perfume a · · · Airflow passing material mis · · · Mist mist · Mist generator Move · · · Operation of compression plate Obj · ... Objects (virtual objects)
P1, P2, P3, P4 ··· Piezo ··· Piezoelectric device Pix ··· Pixel Laser ··· Laser drawing device Ref ··· Concave mirror Load ··· Path SG1 ··· Receiver SG2 ···・ Information processing device SL ・ ・ ・ Sealed part Sm ・ ・ ・ Scent discharge device Wd ・ ・ ・ Blower Sd ・ ・ ・ Speaker SWH, SWL Drive circuit Tube ··· Tube Ue ··· Portable terminal Wa · · · Liquid Wb containing fragrance a · · · Liquid YAS containing fragrance b · · · Opening ratio; Of area where gas actually passes to the inner circumference area

Embodiments of the present invention will be specifically described.

FIG. 1 shows a display device with a scent presentation function according to a first embodiment of the present invention. FIG. 4A is a front view of the apparatus and a display screen, and FIG. 4B is a longitudinal sectional view of the apparatus. 01 is a gas releasing device that emits a scent, and 10 is a board-like screen. Details of the apparatus configuration will be described.

Reference numeral 11 denotes a display element that constitutes a pixel (Pix). As the display element, an LED, an organic EL element (OLED), a plasma discharge tube, a small CRT, a liquid crystal, or the like can be used. Reference numeral 12 denotes a board-like substrate on which 11 is mounted. A circuit and wiring for driving 11 are provided inside 12. 11 is connected to the drive circuit. The 12 can be made of plastic (molded resin), glass, carbon material, FRP, light metal, wood, or a combination thereof. Thin is desirable.

Reference numeral 13 denotes an eleven drive control device. The light amount of the display elements 11 arranged in a matrix is adjusted by the device, and an image is displayed on the screen 10. A large-screen display device can be configured by arranging a plurality of board-like substrates 12.

Reference numeral 02 denotes a hole provided between the display elements 11 in the substrate 12. A gas or a sound wave that generates a scent or skin touch is passed through the hole. Moreover, the reference light for detecting a user's sensory stimulation medium presentation site (eye, nose, ear, face, hand, etc.) is passed. The hole is configured such that the screen side (left side) is small and the back side (right side) is large. The hole 02 acts as a sensory stimulation medium such as gas or sound wave, or a guide for reference light. 02 is provided densely in a predetermined range (opening 05), and is configured such that atmospheric pressure is applied to the opening from the back side (right side) of the substrate 12.

In the hole 02, scent discharge tubes (02a, 02b,...) Are inserted. In this case, since the function of the hole is replaced by the pipe, means 07 for applying an air pressure is provided at the rear of each pipe. Details of 07 will be described later. The length of the scent discharge tube (02a, 02b,...) Is configured to be at least twice the hole diameter on the screen side. Here, if the aperture ratio YAS of 05 is defined as a numerical value obtained by dividing the sum of the aperture areas of each hole (ΣOpen02i) by the area Area05 of 05, the gas emitted from 05 is rectified in a predetermined direction when YAS is 10% or more. The If YAS is set to 20% or more, 05 acts as a virtual cannon for releasing gas as a mass. Details will be described later.

In FIG. 1, the scent discharge tube 02i (i = a to e) is inclined toward the center of 05 in order to increase the aperture ratio YAS and to reduce the density of the central portion of the released gas. It is for raising and generating a vortex ring efficiently. The inclination angle of the outer 02i is about 20 degrees in the figure, but is preferably in the range of 0 degree (parallel to the axial direction of the center 02i) to about 60 degrees.

In the present invention, the size of the hole 02 provided in the screen is important. Depending on the viewing distance and the size of the screen, various hole sizes are possible, but it must be inconspicuous for people with standard vision. For this purpose, a smaller one is desirable, but if it is too small, the passage characteristics such as air are deteriorated, and removal is difficult when a foreign substance enters the hole.

Therefore, it is necessary to efficiently pass a sensory stimulation medium such as gas or sound wave and make maintenance easy. A hole diameter satisfying these conditions is 0.1 mm or more, and a viewing angle of 0.5 degrees or less at the shortest viewing distance, or 5 times or less of the size of the display element (11; pixel) can be applied. The maximum hole diameter can be determined by the size of the display device. In a large display device, the hole diameter may be 20 mm or more. The definition of the shortest viewing distance and the reason for the hole diameter will be described in detail later with reference to FIG.

Next, a method for allowing a scented gas to simultaneously pass through the plurality of holes 02 of the opening 05 and releasing the scent as a mass will be described. 36A is a scent supply part which supplies a fragrance | flavor to the scent discharge | emission pipe | tube (02a, 02b ...) from the outside.

FIG. 2 is an enlarged view of 36A and explains the scent supply operation. FIG. 2A shows a state before the scent discharge pipe 37 is connected to the atmospheric pressure generation means 07. A hole Hol1 for taking in the fragrance from the outside is provided in the tube wall 37, and the hole and the scent generating device Kaori are connected by a scent transport pipe 38. a, b, c, d, and e show each fragrance | flavor. Reference numeral 33 denotes a tube-type airflow control plate, which has a hole Hol2 in the tube wall and can be slid left and right inside 37. 33 is made of a magnetic material and is normally urged to the left by a spring 35. In this state, Hol1 and Hol2 are out of position, and the scent is not supplied into the scent discharge tube 37.

On the left side of 07, a mechanism for connecting the scent discharge pipe 37 and an electromagnetic drive mechanism 39 for operating 33 are provided. 46 is an air collecting mechanism. When 07 is driven, air Air is collected at 46, passed through 37 and released. 41 is a tube made of a magnetic material and is inserted into the right end portion 37 of 37. FIG. 2B shows a state where 37 and 41 are connected. Reference numeral 40 denotes a cylindrical electromagnet provided around 41. When 40 is energized, magnetic flux is generated in 41 and 33 is pulled to the right. This state is shown in FIG. In this state, the holes of Hol1 and Hol2 are connected, and the scent Frg is supplied into the scent discharge tube 37. The amount of fragrance supplied to 37 can be controlled by turning 40 on and off at high speed. This will be described in detail later with reference to FIG.

In FIG. 1 (B), when 33 is in a state like 02a, 02c, 2e, since Hol1 and Hol2 are connected, a fragrance | flavor passes through two holes and is taken in in a pipe | tube. This is indicated by a one-dot chain line Frg. On the other hand, when 33 is in a state such as 02b and 02d, Hol1 and Hol2 are not connected, and the fragrance is not supplied into the tube. Reference numeral 14 denotes a drive control device 40 having a function of controlling the supply of the fragrance. In the drawing, 14 is connected only to 40 of 02e, but it is natural that it is also connected to other 02i.

08 is an air tank, and 50 is an electromagnetic instantaneous atmospheric pressure generating mechanism. 50 includes a compression plate 51, a bellows type compression plate moving mechanism 54, an electromagnet 53, and a drive core 52. 51 and 52 are connected. When 53 is energized, 52 and 51 move to the left and right as indicated by arrow Move. Reference numeral 16 denotes a drive control device 53, which has a function of controlling the atmospheric pressure applied to the air tank 08.

FIG. 1D shows an instantaneous atmospheric pressure generation mechanism using a link mechanism instead of 50. In the figure, 55 is a servo motor, and 56 is a link mechanism for operating the compression plate 51. The servo motor can control the rotation angle and the rotation angular velocity.

FIG. 1C shows two types of operations of the compression plate 51. The vertical axis is 51 movements, and the horizontal axis is time. The operation mode of K1 shows a case where 51 moves to the left side rapidly, maintains the state for a short time, and slowly returns to the right side. In FIG. 1 (B), the rapid rise of 51 (leftward movement) instantaneously increases the air pressure in 08, and the air Air is sent to the scent discharge pipes (02a, 02b,...) As shown by the one-dot chain line. . At this time, since the scent is supplied to the tubes 02a, 02c, and 02e, the virtual barrel 05 emits a gas mixed with the fragrances a, c, and e.

Here, since the plurality of scent discharge tubes are provided in close contact with each other, the gases emitted from the tubes interfere with each other, and the gas behaves as if it exits the hollow tube. In other words, the gas released from the virtual cannon 05 creates a vortex along the periphery of the tube and becomes a tube-shaped vortex ring (a mass of gas) and flies forward (to the left in the figure). In particular, when the YAS is 20% or more, a vortex ring is likely to occur. The vortex ring flies while rotating in the direction shown in FIG. 4 <3>. Details will be described later.

The feature of the operation mode of K1 is supplemented. In a conventional air cannon, a method is used in which the compression plate is pulse-driven using an electromagnet. However, in this method, the compression plate is easily damped and oscillated. When the gas is repeatedly compressed by the vibration, the airflow is disturbed and a beautiful vortex ring is unlikely to occur.

The operation mode of K1 is an asymmetric one-way reciprocation with a fast rising and a slow falling, and does not vibrate, so that the conventional gas turbulence hardly occurs. A beautiful vortex ring is generated. Moreover, the gas can be made to fly straight away.

Further, since each tube constituting the cannon has an appropriate air resistance, when the asymmetric pulse driving is used, the fragrance remaining in the tube after releasing the gas tends to stay in the tube without coming out of the tube. That is, the inconvenience that a plurality of scents flow backward and mix in the air tank 08 hardly occurs. Therefore, even when the scent is repeatedly emitted, a clear scent can be presented.

The discharge distance of the gas mass can be controlled by the operation speed or the operation width of the compression plate. A scent can be appropriately presented based on the position detection information of the user described later.

The operation mode of K2 in FIG. 1C shows an operation (pushing 51 to the right) immediately after pushing the compression plate 51 to the left and immediately pulling the scent out of the barrel. In this operation mode, the movement of the gas in the center of the cannon is switched and rapidly moves to the right, so the vortex ring is in the direction opposite to the rotation direction shown in FIG. The entire vortex ring flies forward (left side of the figure) while rotating. Although control is complicated, there is an advantage that a residual zone of gas (residual scent) hardly occurs.

As mentioned above, although the case where a fragrance was discharged | emitted as a lump from the virtual barrel 05 was described, you may discharge | release lump of warm or cold air, fog, smoke, pharmaceutical containing gas, etc. A mass of scent can provide olfactory stimulation, and a mass of air can provide tactile stimulation.

In FIG. 1, the olfactory stimulation or tactile stimulation means can be controlled to be interlocked with the image on the screen 10. For example, when a fruit image is displayed on the screen and the scent of the fruit is presented from the inside of the screen on which the fruit is displayed, the sense of reality is improved. Since the scent supply unit 36A can control the scent supplied to the scent discharge tube in a minute amount, the scent release device 01 can release the scent by switching the type of scent at a very high speed. Therefore, even when various scent generating objects (flowers and the like) are displayed one after another, a scent suitable for the scene can be appropriately presented.

Also, when the gas release rate is increased and the skin is released so as to produce an impact force, the ball of gas is released continuously or when it is released with fluctuations, the natural wind, the face from the vehicle window. It can express the wind when it is out. In addition, warming the mist and releasing it with the smell of sulfur can produce the atmosphere of traveling in a hot spring resort. Moreover, when the mist is cooled and released, it is possible to produce an atmosphere like walking in a snowstorm.

FIG. 3 shows a scent supply unit 36B that can be used instead of 36A in FIG. The scent discharge pipe 37 is provided with a hole Hol1 for connecting the scent transport pipe 38 and a hole Hol3 for taking in the gas. Although only two locations of Hol3 are shown in the figure, a plurality of Hol3 are provided around the tube wall. Reference numeral 34 denotes a tubular airflow control plate. A hole Hol2 is provided on the tube wall so as to be able to counter the hole Hol3 of 37. The right end of the tube is closed. The said 34 can be slid right and left inside 37, and a material is comprised with a magnetic body.

37 is attached to the left side of the atmospheric pressure generating means 07. Ins mates with End at the outlet. 46 is an air collecting mechanism, and 40 is an electromagnet for driving the airflow control plate 34. 45 is a mesh mechanism for holding 40, and allows air to pass through.

3A shows a state where the scent discharge pipe 37 and the atmospheric pressure generating means 07 are separated from each other, and FIG. 3B shows a state where 37 is attached to the air tank 08. FIG. In FIG. 3 (B), since Hol1 and Hol2 are out of position, no scent is supplied into 37. Here, when 40 is operated and the airflow control plate 34 is moved to the left side, as shown in FIG. 3C, Hol1 and Hol2 are connected, and the fragrance is supplied into 37 as shown by a one-dot chain line Frg.

Next, when a current flowing in 40 is reversed to generate a magnetic field in the opposite direction, and 34 is moved to the right side, Hol3 and Hol2 are connected as shown in FIG. Here, when 07 is operated, the air Air passes through the mesh mechanism 45 and is sent to the scent discharge pipe 37 like a one-dot chain line. The fragrance Frg supplied to the 37 passes through the air 37 together with the air Air and is pushed forward. The scent supplied from Kaori to 37 may be fog. 3 (C) and 3 (D), ma indicates a mist containing the fragrance a.

In FIG. 3, since the scent is supplied immediately before the air is passed through the scent discharge tube 37, the scents are rarely mixed even when a plurality of scents are switched and released at high speed. In addition, since the scent does not flow back into the air tank 08, maintenance is good.

FIG. 4 is a diagram for explaining the principle of vortex ring generation in the present invention in more detail. FIG. 4A shows a case in which the gas release pipe 02i is paralleled and the bimorph piezoelectric element 20 is used for the instantaneous atmospheric pressure generation mechanism 09 in FIG. 1B. Of course, an electromagnetic drive mechanism may be used.

When the gas in the air tank 08 is instantaneously compressed by 20, the gas emitted from the virtual cannon 05 becomes the velocity distribution VE as shown in <1> at the moment when it jumps out. The arrow indicates the speed, indicating that the central part is fast and the peripheral part is slow. This is because, when the tube 02i has a predetermined density as will be described later, gases released from the tube interfere with each other.

<2> is shown when the relative velocity RVE of the gas around the gun barrel is shown based on the average velocity of the ejected gas mass. The white arrow indicates the speed of gas mass. As can be seen from the figure, there is a gas in the lump that is going to move to the left side and a gas that is going to move to the right side, so a vortex is formed and this occurs along the periphery of the virtual cannon 05. 3> is formed. F1 indicates the gas flow at the center of 05, and F2 indicates the gas flow at the periphery of 05. In this example, an air flow is generated from the inside to the outside and becomes a vortex.

By narrowing the tube 02i in 05, an extremely large amount of scent or chemical substance can be mixed and released. For example, when a tube having a diameter of about 3 mm is provided between the display elements to form a virtual barrel 05 having a diameter of about 70 mm, 50 or more kinds of fragrances can be used. By presenting these scents by switching them at high speed, or by releasing a plurality of scents from the gun barrel and mixing them in the vortex ring, extremely diverse scents can be presented.

FIG. 4B is a specific example of the scent generating device Kaori. 81 is a fragrance container, Wa is a liquid containing the fragrance a, Wb is a liquid containing the fragrance b, and Tube is a gas carrying tube. The operation will be described. From the left side of the figure, air is sent to the air tank 87 by an air pump or the like and compressed and stored. 36Aa and 36Ab are the scent supply parts shown in FIG. By operating the air flow control plate 33 to the left and right at high speed, the flow rate per unit time supplied to the scent discharge tube 02i (i = 1, 2) can be controlled. Air passes through 81a and 81b and is supplied to 02i including each fragrance and discharged from 05. The fragrance supplied to 02i can be quantified with an accuracy of about 1% of the mixing ratio.

FIG. 4C shows another configuration of the scent generator Kaori. In the scent discharge pipe 02i, only the scent transport pipe 38 is provided, and the scent supply unit is provided outside. With such a configuration, since the scent discharge tube can be accumulated, a virtual cannon that easily releases a lump of gas can be realized.

The operation will be described. The compressed air stored in the air tank 87 is sent to the input unit of the airflow switch 89 by Tube. The output part 89 is connected to the fragrance container 81 by Tube1. 89 is normally in a cut-off state (OFF), is operated (ON) by an electromagnetic drive mechanism as necessary, and is connected to Tube 1. A predetermined number of pulse operations can be performed per unit time. In the same figure, 89 (1) has shown the state which sends air to Tube1 in an ON state. The air contains a scent at 81a and flows into 02a. 89 (2) is in the OFF state. By controlling the number of operations 89, the scent supplied to 02i can be quantified. For example, if 89 (1) is operated 5 times per second and 89 (2) is operated once, a gas having a mixing ratio of the fragrances a and b of 5 to 1 can be released.

FIG. 5 is a diagram for explaining the relationship between the density of the gas discharge pipe 02i and the gas rectifying action. A conventional air cannon uses a hollow barrel. Commonly speaking, when an object that blocks airflow is inserted into the cannon, it is considered that a vortex ring is unlikely to be generated, and therefore a vortex ring generation condition other than hollow is not required.

FIG. 5B shows a case where the density of 02i is sparse and YAS is reduced. Gases exiting the tube cannot interfere with each other and are not rectified. For this reason, the vortex ring is not generated and the gas cannot fly far. Gas diffuses over a short distance.

FIG. 5A is a typical example of the present invention, and has the same configuration as FIG. This is a case where the pipes 02i are densely packed and an atmospheric pressure is instantaneously generated in the hole of the pipe. The gases exiting the tube interfere with each other and a vortex ring 04 is generated.

Thus, it can be seen that the density of the holes 02 is important for vortex ring generation. The diameter of the hole 02 is in the range from 1/100 to 1/3 of the diameter of the virtual turret 05, and the length of the hole (tube) is from 1/10 to 5 times the diameter of the turret 3 or more of the tubes are arranged along the inner periphery of the cylinder, and the ratio of the total opening area of the hole (Σ (Open02i)) to the inner periphery area (Area05) of the gun barrel (opening ratio; YAS) ) Is configured to be 20% or more, the gases released from the tubes easily interfere with each other and easily generate a vortex ring at the tip of the gun barrel.

FIG. 5 (D) shows the result of conducting a gas release experiment in which a large number of holes are provided in the board, an air cannon having a gun barrel having a diameter of about 5 cm is in close contact with the back side of the board, and the front side of the board is a virtual gun barrel. When the aperture ratio YAS of the virtual cannon exceeds 20%, the generation rate of the vortex ring is significantly increased.

If the diameter of the virtual cannon 05 is 1 cm to 5 cm and the aperture ratio is increased, the gas mass will fly several meters. Further, when a large gun barrel having a diameter of 05 or more of 10 cm is used, it can fly over 5 m.

FIG. 5C is an apparatus that increases the area of 05 and discharges airflow continuously from the screen using the blower 97. In this case as well, if the holes 02 are dense, the gas is rectified and the central portion of the gun barrel 05 has a uniform pressure. The alternate long and short dash line in the broken line frame in the figure shows the air flow, and schematically shows how the gas released from each tube advances without spreading by concentrating the tubes. In the center part of the gun barrel, the velocity component in the horizontal direction (direction perpendicular to the gun barrel axis) is hardly generated, and the velocity component in the vertical direction (gun barrel axis direction) is large. With a large barrel, the air flow in the center is unidirectional. Since the apparatus can apply an air flow to the observer from a wide range of the screen, the apparatus is suitable for, for example, reproducing a tactile sensation in which the wind hits the skin. In order to release the rectified gas, YAS is desirably 10% or more.

FIG. 6 is a sectional view of a display device with a scent presentation function according to the second embodiment of the present invention. The screen 10 is the same as in FIG. A hole 02 is provided between the display elements 11. The airflow discharge device 01 uses the principle of an air cannon and is mounted so as to be in close contact with the back side of the screen 10. Reference numeral 06 denotes a cannon, which has a cylinder cross-sectional area that decreases from the abdomen to the tip of the cylinder. In 06, a plurality of scent discharge tubes 02i (i = a, b) are provided around the opening of the gun barrel. Although only two are shown in the figure, several tens can be provided. The scent discharge tube is provided with a scent supply unit 36D to supply various scents. 07 is an atmospheric pressure generating means similar to that shown in FIG. Moreover, you may use the atmospheric | air pressure generation means of FIG.

The operation will be described. When 07 is operated in a state where the scent is supplied to the scent discharge tube 02i, the air in the cannon 06 is compressed, and an air current as shown by a one-dot chain line in FIG. That is, the air Air passes through 06 and 02i. Since the tip of the cannon is thin, the airflow gets faster as it goes to the tip. Since the screen 10 is provided with a plurality of holes to form the virtual gun barrel 05, the gas released from the 05 forms a vortex ring. The gas released from 02i contains the scent Frg and is mixed in the vortex ring.

An air collection mechanism 46 for taking air into the pipe is provided at the end of the scent discharge pipe 02i. 46 is a conical cylinder. If the cylinder diameter is small, the pressure is insufficient, and the airflow in 02i is weak, making it difficult to convey the scent. On the other hand, if the pressure is increased, the pressure in 02i increases, and the airflow becomes faster. If it is too fast, it is difficult to form a vortex ring. Therefore, the conical cylinder 46 is designed so that the fragrance is efficiently conveyed and forms a vortex ring.

Next, in FIG. 6A, the scent supply unit 36D will be described. The fragrance-containing liquid Wb in the fragrance container 81 is transported to the hole provided in the tube wall 02b by the capillary phenomenon of the core 90 of the porous material. A small piezoelectric vibrator 91 is fixed to the tube wall by a holding mechanism 96. When 91 is operated at a high frequency of, for example, 1 MHz or more, the surface tension of the liquid is broken by vibration, and a fragrance-containing mist mis is generated in 02b. Since the particle size of the mist is 1 to several microns, it passes freely through the holes in the screen. In addition, since it is so that the particle diameter of fog becomes so small that it operates at high frequency, it is desirable to operate at 2 MHz or more.

Although the atomization mechanism can be manufactured in a small size, since it is larger than the hole diameter 02 of the screen, it is desirable to provide it in a thick cylindrical portion of 02b that is separated from the screen as shown in FIG. In the present invention, since the abdomen of the gun tube 06 is thickened, it can be provided in the cylinder. That is, the structure in which the abdomen of the cannon 06 is thick and narrows toward the tip has the purpose of facilitating the formation of a vortex ring by increasing the air flow and the purpose of facilitating the mounting of the fragrance supply unit. When the screen is large and a large hole can be provided, an atomization mechanism may be directly attached to the back side of the screen, and the gun tube 06 may be provided so as to surround the atomization mechanism.

FIG. 6B shows an atomization mechanism in which the piezoelectric vibrator 91 is mounted to be inclined with respect to the axial direction of the tube 02i so that the mist mist can be easily supplied into the tube. FIG. 6C shows an atomization mechanism using a piezoelectric vibrator 92 having a concave structure. Since the ultrasonic waves are focused toward the focal point of the concave vibrator, the atomization efficiency is good. FIG. 6D shows an atomization mechanism using a piezoelectric drive mechanism (piezo element). 93 is an atomization head (cross section), which is provided on the tube wall of 02i. A small liquid container 94 is provided with a piezo element Piezo. Piezo is deformed so that when the voltage is applied, the volume of the liquid container is reduced. Therefore, liquid fine particles (mist) are discharged from the micro nozzle 95 provided in the container at the pressure Press. Since Mist, Heater, and Cooler in FIG. 6A are the same as those in FIG. 7, they will be described later.

FIG. 7 shows a display device with a scent presentation function according to a third embodiment of the present invention. The description will focus on the differences from the embodiment of FIG. Reference numeral 10 denotes a board-like screen, and 99 denotes a video control device. 01 is a gas discharge device, and the scent discharge tubes 02a and 02b and the air discharge tube 02S are alternately arranged to form a virtual barrel 05. 02i shows all the gas discharge tubes including 02a, 02b, and 02S.

Since the scent supply tube 30 is required for the scent discharge tube, the diameter of the tube tends to be large. As shown in FIG. 1, when the gas release pipe 02 i is configured only by a scent discharge pipe, the pipes are hardly brought into close contact due to 30. Accordingly, there is a limit to increasing the ratio YAS of the total opening area (Σ (Open02i)) of the tube with respect to the inner peripheral area (Area 05) of the gun barrel tip.

In FIG. 7A, since the scent discharge tubes 02a and 02b and the air discharge tubes 02S are alternately arranged, the density of the gas discharge tubes can be increased. That is, by providing the air discharge pipe 02S between the scent supply units 30, the total opening area of the pipes increases, so that YAS can be increased. YAS can easily be increased to 20% or more. When YAS is increased, a vortex ring is easily generated, and the scented lump can be stably moved far away.

FIG. 7B is a longitudinal sectional view of the gas discharge device 01. Although 02b is only one fragrance discharge tube, it is the same for other fragrance discharge tubes. 30 is a scent supply part, and 07 is an atmospheric pressure generating means.

The configuration of 07 will be described. 08 is an air tank, and 09 is an instantaneous atmospheric pressure generating mechanism. 41 is an opening into which the end portion End of 02b is inserted, and is made of a cylindrical magnetic body. 39i (i = a, b, c, d) is an electromagnetic drive mechanism composed of 41 and a cylindrical electromagnet 40, and drives the airflow control plate 33 to the right side of the figure. Reference numeral 14 denotes a drive control device 39i for controlling the supply of the fragrance to the scent discharge tube 02i (i = a, b, c, d). In the figure, 14 is connected only to 39d, but naturally it is also connected to 39a, 39b, 39c.

The instantaneous atmospheric pressure generation mechanism 09 includes a bimorph piezoelectric element 20. 21 is a metal plate and 22 is a piezoelectric plate. Reference numeral 16 denotes a voltage control device, which controls the voltage applied to 22. When a voltage is applied to 22, the 22 expands and contracts in the plate surface direction depending on the polarity of the applied voltage. In a state where 22 is contracted, 20 is curved inward as indicated by a broken line in FIG. 2 and compresses the gas in the air tank 08. The air in 08 is sent to the scent discharge tube 02b. On the other hand, in a state where 22 is extended, 20 is curved outward to lower the atmospheric pressure in 08 and take in air. Thus, the atmospheric pressure in the air tank 08 can be controlled by 16. As the instantaneous atmospheric pressure generation mechanism 09, an electromagnetic mechanism shown in FIG. 1A or a servo motor mechanism shown in FIG. 1D can be used.

In FIG. 7B, the configuration of 30 for supplying scent to the scent discharge tube 02b will be described. Reference numeral 32 denotes a part of a pipe line continuing from 02b, and a plurality of holes Hol1 are provided in the pipe wall. Reference numeral 31 denotes a perfume accumulation mechanism, which can use a network structure material, a porous material, or the like. Liquid fragrances, gel fragrances, etc. can be stored in the mechanism. b is a fragrance | flavor. The liquid is retained inside the microstructure by capillary action. The perforated pipe line 32 serves as a cover plate for holding the perfume accumulating mechanism 31. The fragrance | flavor of 31 vaporizes and is supplied to the pipe line 02b from the hole Hol1.

About the fragrance | flavor storage mechanism 31 and the pipe line 32 with a hole, the structure of Unexamined-Japanese-Patent No. 2004-159875 by the present inventors can be used. Moreover, as 31, a gelation fragrance | flavor and a solid fragrance | flavor can also be used. In this case, since the fragrance does not leak, the fragrance can be processed into a cylindrical shape and mounted.

Further, a fragrance microcapsule material can be used as the fragrance storage mechanism 31. A perfume microcapsule is a perfume confined in a capsule having a diameter of about 1 to 100 microns. As the capsule film, although it varies depending on the kind of the fragrance component, any material that can be encapsulated such as gelatin, polyvinyl alcohol, ethylene cellulose, carboxymethyl cellulose, urea resin, melanin resin and the like can be used.

If a heat sensitive film is used, it can be configured so that the film is destroyed and a fragrance is produced by heating. The microcapsules are contained in ultraviolet curable ink, and the ink is applied to cylindrical paper, cloth, ceramic, metal, molding resin, or the like. A cylinder coated with the perfume microcapsule-containing ink can be used as 31. That is, by heating the cylinder, the fragrance can be discharged from the capsule, vaporized, and supplied into 02b. In addition, a method of applying physical pressure can be used as a means for causing the perfume to flow out by destroying the perfume microcapsules.

HT is an electric heater, and 15 is a device that controls HT, and can accelerate the vaporization of the fragrance. CN is a connector for connecting HT and 15. In the figure, 15 is connected only to the CN of 39d, but naturally it is also connected to the CNs of 39a, 39b and 39c. When HT is operated and 31 is heated, vaporization of the fragrance is promoted and a large amount of fragrance is supplied to the pipeline.

Reference numeral 33 denotes an airflow control plate for opening and closing the scent supply hole Hol1 of 32, and is a cylindrical magnetic body similar to 32. 33 is provided with an air hole Hol2 so as to face the 32 holes Hol1. 33 is normally urged to the left side of the figure by a spring 35. In this state, the positions of Hol1 and Hol2 are off and the hole is closed. Therefore, no scent is supplied into the tube.

By inserting the end of 02b into 41, the airflow control plate 33 is connected to 39b and becomes operable. When the electromagnet 40 is energized, the magnetic flux passes through 41 and reaches 33. When 33 is slightly pulled to the right, Hol1 and Hol2 face each other and gas can pass through. The scent evaporated in 31 passes through the hole and is supplied into the scent discharge tube 02b.

Since the scent discharge pipe 02b and the scent supply unit 30 can be detached from the atmospheric pressure generating means 07, maintenance is easy. Further, since one kind of fragrance is accumulated in one tube and the vaporized fragrance passes only through the tube, the fragrance of one tube is unlikely to contaminate another tube. Even when used for a long time, the dirt is limited, and maintenance is easy. Since the fragrance is rarely mixed inside the apparatus, the scent change is clear. Since thin fragrance discharge tubes are used in an integrated manner, many fragrances can be switched at high speed, and perfumes can be prepared and released.

In the case of mixing and releasing a plurality of scents, when using a conventional hollow gun barrel, there was a problem that the gun barrel was contaminated because the fragrance was mixed and released in the gun barrel, Since multiple fragrances are mixed in the air (in the vortex ring) away from the cannon, there is no problem of contaminating the cannon.

Next, the operation 01 will be described. A predetermined fragrance is accumulated in the fragrance accumulation mechanism 31 of the scent discharge tube 02b. After 39b is slid to the right side by 39b and the scent is supplied to the pipe line 02b, 07 is compressed. Air Air is sent to 02b, and scent is released from the tip of 02b. The same applies to the other tubes.

The important point here is that in 02i (i = a, b, c, d), there are a tube that emits a fragrance and a tube that discharges only air depending on the operation of 39i. The gas is released. That is, in the case where scent is released or not, the amount of released gas does not change depending on the type of scent. The aperture ratio is always high, and a vortex ring can be made stably.

In FIG. 7B, mist may be put into the air tank 08 and discharged. Mist can be connected to 08 with a fog generator. An ultrasonic fog generator or an electrostatic fog generator can be used. If the liquid that generates the mist is preheated, a warm mist is released along with the scent. If a cold liquid is used, a cold mist is released along with the scent. Various tactile sensations can be presented to the user by controlling the amount of mist, liquid temperature control, wind pressure control, and the like.

When an ultrasonic fog generator is used, extremely fine particles can be produced by increasing the frequency. Humidity can be adjusted by controlling the amount of fog and particle size. Incidentally, when the piezoelectric vibrator is driven at about 1 to 2 MHz, particles having a diameter of about 1 micron can be obtained. When this size is reached, it looks white, but does not feel strong moisture and has a pleasant stimulus. Further, the particle diameter can be reduced to make it invisible.

By using this in conjunction with the video, a high sense of realism can be produced. For example, when the scenery of the plateau is presented as a video, and a cold mist with a refreshing scent is emitted from the screen toward the user's face, the atmosphere is like walking in the plateau with a breeze. can get. It can be used as a system for producing healing.

Moreover, in FIG. 7 (B), the mist produced | generated with the fog generator may be heated with an electric heater (Heator), or may be cooled with a cooler (Cooler). In the same figure, the control means is omitted, but the video control device 99, the fragrance supply control device 14, the atmospheric pressure control device 16, the mist generation device Mist, the mist heating / cooling device, etc. can be controlled to work together. Of course.

FIG. 8 shows a display device with an exhaust function according to the fourth embodiment of the present invention. FIG. 4A is a front view, and FIG. An air hole 02 is provided between the display elements 11 of the screen 10, and an exhaust device 48 is provided in the air hole.

The air hole 02 is provided substantially perpendicular to the surface of the substrate 12. The hole diameter is small on the display surface side (left side) and large on the back side (right side). The exhaust device includes an exhaust pipe 43 and a decompression means 49. The exhaust pipe 43 is mounted so as to be inserted into the air hole 02. The right side of 43 is connected to the air tank 08. In 08, an airflow generator (blower 97) using an impeller 47 and a motor 85 is provided. The impeller is rotated and the air in 08 is sent to the outside. The air Air flows as indicated by the one-dot chain line arrow in the figure, and the gas in front of the screen 10 is sucked and discharged. The exhaust gas may be a fragrance-containing gas released by another means before the screen.

A filter for removing dirt in the air can be provided in the air flow path 43 or 49. Further, when the impeller 47 is rotated in the reverse direction, air can be released to the front of the screen 10. This is the same as in the case of FIG.

FIG. 9 shows a display device with a sensory stimulus presentation function that constitutes a pixel using a top emission type organic EL element (OLED) according to a fifth embodiment of the present invention. FIG. 9A is a configuration diagram of the screen 10 and the display element 11. 12B is a back side substrate provided with a hole 02, and 12C is a transparent front side substrate provided with a hole 02. A material such as glass or resin can be used for the substrate. The thickness of the substrate can be manufactured at about 0.7 mm for both 12B and 12C. 02 (Air) is a hole through which gas passes, and 02 (74) is a hole through which reflected light of near-infrared reference light passes, and a camera lens 74 is provided. The diameter of the hole can be 0.1 mm to several cm, and can be previously opened at a predetermined position that penetrates when two substrates are stacked.

EL (R), EL (G), and EL (B) are red, green, and blue organic EL elements, respectively, and TFT is an EL drive circuit that includes thin film transistors. EL (R, G, B) surrounded by a broken line indicates the display element 11 (pixel) constituting the screen. Reference numeral 99 denotes an eleven drive circuit. Reference numeral 77 denotes a near-infrared light emitting element, which may be configured using an EL element (EL (IR)), or may be another element structure such as an LED. As shown in FIG. 9B, 77 can be arranged around the hole 02 (74). In the figure, a large area is assigned to 77 in order to obtain strong near-infrared illumination.

A method for manufacturing the screen 10 will be described. In FIG. 9A, a TFT (thin film transistor) driving circuit is formed on the back substrate 12B by vapor deposition or the like, and an organic layer (EL) to be a light emitting layer is vapor deposited thereon with a thickness of several hundred nm. The transparent electrode can be formed by sputtering vapor deposition of ITO (indium tin oxide) or the like. For the organic layer, a high-molecular fluorescent material or a low-molecular fluorescent material such as an aluminum complex can be used. A trace amount of a dopant with high luminous efficiency may be mixed. The size of the element can be formed such that one side is 0.05 mm to several mm.

Thereafter, the substrates are laminated in a vacuum so that air does not enter between the substrates. In the vacuum chamber, the front substrate 02C is overlaid on the back substrate 02B, and the periphery of the two substrates and the edge of the hole are bonded. For the adhesive SL, an ultraviolet curable resin or the like can be used. The bonded portion is shown by a striped oblique line. After bonding, remove from the vacuum chamber. Note that the entire surface may be bonded, leaving the holes of 12B and 12C.

The effect of the adhesion will be described. Organic EL elements are vulnerable to oxidation and humidity. When a hole is provided in the screen, moisture and dust can easily enter between the substrates. However, at least the periphery of the screen (substrate) and the edge of the hole are bonded to each other so that the element portion is hermetically sealed, so that deterioration is small. It is more certain if the whole surface is bonded.

As described above, the glass substrate can be manufactured with a thickness of about 0.7 mm, and can be formed to a thickness of 2 mm or less even if elements are provided and bonded together. Of course, if there is a problem with mechanical strength, the substrate can be thickened.

FIG. 9B is a front view of the screen 10. Compared to FIG. 9A, the shape and position of the near-infrared light emitting element 77 (EL (IR)) and the position of the hole 02 are changed. In the screen 10, the display element 11 is formed without a gap as in the first row, but the display element is thinned out only at a portion 77 and a portion where a hole is provided.

In the figure, the case where the size of the display element 11 (EL (R, G, B)) is 1 mm is shown. If the shortest viewing distance MinD is about 60 cm, which is a color mixing distance, the hole diameter is preferably set to 0.5 degrees or less, that is, 5.2 mm or less in terms of viewing angle. When observed at a normal viewing distance of 120 cm or more, the hole diameter is 0.25 degrees or less. The allowable range of the hole diameter will be described later in detail with reference to FIG. In this embodiment, the holes provided in the substrate are small, but by providing a large number of holes with an appropriate density, a sensory stimulation medium such as an air current passes smoothly.

FIG. 9C is a cross-sectional view taken along the alternate long and two short dashes line in FIG. 9B and shows a state where the user (observer) P1 is paying attention to the video in front of the large screen. In the screen, cameras 72 are provided at two locations to constitute a stereo image measurement system. A near-infrared light emitting element 77 (EL (IR)) is provided around the camera to illuminate the observer's feature points (eyeball etc.). LGR is near infrared illumination light. This reflected light is photographed by a camera. LGA indicates photographing light captured by the camera lens 74. 75 is a lens barrel, and 73 is an image sensor such as a CCD or CMOS. When illuminated from the vicinity of the camera lens, the feature points are photographed efficiently. The image measurement system extracts the feature point and detects its spatial position. It is possible to detect the position of the eye (viewpoint position), the point on the screen (gazepoint), the position of the nose, the position of the ear, and the like. Details will be described with reference to FIG. 20, FIG. 21, and FIG.

The gas discharge devices 01 using the impeller-type blower 97 are provided at two locations on the back side of the screen, and the position detection result of the observer P1 is selected below, and 01 closer to P1 is selected, and the wind (Air) Fragrance (Frg) and the like are released toward P1.

FIG. 9D illustrates the advantage of using a thin display device such as this example when a hole is provided in the screen and gas is allowed to pass through. Since the screen 10 is thin, the depth length of the hole 02 can be shortened. When the hole diameter is made larger than the thickness of the screen, the gas discharge device 01 using the impeller 47 and the motor 85 is provided after the screen, and the gas discharge direction is changed by the rotation control mechanism 62, as shown by a one-dot chain line, The direction of wind Air and scent Frg released from the screen can be changed variously. Airflow can be presented to follow the observer.

FIG. 9E shows a screen using a front substrate 12D with a lens obtained by molding a lens 19 on a transparent front substrate 12C. The left side of the figure shows only 12D. The right side of the figure shows a state in which the light emitter 18 is formed on the back substrate 12B, and the screen 10 is formed by superimposing 12D thereon. The lens 19 is formed in front of the light emitter 18 and displays 18 in an enlarged manner. Reference numeral 19k denotes a light main emission surface of the lens. The display element 11 (pixel) is an area composed of 18 and 19. 18 is a total of six EL elements for right eye (EL-r (R, G, B)) and left eye (EL-I (R, G, B)) for binocular stereoscopic viewing. It is configured.

Wearing time-division glasses and controlling to switch between light for the right eye (EL-r (R, G, B)) and light for the left eye (EL-I (R, G, B)). If so, binocular stereopsis is possible.

Further, binocular stereoscopic vision without glasses is possible by using the lens 19 to make the light of the right eye image and the light of the left eye image into thin beams and irradiate the positions of the left and right eyes. This will be described in detail later with reference to FIGS.

In FIG. 9E, the light from the light emitter 18 is irradiated forward by the lens 19, and the hole 02 is provided beside the optical main emission surface 19k of the lens, so that the 18 light does not illuminate the hole. . Therefore, the hole is hardly noticeable to the observer.

Reference numeral 74b denotes a lens of the camera 72 that collects and passes the photographing light LGA. Thus, the display element lens 19 and the camera lens 74b can be integrally formed on the sheet-like substrate 12D. Thereby, a thin screen can be constituted.

FIG. 10 shows a display device with a sensory stimulation medium presentation function using a liquid crystal element in the sixth embodiment of the present invention. FIG. 10A is a configuration diagram of the screen 10. The display element 11 using the liquid crystal LC is provided on the transparent back substrate 12B provided with the holes 02, and the transparent front substrate 12C provided with the holes 02 is provided thereon. At this time, the hole and the surroundings of the hole are sealed. Air Air passes through the hole. SL indicates a sealed portion. Reference numeral 99 denotes an LC drive circuit.

A conventional method can be applied to the method for manufacturing the display element. That is, as a back side module, a transparent electrode (pixel electrode) and an orientation film are provided on a glass substrate to which a polarizing plate is adhered, a liquid crystal layer is provided thereon, and further, an orientation film and a transparent electrode are provided thereon as a front side module. (Counter electrode), a color filter, a glass substrate, and a polarizing plate may be provided. In the present invention, the back side module corresponds to the back side substrate, and the front side module corresponds to the front side substrate.

FIG. 10B is a top view of the screen 10. The display element 11 (LC) can create a transparent or light-shielded state by controlling the voltage. This figure shows a state where an image Img is generated by a set of display elements in a light-shielded state.

FIG. 10C shows a room where the screen 10 is used as a ceiling. When sunlight is used as lighting Light, an Img shadow pattern ImgSD appears on the floor. Moreover, since the hole 02 is provided in the screen, outside air can be taken in. Wind can also be presented using the blower 97. While taking in natural light and wind into the room, it is possible to project various geometric patterns and the state of the leaves swaying as shadow patterns on the floor and walls, creating a healing space.

In this application, the user enjoys the shadows instead of looking directly at the screen, so the presence of holes is not a concern. Large holes with good ventilation can be used. Alternatively, a lighting system may be used instead of sunlight to adopt a backlight system.

FIG. 11 is a seventh embodiment of the present invention, showing a device provided with a sensory stimulus medium presentation function in a display device that irradiates the screen from the back, and experimental results illustrating the effect thereof. 11A and 11B are configuration diagrams of the screen 10. The front substrate 12C is a sheet or screen member, and an image Img such as a photograph or a picture is printed on the surface. For 12C, materials such as acrylic, polystyrene, vinyl chloride, and polished glass through which light passes can be applied. An illumination element 11 for illuminating 12C is provided on the back substrate 12B. 11 can be an LED, a fluorescent tube, a light bulb, or the like.

A large conical hole 02 is provided in the back substrate 12B, and a small hole 02 is provided in the front substrate 12C. A conical tube 02a is provided so as to connect both holes or to seal the ridges of both holes. A scent supply mechanism 36 is provided in the tube 02a. Further, a gas releasing device 01 is provided on the back side of the back side substrate 12B. FIG. 11C shows the configuration of 02a and 36 in a three-dimensional manner.

The operation will be described. When the illumination element 11 is operated, the light illuminates the back side of 12C as shown by an arrow in FIG. Since 12C is a thin sheet that allows light to pass therethrough, the image Img on the surface rises brightly due to the light. Here, when the scent is supplied into the 02a from the tip of the 36 scent conveying pipe 38 and the air Air is caused to flow as indicated by a one-dot chain line by 01, the scent is released from the hole 02 of 12C. As shown in FIG. 11A, when Img is a forest image, the sense of reality is improved by releasing the forest scent.

Next, a description will be given of the light shielding effect of the structure in which the flange of the hole 02 penetrating 12C and 12B is sealed using the tube 02a. If there is no 02a, the light from the illumination element 11 (LED) leaks from the hole 02, so that the presence of the hole is worrisome and the image quality deteriorates. The installation of the tube 02a of the present invention acts so as not to leak light from the hole when the backlight is used. The light irradiates only the front substrate 12C, so that Img emerges. The holes are difficult to see and do not bother you.

A light absorbing material may be applied to the inside of 02a, and a light diffusing reflector may be applied to the outside of 02a. Thereby, 12C is illuminated uniformly and image quality improves. When the 12C hole 02 is anxious, as shown in FIG. 11 (F), an airflow passing material mes such as a mesh material may be provided in front of the hole. The holes can be made inconspicuous without impairing the airflow characteristics.

FIG. 11D shows the experimental results showing the light shielding effect by sealing the ridges of the holes. Holes 02 are made in a pattern as shown in FIG. The aperture ratio of the hole is about 12%. The vertical axis shows the result of evaluating the presence of a hole by illuminating this picture with five subjects observing at a viewing distance of 5 m. The percentage of responding that the shaded bars can accept the holes. (1) in the figure is when the hole is not shielded (corresponding to the case where the 02a is not provided), (2) is when light leakage from the hole is prevented (corresponding to the case where the 02a is provided), ( 3) is a case where a hole is provided in a region having a high spatial frequency of the image under the condition (2), and (4) is a case where the airflow passage material mes is provided in the hole. The horizontal axis indicates the viewing angle of the hole when viewed from the size of the hole and a distance of 5 m.

In (1), the hole is anxious and the evaluation is low, but in (2) and (3), the evaluation is high. The effect of sealing the hole with 02a and shielding the light is obvious. The backlight method is more difficult to notice the presence of holes than the method using light-emitting elements, but the image quality is sufficient when the holes are shielded from light and covered with mes. I understand.

FIG. 11G shows an example in which the screen configuration of the present invention is used in two places. 10b is a screen using the illumination element 11 (LED) similar to FIG. 11 (B). 10a is a screen using the liquid crystal display element 11 (LC) shown in FIG. The 10a image is backlit by the 10b illumination element 11 (LED). The front substrate 12C of 10b corresponds to the back substrate 12B in 10a. The flange of the hole 02 provided in 10a is sealed (SL) and connected to the tube 02a of 10b. The light from the illumination element 11 (LED) does not leak into the hole 02 and illuminates the back side of 10a exclusively. As described above, the liquid crystal display device can also be provided with a hole in the screen to release the sensory stimulus presentation medium.

FIG. 12 shows a display device with a scent presentation function using a projector screen in the eighth embodiment of the present invention. FIG. 4A is an apparatus configuration diagram, FIG. 4B is a longitudinal sectional view, FIG. 4C is a front view of the screen, FIG. 4D is an enlarged view of the screen, and FIG.

Reference numeral 29 is a projector, and 28 is a screen provided with many small holes 02 on the screen. Sensory stimulation media such as airflow and sound waves pass through the holes. A light scattering reflector is applied to the inside of the hole so that the hole is not noticeable when observed at a predetermined distance. Further, as shown in FIG. 12D, a retroreflecting material 83 may be spread over the screen. Reference numeral 83 denotes a microsphere. Holes 02 can be provided between the retroreflecting materials. In this configuration, since the projector light is reflected by 83, the hole between 83 becomes dark and unnoticeable.

01 is a gas discharge device. An exhaust device 65 is provided in a direction opposite to 01. In FIG. 12 (B), a large number of scent discharge tubes 02a and 02b are provided in the gun tube 06. Reference numeral 30 denotes a means for supplying a scent to the scent discharge tube, which has the same structure as 30 in FIG. Air is sent to the barrel 06 using the blower 97. Air Air and scent Frg are emitted in front of the screen. 05 is a range (virtual cannon) in which gas is released. YAS is 10% or more.

A feature point detection camera as shown in FIG. 9C can be provided in the screen 28. Motion vision can be realized by detecting the position of the eye, perspective-transforming the three-dimensional world model to generate a CG image and projecting it on the screen. Also, binocular stereoscopic vision can be realized by projecting left and right eye images, wearing polarized glasses shown in 82, or stereoscopic glasses such as liquid crystal shutter glasses, and separating the images and presenting them to each eye. it can. Reference numeral 83 denotes a feature point mark provided on the glasses. In order to detect the position of the eye, a pupil or a cornea reflection image may be used as a feature point, or the feature point mark may be detected.

The screen 28 in FIG. 12 is a flat surface, but may be a hemispherical surface. Since the viewing angle can be increased, a high immersive feeling can be obtained. A thin plate-like material is suitable for the screen. Plastic, glass, FRP, etc. can be used.

The screen 28 may be a flexible sheet-like material. When making a hole in the sheet, as shown in FIG. 12 (F), by providing a cut St around the hole 02, a sensory stimulation medium such as an air current or a sound wave can be passed efficiently. For example, when a gas is allowed to pass through, if the hole is configured to expand with the pressure of the gas, it is usually possible to form a small, inconspicuous hole. In the figure, six notches around the hole open from the back side to the front side. Sound pressure can also be used as a method of spreading the cut. An ultrasonic speaker as shown in FIG. 23 may be arranged on the back surface of the screen and spread by the ultrasonic pressure.

FIG. 13 is a realistic evaluation experiment by presenting a sensory stimulation medium from the screen. FIG. 4A shows the experimental method. Reference numeral 28 denotes a screen provided with a large number of minute holes 02 and displays an image by a projector. The viewing distance is 200 cm, and the horizontal viewing angle is 40 degrees. The subjects were presented with the scent, airflow, and sound so as to be linked to the video Im, and the realism by the presentation of the sensory stimulus medium was relatively evaluated in five stages, with only the video presented as one point. The sensory stimulation medium presentation conditions are the case where the gas releasing device 01 or the speaker is provided away from the screen (condition 1) (scent; Sm1, air current; Wd1, sound; Sd1) and the case where the speaker is provided on the back side of the screen (condition 2). (Scent; Sm2, Airflow; Wd2, Sound; Sd2). The presented video is a one-minute healing video.

FIG. 13B shows the experimental results. (1) on the horizontal axis is the case of video only (Im), the case where the sound of the condition 1 is added to the video (Im + Sd1), and the case where the sound of the condition 2 is added to the video (Im + Sd2). Although the vertical axis shows the evaluation results, both (Im + Sd1) and (Im + Sd2) are evaluated better than (Im), but (Im + Sd2) has a higher evaluation. In other words, the person who feels the sound from the screen is highly evaluated.

(2) on the horizontal axis is when the sound of condition 1 is added to the image Im (Im + Sd1), when the scent of condition 1 is further added (Im + Sd1 + Sm1), and when the scent of condition 2 is added (Im + Sd1 + Sm2) It is the result of comparison. It can be seen that the evaluation of (Im + Sd1 + Sm2) is the highest.

(3) on the horizontal axis shows the case where the sound of condition 1 is added to the video Im (Im + Sd1), the case where the airflow of condition 1 is further added (Im + Sd1 + Wd1), and the case where the airflow of condition 2 is added (Im + Sd1 + Wd2). It is the result of comparison. It can be seen that the evaluation of (Im + Sd1 + Wd2) is the highest.

(4) on the horizontal axis is the result when (Im + Sm2 + Wd2 + Sd2) is added to the image Im with the scent, airflow, and sound of condition 2. It can be seen that the evaluation is higher than any of the above conditions (1) to (3).

From the above results, it is clear that the sense of reality is improved when the sensory stimulus presentation medium is released from the screen. This is because the object feels as if it is emitting a stimulus. Moreover, the result which improves the content understanding of the content is also obtained.

FIG. 14 shows a display device with a scent presentation function that constitutes a display element (pixel) using a light emitter and a lens in the ninth embodiment of the present invention. FIG. 4A is a front view, and FIG. 4B is a diagram in which two longitudinal sections (indicated by a two-dot chain line) in FIG. The description will focus on the differences from the embodiment of FIG. The display element 11 (pixel) includes a light emitter 18 and a lens 19. 18 can be an LED, an organic EL, a phosphor, a discharge tube, or the like. Reference numeral 19 can be made of a transparent resin, glass, or the like, and has a characteristic of refracting light emitted from the light emitter 18 in the direction of the observer.

A large number of air holes 02 are provided between 11 and constitute an opening (virtual gun barrel 05). As shown in FIG. 4B, a scent discharge tube 02i (i = a, b, c) is inserted into 02, and a pressure generating means 07 is provided on the right side of 02i. 02i and 07 constitute the scent discharge device 01. The scent supply unit 36A is the same as that shown in FIGS. The aperture ratio YAS is 10% or more.

In FIG. 14B, the three fragrance supply units 36A operate, the fragrance Frg is supplied to 02i, three kinds of fragrance-containing gases are discharged from the holes, mixed in front of the screen 10, and presented to the observer. It shows how it works. A blower 97 is used for the atmospheric pressure generating means 07.

In this embodiment, the air holes 02 are provided between the lenses 19 and behind the optical main emission surface 19k of the lenses. Since the light emitted from the illuminant is irradiated almost forward from the front end of the lens, the light hardly irradiates the hole 02 and the hole is dark. In addition, since the illuminant is enlarged by the lens, it is perceived to be large. As a result, the air holes 02 are hardly perceived.

Since the airflow flows through the screen in the thickness direction like a one-dot chain line, the board-like substrate 12 is cooled, and the temperature of the light emitter and the drive circuit does not rise. For this reason, the reliability of the display element is improved.

FIG. 15 is a tenth embodiment of the present invention, which is a display device with a scent presentation function that constitutes a display element (pixel) using a light emitter and a lens. FIG. 4A is a front view, and FIG. 4B is a longitudinal sectional view taken along the two-dot chain line in FIG. Differences from FIG. 14 will be described. As shown to (A), the air hole 02 provided between the display elements 11 (pixel) is enlarged as much as possible. A scent discharge tube 02a is provided in the air hole in the center of the figure. Reference numeral 06 denotes an air gun barrel provided on the back side of the substrate 12 so as to surround the outer periphery of the hole 02.

In FIG. 15 (B), the scent supply part 36A to 02a is the same as that of FIG. 36A shows a state in which the fragrance gas Frg is operated and supplied to 02a. The pressure generating means 07 is connected to the gun barrel 06. The electromagnetic drive mechanism 39 is held by a mesh mechanism 45 that allows air to pass through the central position of the air tank 08. The configuration and operation of the instantaneous atmospheric pressure generation mechanism 09 are the same as in FIG. A vortex ring is released from the screen 10.

FIG. 16 shows an eleventh embodiment of the present invention, which is a display device with a sensory stimulus medium presenting function that constitutes a display element (pixel) using an LED and a lens. A near-infrared light photographing camera 72 is provided between the pixels.

FIG. 2A is a front view of the screen 10. (B) shows the two two-dot chain line cross-sections of (A) superimposed. The board-like substrate 12 is provided with four vertical display elements and four horizontal display elements 11 (pixels; Pix). This figure shows a part of the enlarged view, but in reality, several tens to several hundreds of pixels can be formed on a single substrate 12 and arranged in the vertical and horizontal directions with the substrate as a unit. Can be configured.

The display element 11 includes a light emitter 18, a drive circuit, and a lens 19 for collecting the 18 light. 18, R, G, and B are red, green, and blue LEDs, respectively. Light indicates rays from R, G, and B. IR is a near-infrared LED and emits reference light LGR for extracting a user's feature point. Ref is a concave mirror that reflects the light of the LED toward the main light emission surface 19k of the lens. In this way, the visible light emitter and the near infrared light emitter can be mounted on one lens.

Reference numeral 02b denotes a tube containing the lens of the camera 72, and four display elements 11 on which four LEDs (IR, R, G, B) are mounted are provided around 02b. Further, IR may be mounted on many display elements. The IR can be intermittently driven according to the shooting timing of the camera. This reflected light is captured by the camera 72. LGA is photographing light captured by the camera. By intermittently driving, it is not necessary to irradiate the user with useless near-infrared light, so there is little physiological and psychological influence. The photographing optical system can be provided with a near-infrared bandpass filter. Thereby, the reflected light of R, G, and B is blocked, and feature points can be extracted efficiently.

In the present invention, the lens tip (light main emission surface 19k) is not necessarily spherical. FIG. 16D shows a display element using a cylindrical lens 19. 19k is a circular plane. A light diffusing material 88 is provided around the light emitter 18. The light 18 is reflected by the concave mirror Ref and travels to the left side of the figure, but is diffused by 88 and the tip surface 19k of the cylinder shines.

In any case, since the light emitter 18 is magnified by the lens, the area 18 can be a region sufficiently smaller than the light main emission surface 19k. That is, 18 are discretely arranged on the substrate, and the hole 02 can be provided away from the light emitter 18. Therefore, a sufficient area can be secured for forming the hole and sealing the hole ridge, so that the design is easy.

FIGS. 16B and 16C show a case where the diameter of the LED display element 11 is 2.1 mm. In the case of a display element of this size, the color mixing distance of the three colors can be about 120 cm. In the case where the screen is configured by arranging the display elements in an array, the distance between the display elements is 0.5 degrees or less, and accordingly, the hole diameter is suitably 10 mm or less. Details will be described with reference to FIG.

When using an LED display element, considering the manufacturability and the like, the diameter of the element is about 1 mm to 10 mm, the distance between display elements Dis is about 1.5 mm to 20 mm, and the diameter of the hole 02 is about 1 mm to 20 mm. Is practical.

In FIG. 16, the hole 02 around the camera 72 can be used to release air Air or scent Frg. 02a and 02c are pipes for connecting the gas releasing device. The gas is emitted like a one-dot chain line.

Although near-infrared light is shown as the reference light that passes through the hole 02b, visible light can also be used as other reference light. Infrared rays (heat rays) can also be used. In this case, a camera that captures a thermal image is used. Further, an ultrasonic emission element and an ultrasonic detection element may be provided in the hole instead of the light emitting element and the camera, and the position of the user may be measured. It can emit ultrasonic waves, capture the reflected waves, and measure the distance from the time difference to the user. If multiple sets are incorporated in the screen, the position can be detected by the principle of triangulation.

FIG. 17 is a simulation evaluation experiment showing the allowable range of holes provided in the screen and their validity.

The minimum hole diameter can be determined from the ease of cleaning while the sensory stimulation medium passes as intended. Assuming that the hole diameter is 0.1 mm and the aperture ratio of the set of holes is 10%, as shown in FIG. 17A, the adjacent interval between the display elements (11; pixels) is about 0.28 mm. A display device having a width of 100 cm has 3571 pixels, and can display a high-definition image on a bright screen. FIG. 17E shows the result of subjective evaluation of a display device having the same definition, but the video quality is very good. Moreover, as a result of a simulation experiment in which a hole as shown in FIG.

Further, when the hole diameter is small, dirt and foreign matters are easily clogged and cleaning becomes difficult. If the thickness of the screen is about several mm to 1 cm, the cleaning liquid can be passed through and cleaned with a hole diameter of 0.1 mm or more. In the present invention, as described later, since the screen can be configured to be thin, the cleaning liquid easily passes through even a small hole. If the cleaning liquid is clogged so as not to pass, it can be cleaned by applying pressure to the hole, such as by jetting the solution. From the above, the minimum hole diameter can be about 0.1 mm. If possible, 0.5 mm or more is desirable.

As for the maximum value of the hole diameter, first, the color mixing distance in which the display element constituent colors (blue, green, red) are mixed and appear to be almost a single color is set as the shortest viewing distance MinD. This is because the color is not visible at a distance shorter than this. The standard visual acuity is an adjustment power that can perceive a gap with a viewing angle of about 0.017 degrees. However, color mixing tends to occur when the display element (three colors) has a viewing angle that is six times or less of the visual acuity characteristic. Therefore, the shortest viewing distance MinD is a distance at which the display element can be observed with a viewing angle of about 0.1 degree. In the case of a display element in which the light emitter is enlarged by a lens, the size of the display element may be the diameter of the lens.

The maximum inconspicuous hole diameter is obtained at this shortest viewing distance. In FIG. 17C, the size of the display element 11 is 2.1 mm. The shortest viewing distance MinD at which the viewing angle is 0.1 degree is 120 cm. The standard viewing distance is about 240 cm. In the MinD, the distance between display elements is increased, and an element interval Dis at which a video (character, picture, symbol, advertisement, moving image (movie), etc.) intended by the present invention can be displayed without a sense of incongruity is obtained. FIGS. 17B and 17C are screens where the viewing angle of Dis is 0.5 degrees. In this case, holes with a viewing angle of 0.5 degrees can be provided continuously. In the case of a screen with a MinD of 120 cm and a viewing angle of about 50 degrees, the number of horizontal pixels is about 100.

(B) in FIG. 17E shows the result of subjective evaluation of an image on a screen provided with LED display elements at the same density as described above. The image intended by the present invention can be displayed without great discomfort. This is because, in the case of moving images, the human eye follows the light emission point, and the dynamic visual acuity is reduced compared to the static visual acuity. This is because information is interpolated. In other words, this is because a visual system in which jumping points are perceived as a coherent shape occurs.

When holes are provided as shown in FIG. 17B, the aperture ratio (YAS) of the hole assembly is 70% or more. Gases coming out of a plurality of holes can interfere with each other and provide sufficient sensory stimulation to the user. Regarding the presence of the hole, when a light emitting element (LED or the like) is used as the display element (11), light is irradiated forward, and therefore the hole (02) behind the hole is difficult to see. In particular, if a black color that absorbs light is used for the substrate on which the light-emitting element is provided, the presence of the hole does not hinder perception.

However, when Dis is 0.5 ° or more, visual organization becomes difficult, and the video that can be expressed is greatly limited. In addition, the presence of holes tends to be an obstacle to perception.

(D) of FIG. 17 (E) is an evaluation result when a large screen in which LED display elements having a diameter of 2.1 mm are arranged in an array at intervals of 4 mm is observed at a viewing distance of 460 cm and a viewing angle of 50 degrees. The number of pixels in the horizontal direction is 1000, and movies can be enjoyed with good quality. In the case of this screen, as shown in FIG. 17D, a hole 02 having a diameter of about 2.6 mm can be provided between the display elements 11. The aperture ratio YAS is about 33%, and the sensory stimulation medium can be sufficiently released.

From the above, the hole diameter of the screen is preferably 0.1 mm or more and a viewing angle of 0.5 degrees or less at the shortest viewing distance MinD.

FIG. 17C shows the case where the pixel size is 2.1 mm. However, in the large screen display device, when the pixel is further increased, the shortest viewing distance or the normal viewing distance is also increased. The maximum allowable value of the hole diameter is increased. When the pixel size is about 4 mm, the hole diameter can be increased up to about 20 mm.

FIG. 18 shows a display device with a sensory stimulation medium presenting function which constitutes a display element (pixel) using an electron emission phosphor in the twelfth embodiment of the present invention. 4A is a front view and a cross-sectional view of the screen 10, and FIG.

The display element 11 includes a light emitter 18 provided between the back substrate 12B and the transparent front substrate 12C, and a lens 19 provided on 12C. The front substrate with lens is shown in 12D. The configuration of 18 will be described. The hole 98 is provided in 12B, and the electron emission part DEN is provided in the hole. A phosphor KEI is provided on the back surface of 12D. 12B and 12D (12C) are bonded so that the inside of 98 is evacuated. Electrons emitted from DEN collide with three phosphors KEI corresponding to red, green, and blue to emit fluorescence. The three solid arrows from DEN to KEI in FIG. Light Light is emitted from the optical main emission surface 19k of the lens.

FIG. 18C is an enlarged view of the electron emission fluorescent element portion. Of the three colors, the configuration for one color is shown. DEN is composed of a cathode (emitter) and a gate. Electrons are extracted from the cathode by applying a high electric field. 12D is made of glass, and an anode (anode) for attracting electrons and a phosphor KEI are provided on the back side. In the figure, electrons are extracted in the vertical direction, but as another method, a small slit may be provided on the substrate to form an emitter and a gate to extract electrons. A so-called surface-conduction emitter (SCE) may be used.

A hole 02 is provided so as to penetrate 12D (12C) and 12B. As shown in FIG. (B), 02 is provided large between the lenses 19, but the light emitter 18 is smaller than the optical main emission surface 19 k of the lens, so 02 is spaced from 18. Provided. Therefore, it is easy to provide a hole and the reliability is high. A thin display device can be configured.

FIG. 19 shows a display device with a sensory stimulus medium presentation function used as an electronic signboard in the thirteenth embodiment of the present invention.

This is an information providing system in which gas releasing devices 01A and 01B are provided in the screen 10 to present a scent or the like to a person (Aki, Yoshi) who passes in front of the screen and make them interested. It is intended for use in electronic advertisements. A state viewed from above the passage Road is shown. The said 01A, 01B is the same as that of the gas discharge | release apparatus 01 described in FIG.

01A can be released toward Yoshi as a mass 04 of scents by switching various scents (Frg). 01B can release a cold mist mass 04 along with the scent towards Aki.

Although two gas releasing devices are provided on the screen, the gas releasing device near the position where the video object is visually perceived is selectively driven to present a gas such as a scent corresponding to the object. Objects that generate a fragrance such as a flower can be displayed as an image on the screen on which the gas release device is mounted. By selectively driving 01, the scent can be emitted from the vicinity of the object and from the vicinity of the user, so there is little discomfort and it is natural.

Alternatively, a passerby may be guided in front of the scent discharge device 01A or 01B by video, audio, etc., and the device may be selectively driven by detecting that a person has approached. Since 01 uses the principle of an air cannon, a scent can be presented to the user's nose. Since the sense of reality of objects increases, understanding and interest in products increases. There is a sales promotion effect.

Ue is a portable communication terminal possessed by a passerby. The terminal can transmit user attribute information, position information, and scent release request information. SG1 is a device that receives the signal, and SG2 is a device that controls 01A and 01B. SG2 can be controlled to release an appropriate scent or tactile stimulus under the information transmitted from the user. As a tactile stimulus, in addition to the cold fog, warm air, an air current such as a breeze, and the like are possible.

The attribute information includes sex, age, occupation, etc., which can be registered in advance by the user. In conjunction with the information, an image can be displayed on the screen 10 to release a scent. For example, if the passerby is a woman, display a flower image such as a rose or a lily on the screen in front of the scent discharge device, detect that a person is approaching, or guide it in front of the flower image. , Can release the scent of flowers. In addition, if you are a man, you can display images of the sea and mountains and release marine and forest scents. You may make it select a favorite image | video and fragrance from the sender | caller side.

The position information can be obtained by a method of transmitting a signal as indicated by a broken line from the directional signal generator DT incorporated on the wall side to the passage side, and returning immediately when Ue receives the signal. As the DT signal medium, infrared rays, ultrasonic waves, radio waves, and the like can be used. In other words, by receiving the confirmation signal from Ue, it can be detected that a person has entered the signal range of DT.

The attribute information and position information may be recognized or estimated by image processing instead of using a mobile communication terminal. The camera can be provided in the screen or on the aisle ceiling. When the reference light emitting device and the camera are provided in the screen, it is possible to reliably catch a person who is approaching the object and detect the position with high accuracy.

As mentioned above, although the example which discharge | releases a fragrance was demonstrated, as a chemical substance mixed in the gas to discharge | release, a deodorizer, a pharmaceutical, an antibacterial agent, an insecticide, high concentration oxygen, fog, or these combination can be utilized. It can vaporize and release chemical substances that are needed in daily life. If the user is guided in front of the gas discharge device and breathing is indicated by video, audio, etc., the chemical substance can be quantified and administered. Administration of nasal vaccine for influenza is also possible. Passers can easily take the vaccine by stopping their feet and breathing with their face close to the screen. The drug can be administered to a large number of people at high speed.

20 and 21 show a 14th embodiment of the present invention in which a near-infrared reference light is emitted from the screen, the reflected light is photographed by a camera in the screen, and the sensory stimulation medium presenting portion of the user is processed by image processing. (Eye, nose, ear, face, hand, etc.) or a display device that detects a gazing point and presents a sensory stimulus medium, a display device that presents a motion CG image, and allows head movement Thus, the display device enables binocular stereoscopic vision.

FIG. 21A is a top view of the device, and FIG. 21B is a front view. 10 is a screen, 12B is a back substrate, 12C is a front substrate, and light emitters 18 are provided in an array between the substrates. Lenses 19 are provided in an array on 12C so as to enlarge the light emitter 18. The display element 11 is composed of 18 and 19. 12D is a front substrate with a lens. 18 can be an LED, an EL element, an electron emission fluorescent element, a plasma discharge element, or the like. Moreover, you may comprise LED with a lens like FIG. Reference numeral 78 denotes a circuit for driving 11.

11, holes 02 are provided. This configuration is the same as in FIG. Since the hole 02 penetrating the substrates 12B and 12C is provided between the lenses 19 and behind the light main emission surface, the hole is not irradiated with light and is dark and hardly perceived by an observer.

01 is a gas discharge device, 07 is a pressure generating means using a blower 97, 06 is a cylinder, and is provided so as to be in close contact with 12B so as to surround a plurality of holes 02. As shown in FIG. 21B, the plurality of holes 02 form a virtual gun barrel 05. The air Air or the scent Frg passes through the hole 02 as shown by the alternate long and short dash line in FIG. 20A and is presented to the users (observers) P1 to P4.

Next, a method for detecting the position of the user's sensory stimulation medium presentation site (eye, nose, ear, face, hand, etc.) will be described. The hole 02 is provided with a camera lens 74, an image pickup element 73, a cylinder 75 for receiving them, and a small camera 72 comprising a drive circuit. A hole near the camera hole is provided with a near infrared light emitting element 77 and a drive. A near-infrared projector 76 composed of a circuit is provided.

For 77, a high-intensity LED, EL element, SED element, or the like can be used. It is desirable to provide it symmetrically around the 74 optical axes. In FIG. 21B, four 77 are shown, but more, for example, several tens may be provided. 77 can be intermittently driven in accordance with the photographing timing of the camera. The camera 72 can capture only an image of near-infrared reflected light by using a near-infrared bandpass filter. It is easy to extract feature points.

When the user's eyes are irradiated from near the optical axis of the camera lens, the light is refracted by the cornea, enters through the pupil, and is collected by the retina. Part of this light is scattered and reflected, passes through the pupil, is refracted by the cornea, and returns to the direction of the light source. In other words, retroreflection occurs. Since there is a camera near the light source, the pupil is brightly photographed. LGR indicates near-infrared illumination light, and LGA indicates light captured by the camera 72.

When a plurality of 77 are provided around the optical axis of the camera lens 74, the entire pupil image by the retinal reflection is photographed with uniform brightness. Since the brightness is higher than the brightness of the background, the pupil can be easily extracted. Since the pupil is close to the focal point of the eyeball optical system, it can be used as a feature point for detecting the position of the eye.

Since a plurality of cameras can be provided on the screen 10, if the pupil images are associated in each camera image, the pupil position (measurement coordinate system) in the camera coordinate system (measurement coordinate system) can be obtained by a stereo image measurement technique. Eye position) can be detected. In the present invention, since cameras can be provided at various locations on the screen, even if the user moves in front of the screen, the feature points can always be captured by a plurality of cameras. it can.

Further, since the camera 72 is fixed in the screen, the camera coordinate system (feature point measurement coordinate system) and the screen coordinate system, that is, the display coordinate system can be calibrated at the time of manufacture. To determine the relative positional relationship between the feature point measurement coordinate system and the display coordinate system, for example, the academic literature by the present inventors “Akira Banno, Fumiro Kishino, Yukio Kobayashi: Allowing pupil extraction processing and head movement The algorithm described in "Prototype of eye-gaze detection apparatus, IEICE, IEICE (D-II), J76-D-II, 3, pp. 636-646 (1993-03)" can be used. After the device is manufactured, calibration for obtaining the coordinate conversion parameters is unnecessary or greatly simplified. In this way, the position of the feature point can be detected in the display coordinate system.

The same applies to the case where a cornea reflection image is used as a feature point other than the pupil. Since it is photographed as a bright spot by the near-infrared reference light, extraction is easy. Furthermore, a retroreflective material mark can be used. For example, as shown later in FIG. 26 and FIG. 27, when the mark is provided on the eyeglass eyeglass and the image is taken with the camera in the same manner, the mark is taken brightly, so that the extraction is easy and the position of the eye is highly accurate. Can be measured. A small transparent sphere having a refractive index of about 2.0 can be used as the retroreflecting material.

As described above, if the position of the eye or the position of the eyeglasses is known in the display coordinate system, the three-dimensional world model is converted into a two-dimensional image at high speed in real time by the perspective projection conversion method using this position as a viewpoint. If it is displayed, a motion parallax image whose appearance changes by moving the head can be displayed.

If the positions of both eyes are known, the positions of the nose, ears, cheeks and the like can be estimated from the three-dimensional model of the face. Further, a retroreflecting material mark may be attached to the part as a feature point such as a nose, an ear, or a cheek, and its position may be detected. Moreover, you may detect positions, such as a nose, an ear, and a cheek, using a moire pattern as reference light. In either case, the feature point position can be obtained directly in the display coordinate system.

As shown in FIG. 20, since the gas discharge device 01 can be mounted in the screen, the position of 01 can be determined in the display coordinate system. Therefore, 01 can be controlled based on the position information of the sensory stimulation medium presentation site, and the scent, airflow, etc. can be presented to the user accurately.

Next, a gaze point detection method will be described. In order to detect the line of sight, the position of the eyeball and the rotation angle of the eyeball are required. The position of the eyeball can be detected by the above method. However, in order to detect the rotation angle of the eyeball, it is necessary to magnify the eye and to extract the feature points efficiently. The method will be described below.

FIG. 21C shows a part of the screen 10 of FIG. 21A in which a small camera with a telephoto lens (72 Zoom) is mounted in the hole 02 of the thin screen so that the tip of the lens rotates as a fulcrum. . By using a lens having a long focal length or a lens whose focal length can be adjusted, the eye can be enlarged and photographed. A near-infrared light emitting element can be provided around the lens.

On the screen 10, a camera 72 with a standard or wide-angle lens and the camera with a telephoto lens (72Zoom) can be provided. A stereo image measurement system is configured using a plurality of 72, the position of the eye is detected, the imaging direction of 72Zoom is controlled using the position information, and the part can be enlarged and imaged. Since the pupil and the corneal reflection image are captured in the image, the eyeball rotation angle can be detected by measuring the distance between the two feature points and applying the eyeball model. Accordingly, the line of sight can be detected. A gaze point can be detected as a point where the line of sight and the screen intersect.

As the gaze point detection algorithm, the method described in Japanese Patent Publication No. 03-051407 by the present inventors can be used. In this document, a three-dimensional magnetic sensor is used for eye position detection, and special eyeglasses are used for measuring an eyeball rotation angle. In the present invention, since these measurement systems can be incorporated in the screen, the gazing point can be detected without wearing. Easy to use and much more accurate.

Further, the point of interest on the screen can be obtained based on detection of the feature point positions of the pupil and the face. The gaze point detection algorithm described in Japanese Patent No. 273931 by the present inventors can be used. In this document, since the camera is arranged around the display device, the feature point of the pupil and the face cannot be captured in the front if the display device is large, so the gazing point detection range is narrow and the screen of the screen being watched The detection accuracy varies depending on the location. However, in the present invention, a camera capable of enlarging and photographing feature points at various locations on the screen can be provided, so that the point of gaze can be detected with high accuracy even on a large screen.

In addition, since cameras can be provided at various locations on the screen, the pupils are magnified and photographed with each camera, and if the pupil is photographed in a circle, the line of sight is in the direction of the camera, so the vicinity of the camera It can be determined that the object is being watched. An algorithm can be applied in which the direction of the camera in which the pupil image closest to the circle is taken is the viewing direction of the observer. If the pupil image is an ellipse, the line-of-sight angle can be estimated from the ratio of the major axis to the minor axis. Thus, the gaze direction can be estimated relatively easily from the shape of the pupil. Although it is difficult to achieve high accuracy with a conventional display device in which the camera installation location is limited, since many cameras can be arranged in the screen, it is possible to detect a gaze point with high accuracy.

Next, binocular stereoscopic display that allows head movement without wearing special glasses will be described. The structure shown in FIG. 20B is used for the display element 11. A total of six left eye light emitters (18L) and three right eye light emitters (18R) are provided per display element. An optical slit 69 is provided in front of 18, and only a part of the light passes therethrough. In the figure, only the light rays LG1, LG3, LG5 for the left eye are shaded. As shown in FIG. 20A, the light beam is refracted by the lens 19 and travels in the direction of the observer.

The lump of light emitters 18, optical slits 69, and lens 19 are display elements for left-eye images and right-eye images. The three light emitters 18 (L) illuminate the left eye positions (17L) at three locations (P1, P2, P3) as indicated by broken lines (LG1, LG3, LG5). The three light emitters 18 (R) irradiate three right eye positions (17R) as indicated by solid lines (LG2, LG4, LG6). Here, the light beam is irradiated by the lens 19 so as to have a predetermined width (for example, about 6 cm) at the position of the eye as shown by hatching in FIG. 6 cm corresponds to the distance between the left and right eyes. Other light rays are similarly irradiated so as to have a predetermined width.

By detecting the position of the user's eyes in real time and irradiating a band of light at that position, separate parallax images are presented to the left and right eyes, allowing head movement and binocular stereo without glasses Visible. If the positions of the eyes of a plurality of observers are measured and a band of light is projected, a plurality of people can view both eyes simultaneously.

FIG. 20C illustrates another mode of the display element. One lens 19 is provided for each of the two light emitters 18 for the left and right eyes. That is, the lens is shared by the two light emitters. The optical slit is omitted. Three odd numbers 18 (L) from the right side of the light emitter 18 correspond to the screen for the left eye, and three even numbers 18 (R) correspond to the screen for the right eye.

In FIG. 20A, there are three observation places where binocular stereoscopic vision is possible, but since the distance between both eyes is about 6 cm, light is emitted so as to irradiate more bands with this width. When the body and the optical system are provided, the observation place can be greatly expanded. The observation range can be expanded not only in the left-right direction but also in the front-rear direction as in P4. A lump of light emitters can be manufactured using integrated circuit technology or the like. Organic EL elements are suitable for integration.

As an application of this embodiment, if the user's viewpoint position is detected, a specular viewpoint that is symmetrical to the viewpoint is set in the screen, and an image taken by the in-screen camera near the viewpoint is displayed, the screen is displayed. A “digital mirror” used as a mirror can be realized.

FIG. 22 shows control of a circuit for driving the lump 18 of the display element in FIG. It is a simple matrix method. SWLi (i = 1 to 6) is a switch for horizontal pixels, SWHi (i = 1 to 3) is a switch for vertical pixels, and Ei (i = 1 to 6) is a power source for the light emitter. Since the pixel information is the intensity of light (brightness), the voltage of E is adjusted according to the image.

FIG. 22 shows a case where the observer is in P3 in FIG. SWL5 and SWL6 and the vertical pixel switch SWHi are operated to adjust the voltages E5 and E6, thereby controlling the light intensity of the left-eye pixel and the right-eye pixel. A band of light is emitted from the light emitter 18 toward the positions 17L and 17R of the left and right eyes of the observer P3.

When the observer moves from P3 to P2, SWL3 and SWL4 are operated to adjust E3 and E4. In the middle position between P2 and P3, SWL4 and SWL5 are operated, and E4 and E5 are adjusted. Thus, the light emitter to be operated can be selected according to the position of the observer, and the light intensity can be instantaneously controlled.

Note that the simple matrix method of FIG. 22 has a problem that the light emission time is shortened, so the active matrix method can also be used. In the active matrix method, a driver circuit and a control circuit are integrated and mounted in the vicinity of a light emitting element. The light emission time and intensity can be adjusted for each element.

FIG. 23 shows a display device with sound presentation according to a fifteenth embodiment of the present invention. Figures (A) and (B) are longitudinal sectional views of the apparatus. A sound wave passage hole 02 is provided between the display elements 11 (Pix) of the screen 10. Reference numeral 60 denotes a directional sound presentation device such as an ultrasonic speaker. The sound wave emission direction can be changed by rotating 60. Although not shown in the figure, it is natural that the gas discharge device can be provided in a part of the hole 02.

The hole (02) provided in the screen is configured such that the front side where the display element is located is small and the back side is large. Acts as a guide for sensory stimulation media such as wind, sound waves, or reference light.

FIG. 23C illustrates a realistic communication system. Reference numeral 79 is an observation camera, 66 is a directional microphone, 62 is a rotation control mechanism, and 67 and 68 are communication devices. The operation will be described. The movement of the head of the user P1 is detected by the image measuring means as described in FIG. The movement of the head is transmitted to a remote place by a communication device. Based on the head information, 79 and 66 change directions by 62. The sound collected at 66 is transmitted at 67 and 68 and reproduced at 60. At this time, the direction of 60 changes in synchronization with 66. 10 can faithfully reproduce the sound in the direction that the observer is facing. The video imaged at 79 is transmitted and displayed at 10 by 11 drive control devices 13.

Further, since the ultrasonic wave has an effect of conveying fine particles with sound pressure, a mist generating device can be provided in front of the ultrasonic speaker 60 and the mist can be discharged from the hole with sound pressure. The fog can also contain a scent.

FIG. 24 shows a sixteenth embodiment of the present invention, which is a display device that presents a three-dimensional sound from a hole provided in a thin screen. In the figure, reference numeral 10 denotes a screen using the same organic EL element as in FIG. Reference numeral 11 denotes a display element, and EL (R, G, B) are EL elements of three colors. EL (IR, R, G, B) indicates a display element in which EL (R, G, B) and a near-infrared EL element (IR) are integrated.

The display device can perform kinematic display and binocular stereoscopic using the stereoscopic glasses 82 in combination. A retroreflecting material (mark) 83 is provided at 82. Light LGR emitted from EL (IR) is reflected by 83 and the reflected light LGA passes through the screen 10 and is captured by the camera 72. Three marks 83 are provided around the left and right eyes. By determining the attachment position of each mark in advance, the position of the eye and the orientation of the face can be detected with a single camera.

For this detection, for example, the scientific literature “Kazunori Omura, Akira Banno, Yukio Kobayashi: Application to the instruction input of the face direction detection method by monocular image, IEICE, Theory of Science (D-II), J72 -D-II, 9, pp. 1441-1447 (1989-09) "can be used. If the positions of the left and right eyes are known, binocular stereoscopic video images and motion video images can be displayed on the screen 10 by performing perspective projection conversion of the three-dimensional object model Obj.

Here, liquid crystal shutter glasses can be used for switching between the left and right eye images. That is, it can be realized by alternately switching and displaying the left and right eye images and switching the liquid crystal shutter of the glasses 82 so as to be synchronized with the switching.

In addition, polarizing filter glasses can be used for switching between the left and right eye images. That is, a display element for left and right eye images is provided on the screen 10 (see FIG. 9E), a polarizing filter whose polarization directions are orthogonal to each other is provided in front of the display element for the left eye and the display element for the right eye, This can be realized by observing a pair of polarizing filters provided on the glasses 82. Polarized filter eyeglasses are lighter and cheaper than liquid crystal shutter eyeglasses, and thus are highly convenient.

FIG. 24A shows a state where the object Obj that emits sound is observed forward on the inside of the screen 10. A spherical integrated speaker 63 has a large number of small speakers 64 provided on a spherical surface. The sphere can emit sound waves radially. When the spherical integrated speaker is used, a clear and loud sound can be presented to the observer in a state where Obj is facing forward. The loudness of the sound is indicated by the thickness of the dashed arrow.

FIG. 24B shows a state in which Obj faces backward. A dull little sound can be presented. In this way, the sound can be changed and presented depending on the direction of the three-dimensional display object on the screen. Since the sound wave passes through the screen 10, it sounds as if sound is really coming from Obj, and a high sense of presence is obtained.

FIG. 24C shows an example in which the holes 02 of the substrates 12B and 12C are used as the pinhole lens 74a of the camera 72. The lens can be realized by processing the hole small as shown in the figure and applying a light shielding material to the edge of the hole. The camera 72 can be configured by a tube 75 serving as a light guide provided on the right side of the lens and the hole of the back substrate 12B, an image sensor 73, and a drive circuit. The periphery of the lens can be covered with a transparent member so that foreign matter such as dust does not enter from the lens hole.

FIG. 25 is a display device according to the seventeenth embodiment of the present invention, in which a plurality of sensory stimulation medium discharge means provided on the screen are selectively driven. FIG. (A) is a display device with a scent presentation function provided on a pillar and shows application to an electronic advertising board. In the figure, 57 is a pillar, 10 is a screen, 01 is a gas discharge device, 05 is a virtual cannon as shown in FIG. 1, and 04 is a vortex ring of scent discharged from the cannon. Released near the nasal cavity.

A plurality of screens are provided on the pillar, and objects Obj1 (forest images) and Obj2 (fruit images) are displayed on each screen. A passerby P1 is detected by a camera provided in the screen. In the figure, since P1 looks at Obj1, the scent releasing device 01 near Obj1 is selectively driven to release the forest scent. If P1 moves in front of Obj2, the fruit scent is released.

In the public place, if the scent is unnecessarily released, the scent diffuses and becomes annoying, or the freshness of the scent presentation is impaired. This problem does not occur because the discharge device is selectively driven and the minimum scent is presented.

When a person tries to pass in front of a pillar in a station or underground mall, the apparatus detects the passage and releases a scent. Since the passersby turn around and look at the electronic advertising board (display device), the advertising effect is high. If the passerby can be stopped, the billboard can be switched from a still image to a moving image.

For example, when an image of several tens of seconds flows when stopped and a scent is presented in conjunction with the image, the viewer strongly remembers the content of the image, so the advertising effect is great.

FIG. 25B shows a display device with a large curved screen with aroma and sound presentation function. It shows application to watching movies and artistic video content. In the figure, 10 is a curved large screen, 01 is a scent discharge device, and 63 is a spherical integrated speaker shown in FIG. The user P1 wears stereoscopic eyeglasses 82 and observes by moving vision and binocular stereoscopic vision. An orchestra stereoscopic image is displayed on the screen. Obj-Pi (i = 1 to 3) is a life-size object of an orchestra member.

A speaker in the vicinity of a position where each instrument part (object) is visually perceived is selectively driven to present a performance sound of the instrument. When the movement view is displayed, when the user P1 changes the position, the video position of the musical instrument part also changes, so that the speaker is switched. Similarly, when the object moves, the video position changes, so the speaker is switched.

In the figure, the performance sound of Obj-P1 (violin part) is presented from the speaker 63-2 near the line segment 58 connecting Obj-P1 and P1, but if P1 moves to the left, the image is displayed. Since the distance from the image is closer to 63-1, the performance sound is presented from the speaker.

In order to present the performance sound of Obj-P2 (flute part), a speaker near line segment 59 connecting Obj-P2 and P1 is selected, but there is no speaker on the same line. In this case, the sound image may be localized at a position where Obj-P2 is visually perceived by selecting the nearest 63-3 and 63-4 and changing the phase of both sounds or changing the volume. Furthermore, you may mix the sound of a some speaker.

In addition, control may be performed so as to enhance the attractiveness, such as brightening the image of the place where the sound is being emitted. In the case of a solo part in an orchestra, you can direct the sound of the instrument to jump out of the spotlight.

The same applies to scent presentation. Many scent discharge devices are provided on the screen, and the scent release device near the position where Obj-Pi is visually perceived can be driven. For example, when the object is a flower field and a plurality of types of flowers are displayed, a corresponding scent can be presented from the position of the flower.

However, when the number of scent discharge devices 01 is small, 01 may not exist near the flower display position. In this case, as shown in FIG. 25 (B), the two right and left scent discharge devices 01 can be interlocked. A local scent space can be formed by releasing a scent lump 04 from the virtual cannon 05 and causing two 04 to collide near the nasal cavity of the observer. Since the minute fragrance is used, the fragrance does not disappear when the observer breathes. Various scents can be switched and presented.

In the prior art, since a speaker or a scent presentation device is provided outside the screen, it is difficult to localize sensory stimuli as the screen becomes larger. In other words, you can't make a sense of making a sound or smelling from the location of an object. However, in the present invention, the sensory stimulation medium can be presented locally from the screen. Increases the added value of video content because it provides a high sense of realism and remains highly memorable.

FIG. 25C shows a case where the present invention is applied to display means for direct drawing by focusing and irradiating laser light into a space to generate plasma discharge. Obj1 and Obj2 are objects drawn in the air by lasers (Laser1 and Laser2). Since Obj is an image in the air, it is difficult to release a sensory stimulation medium other than vision from the place.

Therefore, in FIG. 25C, the curved screen of the present invention is provided so as to surround a space for direct drawing. A background image is displayed on the screen, and fragrance, airflow, and sound are emitted from a hole in the screen. The feature point extracting device 71 extracts the feature point P1, and the stereo image measurement detects the P1 viewpoint position.

It is possible to selectively drive the gas discharge device 01 or the small directional speaker 61 located on the extension line where Obj is visually perceived when viewed from the viewpoint position of P1. Or you may control to drive 01 or 61 near Obj. As described above, it is possible to feel as if sound, fragrance, and airflow are released from the position of Obj. Since there is no contradiction in the presentation of multiple sensory stimuli, a natural and high sense of presence can be obtained.

FIG. 26 is an immersive display device using a plurality of screens for detecting a user's sensory stimulation medium presentation site or a gazing point and presenting a scent, airflow, and sound in an eighteenth embodiment of the present invention. .

In FIG. 26A, 10-1, 10-2, and 10-3 are screens, and structures such as FIGS. 9, 16, 18, and 21 can be used. 01 is a gas discharge device, which is the same as 01 in FIG. 05 is a virtual cannon, and 04 is a scent (Frg) or air (Air) vortex ring, which presents olfactory and tactile stimuli to the observers P1 and P2. 65-1 and 65-2 are devices for discharging the remaining scent discharged from 01, and have the same structure as FIG. The alternate long and short dash line indicates the gas flow.

In FIG. 26B, 71 is a feature point extracting device, 74 is a camera lens provided in the hole 02, and 77 is a near infrared light emitting element provided in the surrounding hole 02. In FIG. 26C, 72 is a camera, 73 is an image sensor, and 75 is a cylinder. Details are the same as in FIG. In FIG. 26A, reference numeral 70 denotes a stereo image measuring apparatus composed of a plurality of 71, which detects the spatial positions of feature points. Since the viewpoint position can be detected at 70, motion visual display is possible without glasses. In addition, binocular stereoscopic display is possible using the screen of FIG. Of course, the stereoscopic glasses can be used as an alternative means.

In the present invention, since the position of the user can be accurately detected, it is possible to detect that the user has approached a predetermined place on the screen and release the scent from the gas discharge device 01 to the user. After the release of the scent, there is a problem that if the scent remains in the space, it will not be linked to the image, so exhaust is made at 65-1, 65-2. Thereby, a scent can be switched at high speed.

Reference numerals 60-1 and 60-2 denote ultrasonic speakers, which are the same as 60 in FIG. The position of the user's ear can be detected and sound waves can be emitted in that direction. Since the ultrasonic speaker has super directivity, when there are a plurality of users, specific information can be presented to a specific person.

In FIG. 26D, the configurations of the gas release device 01 and the speaker 61 are different from those in FIG. The gas discharge device 01 is horizontally long and has a structure shown in FIG. That is, many airflow tubes 021 (i = a, b,...) Shown in FIG. 7 are provided in the region 01 on the screen 10-1. A virtual gun barrel 051 (i = a, b...) Can be formed by using a predetermined number of airflow tubes from the 02i collectively (in a bundle). The location of the virtual cannon can be changed depending on how the airflow tube is selected. The user's position can be detected, and the scented lump can be released from the virtual barrel near the position. Moreover, you may discharge | release the lump of fragrance from the virtual gun barrel near the position where an object is visually perceived.

Reference numeral 61 denotes a small directional speaker, which is arranged in a number of holes in the screen. When the observer approaches the display target, the position of the observer can be detected by 70, and sound can be presented from the speaker at the most appropriate position. That is, a sound related to the object can be emitted from a speaker near the position where the object is visually perceived. Therefore, the observer can identify the sound source and feel as if sound is emitted from the object.

FIG. 26F shows a state in which many feature point extraction devices 71 i (i = a to e) are incorporated in the screen 10 to detect a gazing point. In a state where P1 faces the front, the line of sight Gaz1 is in the direction of 71C. With the 71C camera, the pupil is photographed in a circular shape. On the other hand, images are captured in an ellipse with other cameras. Accordingly, the gaze direction can be detected by measuring the deviation of the pupil shape from the circle.

In the figure, it can be estimated that the object displayed in the vicinity of 71C is viewed. Similarly, if it is detected that the line of sight Gaz2 is in the direction of 71a, it is understood that the object in the vicinity is being viewed. It is possible to increase the measurement accuracy of the position of the gazing point by statistical processing by calculating the average value and variance of the major axis and minor axis of the pupil images taken by a plurality of cameras.

Compared with the conventional immersive display device shown in FIG. 28, the screens of FIGS. 26A and 26D are thin and can be incorporated into a wall. Because it is far less space, it can be used as a home media room. The user's position can be detected, and the scent and sound can be linked with the video and presented appropriately. It is also possible to detect a gazing point, and it is possible to display an image based on the user's intention extraction and present a sensory stimulus medium. Realistic effect is extremely high.

In addition, a calibration operation (operation for obtaining coordinate conversion parameters) for determining a positional relationship between the display coordinate system of the screen 10 and the coordinate system of the stereo image measuring device 70, and the display coordinate system, the gas discharge device 01, the speaker 61, Since the work for determining the positional relationship can be performed at the time of manufacturing the apparatus, no work on the user side is required. Convenience is high.

FIG. 26G illustrates an example in which the present invention is applied to an air conditioner. 01 is a gas discharge device, and 65 is a gas discharge device. A thin screen 10 provided with a hole in the front surface of Aircon is provided so as to be in close contact. Although the case where an EL element is used as a display element is shown, an LED may be used. It is an air conditioner that can display images.

The gas is discharged from the back side of the screen to the front side and discharged from the front side to the back side. The gas can be released by heating, cooling, humidification, or dehumidification. If it is made large, the screen itself in FIG. 26A becomes an air conditioner. Since the walls, ceiling, and floor of the room are display devices and atmosphere control devices, the space can be used effectively. In the conventional air conditioner, the wind blows out from one place, but in the wall built-in air conditioner of the present invention, air is released from the entire wall surface, so that a feeling close to natural wind can be obtained.

FIG. 27A is a nineteenth embodiment of the present invention, which detects a user's sensory stimulation medium presentation site or gaze point and appropriately presents fragrance, airflow, and sound from front and rear, left and right, and top and bottom. It is an immersive display device using a plurality of screens. Screens 10-i (i = 1 to 5) are provided on five surfaces around the user (observer) P1. It is intended for application to home and business media rooms, and the screen size is about 2 to 3 m on a side.

FIG. 27B is a cross-sectional view of the screen 10-2. The screen configuration is the same as in FIG. 16, and the display element 11 includes a light emitter 18 (R, G, B; LED) and a lens 19 and is provided on the substrate 12. The size of 11 can be about 1 mm to 3 mm, and the distance between display elements can be about 2 mm to 4 mm. If an integration technique or an organic EL element is used, the definition can be further improved. 11 is provided with a hole 02 for gas passage and reference light passage.

The near-infrared reference light source 77 uses a high-intensity near-infrared LED different from 11. Reference numeral 72 denotes a camera, LGR denotes reference light, and LGA denotes photographing light that passes through the lens 74.

In the screen 10-i, six feature point extraction devices 71 described with reference to FIG. 26 and the like are shown, but they may be provided in more places. By using a plurality of 71 in combination, the feature point position of the user can be detected with high accuracy in the space surrounded by the screen. There is no place that cannot be measured no matter how the user moves.

Motion parallax video can be displayed using viewpoint position detection. A binocular stereoscopic image can be enjoyed using the stereoscopic glasses 82. In addition, if the camera with a telephoto lens shown in FIG. 21C is used together, it is possible to detect a gazing point, so that it is possible to provide advanced services such as video display based on user's intention estimation, auditory / olfactory / tactile presentation. .

01 or 65 is a device that serves both for gas discharge and exhaust, and can be configured by combining 01 in FIG. 14 and 48 in FIG. By controlling forward and reverse rotation of the impeller 47, the flow of the airflow (Air, Frg) can be changed as indicated by a one-dot chain line arrow in FIG.

The gas that is an olfactory stimulus or a skin tactile stimulus medium is released from the back side of the screen to the front side and discharged from the front side to the back side through the holes in the screen. Therefore, it is possible to present fragrance and wind from various directions to the observer. In particular, effective stimulation presentation is possible by detecting the position of the user's nose, face, etc., selectively driving 01or65, and applying airflow to the position.

For example, it can reproduce the situation where the wind direction changes drastically like a storm. Since 01 or 65 can discharge gas from a wide range, it is suitable for presentation of skin tactile sensation such as wind. In addition, as shown in FIG. 26, a virtual gun barrel may be configured to release airflow, scent, mist vortex ring, and the like. Although it is a physically small space, it can produce a high sense of presence by presenting the five senses.

FIG. 27C shows a cross-sectional structure of the floor screen 10-3. In the same figure, 12B is a back side board | substrate and the display element 11 demonstrated in FIG.27 (B) is located in a line. A tube 02a is provided in the hole 02, and a transparent front substrate 12C provided with a hole is provided on the tube. That is, 11 is provided between 12B and 12C, and a hole 02 is provided between 11 and 11 so as to penetrate both substrates. The tube 02a has a function of supporting the 12C while allowing the air flow to pass therethrough. Since 02a and 12C are sealed, no dust or moisture enters from the hole.

A gas discharge / discharge device 01or65 is provided below 12B. Moreover, the fragrance | flavor supply parts 30-1 and 30-2 of the structure shown in FIG. 2 or FIG. 7 are provided in a part of pipe | tube 02a. From 02a, in addition to air Air, various fragrances Frg can be released. For example, a flower scent can be emitted when a flower field is represented by an image, and a cold mist can be emitted when a morning frost landscape is represented.

The light emitted from the 11 main light emitting surfaces 19k is denoted by Light. The tip of the tube 02a provided in the hole protrudes from the tip of the lens 19, but is set so as not to be caught by the light light. That is, as shown in the figure, the hole 02 or the tube 02a connected to the hole can be prevented from entering the conical shape (Light) connecting the light emitter 18 and the light main emission surface 19k. Since Light does not illuminate the inside of the tube, the hole is dark and not visible.

FIG. 27D shows another configuration example near the hole. 12C, 02a and 86 are integrally formed of plastic or the like. Reference numeral 86 denotes a support portion for the front substrate. The screen of the present invention can be configured by covering the integrated component on 12B. Easy to manufacture. Moreover, when 12C becomes dirty or damaged, there is an advantage that it can be replaced.

Since a person walks on the front side base 12C, it is made of a material having high transparency and strength. Reinforced resin, glass, etc. can be used. In addition, a transparent sheet with a further hole may be stretched on 12C to reinforce the floor surface. An airflow passage material such as a mesh may be provided on the hole 02 so that the hole does not stand out and dust does not enter.

FIG. 27E shows an example in which the screen 10-3 is configured by the display element 11 using the cylindrical lens of FIG. Laminate 12C on 12B. Since the front surface of the lens is flat, it is easy to manufacture and suitable for thinness. Easy to clean. The display element (lens) may be a quadrangular prism type. The hole may be a circle or a polygon including a quadrangle.

It is natural that scents and skin tactile sensations are desired when the image becomes large-screen and high-resolution and the sense of presence increases. All of these can be realized in the present invention. Since the user's intention can be estimated from the gazing point detection, it is possible to detect sleepiness, present an image urging activation, present a fragrance, detect excitement, and present a scent with a calming action. A cold water may be atomized and the fog may be emitted from the gas generator toward the face so that a three-dimensional image of the fountain is presented, and it is possible to detect that the observer is approaching and feel a splash. At the same time, the local sound can be presented from a nearby speaker.

In the embodiments of FIGS. 26 and 27, since a large number of cameras (72) can be built in a plurality of screens, a user can be photographed simultaneously from various directions and feature points can be extracted. By detecting the three-dimensional position of the feature point and collating it with a user's three-dimensional model prepared in advance, a three-dimensional image of the user can be produced in real time. By transmitting the feature point information and auditory, olfactory, and tactile information to a remote location and reconfiguring them, it is possible to realize intelligent encoded communication capable of presenting the five senses.

The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the above-described embodiments include various stages of the invention, and may be implemented by an appropriate combination. Furthermore, the constituent elements of the above-described embodiments can be omitted as appropriate based on the purpose, or can be supplemented by well-known conventional techniques.

The following devices and services can be used.
(1) Highly realistic video display device; scent, air current, and three-dimensional sound can be presented in synchronization with the video story. That is, in addition to conventional vision and hearing, olfaction and touch can be presented. Improves realism and deepens understanding of the content. The scent and airflow can be switched at high speed, making it ideal for next-generation television, movie / Internet video content, and bodily games. For example, a user who is watching a horror movie can be sprayed with a lively nasty smell from behind. The presence is increased and interest is increased (FIG. 25B, FIG. 26, FIG. 27, etc.).

(2) Highly realistic simulator: Various situations that can occur in reality can be created in a virtual environment and used for training and confirmation. Since the present invention can present the five senses, a highly accurate simulation close to reality is possible. For example, it can be used for driving assistance for driving, airplane operation assistance, housing design confirmation, travel destination selection confirmation, disaster prevention condemnation training, golf and baseball practice. In practice and training using the simulator, if there is a device that makes you feel better when you go well, the training effect will increase. Particularly in sports simulations that require concentration, it is important to create a state in which α waves are emitted from the brain. So, when golfing, etc., you can present a scent that will make you feel better when you are satisfied with the shot, a good image will remain in your memory, and even with the actual shot, your brain will be in a relaxed state, which can lead to good results. .

(3) Virtual museums / art galleries; because the five senses can be presented, you can appreciate the feeling of actually using the exhibits. A three-dimensional object can be produced by CG and can be observed from all directions, and can be configured to present fragrance, wind, and sound from a selected direction. An exhibition that stimulates the five senses is possible, such as "Such a thing was used in a place with such a smell." It is installed in a corner of the museum and can be used as a guide service for visitors. If it is installed in a hospital or medical institution, people who are forced to go to bed and those with disabilities can visit museums and galleries around the world as they live.

(4) Virtual conferencing system; using remote communication, people in remote locations can confer as if they met together. Increased presence can handle more complex agendas.

(5) Healing space generation device: Healing space can be generated by presenting scents and air currents along with images and sounds of favorite places. For example, presenting the scent of amber in a sea image, or presenting a mist containing a forest scent and negative ions in a forest image. For hospital waiting rooms with high demands for stress relief and pain relief, hotel rooms, study rooms for children who want to increase concentration, sports practice areas for eliminating sweat odor, bedrooms for inducing a peaceful sleep, special customers Ideal for serving airlines, bank lobbies, meeting rooms, etc.

As chemical substances to be mixed in the gas, for example, cypress, lemon, and herbal scents are effective in preventing colds. Eucalyptus and peppermint are effective for hay fever. Since sodium hypochlorite has a bactericidal action, it can be used to prevent infection by dissolving and spraying in water. For example, an image of a waterfall may be displayed, and a mist containing these chemicals may be released from the screen. Further, it can be configured to release a high concentration of oxygen to obtain a refreshing feeling.

(6) Electronic signboard (digital sign); As shown in FIG. 19, when a scent and air current are presented together with video from a large display, the passerby shows interest and has the effect of stopping. It can be used as a next-generation five-sense digital advertisement that replaces the existing billboard advertisement.

(7) Image fragrance clock; the clock face of the clock can be displayed on the screen to generate a scent as a time signal. For example, refreshing aromas such as bergamot, lemon, peppermint, and coffee in the morning, refreshing aromas such as grapefruit and cedarwood in the daytime, and relaxing aromas such as lavender, rosewood, and sweet orange at night Can be released. An image suitable for the time may be displayed on the watch face. If you change the scent of the room in a short time, the scent will mix in a complex way and create a nice aromatic space.

(8) Illumination device: As shown in FIG. 11, the display device of the present invention can also be used as an illumination device. In particular, when a high-intensity LED is used for the screen, the lighting device is replaced with a fluorescent lamp or a light bulb. If a hole is provided in the screen to allow gas to pass therethrough, an air cleaning function can be provided. Cigarette smoke emission, dust and pollen can be removed.

A reference light emitting device and a camera are provided in the hole of the screen, the position of the person is measured, and only the surroundings of the person can be illuminated. Of course, characters and the like may be displayed on the screen. Usually, it can be used as lighting, detect the passage of people in an emergency, etc., and display pictures and characters such as guidance blame.

Color is closely related to the olfactory impression. In a colored lighting device, assuming olfactory anticipation and presenting a scent that matches from a hole in the board, sensory integration of visual stimuli and olfactory stimuli occurs and psychological effects increase. Here, olfactory anticipation is a sense of expectation that “the scent will come from now on”. Sensory integration means that the images match. Of course, it is desirable that there is a positive correlation between the psychological effects of scent and lighting color.

Specifically, for fragrances such as eucalyptus and peppermint that have an air purifying effect, light green lighting, sweet orange with a bright and positive impression, fragrances such as mandarin, warm orange, quiet and calm Light purple or blue is effective for lavender with a strong impression, light pink or red is effective for ylang-ylang, which has an attractive effect, and light yellow is effective for aroma such as grapefruit or lemon, which has a refreshing effect.

When the foggy vortex ring 04 is released from the cannon provided on the screen and the illumination element of the screen is driven in accordance with the release, the mist vortex ring emerges in the space and flies while changing its appearance and color. You can create a healing space.

(9) Display type air conditioner; The present invention is a large screen display through which air passes, and can be configured thinly using an organic EL element or the like. It can be used as an air conditioner). In FIG. 26 and FIG. 27, the entire wall is a screen and also an atmosphere control device. When used as a window, if the atmospheric pressure in the room is increased, stagnant air in the room is discharged. If the air pressure is lowered, fresh outside air can be taken into the room.

(10) Home media room: A large-sized display device as shown in FIGS. That is, the display device built-in wall can be provided as a building material. Since the user is surrounded by the display device and is presented with video, sound, fragrance, wind, etc., the user can enjoy multimedia content with a high sense of reality. Moreover, if a communication apparatus is used, a world trip can be enjoyed while staying. Furthermore, if a gaze detection device is incorporated in the display device, a gaze object on the screen can be estimated. Various services can be provided, such as presuming what the user has shown interest and presenting product advertisements with scents.

(11) Image air curtain: The floor screen of FIG. 27C can display an image on the floor and allow airflow to pass through. An air curtain that displays a large screen image on the floor and flows gas from the ceiling to the floor at the entrance of a department store or the like is effective in attracting customers and promoting sales.

Claims (8)

A display screen using a self-luminous body or a video projection screen provided with a reflective material on the front surface is provided with a plurality of holes or cuts, and a sensory stimulus medium presentation device is provided on the back side of the screen or projection screen. The sensory stimulation medium passes through the hole or slit and is presented to the user.
The hole or notch is configured so that the sensory stimulation medium passes in a direction perpendicular or oblique to the screen, and the sensory stimulation medium presentation device is connected to or provided close to the back side of the screen. The display device according to claim 1, wherein the sensory stimulation medium is released through the hole or notch by changing the air pressure on the back side. In Claim 1, the screen or the projection screen is configured to be thin, and the hole or notch is configured to have a width or diameter wider than the depth length of the hole (corresponding to the screen thickness), Alternatively, the display device is configured to have a degree of freedom in passing through the sensory stimulation medium, and the sensory stimulation medium is emitted with controlled directivity with respect to the screen. In Claim 1 or Claim 2, the user in front of the screen is detected by a sensor, and based on the detection result, the sensory stimulation medium is directed toward the user through a hole or cut in the screen. The target of gaze on the user's screen is detected by the sensor, and based on the detection result, the sensory stimulation medium related to the target of gaze is transmitted to the user via the hole or notch in the screen. A display device characterized by being discharged toward the screen. In any one of Claims 1-3, the said screen has a hole so that a self-light-emitting body may be mounted between two thin plates consisting of a back side and a front side, and the both plates may be penetrated between pixels. Alternatively, a notch is provided, and the hole or notch is configured so that a scent or gas that is a sensory stimulation medium can pass with directivity, and the sensory stimulation medium is disposed around the hole or notch. A display device characterized by being sealed to prevent entry between plates. 5. The gas according to any one of claims 1 to 4, wherein the gas is released from the hole or notch provided on the screen with the temperature or humidity being controlled so as to relate to the image displayed on the screen. A display device. 6. The gas or scent in any one of claims 1 to 5, wherein the gas or scent in the sensory stimulation medium is released toward the user through a hole or cut in the screen. Is a display device characterized in that it is discharged through a hole or cut in another screen, and an air flow is generated in the space formed by the discharge and discharge.
7. The aperture ratio YAS, which is the ratio of the total area (ΣOpen02i) of the hole tip occupying the screen area (Area05) in which the hole is provided, is 10% or more. A display device configured to release a mass of gas which is a part of the sensory stimulation medium from a screen by applying instantaneous atmospheric pressure to the plurality of holes almost simultaneously. In any one of claims 1 to 7, wherein the screen may be configured to display a stereoscopic image, gas or smell is a part of the organoleptic medium related to the stereoscopic video near stereo image A display device which is discharged from the hole or notch.

Images