JP4272855B2 - Show window interactive display device - Google Patents

Description

[0001]
[Technical field to which the invention belongs]
The present invention relates to an interactive display device attached to a show window.
[0002]
[Prior art]
In recent years, high-performance transparent screens such as hologram screens have been developed, and video display devices that stick this to a show window and project the image onto it are used in convenience stores, showrooms, car dealers, financial institutions, securities companies, etc. It is used as a show window display.
[0003]
[Problems to be solved by the invention]
In the conventional configuration, a so-called interactive function capable of reflecting a viewer's intention is not realized, but only providing a one-sided image as a window display. However, if an interactive function is realized in the show window, there will be a color variation of the viewer's preference for the exhibits in the show window, and if it is clothing, there will be a size that fits the body. It is possible to present information on the spot according to the taste of the customer. If we go further, we can also make purchases electronically on the spot, and we can expect to bring about one big change in sales methods.
[0004]
To make the show window an interactive display device, an input device must be added thereto. Therefore, a so-called touch panel device must be attached to the show window. However, in order to be able to operate from outside the show window, the touch panel itself must be installed outdoors. Such a touch panel is required to have such reliability that it can be operated outdoors, and in particular, durability that does not break even if an unspecified number of people handle it roughly regardless of the presence or absence of arbitrariness.
[0005]
As a touch panel method, there are a resistive film method, a capacitance method, a surface acoustic wave method, a light blocking method, and the like. Of these, both the resistance film method and the capacitance method require the provision of a transparent electrode on the screen, which causes a problem of light permeability and a problem of fragility. The surface acoustic wave method is a method of running surface acoustic waves on the glass surface, and there is a merit that nothing is required for the position detection surface other than glass, but the surface acoustic wave generation part, its reflection part, its reception part Must be built around the glass and difficult to install easily using the original show window.
[0006]
The light blocking method detects light by using light blocking, and has a merit that nothing is required on the position detection surface. The light blocking method is further divided into an optical matrix method and an optical triangulation method. The optical matrix system is a system in which a large number of pairs of light projecting elements and light receiving elements are arranged opposite to each other with a detection region interposed therebetween. In this case, a large number of electronic elements are required around the detection area, and a considerably large frame-like frame is required. This frame is a hindrance and requires electrical wiring, which causes a problem with durability.
[0007]
[Means for Solving the Problems]
Therefore, we propose a light triangulation method. In this method, an optical sensor for projecting and receiving light may be disposed on one side of the detection region, and a thin light retroreflective frame may be provided on the other side. For example, if the optical sensor is also provided near the ceiling of the show window and a retroreflective frame is provided at the frame portion of the show window, the presence of the sensor itself can be hardly felt.
[0008]
The specific configuration is as follows. That is, an interactive display device integrated with input and output in which a video display surface and an operation input surface are overlapped, and the interactive display device includes a display device, an input device, and an information processing device. The display device includes a video projection device and a screen that captures the video projected from the video projection device, and the input device is provided at a position detection plane that overlaps the screen and at a predetermined position around it. And at least two optical sensors and a retroreflective frame provided so as to face the optical sensors across the position detection plane.
[0009]
Note that retroreflection refers to the property that when light is reflected, the light is reflected back at the same angle with respect to the incident angle of the light. Retroreflective materials are attached to road signs, the back of automobiles, bicycles, etc., and are widely used for applications such as improving nighttime visibility by efficiently reflecting the light of automobile headlights toward the driver. in use. Retroreflective materials include those in which many small transparent beads are arranged, and those made of transparent plastic in which many corner cubes are formed by combining three mirrors at right angles to each other. In the present invention, the frame with the retroreflective member attached is called a retroreflective frame.
[0010]
The optical sensor is provided in the vicinity of the light projection unit and the light projection unit, and the incident direction of the light returned from the light projection unit is reflected by the retroreflective frame across the position detection plane. It comprises a light detection unit for detection, and the light detection unit comprises an optical lens and a linear image sensor in which a large number of light receiving elements are arranged in a one-dimensional direction. The screen and the position detection plane are provided on the window surface of the show window, at least the optical sensor and the retroreflective frame are provided on the outdoor side of the window surface, and the image is on the outdoor side of the window surface. From the outdoor side of the window surface, the operator detects the indicated position by blocking the light path between the optical sensor and the retroreflective frame with a finger or the like. The display image was changed according to the indicated position.
[0011]
As a result, only the optical sensor can be used as the electronic component required outside the show window. It goes without saying that the optical sensor can also be installed above the show window and out of reach. Needless to say, the image projection apparatus may also be installed at a high place outdoors. Furthermore, if the display device and the information processing device are installed indoors, it is possible to reliably protect expensive display devices and information processing devices from destruction.
[0012]
Furthermore, the input device has a light reflecting mirror, and at least the optical sensor is arranged indoors on the window surface, a light reflecting mirror is arranged on the outdoor side across the window, and the light reflecting mirror and the retroreflective frame are reciprocated. The light to be transmitted passes through the outdoor side of the window surface, and the operator detects the indicated position by blocking the light path with a finger or the like from the outdoor side. As a result, there are no electronic components on the outdoor side of the window, and only light forms the outdoor detection surface, so that all electronic devices can be protected from the influence and destruction of external weather. became.
[0013]
When such an optical sensor is exposed to sunlight from outside, it is easily affected. Therefore, a mechanism for canceling extraneous light and receiving only signal light is required. Therefore, it further includes a blinking control unit that causes the light projection unit to blink at a predetermined period, and a difference calculation device that obtains a difference between signals when the light projection unit is turned on and off, and the coordinate calculation device is a difference calculation device. As a result, a signal with less influence of ambient light was obtained, and the coordinates were calculated based on the obtained signal. As a result, the influence of ambient light entering the optical sensor can be greatly reduced.
[0014]
Further, the interactive display device further includes a host connection interface device such as a LAN, and is thereby connected to the host device. As a result, a wealth of information can be provided from external devices. Furthermore, by using it as a part of a large system, it can be used for various purposes.
[0015]
The term “outdoor” and “indoor” as used herein does not necessarily mean the outside and inside of the building in a physical sense, but the part that ordinary people can freely enter and the part where entry is restricted are called “outdoor and indoor”. It is expressed in words. The screen on which the image is projected is a dedicated screen with good luminous efficiency, but is not necessarily limited thereto. Special screens include screens that use light interference to increase display brightness. Moreover, a ground glass surface may be used in an inexpensive system. In order to eliminate the parallax between the display position and the input position due to the thickness of the glass, it is better to place the screen on the outside. However, if the screen is expensive, it is safe to paste it on the indoor side of the window to prevent damage. is there.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
[0017]
【Example】
FIG. 1 is a block diagram showing a configuration of a show window interactive display device of the present invention, and FIG. 2 shows an embodiment. The show window / interactive display device includes a display device, an input device, and an information processing device 3. The display device is indoors, and the image projection device 1 and a screen 2 for mounting and projecting the projected image on the show window 4 are displayed. It is a video. The input device is on the outdoor side, and includes a position detection plane 5 that overlaps the screen 2, a sensor bar 6, and a retroreflective frame 7 provided so as to face the sensor bar 6. The sensor bar 6 incorporates two optical sensors and a coordinate calculation device, and detects the position of the finger 8 on the position detection plane 5. The information processing apparatus 3 changes the display image corresponding to the designated position of the finger 8. According to the present invention, the information processing apparatus 3 may further include an upper level connection interface device such as a LAN, and thereby, it is connected to the higher level device and interactively handles abundant information from the outside. An interactive display device that can be made possible.
[0018]
FIG. 3 shows a detection principle by the optical sensor 11 of the present invention. Two optical sensors 11 are provided on the left and right sides of the position detection plane 5 indicated by the dotted line, and detect the designated position coordinates of the finger 8 introduced on the position detection plane 5. There is a retroreflective frame 7 around the position detection plane 5. Since the two optical sensors 11 have an error in measurement when their mounting angles are deviated, it is better that they are built in one case and configured as a sensor bar together with the coordinate calculation unit.
[0019]
First, light from a light source built in the optical sensor 11 passes through the position detection plane 5 and strikes the retroreflective frame 7. Due to the retroreflective property, light is reflected from the hit location toward the light source, and travels back in the same path as when it came, returns to the optical sensor 11 and is detected by the light receiving element. The light receiving element is a one-dimensional linear image sensor, and is configured so as to know the angle of incident light in combination with an optical lens. At this time, if there is nothing that blocks light on the position detection plane 5, light returns from all directions, but if there is a light blocking object such as a human finger 8, only light from that direction will be returned. Since it is blocked, the direction in which the finger 8 exists can be detected by detecting it.
[0020]
Next, a method for calculating the designated position coordinates of the finger 8 based on the principle of triangulation will be described with reference to FIG. A shadow obtained by blocking the light projected from the optical sensor 11 and the light returning from the retroreflective frame 7 to the optical sensor 11 with the finger 8 is detected, and the incident angles α and β of the shadow are obtained. Here, the position coordinate of the finger 8 is (X, Y), and the origin position is the position of the left optical sensor. From there, if the direction of the right optical sensor is the X-axis, the direction perpendicular to it is the Y-axis, and the distance between the two optical sensors is L, the following equations (1) and (2) are satisfied. .
Y = X tan α (1)
Y = (L−X) tan β (2)
However, X and Y represent finger position coordinates. When X is obtained using these formulas (1) and (2), the relationship of the following formula (3) is established.
X = (L tan β) / (tan α + tan β) (3)
By using the equations (1) and (3), the designated position coordinates (X, Y) of the finger 8 designated in the position detection plane 5 can be calculated if the angles α and β can be detected.
[0021]
FIG. 5 shows a configuration example of the optical sensor 11 of the present invention. The optical sensor 11 has an optical lens 22 in front of the light receiving element 21. The light receiving element 21 is an external appearance of an IC package, but is a CCD or CMOS structure linear image sensor having a large number of divided light receiving portions in a one-dimensional direction. Here, the optical lens 22 is shown as a convex lens as shown in the figure. The simplest is a pinhole lens. The light receiving element 21 and the optical lens 22 constitute a light detection unit. Moreover, the several light source 23 is arrange | positioned at fan shape, and forms the light projection part. Here, a light emitting diode is drawn as the light source 23. Since the light from the light source 23 is reflected by the retroreflective frame and returns toward the light source 23, the light source 23 and the optical lens 22 for light reception are arranged as close as possible. Here, a half mirror can also be used in order to make the optical axes completely coincide. However, since the half mirror itself reduces the amount of light, it is not necessarily the best configuration, and here a configuration in which the half mirror is not used is illustrated.
[0022]
FIG. 6 shows an example in which the retroreflective frame 7 of the show window interactive display device of the present invention is arranged at the lower end of the window. FIG. 6A is a side view thereof, and FIG. 6B is a front view thereof. The display device and the information processing device 3 are disposed indoors with the show window 4 interposed therebetween, and the input device is disposed outdoors. In the input device, a sensor bar 6 is attached in the upper direction around the position detection plane 5 that overlaps the screen 2 on the outdoor side, and a retroreflective frame 7 is attached in the lower direction, and an instruction of the finger 8 introduced into the position detection plane 5 Detect position coordinates. In this way, if the retroreflective frame is arranged at the lower end of the window, the operator's eyes can be hardly touched. When retroreflective frames are required on the left and right of the position detection plane, the retroreflective frames may be attached to the left and right frames of the window itself. Although the retroreflective frame 7 is drawn large for explanation, a retroreflective material is available in tape form, and the tape is pasted on the window frame to make a retroreflective frame. Is also possible.
[0023]
FIG. 7 shows another embodiment of the show window interactive display device of the present invention. FIG. 7A is a side view, and FIG. 7B is a front view. The display device, the information processing device 3, and the sensor bar 6 of the input device are disposed indoors with the show window 4 interposed therebetween, and the retroreflective frame 7 and the light reflecting prism 9 of the input device are disposed outdoors. . The sensor bar 6 of the input device is attached at an upper position on the screen 2 on the indoor side, and the light path of the sensor bar 6 is secured on the outdoor side around the position detection plane 5 overlapping the screen 2. The light reflecting prism 9 is attached to the position where the light is reflected, and the retroreflective frame 7 is attached to the left and right and the lower direction to detect the designated position coordinates of the finger 8 introduced into the position detection plane 5. The information processing device 3 changes the display image corresponding to the position indicated by the finger 8. The light reflecting prism can be realized by a normal mirror, but it is easier to attach the prism to the glass surface as in the embodiment. Also, depending on the structure of the recurrence reflecting member, there are things that do not perform when wet with rain or dew.In that case, a light reflecting mirror is also provided on the recurrence reflecting frame side, and only the light reflecting mirror is outdoors. You may comprise.
[0024]
FIG. 8 shows a block diagram of a configuration designed to reduce the influence of extraneous light. The sensor bar 6 has two optical sensors 11 including a light projection unit 14 and a light detection unit 12, a blinking control unit 15 that controls blinking of the light projection unit 14, and takes a difference between signals when the light is turned on and when the light is turned off. It comprises a difference calculation unit 16 and a coordinate calculation unit 17 that obtains the incident angle of light from the signal and calculates the indicated position. Light from the light projection unit 14 crosses the position detection plane 5, is reflected in the direction coming from the retroreflective frame 7, crosses the position detection plane 5 again, and is detected by the light detection unit 12. Further, the display device 1 is driven from the information processing device 3 and an image is projected onto the screen 2. The screen 2 and the position detection plane 5 are overlaid on the window 4. Then, the information processing device 3 receives the indicated position detection information from the sensor bar 6 and changes the display content of the screen 2 through the display device 1 accordingly, so that interactivity occurs here.
[0025]
Here, since the difference calculation unit calculates a difference between signals when the light source is turned on and off, a digital or analog storage circuit is required. In fact, it is easier to do it digitally. In that case, the signal digitized by the AD converter is stored in the memory, and the difference calculation is performed by the digital circuit. Of course, it can be processed by the CPU. Since the coordinate calculation unit is also constituted by the CPU, it goes without saying that the difference calculation unit can also be calculated by the same CPU.
[0026]
Now, it is theoretically possible to realize such an optical coordinate detection apparatus using a normal video camera, that is, a two-dimensional optical sensor. However, the two-dimensional sensor is more expensive than the one-dimensional sensor because of its complicated structure. In addition, the processing takes time because the number of pixels is large. Also, most ordinary two-dimensional sensors have an output speed of 30 to 60 frames per second. However, an output speed of 10,000 frames per second is realized with a one-dimensional linear image sensor. As in the present invention, in order to reduce the influence of ambient light, the method of taking the difference between the signals at the time of lighting and extinguishing by blinking the light source eliminates the influence of the change in the indicated position and the environmental change as much as possible. Therefore, it is necessary to capture the data by blinking the light source at as short a time interval as possible. Therefore, it is best to use a one-dimensional linear image sensor that can take in data at high speed, has a small number of data, and can process the data at high speed.
[0027]
【The invention's effect】
As described above, according to the show window / interactive display device of the present invention, an interactive display device using a show window as a medium can be provided. Since the display device and the information processing device can be installed indoors, all expensive devices can be installed indoors, and destruction from the outdoor environment can be prevented. Further, by adding a light reflecting mirror, it is possible to install even an optical sensor indoors, and it is not necessary to install any electronic device on the outdoor side, and it is possible to improve reliability and durability. Moreover, the influence of extraneous light can be reduced by taking the signal difference while blinking the light source.
[Brief description of the drawings]
FIG. 1 is a diagram showing an outline of the present invention.
FIG. 2 is a diagram showing a configuration of the present invention.
FIG. 3 is a diagram showing the operating principle of the optical sensor of the present invention.
FIG. 4 is a diagram showing a method for calculating coordinates according to the principle of triangulation.
FIG. 5 is a diagram showing an internal configuration of the optical sensor of the present invention.
(A) is the top view, (b) is the side view.
FIG. 6 is a diagram showing another embodiment of the present invention.
(A) is the side view, (b) is the front view.
FIG. 7 is a diagram showing still another embodiment of the present invention.
(A) is the side view, (b) is the front view.
FIG. 8 is a block diagram showing a configuration of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Image projection apparatus 2 Screen 3 Information processing apparatus 4 Show window 5 Position detection plane 6 Sensor bar 7 Retroreflective frame 8 Finger 9 Light reflection prism 11 Optical sensor 12 Light detection part 14 Light projection part 15 Flashing control part 16 Difference calculation part 17 Coordinate calculator 21 Light receiving element 22 Optical lens 23 Light source

Claims (5)

An input / output integrated interactive display device that allows the operator to view the image displayed on the inside of the transparent flat plate that constitutes the show window from the outside and operate it according to instructions from a finger or the like. And the device is
A display device that is provided inside the transparent flat plate and performs the video display;
At least two optical sensors provided on the inner side of the transparent flat plate, each of which includes a light detection unit and a light projection unit, each of which includes a combination of an optical lens and an image sensor having a large number of light receiving elements, and which constitutes a show window. And the display device by bending a field of view of the light detection unit passing through the transparent flat plate and an optical axis of light from the light projection unit provided at a position facing the optical sensor outside the transparent flat plate. A light reflecting device that overlaps with the image display surface and is directed across a position detection plane defined outside the transparent flat plate, and is provided to face the light reflecting device across the position detection plane. finger such retroreflective frame and finger of the operator based on the principle of the signal by triangulation from said optical sensor light reflected toward the light detection unit from the light projection unit An input device consisting of a coordinate calculation unit for calculating the coordinates corresponding to the position,
An information processing device that is provided inside the transparent flat plate and changes the content of video information displayed by the display device in accordance with an output indicating an instruction position from the input device;
An input / output integrated interactive display device comprising: 2. The input / output integrated interactive display device according to claim 1 , wherein the light reflecting device is a light reflecting mirror. The input / output integrated interactive display device according to claim 1 , wherein the light reflecting device is a light reflecting prism. The display device according to claim 1 , wherein the input device further includes a blinking control unit that causes the light projection unit to blink at a predetermined period, and a difference calculation that obtains a difference between signals when the light projection unit is turned on and when the light projection unit is turned off. An input / output integrated type characterized in that the coordinate calculation unit obtains a signal with less influence of ambient light by the difference calculation unit and calculates a coordinate corresponding to the indicated position based on the signal. Interactive display device. 2. The input / output integrated interactive display device according to claim 1 , wherein the display device further includes a host connection interface device such as a LAN, and is thereby connected to the host device.

Images