JP5499393B2 - Dialog system using transparent polarizing film, interactive method using transparent polarizing film, interactive processing apparatus program for interactive system, and transparent polarizing film recognition interactive processing apparatus program for interactive system - Google Patents

Description

  The present invention relates to an interactive system in which a polarizing filter is provided in front of a lens of a camera, and a polarizing film sheet or a transparent sheet is placed on a display surface of a display, and conversation can be performed using these sheets.

  Until now, many researches have been made on table top systems that apply physical development called polarization.

  The video display methods of this table top system are generally roughly classified into the following three types.

(1) Projection from above by projector (2) Projection from below by projector (3) Display by thin display such as plasma or liquid crystal.

  Each of these has advantages and disadvantages, but a common problem in projection by a projector is that visibility is reduced unless the room is darkened because the amount of light is small.

  On the other hand, a thin display can obtain sufficient visibility even in a bright room, and in recent years, a thin display is inexpensive.

  There exists patent document 1 (Unexamined-Japanese-Patent No. 2004-239664) in the system using such a thin liquid crystal display.

  Patent Document 1 discloses a liquid crystal display that is illuminated with a backlight by providing an orthogonal polarizing film in front of the lens with the display surface facing upward, and photographing the display surface of the liquid crystal display with a CCD camera. It is a system that detects scratches, dust, etc. on the protective film by obtaining an image from which the light that has passed is removed. That is, if there is a scratch on the surface of the liquid crystal display or the protective film, an image irregularly reflected by the scratch is detected, and if dust is attached, an image of light irregularly reflected by the dust is detected.

  Further, Patent Document 1 detects a defect of the display element itself in the liquid crystal display by retracting the orthogonal polarizing film from the lens front of the CCD camera or setting it in front of the lens.

  On the other hand, research is also being conducted on using it as a tabletop system by placing the large LCD display face up.

  For example, when a hand is held over the display surface of a large liquid crystal display with the display surface facing upwards, it is easy to recognize a finger by photographing the display surface with a CCD camera through a polarizing film. There is research to talk with.

In such a table top system, a document is brought in and explained, or a document is put on a transparent sheet for a meeting.
JP 2004-239664 A

  However, even though a liquid crystal display has sufficient visibility even in a bright room, the display surface of the liquid crystal display is shielded by a shielding object such as a hand, so that the characteristics of the liquid crystal display can be fully utilized. Absent.

  For example, when important information that must be immediately determined is displayed at the location of the display surface shielded by the shielding object, there is a problem in that the important information cannot be seen by humans due to the shielding object.

  At the time of a meeting, there are cases where a large amount of materials are placed on a table, and when necessary, meetings are made with the other party while referring to the materials, and the materials are explained to me.

  In such a case, there is a problem that the burden is large on the person who explains, because it is necessary to bring materials into the conference room for the number of people.

  Furthermore, a transparent sheet that can contain materials is useful because it allows you to see what the contents are and to organize them by material.

  Such a transparent sheet is mostly used to put materials, but when meeting with a table with a liquid crystal display with the display surface facing upward, the display on the liquid crystal display depends on the materials inside. There was a problem that a part of the surface was cut off. However, the transparent sheet has an advantage that it can be seen through.

  However, in Patent Document 1, the display surface is photographed with a CCD camera in which a polarizing film is provided in front of the lens in the upward direction of the liquid crystal display with the display surface facing upward, and scratches and dust on the surface are detected. It is not an interactive system using a liquid crystal display that takes advantage of the transparent sheet.

  The present invention has been made in view of the above problems, and can take advantage of the advantages of a transparent sheet, without interrupting the display surface, and without having to bring the material into a conference room or the like, and a liquid crystal capable of interacting with each other while viewing the material. The purpose is to obtain a dialogue system using a display.

  On the other hand, even in an interactive system using a liquid crystal display that takes advantage of the above-described transparent sheet, there are various types of materials, and the materials must be organized for each person in charge.

  Therefore, in a dialogue system using a liquid crystal display that takes advantage of transparency, a transparent sheet that can identify materials and persons in charge, even if transparent, can be used to create a liquid crystal display that can interact with each person or material. The dialogue system used is desirable.

The dialogue system using the transparent polarizing film of the present invention is
Display means for displaying video on the display surface;
An imaging means that is provided so as to be capable of imaging the display surface of the display means, and that sends out a video signal each time the display surface is imaged;
Provided between said display means in proximity to said imaging means, a polarization filter having a polarization direction that blocks the image from the display surface,
Wherein the location placing the display surface, formed by a transparent material of a predetermined size, and a transparent polarizing film having a predetermined polarization direction to pass from the polarizing filter the image from the display surface,
Inputs a video signal from the imaging means, an image signal of this after obtaining the image data obtained by digital conversion, the size of the image of the transparent polarizing film on the display surface based on the image data, the position and inclination recognize and define a display region of the display surface, on the display area, and gist of the dialog processing system to display the desired information has been pre-Me store.

In addition, the interactive system using the transparent polarizing film of the present invention,
Display means for displaying video on the display surface;
The imaging capable provided the display surface of the display means, imaging means for delivering the video signal each time photographing the display surface,
Provided between said display means in proximity to said imaging means, a polarization filter having a polarization direction that blocks the image from the display surface,
Wherein the location placing the display surface, Toru predetermined transparent identifiers polarizing film member which are arranged a transparent polarizing film having a polarization direction to be identified for passing image from said polarizing filter from the display surface is attached A transparent sheet with a light identifier polarizing film;
After inputting a video signal from the imaging means and obtaining image data obtained by digitally converting the video signal, all the transparent identifier polarizing film members included in the image data are decoded to obtain identification information, the size of Jo Tokoro that is associated with the identification information, wherein according to the position and inclination of the transparent identifiers polarizing film member, the desired information the display surface displayed to a transparent polarizing film recognition interaction device corresponding to the identification information The main point is that

In addition, the interactive method using the transparent polarizing film of the present invention,
A display process for displaying an image on a display surface;
An imaging step of the pre-Symbol Table示面captured by the imaging capable provided imaging means, and transmits the video signal each time the shooting,
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
Is location mounting on the display surface, formed by a transparent material of a predetermined size, and a second polarization step of polarizing a transparent polarizing film having a predetermined polarization direction to pass video from the display surface from the polarizing filter ,
After inputting the video signal from the imaging step and obtaining image data obtained by digitally converting the video signal, the size, position and inclination of the image of the transparent polarizing film on the display surface are recognized based on the image data. to define a display region of the display surface, on the display area, and the gist to carry out the interaction step of displaying the desired information stored in advance.

In addition, the interactive method using the transparent polarizing film of the present invention,
A display process for displaying an image on a display surface;
An imaging step of capturing a pre Symbol table示面and sends the video signal each time the shooting,
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
Wherein the location placing the display surface, Toru predetermined transparent identifiers polarizing film member which are arranged a transparent polarizing film having a polarization direction to be identified for passing image from said polarizing filter from the display surface is attached A second polarizing step of polarizing with a transparent sheet with a bright identifier polarizing film;
The inputs a video signal from the imaging process, the video signal of this after obtaining the image data obtained by digital conversion, and decrypt all of the transparent identifiers polarizing film members included in the image data to obtain identification information, in the identification information to the yet that Jo Tokoro associated magnitude, according to the position and inclination of the transparent identifiers polarizing film member, desired information the display surface on the transparent polarizing film recognition interaction step of display corresponding to the identification information The gist is to do.

  Furthermore, the program of the dialog processing apparatus of the dialog system is

A display means for displaying an image on a display surface; an image pickup means provided so that the display surface of the display means can be imaged; and sending the video signal each time the display surface is imaged; A polarizing filter provided between the display unit and having a polarization direction that blocks an image from the display surface; and a predetermined polarization that is placed on the display surface and allows the image from the display surface to pass through the polarization filter. A dialogue processing apparatus program of a dialogue system comprising a transparent polarizing film having a direction and formed of a transparent material in a predetermined size, and a dialogue processing apparatus,

On the computer,
  Means for storing, in a fifth storage means, calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
  Means for storing desired information in a sixth storage means;
  Means for performing contour extraction of the image of the transparent polarizing film based on the video signal to determine the size, position and inclination of the image of the transparent polarizing film, and outputting these as transparent polarizing film recognition information;
  Means for defining a display area of an image of the transparent polarizing film on the display surface based on the calibration information of the fifth storage means and the transparent polarizing film recognition information;
  Means for reading out the desired information from the sixth storage means and outputting the information to the display means for display in the display area
The gist is to execute the function as.

Furthermore, the program of the transparent polarizing film recognition dialogue processing apparatus of the dialogue system of the present invention is:

A display means for displaying an image on a display surface; an image pickup means provided so that the display surface of the display means can be imaged; and sending the video signal each time the display surface is imaged; A polarizing filter provided between the display unit and having a polarization direction that blocks an image from the display surface; and a predetermined polarization that is placed on the display surface and allows the image from the display surface to pass through the polarization filter. Transparent polarizing filter of interactive system comprising transparent sheet with transparent identifier polarizing film to which transparent polarizing film having direction is arranged and made identifiable, and transparent polarizing film recognition interactive processing device A program for a recognition dialogue processing apparatus,

On the computer,
  Means for storing, in a seventh storage means, calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
  Means for storing the size of the transparent sheet with the transparent identifier polarizing film corresponding to the identification information and desired information to be displayed in the eighth storage means for each identification information;
  After inputting a video signal from the imaging means and obtaining image data obtained by digitally converting the video signal, contour extraction of images of all the transparent identifier polarizing film members included in the image data is performed, and this transparent Means for determining the position and inclination of the image of the identifier polarizing film member;
  Means for deciphering the arrangement of the transparent polarizing film to obtain the identification information for each image of all the transparent identifier polarizing film members included in the image data;
  Each time the identification information is obtained, the size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information is read from the eighth storage means, and this is read as calibration information of the seventh storage means. Means for determining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface,
  Each time the identification information is obtained, the desired information corresponding to the identification information is read from the eighth storage means and displayed on the display area of the display surface according to the obtained position and inclination.
The gist is to execute the function as.

  As described above, according to the present invention, the image from the display means is blocked by the polarizing filter provided near the image pickup means and between the display means, and the image of the transparent polarizing film placed on the display means is displayed. Since the desired information can be displayed in a predetermined size and in accordance with the inclination of the transparent polarizing film in the area on the display surface of the display means of the transparent polarizing film, the transparent polarizing film can be viewed while viewing the image displayed by the display means. The desired information displayed below is viewed, and this information can be used for dialogue.

  Further, according to the present invention, when the transparent sheet provided with the transparent identifier polarizing film is placed on the display means, the transparent identifying polarizing film is decoded, the identification information is extracted, and the desired information corresponding to the identification information is extracted. Information is displayed in the area below the transparent sheet with its inclination, position and size.

  For this reason, when the display means is embedded in the table with the display surface facing up and the table is surrounded by a plurality of persons, it is possible to display desired information corresponding to each transparent sheet.

In addition, since the sequence of the polarizing film having a polarization direction or different polarization directions of Jo Tokoro, by a camera provided with a polarizing filter on the lens front, it is possible to detect an image of the polarizing film, it can be used as an identifier Besides, it is transparent so you can see the video below.

In addition, the the person surrounding the tables can show the image below that transparent sheet, the desired information corresponding to the identification information of the transparent sheet computer can be extracted from the database.

  First, the construction of a table top system applying the physical phenomenon of polarization and the outline of the method will be described first.

  By blocking the display image using polarized light, the accuracy of recognition of the actual object on the table surface by the camera can be significantly improved. This method can also be applied to the rear projection method by attaching a polarizing film to the projector.

  However, the light transmitted through the polarizing film is theoretically 50% or less. For this reason, it is preferable to use a liquid crystal display rather than a projector with poor visibility even during normal times.

  In the present embodiment, a polarizing filter for blocking the image (light) from the liquid crystal display is provided in front of the lens of the CCD camera so as to block the image on the liquid crystal display. Thereby, the image obtained by the CCD camera becomes an image in which the display surface of the liquid crystal display looks black.

  However, when a polarizing film having certain characteristics is superimposed on the liquid crystal display, it appears that the image from only the area where the polarizing film is placed is reflected on the liquid crystal display. This phenomenon is used in this embodiment.

  In addition, if a real object is placed on the table, the displayed image is shielded, so the polarizing film is preferably transparent.

  For example, using a transparent acrylic tile pasted with ARTag, we conducted an evaluation experiment by comparing it with a touch panel and actual paper, and showed its usefulness in collaborative work.

  However, the highest evaluation was obtained when using actual paper. Therefore, in order to obtain affordance that is closer to the real world, it is preferable to use a thin film.

  Further, in order to use the interactive method, it is preferable to use as a table top system in which the display surface of the large liquid crystal display is set up.

  Therefore, the present system realizes the dialogue by embedding the large liquid crystal display in the table with the display surface of the large liquid crystal display facing up, and image recognition by a camera attached above the table.

  The image is polarized on the principle of the large liquid crystal display, and only the image can be blocked by attaching a polarizing filter (hereinafter referred to as an orthogonal polarizing filter) orthogonal to the polarization direction to the CCD camera.

  A transparent polarizing film sheet (hereinafter referred to as a transparent polarizing film) is used. There are two advantages of this transparent polarizing film.

  Since it is transparent, it does not block the image of the large liquid crystal display even if it is placed on the large liquid crystal display, and since the transparent polarizing film is in the form of a sheet, it can be easily moved and handled.

  In other words, when the transparent polarizing film is superimposed on a large liquid crystal display, it appears transparent to the user, but when an orthogonal polarizing film is provided in front of the lens of the CCD camera of the system and the display surface of the large liquid crystal display is photographed with the CCD camera, Only an image of this transparent polarizing film can be obtained.

  In this embodiment, even if a large liquid crystal display is arranged on the table with the display surface facing upward, the image displayed in the transparent polarizing film area is not blocked by the transparent polarizing film. While making it visible to humans, the CCD camera obtains only an image of a transparent polarizing film by a polarizing filter provided in front of the lens. Then, an interactive system using the transparent polarizing film is realized, in which desired information is displayed on the area of the transparent polarizing film on the large-sized liquid crystal display, and this can be shown to humans for dialogue.

  The configuration of this embodiment will be shown and described below.

<Embodiment 1>
FIG. 1 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the first embodiment.

As shown in FIG. 1, a table 2 in which a display surface (also simply referred to as LCD 1) of a large liquid crystal display 1 is embedded upward is used. Above this large liquid crystal display 1, a CCD camera 5 is provided so that the entire table surface can be photographed. The CCD camera 5 is attached to the ceiling or pole by an attachment jig (not shown). An orthogonal polarization filter 4 is provided in front of the lens of the CCD camera 5. The orthogonal polarization filter 4 and the CCD camera 5 are collectively referred to simply as a camera unit 6.

  A transparent polarizing film 3 is placed on the large liquid crystal display 1. The transparent polarizing film 3 (also referred to as a transparent polarizing film member) is transparent and desirably has an A4 size (for example, rectangular hard vinyl chloride).

  That is, since the transparent polarizing film 3 that can be actually moved by hand is in a sheet form, the information can be displayed only in that portion by overlapping the transparent polarizing film 3 on the region to be operated. This transparent polarizing film takes advantage of the fact that the image from the large-sized liquid crystal display 1 is not blocked, and desired information is displayed in the area under the moved transparent polarizing film 3 only by moving the transparent polarizing film 3. be able to.

Further, the cable 7 a of the camera unit 6 described above is connected to the first dialogue processing device 7. The first dialog processing device 7 includes a first image recognition computer 8 and a first drawing computer 9, and the first image recognition computer 8 is connected to the camera unit 6 by a cable 7 a, and drawing computer 9 is connected to a large-sized liquid crystal display 1 in the cable 9a.

Although the first image recognition computer 8 and the first drawing computer 9 may be integrated, the present embodiment shows a separated example.

  With such a configuration, when, for example, a map from the first interactive processing device 7 is displayed on the large-sized liquid crystal display 1, the map displayed in the area of the transparent polarizing film 3 can be seen by humans, and the CCD camera Only the image of the transparent polarizing film 3 is obtained by the orthogonal polarizing filter 4 provided in front of the lens 5. And it implement | achieves displaying desired information (for example, disaster information) in the area | region of the transparent polarizing film 3 on the large sized liquid crystal display 1. FIG.

FIG. 2 is an explanatory diagram for explaining blocking and transmission of an image by the orthogonal polarization filter 4, the large-sized liquid crystal display 1, and the transparent polarizing film 3 according to the first embodiment.

  In the first embodiment, the transparent polarizing film 3 is placed on the large liquid crystal display 1, and the CCD camera 5 having the orthogonal polarization filter 4 is disposed in front of the large liquid crystal display 1 in front of the lens. The image (light) from the large liquid crystal display 1 is blocked by the orthogonal polarization filter 4.

  However, if the transparent polarizing film 3 is placed so that the polarization direction of the transparent polarizing film 3 does not coincide with that of the large-sized liquid crystal display 1 or the orthogonal polarization filter 4, the light passes through the orthogonal polarization filter 4 and enters through the lens of the CCD camera 5. To do.

  For this reason, the CCD camera 5 obtains only the image of the transparent polarizing film 3, and even if the transparent polarizing film 3 is placed on the large liquid crystal display 1 as shown in FIG. Since it is transparent (wavelength 360 to 830 nm), a human can see the image under the transparent polarizing film 3.

  FIG. 4 is an explanatory diagram for explaining blocking of an image using polarized light.

  A table top system using an image recognition by a general camera as an interactive method has a problem that it is difficult to cut out a finger by background difference due to a video displayed on the table.

  Light is a kind of electromagnetic wave, and its vibration direction is a transverse wave perpendicular to the traveling direction of the wave. When natural light vibrates in all directions of 360 °, this light is called polarized light when it vibrates only in a specific direction.

  A polarizing film is like a fine streak and has the property of transmitting only light in a specific vibration direction and blocking other light, so that light transmitted through the film becomes polarized light. For this reason, if two polarizing films (polarizing plates) are stacked perpendicularly, all the light is blocked.

  However, when a substance that changes the vibration direction of light is sandwiched between polarizing films (polarizing plates) orthogonal to each other, light is transmitted. Since the liquid crystal display uses this principle, the displayed image is polarized.

  In this system, by attaching a polarization filter (orthogonal polarization filter) orthogonal to the polarization direction of the image from the liquid crystal display to the camera, only the image on the liquid crystal display can be blocked.

FIG. 5A shows a case where the orthogonal polarization filter 4 is not provided in front of the liquid crystal display 1, and the image of the liquid crystal display and the image from the transparent polarizing film 3 are received by the CCD camera. I understand. That is, the image from both the liquid crystal display 1, and a transparent polarizing film 3 because it is received by the CCD camera, it can be said that difficult to recognize the object (transparent polarizing film 3).

  On the other hand, FIG. 5B shows a case where the orthogonal polarization filter 4 according to the present embodiment is provided in front of the CCD camera, and only the image on the liquid crystal display is blocked. That is, since only the image from the transparent polarizing film 3 is transmitted, the transparent polarizing film 3 itself can be easily recognized. At this time, even if the “hand” is placed on the liquid crystal display, the “hand” is photographed as it is, so that the “hand” above the table can also be recognized (object recognition) without being affected by the background image. it can.

FIG. 6 is a schematic configuration diagram of the first image recognition computer 8 . FIG. 7 is a schematic configuration diagram of the first drawing computer 9 . These schematic configuration diagrams collectively show software processing and hardware units (CPU, memory, etc.).

  As shown in FIG. 6, the first image recognition computer 8 includes a capture board 11, a buffer memory 12, a transparent polarizing film recognition unit 13, an LCD upper region determination unit 14, and a first related information addition unit. 17 and a drawing information transmission unit 19 and the like.

  The capture board 11 digitally converts the video information for each frame from the camera unit 6, captures it inside, and stores it in the buffer memory 12.

  The transparent polarizing film recognition unit 13 reads the image data for each frame stored in the buffer memory 12, extracts the outline of the transparent polarizing film 3 by binarization processing, and the number of approximate figure sides is “4”. Is recognized as a rectangle. The recognized center of gravity and the coordinates of the four vertices are obtained using the calibration information in the memory. At this time, when the size is smaller than the rectangular size stored in advance, it is excluded. The coordinates of the four vertices and the rectangular coordinates are output as polarizing film recognition information H to the LCD upper area determination unit 14.

  The LCD area determination unit 14 reads the polarizing film recognition information H, determines the area of the transparent polarizing film 3 on the LCD using the calibration information in the memory 18, and stores this in the memory 16. In this system, coordinate transformation is performed using perspective transformation.

  This calibration information needs to match the coordinates between the camera and the display in order to accurately draw a desired image in the area where the transparent polarizing film is arranged on the liquid crystal display with the display surface facing upward. .

  For this reason, camera lens characteristics, camera height, CCD information, liquid crystal display surface size, camera posture angle, LCD display surface posture angle, etc. are stored in memory in association with each other as calibration information. Yes.

  The first related information adding unit 17 reads the storage address M of the related information stored in the database 15 after the LCD upper region determination unit 14 determines the region of the transparent polarizing film 3, and the storage address M is transparent. It is added to the area information of the polarizing film 3 and sent to the drawing information sending unit 19.

  The drawing information sending unit 19 sends the area information of the transparent polarizing film 3 and the storage address M of related information to the first drawing computer 9 as a set.

Next, a schematic configuration diagram of the first drawing computer 9 in FIG. 7 will be described. The drawing computer 9 includes a polarizing film information output unit 24, an LCD display information extraction unit 21, a map information database 22, a photo information database 23, a drawing information extraction unit 25, and an information writing unit. 26, a polarizing film information output unit 24, and the like.

The LCD display information extraction unit 21 reads a map or photo selected by the operator from the map information database 22 or the photo information database 23 and outputs it to the large liquid crystal display 1 for display.

Drawing information extraction unit 25 reads the storage address information M i from the first image recognition computer 8 reads the actual information of the storage address information Mi (e.g. disaster-related), outputs it to the information writing section 26 To do.

The information writing unit 26 receives the area information DH (position, direction, size) on the LCD from the first image recognition computer 8 and inputs it into the layer of the memory 27 (the same coordinate system as the LCD display surface). defined in the with), and writes the actual information from the drawing information extraction section 25 in the region of this layer over.

  The polarizing film information output unit 24 reads the layer information in the memory 27 and outputs it to the LCD, thereby displaying the actual information under the transparent polarizing film 3.

  The operation of the system configured as described above will be described below. FIG. 8 is a flowchart for explaining the operation of the image recognition computer 8 according to the first embodiment.

  The transparent polarizing film recognition unit 13 of the first image recognition computer 8 monitors whether image data is stored in the buffer memory 12 (S1).

  If it is determined in step S1 that image data has been stored, an image on the transparent polarizing film 3 (also simply referred to as a transparent polarizing film) is recognized (S2).

  In the recognition process of the transparent polarizing film 3, image data is acquired from the buffer memory 12, and the acquired image is subjected to binarization processing to extract a contour line. Next, linear approximation of the contour line is performed, and when the number of sides of the approximated figure is “4”, it is recognized as a quadrangle. Finally, if it is smaller than the minimum rectangle size, it is excluded. The center of gravity of the rectangle thus obtained and the coordinates of the four vertices are obtained. The coordinates of the center of gravity of the rectangle and the coordinates of the four vertices are output as polarizing film recognition information H to the LCD upper area determination unit 14.

Next, LCD region determining unit 14 reads the polarizing film recognition information H, based on the calibration information, projected from the focal center of the camera on the display surface (projection in the layer over the transparent polarizing film) to (S3) . Then, the projection position, the size and direction of the area, etc. are obtained (S4). For example, coordinate conversion is performed using per-spectrum conversion.

For example, as shown in FIG. 9, in the LCD coordinate system that defines the size of the display surface of the liquid crystal display, the polarizing film recognition information H is projected onto the layer of the LCD coordinate system. Then, the inclination θp with respect to the Y-axis and the inclination θq with respect to the X-axis (collectively, inclination θi) are obtained, and the size of the projected area (defined by four-point coordinates) and the center position are obtained. This is stored in the memory 16 as area information DH on the LCD of the transparent polarizing film 3.

Then, the first related information adding unit 17 reads the storage address M of the related information related to the transparent film from the database 15 (S5), and adds the storage address M of the related information to the area information DH on the LCD. The related information K is sent to the first drawing computer 9 by the drawing information sending unit 19 (S6).

  Next, it is determined whether or not it is finished. If not finished, the process is returned to step S1 (S7).

  On the other hand, the first drawing computer 9 inputs the LCD area / related information K and performs the processing of the flowchart shown in FIG.

Information writing unit 26 of the first drawing computer 9 monitors whether the input of the LCD upper area-related information K (S10).

In step S10, when it is determined that the input of the LCD upper area-related information K, the actual information of the LCD area (area corresponding to the transparent polarizing film) monitors whether the input from the rendering information extraction unit 25 (S11 ).

  If it is determined in step S11 that actual information has been input, an area on the LCD is generated in the layer, the actual information is written in this area, and this layer is output to the LCD (S12, S13). Next, it is determined whether or not to end, and if it is not ended, the process returns to step S10.

  That is, in the present embodiment, as shown in FIG. 11A, when a map is displayed on the LCD, the transparent polarizing film 3 is transparent when the transparent polarizing film 3 is placed on the LCD. Therefore, a human can see the map under the transparent polarizing film 3.

  However, in this embodiment, since the CCD camera is provided with the orthogonal polarization filter 4 (perpendicular to the polarization of the LCD) in front of the lens, the light from the LCD is blocked. As a result, as shown in FIG. 11B, only the image of the transparent polarizing film 3 is received by the CCD camera 5.

  In the present embodiment, the position and inclination of the transparent polarizing film 3 are detected in real time, the area is determined on the LCD, and the determined area is desired as shown in FIG. 11 (c). Displays real information for.

  For example, as shown in FIG. 1, when the entire map (which may be an aerial photograph) is displayed on the liquid crystal display, the area of the transparent polarizing film 3 may be replaced with past disaster information.

  Various information such as past temperature, rainfall, and population density can be added. Furthermore, it is effective to find out the relevance by displaying a plurality of information in a superimposed manner. For example, by displaying the population density and the average annual income per household in an overlapping manner, the relationship between these two elements can be seen. Moreover, since it is not only information with a clear orientation such as characters, the visibility does not deteriorate much even when a collaborative work is performed by surrounding a table with a plurality of people.

<Embodiment 2>
In the second embodiment, the transparent polarizing film 3 is recognized, the movement of the hand is recognized, and actual information corresponding to the movement of the hand is displayed in a region below the transparent polarizing film 3. In this embodiment, only the recognition computer will be described.

  Using a CCD camera provided with a polarizing filter in front of the lens, natural human actions based on physical properties such as gestures are used for operations. That is, the image of the large liquid crystal display 1 is blocked by using the CCD camera 5 provided with the orthogonal polarization filter 4 in front of the lens. As a result, it is possible to improve the recognition difficulty due to the change of the finger, and thus it is possible to recognize the finger with high accuracy.

  FIG. 12 is a schematic configuration diagram of an image recognition computer according to the second embodiment. In FIG. 12, the same reference numerals as those in the first embodiment are omitted.

  As shown in FIG. 12, the second embodiment includes a hand recognition unit 30, a hand motion decoding unit 31, a second related information adding unit 34, and the like.

  Each time image data is stored in the buffer memory 12, the hand recognition unit 30 recognizes a hand image compared with a reference hand image stored in advance, and outputs the hand image to the hand motion decoding unit 31. To do. Each time a hand image is input, the hand motion decoding unit 31 determines whether or not the hand motion has been compared with the previous hand image stored in the memory 32.

  If the hand has moved, it is determined whether it has moved from right to left or from left to right, and page control information corresponding to the determination result is extracted from the memory 33.

  For example, in the case of right to left, the memory 33 sets the page control information to “next page”. In the case of left to right, the page control information is “return”.

  The second related information adding unit 34 receives the page control information from the hand movement decoding unit 31 and each time the LCD area determination unit 14 obtains the area of the transparent polarizing film on the LCD, The storage address next to the information storage address M is read, and the transparent polarizing film area (four coordinate points and center coordinates) is sent to the drawing computer by the drawing information sending unit 19. Therefore, the drawing computer displays the actual information corresponding to the next storage address corresponding to the movement of the hand in the area below the transparent polarizing film 3.

  That is, as shown in FIG. 13 (a), for example, when a map is displayed on an LCD and a transparent polarizing film is placed on the LCD, the transparent polarizing film 3 is transparent. it can.

  However, in the present embodiment, since the orthogonal polarization filter 4 is provided in front of the lens of the CCD camera 5, light from the LCD is blocked. As a result, only the image of the transparent polarizing film 3 is received by the CCD camera 5. FIG. 13B shows the case where the hand is on the transparent polarizing film 3.

At this time, for example, if the hand is moved to the left side, the hand recognition unit 30 and the hand movement decoding unit 31 determine that the hand has moved to the left. This page control information is sent to the second related information adding unit 34. Therefore, as shown in (c) of FIG. 13, the actual information of the next page is displayed in the area of the transparent polarizing film 3.

<Embodiment 3>
Since the transparent polarizing film has the advantage of not blocking the display of the large-sized liquid crystal display, it has been found that different information can be displayed on the information of only the region portion of the transparent polarizing film.

  However, there are many points that need to be improved even at this stage. At this stage, only one type of information can be overlaid. When it is desired to display several types of information in a superimposed manner, each transparent polarizing film 3 needs to have a unique ID.

  Then, as an example which gives identification information to a transparent polarizing film, you may make it identify, for example by changing the shape of a transparent polarizing film.

  Alternatively, a transparent polarizing film is arranged on a simple transparent sheet at a predetermined interval in a predetermined interval and is detected by the CCD camera 5 so as to have identification information (hereinafter referred to as a transparent identifier polarizing film) as a so-called bar code. It may be.

  However, these polarization directions should not coincide with at least the polarization direction of the image of the large liquid crystal display and the polarization direction of the orthogonal polarization filter (for example, 1 to 89 degrees with respect to the polarization direction of the image of the liquid crystal display). 45 degrees is most desirable in the range).

  For example, the transparent identifier polarizing film is attached to a simple transparent sheet with an inclination of +45 degrees with respect to the incident light from the liquid crystal display.

  In addition, you may make it overlap | superpose a transparent identifier polarizing film so that a several polarizing film may become a respectively different polarization direction.

  In the present embodiment, a description will be given as an example in which a predetermined number of polarizing films having polarization characteristics and a simple transparent vinyl film are combined to form a transparent identifier polarizing film and attached to a transparent sheet.

  Since such a transparent polarization identifier polarizing film and transparent sheet are transparent, they have various uses. For example, you may use it for a picture, a photograph, or a car, a part, and a foodstuff. In other words, even if it is used for paintings, photographs, or automobiles, parts, and foodstuffs such as barcodes, humans can see them themselves, but the CCD camera (with a polarizing filter) detects this transparent identifier polarizing film. It will be out.

FIG. 14 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the third embodiment.
As shown in FIG. 14, the transparent identifier polarizing film 40 (40a, 40b) is attached to the transparent sheet 4 3 (4 3 a, 4 3 b) of about A4 (the transparent sheet 43 with the transparent identifier polarizing film or simply the transparent sheet) 43). The transparent identifier polarizing film 40 is about 1 cm × 5 cm, for example.

  The transparent identifier polarizing film 40 is detected by the CCD camera 5 provided with the orthogonal polarization filter 4 in front of the lens, and the second dialogue processing device 41 decodes the information, position and tilt angle of the transparent identifier, and displays them on the LCD. The actual information corresponding to the transparent identifier is displayed in a predetermined size at the decoded position and tilt angle.

  FIG. 14 shows an example in which two people are sitting in front of a table and interacting with each other using the transparent sheet 43 of the present embodiment. In the third embodiment, the transparent sheet in front of the person sitting on the left side is referred to as the transparent sheet 43a, and the transparent sheet in front of the person sitting on the right side is referred to as the transparent sheet 43b.

  As shown in FIG. 14, the camera unit 6 is connected to a second image recognition computer 42 of a second dialogue processing device 41 (also referred to as a transparent polarizing film recognition dialogue processing device) by a cable 42a. The second drawing computer 44 of the second dialogue processing device 41 is connected to the LCD by a cable 44a.

  FIG. 15 is an explanatory diagram for explaining the transparent sheet with a transparent identifier polarizing film used in the third embodiment.

  Although the magnitude | size of the transparent sheet | seat 43 with a transparent identifier polarizing film is not ask | required, in this Embodiment, it shall be A4 size as shown to (a) of FIG. Moreover, the transparent identifier polarizing film 40 is affixed, for example to the left end part of the transparent sheet 43, as shown to (a) of FIG.

  It is assumed that the transparent identifier polarizing film 40 described above forms a one-dimensional barcode or a two-dimensional barcode as shown in FIG. These thick bar, thin bar, and medium thick bar are polarizing films, and are arranged in a straight line at predetermined intervals. A space is a member of a transparent sheet.

Further, the transparent identifiers polarizing film with the transparent sheet 43, as shown in (c) of FIG. 15, paste transparent identifiers polarizing film 40 to the transparent sheet 4 3 of the upper surface of the A4 size plastic, as the rear surface is slippery A lubricant 40 bb is preferably applied. This is because when the transparent sheet 43 with the transparent identifier polarizing film is placed on the liquid crystal display with the display surface facing upward and moved to the other party, it can be moved smoothly in front of the other party.

  Further, as shown in FIG. 15D, the transparent identifier polarizing film 40 may be embedded in the vinyl sheet 40a.

  Moreover, the area | region of transparent sheets other than the transparent identifier polarizing film 40 is only called a sheet | seat part in this Embodiment.

  FIG. 16 is an explanatory view for explaining the polarization by the transparent sheet with the transparent identifier polarizing film of the third embodiment.

  The orthogonal polarizing filter 4 provided in front of the lens of the CCD camera 5 blocks the light from the LCD and allows the light from the polarizing film forming the bar of the transparent identifier polarizing film 40 to pass through. Block the light from.

  For this reason, as shown in FIG. 16, the image from the large liquid crystal display (LCD display surface) and the light from the sheet portion are blocked, but the light from the polarizing film forming the bar of the transparent identifier polarizing film 40 is orthogonal. The light passes through the polarizing filter 4 and is received by the CCD camera 5. Bars are detected in white and spaces are detected in black.

In this embodiment, detecting only bars of the transparent identifiers polarizing film 40, (referred to as simply a transparent identifiers polarization-I Lum 40 images) bar, it obtains a contour connecting the space between the center of gravity of the contour The position and inclination are determined, and A4 size information corresponding to the position and inclination is displayed on the LCD.

Therefore, the second image recognition computer 42 preferably has a structure shown in FIG. 17.

FIG. 17 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the third embodiment.
In FIG. 17, the description of the same reference numerals as those in FIG. 6 is omitted.

In the third embodiment, as shown in FIG. 17, an identifier recognition unit 50, a transparent identifier polarizing film number determination unit 51, an identifier information registration unit 52, a sheet LCD upper area determination unit 54, and a transparent identifier polarizing film The memory 53 for storing the identifier information of the memory, the memory 55 for storing the display size for each identifier, and the memory 56 (56a, 56b,...) For storing the actual report storage address for each identifier. An information adding unit 57 and the like are included.

  The identifier recognition unit 50 monitors whether the image data for each frame is stored in the buffer memory 12, and when the image data is stored, the bar of the image of the transparent identifier polarizing film 40 is obtained from the image data of one frame. Recognize the image of the polarizing film. In this recognition, when the image of the transparent identifier polarizing film 40 is a barcode, an emphasis process is performed, and a numeric string (identifier code hi) obtained by decoding the barcode is output.

  And the outline of the emphasized transparent identifier polarizing film 40 is calculated | required, and the coordinate of the four vertexes of this outline and the coordinate of a gravity center are calculated | required based on calibration information. That is, the inclination and position of the transparent identifier (barcode) on the LCD are calculated. This is called identifier recognition information Qi in the third embodiment.

  The transparent identifier polarizing film number determination unit 51 counts the number every time the identifier recognition unit 50 recognizes the transparent identifier film, and the identifier number Ri (R1, R2,...) Corresponding to this number is the identifier information registration unit 52. Output to.

  The identifier information registration unit 52 inputs the identifier number Ri from the transparent identifier polarizing film number determination unit 51, the identifier recognition information Qi from the identifier recognition unit 50, and the identifier code hi, and stores them in the memory 53 in association with each other. . This is referred to as sheet area information Pi in the third embodiment. That is, the memory 53 stores the sheet area information Pi of all the transparent identifier films in one frame.

The sheet LCD upper area determination unit 54 reads the sheet area information Pi of the memory 53, reads the size (for example, A4 size, A3 size) corresponding to the identifier code hi of the sheet area information Pi, and also identifies the identifier of the memory 53. The position and inclination of the recognition information Qi are read and defined in the LCD coordinate system of calibration information. This is stored in the memory 16. In other words, the memory 16 uses the position of the transparent identifier polarizing film (barcode) on the LCD as a reference, and the transparent identifier polarizing film (barcode) is inclined at this position, and is used as the identifier code of the transparent identifier polarizing film (barcode). An area of the corresponding size is defined.

  The third related information adding unit 57 reads information (name, date, actual information storage address) corresponding to the identifier code hi from the database 56, and stores an area (4 points) of a size corresponding to the identifier code. (Coordinates) is added and sent to the drawing information sending unit 19.

  That is, in the third embodiment, as shown in FIG. 18A, the contour of the transparent identifier polarizing film (barcode) is extracted, and the inclination θi (θp, θq) and the position of the transparent identifier polarizing film on the LCD are displayed. Ask for. Then, an area Ji (J1, J2,...) Having a size corresponding to the identifier code hi with this inclination θi is generated in the layer ((b) of FIG. 18).

(B) in FIG. 18 is the size of the identifier code hi indicates a case all A4. Then, these regions Ji (J1, J2, · · ·) to write the actual information identifier code hi (in FIG. 18 (c)) in FIG. 18 (c) graph J1 population trends, J2 is A bar graph by age, J3, shows a point graph of the transition of the disaster budget.

  Therefore, different information can be displayed for each transparent identification polarizing film in the size of the operator by the position and inclination of the transparent sheet of the operator of the transparent sheet. Further, since the transparent sheet is transparent, each person in charge can see the information under the transparent sheet and can also check the main image information, so that the user can interact with the sheet.

  Furthermore, since the identifier of each sheet is different in this embodiment, for example, as shown in FIG. 19A, when two transparent sheets are placed on the LCD, as shown in FIG. 19B. Only the images of the two polarizing films are obtained by the CCD camera 5 through the orthogonal polarization filter 4.

  This identifier is all detected by the second image recognition computer, and information corresponding to this identifier is displayed on the LCD (see FIG. 19C).

Further, as shown in FIG. 19D, when the transparent sheets are stacked, information corresponding to the two identifiers can be displayed together. For example, above identifier, lower display another one of the identifiers (see (e) in FIG. 19).

  Therefore, the dialogue can be performed on the LCD with the transparent sheet possessed by the operator.

  The third embodiment may include the hand recognition unit 30 and the hand motion decoding unit 31 of the second embodiment, and may perform page control by hand movement.

  Further, in each of the above-described embodiments, the description has been made using the large-sized liquid crystal display, but the large-sized liquid crystal display may not be used.

  Moreover, although it demonstrated as a table top down system embedded in the table with the display surface facing up, even if it uses a liquid crystal display on a wall and the transparent polarizing film or transparent sheet of this Embodiment is affixed on a liquid crystal display, it can be used. Good.

Further, in each of the above embodiments, the orthogonal polarizing filter provided in front of the lens of the CCD camera is fixed, but this orthogonal polarizing filter is polarized light according to the polarization characteristics of the transparent identifier polarizing film or the transparent identifier polarizing film of the transparent sheet. You may provide the control mechanism which can be changed into a filter.
<Embodiment 4>
In the above embodiment, as shown in FIGS. 2, 4, and 16, the transparent polarizing film 3 or the transparent sheet 430 with the transparent identifier polarizing film is placed on the large liquid crystal display 1, By disposing a CCD camera 5 having an orthogonal polarization filter 4 in front of the lens, an image (light) from the large liquid crystal display 1 is blocked by the orthogonal polarization filter 4, and the transparent polarizing film 3 or the transparent sheet 4. 3 (hereinafter collectively referred to simply as an optical film), light is allowed to pass through and an image (also referred to as an LCD image) from the large liquid crystal display 1 is made incident through the lens of the CCD camera 5.
For this reason, when the optical film is rotated, the phenomenon described below may occur. FIG. 20 shows an image viewed by the user (FIG. 20A) and an image viewed by the camera (FIG. 20B) when the optical film is rotated on the LCD.
In the polarization relationship between the optical film and the orthogonal polarization filter 4 as described above, when viewed from the user, transmission and blocking are repeated each time the optical film is rotated by π / 2.
This is because the polarization direction of the LCD image coincides with the transmission axis of the optical film at θ = 0, so that the LCD image is transmitted through the optical film, and the transmission axis of the optical film is orthogonal at θ = π / 2. This is because is blocked.
On the other hand, when viewed with a CCD camera equipped with an optical film, transmission and blocking are repeated every rotation of π / 4 (see FIG. 20B).
This is because if the angle between the polarization direction of the display image and the transmission axis of the optical film is θ, the orthogonal polarization filter 4 attached to the camera blocks the image when θ = 0, and when θ = π / 2. This is because the rotating orthogonal polarization filter 4 blocks the image. For this reason, the light intensity becomes maximum when θ = π / 4.
Therefore, when this optical film is used as a marker, when it is rotated, a black portion is generated for every π / 2 for the user, and light is not transmitted for every π / 4 for the camera.
Therefore, instead of the optical film as described above, a half-wave plate optical sheet 500 described below is used.
The half-wave plate described above will be described.
In general, a wave plate (retardation film) is one that generates a retardation using a birefringent crystal such as quartz.
The wave plate has a fast axis and a slow axis, and the incident light is divided into two polarization components orthogonal to each other. The slow axis component is delayed with respect to the fast axis, and then both are combined to form a single wave. It can be emitted as a ray. That is, when the optical axis of the half-wave plate is an angle θ with respect to the polarization plane of the incident light, the emitted light rotates by 180 ° −2θ. For this reason, when the half-wave plate is rotated by the angle a, the polarization plane of the emitted light is rotated by 2a. That is, the half-wave plate can be used to rotate the polarization plane.
The most commonly used waveplates are a quarter wave plate and a half wave plate, which can delay the phase by π / 2 and π, respectively.
FIG. 21 is an explanatory diagram for explaining the relationship between incident light and outgoing light on two half-wave plates.
As shown in FIG. 21, in the half-wave plate, when light passes, the phase of the slow axis component is delayed by π with respect to the fast axis component. As a result, the light emitted by combining both components is rotated 2θ with respect to the vibration direction of the incident light. Detailed analysis will be described later.
That is, the rotation angle can be adjusted by the angle formed between the incident polarized light and the slow axis. For example, when the slow axis is set to 45 degrees with respect to the linearly polarized light, the polarization plane rotates 90 degrees.
Here, the polarization state of FIG. 21 will be described.
The Jones matrix is generally used as an operator to express the polarization state. It intends line the original to the description of FIG. 21 in the following.
Jones vectors of incident light and outgoing light to an optical element are respectively set as follows.

If the angle between the fast axis of the optical element and the x axis is θ and the relative phase difference between the fast axis component and the slow axis component is ε, the relationship between the incident light and the outgoing light is the rotation operator Rθ and the phase operator. It can be expressed by the following equation using Tε.

However,

Here, for a half-wave plate, ε = π, so


This is the Jones matrix of a half-wave plate.
Where the incident light is polarized in the x-axis direction,


Then, equation (1) becomes

Thus, it can be seen that the light emitted from the half-wave plate becomes polarized light rotated by 2θ.
Next, if the second wave plate is rotated by π / 4 with respect to the first wave plate, it is rotated by θ + π / 4 with respect to the incident light on the first wave. The Jones vector of the emitted light can be described as follows.

Substituting this into equation (2)

From this, it can be seen that the light emitted from the second half-wave plate is always polarized by π / 2 with respect to the first incident light, regardless of θ.
FIG. 22 is an explanatory view for explaining the state when the half-wave plate is rotated on the LCD.
FIG. 22A shows a viewpoint from the user. FIG. 22B is a viewpoint from the CCD camera.
As shown in FIG. 22A, it always looks transparent from the viewpoint of the user regardless of the rotation angle.
On the other hand, in FIG. 22B, transmission and blocking are repeated every π / 4 rotation as in the polarizing plate from the viewpoint of the camera.
This appears to be the same behavior as in the polarizing plate, but the principle is different. When the angle between the polarization direction of the LCD and the fast axis of the wave plate is θ, the polarization direction of the emitted light is rotated by 2θ. (When θ = 0, the image is blocked as it is, and when θ = π / 2, the π-rotated transmitted light is blocked.
In other words, as described above, when the angle between the polarization direction of the LCD image and the fast axis of the wave plate is θ, the polarization direction of the emitted light of the half-wave plate is rotated by 2θ. Therefore, as shown in FIG. 21, when the second half-wave plate is overlapped with the first half-wave plate by shifting by π / 4 (the optical film of the present embodiment), the polarization direction is further increased. The light is emitted after rotating 2 (θ + π / 4).
As a result, the polarization direction of the emitted light from the second half-wave plate is always a direction rotated by π / 2 with respect to the polarization direction of the LCD image (the transmission axis of the polarization filter) (FIG. 21). Therefore, the LCD image can be transmitted regardless of the rotation angle . FIG. 23 shows how this is rotated on the LCD.
FIG. 23A is an explanatory diagram of the viewpoint of the user of the optical film of the present embodiment. FIG. 23B is an explanatory diagram of the viewpoint of the optical film camera of the present embodiment.
That is, as shown in FIG. 23 (a), the viewpoint from the user always looks transparent regardless of the rotation angle, and as shown in FIG. 23 (b), the rotation angle also from the viewpoint from the camera. It will always look transparent without depending on.
Therefore, by using two half-wave plates rotated by π / 4, it became possible to make transparent markers (including barcodes) with rotation resistance.
This optical film is prepared, for example, as shown in FIG. The second half-wave plate sheet 50 0 b is rotated by an angle of π / 4 (45 degrees) with respect to the first half-wave plate sheet 50 0 a and overlapped on the first sheet (Adhesive) Generated as shown in FIG. This is, in this embodiment, it referred to as a half-wave plate optical sheets 50 0.
<Other embodiments>
Moreover, when using the transparent sheet | seat with a transparent identifier polarizing film as shown in FIG. 15, it produces | generates as shown in FIG.
Figure 25 is an explanatory view of the identifier-attached sheet 52 0 of the half-wave plate transparent identifiers optical film 51 with 0 of this embodiment, circled frame, the expansion of 1/2-wavelength plate transparent identifiers optical film 51 0 It is explanatory drawing.
Identifier-attached sheet 52 0, to the transparent sheet 50 0, is generated by superimposing a 1/2-wavelength plate transparent identifiers optical film 51 0.
The half-wave plate transparent identifiers optical film 51 0 is 25 as circled, 1/2 rotated for example 45 degrees with respect to first half-wave plate 51 0 a and the second sheet Wave plates 51 0 b are overlaid.
Thus, by the CCD camera, even when the identifier-attached sheet 52 0 rotated to any angle on LCD, so that can recognize the bar code.

It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 1. FIG. 3 is an explanatory diagram for explaining blocking and transmission of an image by the orthogonal polarization filter 4, the large liquid crystal display 1, and the transparent polarizing film 3 according to the first embodiment. It is explanatory drawing explaining the image | video obtained when a polarizing filter is provided in the front of the lens of a CCD camera. It is explanatory drawing explaining the interruption | blocking of the image | video which applied polarized light. It is explanatory drawing explaining the image on LCD which is seen through a polarizing film and the image obtained when a polarizing filter is provided in front of the lens of a CCD camera. It is a schematic block diagram of the 1st computer for image recognition. It is a schematic block diagram of the 1st drawing computer. 6 is a flowchart for explaining the operation of the image recognition computer 8 according to the first embodiment. It is explanatory drawing explaining the production | generation of the area | region on LCD of a transparent polarizing film. 6 is a flowchart for explaining the operation of the first drawing computer 9; FIG. 3 is an explanatory diagram for explaining image display by the transparent polarizing film of the first embodiment. FIG. 3 is a schematic configuration diagram of an image recognition computer according to a second embodiment. FIG. 10 is an explanatory diagram for explaining the operation of the image recognition computer according to the second embodiment. It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 3. It is explanatory drawing explaining the transparent sheet | seat with a transparent identifier polarizing film used for Embodiment 3. FIG. It is explanatory drawing explaining the polarization | polarized-light by a transparent sheet with the transparent identifier polarizing film of Embodiment 3. FIG. It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 3. FIG. 10 is an explanatory diagram for explaining processing of a third embodiment. It is explanatory drawing explaining the process at the time of overlapping two transparent sheets. FIG. 20 shows an image viewed by the user (FIG. 20A) and an image viewed by the camera (FIG. 20B) when the optical film is rotated on the LCD. It is explanatory drawing explaining the relationship between the entrance light to two half-wave plates, and emitted light. It is explanatory drawing explaining a mode when a 1/2 wavelength plate is rotated on LCD. It is explanatory drawing explaining a mode when the optical film of this Embodiment is rotated. It is explanatory drawing explaining creation of the optical film of this Embodiment. It is an explanatory diagram illustrating the creation of another embodiment of a transparent identifiers polarization-I Lum with the transparent sheet.

DESCRIPTION OF SYMBOLS 1 Large liquid crystal display 2 Table 3 Transparent polarizing film 4 Orthogonal polarization filter 5 CCD camera 7 1st dialog processing device 8 1st image recognition computer 9 1st drawing computer 11 Capture board 13 Transparent polarizing film recognition part 14 LCD Upper region determining unit 17 First related information adding unit 19 Drawing information sending unit 50 0 a 1/2 wavelength plate 50 0 b 1/2 wavelength plate

Claims (11)

Display means for displaying video on the display surface;
An imaging means that is provided so as to be capable of imaging the display surface of the display means, and that sends out a video signal each time the display surface is imaged;
Provided between said display means in proximity to said imaging means, a polarization filter having a polarization direction that blocks the image from the display surface,
Wherein the location placing the display surface, formed by a transparent material of a predetermined size, and a transparent polarizing film having a predetermined polarization direction to pass from the polarizing filter the image from the display surface,
Inputs a video signal from the imaging means, an image signal of this after obtaining the image data obtained by digital conversion, the size of the image of the transparent polarizing film on the display surface based on the image data, the position and inclination recognize and define a display region of the display surface, on the display area, dialogue system using a transparent polarizing film characterized by having a conversation processing device for displaying the desired information has been pre-Me store. The dialogue processing apparatus includes:
The characteristics of the display surface, orientation and characteristics of the imaging means, the height of the display unit, a first storage means for storing calibration information including position,
Second storage means for storing Nozomu Tokoro information,
The size of the image of the transparent polarizing film by performing contour extraction of the image of the transparent polarizing film based on the image data, obtains the position and the tilt, and outputting them as a transparent polarizing film recognition information,
It means for defining the calibration information, the display area of the image of the transparent polarizing film on the display surface based on the transparent polarizing film recognition information of said first storage means,
Dialogue system using a transparent polarizing film according to claim 1, characterized in that it has a means that presents the desired information in the display area is outputted to the display unit of the second storage means. The dialogue processing apparatus includes:
When a predetermined object image is recognized in addition to the image of the transparent polarizing film, the desired information of the second storage means is displayed in the display area based on the movement or deformation of the object image. An interactive system using the transparent polarizing film according to claim 2 .   The transparent polarizing film according to any one of claims 1 to 3, wherein the transparent polarizing film is composed of two half-wave plates stacked so that their polarization directions are different by π / 4 from each other on the same plane. Dialog system using polarizing film. Display means for displaying video on the display surface;
The imaging capable provided the display surface of the display means, imaging means for delivering the video signal each time photographing the display surface,
Provided between said display means in proximity to said imaging means, a polarization filter having a polarization direction that blocks the image from the display surface,
Wherein the location placing the display surface, Toru predetermined transparent identifiers polarizing film member which are arranged a transparent polarizing film having a polarization direction to be identified for passing image from said polarizing filter from the display surface is attached A transparent sheet with a light identifier polarizing film;
After inputting a video signal from the imaging means and obtaining image data obtained by digitally converting the video signal, all the transparent identifier polarizing film members included in the image data are decoded to obtain identification information, the size of Jo Tokoro that is associated with the identification information, wherein according to the position and inclination of the transparent identifiers polarizing film member, the desired information the display surface displayed to a transparent polarizing film recognition interaction device corresponding to the identification information A dialogue system using a transparent polarizing film. The transparent polarizing film recognition dialogue processing apparatus,
The characteristics of the display surface, orientation and characteristics of the imaging means, the height of the display unit, a third storage means for storing calibration information including position,
For each identification information, a size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information, a fourth storage means that stores desired information to be displayed,
After inputting the video signal from the imaging means and obtaining the image data obtained by digitally converting the video signal, the contour of all the transparent identifier polarizing film members included in the image data is extracted, and this transparent Means for determining the position and inclination of the image of the identifier polarizing film member;
Means for deciphering the arrangement of the transparent polarizing film to obtain the identification information for every image of all the transparent identifier polarizing film members included in the image data;
Each time the identification information is obtained, the size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information is read from the fourth storage means, and this is read as calibration information of the third storage means. Means for obtaining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface,
A means for reading desired information corresponding to the identification information each time the identification information is obtained, and displaying the information on a display area of the display surface according to the obtained position and inclination. 5. A dialogue system using the transparent polarizing film according to 5.   7. The transparent according to claim 5, wherein the transparent identifier polarizing film member is composed of two half-wave plates stacked so that their polarization directions are different by π / 4 in the same plane. Dialog system using polarizing film. A display process for displaying an image on a display surface;
An imaging step of the pre-Symbol Table示面captured by the imaging capable provided imaging means, and transmits the video signal each time the shooting,
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
Is location mounting on the display surface, formed by a transparent material of a predetermined size, and a second polarization step of polarizing a transparent polarizing film having a predetermined polarization direction to pass video from the display surface from the polarizing filter ,
After inputting the video signal from the imaging step and obtaining image data obtained by digitally converting the video signal, the size, position and inclination of the image of the transparent polarizing film on the display surface are recognized based on the image data. Then , a dialogue method using a transparent polarizing film is performed, wherein a dialogue processing step of defining a display area on the display surface and displaying desired information stored in advance in the display area is performed. A display process for displaying an image on a display surface;
An imaging step of capturing a pre Symbol table示面and sends the video signal each time the shooting,
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
Wherein the location placing the display surface, Toru predetermined transparent identifiers polarizing film member which are arranged a transparent polarizing film having a polarization direction to be identified for passing image from said polarizing filter from the display surface is attached A second polarizing step of polarizing with a transparent sheet with a bright identifier polarizing film;
The inputs a video signal from the imaging process, the video signal of this after obtaining the image data obtained by digital conversion, and decrypt all of the transparent identifiers polarizing film members included in the image data to obtain identification information, in the identification information to the yet that Jo Tokoro associated magnitude, according to the position and inclination of the transparent identifiers polarizing film member, desired information the display surface on the transparent polarizing film recognition interaction step of display corresponding to the identification information And a dialogue method using a transparent polarizing film. Display means for displaying an image on a display surface, provided the display surface of the display means to be imaged, an imaging means for transmitting the video signal each time photographing the display surface, the proximate said image pickup means is provided between the display means, wherein the polarizing filter having a polarization direction that blocks the image from the display surface, the is location mounting the display surface, predetermined polarization to pass video from the display surface from the polarizing filter A dialogue processing apparatus program of a dialogue system comprising a transparent polarizing film having a direction and formed of a transparent material in a predetermined size, and a dialogue processing apparatus,
On the computer,
Means for storing characteristics of the display surface of the display means, the characteristics of the attitude and the imaging means, the height, the calibration information including the position to the fifth storage means,
It means for storing the Nozomu Tokoro information to the sixth memory means,
Means for performing contour extraction of the image of the transparent polarizing film based on the video signal to determine the size, position and inclination of the image of the transparent polarizing film, and outputting these as transparent polarizing film recognition information;
The calibration information of the fifth memory means, means for defining a display area of the transparent polarizing fill beam of the image on the display surface based on said transparent polarizing film recognition information,
The desired information sixth program interaction processing apparatus dialogue system for which reading from the storage means is output to the display means to execute the function of the means that presents on the display area of. Display means for displaying an image on a display surface, provided the display surface of the display means to be imaged, an imaging means for transmitting the video signal each time photographing the display surface, the proximate said image pickup means is provided between the display means, wherein the polarizing filter having a polarization direction that blocks the image from the display surface, the is location mounting the display surface, predetermined polarization to pass video from the display surface from the polarizing filter and by arranging the transparent polarizing film identifiable with the transparency identifier polarizing film with a transparent sheet transparent identifiers polarizing film member is adhered to with a direction, transparent polarization dialogue system comprising a transparent polarizing film recognition dialog processing system A filter recognition dialogue processing program comprising:
On the computer,
Means for storing characteristics of the display surface of the display means, the characteristics of the attitude and the imaging means, the height, the calibration information including the position to the seventh memory means,
For each identification information, means for storing said transparent identifiers polarizing film with a transparent sheet of a size corresponding to the identification information, the desired information to be displayed in the storage unit of the eighth,
Inputs a video signal from the imaging means, an image signal of this after obtaining the image data obtained by digital conversion, by performing contour extraction of the image of all of the transparent identifiers polarizing film members included in the image data, the Means for determining the position and inclination of the image of the transparent identifier polarizing film member;
The images for each image of all of said transparent identifiers polarizing film members included in the data, it means for obtaining the identification information by decoding the sequence of the transparent polarizing film,
Each time the identification information is obtained, the size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information is read from the eighth storage means, and this is read as calibration information of the seventh storage means. Means for determining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface,
Every time the identification information is determined by reading the desired information corresponding to the identification information from the storage unit of the eighth, as a means to be displayed on the display area of the display surface according to the position and tilt the obtained A program of a transparent polarizing film recognition dialogue processing apparatus of a dialogue system for executing a function.