JP2009157360A - Interactive processing system using transparent polarization film, interactive method using transparent polarization film, program of interactive processor of interactive system, program of transparent polarization film recognition interactive processor of interactive system, polarization film member and transparent sheet with transparent identifier polarization film - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an interactive system using a liquid crystal display, which makes it possible to interact with each other while looking at data without interrupting a display surface and without bringing the data into a conference room or the like by utilizing the advantages of a transparent sheet. <P>SOLUTION: A polarization filter is interposed adjacently to the lens of a CCD camera 5 between that and a large-sized liquid crystal display 1, video images from the large-sized liquid crystal display 1 are interrupted, and only the video images from a sheet-like polarization film 3 formed of a transparent material in a prescribed size placed on a large-sized display are detected. Then, by having a first interactive processor 7 determine an area on the large-sized display 1 of the transparent polarization film 3 and display desired information in the area, information different from a main image displayed on the large-sized display 1 is shown. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an interactive system in which a polarizing filter is provided in front of a lens of a camera, and a polarizing film sheet or a transparent sheet is placed on a display surface of a display, and conversation can be performed using these sheets.

  Until now, many researches have been made on table top systems that apply physical development called polarization.

  The video display methods of this table top system are generally roughly classified into the following three types.

(1) Projection from above by projector (2) Projection from below by projector (3) Display by thin display such as plasma or liquid crystal.

  Each of these has advantages and disadvantages, but a common problem in projection by a projector is that visibility is reduced unless the room is darkened because the amount of light is small.

  On the other hand, a thin display can obtain sufficient visibility even in a bright room, and in recent years, a thin display is inexpensive.

  There exists patent document 1 (Unexamined-Japanese-Patent No. 2004-239664) in the system using such a thin liquid crystal display.

  Patent Document 1 discloses a liquid crystal display that is illuminated with a backlight by providing an orthogonal polarizing film in front of the lens with the display surface facing upward, and photographing the display surface of the liquid crystal display with a CCD camera. It is a system that detects scratches, dust, etc. on the protective film by obtaining an image from which the light that has passed is removed. That is, if there is a scratch on the surface of the liquid crystal display or the protective film, an image irregularly reflected by the scratch is detected, and if dust is attached, an image of light irregularly reflected by the dust is detected.

  Further, Patent Document 1 detects a defect of the display element itself in the liquid crystal display by retracting the orthogonal polarizing film from the lens front of the CCD camera or setting it in front of the lens.

  On the other hand, research is also being conducted on using it as a tabletop system by placing the large LCD display face up.

  For example, when a hand is held over the display surface of a large liquid crystal display with the display surface facing upwards, it is easy to recognize a finger by photographing the display surface with a CCD camera through a polarizing film. There is research to talk with.

In such a table top system, a document is brought in and explained, or a document is put on a transparent sheet for a meeting.
JP 2004-239664 A

  However, even though a liquid crystal display has sufficient visibility even in a bright room, the display surface of the liquid crystal display is shielded by a shielding object such as a hand, so that the characteristics of the liquid crystal display can be fully utilized. Absent.

  For example, when important information that must be immediately determined is displayed at the location of the display surface shielded by the shielding object, there is a problem in that the important information cannot be seen by humans due to the shielding object.

  At the time of a meeting, there are cases where a large amount of materials are placed on a table, and when necessary, meetings are made with the other party while referring to the materials, and the materials are explained to me.

  In such a case, there is a problem that the burden is large on the person who explains, because it is necessary to bring materials into the conference room for the number of people.

  Furthermore, a transparent sheet that can contain materials is useful because it allows you to see what the contents are and to organize them by material.

  Such a transparent sheet is mostly used to put materials, but when meeting with a table with a liquid crystal display with the display surface facing upward, the display on the liquid crystal display depends on the materials inside. There was a problem that a part of the surface was cut off. However, the transparent sheet has an advantage that it can be seen through.

  However, in Patent Document 1, the display surface is photographed with a CCD camera in which a polarizing film is provided in front of the lens in the upward direction of the liquid crystal display with the display surface facing upward, and scratches and dust on the surface are detected. It is not an interactive system using a liquid crystal display that takes advantage of the transparent sheet.

  The present invention has been made in view of the above problems, and can take advantage of the advantages of a transparent sheet, without interrupting the display surface, and without having to bring the material into a conference room or the like, and a liquid crystal capable of interacting with each other while viewing the material. The purpose is to obtain a dialogue system using a display.

  On the other hand, even in an interactive system using a liquid crystal display that takes advantage of the above-described transparent sheet, there are various types of materials, and the materials must be organized for each person in charge.

  Therefore, in a dialogue system using a liquid crystal display that takes advantage of transparency, a transparent sheet that can identify materials and persons in charge, even if transparent, can be used to create a liquid crystal display that can interact with each person or material. The dialogue system used is desirable.

  The dialogue system using the transparent polarizing film of the present invention is provided with a display means for displaying an image on a display surface and a display surface of the display means so as to be capable of imaging, and sends out the image signal every time the display surface is photographed. And a polarizing filter provided between the imaging means and the display means adjacent to the imaging means and having a polarization direction for blocking an image from the display surface, and disposed on the display surface and having a predetermined size An image obtained by inputting the video signal from the imaging means and converting the video signal into a digital signal, and a transparent polarizing film having a predetermined polarization direction that is formed of the transparent material and passes the video from the display surface through the polarizing filter. After obtaining the data, the size, position and inclination of the image of the transparent polarizing film of the image data are recognized and determined on the display surface, and desired information stored in advance in this area is displayed. And gist that a dialog processing system for.

  Further, the dialogue system using the transparent polarizing film of the present invention is provided with a display means for displaying an image on a display surface, and a display surface of the display means so as to be able to take an image. An imaging means for transmitting the light, a polarizing filter provided between the display means and the display means, and having a polarization direction that blocks an image from the display surface, and disposed on the display surface, the display A transparent identifier polarized light having a transparent identifier polarizing film member that makes a transparent polarizing film having a predetermined polarization direction that allows an image from a plane to pass through the polarizing filter to be identifiable, and made of a transparent material of a predetermined size A transparent sheet with a film and a video signal from the imaging means are input, and after obtaining the image data obtained by digitally converting the video signal, all of the image data included in the image data The bright identifier polarizing film member is decoded to obtain identification information, and the desired size corresponding to this identification information is obtained according to the position and inclination of the transparent identifier polarizing film member at the predetermined size associated with the identification information. The gist of the present invention is to provide a transparent polarizing film recognizing dialogue processing apparatus for displaying information on the display surface.

  Further, the interactive method using the transparent polarizing film of the present invention includes a display step of displaying an image on a display surface, and the display surface of the display step is photographed by photographing means provided so as to be capable of being imaged, and the image is displayed every time the image is photographed. An imaging process for transmitting a signal, a first polarization process for polarizing with a polarization filter having a polarization direction that blocks an image from the display surface, and a transparent material of a predetermined size disposed on the display surface A second polarization step of polarizing an image from the display surface with a transparent polarizing film having a predetermined polarization direction that passes through the polarizing filter, and a video signal from the imaging step is input, and the video signal is digitally After obtaining the converted image data, the size, position and inclination of the image of the transparent polarizing film of the image data are recognized and determined on the display surface, and stored in this area in advance. And gist to carry out the desired information interaction process of displaying the that.

  Further, the interactive method using the transparent polarizing film of the present invention includes a display step of displaying an image on a display surface, an image pickup step of photographing the display surface of the display step, and sending out the image signal every time it is photographed, A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface; and a predetermined polarization direction that is disposed on the display surface and allows the image from the display surface to pass through the polarization filter. A second polarizing step of polarizing with a transparent sheet with a transparent identifier polarizing film made of a transparent material having a predetermined size, and having a transparent identifier polarizing film member that allows the transparent polarizing film to be arranged and made identifiable, and After the image signal from the imaging process is input and the image data obtained by digital conversion of the image signal is obtained, all the transparent identifier polarizing film portions included in the image data The identification information is obtained by decoding the information, and desired information corresponding to the identification information is displayed on the display surface according to the position and the inclination of the transparent identifier polarizing film member with the predetermined size associated with the identification information. The gist is to perform the transparent polarizing film recognition dialogue processing step to be displayed.

  Furthermore, the program of the dialog processing apparatus of the dialog system is provided with a display means for displaying an image on a display surface and a display surface of the display means so as to be able to image, and sends out the image signal every time the display surface is imaged. A polarizing filter provided between the imaging means and the display means adjacent to the imaging means and having a polarization direction that blocks an image from the display surface; and disposed on the display surface, from the display surface A program for an interactive processing apparatus of an interactive system, comprising: a transparent polarizing film having a predetermined polarization direction that allows an image to pass through the polarizing filter and having a predetermined size with a transparent material; and an interactive processing apparatus. Means for storing, in a fifth storage means, calibration information including characteristics of the display surface and orientation of the display means and characteristics, height and orientation of the imaging means in the computer; Means for storing desired information in a sixth storage means; extracting the contour of the image of the transparent polarizing film of the image data to determine the size, position and inclination of the image of the transparent polarizing film; Means for outputting as film recognition information; means for defining the transparent polarizing film recognition information as a display area for the transparent polarizing film on the display surface based on the calibration information; and outputting the desired information to the display means. The gist of the present invention is to execute a function as means for displaying on the area of the display surface corresponding to the display area for the transparent polarizing film.

  Furthermore, the program of the transparent polarizing film recognition dialogue processing apparatus of the dialogue system of the present invention is provided with a display means for displaying an image on a display surface and a display surface of the display means so as to be able to take an image. An image pickup means for transmitting the image signal to the image pickup means, a polarizing filter provided between the display means and the display means adjacent to the image pickup means, and having a polarization direction for blocking an image from the display surface, and disposed on the display surface A transparent identifier polarizing film member for arranging and identifying a transparent polarizing film having a predetermined polarization direction that allows an image from the display surface to pass through the polarizing filter, and from a transparent material having a predetermined size A transparent polarizing filter recognition dialogue processing program of a dialogue system comprising a transparent sheet with a transparent identifier polarizing film and a transparent polarization film recognition dialogue processing device A means for storing calibration information including characteristics of the display surface of the display means, orientation and characteristics, height, orientation of the imaging means in a seventh storage means in a computer; , A size of the transparent sheet with the transparent identifier polarizing film corresponding to the identification information, a means for storing desired information to be displayed in an eighth storage means, a video signal from the imaging means is input, and the video signal is input After obtaining digitally converted image data, the contour extraction of the images of all the transparent identifier polarizing film members included in the image data is performed, and the means for determining the position and inclination of the image of the transparent identifier polarizing film member, Means for deciphering the arrangement of the transparent polarizing film to obtain the identification information for each image of all the transparent identifier polarizing film members included in the image data, Each time the different information is obtained, the size of the transparent sheet with the transparent identifier polarizing film corresponding to the identification information is read from the eighth storage means, and this is read based on the calibration information of the seventh storage means. Means for obtaining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface, each time the identification information is obtained, reading desired information corresponding to the identification information, and according to the obtained position and inclination The gist of the invention is to execute a function as means for displaying in the display area of the display surface.

  Furthermore, the transparent polarizing film member of the present invention is a transparent polarizing film member that combines a transparent polarizing film having a predetermined polarization direction and a transparent film, and makes it identifiable by the arrangement, spacing, and size of the combination. It is a summary.

  The gist of the transparent polarizing film member of the present invention is that it is a transparent polarizing film member comprising two half-wave plates stacked so that their polarization directions are different from each other by π / 4 on the same plane.

  The gist of the transparent sheet with a transparent identifier polarizing film of the present invention is that the transparent polarizing film member according to claim 12 or 13 is formed at a predetermined position of a transparent sheet having a predetermined size.

  As described above, according to the present invention, the image from the display means is blocked by the polarizing filter provided near the image pickup means and between the display means, and the image of the transparent polarizing film placed on the display means is displayed. Since the desired information can be displayed in a predetermined size and in accordance with the inclination of the transparent polarizing film in the area on the display surface of the display means of the transparent polarizing film, the transparent polarizing film can be viewed while viewing the image displayed by the display means. The desired information displayed below is viewed, and this information can be used for dialogue.

  Further, according to the present invention, when the transparent sheet provided with the transparent identifier polarizing film is placed on the display means, the transparent identifying polarizing film is decoded, the identification information is extracted, and the desired information corresponding to the identification information is extracted. Information is displayed in the area below the transparent sheet with its inclination, position and size.

  For this reason, when the display means is embedded in the table with the display surface facing up and the table is surrounded by a plurality of persons, it is possible to display desired information corresponding to each transparent sheet.

  Furthermore, since the transparent polarizing member of the present invention is arranged with polarizing films having a predetermined polarization direction or different polarization directions, images of these polarizing films can be detected by a camera provided with a polarizing filter in front of the lens. Can be used as an identifier and is transparent, so that the video below can be seen.

  Furthermore, the transparent sheet with the transparent identifier polarizing film of the present invention can show the image under the transparent sheet to the person surrounding the table, and the computer can provide desired information according to the identification information of the transparent sheet. Can be extracted from the database.

  First, the construction of a table top system applying the physical phenomenon of polarization and the outline of the method will be described first.

  By blocking the display image using polarized light, the accuracy of recognition of the actual object on the table surface by the camera can be significantly improved. This method can also be applied to the rear projection method by attaching a polarizing film to the projector.

  However, the light transmitted through the polarizing film is theoretically 50% or less. For this reason, it is preferable to use a liquid crystal display rather than a projector with poor visibility even during normal times.

  In the present embodiment, a polarizing filter for blocking the image (light) from the liquid crystal display is provided in front of the lens of the CCD camera so as to block the image on the liquid crystal display. Thereby, the image obtained by the CCD camera becomes an image in which the display surface of the liquid crystal display looks black.

  However, when a polarizing film having certain characteristics is superimposed on the liquid crystal display, it appears that the image from only the area where the polarizing film is placed is reflected on the liquid crystal display. This phenomenon is used in this embodiment.

  In addition, if a real object is placed on the table, the displayed image is shielded, so the polarizing film is preferably transparent.

  For example, using a transparent acrylic tile pasted with ARTag, we conducted an evaluation experiment by comparing it with a touch panel and actual paper, and showed its usefulness in collaborative work.

  However, the highest evaluation was obtained when using actual paper. Therefore, in order to obtain affordance that is closer to the real world, it is preferable to use a thin film.

  Further, in order to use the interactive method, it is preferable to use as a table top system in which the display surface of the large liquid crystal display is set up.

  Therefore, the present system realizes the dialogue by embedding the large liquid crystal display in the table with the display surface of the large liquid crystal display facing up, and image recognition by a camera attached above the table.

  The image is polarized on the principle of the large liquid crystal display, and only the image can be blocked by attaching a polarizing filter (hereinafter referred to as an orthogonal polarizing filter) orthogonal to the polarization direction to the CCD camera.

  A transparent polarizing film sheet (hereinafter referred to as a transparent polarizing film) is used. There are two advantages of this transparent polarizing film.

  Since it is transparent, it does not block the image of the large liquid crystal display even if it is placed on the large liquid crystal display, and since the transparent polarizing film is in the form of a sheet, it can be easily moved and handled.

  In other words, when the transparent polarizing film is superimposed on a large liquid crystal display, it appears transparent to the user, but when an orthogonal polarizing film is provided in front of the lens of the CCD camera of the system and the display surface of the large liquid crystal display is photographed with the CCD camera, Only an image of this transparent polarizing film can be obtained.

  In this embodiment, even if a large liquid crystal display is arranged on the table with the display surface facing upward, the image displayed in the transparent polarizing film area is not blocked by the transparent polarizing film. While making it visible to humans, the CCD camera obtains only an image of a transparent polarizing film by a polarizing filter provided in front of the lens. Then, an interactive system using the transparent polarizing film is realized, in which desired information is displayed on the area of the transparent polarizing film on the large-sized liquid crystal display, and this can be shown to humans for dialogue.

  The configuration of this embodiment will be shown and described below.

<Embodiment 1>
FIG. 1 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the first embodiment.

As shown in FIG. 1, a table 2 in which a display surface (also simply referred to as LCD 1) of a large liquid crystal display 1 is embedded upward is used. Above this large liquid crystal display 1, a CCD camera 5 is provided so that the entire table surface can be photographed. The CCD camera 5 is attached to the ceiling or pole by an attachment jig (not shown). An orthogonal polarization filter 4 is provided in front of the lens of the CCD camera 5. The orthogonal polarization filter 4 and the CCD camera 5 are collectively referred to simply as a camera unit 6.

  A transparent polarizing film 3 is placed on the large liquid crystal display 1. The transparent polarizing film 3 (also referred to as a transparent polarizing film member) is transparent and desirably has an A4 size (for example, rectangular hard vinyl chloride).

  That is, since the transparent polarizing film 3 that can be actually moved by hand is in a sheet form, the information can be displayed only in that portion by overlapping the transparent polarizing film 3 on the region to be operated. This transparent polarizing film takes advantage of the fact that the image from the large-sized liquid crystal display 1 is not blocked, and desired information is displayed in the area under the moved transparent polarizing film 3 only by moving the transparent polarizing film 3. be able to.

  Further, the cable 7 a of the camera unit 6 described above is connected to the first dialogue processing device 7. The first dialog processing device 7 includes a first image recognition computer 8 and a first drawing computer 9, and the first image recognition computer 8 is connected to the camera unit 6 by a cable 7 a, and The drawing computer 9 is connected to the large liquid crystal display 1 by a cable 9a.

  Although the image recognition computer 8 and the drawing computer 9 may be integrated, this embodiment shows a separated example.

  With such a configuration, when, for example, a map from the first interactive processing device 7 is displayed on the large-sized liquid crystal display 1, the map displayed in the area of the transparent polarizing film 3 can be seen by humans, and the CCD camera Only the image of the transparent polarizing film 3 is obtained by the orthogonal polarizing filter 4 provided in front of the lens 5. And it implement | achieves displaying desired information (for example, disaster information) in the area | region of the transparent polarizing film 3 on the large sized liquid crystal display 1. FIG.

  FIG. 2 is an explanatory diagram for explaining blocking and transmission of an image by the polarizing filter 4, the large-sized liquid crystal display 1, and the transparent polarizing film 3 according to the first embodiment.

  In the first embodiment, the transparent polarizing film 3 is placed on the large liquid crystal display 1, and the CCD camera 5 having the orthogonal polarization filter 4 is disposed in front of the large liquid crystal display 1 in front of the lens. The image (light) from the large liquid crystal display 1 is blocked by the orthogonal polarization filter 4.

  However, if the transparent polarizing film 3 is placed so that the polarization direction of the transparent polarizing film 3 does not coincide with that of the large-sized liquid crystal display 1 or the orthogonal polarization filter 4, the light passes through the orthogonal polarization filter 4 and enters through the lens of the CCD camera 5. To do.

  For this reason, the CCD camera 5 obtains only the image of the transparent polarizing film 3, and even if the transparent polarizing film 3 is placed on the large liquid crystal display 1 as shown in FIG. Since it is transparent (wavelength 360 to 830 nm), a human can see the image under the transparent polarizing film 3.

  FIG. 4 is an explanatory diagram for explaining blocking of an image using polarized light.

  A table top system using an image recognition by a general camera as an interactive method has a problem that it is difficult to cut out a finger by background difference due to a video displayed on the table.

  Light is a kind of electromagnetic wave, and its vibration direction is a transverse wave perpendicular to the traveling direction of the wave. When natural light vibrates in all directions of 360 °, this light is called polarized light when it vibrates only in a specific direction.

  A polarizing film is like a fine streak and has the property of transmitting only light in a specific vibration direction and blocking other light, so that light transmitted through the film becomes polarized light. For this reason, if two polarizing films (polarizing plates) are stacked perpendicularly, all the light is blocked.

  However, when a substance that changes the vibration direction of light is sandwiched between polarizing films (polarizing plates) orthogonal to each other, light is transmitted. Since the liquid crystal display uses this principle, the displayed image is polarized.

  In this system, by attaching a polarization filter (orthogonal polarization filter) orthogonal to the polarization direction of the image from the liquid crystal display to the camera, only the image on the liquid crystal display can be blocked.

  FIG. 5A shows a case where the orthogonal polarization filter 4 is not provided in front of the liquid crystal display 1, and the image of the liquid crystal display and the image from the transparent polarizing film 3 are received by the CCD camera. I understand. That is, since images from both the liquid crystal display 1 and the transparent polarizing film 3 are received by the CCD camera, it can be said that it is difficult to recognize the object (the transparent deflection film 3).

  On the other hand, FIG. 5B shows a case where the orthogonal polarization filter 4 according to the present embodiment is provided in front of the CCD camera, and only the image on the liquid crystal display is blocked. That is, since only the image from the transparent polarizing film 3 is transmitted, the transparent polarizing film 3 itself can be easily recognized. At this time, even if the “hand” is placed on the liquid crystal display, the “hand” is photographed as it is, so that the “hand” above the table can also be recognized (object recognition) without being affected by the background image. it can.

  FIG. 6 is a schematic configuration diagram of the first image recognition computer. FIG. 7 is a schematic configuration diagram of the first drawing computer. These schematic configuration diagrams collectively show software processing and hardware units (CPU, memory, etc.).

  As shown in FIG. 6, the first image recognition computer 8 includes a capture board 11, a buffer memory 12, a transparent polarizing film recognition unit 13, an LCD upper region determination unit 14, and a first related information addition unit. 17 and a drawing information transmission unit 19 and the like.

  The capture board 11 digitally converts the video information for each frame from the camera unit 6, captures it inside, and stores it in the buffer memory 12.

  The transparent polarizing film recognition unit 13 reads the image data for each frame stored in the buffer memory 12, extracts the outline of the transparent polarizing film 3 by binarization processing, and the number of approximate figure sides is “4”. Is recognized as a rectangle. The recognized center of gravity and the coordinates of the four vertices are obtained using the calibration information in the memory. At this time, when the size is smaller than the rectangular size stored in advance, it is excluded. The coordinates of the four vertices and the rectangular coordinates are output as polarizing film recognition information H to the LCD upper area determination unit 14.

  The LCD area determination unit 14 reads the polarizing film recognition information H, determines the area of the transparent polarizing film 3 on the LCD using the calibration information in the memory 18, and stores this in the memory 16. In this system, coordinate transformation is performed using perspective transformation.

  This calibration information needs to match the coordinates between the camera and the display in order to accurately draw a desired image in the area where the transparent polarizing film is arranged on the liquid crystal display with the display surface facing upward. .

  For this reason, camera lens characteristics, camera height, CCD information, liquid crystal display surface size, camera posture angle, LCD display surface posture angle, etc. are stored in memory in association with each other as calibration information. Yes.

  The first related information adding unit 17 reads the storage address M of the related information stored in the database 15 after the LCD upper region determination unit 14 determines the region of the transparent polarizing film 3, and the storage address M is transparent. It is added to the area information of the polarizing film 3 and sent to the drawing information sending unit 19.

  The drawing information sending unit 19 sends the area information of the transparent polarizing film 3 and the storage address M of related information to the first drawing computer 9 as a set.

  Next, a schematic configuration diagram of the first drawing computer of FIG. 7 will be described. The drawing computer 9 includes a polarizing film information output unit 24, an LCD display information extraction unit 21, a map information database 22, a photo information database 23, a drawing information extraction unit 25, and an information writing unit. 26, a sheet information output unit 24, and the like.

  The LCD display information extraction unit 24 reads the map or photo selected by the operator from the map information database 22 or the photo information database 23 and outputs it to the liquid crystal display 1 for display.

  The drawing information extraction unit 25 reads the storage address information M from the image recognition computer 8, reads the actual information (for example, disaster related) of the storage address information, and outputs it to the information writing unit 26.

  The information writing unit 26 receives the area information DH (position, direction, size) on the LCD from the drawing computer 8 and inputs it to the layer of the memory 27 (having the same coordinate system as the display surface of the LCD). Define and write the real information from the drawing information extraction unit 25 to the area of this layer.

  The polarizing film information output unit 24 reads the layer information in the memory 27 and outputs it to the LCD, thereby displaying the actual information under the transparent polarizing film 3.

  The operation of the system configured as described above will be described below. FIG. 8 is a flowchart for explaining the operation of the image recognition computer 8 according to the first embodiment.

  The transparent polarizing film recognition unit 13 of the first image recognition computer 8 monitors whether image data is stored in the buffer memory 12 (S1).

  If it is determined in step S1 that image data has been stored, an image on the transparent polarizing film 3 (also simply referred to as a transparent polarizing film) is recognized (S2).

  In the recognition process of the transparent polarizing film 3, image data is acquired from the buffer memory 12, and the acquired image is subjected to binarization processing to extract a contour line. Next, linear approximation of the contour line is performed, and when the number of sides of the approximated figure is “4”, it is recognized as a quadrangle. Finally, if it is smaller than the minimum rectangle size, it is excluded. The center of gravity of the rectangle thus obtained and the coordinates of the four vertices are obtained. The coordinates of the center of gravity of the rectangle and the coordinates of the four vertices are output as polarizing film recognition information H to the LCD upper area determination unit 14.

  Next, the LCD upper area determination unit 14 reads the polarizing film recognition information H, and projects it on the display surface (projects on the transparent polarizing film layer) from the focal point of the camera based on the calibration information (S3). Then, the projection position, the size and direction of the area, etc. are obtained (S4). For example, coordinate conversion is performed using per-spectrum conversion.

  For example, as shown in FIG. 9, in the LCD coordinate system that defines the size of the display surface of the liquid crystal display, the polarizing film recognition information H is projected onto the layer of the LCD coordinate system. Then, the inclination θp with respect to the Y-axis and the inclination θq with respect to the X-axis (collectively, inclination θi) are obtained, and the size of the projected area (defined by four-point coordinates) and the center position are obtained. This is stored in the memory 16 as area information DH on the LCD of the transparent polarizing film 3.

  Then, the first related information adding unit 17 reads the storage address M of the related information related to the transparent film from the database 15 (S5), and adds the storage address M of the related information to the LCD upper area information DH. The related information K is sent to the drawing computer 9 by the drawing information sending unit 19 (S6).

  Next, it is determined whether or not to end, and if it is not ended, the process returns to step S1 (S7).

  On the other hand, the first drawing computer 9 inputs the LCD area / related information K and performs the processing of the flowchart shown in FIG.

  The information writing unit 26 of the first drawing computer 9 monitors whether or not the region / related information K on the LCD is input (S10).

  If it is determined in step S10 that the area / related information K on the LCD is input, it is monitored whether or not the actual information of the LCD area (area corresponding to the transparent polarizing film) is input from the drawing information extraction unit 25 (S11). ).

  If it is determined in step S11 that actual information has been input, an area on the LCD is generated in the layer, the actual information is written in this area, and this layer is output to the LCD (S12, S13). Next, it is determined whether or not to end, and if it is not ended, the process returns to step S10.

  That is, in the present embodiment, as shown in FIG. 11A, when a map is displayed on the LCD, the transparent polarizing film 3 is transparent when the transparent polarizing film 3 is placed on the LCD. Therefore, a human can see the map under the transparent polarizing film 3.

  However, in this embodiment, since the CCD camera is provided with the orthogonal polarization filter 4 (perpendicular to the polarization of the LCD) in front of the lens, the light from the LCD is blocked. As a result, as shown in FIG. 11B, only the image of the transparent polarizing film 3 is received by the CCD camera 5.

  In the present embodiment, the position and inclination of the transparent polarizing film 3 are detected in real time, the area is determined on the LCD, and the determined area is desired as shown in FIG. 11 (c). Displays real information for.

  For example, as shown in FIG. 1, when the entire map (which may be an aerial photograph) is displayed on the liquid crystal display, the area of the transparent polarizing film 3 may be replaced with past disaster information.

  Various information such as past temperature, rainfall, and population density can be added. Furthermore, it is effective to find out the relevance by displaying a plurality of information in a superimposed manner. For example, by displaying the population density and the average annual income per household in an overlapping manner, the relationship between these two elements can be seen. Moreover, since it is not only information with a clear orientation such as characters, the visibility does not deteriorate much even when a collaborative work is performed by surrounding a table with a plurality of people.

<Embodiment 2>
In the second embodiment, the transparent polarizing film 3 is recognized, the movement of the hand is recognized, and actual information corresponding to the movement of the hand is displayed in a region below the transparent polarizing film 3. In this embodiment, only the recognition computer will be described.

  Using a CCD camera provided with a polarizing filter in front of the lens, natural human actions based on physical properties such as gestures are used for operations. That is, the image of the large liquid crystal display 1 is blocked by using the CCD camera 5 provided with the orthogonal polarization filter 4 in front of the lens. As a result, it is possible to improve the recognition difficulty due to the change of the finger, and thus it is possible to recognize the finger with high accuracy.

  FIG. 12 is a schematic configuration diagram of an image recognition computer according to the second embodiment. In FIG. 12, the same reference numerals as those in the first embodiment are omitted.

  As shown in FIG. 12, the second embodiment includes a hand recognition unit 30, a hand motion decoding unit 31, a second related information adding unit 34, and the like.

  Each time image data is stored in the buffer memory 12, the hand recognition unit 30 recognizes a hand image compared with a reference hand image stored in advance, and outputs the hand image to the hand motion decoding unit 31. To do. Each time a hand image is input, the hand motion decoding unit 31 determines whether or not the hand motion has been compared with the previous hand image stored in the memory 32.

  If the hand has moved, it is determined whether it has moved from right to left or from left to right, and page control information corresponding to the determination result is extracted from the memory 33.

  For example, in the case of right to left, the memory 33 sets the page control information to “next page”. In the case of left to right, the page control information is “return”.

  The second related information adding unit 34 receives the page control information from the hand movement decoding unit 31 and each time the LCD area determination unit 14 obtains the area of the transparent polarizing film on the LCD, The storage address next to the information storage address M is read, and the transparent polarizing film area (four coordinate points and center coordinates) is sent to the drawing computer by the drawing information sending unit 19. Therefore, the drawing computer displays the actual information corresponding to the next storage address corresponding to the movement of the hand in the area below the transparent polarizing film 3.

That is, as shown in FIG. 13 (a), for example, when a map is displayed on an LCD and a transparent polarizing film is placed on the LCD, the transparent polarizing film 3 is transparent. it can.

  However, in the present embodiment, since the orthogonal polarization filter 4 is provided in front of the lens of the CCD camera 5, light from the LCD is blocked. As a result, only the image of the transparent polarizing film 3 is received by the CCD camera 5. FIG. 13B shows the case where the hand is on the transparent polarizing film 3.

  At this time, for example, if the hand is moved to the left side, the hand recognition unit 30 and the hand movement decoding unit 31 determine that the hand has moved to the left. This page control information is sent to the related information adding unit 34. Therefore, as shown in (c) of FIG. 13, the actual information of the next page is displayed in the area of the transparent polarizing film 3.

<Embodiment 3>
Since the transparent polarizing film has the advantage of not blocking the display of the large-sized liquid crystal display, it has been found that different information can be displayed on the information of only the region portion of the transparent polarizing film.

  However, there are many points that need to be improved even at this stage. At this stage, only one type of information can be overlaid. When it is desired to display several types of information in a superimposed manner, each transparent polarizing film 3 needs to have a unique ID.

  Then, as an example which gives identification information to a transparent polarizing film, you may make it identify, for example by changing the shape of a transparent polarizing film.

  Alternatively, a transparent polarizing film is arranged on a simple transparent sheet at a predetermined interval in a predetermined interval and is detected by the CCD camera 5 so as to have identification information (hereinafter referred to as a transparent identifier polarizing film) as a so-called bar code. It may be.

  However, these polarization directions should not coincide with at least the polarization direction of the image of the large liquid crystal display and the polarization direction of the orthogonal polarization filter (for example, 1 to 89 degrees with respect to the polarization direction of the image of the liquid crystal display). 45 degrees is most desirable in the range).

  For example, the transparent identifier polarizing film is attached to a simple transparent sheet with an inclination of +45 degrees with respect to the incident light from the liquid crystal display.

  In addition, you may make it overlap | superpose a transparent identifier polarizing film so that a several polarizing film may become a respectively different polarization direction.

  In the present embodiment, a description will be given as an example in which a predetermined number of polarizing films having polarization characteristics and a simple transparent vinyl film are combined to form a transparent identifier polarizing film and attached to a transparent sheet.

  Since such a transparent polarization identifier polarizing film and transparent sheet are transparent, they have various uses. For example, it may be used for paintings, photographs, automobiles, parts, and food materials. In other words, even if it is used for paintings, photographs, or automobiles, parts, and foodstuffs such as barcodes, humans can see them themselves, but the CCD camera (with a polarizing filter) detects this transparent identifier polarizing film. It will be out.

  FIG. 14 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the third embodiment. As shown in FIG. 14, a transparent identifier polarizing film 40 (40a, 40b) is attached to a transparent sheet 42 (42a, 42b) of about A4 (also referred to as a transparent sheet 43 with a transparent identifier polarizing film or simply a transparent sheet 43). The transparent identifier polarizing film 40 is about 1 cm × 5 cm, for example.

  The transparent identifier polarizing film 40 is detected by the CCD camera 5 provided with the orthogonal polarization filter 4 in front of the lens, and the second dialogue processing device 41 decodes the information, position and tilt angle of the transparent identifier, and displays them on the LCD. The actual information corresponding to the transparent identifier is displayed in a predetermined size at the decoded position and tilt angle.

  FIG. 14 shows an example in which two people are sitting in front of a table and interacting with each other using the transparent sheet 43 of the present embodiment. In the third embodiment, the transparent sheet in front of the person sitting on the left side is referred to as the transparent sheet 43a, and the transparent sheet in front of the person sitting on the right side is referred to as the transparent sheet 43b.

  As shown in FIG. 14, the camera unit 6 is connected to a second image recognition computer 42 of a second dialogue processing device 41 (also referred to as a transparent polarizing film recognition dialogue processing device) by a cable 42a. The second drawing computer 44 of the second dialogue processing device 41 is connected to the LCD by a cable 44a.

  FIG. 15 is an explanatory diagram for explaining the transparent sheet with a transparent identifier polarizing film used in the third embodiment.

  Although the magnitude | size of the transparent sheet | seat 43 with a transparent identifier polarizing film is not ask | required, in this Embodiment, it shall be A4 size as shown to (a) of FIG. Moreover, the transparent identifier polarizing film 40 is affixed, for example to the left end part of the transparent sheet 43, as shown to (a) of FIG.

  It is assumed that the transparent identifier polarizing film 40 described above forms a one-dimensional barcode or a two-dimensional barcode as shown in FIG. These thick bar, thin bar, and medium thick bar are polarizing films, and are arranged in a straight line at predetermined intervals. A space is a member of a transparent sheet.

  Further, as shown in FIG. 15 (c), the transparent identifier polarizing film-attached transparent sheet 43 has the transparent identifier polarizing film 40 attached to the upper surface of the A4 size vinyl sheet 40a, and the back surface is provided with the lubricant 40b so that the slip is cheap. It is preferably applied. This is because when the transparent sheet 43 with the transparent identifier polarizing film is placed on the liquid crystal display with the display surface facing upward and moved to the other party, it can be moved smoothly in front of the other party.

  Further, as shown in FIG. 15D, the transparent identifier polarizing film 40 may be embedded in the vinyl sheet 40a.

  Moreover, the area | region of transparent sheets other than the transparent identifier polarizing film 40 is only called a sheet | seat part in this Embodiment.

  FIG. 16 is an explanatory view for explaining the polarization by the transparent sheet with the transparent identifier polarizing film of the third embodiment.

  The orthogonal polarizing filter 4 provided in front of the lens of the CCD camera 5 blocks the light from the LCD and allows the light from the polarizing film forming the bar of the transparent identifier polarizing film 40 to pass through. Block the light from.

  For this reason, as shown in FIG. 16, the image from the large liquid crystal display (LCD display surface) and the light from the sheet portion are blocked, but the light from the polarizing film forming the bar of the transparent identifier polarizing film 40 is orthogonal. The light passes through the polarizing filter 4 and is received by the CCD camera 5. Bars are detected in white and spaces are detected in black.

  In the present embodiment, only the bar of the transparent identifier polarizing film 40 is detected, the contour connecting the bar and the space is obtained (this is simply referred to as an image of the transparent identifier polarizing film 40), and the center of gravity position of the contour is determined. The inclination is determined, and A4 size information corresponding to the position and inclination is displayed on the LCD.

  Therefore, the second image recognition computer 42 preferably has the configuration shown in FIG.

  FIG. 17 is a schematic configuration diagram of an interactive system using the transparent polarizing film of the third embodiment. In FIG. 17, the description of the same reference numerals as those in FIG. 6 is omitted.

  In the third embodiment, as shown in FIG. 17, an identifier recognition unit 50, a transparent identifier polarization film number determination unit 51, an identifier information registration unit 52, a sheet LCD region determination unit 54, and a transparent identifier polarization film Memory 53 for storing identifier information, memory 55 for storing the display size for each identifier, and memory 56 (56a, 56b,...) Third related information for storing storage addresses of actual information for each identifier An additional unit 53 and the like are included.

  The identifier recognition unit 50 monitors whether the image data for each frame is stored in the buffer memory 12, and when the image data is stored, the bar of the image of the transparent identifier polarizing film 40 is obtained from the image data of one frame. Recognize the image of the polarizing film. In this recognition, when the image of the transparent identifier polarizing film 40 is a barcode, an emphasis process is performed, and a numeric string (identifier code hi) obtained by decoding the barcode is output.

  And the outline of the emphasized transparent identifier polarizing film 40 is calculated | required, and the coordinate of the 4 vertex of this outline and the coordinate of a gravity center are calculated | required based on calibration information. That is, the inclination and position of the transparent identifier (barcode) on the LCD are calculated. This is called identifier recognition information Qi in the third embodiment.

  The transparent identifier polarizing film number determination unit 51 counts the number every time the identifier recognition unit 50 recognizes the transparent identifier film, and the identifier number Ri (R1, R2,...) Corresponding to this number is the identifier information registration unit 52. Output to.

  The identifier information registration unit 52 inputs the identifier number Ri from the transparent identifier polarizing film number determination unit 51, the identifier recognition information Qi from the identifier recognition unit 50, and the identifier code hi, and stores them in the memory 53 in association with each other. . This is referred to as sheet area information Pi in the third embodiment. That is, the memory 53 stores the sheet area information Pi of all the transparent identifier films in one frame.

  The sheet LCD upper area determination unit 54 reads the sheet area information Pi of the memory 53, reads the size (for example, A4 size, A3 size) corresponding to the identifier code hi of the sheet area information Pi, and also identifies the identifier of the memory 53. The position and inclination of the recognition information Qi are read and defined in the LCD coordinate system of calibration information. This is stored in the memory 16. In other words, the memory 16 uses the position of the transparent identifier polarizing film (barcode) on the LCD as a reference, and the transparent identifier polarizing film (barcode) is inclined at this position, and is used as the identifier code of the transparent identifier polarizing film (barcode). An area of the corresponding size is defined.

  The third related information adding unit 57 reads information (name, date, actual information storage address) corresponding to the identifier code hi from the database 56, and stores an area (4 points) of a size corresponding to the identifier code. (Coordinates) is added and sent to the drawing information sending unit 19.

  That is, in the third embodiment, as shown in FIG. 18A, the contour of the transparent identifier polarizing film (barcode) is extracted, and the inclination θi (θp, θq) and the position of the transparent identifier polarizing film on the LCD are displayed. Ask for. Then, an area Ji (J1, J2,...) Having a size corresponding to the identification code hi with this inclination θi is generated in the layer ((b) of FIG. 18).

  FIG. 18B shows a case where the size of the identification code hi is all A4. Then, the actual information of the identification code hi is written in these areas Ji (J1, J2,...) ((C) in FIG. 18). FIG. 18 (c) shows a graph of J1 being the population transition and J2 being the age. Another bar graph, J3, is shown as a point graph of the transition of the disaster budget.

  Therefore, different information can be displayed for each transparent identification polarizing film in the size of the operator by the position and inclination of the transparent sheet of the operator of the transparent sheet. Further, since the transparent sheet is transparent, each person in charge can see the information under the transparent sheet and can also check the main image information, so that the user can interact with the sheet.

  Furthermore, since the identifier of each sheet is different in this embodiment, for example, as shown in FIG. 19A, when two transparent sheets are placed on the LCD, as shown in FIG. 19B. Only the images of the two polarizing films are obtained by the CCD camera 5 through the orthogonal polarization filter 4.

  This identifier is all detected by the second image recognition computer, and information corresponding to this identifier is displayed on the LCD (see FIG. 19C).

  Further, as shown in FIG. 19D, when the transparent sheets are stacked, information corresponding to the two identifiers can be displayed together. For example, an identifier having a different identifier is displayed below the identifier 1 (see FIG. 19E).

  Therefore, the dialogue can be performed on the LCD with the transparent sheet possessed by the operator.

  The third embodiment may include the hand recognition unit 30 and the hand motion decoding unit 31 of the second embodiment, and may perform page control by hand movement.

  Further, in each of the above-described embodiments, the description has been made using the large-sized liquid crystal display, but the large-sized liquid crystal display may not be used.

  Moreover, although it demonstrated as a table top down system embedded in the table with the display surface facing upwards, even if it uses a liquid crystal display on a wall and the transparent polarizing film or transparent sheet of this Embodiment is affixed on a liquid crystal display, it can be used. Good.

Further, in each of the above embodiments, the orthogonal polarizing filter provided in front of the lens of the CCD camera is fixed, but this orthogonal polarizing filter is polarized light according to the polarization characteristics of the transparent identifier polarizing film or the transparent identifier polarizing film of the transparent sheet. You may provide the control mechanism which can be changed into a filter.
<Embodiment 4>
In the above embodiment, as shown in FIGS. 2, 4, and 16, the transparent polarizing film 3 or the transparent sheet 40 with the transparent identifier polarizing film is placed on the large liquid crystal display 1, and By disposing a CCD camera 5 having an orthogonal polarizing filter 4 in front of the lens, an image (light) from the large liquid crystal display 1 is blocked by the orthogonal polarizing filter 4, and the transparent polarizing film 3 or the transparent sheet 40. Light is allowed to pass through (hereinafter collectively referred to simply as an optical film), and an image (also referred to as an LCD image) from the large display 1 is incident through the lens of the CCD camera 5.
For this reason, when the optical film is rotated, the phenomenon described below may occur. FIG. 20 shows an image seen by the user (FIG. 20A) and an image seen by the camera (FIG. 20B) when the optical film is rotated on the LCD.
In the polarization relationship between the optical film and the orthogonal polarization filter 4 as described above, when viewed from the user, transmission and blocking are repeated each time the optical film is rotated by π / 2.
This is because when θ = 0, the polarization direction of the LCD image and the transmission axis of the optical film match, so the LCD image passes through the optical film, and when θ = π / 2, the transmission axis of the optical film is orthogonal. This is because is blocked.
On the other hand, when viewed with a CCD camera equipped with an optical film, transmission and blocking are repeated each time π / 4 is rotated (see FIG. 20B).
When the angle between the polarization direction of the display image and the transmission axis of the optical film is θ, the orthogonal polarization filter 4 attached to the camera blocks the image when θ = 0, and when θ = π / 2. This is because the rotating orthogonal polarization filter 4 blocks the image. For this reason, the light intensity becomes maximum when θ = π / 4.
Therefore, when this optical film is used as a marker, when it is rotated, a black portion is generated for every π / 2 for the user, and light is not transmitted for every π / 4 for the camera.
Therefore, instead of the above optical film, a half-wave plate optical film 50 described below is used.
The half-wave plate described above will be described.
In general, a wave plate (retardation film) is one that generates a phase difference using a birefringent crystal such as quartz.
The wave plate has a fast axis and a slow axis, and the incident light is divided into two polarization components orthogonal to each other. The slow axis component is delayed with respect to the fast axis, and then both are combined to form a single wave. It can be emitted as a ray. That is, when the optical axis of the half-wave plate is an angle θ with respect to the polarization plane of the incident light, the emitted light rotates by 180 ° −2θ. For this reason, when the half-wave plate is rotated by the angle a, the polarization plane of the emitted light is rotated by 2a. That is, the half-wave plate can be used to rotate the polarization plane.
The most commonly used waveplates are the quarter waveplate and the half waveplate, which can delay the phase by π / 2 and π, respectively.
FIG. 21 is an explanatory diagram for explaining the relationship between incident light and outgoing light on two half-wave plates.
As shown in FIG. 21, in the half-wave plate, when light passes, the phase of the slow axis component is delayed by π with respect to the fast axis component. As a result, the light emitted by combining both components is rotated 2θ with respect to the vibration direction of the incident light. Detailed analysis will be described later.
That is, the rotation angle can be adjusted by the angle formed between the incident polarized light and the slow axis. For example, when the slow axis is set to 45 degrees with respect to the linearly polarized light, the polarization plane rotates 90 degrees.
Here, the polarization state of FIG. 21 will be described.
The Jones matrix is generally used as an operator to express the polarization state. The following explanation is based on Fig. 21.
Jones vectors of incident light and outgoing light to an optical element are set as follows.
If the angle between the fast axis of the optical element and the x axis is θ, and the relative phase difference between the fast axis component and the slow axis component is ε, the relationship between the incident light and the outgoing light is the rotation operator Rθ and the phase operator. It can be expressed by the following formula using Tε.
However,
Here, for a half-wave plate, ε = π, so

This is the Jones matrix of a half-wave plate.
Where the incident light is polarized in the x-axis direction,

Then, equation (1) becomes
Thus, it can be seen that the light emitted from the half-wave plate is polarized by 2θ rotation.
Next, when the second wave plate is rotated by π / 4 with respect to the first wave plate, it is rotated by θ + π / 4 with respect to the incident light on the first wave. The Jones vector of the emitted light can be described as follows.
Substituting this into equation (2)
From this, it can be seen that the emitted light from the second half-wave plate is always polarized by π / 2 with respect to the first incident light, regardless of θ.
FIG. 22 is an explanatory diagram for explaining the state when the half-wave plate is rotated on the LCD.
FIG. 22A shows a viewpoint from the user. FIG. 22B is a viewpoint from the CCD camera.
As shown in FIG. 22A, it always looks transparent from the viewpoint of the user regardless of the rotation angle.
On the other hand, in FIG. 22B, transmission and blocking are repeated every π / 4 rotation from the viewpoint of the camera as in the polarizing plate.
This appears to be the same behavior as in the polarizing plate, but the principle is different. When the angle between the polarization direction of the LCD and the fast axis of the wave plate is θ, the polarization direction of the emitted light is rotated by 2θ. Therefore, the image is blocked as it is when θ = 0, and the transmitted light rotated by π is blocked when θ = π / 2.
In other words, as described above, when the angle between the polarization direction of the LCD image and the fast axis of the wave plate is θ, the polarization direction of the emitted light from the half-wave plate is rotated by 2θ. For this reason, as shown in FIG. 21, when the second half-wave plate is shifted by π / 4 from the first half-wave plate (the optical film of the present embodiment), the polarization direction is further increased. 2 (θ + π / 4) Rotate and exit.
As a result, the polarization direction of the light emitted from the second half-wave plate is always a direction rotated by π / 2 with respect to the polarization direction of the LCD image (the transmission axis of the polarization filter) (FIG. 21). Therefore, the LCD image can be transmitted regardless of the rotation angle.
FIG. 23 shows how this is rotated on the LCD.
FIG. 23A is an explanatory diagram of the viewpoint of the user of the optical film of the present embodiment. FIG. 23B is an explanatory diagram of the viewpoint of the optical film camera of the present embodiment.
That is, as shown in FIG. 23 (a), the viewpoint from the user always looks transparent regardless of the rotation angle, and as shown in FIG. 23 (b), the rotation angle also from the viewpoint from the camera. It will always look transparent without depending on.
Therefore, by using two half-wave plates rotated by π / 4, it became possible to make transparent markers (including barcodes) with rotation resistance.
This optical film is prepared, for example, as shown in FIG. The second half-wave plate sheet 50b is rotated by an angle of π / 4 (45 degrees) with respect to the first half-wave plate sheet 50a, and the first half-wave plate sheet 50a is overlapped (adhesive) It is generated as shown in FIG. This is referred to as a half-wave plate optical sheet 50 in the present embodiment.
<Other embodiments>
Moreover, when using the transparent sheet | seat with a transparent identifier polarizing film as shown in FIG. 15, it produces | generates as shown in FIG.
FIG. 25 is an explanatory view of the sheet with identifier 52 with the half-wave plate transparent identifier optical film 51 of the present embodiment, and the round frame in the drawing is an enlarged explanatory view of the half-wave plate transparent identifier optical film 51. is there.
The identifier-added sheet 52 is generated by superposing the half-wave plate transparent identifier optical film 51 on the transparent sheet 50.
This half-wave plate transparent identifier optical film 51 is rotated by, for example, 45 degrees with respect to the first half-wave plate 51a, as shown in a round frame in FIG. 25, and the second half-wave plate 51b. Are generated.
Therefore, the barcode can be recognized regardless of the angle at which the sheet with identifier 52 is rotated on the LCD by the CCD camera.

It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 1. FIG. 3 is an explanatory diagram for explaining blocking and transmission of an image by the polarizing filter 4, the large liquid crystal display 1, and the transparent polarizing film 3 according to the first embodiment. It is explanatory drawing explaining the image | video obtained when a polarizing filter is provided in the front of the lens of a CCD camera. It is explanatory drawing explaining the interruption | blocking of the image | video which applied polarized light. It is explanatory drawing explaining the image on LCD which is seen through a polarizing film and the image obtained when a polarizing filter is provided in front of the lens of a CCD camera. It is a schematic block diagram of the 1st computer for image recognition. It is a schematic block diagram of the 1st drawing computer. 6 is a flowchart for explaining the operation of the image recognition computer 8 according to the first embodiment. It is explanatory drawing explaining the production | generation of the area | region on LCD of a transparent polarizing film. 6 is a flowchart for explaining the operation of the first drawing computer 9; FIG. 3 is an explanatory diagram for explaining image display by the transparent polarizing film of the first embodiment. FIG. 3 is a schematic configuration diagram of an image recognition computer according to a second embodiment. FIG. 10 is an explanatory diagram for explaining the operation of the image recognition computer according to the second embodiment. It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 3. It is explanatory drawing explaining the transparent sheet | seat with a transparent identifier polarizing film used for Embodiment 3. FIG. It is explanatory drawing explaining the polarization | polarized-light by a transparent sheet with the transparent identifier polarizing film of Embodiment 3. FIG. It is a schematic block diagram of the dialogue system using the transparent polarizing film of Embodiment 3. FIG. 10 is an explanatory diagram for explaining processing of a third embodiment. It is explanatory drawing explaining the process at the time of overlapping two transparent sheets. FIG. 20 shows an image seen by the user (FIG. 20A) and an image seen by the camera (FIG. 20B) when the optical film is rotated on the LCD. It is explanatory drawing explaining the relationship between the entrance light to two half-wave plates, and emitted light. It is explanatory drawing explaining a mode when a 1/2 wavelength plate is rotated on LCD. It is explanatory drawing explaining a mode when the optical film of this Embodiment is rotated. It is explanatory drawing explaining creation of the optical film of this Embodiment. It is explanatory drawing explaining preparation of the transparent sheet | seat with a transparent identifier polarizing film of other embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Large liquid crystal display 2 Table 3 Transparent polarizing film 4 Orthogonal polarization filter 5 CCD camera 7 1st dialog processing device 8 1st image recognition computer 9 1st drawing computer 11 Capture board 13 Transparent polarizing film recognition part 14 LCD Upper region determination unit 17 First related information addition unit 19 Drawing information transmission unit 50a 1/2 wavelength plate 50a 1/2 wavelength plate

Claims (14)

Display means for displaying video on the display surface;
An imaging means that is provided so as to be capable of imaging the display surface of the display means, and that sends out a video signal each time the display surface is imaged;
A polarizing filter provided near the image pickup means and between the display means and having a polarization direction for blocking an image from the display surface;
A transparent polarizing film disposed on the display surface, formed of a transparent material of a predetermined size, and having a predetermined polarization direction that allows an image from the display surface to pass through the polarizing filter;
After inputting a video signal from the imaging means and obtaining image data obtained by digitally converting the video signal, the size, position and inclination of the image of the transparent polarizing film of the image data are recognized and displayed on the display surface. An interactive system using a transparent polarizing film, comprising: an interactive processing device that defines and displays desired information stored in advance in this area. The dialogue processing apparatus includes:
First storage means for storing calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
Second storage means for storing the desired information;
Means for performing contour extraction of the image of the transparent polarizing film of the image data to determine the size, position and inclination of the image of the transparent polarizing film, and outputting these as transparent polarizing film recognition information;
Based on the calibration information, means for defining the transparent polarizing film recognition information as a display area for the transparent polarizing film on the display surface;
The transparent polarizing film according to claim 1, further comprising means for outputting the desired information to the display means and displaying the information on a region of the display surface corresponding to the display region for the transparent polarizing film. Dialog system. The dialogue processing apparatus includes:
2. The transparent polarized light according to claim 1, wherein when a predetermined object image is recognized in addition to the image of the transparent polarizing film, the desired information is displayed based on movement or deformation of the object image. Dialog system using film.   The transparent polarizing film according to any one of claims 1 to 3, wherein the transparent polarizing film is composed of two half-wave plates stacked so that their polarization directions are different by π / 4 from each other on the same plane. Dialog system using polarizing film. Display means for displaying video on the display surface;
An imaging means that is provided so as to be capable of imaging the display surface of the display means, and that sends out a video signal each time the display surface is imaged;
A polarizing filter provided near the image pickup means and between the display means and having a polarization direction for blocking an image from the display surface;
A transparent identifier polarizing film member that is arranged on the display surface and allows a transparent polarizing film having a predetermined polarization direction to pass through an image from the display surface to pass through the polarizing filter, and is identifiable; and A transparent sheet with a transparent identifier polarizing film made of a transparent material of a size;
After inputting a video signal from the imaging means and obtaining image data obtained by digitally converting the video signal, all the transparent identifier polarizing film members included in the image data are decoded to obtain identification information, A transparent polarizing film recognition dialogue processing apparatus for displaying desired information corresponding to the identification information on the display surface in accordance with the position and inclination of the transparent identifier polarizing film member with the predetermined size associated with the identification information; A dialogue system using a transparent polarizing film. The transparent polarizing film recognition dialogue processing apparatus,
Third storage means for storing calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
For each identification information, a size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information, a fourth storage means that stores desired information to be displayed,
After inputting the video signal from the imaging means and obtaining the image data obtained by digitally converting the video signal, the contour of all the transparent identifier polarizing film members included in the image data is extracted, and this transparent Means for determining the position and inclination of the image of the identifier polarizing film member;
Means for deciphering the arrangement of the transparent polarizing film to obtain the identification information for every image of all the transparent identifier polarizing film members included in the image data;
Each time the identification information is obtained, the size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information is read from the fourth storage means, and this is read as calibration information of the third storage means. Means for obtaining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface,
A means for reading desired information corresponding to the identification information each time the identification information is obtained, and displaying the information on a display area of the display surface according to the obtained position and inclination. 5. A dialogue system using the transparent polarizing film according to 5.   7. The transparent according to claim 5, wherein the transparent identifier polarizing film member is composed of two half-wave plates stacked so that their polarization directions are different by π / 4 in the same plane. Dialog system using polarizing film. A display process for displaying an image on a display surface;
An imaging step of photographing the display surface of the display step by photographing means provided so as to be capable of imaging, and sending out a video signal each time it is photographed;
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
A second polarizing step that is disposed on the display surface, is formed of a transparent material having a predetermined size, and is polarized by a transparent polarizing film having a predetermined polarization direction that allows an image from the display surface to pass through the polarizing filter; ,
After inputting the video signal from the imaging step and obtaining image data obtained by digitally converting the video signal, the image data is recognized on the display surface by recognizing the size, position, and inclination of the transparent polarizing film. An interactive method using a transparent polarizing film, characterized by performing an interactive processing step of defining and displaying desired information stored in advance in this area. A display process for displaying an image on a display surface;
An imaging step of photographing the display surface of the display step and sending out a video signal each time it is photographed;
A first polarization step of polarizing with a polarization filter having a polarization direction that blocks an image from the display surface;
A transparent identifier polarizing film member that is arranged on the display surface and allows a transparent polarizing film having a predetermined polarization direction to pass through an image from the display surface to pass through the polarizing filter, and is identifiable; and A second polarizing step of polarizing with a transparent sheet with a transparent identifier polarizing film made of a transparent material having a size;
After obtaining a video signal from the imaging step and obtaining image data obtained by digitally converting the video signal, all the transparent identifier polarizing film members included in the image data are decoded to obtain identification information, A transparent polarizing film recognition dialogue processing step of displaying desired information corresponding to the identification information on a display surface in accordance with the position and inclination of the transparent identifier polarizing film member with the predetermined size associated with the identification information. An interactive method using a transparent polarizing film, characterized in that: Display means for displaying an image on a display surface, an image pickup means provided so as to be able to image the display surface of the display means, and sending the image signal each time the display surface is imaged, and the display close to the image pickup means And a polarization filter having a polarization direction for blocking an image from the display surface, and a predetermined polarization direction that is disposed on the display surface and allows the image from the display surface to pass through the polarization filter. And a dialogue processing apparatus program of a dialogue system comprising a transparent polarizing film formed of a transparent material and having a predetermined size, and a dialogue processing apparatus,
On the computer,
Means for storing, in a fifth storage means, calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
Means for storing the desired information in a sixth storage means;
Means for performing contour extraction of the image of the transparent polarizing film of the image data to determine the size, position and inclination of the image of the transparent polarizing film, and outputting these as transparent polarizing film recognition information;
Means for defining the transparent polarizing film recognition information as a display area for the transparent polarizing film on the display surface based on the calibration information;
A program for a dialogue processing apparatus of a dialogue system for executing a function as a means for outputting the desired information to the display means and displaying it on the area of the display surface corresponding to the display area for the transparent polarizing film. Display means for displaying an image on a display surface, an image pickup means provided so as to be able to image the display surface of the display means, and sending the image signal each time the display surface is imaged, and the display close to the image pickup means And a polarization filter having a polarization direction for blocking an image from the display surface, and a predetermined polarization direction that is disposed on the display surface and allows the image from the display surface to pass through the polarization filter. A transparent sheet with a transparent identifier polarizing film having a transparent identifier polarizing film member that makes a transparent polarizing film arranged and identifiable, and a transparent polarizing film recognition dialogue processing apparatus A transparent polarization filter recognition dialogue processing program of a dialogue system comprising:
On the computer,
Means for storing, in a seventh storage means, calibration information including the characteristics and orientation of the display surface of the display means and the characteristics, height and orientation of the imaging means;
Means for storing the size of the transparent identifier polarizing film-equipped transparent sheet corresponding to the identification information and desired information to be displayed in the eighth storage means for each identification information;
After inputting the video signal from the imaging means and obtaining the image data obtained by digitally converting the video signal, the contour of all the transparent identifier polarizing film members included in the image data is extracted, and this transparent Means for determining the position and inclination of the image of the identifier polarizing film member;
Means for deciphering the arrangement of the transparent polarizing film to obtain the identification information for each image of all the transparent identifier polarizing film members included in the image data;
Each time the identification information is obtained, the size of the transparent sheet with a transparent identifier polarizing film corresponding to the identification information is read from the eighth storage means, and this is read as calibration information of the seventh storage means. Means for determining a display area of the transparent sheet with the transparent identifier polarizing film on the display surface,
Each time the identification information is obtained, a dialogue system for reading desired information corresponding to the identification information and executing a function as means for displaying the information on the display area according to the obtained position and inclination. Program for dialogue processing device for transparent polarizing film recognition.   A transparent identifier polarizing film member that combines a transparent polarizing film having a predetermined polarization direction and a transparent film, and enables identification by the arrangement, interval, and size of the combination.   The transparent polarizing film member according to claim 12, wherein the polarizing film is composed of two half-wave plates stacked so that the polarization directions thereof are different from each other by π / 4 on the same plane.   A transparent sheet with a transparent identifier polarizing film, wherein the transparent polarizing film member according to claim 12 or 13 is formed at a predetermined position of a transparent sheet having a predetermined size.