JP2007200353A - Information processor and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To strengthen and extend an interactive input and output environment. <P>SOLUTION: The processor comprises a translucent surface, an information display part displaying information on the translucent surface, an imaging part taking an image, a control part outputting a signal to the display part based on the image taken by the imaging part and a parameter change signal for changing a predetermined parameter value of the information processor, and a radiation part radiating light of a predetermined wavelength band to the translucent surface. The imaging part includes an imaging element and a filter transmitting only light of the predetermined wavelength band. The control part recognizes a movement direction of an operating body in the vicinity of the translucent surface based on the image taken by the imaging part, outputs the signal to the display part according to the movement direction and also outputs the parameter change signal according to the movement direction. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information processing apparatus and an information processing method suitable for use, for example, for interactive input / output.

  For example, a computer apparatus or the like widely employs a so-called interactive input / output mode in which a computer apparatus side presents a predetermined response in response to a user operation based on various application programs.

  For example, a touch panel is widely known as one of input devices used for interactive input / output as described above. The touch panel performs a required operation by sliding it in an arbitrary direction while bringing a user's finger into contact with the panel, for example.

  A projection display that functions as a computerized whiteboard is also known. In such a projection display, for example, a user operates the whiteboard using a dedicated infrared light emitting pen.

  There is also known a device that aims at an interactive effect called “video place”. The video place is an artistic device using a video camera, for example. For example, a viewer of a video place causes a video camera to photograph a part of his / her hand or other human body as a silhouette. The viewer can freely move the hand or a part of the human body while looking at the monitor device for any image obtained by combining this captured image with another image, for example, to change the response or change of the image displayed on the monitor device. You can enjoy it.

By the way, when it is considered to realize a further expanded interactive input / output environment, the above-described input devices as described above have limitations in the following points.
When the touch panel is taken as an example, the pointing operation is generally limited to the finger. Further, it is not possible to perform an operation in the space on the touch panel, and it is necessary to bring a physical operation body such as a finger into contact with the operation surface on the panel surface. Further, since the touch panel is relatively expensive, it is not suitable as a large operation panel.
In the case of a projection display that functions as a computerized whiteboard, the operation screen can be easily enlarged. However, as described above, a special pointing device such as an infrared light emitting pen is required.

  In addition, in the case of a video place, since some kind of interactive operation is realized using the silhouette of the hand or human body, the interface between the input and output is indirect, and it is functional when direct operation is desired. Is insufficient.

  As described above, there are various factors that hinder the interactive input / output environment in the conventional input devices.

Therefore, in order to solve the above-described problems, the present invention provides an information processing apparatus that uses a translucent surface, an information display unit that displays information on the translucent surface, an imaging unit that captures an image, and an image that is captured by the imaging unit. A control unit that outputs a signal for the display unit and a parameter change signal for changing a predetermined parameter value of the information processing device based on the image that has been processed, and irradiates the translucent surface with light of a predetermined wavelength band An imaging unit, the imaging unit includes an imaging element and a filter that transmits only light in the predetermined wavelength band, and the control unit is based on an image captured by the imaging unit and is translucent Recognize the direction of movement of the operating tool in the vicinity of the surface, and output a signal to the display unit according to the direction of the movement, and also output a parameter change signal according to the direction of the movement.
In addition, the control unit determines a size of a region where the intensity of light in a predetermined wavelength band generated when the operation body approaches the semitransparent surface based on an image captured by the imaging unit. Recognizing and outputting a signal to the display unit according to the size of the area.
Further, the control unit recognizes a change in intensity of light in a predetermined wavelength band caused by a change in the distance between the translucent surface and the operation body based on the image captured by the imaging unit, A signal for the display unit corresponding to the change in intensity is output.
The information processing apparatus has a table-like shape, the translucent surface is disposed on the table surface, the imaging unit is disposed so as to capture the table surface from a lower part of the table, and the irradiation unit is configured to It was set as the structure arrange | positioned so that light may be irradiated toward a table surface from a lower part.
Further, the imaging unit and the irradiation unit perform imaging and irradiation on the table surface by utilizing reflection by a mirror provided at the lower part of the table.

  Furthermore, the present invention provides an information processing method based on a translucent surface, an information display unit that displays information on the translucent surface, an image capturing unit that captures an image, and an image captured by the image capturing unit. An information processing apparatus comprising: a control unit that outputs a signal for a unit and a parameter change signal for changing a predetermined parameter value of the information processing apparatus; and an irradiation unit that irradiates the semitransparent surface with light of a predetermined wavelength band In this information processing method, an image is picked up by the image pickup device of the image pickup unit through a filter that transmits only light in the predetermined wavelength band, and based on the image picked up by the image pickup unit, in the vicinity of the translucent surface Recognizing the direction of movement of the operating body in step, outputting a signal to the display unit corresponding to the direction of movement, and outputting a parameter change signal corresponding to the direction of movement It was.

The present invention has the following effects.
The information processing apparatus according to the present invention is established as an operating body for performing an operation as long as it is an object that can change a state of the object by reflecting light or electromagnetic waves in a predetermined wavelength band. That is, no special pointing device is required for the operation. In addition, since the operating tool can be recognized at a position close to the translucent surface (for example, the hollow position on the front surface of the translucent surface), the operating method can be performed without bringing the operating tool into contact with the translucent surface that is the operation panel. An operation can be performed in the front space, or an object approaching the translucent surface can be recognized to perform some kind of response processing.
Further, a semi-transparent surface may be obtained as a semi-invention operation panel. For example, unlike a conventional touch panel, the size can be easily increased.

And since it is possible to recognize a plurality of detection targets at the same time and independently execute the required control processing in response to each, it is possible to simultaneously operate a plurality of menu screens, etc. Become.
In addition, it is possible to determine whether or not to recognize this as operation information depending on the shape of the detection target, and it is possible to easily realize only the operation with a human hand or finger as operation information.

  Furthermore, based on the image shape obtained in the detected image information, it is possible to recognize the movement of the human hand or finger as the operation information, and to ignore other detection targets as the operation information.

  Subsequently, by projecting and displaying an image with a projector or the like using the translucency of the translucent surface, the translucent surface can be used not only as an operation panel but also as a display panel for displaying an image. If you set a menu screen for prompting the user to perform various operations as a display image or display an initial image such as a map and specify a certain area on the map, attribute information such as the description of that area It is possible to use it by displaying In this case, a direct operation information input form in which the user operates the image displayed on the translucent surface is also realized.

  In addition, as an image to be displayed on the translucent surface, it is possible to display using the detected image information detected based on the imaging signal captured by the imaging unit, and by using the detected image information Further, it is possible to give a visual effect such as displaying a shadow object corresponding to an object placed on a translucent surface.

  In addition, by providing radiation means that radiates light or electromagnetic waves to be imaged by the imaging means steadily to the translucent surface, a medium (for example, infrared light, microwaves, etc.) imaged by the imaging means is stabilized. Therefore, high reliability can be obtained regardless of the installation environment of the system including the information processing apparatus.

  Moreover, a semi-transparent surface can be comprised only by combining the material which forms transparent surfaces, such as glass, for example, and the material which forms semi-transparent surfaces, such as a certain semi-transparent film | membrane, and can be cheaply processed. Moreover, the possibility of the enlargement mentioned above is not disturbed.

  Furthermore, the translucent surface can be made into a wall surface, a curved surface shape, or can correspond to various forms such as functioning as a table surface, and accordingly, the range of applications to which the information processing apparatus of the present invention is applied is expanded. Will be.

  Further, by providing a pointing device that radiates light or electromagnetic waves in a predetermined wavelength band to be imaged by the imaging means, in the basic configuration of the present invention, light in a predetermined wavelength band to be imaged by the imaging means or It is configured based on the fact that it can be an operating body as long as it can give some change to electromagnetic waves. By using a specific pointing device, the user can move from a position relatively away from the translucent surface. Accurate operation information can be given.

  In addition, image information for detection can be obtained with different magnifications, and when the user identifies the position pointed to the translucent surface, the pointed area is enlarged and captured by another imaging means. If the detected image information is obtained, the pointed position (coordinates) can be detected with higher accuracy.

  As described above, the present invention provides various degrees of use by providing a degree of freedom as described above when inputting information such as operations and providing an enlarged operation panel that can also be used as a display panel. The possibility of adopting the form is given, and the effect that the interactive input / output environment can be easily strengthened and expanded can be obtained.

Hereinafter, an information processing apparatus according to an embodiment of the present invention will be described. The following description will be given in the following order.
<1. First Embodiment>
<2. Second Embodiment>
<3. Third Embodiment>
<4. Fourth Embodiment>
<5. Fifth embodiment>
<6. Sixth Embodiment>
<7. Seventh Embodiment>
<8. Eighth Embodiment>

<1. First Embodiment>
First, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 conceptually shows a configuration example of an interactive display system including an information input device as a first embodiment of the present invention.
An interactive display system 1 according to the present embodiment includes a translucent surface 2, an infrared light emitting diode (LED) panel 3, a CCD (Charge Coupled Device) camera 4, a projector 5, and a control device 6. Composed. The infrared LED panel 3, the CCD camera 4, and the projector 5 are provided on the back side of the translucent surface 2.

The translucent surface 2 is formed by, for example, attaching a translucent film that looks like a tracing paper to a transparent glass plate, or using a translucent material such as polished glass. It is formed and has the functions of both the operation panel and the display panel in the interactive display system 1 as described later.
The infrared LED panel 3 is configured by, for example, a large number of infrared LEDs collectively arranged on the panel surface, and the infrared light emitted from the infrared LED is irradiated to the entire back surface of the translucent surface. Provided. The infrared LED is driven by the control device 6 so as to constantly emit infrared light.
The infrared LED panel 3 may be provided with a sufficient number of infrared LEDs so that the emitted infrared light is emitted to the entire translucent surface 2. As will be described later, since the image information reflected from the semitransparent surface 2 side is obtained based on the difference between the current infrared image and the initial infrared image, the entire translucent surface 2 is obtained. It is not necessary that the amount of infrared light to be irradiated should be uniform. Therefore, the size of the infrared LED panel 3 can be much smaller than that of the translucent surface 2.

  The CCD camera 4 is a camera device using a CCD as an image sensor. In this case, only the infrared light component is imaged as image light reflected on the translucent surface 2, so It is provided for recognizing a broken operation as image information. For this reason, an infrared transmission filter 4 a that transmits only the wavelength band of the infrared region is provided for the optical system portion of the CCD camera 4. Further, the arrangement position is set so that the entire translucent surface 2 is included as a composition photographed by the CCD camera 4.

  The projector 5 projects and displays image light based on visible light on the back surface of the translucent surface 2 based on image information supplied from the control device 6. For example, the user can observe the image of the projector 5 projected and displayed on the translucent surface 2 from the front side of the translucent surface 2. Here, the optical system of the projector 5 is provided with an infrared blocking filter 5a that blocks the wavelength in the infrared region. However, the image light projected and displayed on the translucent surface 2 does not include infrared rays. The projection image of the projector 5 becomes invisible from the CCD camera 4.

The control device 6 includes, for example, a microcomputer, obtains image information (video data) from the imaging signal supplied from the CCD camera 4, and obtains operation information based on this image information. Based on this operation information, for example, display control relating to an image displayed on the semi-transparent surface 2 by the projector 5 is executed, and various necessary control processes are performed. Further, the infrared LED of the infrared LED panel 3 is driven to emit light.
It should be noted that the arrangement positions of the infrared LED panel 3, the CCD camera 4, and the projector 5 may be set in consideration that the roles to be played by each function sufficiently.

  FIG. 2 is a block diagram showing an example of the internal configuration of the control device 6. In the control device 6 shown in this figure, the LED drive unit 10 is a circuit part for driving the plurality of infrared LEDs provided in the infrared LED panel 3 to emit light.

  The image input unit 11 generates a video signal by performing required signal processing on the imaging signal supplied from the CCD camera 4 and supplies the video signal to the input image processing unit 12. That is, the image input unit 11 outputs infrared light incident from the translucent surface 2 side via the CCD camera 4 as video information.

  For example, the input image processing unit 12 converts the video signal supplied from the image input unit 11 into video signal data based on a digital signal. The input image processing unit 12 executes necessary analysis processing using “image information (for example, video data in units of frames)” obtained based on the video signal data, so that the translucent surface 2 is processed. The operation information performed is obtained. Here, as the operation information obtained based on the image information, for example, the position (coordinates) on the image of the operating body that is operating the translucent surface 2, the signal level of the image, and the like are used. This operation information is transmitted to the database drive unit 14. The video signal data can also be supplied to the image composition unit 17.

  The threshold control unit 13 sets a threshold necessary for processing related to operation information executed by the input image processing unit 12 and transmits the threshold to the input image processing unit 12. The input image processing unit 12 obtains operation information by executing necessary processing such as analysis of image information using the threshold set in the threshold control unit 13. Further, in the present embodiment, the current image state (detected image information) of the translucent surface 2 is obtained by calculating the frame difference of the input image data as will be described later. Information such as a reference value (reference image input level) to be used is also stored in the threshold control unit 13 as described later.

  The database driving unit 14 takes in the operation information obtained by the input image processing unit 12 and appropriately executes necessary processing based on the operation information. At this time, program data necessary for control processing to be executed by the database driving unit 14 is stored in the database memory 15, and the database driving unit 14 performs necessary control processing based on the program data stored in the database memory 15. Will be executed.

The image generation unit 16 generates necessary image data (video signal data based on a digital signal) under the control of the database driving unit 14 and outputs the generated image data to the image synthesis unit 17.
In the image synthesis unit 17, if necessary, the video signal data supplied from the input image processing unit 12 is synthesized with the video signal data supplied from the image generation unit 16 to the RGB signal generation unit 18. Output.
In the RGB signal generation unit 18, the video signal data supplied from the image synthesis unit 17 is converted into, for example, an analog RGB signal and output to the projector 5. As a result, the projector 5 emits and outputs image light based on an image in response to an operation performed on the translucent surface 2 to the translucent surface 2.

Next, a method for detecting operation information in the interactive display system 1 of the present embodiment having the above-described configuration will be described.
As described above, the entire translucent surface 2 shown in FIG. 1 is irradiated with infrared light from the rear surface thereof by the infrared LED panel 3, and the translucent surface 2 is translucent. For this reason, not all infrared light passes through the translucent surface 2, but some infrared light is reflected by the action of the translucent surface 2.
In the present embodiment, infrared light reflected by the semitransparent surface 2 is imaged by the CCD camera 4 under the condition that no operation is performed on the translucent surface 2. The initial level of the video signal data obtained in this way is stored as the “reference input image level”. The reference input image level may be determined by detecting the signal level for each pixel in one frame based on the input video signal data. This detection process is performed by the input image processing unit 12. The information on the reference input image level detected in this way is transmitted to the threshold detection unit 13 and held there.

The reference input image level detection process is, for example, as shown in the flowchart of FIG. As shown in this figure, first, in the input image processing unit 12, in step S101, based on the image data for one frame obtained from the video signal supplied from the CCD camera 4 through the image input unit 11, the above-described image data is input. In this way, the signal level is detected for each pixel, and the detection result is obtained as the reference input image level Lint. Specifically, it is conceivable that the level of the luminance signal component for each pixel is detected and used as the reference input image level Lint.
In the subsequent step S102, the input image processing unit 12 performs processing so as to transmit the reference input image level Lint to the threshold value control unit 13 for storage.

  Note that the processing (the processing operation shown in FIG. 3) for detecting the reference input image level Lint and storing it in the threshold control unit 13 is executed, for example, when the interactive display system is turned on, or for some user It is conceivable that the reference input image level Lint is updated when necessary by the instruction.

Image information treated as operation information is obtained in the following manner while the information of the reference input image level Lint is held as described above.
FIG. 4 is a flowchart showing the processing operation of the input image processing unit 12 for obtaining image information (hereinafter referred to as “detected image information” in particular). In this case, the input image processing unit 12 first executes a process of detecting the current input image level Lprs in step S201. The input image level Lprs here is data in units of frames for the image of the translucent surface 2 based on infrared light currently captured by the CCD camera 4, and the signal level for each pixel in the image data in units of frames. This is information obtained by detecting.
Subsequently, in step S202, the input image processing unit 12 calculates a difference input image level L by calculating a difference between the reference input image level Lint and the current input image level Lprs (L = Lprs−Lint). Specifically, the difference input image level L is obtained by obtaining a difference between the reference input image level Lint and the data value obtained as the input image level Lprs for each pixel at the same position. Therefore, as the difference input image level L, a signal level difference between the current input image level Lprs and the reference input image level Lint is always obtained for each pixel. Then, the input image processing unit 12 proceeds to step S203 so as to generate current detected image information (video data having a level information for each pixel in units of frames) based on the difference input image level L. Is done.

The detection operation of the detected image information as described above will be described together with the movement of the actual user on the front side of the translucent surface 2. For example, the user performs an operation on the front side of the translucent surface 2 using some object that can reflect infrared rays on the front side of the translucent surface 2. The user's own fingers and body are used.
Here, for example, as shown in FIG. 1, when the user is far away from the semi-transparent surface 2 on the front side of the semi-transparent surface 2, for example, the user passes through the semi-transparent surface 2 and is reflected on the user's body. Since the amount of infrared light is small, most of the light does not return from the front surface of the translucent surface 2 through the back surface. At this time, the above-described reference input image level Lint and the current input image level Lprs are equivalent, and the input image processing unit 12 detects that the difference input image level L is substantially zero. That is, as the detected image information generated based on the difference input image level L, a state in which there is no change similar to the initial state is obtained.

For example, if the user gradually approaches the translucent surface 2 from the above state, the infrared light that passes through the translucent surface 2 and reflects on the user's body passes through the translucent surface 2. As a result, the amount of light reaching the back side gradually increases. When this state is viewed from the input image processing unit 12, it can be regarded as a state in which the current input image level Lprs gradually increases with respect to the reference input image level Lint of the image portion corresponding to the user's body. Accordingly, as the detected image information, the appearance of the user approaching the translucent surface 2 is gradually captured according to the calculated difference input image level L.
When the user's body is very close to the translucent surface 2 (for example, within 30 cm from the translucent surface 2 depending on the setting of the threshold), the infrared light reflected on the human body is almost semi-transparent. Since it passes through the transparent surface 2 and reaches the back side, detection image information with a clearer body shape is generated.

Here, it is assumed that the user places his / her body at a certain distance from the translucent surface 2 and puts his / her finger at a position very close to the translucent surface 2, for example.
In this case, since the user's finger close to the translucent surface 2 reflects more infrared light than other body parts, the image information obtained in the input image processing unit 12 is an image corresponding to the user's finger. The level of the region is strong, and the level of the image region at the position corresponding to the body part of the user in the background portion becomes weak according to the distance from the translucent surface 2. For example, in this state, if a predetermined threshold value set by the threshold value control unit 13 is compared with the detected image information, an image of only a portion corresponding to the user's finger is easily separated from the background. Similarly, depending on the setting of the threshold value, it is also possible to obtain image information obtained by extracting only the body part of the user at a distance away from the translucent surface 2. As described above, the threshold value control unit 13 sets such a threshold value according to the condition actually required.

In this way, by adopting a configuration for detecting the state of the front surface side of the translucent surface 2, the following advantages can be obtained when the translucent surface 2 functions as an operation panel for an interactive interface, for example. can get.
First, in the present embodiment, operation information is obtained based on an image obtained from the amount of reflected infrared light from the translucent surface 2 side. Therefore, a special pointing device is used as an operation body for performing the operation. Any object that does not need to be reflected and reflects infrared rays can be used. In other words, as described above, the entire human body or a part thereof, or some other object can be used without any problem as described above.

  Further, for example, in a touch panel or the like, an operation body such as a finger needs to be brought into contact with the operation panel surface. In the case of the present embodiment, the position and movement of the operation body may be detected as reflection of infrared light. Therefore, it is not necessary to bring the operating body into contact with the translucent surface 2, and a method of operating in the space in front of the operating body can be adopted.

  In addition, as described above, since the amount of reflected infrared light changes according to the distance of the operating body relative to the semi-transparent surface 2, for example, the distance from the semi-transparent surface 2 of the operating body may be used as the operation information. .

Further, as described above, the translucent surface 2 is constituted by simple means such as combining a translucent thin film such as tracing paper with a transparent glass plate or the like, or using something like polished glass. In particular, since a driving circuit unique to the panel is unnecessary, it is possible to easily realize an increase in size at a low cost. In this respect, it is greatly different from a touch panel that is difficult to increase in size.
Then, by obtaining operation information based on an image obtained by infrared reflected light from the semi-transparent surface 2 side, a plurality of operating bodies can be simultaneously recognized and necessary control can be executed if image recognition is possible. Is possible. That is, simultaneous operation with respect to a plurality of different operation objects is possible, and in particular, when the translucent surface 2 is configured as a large screen, different types of operations using various regions on the translucent surface 2 are possible. This is very effective because it can be performed simultaneously.

Since the translucent surface 2 also has a function as an image display panel, for example, a menu screen to be operated is displayed as will be described later, and then the user touches the menu screen with a finger or the like. It is also possible to easily realize a direct operation such as enabling the operation.
As described above, the interactive display system according to the present embodiment provides many possibilities for inputting the operation information, and thus it is easy to construct an interactive input / output environment that has never existed before. can do.

Next, usage examples of the interactive display system 1 according to the present embodiment having the above-described configuration will be described with reference to FIGS.
FIG. 5 shows a case where a menu operation is performed as a first usage example of the interactive display system 1 of the present embodiment. Here, a state where the translucent surface 2 is viewed from the front side is illustrated. .
For example, as shown in this figure, if the user approaches the front surface of the translucent surface 2, first, the control device 6 of the interactive display system 1 translucent the user has approached based on the detected image information obtained at this time. Recognize position on surface 2. Then, display control is performed so that the menu screen M is displayed as shown in the figure at the position on the semi-transparent surface 2 that the user has recognized as approaching. This menu screen M is naturally an image projected from the projector 5 onto the translucent surface 2. Then, under the state in which the menu screen M is displayed on the semitransparent surface 2 near the user himself / herself, for example, the user uses his / her finger to display the operation item on the menu screen M. Suppose you specify to point to an arbitrary area. At this time, the user's fingertip is set at a distance within a range of about 3 cm to 30 cm from the top of the translucent surface 2.

Thus, for example, on the menu screen M, some instruction display (for example, cursor placement display on the selected region or highlight display in a predetermined form) is performed indicating that the region of the operation item pointed to by the user has been selected. become. This display control for highlighting is realized by detecting the coordinates of the region pointed by the user's finger based on the detected image information.
Here, it is assumed that the enter operation is performed when a predetermined time (for example, about several seconds) has passed since the instruction display is started as described above. If the user performs an enter operation, that is, if a state in which a specific operation item is highlighted is maintained for a predetermined time or longer, a required control operation according to the specified operation item is executed. For example, according to the designated operation item, a menu screen of another hierarchy is displayed, or a desired operation is executed on the interactive display system 1. Alternatively, if the interactive display system 1 is configured to be able to control some external device, and the menu screen is for performing operation control on the operation of the external device, the external display system 1 can be controlled according to the designated operation item. It will control the operation of the equipment.
When the user moves away from the front surface of the translucent surface 2 and there is a certain distance between the user and the translucent surface 2, the menu screen M that has been displayed so far is automatically deleted. It is supposed to be.

  Here, the flowchart of FIG. 6 shows the processing operation of the control device 6 executed corresponding to the usage example shown in FIG. The processing operation shown in this figure is performed mainly by the input image processing unit 12 in the control device 6 recognizing the operation information based on the detected image information, and the database driving unit 14 in accordance with the program stored in the database memory 15. This is realized by appropriately performing the processing operation based on the information.

In the routine shown in this figure, first, in step S301, it is determined whether or not an “approaching object” is detected from the current detected image information. Here, the “approximate body” refers to some detection target (referred to as the user's own body in FIG. 5) that has approached the translucent surface 2 to a predetermined distance range.
This “approaching object” is detected by comparing, for example, the input image processing unit 12 with the detected image information and a threshold value (set by the threshold control unit 13) set for detecting the approaching object. If a value greater than or equal to this threshold is obtained in an area with detected image information, it is detected that there is an approaching object. Will be detected. The threshold for detecting the approaching body is usually set based on the image level of the human body part obtained as detected image information when the human body (user) approaches the translucent surface 2 to some extent (for example, several tens of centimeters). It only has to be done.

  If no approaching object is detected in step S301, the process proceeds to step S308, where it is determined whether or not the menu screen M is currently displayed. Here, the menu screen M is not displayed. In this case, the process returns to the original routine (i.e., shifts to the process of step S301 again). However, if the menu screen M is being displayed, the process proceeds to step S309, and the control process for deleting the menu screen M is performed. Execute. The menu screen M erasing process is realized, for example, when the database driving unit 14 stops the image data generating process of the menu screen M for the image generating unit 16.

  On the other hand, when an approaching body is detected in step S301, the process proceeds to step S302, and the position of the approaching body on the translucent surface 2 is detected. This processing can be performed, for example, by detecting the coordinates of the area occupied by the approaching body portion in the detected image information. In this case, the coordinates to be detected may be a predetermined point in the area of the approaching body or a plurality of points obtained according to a predetermined rule, and can be arbitrarily set according to the actual use environment or the like. Good.

In the subsequent step S303, control for displaying the menu screen M on the region of the translucent surface 2 corresponding to the position of the approaching body detected in step S302 is executed. In this control processing, for example, the database drive unit 14 is controlled based on a program for menu screen display stored in the database memory 15 so that image data of a required type of menu screen is created in the image generation unit 16. Will do.
At this time, the database drive unit 14 creates display image data, for example, by mapping the image data of the menu screen to the display area corresponding to the position of the approaching body detected in step S302. As a result, as an image finally projected from the projector 5, the menu screen M is displayed at a position on the translucent surface 2 where the user approaches.

After the process of step S303 is executed, in step S304, it is determined whether or not an “operation tool” has been detected in the display area that is the operation item of the currently displayed menu screen M. Here, the “operation body” refers to an object (detection target) at a close distance (approximately 3 cm to 30 cm depending on the setting of the threshold) on the front surface of the translucent surface 2. That is, in FIG. 5, the finger pointing to the menu screen M is a target.
Then, in the detection process of the “operation object”, first, the threshold value set in the threshold value control unit 13 for detecting the operation object is compared with the image level of the detected image information, so that the operation object is detected. The presence or absence is detected. The threshold value set at this time is set to a value larger than the threshold value for detecting the approaching object described above in order to detect an object at a close distance on the front surface of the translucent surface 2 separately from the background. Is done.
For example, if an operating tool is detected as a result of comparison with a threshold value, the coordinate position on the detected image information from which the operating tool is detected is detected, and the detected position and the menu screen M are displayed. By determining whether or not the positions on the image information are the same, the presence or absence of the operating body in the display area of the currently displayed menu screen is detected.

  The case where the operating tool is not detected in the display area which is the operation item of the menu screen M in the above step S304 means that the operating tool is not detected on the detected image information (the user moves on the translucent surface 2 at a close distance). Even if an operating tool is detected on the detected image information, the detected position (coordinates) of the operating tool is displayed in an area on the image information corresponding to the display area of the menu screen M. There is no state (a state in which the user is pointing to the semi-transparent surface 2 at a close distance is an area other than the operation item on the menu screen M). In such a case, the process returns to step S301. To be done.

  When the operating body is specified as a human hand or finger, for example, as the operating body detection process in step S304, for example, the shape of the human hand or finger appearing during operation on the database memory 15 The information on the shape of the hand or finger and the image shape obtained as the detected image information are compared, and the presence or absence of detection of the operating body is identified by checking the matching state. Is possible. In the present invention, in order to detect input information from image information, it can be recognized as operation information based on the shape of the image obtained in the detected image information.

  If it is determined in step S304 that the operating tool has been detected within the display area that is the operation item of the menu screen M, the process proceeds to step S305, and the operation of the menu screen M corresponding to the position where the operating tool is detected. Control is performed so that instructions are displayed for the item, and the process proceeds to step S306.

The process in step S306 is an enter operation standby process. As described above, the enter operation here is defined to be determined when a predetermined time elapses from the state in which the instruction display is started. Therefore, in step S306, detection is made as to whether or not the detection state of the operating tool detected in step S304 is maintained for a predetermined time or more. This detection process is performed by monitoring the state transition of the current detected image in the input image processing unit 12.
Then, for example, the operating tool is no longer detected from the current detected image information, or the detection position of the operating tool on the current detected image information is displayed as the operation item of the menu screen M detected in step S304. If it is detected that the region has fallen out, the process returns from step S306 to step S301. (By this process, for example, when the designated position is changed so that the user points to a different operation item on the menu screen M, the operation item on the newly designated menu screen M is changed. Instruction display will be performed.)

On the other hand, if it is determined in step S306 that the detection state of the operating tool detected in the immediately preceding step S304 has been maintained for a predetermined time or longer, the process proceeds to step S307 assuming that the enter operation has been performed.
In step S307, a required control process corresponding to the operation item at the position where the operating tool is detected on the menu screen M is executed. This process is executed by the database drive unit 14 according to a program stored in the database memory 15.

FIG. 7 shows a second usage example of the interactive display system 1 of the present embodiment. In this case, a world map is displayed on the translucent surface 2 as an image projected from the projector 5 under the control of the control unit 6.
For example, when the world map is displayed, it may be displayed by operating the menu screen M as shown in FIG. 5, for example, or the user (explainer) approaches the translucent surface 2 to some extent. It is also conceivable that when this is detected as an “approaching object”, it is automatically displayed. Also, as a display form at this time, the reference country or region (for example, Japan) is always located near the presenter corresponding to the horizontal position where the presenter stands on the front surface of the translucent surface 2. It is possible to be displayed on the screen.
In this case, an explanation image DT that explains something about the designated area is imposed on the map at the position indicated by the explainer on the map (semi-transparent surface 2). Is displayed. In this case, the control device 6 detects the position (coordinates) pointed to by the presenter with a finger or the like as the operating tool, and displays the explanation image DT of the region that is supposed to match the detected position of the operating tool. Will be controlled. In this case, the image data as the map and various explanation images DT are stored in the database memory 15.
As described above, the interactive display system 1 of the present embodiment can easily increase the size of the translucent surface 2 that is a display screen (and an operation panel). A meeting or demonstration using the surface 2 is sufficiently conceivable as the interactive display system 1 of the present embodiment as its application.

Next, FIG. 8 shows a third usage example of the interactive display system 1 of the present embodiment. Here, two menu screens M1 and M2 are displayed at the same time, and a state in which the user operates the menu screens M1 and M2 at the same time is shown.
As described above, in this embodiment, operation information is obtained from “detected image information” obtained based on infrared light imaged by the CCD camera 4. That is, operation information is obtained by recognizing the image state. Therefore, for example, as shown in FIG. 8, even when a plurality of operation objects (here, a user's hand or finger) are detected simultaneously on the detected image information, the detection results for the respective operation objects are different from each other. Can be processed as
Therefore, even if the user performs a simultaneous operation using both hands on the menu screens M1 and M2 after displaying a plurality of (here, two) menu screens M1 and M2 as shown in FIG. In the present embodiment, it is possible to perform a required operation in response to an operation performed on the menu screens M1 and M2. In particular, since the interactive display system 1 according to the present embodiment can easily increase the size of the translucent surface 2, if a plurality of images to be operated are displayed at the same time, a larger display panel (operation panel) can be obtained. ) Can be used effectively.

FIG. 9 shows a fourth usage example of the interactive display system 1 of the present embodiment. In this figure, parameter adjustment images PC1 and PC2 for adjusting some predetermined parameter value are displayed on the translucent surface 2, and the user uses both hands for the parameter adjustment images PC1 and PC2. The case where simultaneous operation is performed is shown. The parameter adjustment images PC1 and PC2 are displayed in a form simulating a slide volume, for example.
In this case, for example, the user places his / her hands on the front portions of the parameter adjustment images PC1 and PC2 where the lever portions (lever images LV and LV) are displayed, and puts the hands so that a desired parameter value can be obtained. The operation is performed by moving it so as to slide up and down. In this case, the lever images LV and LV are displayed so as to move up and down according to the movement of the hand, and the process in the control device 6 is appropriately executed so that the actual parameter value is also variably controlled according to this. Will be. At this time, even if the lever images LV and LV are operated at the same time, as in the case of FIG. 8, the operation information is recognized at the same time and the parameter value is changed at the same time according to each operation. Is.

FIG. 10 shows a fifth usage example of the interactive display system 1 of the present embodiment. This figure shows a state in which an adult and a child are operating different menu screens simultaneously.
For example, as a usage situation in this case, when it is normal for the user to perform an operation on the semi-transparent surface 2 in a standing state, in adults and children, on the detected image information as described in FIG. The occupancy rate of the approaching body and its position state, and the position (height) in the vertical direction appearing on the semi-transparent surface as the operating body are different. In other words, due to the height difference between the adult and the child, the child closer to the adult as an approaching body will appear in the lower region on the detected image, and similarly the operation body (position pointed by the user with a finger or the like) A child tends to appear in a lower region in the detected image information than an adult.

  Therefore, in this fifth usage example, for example, when the application is to perform different types of operations for adults and children, the height direction (vertical direction) on the detected image information When a predetermined threshold value is set and an approaching body or operation body having a height exceeding the predetermined threshold value is detected, a position corresponding to the approaching body on the translucent surface 2 (in this case) If the height of the display on the semi-transparent surface 2 is also changed), an adult menu screen Mad is displayed, and if an approaching body or operating body whose height does not exceed the threshold is detected, The child menu screen Mch is displayed at a position (and height) corresponding to the approaching body on the translucent surface 2. As the threshold value, different appropriate values may be set for the approaching body and the operating body, or different values may be set as the threshold values in the height direction for identifying adults and children. It doesn't matter. Also in the fifth usage example, when an operation is simultaneously performed on the adult menu screen Mad and the child menu screen Mch, the control operation that recognizes the operation information at the same time and responds to the operation information simultaneously. Is the same as the case of FIG. 8 and FIG.

  In addition, regarding the second to fifth usage examples shown in FIGS. 7 to 10, the description of the processing operation of the control device 6 by the flowchart is omitted, but in any usage example, the “approach” or “operation” The presence or absence of the body and its position (coordinates) are detected, and the required control operation is executed by identifying the positional relationship between the detection result and some operation target image displayed on the translucent surface 2. 5 is the same as the case of the first usage example in FIG. 5, and the processing operation in each usage example can be realized according to the flowchart shown in FIG.

<2. Second Embodiment>
FIG. 11 is a diagram showing an interactive display system according to the second embodiment of the present invention. The same parts as those in FIG. The internal configuration of the control device 6 may be the same as that shown in FIG.
In the second embodiment, as shown in FIG. 11, an infrared transmitter PD that emits infrared light is used as a pointing device.

  As described above, in this embodiment, the operation information is obtained from the detected image information obtained from the infrared light from the translucent surface 2 imaged by the CCD camera 4. In other words, in the present embodiment, as long as the amount of infrared light incident on the CCD camera 4 from the translucent surface 2 is changed, this can be recognized as operation information.

For example, in the previous first embodiment, instead of using a finger or the like to point to a desired position on the translucent surface 2, in the second embodiment, the user moves the infrared transmitter PD. The infrared light emitted from the infrared transmitter PD is irradiated to the front side of the semitransparent surface 2 with a hand in a desired position on the translucent surface 2.
When the infrared light from the infrared transmitter PD is irradiated onto the translucent surface 2 in this way, the level of the position (coordinates) corresponding to the irradiated portion of the infrared light is the surrounding as the detected image information detected at this time. Will change. Therefore, the input image processing unit 12 of the control device 6 may perform processing so as to recognize the level change of the detected image information as operation information.
Since the infrared light is invisible, for example, the spot SP is displayed on the semi-transparent surface 2 so that the current irradiation position of the infrared light from the infrared transmitter PD on the semi-transparent surface 2 can be known. It is preferable. In this spot display, the input image processing unit 12 of the control device 6 identifies the position (coordinates) where the infrared light is currently irradiated based on the detected image information, and the projector 5 performs the identified irradiation position. This can be realized by executing display control so that the spot SP is displayed.

<3. Third Embodiment>
FIGS. 12 and 13 are block diagrams showing the overall configuration of the interactive display system 1B as the third embodiment of the present invention and the internal configuration of the control device 6, respectively. The same parts as those in FIGS. The same reference numerals are given and the description is omitted.

  As shown in FIGS. 12 and 13, the interactive display system 1B of the present embodiment is provided with two CCD cameras, a first CCD camera 4A and a second CCD camera 4B. The first CCD camera 4A is assumed to have the same role as the CCD camera 4 in the previous embodiment. That is, it is provided on the back side of the semi-transparent surface 2 in order to capture infrared light incident from the entire semi-transparent surface 2 as an imaging range.

The second CCD camera 4B is provided for enlarging and reducing a required partial area on the translucent surface 2 as will be described later. Therefore, the second CCD camera 4B is provided with a pan / tilt / zoom mechanism 7 as shown in the figure. The pan / tilt / zoom mechanism 7 includes a mechanism (pan / tilt mechanism) capable of rotating the second CCD camera 4B in both the horizontal direction and the vertical direction, and is provided in the second CCD camera. A mechanism (zoom mechanism) is provided that varies the magnification of the captured image by moving the zoom lens. The control for the pan / tilt / zoom mechanism 7, that is, the variable control of the pan / tilt position and the variable control of the zoom ratio are performed by the database drive unit 14 as shown in FIG. Therefore, the database memory stores a program for controlling the pan / tilt / zoom mechanism 7 as necessary.
Note that the optical system of each of the CCD cameras 4A and 4B is provided with an infrared transmission filter 4a so that an image on the translucent surface 2 is captured only by infrared light.

  In this case, in the control device 6, as shown in FIG. 13, two image input units 11A and 11B are provided corresponding to the provision of the two CCD cameras of the first CCD camera 4A and the second CCD camera 4B. Will be. The image input unit 11A inputs the imaging signal of the first CCD camera 4A and supplies it as a video signal to the input image processing unit 12, and the image input unit 11B inputs the imaging signal of the second CCD camera 4B and inputs the video signal. To the input image processing unit 12. Therefore, the input image processing unit 12 of the present embodiment generates detection image information obtained based on the video signal of the first CCD camera 4A and detection image information obtained based on the video signal of the second CCD camera 4B. Necessary operation information is obtained from both pieces of detected image information.

The interactive display system 1B as the present embodiment can be used as follows, for example.
For example, it is assumed that the user performs a designation operation with a finger on a certain position of the translucent plate 2 in a state where the user is positioned in front of the translucent plate 2 as shown in FIG. In this case, the detected image information captured by the first CCD camera 4A that captures the entire translucent plate 2 and obtained in the input image processing unit is, for example, as shown in FIG. When performing the above operation, the user's finger (hand) is usually closest to the translucent surface 2 and the remaining body part is more distant from the translucent surface 2 than the hand portion. There will be.
Therefore, in the detected image information shown in FIG. 14A, the image area B where the hand part is displayed has a higher value (for example, luminance) than the image area A where the body part is displayed. Level). Here, by appropriately setting the threshold value in the threshold control unit 13, the input image processing unit 12 separates the portion of the image region B from the background including the portion of the image region A as the “operation tool”. As described above, it can be identified. As described above, when the operating body is limited to a human hand or finger, the user's labor obtained as detected image information is recognized as an operating body based on the finger shape. It is also possible to do.

  Here, if the input image processing unit 12 detects the portion of the image area B as an “operation object” as described above, the database drive unit 14 is based on the position information of the operation object on the translucent surface 2. Thus, control is executed so that the second CCD camera 4B zooms in on the operation tool, that is, the image area B. That is, on the basis of the position information of the image area B on the translucent surface 2, the pan / tilt / zoom mechanism 7 is arranged so that the image area B is approximately at the center of the image captured by the second CCD camera 4B. Then, the pan / tilt control is executed on the pan / tilt / zoom mechanism 7 so that the portion of the image area B occupies almost the entire captured image. By such control, as the detected image information obtained based on the imaging signal of the second CCD camera 4B, image information in which the portion of the image region B (operation body) is enlarged as shown in FIG. 14B is obtained. be able to.

  For example, when obtaining the operation information based on the detected image information shown in FIG. 14B, particularly when detecting the designated position as the operation information, for example, based on the detected image information shown in FIG. The relative resolution will be higher than when the designated position information is obtained. Therefore, it is possible to obtain designated position information with higher accuracy.

  Note that the above-described usage method is merely an example, and various other application examples using two CCD cameras are conceivable. Further, the pan / tilt / zoom mechanism 7 may be provided for two CCD cameras, or more than two CCD cameras (which CCD camera is provided with the pan / tilt / zoom mechanism at this time). Even if the operation information is obtained independently from each of these CCD cameras by using (optional), various application examples can be considered.

<4. Fourth Embodiment>
FIG. 15 is a diagram conceptually showing a configuration example of an interactive display system 1C as a fourth embodiment of the present invention. For example, the same parts as those in FIG. The internal configuration of the control device 6 may be the same as that shown in FIG.
Each interactive display system described so far in the embodiment has been described assuming that the translucent surface 2 is a so-called wall surface. However, the functions (display panel function and operation) of the translucent surface 2 according to the present invention are described. In consideration of the panel function), the present invention is not limited to this. Therefore, in the interactive display system 1C of the fourth embodiment, the translucent surface 2A is formed in a curved surface shape. FIG. 15 shows a state in which a semitransparent surface 2A having a hemispherical shape is installed. For example, at least the infrared LED panel 3 is disposed on the inner wall side of the semitransparent surface 2A. A CCD camera 4 and a projector 5 are provided. The user operates from the outer wall side of the translucent surface 2A. In this figure, the illustration of the infrared transmission filter 4a provided for the CCD camera 4 and the infrared cutoff filter 5a provided for the projector 5 are omitted, but in practice, the implementations so far are omitted. It is assumed that it is provided similarly to the form.
In this figure, a state in which a world map is projected and displayed on the semi-transparent surface 2A is shown. For example, in this case, as described in FIG. 7 in the first embodiment. It can be considered to be used in this way.

<5. Fifth embodiment>
FIG. 16 is a diagram conceptually showing a construction example of an interactive display system 1D as the fifth embodiment of the present invention. The same parts as those in FIG. Also in this figure, the infrared transmission filter 4a and the infrared blocking filter 5a are not shown, but actually, they are provided for the CCD camera 4 and the projector 5, respectively. Although illustration of the control device 6 is omitted here, it is actually provided to realize control of the infrared LED panel 3, the CCD camera 4, and the projector 5, and its internal configuration. May be the same as in FIG.

In this case, for example, the wall surface of the passage is configured as a translucent surface 2, and for example, the infrared LED panel 3, the CCD camera 4, and the projector 5 are provided behind the passage wall surface (semitransparent surface 2). . That is, the interactive display system 1D of the present embodiment is configured as a part of the wall surface of the passage.
Here, for example, it is assumed that the user (pedestrian) is walking along the passage and passes by the side of the translucent surface 2 (wall surface) of the interactive display system 1D.
As described above, in the present invention, even if the user is at a distance from the translucent surface 2 functioning as the operation panel to some extent, it can be detected as an “approach”. Therefore, in this case, when the pedestrian comes to the side of the translucent surface 2 (wall surface) of the interactive display system 1D, the appearance is detected as an approaching body. Based on the detection result of the approaching body, for example, as shown in FIG. 16, the projector 5 can be operated to project and display a guide image GD that presents a destination or the like on the translucent surface 2 that is a wall surface. .
When such an interactive display system 1D is viewed from a pedestrian, the destination guidance display is automatically performed on the wall surface when the person walks along the passage.

  In the fifth embodiment described above, for example, in the situation where the installation space for the infrared LED panel 3, the CCD camera 4, the projector 5 (and the control device 6), etc. is limited on the back side of the wall surface of the passage. As shown in FIG. 17, it is conceivable to change the optical path by reflecting the light emitted from the infrared LED panel 3 and the projector 5 and the light incident from the CCD camera 4 using a mirror MR. In particular, depending on the angle of view of the CCD camera 4 and the projector 5, a considerable distance is required to obtain an imaging range and a projection display range that can cover the translucent surface 2 having a large screen. Thus, if the mirror MR is provided, a sufficient imaging range and projection display range can be obtained even at a narrow depth, and the conditions required for the interactive display system 1D of the present embodiment as an installation environment are eased. Can be made.

<6. Sixth Embodiment>
FIG. 18 is a diagram conceptually showing a configuration example of an interactive display system 1E as a sixth embodiment of the present invention. The same parts as those in FIG. In this figure, the infrared transmission filter 4a and the infrared blocking filter 5a are not shown, but are actually provided for the CCD camera 4 and the projector 5.

In this case, the translucent surface 2B is installed as a table. That is, when it is instructed by the four table legs F, F, F, F, it also functions as a table top as a normal furniture. In this case, the infrared LED panel 3, the CCD camera 4, and the projector 5 (and the control device 6) are provided on the lower surface side of the translucent surface 2B as shown in the figure.
In the present embodiment, the user can perform operation control on the monitor device 30 by operating the semi-transparent surface 2B as described later.

FIG. 19 is a block diagram showing the internal configuration of the control device 6 as the interactive display system 1E of the present embodiment. The same parts as those in FIG.
In the control device 6 shown in this figure, an external device control unit 20 is provided. In this case, the external device control unit 20 is a circuit part for performing operation control on the monitor device 30, and performs necessary operation control on the television receiver 30 according to operation information given from the database driving unit 14. A command signal for transmission is output. Therefore, the database memory 14 in this case stores a program for realizing an operation on the television receiver 30 by the interactive display system 1E.

In the interactive display system 1E as the sixth embodiment, for example, as shown in FIG. 18, a remote control (hereinafter abbreviated as “remote control”) display RMD is displayed in a specific area of the translucent surface 2B. This remote control display RMD is displayed in a form simulating an operation panel surface of a remote controller provided with keys capable of various operations on the television receiver 30. The display control of the remote control display RMD is controlled by the database drive unit 14 using the image data of the remote control display RMD stored in the database memory 14 so that the video of the remote control display RMD is displayed on the projector. This is realized by projecting and displaying with 5.
The display position of the remote control display RMD may be arbitrarily set. For example, by a predetermined setting operation on the interactive display system 1E, the display position can be arbitrarily set to be displayed at a position that is easy for the user to use. It is also possible to do. At this time, as long as the database drive unit 14 recognizes the current display position of the remote control display RMD, the position (coordinates) of the display portions of the various keys of the remote control display RMD can always be grasped by the database drive unit 14. Is possible.

  For example, as a user operation on the remote control display RMD displayed on the translucent surface 2B, it is assumed here that a desired channel is selected by operating a numeric key. At this time, for example, the user may perform an operation on the translucent surface 2B with an image of pressing a desired one of the numeric keys in the remote control display RMD on the translucent surface 2B. In this case, although depending on the setting of a threshold value for determining the key operation in the threshold value control unit 13, the user does not necessarily need to touch an operating body such as a finger on the table surface (semi-transparent surface 2B). Of course, it is possible to make it possible to discriminate as a key operation only by performing an operation on the hollow of a portion where a desired key is displayed.

The operation position (coordinates) of the above-described user operation is detected by the input image processing unit 12 based on detected image information obtained by being imaged by the CCD camera 4. Then, the database drive unit 14 identifies which key portion coordinates displayed as the remote control display RMD match the detected operation position coordinates, for example, the key matching the operation position coordinates. Is transmitted to the external device control unit 20.
The external device control unit 20 outputs a command signal corresponding to the key type to the monitor device 30 based on the information indicating the key type input from the database driving unit 14.
In this case, since it is a channel switching operation using a certain number key, for example, the database drive unit 14 transmits information that the number key using the number corresponding to the channel number has been operated. Then, the external device control unit 20 transmits a command signal for switching to the channel number indicated by the designated numeric key. As a result, the television receiver 30 operates so as to switch to the screen of the channel operated by the user.

  As a matter of course, the external device that can be operated by the interactive display system 1E is not limited to the television receiver, and may be configured to be able to operate other various electronic devices. Further, according to the present invention, it is possible to display a remote control display RMD corresponding to a plurality of types of devices at the same time so that the user can perform an operation, and one remote control display RMD is also possible. It is also possible to control external devices by recognizing simultaneous operations on a plurality of keys.

Further, when the translucent surface 2B is a table surface as in the present embodiment, the following operation can also be performed.
For example, when a tableware or some other object is placed on the translucent surface 2B as the table surface, the object placed on the translucent surface 2B reflects infrared light, so that an image of the shape of the installation object is obtained. It is obtained as detected image information. In the embodiment described so far, such an image change has been handled as operation information. In this case, the image data as the detected image information may be used as an image to be projected and displayed by the projector 5. it can. Thus, for example, as shown as a shadow display SHD in FIG. 18, it is conceivable that an image of an object placed on the translucent surface 2B can be displayed like the shadow. In this case, the position of the shadow display SHD on the semi-transparent surface 2B changes according to the position where the object is placed, or the shape of the shadow display SHD according to the distance change from the surface of the semi-transparent surface 2B. Etc. will change, so that an interesting visual effect will be obtained for the user.

In order to realize the shadow display SHD as described above, for example, detected image information obtained in the input image processing unit 12 of the control device 6 may be supplied to the image composition unit 17 as image data. As a result, the image composition unit 17 synthesizes the image data (shadow display SHD image data) as the detected image information and the remote control display RMD created by the image generation unit 16 under the control of the database drive unit 14. As a result, projection display on the semitransparent surface 2B as shown in FIG. 18 is finally performed.
Although detailed explanation is omitted here, the detected image information can be further visualized by applying special effects such as multi-coloring or changing the shape of the image by various signal processing on the image data. It can also be configured to enhance the effect.

  By the way, in the above-described sixth embodiment, at least the infrared LED panel 3, the CCD camera 4, and the projector 5 need to be arranged below the table. For example, from the floor to the table surface (semi-transparent surface 2B). Since the height (distance) cannot be so large, it may be difficult to obtain a linear distance necessary for the CCD camera 4 and the projector 5 to cover the entire translucent surface 2B. Therefore, as described in the previous fifth embodiment, similarly in this case, as shown in FIG. 20, a mirror MR for changing the optical path by reflection is disposed below the translucent surface 2B (table surface). The devices such as the infrared LED panel 3, the CCD camera 4, and the projector 5 can be arranged on the side of the table.

  Instead of the mirror MR, a half mirror MR in which predetermined light transmittance and reflectance are set may be used. When such a half mirror MR is used, for example, the infrared LED panel 3 can be installed on the floor surface of the lower part of the table without being arranged on the side of the table, and the degree of freedom of installation is accordingly increased. Becomes higher. Note that the installation method using the half mirror can be applied to, for example, the installation form as shown in FIG. 17 in the fifth embodiment.

<7. Seventh Embodiment>
FIG. 21 is a diagram showing a configuration example of an interactive display system 1F as a seventh embodiment of the present invention. The same parts as those in FIG.
In the interactive display system 1F, the infrared LED panel 3 is not provided.
For example, when the interactive display system according to the present invention is used in an environment with strong outside light such as outdoors, the infrared LED panel 3 as shown in FIG. In the configuration in which infrared light is used as a light source for detecting operation information, the intensity of the infrared light emitted from the infrared LED panel 3 is relatively weaker than the infrared light contained in natural light. There is a possibility that detection is not performed (that is, proper detected image information capable of recognizing operation information cannot be obtained).
In such a case, instead of omitting the infrared LED panel 3 as in the present embodiment, infrared light contained in natural light is used as a light source for detecting operation information.
In this case, the reference input image level Lint necessary for obtaining the detected image information is assumed that there is no detection target such as an approaching body and an operating body (no operation is performed on the translucent surface 2). In this state, detection is performed based on image information obtained from an imaging signal that is transmitted through the translucent surface 2 from the front surface side and captured by the CCD camera 4.

For example, if any operation is performed on the translucent surface 2, when the approaching body and the operating body on the translucent surface 2 at this time are viewed from the CCD camera 4 side, the approaching body and the operating body. Since the infrared light of natural light is blocked by the above, it can be seen as a shadow of the infrared light contained in the natural light. In the control device 6 according to the present embodiment, image information that changes such that the image level becomes lower (darker) with respect to the reference input image level Lint is handled as operation information.
In addition, although illustration of the internal structure of the control apparatus 6 of the interactive display system 1F is omitted, the LED driving unit 10 is not provided when the infrared LED panel 3 is omitted.

<8. Eighth Embodiment>
FIG. 22 is a conceptual diagram showing a configuration of an interactive display system 1G as an eighth embodiment of the present invention, and FIG. 23 is a block diagram showing a configuration of a control device 6 provided in the interactive display system 1G of the present embodiment. The same parts as those in FIGS. 1 and 2 are denoted by the same reference numerals, and description thereof is omitted.
As the interactive display system 1G, a microwave generator 40 is provided instead of the infrared LED panel 3 provided in the interactive display system of the various embodiments described above, and a microwave reception is provided instead of the CCD camera 4. A container 41 is provided.

Correspondingly, in the control device 6, a microwave drive circuit 110 for driving the microwave generator 40 is provided instead of the LED drive unit 10 (see FIG. 1). In addition, the reception microwave supplied from the microwave receiver 41 is input, converted into data of a predetermined format, for example, and output, and the reception of the microwave supplied from the image signal input unit 111. An input data processing unit 112 that obtains, for example, detected image information and obtains operation information based on the detected image information by inputting data and performing a required process is provided. The image signal input unit 111 and the input data processing unit 112 are functional circuit units that replace the image input unit 11 and the input image processing unit 12 (see FIG. 1), respectively. In this case, since microwaves are used as a medium for detecting operation information, the infrared transmission filter 4a provided in the CCD camera 4 and the infrared cutoff filter 5a provided in the projector 5 are not necessary.
Even if it is configured such that a medium such as a microwave having a property of reflecting an object irradiated with the object is used for detection of operation information as in the present embodiment, the embodiment described so far ( The information processing apparatus according to the present invention can be configured in the same manner as in the case of using infrared rays for detecting operation information.

In addition, although illustration and description of a specific application example are omitted, it is only necessary to detect operation information performed on the translucent surface 2 as the present invention. Of course, it is conceivable to construct the information processing apparatus according to the present invention by omitting the projector 5 shown. That is, the translucent surface 2 in this case functions only as an operation panel. When conforming to this configuration, for example, if display means for interactive response display is necessary, another type of display device other than the translucent surface 2 may be used.
Further, the application example of the interactive display system configured based on the present invention is not limited to the embodiment and application examples described so far, and an operation method utilizing the advantages of the input device as the present invention. There are various other possible applications of the application and application. Moreover, in the interactive display system as an embodiment of the present invention, interactive response may be performed by voice.

It is a conceptual diagram which shows the structural example of the interactive display system as the 1st Embodiment of this invention. It is a figure which shows the internal structure of the control apparatus with which the interactive display system of 1st Embodiment is equipped. It is a flowchart which shows the processing operation for detecting and holding | maintaining a reference | standard input image level. It is a flowchart which shows the processing operation for producing | generating detection image information. It is explanatory drawing which shows the 1st usage example of the interactive display system of 1st Embodiment. It is a flowchart which shows the processing operation for implement | achieving the 1st usage example shown in FIG. It is explanatory drawing which shows the 2nd usage example of the interactive display system of 1st Embodiment. It is explanatory drawing which shows the 3rd usage example of the interactive display system of 1st Embodiment. It is explanatory drawing which shows the 4th usage example of the interactive display system of 1st Embodiment. It is explanatory drawing which shows the 5th usage example of the interactive display system of 1st Embodiment. It is a conceptual diagram which shows the structural example of the interactive display system as the 2nd Embodiment of this invention. It is a conceptual diagram which shows the structural example of the interactive display system as the 3rd Embodiment of this invention. It is a figure which shows the internal structure of the control apparatus with which the interactive display system of 3rd Embodiment is equipped. It is explanatory drawing which shows the operation example of the interactive display system of 3rd Embodiment. It is a conceptual diagram which shows the structural example of the interactive display system as the 4th Embodiment of this invention. It is a conceptual diagram which shows the structural example of the interactive display system as the 5th Embodiment of this invention. It is a conceptual diagram which shows the other structural example of the interactive display system as 5th Embodiment. It is a conceptual diagram which shows the structural example of the interactive display system as the 6th Embodiment of this invention. It is a figure which shows the internal structure of the control apparatus with which the interactive display system of 6th Embodiment is equipped. It is a conceptual diagram which shows the other structural example of the interactive display system as 6th Embodiment. It is a conceptual diagram which shows the structural example of the interactive display system as the 7th Embodiment of this invention. It is a conceptual diagram which shows the structural example of the interactive display system as the 8th Embodiment of this invention. It is a figure which shows the internal structure of the control apparatus with which the interactive display system of 8th Embodiment is equipped.

Explanation of symbols

  1, 1A, 1B, 1C, 1D, 1E, 1F, 1G interactive display system, 2, 2A, 2B translucent surface, 3 infrared LED panel, 4 CCD camera, 4A first CCD camera, 4B second CCD camera, 5 projector, 6 control device, 7 pan / tilt / zoom mechanism, 10 LED drive unit, 11, 11A, 11B image input unit, 12 input image processing unit, 13 threshold control unit, 14 database drive unit, 15 database memory, 16 image Generation unit, 17 image composition unit, 18 RGB signal generation unit, 30 television receiver, 40 microwave generator, 41 microwave receiver, 110 microwave drive unit, 111 received signal input unit, 112 input data processing unit, PD infrared transmitter, MR mirror, half mirror, RMD remote control display, HD shadow display

Claims (6)

A translucent surface,
An information display unit for displaying information on the translucent surface;
An imaging unit that captures an image;
A control unit that outputs a signal for the display unit based on an image captured by the imaging unit and a parameter change signal for changing a predetermined parameter value of the information processing device;
An irradiation unit that irradiates light of a predetermined wavelength band to the translucent surface,
The imaging unit includes an imaging device and a filter that transmits only light in the predetermined wavelength band,
The control unit recognizes the direction of movement of the operating body in the vicinity of the translucent surface based on the image captured by the imaging unit, and outputs a signal to the display unit according to the direction of the movement, An information processing apparatus that outputs a parameter change signal according to the direction of the movement. The information processing apparatus according to claim 1,
The control unit recognizes the size of a region in which the intensity of light in a predetermined wavelength band, which is generated when the operating body approaches the semitransparent surface, based on an image captured by the imaging unit. An information processing apparatus that outputs a signal to the display unit in accordance with the size of the area. The information processing apparatus according to claim 1,
The control unit recognizes a change in intensity of light in a predetermined wavelength band caused by a change in the distance between the translucent surface and the operation body based on an image captured by the imaging unit, An information processing apparatus that outputs a signal to the display unit according to a change. The information processing apparatus according to claim 1,
The information processing apparatus has a table shape,
The translucent surface is disposed on a table surface;
The imaging unit is arranged to image the table surface from the bottom of the table,
The information processing apparatus, wherein the irradiation unit is arranged to irradiate light from a lower part of the table toward the table surface. The information processing apparatus according to claim 4.
The information processing apparatus, wherein the imaging unit and the irradiation unit perform imaging and irradiation on a table surface by using reflection by a mirror provided at a lower part of the table. A translucent surface, an information display unit that displays information on the translucent surface, an imaging unit that captures an image, a signal for the display unit based on an image captured by the imaging unit, and a predetermined information processing device In an information processing method of an information processing apparatus, including a control unit that outputs a parameter change signal for changing the parameter value of the light source, and an irradiation unit that irradiates the semitransparent surface with light of a predetermined wavelength band,
An image is captured by the image sensor of the imaging unit through a filter that transmits only light in the predetermined wavelength band,
Recognizing the direction of movement of the operating body in the vicinity of the translucent surface based on the image captured by the imaging unit,
An information processing method characterized by outputting a signal for the display unit corresponding to the direction of the motion and outputting a parameter change signal corresponding to the direction of the motion.

Images