JP2006345228A - Controller for point image and control method for point image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent a presentation image from being frozen when performing the pointing by using a point image while moving the imaging data. <P>SOLUTION: When the data 116 are imaged by an image pickup device 113 and the imaged image is projected and displayed on a screen 103, the point image 117 is displayed at a place corresponding to the position pointed by a luminescent point 119 at the tip of a light pen 118. On that occasion, several frames in an image of 30 frame/second imaged by the image pickup device 113 are used for the imaging of the display contents of the data 116, and the other frames in twenties are used for the imaging of the luminescent point 119. In that case, the update of the presentation image is executed several times in one second. Consequently, the image display of the data 116 is prevented from being frozen. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for displaying a point image in a presentation image when performing presentation or education by presenting an image.

  There is a known method of projecting materials such as charts on a screen and giving a presentation while pointing to it. This technique is often used in meetings and classes. In this method, a material presentation device is used as a device for imaging a material.

  The material presentation device is also called a document camera. The basic function of the material presentation device is to image the set material with an imaging device. The captured image is projected on a screen, and a presentation is performed while showing the projected image to the viewer.

  In this technique, a technique is known in which a point image is further displayed on a screen. A point image is a display of an arrow or the like for pointing to a specific part of a projected image. The presenter points to a predetermined portion of the displayed image while giving a presentation while controlling the display position of the point image.

  In relation to this technique, for example, the technique described in Patent Document 1 is known. In Patent Document 1, an optical filter that selectively transmits infrared light is used to selectively transmit light of a bright spot of a light pen that emits infrared light, and its position is calculated by image processing. A technique for displaying point images is described.

JP 2003-348385 A

  However, in the conventional technique described in Patent Document 1, it is impossible to perform pointing with a point image while moving a presentation image (for example, an image of a material to be presented). This is because, after displaying an image obtained by capturing an image of the material, the display image is temporarily stopped (frozen), and then an operation is performed to perform imaging for recognizing a bright spot of infrared light.

  In a presentation using a presentation image, there is a case where the material being imaged is moved in order to move the display position on the screen to an easily viewable position such as the center. In such a case, for the reasons described above, the point image cannot be displayed while the presentation material is moved. After the movement of the material, the presentation image is statically processed again, and then the point image is displayed. I had to.

  Due to such limitations when displaying presentation materials and point images, the presenter must give a presentation in consideration of the frozen state of the presented image, while the viewer sees an unsmooth image display. I had to.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a technique that does not require a presentation image to be frozen when displaying a point image while moving an imaged material.

  The point image control device according to the present invention acquires an image of an imaging target using an imaging unit that captures a plurality of frames per second and a part of the plurality of frames, and uses other portions of the plurality of frames. And an image acquisition device that acquires a bright spot image of the light pen.

  In the above configuration, a plurality of frames per second refers to a plurality of frames imaged per second. For example, if the standard is 30 frames / second, 30 frames are captured per second.

  A part of the plurality of frames refers to a part of a plurality of frames captured per second. The other part of the plurality of frames refers to another frame obtained by removing the part of the frames from the plurality of frames captured per second. For example, in the case of the standard of 30 frames / second, when a part of a plurality of frames is four frames, the other part of the plurality of frames is the remaining 26 frames.

  According to the above configuration, for example, in the case of a standard of 30 frames / second, n frames are used for imaging of the material, and the remaining 30-n frames are used for detecting a bright spot pointed by the light pen. . In this case, since the material is imaged n times per second, it is not necessary to freeze the display image of the material, and a moving image can be displayed even if the frame is rough. Therefore, when the document being imaged is moved while pointing with the point image, it is possible to display the image of the displayed document moving accordingly.

  In the point image control device of the present invention, an optical filter that selectively transmits the wavelength of a bright spot and the arrangement of the optical filter on the optical axis of the imaging means in accordance with the imaging timing of the other part of the plurality of frames It is preferable to provide control means for performing the above.

  Here, the optical axis of the image pickup means means a perpendicular line to the center of the objective lens of the image pickup means. When the optical filter is arranged on the optical axis of the imaging means, imaging is performed through the optical filter. Further, when the optical filter is not arranged on the optical axis of the imaging means, the imaging is performed without passing through the optical filter.

  According to this aspect, the frame is properly used by using the optical filter. For example, in the case of a standard of 30 frames / second, an optical filter is arranged on the optical axis of the imaging device in accordance with the imaging timing of 30-n frames, thereby using the 30-n frames. The reflected light from the luminescent spot pointed out with the light pen is selectively acquired. In this case, n is a natural number that does not include 0 less than 30.

  As a specific combination, an example in which a light pen that emits infrared light and an optical filter having band-pass filter characteristics that selectively transmits the wavelength of the infrared light can be given. In this case, this optical filter is inserted into the optical axis of the imaging means in accordance with the imaging timing of 30-n frames.

  When an object to be imaged (for example, a document to be presented) having a bright spot of infrared light is imaged through this optical filter, light having a wavelength other than the wavelength of infrared light out of the light from the object to be imaged Is blocked by the optical filter, so that an image of a bright spot of infrared light is preferentially taken.

  In this way, in 30-n frames, light from the bright spot can selectively pass through the optical filter, and an image that can clearly determine the position of the bright spot can be acquired.

  In the n frames, the optical filter is retracted from the optical axis of the imaging unit, so that imaging without the optical filter is performed, and a captured image of the imaging target (for example, the material to be presented) can be obtained. .

  In the point image control device of the present invention, the imaging means includes a CCD imaging device, and the bright spot image is acquired from the CCD imaging device in accordance with the imaging timing of the other part of the plurality of frames. It is preferable to include a process that selectively obtains the luminance signal.

  According to this aspect, for example, in the case of a standard of 30 frames / second, image data of RGB color components is acquired (acquisition of a normal image) corresponding to the imaging timing of n frames, and 30-n Image data of a predetermined color component (for example, any one color component of RGB) is acquired in accordance with the imaging timing of each frame. In this aspect, by matching a predetermined color component with the light pen emission wavelength, image data for specifying the bright spot position of the light pen emission point is selectively acquired in 30-n frames. be able to.

  For example, in the case of a light pen that emits red light, only the R component is output from the CCD image pickup device in the 30-n frames, and image data related to the red component is obtained. In this image, since the position of the red bright spot clearly appears, the brightest part can be easily obtained, and the position pointed by the light pen can be obtained.

  In the point image control device of the present invention, a captured image of a target is generated based on a part of a plurality of frames, and a luminance signal for determining a display position of the point image is generated based on the other part of the plurality of frames. It is preferable to include an image generation unit and a selector that sequentially selects one of the image data signal of the captured image and the point image data signal based on the luminance signal according to the display timing of the pixels.

  According to this aspect, for example, in the case of a standard of 30 frames / second, a captured image (for example, an image of a material to be presented) is created based on n frames, and points based on 30-n frames. Image position information is created. Further, point image data is created based on the position information of the point image.

  The selector sequentially selects either the image data signal of the captured image or the point image data signal in accordance with the pixel display timing. For example, in the case of m × n matrix display, an image data signal of a captured image is selected as pixel data of (m, n) = (1, 1), and (m, n) = (1, 2) A signal selection process such as selecting a point image data signal as pixel data is performed.

  According to this process, for example, as shown in FIG. 1, the point image can be controlled such that the point image 117 is displayed in the projected image of the material 116. At this time, since the image of the material 116 is acquired n times per second, even if the material 116 is moved during imaging, the projected image of the material 116 on the screen 103 follows the movement. As a result, it is possible to perform a presentation that does not involve a frozen state of a presentation image, which is a problem in the prior art.

  The operation of the point image control device of the present invention can also be understood as an invention of a point image control method. That is, in the point image control method of the present invention, an imaging step of imaging a plurality of frames per second, an image of a target to be captured using a part of the plurality of frames, and the other parts of the plurality of frames are acquired. And an image acquisition step of acquiring a bright spot image of the light pen.

  In the point image control method of the present invention, the imaging step includes a selective imaging step of performing imaging through an optical filter that selectively transmits the wavelength of the bright spot in accordance with imaging timing of the other part of the plurality of frames. It is preferable.

  In the point image control method of the present invention, the image acquisition step corresponds to the first sub-step of acquiring signals of RGB components corresponding to a part of the plurality of frames and the other part of the plurality of frames. And a second sub-step of acquiring a signal of a predetermined color component.

  In the point image control method of the present invention, a luminance signal is generated that generates a captured image of the imaging target based on a part of a plurality of frames, and determines a display position of the point image based on the other part of the plurality of frames. It is preferable to include an image generation step to generate, and a selection step to sequentially select one of the image data signal of the captured image and the point image data signal based on the luminance signal according to the display timing of the pixel.

  In the invention of the point image control method, the same effects as those obtained in the above-described point image control device can be obtained.

  In the present specification, the act of explaining while showing materials is referred to as presentation. However, the present invention can be used for classes, study sessions, reports, etc. while presenting images of materials.

  According to the present invention, the frame constituting the captured image is divided into a frame for obtaining the captured image of the material and a frame for detecting the position of the pointed bright spot, and the bright spot is captured while the presentation material is captured. Detection is performed. In this way, a technique is provided that does not require the presentation image to be frozen when displaying the point image while moving the material being imaged.

(1) First Embodiment 1-1. Configuration of First Embodiment FIG. 1 is a conceptual diagram showing an outline of a presentation system using the invention. In FIG. 1, a material presentation device 101, a projection device 102, a screen 103, an image transmission cable 104, a material 116 to be imaged, a point image 117, a light pen (pointer or pointing device) 118 held by an explainer 120, And the presenter 120 is shown.

  The material presentation device 101 includes a display 111, a display support arm 112, an imaging device 113, a camera support arm 114, and an operation unit 115.

  The imaging device 113 includes a CCD camera and an infrared light transmission filter (reference numeral 201 in FIG. 2 described later) that can be appropriately inserted into the optical axis of the CCD camera. The infrared light transmission filter is an optical filter that selectively transmits infrared light emitted from the light pen 118.

  The material presentation device 101 captures the material 116 by the imaging device 113 and sends the captured image to the projection device 102 via the image transmission cable 104. The projection device 102 projects the image captured by the imaging device 113 onto the screen 103.

  The display 111 is supported by a display support arm 112 so that the elevation angle of the display surface can be controlled. The display 111 displays an image picked up by the image pickup device 113 and has a function as a touch panel for performing various operations. The imaging device 113 is supported by an imaging device support arm 114 so that the imaging direction and the angle of view can be adjusted.

  The operation of the material presentation device 101 can be performed by operating the operation unit 115, but can also be performed by a touch panel on the display 111.

  The light pen 118 has a function of emitting infrared light (e.g., a wavelength of 800 nm to 1000 nm) at its tip, and an arbitrary part of the material 116 is brought into contact with or close to the material 116 as illustrated. Can be pointed to. For example, the light pen 118 is provided with a switch function that emits light when pressed, and when the arbitrary portion of the material 116 is pressed with the tip, the tip emits infrared light.

  FIG. 2 is an example of a block diagram showing an outline of the material presentation device 101 shown in FIG. The material presentation device 101 shown in FIG. 2 includes an infrared light transmission filter 201, a filter control device 202, a CCD camera 203, a CCD control circuit 204, a point image control circuit 205, a CPU 206, a selector 207, and a D / A converter 208. ing.

  In this configuration, the image pickup apparatus 113 shown in FIG. 1 has a structure including an infrared light transmission filter 201 and a CCD camera 203.

  The infrared light transmission filter 201 is an optical filter having a bandpass characteristic that selectively transmits infrared light emitted from the light pen 118 of FIG. The filter control device 202 is a mechanism that selects the arrangement or non-arrangement of the infrared light transmission filter 201 on the optical axis of the CCD camera 203. Here, the optical axis of the CCD camera 201 means an axis perpendicular to the center of the objective lens of the CCD camera 201.

  When the infrared light transmission filter 201 is disposed on the optical axis of the CCD camera 203, the CCD camera 203 performs imaging through the infrared light transmission filter 201. For example, in the state shown in FIG. 1, when the material 116 is imaged via the infrared light transmission filter 201, only infrared light from the bright spot 119 at the tip of the light pen 118 is selectively infrared light. The image is filtered and imaged by the transmission filter 201.

  If the infrared light transmission filter 201 is not disposed on the optical axis of the CCD camera 203, the CCD camera 201 performs imaging without using the infrared light transmission filter 201. For example, in the state shown in FIG. 1, when the material 116 is imaged without passing through the infrared light transmission filter 201, the light incident on the CCD camera 201 is not filtered by the infrared light transmission filter 201. Both the image displayed on the material 116 and the infrared light from the bright spot 119 at the tip of the light pen 118 are included in the captured image.

  The filter control device 202 includes a mechanism for selecting the arrangement / non-arrangement of the infrared light transmission filter 201 with respect to the optical axis of the CCD camera 201 and its control circuit. This mechanism is a kind of shutter mechanism and is performed using a solenoid mechanism. As this mechanism, a configuration using a motor can also be adopted.

  The CCD camera 203 captures image data of the captured image, and the image data is read by the CCD control circuit 204. The image data read by the CCD control circuit 204 is output to the selector 207 as a digital RGB output signal. The CCD control circuit 204 outputs a horizontal / vertical synchronizing signal, a luminance signal, and a pixel clock.

  The luminance signal is an image signal of a captured image obtained by capturing the bright spot 119 of the light emitting portion at the tip of the light pen 118 captured by the CCD camera 203. Due to the function of the infrared light transmission filter 201, the display content of the material 116 is not included in this image. By analyzing this luminance signal, the brightest place in the captured image can be calculated.

  The CCD control circuit 204 has a function of temporarily holding captured frames, and further has a function of performing missing frame compensation processing (details will be described later) using this function.

  The point image control circuit 205 finds a position (coordinate in the image) where the luminance value shows a peak from the luminance signal, and outputs a point image data signal based on the position to the selector 207. This point image data signal is a pixel data signal related to the point image 117 in the image projected onto the screen 103 in FIG.

  Further, the point image control circuit 205 generates a point image control signal based on the luminance signal, the horizontal / vertical synchronization signal, and the pixel clock, and sends it to the selector 207. The point image control signal is a control signal that determines the timing for selecting the position for displaying the pixel data constituting the point image.

  The point image control circuit 205 also arranges / not arranges the infrared light transmission filter 201 on the optical axis of the CCD camera 203 based on the vertical synchronization signal included in the horizontal / vertical synchronization signal output from the CCD control circuit. Infrared light transmission filter control signal that determines the timing of the signal is generated and sent to the filter control device 202.

  The CPU 206 controls the operation of the point image control circuit 205 and the operation of the filter control device 202. The selector 207 sequentially selects one of the digital RGB signal and the point image data signal based on the point image control signal. For example, in the case of a pixel structure in which m × n pixels are arranged in a matrix, the selector 207 uses the captured image as pixel data of an image to be displayed on a pixel of (m, n) = (1, 1). An image data signal is selected, and then a signal selection process is performed such that a point image data signal is selected as image data of an image to be displayed on a pixel of (m, n) = (1, 2).

  The D / A converter 208 converts the output of the selector 207 into an analog RGB signal and sends it to the projection device 102. The projection device 102 projects an image based on the analog RGB signal output from the selector 207 onto the screen 103.

1-2. Operation of First Embodiment Here, an operation example in the case where the captured image of the material 116 is projected and displayed on the screen 103 using the material presenting apparatus 101 illustrated in FIG. 2 in the system illustrated in FIG. 1 will be described. In this example, a case where the CCD camera 203 captures 30 frames per second will be described.

  First, an operation in the case where only the captured image of the material 116 is projected and displayed on the screen 103 will be described. In this case, the infrared light transmission filter 201 is fixed in a state of being retracted from the optical axis of the CCD camera 203.

  In this operation, the material 116 is imaged by the imaging device 113, and the digital RGB signal of the captured image is sent from the CCD control circuit 204 of FIG. In this case, the bright spot 119 cannot be selectively read by the function of the infrared light transmission filter, and the luminance signal is not output from the CCD control circuit 204. Therefore, the point image data signal and the point image control signal from the point image control circuit 205 are not output.

  For this reason, the digital RGB signal passes through the selector 207 as it is and is sent to the D / A converter 208, where it is converted into an analog RGB signal. The analog RGB signal is sent to the projection device 102 in FIG. 1, and the projection device 102 projects the captured image of the material 116 on the screen 103 based on the analog RGB signal. In this way, a projection display in which the point image 117 is not displayed is performed on the screen 103.

  Next, the operation when the point image 117 is displayed on the screen 103 so as to overlap the projection image of the material 116 will be described. Here, in a state where the captured image of the material 116 is projected and displayed on the screen 103, the explainer 120 uses the light pen 118 to point to an arbitrary point on the material 116, and the image projected and displayed on the screen 103. A case is assumed where pointing to a predetermined part (an action indicating a part of a projection image) is performed.

  In this example, 3 frames out of 30 frames per second captured by the CCD camera 203 are allocated to the imaging of the material 116 and the bright spot 119, and the remaining 27 frames are allocated to the imaging of the bright spot 119.

  Specifically, the arrangement of the infrared light transmission filter 201 on the optical axis of the CCD camera 203 is not performed at the imaging timing of the first frame, the 10th frame, and the 20th frame. In the second to ninth frames, the 11th to 19th frames, and the 21st to 30th frames, the infrared light transmission filter 201 is arranged on the optical axis of the CCD camera 203.

  That is, the CCD control circuit 204 reads out a captured image of 30 frames per second from the CCD camera 203, and 3 frames among them are frames of an image obtained by capturing the material 116 without using the infrared light transmission filter 201. The frame is a frame of an image obtained by selectively capturing the bright spot 119 by cutting the display content of the material 116 by the infrared light transmission filter 201.

  Here, the CCD control circuit 204 performs missing frame compensation processing. That is, since only 3 frames of an image obtained by capturing the material 116 without using the infrared light transmission filter 201 can be obtained per second, the remaining 27 frames of images are used as substitutes. . For example, the first frame in 3 frames is assigned to the timing corresponding to the missing 2nd to 9th frames, the second frame in 3 frames is assigned to the timing corresponding to the missing 11th to 19th frames, and missing A third frame of the three frames is assigned to the timing corresponding to the 21st to 30th frames.

  In this manner, the CCD control circuit 204 generates a digital RGB signal composed of 30 frames / second. This digital RGB signal is a captured image of the material 116 and is sent to the selector 207.

  In addition, the frame of the image obtained by capturing the material 116 using the infrared light transmission filter 201 is 27 frames per second, and three frames are missing. To assign. For example, the second frame is assigned to the timing corresponding to the first frame in the missing 30 frames, the ninth frame is assigned to the timing corresponding to the missing 10th frame, and the missing 20th frame is equivalent. The 19th frame is assigned to the timing.

  In this way, the CCD control circuit 204 generates a luminance signal composed of 30 frames / second. This luminance signal is a captured image of the bright spot 119 and is sent to the point image control circuit 205.

  The point image control circuit 205 detects the position with the highest luminance (position on the screen) from the luminance signal. Then, a point image data signal for displaying a point image (for example, an arrow image) at the detection position is generated.

  Further, the point image control circuit 205 generates a point image control signal for specifying the pixel position where the pixel data of the point image should be displayed from the analysis result of the luminance signal, and generates the point image control signal based on the horizontal / vertical synchronization signal and the pixel clock. The data is output to the selector 207 at a predetermined timing.

  One of the RGB digital signal and the point image data signal sent to the selector 207 is sequentially selected based on the point image control signal. Here, for example, either the RGB digital signal or the point image data signal is selected as the image data to be displayed on the first row of pixels in the first row, and then the image to be displayed on the second row of pixels in the first row. A selection process is performed in which either an RGB digital signal or a point image data signal is selected as data.

  As a result, the selector 207 generates an image data signal of an image obtained by combining the point image 117 with the captured image of the material 116 as projected and displayed on the screen 103.

  The output signal of the selector 207 is converted into an analog RGB signal by the D / A converter 208, and the analog RGB signal is output to the projection device 102 via the image transmission cable 103. Then, the projection device 102 projects an image based on the analog RGB signal on the screen 103.

  Thus, in a state where the image of the material 116 is projected and displayed on the screen 103, the point image 117 can be displayed on the screen 103 corresponding to the bright spot portion on the material 116 pointed to by the light pen 118.

  In this operation, when the explainer 120 changes the position indicated by the light pen 118 and changes the position of the bright spot 119, the change of the bright spot position is transmitted to the point image control circuit 205 via the luminance signal, and the point image control circuit 205 generates a point image data signal and a point image control signal corresponding to the change in the position of the bright spot 119. As a result, the display position of the point image 117 reflecting the position control of the bright spot 119 by moving the light pen 118 is controlled. Thus, control is performed in which the display position of the point image 117 is determined by the position pointed by the light pen 118.

  In this operation, since the captured image of the material 116 is updated three times per second, although it is somewhat unnatural, when the material 116 is moved, the movement of the material 116 on the screen 103 is followed. The captured image is displayed.

  Moreover, since the point image 117 is created using 27 frames out of 30 frames / second, it is possible to sufficiently cope with the quick movement of the bright spot 119.

  Thus, when the point image 117 is displayed while moving the material 116 being imaged, the presenter 120 does not have to be aware of the frozen state of the presented image, and at the same time, the viewer does not care about that. You can give a presentation.

  Note that when the performance of the CCD camera 203 is 30 frames / second, the frame allocation is 1 to 10 frames (preferably 1 to 4 frames) for capturing the material 116, and 20 for the pointing position (bright spot 119). It is appropriate to allocate ~ 29 frames (preferably 26-29 frames).

  Note that if the number of frames allocated to the imaging of the material 116 is 5 frames or more, the naturalness of the followability of the display image when the material 116 is moved increases, but conversely, the unnaturalness when the point image 117 is quickly moved is increased. It increases. Of course, the allocation of the number of frames can be appropriately set according to the use and required performance. Further, the user may be able to adjust the allocation of the number of frames.

1-3. Modification of First Embodiment In the operation of the first embodiment described above, the bright spot 119 is captured as an image in the captured image in three frames in which the infrared light transmission filter 201 is removed from the optical axis.

  Since this light can be recognized by the CCD camera 203, the bright spot 119 is displayed on the screen 117. When the display size of the point image 117 is larger than the display size of the bright spot 119, the display image of the bright spot 119 is hidden by the point image 117. However, depending on the instruction state to the material 116 by the light pen 118, the bright spot 119 is displayed. It may stand out on the screen 103.

  As a method for preventing this phenomenon, there is a method in which the light pen 118 emits light corresponding to a frame in which an optical filter is used. In this case, a synchronization signal for reading image data from the CCD element is obtained from the CCD control circuit 204, and the light emission timing of the light emitting element provided in the light pen 118 is controlled.

  For example, in the above example, light emission is performed at the imaging timing of 27 frames in the image capturing performed at 30 frames / second, and the light emission is stopped at the imaging timing of the remaining three frames. By doing so, the image data of the bright spot 119 can be prevented from being included in the digital RGB signal, and the bright spot 119 can be prevented from being displayed on the screen 103.

  In order to realize this mode, means for sending a control signal from the CCD control circuit 204 to the light pen 118 is required. As a means for sending this control signal, a method using wired or wireless can be mentioned.

(2) Second embodiment 2-1. Configuration of Second Embodiment Hereinafter, another configuration of the material presentation device 101 illustrated in FIG. 1 will be described. FIG. 3 is a block diagram illustrating another example of the material presentation device 101. The material presentation device 101 shown in FIG. 3 includes an imaging device 113 having a CCD camera 203, a CCD control circuit 204, a point image control circuit 205, a CPU 206, a selector 207, and a D / A converter 208.

  3 differs from the configuration shown in FIG. 2 in that the imaging device 113 does not include the infrared light transmission filter 201, and the point image control circuit 205 has the maximum luminance of the R component based on the luminance signal of the R channel. A point is calculated to control the point image display position, a point image control circuit 205 has a function of controlling the lighting timing of the light pen 118 (see FIG. 1), and a point image control circuit The control content performed by the CPU 206 in relation to the operation 205 is different. In the present embodiment, the light pen 118 includes an LED that emits visible light having a red wavelength (650 nm) at the tip.

  In the mode shown in FIG. 3, a signal for controlling the lighting timing is output from the material presentation device 101 to the light pen 118. The transmission of the control signal is performed by wire or wireless. In FIG. 3, the functions of the parts having the same reference numerals as those in FIGS. 1 and 2 are the same as those described in FIGS.

  In the present embodiment, the brightness of the light pen 118 is set in advance so as to reach the saturation light amount of the CCD element built in the CCD element camera 203. Also, a threshold value (threshold value) for recognizing 90% of the maximum luminance signal as an effective point position signal is set in the CCD control circuit 205.

2-2. Operation of Second Embodiment Here, the operation of the material presentation apparatus 101 illustrated in FIG. 3 when the captured image of the material 116 is projected and displayed on the screen 103 in the presentation using the system shown in FIG. 1 will be described. In this example, a case where the CCD camera 203 captures 30 frames per second will be described.

  First, an operation in the case where only the captured image of the material 116 is projected and displayed on the screen 103 will be described. In this case, image data corresponding to normal RGB is read from the CCD camera 203 by the CCD control circuit 204, and is output to the selector 207.

  In this case, the point image control circuit 205 does not particularly operate, and the selector 207 does not perform selection switching between the point image data signal and the digital RGB signal. Therefore, the digital RGB signal passes through the selector 207 and is sent to the D / A converter 208 where it is converted into an analog RGB signal. The analog RGB signal is sent to the projection device 102 in FIG. 1, and the projection device 102 projects the captured image of the material 116 on the screen 103 based on the analog RGB signal. In this way, a projection display in which the point image 117 is not displayed is performed on the screen 103.

  Next, the operation when the point image 117 is displayed on the screen 103 so as to overlap the projection image of the material 116 will be described. Here, in a state where the captured image of the material 116 is projected and displayed on the screen 103, the explainer 120 uses the light pen 118 to point to an arbitrary point on the material 116, and the image projected and displayed on the screen 103. A case of performing pointing (an action indicating a part of the projection image) with respect to a predetermined part will be described.

  In this example, among the 30 frames captured by the CCD camera 203, 3 frames are allocated to the image acquisition of the material 116, and the remaining 27 frames are allocated to the image acquisition of the bright spot 119. Specifically, the image of the material 116 is acquired in 3 frames of the first frame, the 10th frame, and the 20th frame in 30 frames per second, and the image of the bright spot 119 is acquired in the remaining frames. .

  At this time, the point image control circuit 205 is a light pen control signal for lighting the light pen 118 (see FIG. 1) at imaging timings of 2-9 frames, 11-19 frames, and 21-30 frames. Is output, and the light pen 118 is turned on in accordance with the timing. The light pen control signal is generated based on the vertical synchronization signal of the CCD element.

  The CCD control circuit 204 acquires normal RGB image data in the first frame, the 10th frame, and the 20th frame. Further, the CCD control circuit 204 performs the above-described missing frame compensation processing on the image data of 3 frames / second, generates a digital RGB signal composed of 30 frames / second, and outputs it to the selector 207. .

  Further, the CCD control circuit 204 extracts only the R component from the RGB signal read from the CCD camera at the timings of 2-9 frames, 11-19 frames, and 21-30 frames. Then, the CCD control circuit 204 performs the above-described missing frame compensation processing on the 27-frame / second R component image data to generate an R-channel luminance signal composed of 30 frames / second. The image is output to the point image control circuit 205.

  The point image control circuit 205 calculates position data of the bright spot 119 (see FIG. 1) at the tip of the light pen 118 based on the R channel luminance signal. That is, a threshold value (threshold value) for recognizing 90% of the maximum luminance signal as an effective point position signal is set in the CCD control circuit 205, and the light pen 117 has a light emission intensity equal to the saturation intensity of the CCD element. Therefore, the CCD control circuit 205 can distinguish the bright spot position data at the tip of the light pen 118 from the red component in the normal image and obtain it as valid point position signal information.

  The point image control circuit 205 calculates the position of the maximum luminance from the effective point position signal information, and generates a point image data signal for displaying the point image (for example, an arrow image) based on the position.

  Further, the point image control circuit 205 generates a point image control signal for specifying the pixel position where the pixel data of the point image is to be displayed from the analysis result of the R channel luminance signal, and uses the point image control signal as a horizontal / vertical synchronization signal and a pixel clock. Based on this, it outputs to the selector 207 at a predetermined timing.

  One of the RGB digital signal and the point image data signal sent to the selector 207 is sequentially selected based on the point image control signal. Here, for example, either the RGB digital signal or the point image data signal is selected as the image data to be displayed on the first row of pixels in the first row, and then the image to be displayed on the second row of pixels in the first row. A selection process is performed in which either an RGB digital signal or a point image data signal is selected as data.

  As a result, the selector 207 generates an image data signal of an image obtained by combining the image of the material 116 and the image of the point image 117 as projected and displayed on the screen 103 shown in FIG.

  The output signal of the selector 207 is converted into an analog RGB signal by the D / A converter 208, and the analog RGB signal is output to the projection device 102 via the image transmission cable 103. Then, the projection device 102 projects an image based on the analog RGB signal on the screen 103.

  In this manner, the point image 117 can be displayed at the position on the material 116 pointed to by the light pen 118 in a state where the image of the material 116 is projected and displayed on the screen 103.

  In this operation mode, since the image acquisition for the material 116 is performed at a rate of 3 times per second while the pointing with the light pen 118 is being performed, even if the material 116 is moved, 3 times / The projection image of the material 116 is rewritten at a rate of seconds. For this reason, although it is somewhat unnatural, pointing using the light pen 118 while moving the material 116 can be performed.

  Thus, when the point image 117 is displayed while moving the document 116 being imaged, the presenter 120 does not have to be aware of the frozen state of the presented image, and at the same time the viewer does not care about that. You can give a presentation. Note that the frame allocation ratio is the same as in the first embodiment and has a certain degree of freedom.

  The present invention can be used for a material presentation technique for presenting materials as images in lectures, seminars, and various classes.

It is a conceptual diagram which shows the outline | summary of a presentation system. It is a block diagram which shows an example of a material presentation apparatus. It is a block diagram which shows another example of a data presentation apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... Material presentation apparatus, 102 ... Projection apparatus, 103 ... Screen, 104 ... Image transmission cable, 111 ... Touch-panel display, 112 ... Display support arm, 113 ... Imaging apparatus, 114 ... Imaging apparatus support arm, 115 ... Operation means, 116: Material to be imaged, 117 ... Point image, 118 ... Light pen, 119 ... Bright point at the tip of the light pen, 120 ... Explainer (presenter), 201 ... Infrared light transmission filter, 202 ... Filter control circuit, 203 DESCRIPTION OF SYMBOLS ... CCD camera, 204 ... CCD control circuit, 205 ... Point image control circuit, 206 ... CPU, 207 ... Selector, 208 ... D / A converter, 301 ... Gain amplifier.

Claims (7)

Imaging means for imaging a plurality of frames per second;
An image acquisition device that acquires an image of an imaging target using a part of the plurality of frames and acquires a bright spot image of a light pen using another part of the plurality of frames. Image control device. An optical filter that selectively transmits the wavelength of the bright spot;
2. The point image control according to claim 1, further comprising: a control unit that arranges the optical filter on an optical axis of the imaging unit in accordance with an imaging timing of the other part of the plurality of frames. apparatus. The imaging means includes a CCD imaging device,
The acquisition of the bright spot image includes a process of selectively obtaining a luminance signal of a predetermined color component from the CCD imaging device in accordance with imaging timing of the other part of the plurality of frames. The point image control device according to 1. Image generating means for generating a captured image of the imaging target based on a part of the plurality of frames and generating a luminance signal for determining a display position of the point image based on the other part of the plurality of frames;
4. The selector according to claim 1, further comprising: a selector that sequentially selects one of an image data signal of the captured image and a point image data signal based on the luminance signal according to a display timing of the pixel. Point image control device. An imaging step of imaging multiple frames per second;
An image acquisition step of acquiring an image to be imaged using a part of the plurality of frames and acquiring a bright spot image of a light pen using another part of the plurality of frames. Image control method.   The imaging step includes a selective imaging step in which imaging is performed through an optical filter that selectively transmits the wavelength of the bright spot in accordance with imaging timing of other portions of the plurality of frames. 5. The point image control method according to 5. The image acquisition step includes
A first sub-step of acquiring signals of RGB components corresponding to a part of the plurality of frames;
The point image control method according to claim 5, further comprising: a second sub-step of acquiring a signal of a predetermined color component corresponding to another part of the plurality of frames.

Images