JP2005121747A - Projector device and writing acquisition method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire and keep writing on a projected image on a screen. <P>SOLUTION: The projector device 10 is equipped with a projection part 100 projecting the projected image to the screen 40 and an image pickup part 140 picking up the image of the screen 40. The projection part 100 projects the projected image inputted from the outside according to electronic data to the screen 40, and the image pickup part 140 generates the picked-up image obtained by picking up the image of the screen 40. It is also good that the projector device 10 is further equipped with a writing extracting part 200 extracting the writing directly written on the screen 40 from the picked-up image and a writing storage part 160 storing the electronic data of the projected image and the writing extracted by the extracting part 200 corresponding to each other. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a projector device and a writing acquisition method.

2. Description of the Related Art Conventionally, a projector that projects a projected image on a screen is known in which an image input from an external input device that can communicate with the projector is added to the projected image and projected (for example, Patent Document 1).
JP 2001-356405 A (FIG. 9)

  However, the user of the projector may directly write on the screen with respect to the projection image projected on the screen. In this case, the projector cannot directly capture the writing. In order to capture this writing in the projector, it takes time and effort to manually input the same writing again in the external input device.

  In order to solve the above problems, according to a first aspect of the present invention, a projector device includes a projection unit that projects a projection image onto a screen and an imaging unit that captures the screen. Thereby, when writing directly on the screen with respect to the projection image projected on the screen, this writing can be imaged.

  In the projector device, the projection unit projects the projection image onto the screen, the imaging unit generates a captured image obtained by imaging the screen, and the projector device extracts the writing directly written on the screen from the captured image. You may further provide a writing extraction part and the writing memory | storage part which matches and memorize | stores the electronic data of a projection image, and the writing extracted by the writing extraction part. Thereby, the writing can be captured and stored so that it can be reproduced together with the projection image.

  In the projector device, the writing extraction unit may generate a projection image based on the electronic data of the projection image, and extract writing based on a difference between the captured image and the generated projection image. As a result, writing can be extracted while the projected image continues to be projected on the screen.

  The projector device may further include a writing / reproducing unit that reproduces a projection image and writing based on the electronic data and writing stored in the writing storage unit and projects the projected image and writing on the screen by the projection unit. Thereby, the captured writing can be seen later.

  The projector apparatus may further include an external transmission unit that transmits the writing stored in the writing storage unit to the outside together with the electronic data of the projection image associated with the writing. Thereby, the captured writing can be processed or reproduced externally.

  The projector device may further include a writing printing unit that prints the projection image and writing based on the electronic data and writing stored in the writing storage unit. Thereby, writing can be confirmed with printed matter.

  In the projector device, when the imaging unit captures the screen, the projection unit irradiates the uniform light without projecting the projection image onto at least a part of the screen, and the writing extraction unit You may extract the writing in the area | region irradiated with light. As a result, a captured image obtained by capturing only writing can be acquired without being affected by the projection image.

  In the projector device, the imaging unit generates a plurality of captured images captured at different timings, and the writing extraction unit writes the writings written in the interval when each of the plurality of captured images is captured. You may extract based on the difference of these captured images. Thereby, newly written writing can be extracted with high accuracy.

  In the projector device, when an optical system for projecting a projected image onto a screen is operated, the imaging unit generates one captured image, and the writing and extracting unit performs the one captured image on the one captured image. The writing may be extracted based on a difference between other captured images captured after the captured image. Thereby, writing can be extracted by distinguishing writing from what was on the screen before writing is performed.

  In the projector device, the projection unit may emit white light as uniform light. Thereby, the captured image in which the correct color is expressed can be generated.

  In the projector apparatus, the projection unit sequentially emits red light, green light, and blue light as uniform light, and the imaging unit detects all of red light, green light, and blue light, respectively. It has an image pickup device that picks up a picked-up image with a plurality of possible pixels, and writes based on the picked-up image that the image pickup device picks up sequentially according to each of red light, green light, and blue light emitted by the projection unit. The extraction unit may extract writing. Thereby, it is possible to generate a high-resolution captured image using all the pixels of the image sensor for each of red light, green light, and blue light.

  In the projector device, the projection unit is displayed on the liquid crystal panel by irradiating the screen with a liquid crystal panel that displays a projected image, a light source that generates light to be transmitted through the liquid crystal panel, and light that has passed through the liquid crystal panel. An optical system that projects the projected image onto the screen, and when the imaging unit captures the screen, the liquid crystal panel displays a uniform color without displaying the projected image in at least a part of the area on the screen. The optical system emits uniform light by projecting the uniform color displayed on the liquid crystal panel, and the writing extraction unit extracts writing in the area irradiated with the uniform light. Also good. Thereby, it is possible to irradiate uniform light without preparing another light source.

  According to a second aspect of the present invention, there is provided a writing acquisition method, wherein a projected image is projected onto a screen, a captured image obtained by imaging the screen is generated, and a written directly written on the screen is extracted from the captured image. The electronic data of the projection image and the extracted writing are stored in association with each other. Thereby, the effect similar to the 1st form can be acquired.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows a projector system 60 using a projector apparatus 10 according to an embodiment of the present invention. The projector system 60 includes a projector device 10, a PC (personal computer) 30 that inputs a projection image to the projector device 10, a screen 40 that displays a projection image from the projector device 10, and other devices that can communicate with the PC 30 using a network or the like. The PC 70, another projector device 20 that can communicate with the other PC 70, and another screen 50 that receives a projection image from the other projector device 20. The user 44 writes directly on the screen 40 using the writing instrument 42. Examples of the screen 40 are a steel white board, a glass plate whose rear surface is ground glass, a white paper or a white wall. Moreover, the example of the writing instrument 42 is a water-based pen.

  The projector device 10 according to the embodiment of the present invention captures the writing written directly on the screen 40 by the user 44 by imaging the screen 40. Further, the projector device 10 transmits the captured writing to the other projector device 20 together with the projection image, and the other projector device 20 superimposes the received writing on the projection image and projects it onto the other screen 50.

  FIG. 2 is a block diagram showing the functions of the projector device 10 and the PC 30 together with the printer 80. The projector device 10 includes a projection unit 100 that projects a projection image input from the PC 30 using electronic data onto a screen 40, and an imaging unit 140 that generates a captured image obtained by imaging the screen 40. The projection unit 100 includes an R light source 112, a G light source 114, a B light source 116, an R liquid crystal shutter 122, a G liquid crystal shutter 124, a B liquid crystal shutter 126, a projection light generation unit 120, a coupling prism 128, and an optical system 130. Each of the R light source 112, the G light source 114, and the B light source 116 is a white light source that generates light to be transmitted through each of the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126.

  Each of the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 is a liquid crystal panel divided into a plurality of pixels, and in accordance with an instruction from the projection light generation unit 120, a red component and a green component of the projection image And a red image, a green image, and a blue image, which are blue components, are displayed. As a result, the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 display a projected image. The R liquid crystal shutter 122 has a red filter attached thereto, and generates red image projection light according to the light from the R light source 112. The G liquid crystal shutter 124 has a green filter attached thereto, and generates projection light of a green image according to the light from the G light source 114. The B liquid crystal shutter 126 has a blue filter attached thereto, and generates green image projection light according to the light from the B light source 116.

  The projection light generation unit 120 receives electronic data of a color projection image from the PC 30, and opens and closes the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 for each pixel based on the electronic data. Thereby, the projection light generation unit 120 causes the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 to display a red image, a green image, and a blue image. The combining prism 128 combines the projection light of the red image, the green image, and the blue image received from the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 to generate color projection light, thereby generating an optical system. 130.

  The optical system 130 is an optical system for projecting a projection image onto the screen 40, and includes a projection lens 134 and a half mirror 132. The projection lens 134 receives the color projection light generated by the coupling prism 128 via the half mirror 132 and forms an image on the screen 40. Thereby, the optical system 130 irradiates the screen 40 with the light transmitted through the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126. Then, the optical system 130 projects the projected images displayed on the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 onto the screen 40. The half mirror 132 transmits the light received from the coupling prism 128 toward the projection lens 134. Further, the half mirror 132 reflects light incident from the screen 40 via the projection lens 134 toward the imaging unit 140.

  The imaging unit 140 includes a CCD imaging device 142 and a captured image processing unit 144. The CCD imaging device 142 captures an image of the screen 40 reflected by the half mirror 132 through the projection lens 134 of the optical system 130 to generate a captured image. Thereby, the imaging unit 140 generates a captured image obtained by capturing the screen 40. Here, in this example, the CCD image sensor 142 is arranged such that the distance from the half mirror 132 to the CCD image sensor 142 is substantially equal to the distance from the half mirror 132 to each light source. The CCD image sensor 142 includes a large number of three types of pixels, an R pixel that detects red light, a G pixel that detects green light, and a B pixel that detects blue light. An image can be taken. When the CCD imaging device 142 images the screen 40, the projection system 100 is used to project the projection image on the screen 40 without focusing the projection unit 100 and the imaging unit 140 independently by using the optical system 130 of the projection unit 100. In addition, the screen 40 can be imaged. Furthermore, it is not necessary to provide separate optical systems for the projection unit 100 and the imaging unit 140, and the number of parts can be reduced. The half mirror 132 or a mirror instead of the mirror is movably arranged, and when the projection unit 100 projects the projection image on the screen 40, the half mirror 132 or the mirror is retracted from the optical path of the projection light, and the imaging unit 140 When imaging the screen 40, the half mirror 132 or the mirror may advance into the optical path.

  The captured image processing unit 144 causes the CCD image sensor 142 to capture a captured image. The captured image processing unit 144 electronically processes the captured image captured by the CCD image sensor 142 and supplies the processed image to the PC 30. For example, the captured image processing unit 144 may receive a captured image based on analog data from the CCD image sensor 142 and perform AD conversion to convert the captured image into digital captured data. The captured image processing unit 144 controls the projection light generation unit 120 in the projection unit 100 in synchronization with the timing at which the CCD image sensor 142 captures the screen 40. Thereby, for example, when the CCD imaging device 142 images the screen 40, the captured image processing unit 144 causes the projection unit 100 to interrupt the projection of the projection image, and irradiates the white light strobe instead of the projection image. Let In this case, the projected image disappears on the screen 40 in accordance with the white light. Therefore, in this example, the imaging unit 140 captures the screen 40 on which no projection image is projected, and generates a captured image.

  Here, if the captured image is captured, for example, in a state where the projected image is projected on the screen 40, it may be difficult to distinguish between writing and the projected image in the captured image. However, in this example, the imaging unit 140 generates a captured image by capturing the screen 40 on which the projection image is not projected. Therefore, according to this example, the writing directly written on the screen 40 can be appropriately extracted while being distinguished from the projection image. Moreover, according to this example, uniform light can be irradiated without preparing another light source for strobe irradiation. In this example, the projection unit 100 irradiates the entire screen 40 with uniform white light. In another example, the projection unit 100 may irradiate at least a part of the screen 40 with uniform light other than white light, for example.

  The PC 30 includes a write extraction unit 200, a write storage unit 160, a communication unit 280, a write reproduction unit 180, and a write printing unit 300. The writing extraction unit 200 receives the captured image from the captured image processing unit 144 and extracts the writing written directly on the screen 40 from the captured image. The writing storage unit 160 stores the writing extracted by the writing extraction unit 200 in association with the electronic data of the projection image to be written. As a result, when the projection image projected on the screen 40 is directly written on the screen 40, the writing can be captured and stored so that it can be reproduced together with the projection image. Note that the writing storage unit 160 receives electronic data of the projection image from another PC 70 via the communication unit 280, for example. Here, if a projection image corresponding to writing is acquired by, for example, capturing the screen 40, the captured image is inferior in image quality to the original projection image. Image degradation may occur. However, in this example, the projection image is stored as it is with electronic data received from another PC 70. Therefore, according to this example, the projected image and writing can be managed with high image accuracy while maintaining the sharpness of the image.

  The communication unit 280 receives the electronic data of the projection image from the other PC 70 and supplies it to the projection light generation unit 120 and the writing storage unit 160. Further, the communication unit 280 may acquire the writing directly written on the other screen 50 through the other PC 70 and project the writing on the screen 40 by the projection unit 100. In this case, writing on the other screen 50 can be reflected on the screen 40 and projected. As a result, when a conference is held by connecting remote locations, the conference can be advanced with a sense of presence similar to a conference in which a single projector is used in a single conference room.

  In addition, the communication unit 280 transmits the writing stored in the writing storage unit 160 to the other PC 70 together with the electronic data of the projection image associated with the writing. Thereby, the captured writing can be processed or reproduced by another external PC 70. Communication unit 280 is an example of an external transmission unit. The communication unit 280 may transmit the electronic data and the writing of the projection image to the outside of the PC 30.

  For example, in response to a request from the user 44 (see FIG. 1), the writing / playing unit 180 reads and reads the writing stored in the writing storage unit 160 and the electronic data of the projection image corresponding to the writing. A new projection image is generated by superimposing the writing and the corresponding projection image. Then, the writing / reproducing unit 180 supplies a new projection image to the projection light generation unit 120. In this case, the projection light generation unit 120 controls the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 based on the new projection image. In response to this control, the projection unit 100 reproduces a new projection image on the screen 40. Thus, the writing / reproducing unit 180 reproduces the projected image and writing based on the electronic data and writing of the projection image stored in the writing storage unit 160 and projects the projection image and writing on the screen 40 by the projection unit 100. Therefore, according to the present example, the captured writing can be viewed later. The writing printing unit 300 prints the projection image and writing based on the electronic data and writing of the projection image stored in the writing storage unit 160. In this example, the writing / printing unit 300 generates a printing image in which, for example, the read-out writing and the corresponding projection image are superimposed, and prints the printing image on the printer 80 provided outside the PC 30. Let Thereby, the writing printing unit 300 prints the printing image.

  As described above, according to this example, the projector device 10 can project and display the color projection image input from the PC 30 on the screen 40. Further, the projector device 10 and the PC 30 can be used by extracting the writing directly written on the screen 40 and reproducing, transmitting, or printing, for example.

  FIG. 3 is a diagram for explaining an example of operations of the projector device 10 and the PC 30. In the projector device 10, first, the optical system 130 is adjusted by, for example, autofocus or user 44 operation. Thereby, the projection part 100 projects the projection image 400 on the screen 40, as shown to the screen 600a. In the case shown in the figure, the projection unit 100 projects a projection image 400 including a graph. On the screen 40, there is dirt 604, and a plurality of magnets 606 are placed.

  Then, before writing on the screen 40, the projection unit 100 temporarily interrupts the projection of the projection image 400 and irradiates the screen 40 with white light. In this case, the projected image 400 disappears on the screen 40 as shown in the screen 600b. The imaging unit 140 captures the first captured image 602a according to the white light. As a result, the imaging unit 140 captures the captured image 602a in which the dirt 604 and the plurality of magnets 606 are reflected. After the imaging unit 140 captures the captured image 602a, the projection unit 100 resumes projecting the projection image 400. And the user 44 writes 410 with respect to the projected image 400 projected using the writing instrument 42 as shown on the screen 600c, for example. In this case, the writing 410 is written directly on the screen 40.

  After the writing 410 is performed, the projection unit 100 interrupts the projection of the projection image 400 again, and irradiates the screen 40 with white light. In this case, as shown in the screen 600d, the projected image 400 disappears and the writing 410 remains on the screen 40. The imaging unit 140 captures the captured image 602b according to the white light. As a result, the imaging unit 140 captures the captured image 602b in which the dirt 604, the plurality of magnets 606, and the writing 410 are reflected. In this case, the writing extraction unit 200 in the PC 30 extracts the writing 410 based on the difference between the captured image 602b and the captured image 602a, for example. Here, for example, if writing is to be extracted based on a single captured image 602b, things such as dirt 604 and magnet 606 that have existed before writing may be mistaken for writing. However, in this example, the writing extraction unit 200 extracts writing based on the difference between the newly-captured captured image 602b and the captured image 602a captured before writing. Therefore, according to this example, writing can be extracted with high accuracy.

  After the imaging unit 140 captures the captured image 602b, the projection unit 100 resumes projecting the projection image 400. Then, for example, the user 44 performs new writings 412 and 414 on the screen 40 as shown in the screen 600e. For example, when a predetermined time has elapsed since the captured image 602b was captured, the projection unit 100 interrupts the projection of the projection image 400 again and irradiates the screen 40 with white light. In this case, as shown in the screen 600f, the projected image 400 disappears and the writings 410, 412, and 414 remain on the screen 40. The imaging unit 140 captures the captured image 602c according to the white light. As a result, the imaging unit 140 captures a captured image 602c in which the dirt 604, the plurality of magnets 606, and the writings 410, 412, and 414 are reflected. The writing extraction unit 200 extracts writings 410, 412, and 412 based on, for example, the difference between the captured image 602c and the captured image 602a. According to this example, the writing directly written on the screen 40 can be appropriately extracted. In another example, the writing extraction unit 200 may extract the writings 412 and 414 that are performed after the captured image 602b is captured based on the difference between the captured image 602c and the captured image 602b, for example. Also in this case, writing can be appropriately extracted.

  FIG. 4 shows an example of a detailed configuration of the write extraction unit 200. In this example, the write extraction unit 200 includes an optical system operation detection unit 502, an imaging instruction unit 504, an initial image storage unit 506, and a difference image generation unit 508. The optical system operation detection unit 502 detects that the optical system 130 in the projector device 10 (see FIG. 2) is operated. The optical system operation detection unit 502 may detect, for example, a change in focus or aperture in the optical system 130. The imaging instruction unit 504 gives an instruction for causing the imaging unit 140 to capture a captured image to the captured image processing unit 144 every time a predetermined time elapses. In response to this instruction, the captured image processing unit 144 causes the projection unit 100 (see FIG. 2) to emit white light, and causes the CCD image sensor 142 to capture a captured image. Thereby, the imaging unit 140 generates a plurality of captured images captured at different timings.

  In this example, the imaging instruction unit 504 further gives an instruction to cause the imaging unit 140 to capture a captured image when the optical system 130 is operated in accordance with an instruction from the optical system operation detection unit 502. This is given to the processing unit 144. Thereby, when the optical system 130 is operated, the imaging unit 140 generates one captured image. Here, for example, when the projector apparatus 10 is installed in front of the screen 40, the optical system 130 is first operated in order to appropriately project the projection image. Therefore, according to this example, by detecting that the optical system 130 is operated, it is possible to generate a captured image obtained by capturing the screen 40 before writing.

  The initial image storage unit 506 stores an initial image that is a captured image captured when the optical system 130 is operated in accordance with an instruction from the optical system operation detection unit 502. The initial image may be a captured image captured before writing on the screen 40. The difference image generation unit 508 receives an initial image from the initial image storage unit 506 and receives a new captured image from the captured image processing unit 144. Then, the difference image generation unit 508 generates a difference image obtained by subtracting the initial image from the new captured image. In this case, the generated difference image includes writing written on the screen 40 after the initial image is captured. Therefore, the difference image generation unit 508 extracts the writing directly written on the screen 40 by generating a difference image. Accordingly, the writing extraction unit 200 extracts writing based on the difference between the initial image and another captured image captured after the initial image. According to this example, writing on the screen 40 can be extracted appropriately.

  Note that the difference image generation unit 508 may perform, for example, color adjustment (calibration) based on the initial image. Thereby, the difference image generation unit 508 performs the adjustment when the optical system 130 is operated. In this case, the imaging unit 140 may generate an initial image by, for example, imaging the screen 40 on which an object having a known color is placed. Thereby, the color of writing to be extracted can be reproduced with high accuracy. In another example, the writing extraction unit 200 may extract the writing written between the time when each of the plurality of captured images is captured based on the difference between the plurality of captured images captured at different timings. Good. The writing extraction unit 200 may extract writing based on the difference between the captured image and the projection image. In this case, the imaging unit 140 captures the screen 40 that is not irradiated with white light, and generates a captured image. Then, the writing extraction unit 200 extracts writing by subtracting the originally projected projection image from the captured image. The difference image generation unit 508 receives the electronic data of the projection image data from, for example, the write storage unit 160 (see FIG. 2). Based on this electronic data, a projection image is generated. Also in this case, writing on the screen 40 can be appropriately extracted.

  FIG. 5 is a flowchart showing an operation in which the projector device 10 and the PC 30 capture and store the writing on the screen 40. This flowchart is started when a projection image is input from the PC 30 to the projector apparatus 10.

  When a projection image is input from the PC 30, the projection unit 100 of the projector device 10 generates projection light and projects it onto the screen 40 (S100). The optical system operation detection unit 502 determines whether or not the optical system 130 has been operated (S102). When the optical system 130 is operated (S102: Yes), the imaging unit 140 acquires a captured image by imaging the screen 40 (S104). Step S104 will be described in detail with reference to FIG. Then, the initial image storage unit 506 stores this captured image as an initial image (S106).

  Next, the imaging instruction unit 504 determines whether or not a predetermined time has elapsed since the captured image was captured last time (S108). The predetermined time is set, for example, from several seconds to several tens of seconds, and the imaging instruction unit 504 stores the predetermined time prior to the projection image projection. When the predetermined time has not elapsed in step S108 (S108: No), the process returns to step S100, and the projection unit 100 projects the projection image. Here, in step S102, when the optical system 130 is not operated (S102: No), it progresses to step S108 and it is judged whether predetermined time passed (S108). Thereby, the projection unit 100 continues to project the projection image until a predetermined time elapses.

  If a predetermined time has elapsed in step S108 (S108: Yes), the imaging unit 140 captures the screen 40 and acquires a captured image (S110). In step S110, the imaging unit 140 acquires a captured image in the same manner as in step 104. Then, the writing extraction unit 200 extracts writing based on the acquired captured image and the initial image. Further, the writing storage unit 160 stores the extracted writing in association with the electronic data of the projection image (S112). After step S112, the projector device 10 determines whether or not an external request for termination of projection has been made (S114). If the projection has not ended (S114: No), the process returns to step S100. In addition, when it is requested from the outside that projection of the projector device 10 should be finished in step S114 (S114: Yes), this flowchart is finished.

  FIG. 6 is a flowchart showing an example of operations in steps S104 and S110 in FIG. When the projection unit 100 captures the screen 40 in steps S104 and S110, the projection light generation unit 120 opens the shutters of all the pixels in the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 (S200). . In this case, the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 display uniform colors of red, green, and blue without displaying a projection image on the entire screen. The optical system 130 irradiates uniform white light by projecting these uniform colors on the screen 40 in a superimposed manner. Thereby, the projection unit 100 generates white light strobe light and irradiates the screen 40 with it. In another example, the R liquid crystal shutter 122, the G liquid crystal shutter 124, and the B liquid crystal shutter 126 may display a uniform color in a partial area on the screen. In this case, the projection unit 100 irradiates a part of the screen 40 with uniform white light without projecting a projection image. Further, the writing extraction unit 200 extracts writing in a region irradiated with uniform light on the screen 40.

  Next, the imaging unit 140 images the screen 40 with the CCD image sensor 142 (S202). In this case, since the shutter is fully open, no projection image is projected on the screen 40, and the CCD image sensor 142 acquires the writing directly written on the screen 40 as the captured image. For example, as described with reference to FIG. 3, when there is a writing 410 on the graph in the projection image 400, the projection unit 100 generates white light and irradiates the screen 40, so that the projection image 400 is temporarily displayed. Disappear. In this case, for example, the CCD image sensor 142 acquires a captured image 602b in which the writing 410 is captured. After acquiring the captured image, the projecting unit 100 resumes projecting the projected image (S204). This flowchart is complete | finished by the above. Thereby, when the projection image projected on the screen 40 is directly written on the screen 40, a captured image obtained by imaging the writing can be captured.

  FIG. 7 is a flowchart showing another example of the operations in steps S104 and S110 in FIG. In this example, the CCD image sensor 142 is provided with a large number of pixels that can detect all of red light, green light, and blue light in place of the R pixel, G pixel, and B pixel. These pixels receive incident light without passing through an optical filter such as red, green, or blue. The CCD image sensor 142 captures a captured image with these pixels.

  When the projection unit 100 images the screen 40, the projection light generation unit 120 first opens the shutters of all the pixels in the R liquid crystal shutter 122 (S300). In this case, the projection light generation unit 120 closes the shutters of all the pixels in the G liquid crystal shutter 124 and the B liquid crystal shutter 126. As a result, the projection unit 100 generates a red light strobe and irradiates the screen 40. Then, the imaging unit 140 images the screen 40 with the CCD image sensor 142 (S302). Thereby, the imaging unit 140 acquires a red reflected image that is a captured image obtained by imaging reflected light from the screen 40 with respect to red light.

  Next, the projection light generation unit 120 opens the shutters of all the pixels in the G liquid crystal shutter 124, and closes the shutters of all the pixels in the R liquid crystal shutter 122 and the B liquid crystal shutter 126 (S304). Accordingly, the projection unit 100 generates a green light strobe and irradiates the screen 40 with it. Then, the imaging unit 140 images the screen 40 with the CCD image sensor 142 (S306). Thereby, the imaging unit 140 acquires a green reflected image that is a captured image obtained by imaging reflected light from the screen 40 with respect to green light.

  Next, the projection light generation unit 120 opens the shutters of all the pixels in the B liquid crystal shutter 126, and closes the shutters of all the pixels in the R liquid crystal shutter 122 and the G liquid crystal shutter 124 (S308). Accordingly, the projection unit 100 generates a blue light strobe and irradiates the screen 40 with it. Then, the imaging unit 140 images the screen 40 with the CCD image sensor 142 (S310). Thereby, the imaging unit 140 acquires a blue reflected image that is a captured image obtained by imaging reflected light from the screen 40 with respect to blue light. After acquiring the blue reflection image, the projection unit 100 resumes projecting the projection image (S312). This flowchart is complete | finished by the above.

  As described above, in this example, the projection unit 100 sequentially irradiates each of uniform red light, green light, and blue light. Further, the CCD image sensor 142 sequentially captures each of the red reflection image, the green reflection image, and the blue reflection image in accordance with each of the red light, the green light, and the blue light irradiated by the projection unit 100. The writing extraction unit 200 extracts the writing written on the screen 40 based on the red reflection image, the green reflection image, and the blue reflection image. The writing extraction unit 200 may extract writing based on a color image generated by superimposing a red reflection image, a green reflection image, and a blue reflection image. According to this example, writing can be appropriately extracted.

  Here, when an image sensor including R pixels, G pixels, and B pixels is used as the CCD image sensor 142, each of the red component, the green component, and the blue component of the light reflected from the screen 40 is subjected to CCD imaging. Detection is performed only by some pixels of the element 142. In this case, the resolution of the red reflection image, the green reflection image, and the blue reflection image is smaller than the total number of pixels of the CCD image sensor 142. However, in this example, each pixel of the CCD image sensor 142 detects all of red light, green light, and blue light. Therefore, according to this example, a high-resolution red reflection image, green reflection image, and blue reflection image corresponding to the total number of pixels of the CCD image sensor 142 can be generated. Further, according to this example, writing can be extracted with higher accuracy by using these red reflection image, green reflection image, and blue reflection image. In another example, the CCD image sensor 142 may capture each of the red reflection image, the green reflection image, and the blue reflection image in a different order from the present example.

  As described above, according to the present embodiment, when the projection image projected on the screen 40 is directly written on the screen 40, the writing is captured and saved, and later reproduced together with the projection image. , You can see the writing.

  In the above embodiment, the projector device 10 inputs a projection image by communicating with the PC 30, but the method for inputting the projection image is not limited to this. As another example, a readable / writable storage medium may be attached to the projector apparatus 10 and the projection image data may be acquired from the storage medium.

  In the above embodiment, the write extraction unit 200, the write storage unit 160, the write reproduction unit 180, the communication unit 280, and the write printing unit 300 are provided in the PC 30. However, each of these functional units may be built in the projector device 10.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows the projector system 60 using the projector apparatus 10 which concerns on embodiment of this invention. 4 is a block diagram showing functions of projector device 10 and PC 30. FIG. It is a figure explaining an example of operation | movement of the projector apparatus 10 and PC30. 3 is a diagram illustrating an example of a detailed configuration of a write extraction unit 200. FIG. 4 is a flowchart showing an operation in which projector device 10 and PC 30 capture and store a writing on screen 40. It is a flowchart which shows an example of operation | movement of step S104 in FIG. 5, and S110. It is a flowchart which shows the other example of operation | movement of step S104 in FIG. 5, and S110.

Explanation of symbols

10 projector device, 20 other projector device, 30 PC, 40 screen, 42 writing instrument, 44 user, 50 other screen, 60 projector system, 70 other PC, 80 printer, 100 projector, 112 R light source, 114 G Light source, 116 B light source, 120 projection light generation unit, 122 R liquid crystal shutter, 124 G liquid crystal shutter, 126 B liquid crystal shutter, 128 coupling prism, 130 optical system, 132 half mirror, 134 projection lens, 140 imaging unit, 142 CCD imaging Element, 144 Captured image processing unit, 160 Write storage unit, 180 Write reproduction unit, 200 Write extraction unit, 280 Communication unit, 300 Write printing unit, 400 Projected image, 410 write, 412 write, 414 write, 502 Optical system operation detection unit, 5 04 imaging instruction unit, 506 initial image storage unit, 508 difference image generation unit, 600 screen, 602 captured image, 604 dirt, 606 magnet

Claims (13)

A projection unit that projects a projection image onto a screen;
A projector apparatus comprising: an imaging unit that images the screen. The projection unit projects the projection image onto the screen,
The imaging unit generates a captured image obtained by imaging the screen,
The projector device includes:
A writing extraction unit that extracts writing directly written on the screen from the captured image;
The projector device according to claim 1, further comprising: a writing storage unit that stores the electronic data of the projection image and the writing extracted by the writing extraction unit in association with each other.   The projector apparatus according to claim 2, wherein the writing extraction unit generates the projection image based on electronic data of the projection image, and extracts the writing based on a difference of the captured image with respect to the generated projection image. .   The writing / reproducing unit according to claim 2, further comprising a writing / reproducing unit that reproduces the projection image and the writing based on the electronic data and the writing stored in the writing storage unit, and projects the projected image and the writing onto the screen by the projection unit. Projector device.   The projector apparatus according to claim 2, further comprising: an external transmission unit that transmits the writing stored in the writing storage unit to the outside together with electronic data of the projection image associated with the writing.   The projector device according to claim 2, further comprising a writing printing unit that prints the projection image and the writing based on the electronic data and the writing stored in the writing storage unit. When the imaging unit captures the screen, the projection unit irradiates at least a part of the screen with uniform light without projecting the projection image,
The projector device according to claim 2, wherein the writing extraction unit extracts the writing in an area irradiated with the uniform light. The imaging unit generates a plurality of the captured images captured at different timings,
The projector apparatus according to claim 7, wherein the writing extraction unit extracts the writing written between each time the plurality of captured images are captured based on a difference between the plurality of captured images. When an optical system for projecting the projected image onto a screen is operated, the imaging unit generates one captured image,
The projector device according to claim 8, wherein the writing extraction unit extracts the writing based on a difference between the one captured image and another captured image captured after the one captured image.   The projector device according to claim 7, wherein the projection unit emits white light as the uniform light. The projection unit sequentially irradiates each of red light, green light, and blue light as the uniform light,
The imaging unit has an imaging element that captures the captured image by a plurality of pixels, each of which can detect all of red light, green light, and blue light,
8. The writing extraction unit extracts the writing based on the captured images sequentially captured by the imaging device according to each of red light, green light, and blue light irradiated by the projection unit. The projector apparatus as described. The projection unit
A liquid crystal panel for displaying the projected image;
A light source that generates light to be transmitted through the liquid crystal panel;
An optical system for projecting the projected image displayed on the liquid crystal panel onto the screen by irradiating the screen with light transmitted through the liquid crystal panel;
When the imaging unit images the screen, the liquid crystal panel displays a uniform color without displaying the projection image in at least a part of the area on the screen,
The optical system irradiates the uniform light by projecting the uniform color displayed on the liquid crystal panel,
The projector apparatus according to claim 7, wherein the writing extraction unit extracts the writing in an area irradiated with the uniform light. Project the projected image onto the screen,
Generating a captured image of the screen;
The writing written directly on the screen is extracted from the captured image,
A writing acquisition method for storing electronic data of the projection image and the extracted writing in association with each other.

Images