JP2010061411A - Image projector, image synthesizer, image projection method and image projection program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image projector, image synthesizer, image projection method and image projection program capable of projecting a synthetic image even when there is a part where information overlaps. <P>SOLUTION: A writing time when information is written on a whiteboard is acquired, and the whiteboard with the information written thereon is imaged. An imaged whiteboard image is transmitted to the other image projector as an imaged image at an own-location with the writing time added thereto. The imaged image of the own-location is received as an imaged image of other-location by the other image projector (S31). An information image, as an image corresponding to each piece of information written on the whiteboard, included in the imaged image at other-location is extracted (S32), and respective information images are synthesized into one image while the position of the information image in the imaged image of other-location is retained (S33). Here, the synthetic image is synthesized so that the information image with the last writing time added to the imaged image of other-location is foregrounded (S33). Then, the synthetic image is projected (S35). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention provides an image projection apparatus and an image composition apparatus for installing information entry boards, which are boards capable of entering information, at a plurality of bases, and sharing information entered on the information entry boards at the respective bases. The present invention relates to an image projection method and an image projection program.

  In recent years, information conference boards that can be used to fill in information such as whiteboards are installed at multiple locations, and remote conferences are often held in which information entered on the information entry boards at each location is shared by each location. It has become to. In order to realize such a remote conference, an image projection device is installed at each site. When information is entered on the information entry board, the image projection apparatus images the information entry board. And the captured image which each image projection apparatus imaged is collected, and those captured images are synthesize | combined so that it may become one image. At this time, an information image corresponding to each piece of information entered on the information entry board included in each captured image is extracted, and each information image is stored in one image while maintaining the position of the information image in the captured image. Composite to the image. Then, a composite image, which is a composite image, is transmitted to each image projection device. Each image projection device projects the composite image onto the information entry board. By doing so, it is possible to make each conference participant think that the remote conference is progressing with one information entry board even though there are conference participants at a plurality of bases. Therefore, the remote conference can proceed smoothly.

Moreover, in the invention described in Patent Document 1, in the remote conference, each image projection apparatus, except for the information entered on the information entry board of the site where the image projector is installed, information entry boards of other sites The above composite image is created using only the information entered in. In this way, when the composite image is projected onto the information entry board, the conference participant can easily grasp the information entered on the information entry board or the projected information.
JP 2005-253067 A

  By the way, in the remote conference described above, a conference participant at each site may look at the information projected on the information entry board and enter other information on the information. In such a case, since the computer cannot determine which information should be created in the overlapping portion of the information, the composite image cannot be created. Accordingly, there has been a problem that the composite image cannot be projected on the information entry board.

  The present invention has been made in view of the above problems, and an image projection apparatus, an image composition apparatus, an image projection method, and an image projection capable of projecting a composite image even when there is a portion where information overlaps. The purpose is to provide a program.

  In order to achieve the above object, an image projection apparatus according to claim 1 is provided with an information entry board capable of entering information at a plurality of bases, an imaging means for imaging the information entry board at each base, and the information An acquisition means for acquiring entry time, which is a time when information is entered on the entry board, and a captured image taken by the imaging means at the own location taken by the imaging means via the network with the entry time An image projection apparatus provided at each site used in an image projection system including a transmission unit that transmits to another site, the other site captured image that is the captured image at the other site transmitted by the transmission unit, and When there are a plurality of other site captured images received by the receiving unit and the receiving unit receiving the entry time attached thereto, the information entry board included in the other site captured images Extracting an information image that is an image corresponding to each information entered in the information, and combining the information images into one image while maintaining the position of the information image in the image taken at the other site, A combining unit that combines the information image with the latest entry time attached to the captured image at the other site with the forefront, and a combined image that is the image combined by the combining unit is projected onto the information entry board. And a projecting means.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, the image projecting device includes the image capturing unit, the acquiring unit, and the transmitting unit.

  According to a third aspect of the present invention, in addition to the configuration of the first or second aspect of the invention, the image projecting device further includes a synchronizing unit that synchronizes the time acquired by the acquiring unit with the other image projecting device. It is characterized by providing.

  According to a fourth aspect of the present invention, in addition to the configuration of the invention according to any one of the first to third aspects, the projecting unit is configured to display the composite image when the imaging unit images the information entry board. The projection is stopped.

  According to a fifth aspect of the present invention, in addition to the configuration of the invention according to any one of the first to fourth aspects, the imaging means images the information entry board at a predetermined period, and the acquisition means The imaging unit compares the captured image captured last time with the captured image captured this time, and acquires the entry time when a difference is detected between them.

  According to a sixth aspect of the present invention, in addition to the configuration of the fifth aspect of the present invention, the imaging unit is configured so that the acquisition unit can acquire the entry time by a change in a pixel unit of the captured image. The imaging cycle is determined.

  The image composition apparatus according to claim 7 is provided with an information entry board and an image projection apparatus capable of entering information at a plurality of bases, and each image projection apparatus has the information entry board at its own base where information is entered. The captured image is transmitted to the image composition device, and the image composition device receives the captured image transmitted from each image projection device, and the information entry board included in the captured image. An information image that is an image corresponding to each piece of information entered in is extracted, and the information images are combined into a single image while maintaining the position of the information image in the captured image. An image projection system that transmits a composite image to each image projection device, and each image projection device projects the composite image transmitted from the image synthesis device onto the information entry board. The image synthesizing apparatus used, wherein the image projection system includes an acquisition unit that acquires an entry time, which is a time when information is entered on the information entry board, and the captured image with the entry time. Transmitting means for transmitting to the image synthesizer via a network, and the image synthesizer is an information image with the latest entry time attached to each captured image when the captured image is synthesized. It is characterized by combining with the forefront.

  The image projecting method according to claim 8 is an image projecting method in which information entry boards capable of entering information are installed at a plurality of bases, an imaging step for imaging the information entry boards at each base, and the information entry board In the acquisition step of acquiring the entry time, which is the time when the information is entered in, the collection step of collecting the captured images taken at the respective locations taken in the imaging step with the entry time, and the collection step An information image that is an image corresponding to each information entered in the information entry board included in the captured image at each collected base is extracted, and the position of the information image in the captured image is retained Combining each information image into one image, wherein the information image with the latest entry time attached to the captured image To to to a synthesis step of synthesizing, characterized in that it comprises a projection step of projecting the synthesized image synthesized in the synthesizing step to the information entry board.

  An image projection program according to claim 9 causes a computer to execute various steps of the image projection method according to claim 8.

  According to the image projecting apparatus of the first aspect, the receiving unit can receive the other-site captured image that is a captured image at the other site transmitted by the transmitting unit and the entry time. Then, when there are a plurality of other site captured images received by the receiving unit, the synthesizing unit extracts an information image that is an image corresponding to each information entered on the information entry board included in the other site captured images. Thus, each information image can be combined into one image while maintaining the position of the information image in the image taken at the other site. At that time, the information image with the latest entry time attached to the image taken at the other site can be combined with the information image at the forefront. The projecting unit can project a composite image, which is an image synthesized by the synthesizing unit, onto the information entry board.

  Thus, even if there is a portion where information overlaps, a composite image can be created, so that the composite image can be projected. In the composite image, the latest information image is the foreground. That is, since the old information image is not projected in the foreground, the remote conference can proceed without a sense of incongruity.

  Further, as in the image projecting device of claim 2, since the image projecting device is provided with the image pickup unit, the obtaining unit, and the transmitting unit, the same effect as that of the invention described in claim 1 can be obtained only by the image projecting device.

  According to a third aspect of the present invention, in addition to the effect of the first or second aspect of the invention, the time acquired by the acquisition means is synchronized by the synchronization means between the image projection apparatuses. When the means synthesizes the information image, the latest information image can be accurately brought to the forefront.

  According to a fourth aspect of the present invention, in addition to the effect of the first aspect of the present invention, when the imaging unit images the information entry board, the projection unit stops projecting the composite image. The same information as the information entered on the information entry board is not projected. Therefore, the conference participant can easily grasp the information entered on the information entry board.

  In addition to the effect of the invention according to any one of claims 1 to 4, the image projection apparatus according to claim 5 can acquire the entry time.

  Further, in addition to the effect of the invention according to claim 5, the image projection apparatus according to claim 6 can acquire an accurate entry time.

  According to the image composition device of the seventh aspect, the acquisition unit of the image projection system can acquire the entry time which is the time when the information is entered on the information entry board. Further, the transmission means of the image projection system can transmit the captured image with the entry time to the image composition device via the network. Then, when combining the captured images, the image composition device can combine the information with the latest entry time attached to each captured image as the foreground.

  Thus, even if there is a portion where information overlaps, a composite image can be created, so that the composite image can be projected. In the composite image, the latest information image is the foreground. That is, since the old information image is not projected in the foreground, the remote conference can proceed without a sense of incongruity.

  According to the image projecting method of the eighth aspect, the information entry board at each site can be imaged in the imaging step. In addition, in the obtaining step, the entry time that is the time when the information is entered on the information entry board can be obtained. Thereafter, in the collecting step, the picked-up images picked up in the picking-up step can be collected with the entry time added. Next, in the synthesis step, an information image corresponding to each piece of information entered in the information entry board included in the captured image at each location collected in the collecting step is extracted, and the information image in the captured image is extracted. The respective information images can be combined into one image while maintaining the position of. At this time, information with the latest entry time attached to the captured image can be combined with the forefront information. Thereafter, in the projection step, the synthesized image synthesized in the synthesis step can be projected onto the information entry board.

  Thus, even when there is a portion where information overlaps, a composite image is created, so that each image projection device can project the composite image. In the composite image, the latest information is the foreground. That is, since the old information is not projected in the foreground, the remote conference can proceed without a sense of incongruity.

  If the image projection program of claim 9 is executed by a computer, the effect of claim 8 can be obtained.

(First embodiment)
Hereinafter, a first embodiment of an image projection apparatus, an image projection method, and an image projection program according to the present invention will be described. In the first embodiment, as an example, it is assumed that the image projectors 10a to 10c and the whiteboards 20a to 20c are respectively installed at the three locations A to C. FIG. 1 is a diagram showing an outline of an image projection system 1 of the present embodiment. As shown in FIG. 1, in the image projection system 1, the image projection apparatuses 10 a to 10 c provided at the sites A to C are connected to each other via a network 30. The white boards 20a to 20c correspond to the “information entry board” of the present invention. The image projector 10a and the whiteboard 20a are provided at the site A, the image projector 10b and the whiteboard 20b are provided at the site B, and the image projector 10c and the whiteboard 20c are provided at the site C. The whiteboards 20a to 20c are boards on which information can be entered with an entry pen (not shown). The image projection system 1 is a system applied to a remote conference held at a plurality of bases A to C. And the meeting participant in each base AC can enter information on the whiteboard 20a-20c of own base AC, and the information entered on the whiteboard 20a-20c of other base AC is It is projected on the white boards 20a to 20c of the bases A to C. That is, this is a system for sharing information entered on the whiteboards 20a to 20c among a plurality of bases A to C.

  First, the configuration of the image projectors 10a to 10c will be described with reference to FIG. FIG. 2 is a block diagram showing a schematic configuration of the image projectors 10a to 10c. As shown in FIG. 2, the image projecting devices 10 a to 10 c include a control circuit 101, a camera 102, a timing device 103, a projector 104, an entry end signal input device 105, and a communication unit 109.

  The control circuit 101 includes a CPU 106, a ROM 108, and a RAM 107, which are connected to each other via a bus. The CPU 106 executes various arithmetic processes in accordance with programs stored in the ROM 108. The RAM 107 has a role of temporarily storing information in the course of arithmetic processing, and is provided with a plurality of captured image storage areas. Examples of the arithmetic processing performed by the CPU 106 include imaging processing for imaging the whiteboards 20a to 20c, and projection processing for projecting the image captured at the other site, which is a captured image captured by the camera 102 of the other image projection apparatuses 10a to 10c. . These imaging processing and projection processing will be described later with reference to flowcharts.

  The camera 102 is a digital camera incorporating an image pickup device such as a CCD or CMOS, and is installed at a position where the whiteboards 20a to 20c provided at the bases A to C can be imaged. Based on the control signal from the control circuit 101, the camera 102 images the whiteboards 20 a to 20 c at the bases A to C, and outputs the captured image data to the control circuit 101.

  The time measuring device 103 measures the current time and inputs it to the CPU 106. Further, when the imaging process is executed, the times of the three timing devices 103 of the image projection devices 10a to 10c are synchronized. The projector 104 is a device that projects the image taken at the other site, the projection planes are the whiteboards 20a to 20c of the sites A to C, and the projection range 104a is the imaging range 102a of the camera 102 as shown in FIG. The installation position is determined so as to be the same.

  The entry completion signal input device 105 is a device that inputs an entry completion signal indicating that entry of information on the whiteboards 20 a to 20 c is completed to the control circuit 101. As an example, the entry end signal input device 105 can be realized by a normal switch. That is, when the switch is operated by the conference participant, an entry end signal is input to the control circuit 101. In addition to providing a device for outputting weak radio waves to the entry pen, an entry end signal input device 105 may be provided in the vicinity of the whiteboards 20a to 20c as a device for receiving the weak radio waves. Here, the intensity of the weak radio wave is determined so that the entry end signal input device 105 cannot receive the weak radio wave when the writing pen is separated from the whiteboards 20a to 20c by a predetermined distance or more. Then, the entry end signal input device 105 inputs the entry end signal to the control circuit 101 when the weak radio wave cannot be received. By doing so, the conference participants can input an entry completion signal to the control circuit 101 by separating the entry pen from the whiteboards 20a to 20c when entry of information on the whiteboards 20a to 20c is completed. . Note that the communication unit 109 is a device for communicating via the network 30.

  Next, imaging processing executed by the control circuit 101 of the image projection apparatuses 10a to 10c having the above configuration will be described with reference to a flowchart shown in FIG. FIG. 4 is a flowchart of imaging processing executed by the control circuit 101. This imaging process is started simultaneously when the remote conference is started. First, in this imaging process, a time synchronization process (S11) is performed in which the times of the three timing devices 103 of the image projection apparatuses 10a to 10c are synchronized with the same time. In this time synchronization processing (S11), the timing device 103 of the other image projection devices 10a to 10c may be synchronized with the timing device 103 of any of the image projection devices 10a to 10c, or the time of the image projection devices 10a to 10c. Each timing device 103 may be synchronized with a time server (not shown) provided on the network 30. The CPU 106 that performs the process of S11 corresponds to the “synchronizing means” of the present invention.

  Next, it is determined whether or not a predetermined period has elapsed based on time data from the time measuring device 103 (S12). This period is 1/60 second, for example. Here, the process does not proceed until the predetermined period elapses. Then, when the predetermined period has elapsed (S12: YES), the cameras 102 of the image projection devices 10a to 10c are caused to image the whiteboards 20a to 20c, respectively (S13).

  Next, the captured image is stored in the storage area of the captured image in the RAM 107 (S14). Next, the previous captured image stored in the RAM 107 is compared with the current captured image, and it is determined whether a difference is detected between the images (S15). If no difference is detected (S15: NO), the process returns to S12. If a difference is detected (S15: YES), the process proceeds to S16. Therefore, the whiteboards 20a to 20c are repeatedly imaged at a predetermined period until a difference is detected in the captured images. The predetermined period is determined so that the difference can be detected in units of pixels of the captured image. Also, the fact that a difference has been detected means that the conference participant has started to enter information on the whiteboards 20a to 20c.

  Then, in the processing of S16, it is determined whether or not the entry of information on the whiteboards 20a to 20c is completed depending on whether or not the entry end signal is input from the entry end signal input device 105. Here, this step is executed until an entry end signal is input (S16: NO). Therefore, the imaging by the camera 102 is temporarily stopped until the entry end signal is input. On the other hand, when it is determined that entry of information on the whiteboards 20a to 20c has been completed when the entry completion signal is input (S16: YES), the current time is acquired from the timing device 103 (S17). Note that S17 is a process corresponding to the “acquisition step” of the present invention. The CPU 106 that executes S17 corresponds to the “acquiring means” of the present invention.

  Next, it is determined that the entry of information has been completed (S16: YES), the camera 102 that is photographing the whiteboards 20a to 20c is caused to image the whiteboards 20a to 20c, and the captured image data is received from the camera 102 ( S18). That is, among the whiteboards 20a to 20c, the whiteboards 20a to 20c in which information is written are imaged. The camera 102 corresponds to the “imaging unit” of the present invention, and the processes of S13 and S18 are processes corresponding to the “imaging step” of the present invention.

  Next, the captured image data in S18 is used as a captured image of the local site, and the local site captured image is attached with the entry time acquired in S17, and transmitted to the other image projection apparatuses 10a to 10c via the network 30 (S19). ). Thereafter, the process returns to S12. Therefore, every time information is written on the whiteboards 20a to 20c, the time when the information is written is added, and the captured image of the own base is transmitted to the other 10a to 10c. The CPU 106 that executes S19 corresponds to the “transmission unit” of the present invention.

  Next, projection processing executed by each control circuit 101 of the image projection apparatuses 10a to 10c will be described with reference to the flowchart of FIG. FIG. 5 is a flowchart of a projection process executed by the control circuit 101 by controlling the projector 104. This projection process is started when the remote conference is started. The projection process is executed in parallel with the above-described imaging process.

  First, it is determined whether or not the image transmitted by the other image projecting apparatuses 10a to 10c as the captured image at the local site is received as the captured image at the other site (S31). Here, when the other-site captured image is received (S31: YES), the process proceeds to S32, and when not received (S31: NO), the process proceeds to S35. Note that the above-mentioned entry time is attached to the image taken at the other site. The process in which the determination in S31 is YES is a process corresponding to the “reception unit” of the present invention. The process in which the determinations in S19 and S31 are YES corresponds to the “collection step” of the present invention.

  6 is a diagram showing the whiteboard 20a provided at the site A, FIG. 7 is a diagram showing the whiteboard 20b provided at the site B, and FIG. 8 is a whiteboard 20c provided at the site C. FIG. As shown in FIG. 6, the white board 20a provided at the site A is filled with information 90a that says “to leave the manager at this side”. Further, as shown in FIG. 7, the information 90 b of “minutes 1. agenda 2. contents” is entered in the whiteboard 20 b provided at the site B. Also, as shown in FIG. 8, the information 90c “3. Discussion” is entered in the whiteboard 20c provided at the site C. Therefore, in S110, the image projection device 10a receives the other-site captured image including the information 90b and the other-site captured image including the information 90c. In addition, the image projection device 10b receives the other base image including the information 90a and the other base image including the information 90c. In addition, the image projection device 10c receives the other-site captured image including the information 90a and the other-site captured image including the information 90b. The entry time attached to the image taken at the other site including the information 90a is “10:02 on June 10, 2008”, and the image taken at the other site including the information 90b. The entry time is “June 10, 2008, 10:00”, and the entry time attached to the image captured at the other site including the information 90c is “June 10, 2008, 10:01”.

  Next, an information image that is an image corresponding to each piece of information entered in the whiteboards 20a to 20c included in the image taken at the other site is extracted (S32). Specifically, paying attention to each pixel constituting the image picked up at the other site, the information image is extracted by collecting pixels whose color is different from the color corresponding to the color of the whiteboards 20a to 20c. It should be noted that the extracted information image is attached with the position information in the other site captured image of the information image. Here, the position information is coordinates when the origin is a predetermined position (for example, the center point of the image captured at the other site) of the image captured at the other site. In S32, when the already extracted information is included in the image taken at the other site, the information image corresponding to the information is not extracted.

  S32 will be described with reference to the examples of FIGS. 6 to 8. The image projection apparatus 10a extracts an information image 91b corresponding to the information 90b shown in FIG. 7 and an information image 91c corresponding to the information 90c shown in FIG. It will be. Further, the image projection device 10b extracts an information image 91a corresponding to the information 90a shown in FIG. 6 and an information image 91c corresponding to the information 90c shown in FIG. Further, the image projection apparatus 10c extracts an information image 91a corresponding to the information 90a shown in FIG. 6 and an information image 91b corresponding to the information 90b shown in FIG.

  Next, if the information image extracted in S32 and the information image stored in the RAM 107 in S34, which will be described later, are referred to the positional information attached to each information image, the origin of each information image is referred to. By matching, the information images are combined into one image while maintaining the position of the information image in the image taken at the other site (S33). At this time, the information image with the latest entry time attached to the image taken at the other site is combined with the information image at the forefront. 6 to 8, the image projecting device 10a combines the information image 91b and the information image 91c into one image. At this time, the entry time corresponding to the information image 91b is “June 10, 2008 10:00”, and the entry time corresponding to the information image 91c is “June 10, 2008 10:01”. Therefore, the information image 91c is combined before the information image 91b. FIG. 9 shows a composite image P10 obtained by combining the information image 91b and the information image 91c. As described above, since the information image 91b and the information image 91c do not overlap each other, in this case, the same composite image is obtained regardless of which is preceded.

  In addition, the image projection device 10b combines the information image 91a and the information image 91c into one image. At this time, the entry time corresponding to the information image 91a is “June 10, 2008 10:02”, and the entry time corresponding to the information image 91c is “June 10, 2008 10:01”. Therefore, the information image 91a is combined before the information image 91c. FIG. 10 shows a composite image P20 obtained by combining the information image 91a and the information image 91c. As described above, since the information image 91a and the information image 91c do not overlap each other, in this case, the same composite image is obtained no matter which is preceded.

  In addition, the image projection device 10c combines the information image 91a and the information image 91b into one image. At this time, the entry time corresponding to the information image 91a is “June 10, 2008 10:02”, and the entry time corresponding to the information image 91b is “June 10, 2008 10:00”. Therefore, the information image 91a is combined before the information image 91b. FIG. 11 shows a composite image P30 obtained by combining the information image 91a and the information image 91b. As described above, since the information image 91a and the information image 91b do not overlap each other, in this case, the same composite image is obtained regardless of which is preceded. The CPU 106 that executes S32 and S33 corresponds to “combining means” of the present invention, and S111 and S112 correspond to “combining step” of the present invention.

  Next, the information image is stored in the RAM 107 in association with the entry time (S34). In the cases shown in FIGS. 6 to 8, FIG. 12 shows the contents stored in the RAM 107 of the image projection apparatus 10a, and FIG. 13 shows the contents stored in the RAM 107 of the image projection apparatus 10b. FIG. 14 shows the contents stored in the RAM 107 of the image projection apparatus 10c. As shown in FIG. 12, the information image 91b, the information image 91c, and their entry times are stored in the RAM 107 of the image projection apparatus 10a. Further, as shown in FIG. 13, the information image 91a, the information image 91c, and their entry times are stored in the RAM 107 of the image projection apparatus 10b. As shown in FIG. 14, the information image 91b, the information image 91c, and their entry times are stored in the RAM 107 of the image projection apparatus 10c. Note that the information image stored in S34 is used in S33 as described above.

  Next, the synthesized image synthesized in S33 is output to the projector 104 and projected on the whiteboards 20a to 20c (S35). 6 to 8, the composite image P10 (see FIG. 9) is projected on the whiteboard 20a, the composite image P20 (see FIG. 10) is projected on the whiteboard 20b, and the whiteboard 20c is projected. A composite image P30 (see FIG. 11) is projected. As a result, the information shown in FIG. 15 is displayed on each of the whiteboards 20a to 20c, and the conference participation is performed as if the remote conference is progressing at each of the bases A to C with one whiteboard. Can make you think.

  Next, it is determined whether or not it is time to instruct the camera 102 to take an image (S36). If it is determined that it is time to instruct imaging (S36: YES), the projector 104 is instructed to stop projecting the composite image (S37). The reason for this is to prevent projection of the same information as the information entered on the whiteboards 20a to 20c at each of the sites A to C. Therefore, the conference participant can easily grasp the information entered on the whiteboards 20a to 20c. Thereafter, the process returns to S31. Then, the projection of the composite image is resumed through the processes of S31 to S33. In S36, when it is not the timing for instructing imaging (S36: NO), the process returns to S31. In this case, the projection of the composite image is continued through the processes of S31 to S33. The CPU 106 that executes S35 to S37 corresponds to the “projection unit” of the present invention, and S35 to S37 corresponds to the “projection step” of the present invention.

  In the example of FIGS. 6 to 8, a strike-through line “=” for canceling “2. content” is shown at a position corresponding to “2. content” which is a part of the information image 90 b of the whiteboard 20 c. Assume that information 90d is entered. The entry time when the strikethrough “=” is entered is “10:05 on June 10, 2008”. 16 to 18 are diagrams showing the white boards 20a to 20c at that time. 16 shows the whiteboard 20a, FIG. 17 shows the whiteboard 20b, and FIG. 18 shows the whiteboard 20c. As shown in FIG. 18, the whiteboard 20c has a strikethrough “=” written at a position corresponding to “2. Contents”.

  In this case, the image projection apparatus 10c acquires the entry time “June 10, 2008 10:05” in which the strikethrough “=” is entered (FIG. 4, S17), and images the whiteboard 20c (FIG. 4). 4, S18). After that, the captured image is used as a captured image at the local site, and the entry time “June 10, 2008, 10:05” is added and transmitted to the image projectors 10a and 10b (FIG. 4, S19). Then, in S31, the image projection devices 10a and 10b receive the other-site captured image (FIG. 5, S31: YES), and extract the information image 91d corresponding to the strikethrough “=” from the other-site captured image (FIG. 5). 5, S32). Thereafter, the image projection apparatus 10a combines the information image 91d and the information image 91b and the information image 91c (see FIG. 11) stored in the RAM 107 into one image. At this time, as described above, the information image with the latest entry time is synthesized so that it becomes the foreground. In this case, since the entry time of the information image 91d is the latest, the information image 91d is the foreground. FIG. 19 shows a composite image P11 at that time. As shown in the figure, “2. Contents” and “=” overlap. FIG. 21 is an enlarged view of the portion. As shown in the figure, “=” precedes “2. Contents”. Therefore, since the old information image is not projected in the foreground, the remote conference can proceed without a sense of incongruity.

  The image projection device 10b combines the information image 91d and the information image 91a and the information image 91c (see FIG. 12) stored in the RAM 107 into one image. FIG. 20 is a diagram showing the composite image P21. As shown in the figure, the information image 91d, the information image 91a, and the information image 91c do not overlap each other, and therefore the same composite image is obtained regardless of which information image is the foreground.

  As described above, the image projecting apparatuses 10a to 10c of the image projecting system 1 according to the present embodiment acquire the entry time when information is entered in the whiteboards 20a to 20c (S17), and image the whiteboards 20a to 20c (S18). ). Then, the captured image captured in S18 is transmitted as a self-portion captured image to the other image projection apparatuses 10a to 10c with an entry time (S19). The other image projection devices 10a to 10c receive the captured image of the local site as the captured image of the other site (S31: YES). Then, an information image corresponding to each information entered in the whiteboards 20a to 20c included in the image taken at the other site is extracted (S32), and the position of the information image in the image taken at the other site is held. The information images are combined into one image (S33). At this time, the information image with the latest entry time attached to the image taken at the other site is combined with the information image at the forefront. Then, the synthesized composite image is projected (S34).

  Thereby, even if there is a portion where information overlaps, a composite image can be created, so that the composite image can be projected. In the composite image, the latest information image is the foreground. That is, since the old information image is not projected in the foreground, the remote conference can proceed without a sense of incongruity.

  Further, since the current time is synchronized between the image projection apparatuses 10a to 10c (S11), the latest information image can be accurately brought to the forefront.

  When the camera 102 captures the whiteboards 20a to 20c, the projector 104 stops projecting the composite image (S37), so the information entered in the whiteboards 20a to 20c at the respective locations A to C. Can be prevented from projecting the same information. Therefore, the conference participant can easily grasp the information entered on the whiteboards 20a to 20c.

  Further, the image projection apparatuses 10a to 10c capture the whiteboards 20a to 20c with the camera 102 at predetermined intervals (S12, S13), and compare the captured image captured last time with the captured image captured this time. Is detected (S15: YES), the entry time is acquired (S16). The predetermined period is determined so that the difference can be detected in pixel units of the captured image. Therefore, an accurate entry time can be acquired.

(Second Embodiment)
Next, a second embodiment of the image projection apparatus, the image composition apparatus, the image projection method, and the image projection program according to the invention will be described. FIG. 22 is a diagram showing an outline of the image projection system 2 of the present embodiment. As shown in the figure, the image projection system 2 includes an image projection device 11 and a whiteboard 21 corresponding to the “information entry board” of the present invention at each of the sites A to C. In each of the bases A to C, the image projection apparatus 11 is connected to the network 30, and various information can be transmitted and received between the bases A to C via the network 30. Further, the image projection system 2 includes an image composition device 40 connected to the network 30. Hereinafter, the image projection system 2 will be described. Note that the configurations of the image projection device 11 and the whiteboard 21 are the same as those in the first embodiment, and a description thereof will be omitted.

  The image projection apparatus 11 images the whiteboard 21 at its own bases A to C where information is written. Further, the image projection device 11 acquires the entry time when information is entered on the whiteboard 21. Further, the image projecting device 11 transmits the captured image captured by the image projecting device 11 to the image synthesizing device 40 via the network 30 with an entry time.

  The image composition device 40 receives the captured images transmitted from the image projection devices 11 and extracts information images that are images corresponding to the information entered on the whiteboard 21 included in the captured images. Then, each information image is combined into one image while maintaining the position of the information image in the captured image. At this time, the information image with the latest entry time attached to each captured image is synthesized with the information image at the forefront. Thereafter, a composite image that is a composite image is transmitted to each image projection device 11. Each image projection device 11 receives the composite image and projects the composite image.

  Here, the operation of the image projection system 2 will be described in detail. The image projecting device 11 executes the imaging process shown in FIG. 4 of the first embodiment. Since this imaging process is the same as in the first embodiment, a description thereof will be omitted.

  Next, processing executed by the image composition device 40 will be described with reference to the flowchart of FIG. Note that the processing of this flowchart is executed at regular intervals. First, it is determined whether or not the captured images transmitted from the respective bases A to C have been received (S51). If a captured image has not been received (S51: NO), the process of this flowchart is terminated. On the other hand, when a captured image is received (S51: YES), an image corresponding to each piece of information entered on the whiteboard 21 included in the captured image by the same processing as S32 shown in FIG. 5 of the first embodiment. Is extracted (S52).

  Next, by the same processing as S33 shown in FIG. 5 of the first embodiment, if the information image extracted in S52 and the information image stored in itself in S54 to be described later, the information image is the information image in the captured image. Each information image is combined into one image while maintaining the position of (S53). In this case, the information image with the latest entry time attached to the captured image is combined with the foreground as the foreground. Next, the information image is stored in association with the entry time (S54). Note that the information image stored in S54 is used in S53 as described above. Next, the composite image synthesized in S53 is transmitted to the image projectors 11 at the respective bases A to C (S55). Then, the process of this flowchart is complete | finished.

  Next, projection processing executed by the image projection apparatuses 11 at the respective bases A to C will be described with reference to the flowchart of FIG. This projection process is started when the remote conference is started. The projection process is executed in parallel with the imaging process. First, the composite image transmitted from the image composition device 40 is received (S71). Next, the composite image is projected onto the whiteboard 21 (S72). Next, the same processing as S36 and S37 shown in FIG. 5 of the first embodiment is executed (S73, S74).

  As described above, even if a device for creating a composite image is provided separately from the image projection device, the same effect as in the first embodiment can be obtained. The image composition device 40 may create another composite image for each of the bases A to C when creating the composite image. For example, when creating a composite image for base A, the captured images from base B and base C are combined. When creating a composite image for the base B, the captured images from the base A and the base C are combined. Further, when creating a composite image for the base C, the captured images from the base A and the base B are combined. By doing so, it is possible to prevent the same information as the information written on the whiteboard 21 from being projected at each of the sites A to C. Therefore, the conference participant can easily understand the information entered on the whiteboard 21.

  The image projecting device, the image synthesizing device, the image projecting method, and the image projecting program according to the present invention are not limited to the above-described embodiment, and various modifications may be made without departing from the spirit of the present invention. For example, in the first and second embodiments, the entry time is acquired in units of images, but the entry time may be acquired in units of pixels. For example, when a difference is detected in the pixels, the entry time is acquired, the whiteboards 20a to 20c and 21 are captured, and the captured images are transmitted to the other image projection apparatuses 10a to 10c or the image composition apparatus 40. The image projecting devices 10a to 10c or the image synthesizing device 40 that have received the captured images synthesize the images, and the image projecting devices 10a to 10c and 11 project the synthesized images. In this way, the latest information image can be brought to the forefront more accurately, and the composite image can be projected even while information is being entered, so that the remote conference can have a sense of realism.

  In the first and second embodiments, the time up to the minute unit is acquired as the entry time. However, the time up to a finer unit may be acquired. By doing so, the latest information image can be brought to the forefront more accurately.

  In the first and second embodiments, the current time is acquired as the entry time. However, the relative time between the image projection apparatuses 10a to 10c and 11 may be acquired. That is, the time based on the time synchronization is acquired. Even if it does in this way, the same effect as a 1st and 2nd embodiment is acquired.

  In the first and second embodiments, the remote conference between the three sites has been described. However, the present invention can be applied to any number of sites as long as there are a plurality of sites.

  In the first embodiment, the imaging process shown in FIG. 4 may be executed by an apparatus other than the image projecting apparatuses 10a to 10c. That is, the image projection devices 10a to 10c execute only the projection processing shown in FIG.

It is the figure which showed the outline of the image projection system 1 in 1st Embodiment. It is the block diagram which showed schematic structure of the image projectors 10a-10c. 2 is a diagram illustrating an imaging range 102a of a camera 102 and a projection range 104a of a projector 104. FIG. 3 is a flowchart of imaging processing executed by a control circuit 101. 3 is a flowchart of projection processing executed by a control circuit 101. It is the figure which showed the whiteboard 20a. It is the figure which showed the white board 20b. It is the figure which showed the whiteboard 20c. It is the figure which showed the synthesized image P10. It is the figure which showed the synthesized image P20. It is the figure which showed the synthesized image P30. It is the figure which illustrated the content memorize | stored in RAM107 of the image projector 10a. It is the figure which illustrated the content memorize | stored in RAM107 of the image projector 10b. It is the figure which illustrated the content memorize | stored in RAM107 of the image projector 10c. It is the figure which showed whiteboard 20a-20c when a synthesized image is projected. It is the figure which showed the whiteboard 20a. It is the figure which showed the white board 20b. It is the figure which showed the whiteboard 20c. It is the figure which showed the synthesized image P11. It is the figure which showed the synthesized image P21. In the composite image P11, it is an enlarged view of a portion where information overlaps. It is the figure which showed the outline of the image projection system 2 in 2nd Embodiment. 5 is a flowchart showing processing executed by the image composition device 40. 5 is a flowchart showing a projection process executed by the image projection apparatus 11.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 2 Image projection system 10a-10c, 11 Image projection apparatus 20a-20c, 21 White board 30 Network 40 Image composition apparatus 102 Camera 103 Timing apparatus 104 Projector 105 Input completion signal input apparatus

Claims (9)

An information entry board capable of entering information is provided at a plurality of bases, and at each base, an image pickup means for picking up the information entry board, and acquisition of obtaining the entry time which is the time when the information is entered on the information entry board And an image projection system comprising: a transmission means for transmitting a self-captured image, which is a captured image at the local site, captured by the imaging unit to the other site via the network with the entry time. An image projection apparatus provided at each site,
Receiving means for receiving the other base captured image that is the captured image at the other base transmitted by the transmitting means and the entry time attached thereto;
When there are a plurality of the other-site captured images received by the receiving means, extract an information image that is an image corresponding to each information entered in the information entry board included in the other-site captured images, The information image is synthesized into one image while maintaining the position of the information image in the image taken at the other site, and the information image with the latest entry time attached to the image taken at the other site is obtained. A synthesis means for synthesizing the forefront,
An image projecting apparatus comprising: a projecting unit that projects a synthesized image, which is the image synthesized by the synthesizing unit, onto the information entry board.   The image projection apparatus according to claim 1, wherein the image projection apparatus includes the imaging unit, the acquisition unit, and the transmission unit.   The image projection apparatus according to claim 1, further comprising a synchronization unit that synchronizes a time acquired by the acquisition unit with another image projection apparatus.   The image projecting device according to claim 1, wherein the projecting unit stops projecting the composite image when the image capturing unit captures the information entry board. The imaging means images the information entry board at a predetermined cycle,
The acquisition unit compares the captured image captured by the imaging unit with the captured image captured this time, and acquires the entry time when a difference is detected between them. The image projection apparatus in any one of.   The image projecting apparatus according to claim 5, wherein a period in which the imaging unit captures an image is determined so that the acquisition unit can acquire the entry time by a change in a pixel unit of the captured image. An information entry board and an image projection device capable of entering information are installed at a plurality of locations, and each image projection device images the information entry board at its location where information is entered, and images the captured images. The image composition device receives the captured image transmitted from each image projection device and corresponds to each information entered on the information entry board included in the captured image. An information image that is an image is extracted, and each information image is combined into one image while maintaining the position of the information image in the captured image, and the combined image that is the combined image is combined with each image projection device. The image synthesizing apparatus used in the image projecting system for projecting the synthesized image transmitted from the image synthesizing apparatus onto the information entry board. There is,
The image projection system includes:
Obtaining means for obtaining entry time, which is the time when information is entered on the information entry board;
A transmission means for transmitting the captured image with the entry time to the image composition device via a network;
The image synthesizing apparatus, when synthesizing the captured images, synthesizes the information image with the latest entry time attached to each captured image with the foreground as the foreground. An image projection method in which information entry boards capable of entering information are installed at multiple locations,
An imaging step of imaging the information entry board at each site;
An acquisition step of acquiring an entry time which is a time when information is entered in the information entry board;
A collecting step of collecting the captured images at the respective locations imaged in the imaging step with the entry time;
An information image that is an image corresponding to each information entered in the information entry board included in the captured image at each location collected in the collecting step is extracted, and the position of the information image in the captured image is determined. A step of combining the information images into one image while holding the image, and a combining step of combining the information image with the latest entry time attached to the captured image as the foreground;
A projecting step of projecting the synthesized image synthesized in the synthesizing step onto the information entry board.   An image projection program for causing a computer to execute various steps of the image projection method according to claim 8.

Images