JP2010147517A - Image processing unit, projector, overhead camera, program, and image storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide, an image processing unit etc. capable of generating partially changed images easily according to user's intention. <P>SOLUTION: The image processing unit 102 includes: an image information input section 110 for inputting first image information indicating a first image and second image information indicating a second image; a region data generation section 130 for generating region data 124 indicating different regions for the first and second images, based on the first image information and the second image information; and an image generation section 150 for generating a third image, where at least one portion of the region is changed, in the region of the first image, based on the region data 124 and the first image information. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing device, a projector, a document camera, a program, and an information storage medium.

For example, Japanese Patent Application Laid-Open No. 2000-115603 describes that a document camera captures an imaged object and generates a captured image, and a projector projects the captured image.
JP 2000-115603 A

  When a lesson is conducted using printed materials with questions and answers printed using such a document camera and projector, the teacher must display the answer part in advance after hiding the answer part. It was necessary to prepare a printed material with only the problem and a printed material with the problem and the answer.

  Also, for example, when multiple questions and answers are printed on a single printed document, the teacher attaches sticky notes etc. to all the answer parts, and answers while removing the sticky notes one question at a time However, the work of removing the sticky note paper and the work of placing the printed material on the document camera mounting table had to be repeated for each problem, which was very time-consuming.

  An object of the present invention is to provide an image processing apparatus, a projector, a document camera, a program, and an information storage medium capable of easily generating an image in which a part of the image is changed according to the user's intention. .

  In order to solve the above problems, an image processing apparatus according to the present invention includes first image information indicating a first image, second image information indicating a second image, and an image information input unit that inputs the second image information. An area data generating unit that generates area data indicating different areas between the first image and the second image based on the first image information and the second image information; and the area data; An image generation unit configured to generate a third image in which at least a part of the region of the first image is changed based on the first image information.

  In addition, a projector according to the present invention includes the image processing apparatus and a projection unit that projects an image generated by the image generation unit.

  The document camera according to the present invention includes the image processing device and an imaging unit that generates the first image information.

  In addition, the program according to the present invention causes the computer to execute the first image and the second image based on the first image information indicating the first image and the second image information indicating the second image. Based on the region data generation unit that generates region data indicating a region different from the image, the region data, and the first image information, at least a part of the region in the first image is changed. It is characterized by functioning as an image generation unit for generating a third image.

  An information storage medium according to the present invention is an information storage medium that stores a computer-readable program, and stores the program.

  According to the present invention, the projector or the like generates region data indicating different regions in the two images and generates a third image in which the different regions are changed, so that the user generates the third image in advance. There is no need to do. Thereby, the projector or the like can easily generate an image in which a part of the image is changed according to the user's intention.

  An image processing apparatus according to the present invention includes an image information input unit that inputs first image information indicating a first image, and a target included in the first image based on the first image information. Based on the area data generation unit that generates area data indicating an area having at least one of a color, a pattern, and a shape, the area data, and the first image information, the first image in the first image And an image generation unit that generates a third image in which at least a part of the region is changed.

  In addition, a projector according to the present invention includes the image processing apparatus and a projection unit that projects an image generated by the image generation unit.

  The document camera according to the present invention includes the image processing device and an imaging unit that generates the first image information.

  Further, the program according to the present invention has at least one of a target color, pattern, and shape included in the first image based on the first image information indicating the first image. A region data generating unit that generates region data indicating a region; a third region in which at least a part of the region in the first image is changed based on the region data and the first image information; It is made to function as an image generation part which produces | generates an image, It is characterized by the above-mentioned.

  An information storage medium according to the present invention is an information storage medium that stores a computer-readable program, and stores the program.

  According to the present invention, the projector or the like generates region data indicating a target region in the image and generates a third image in which the region is changed, so that the user generates the third image in advance. There is no need to do. Thereby, the projector or the like can easily generate an image in which a part of the image is changed according to the user's intention.

  The image processing apparatus includes a control unit that causes the image generation unit to generate the third image, and the control unit instructs the image information input by the image information input unit to generate the third image. Is included in the image information input unit, and the image information input by the image information input unit does not include the instruction image. An image based on information may be generated.

  According to this, the image processing apparatus or the like generates a third image when the instruction image is included, and generates a normal image when the instruction image is not included, thereby generating an image according to the user's intention. Can be generated.

  In addition, the image generation unit may generate an image in which a region other than the region of the instruction image in the region is filled as the third image.

  According to this, the image processing apparatus or the like can generate an image in which the answer portion is filled, for example.

  The image generation unit generates a fourth image in which at least a part of the region is returned to a state before the change based on the operation information, the region data, and the first image information. May be.

  According to this, the image processing apparatus or the like can return to the original state after changing the area once. Thus, for example, the image processing apparatus or the like can generate an image that also displays the answer portion after generating the image in a state where the answer portion of the image indicating the question and the answer is hidden.

  Hereinafter, embodiments in which the present invention is applied to a projector and a document camera will be described with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all the configurations shown in the following embodiments are not necessarily essential as means for solving the invention described in the claims.

(First embodiment)
First, the projector generates original image information (first image information) indicating an original image (first image) from the document camera, and a partial change image (second image) obtained by changing a part of the original image. A description will be given of an embodiment in which partial change image information (second image information) to be input is input and different areas are filled and displayed in the original image and the partial change image.

  FIG. 1 is a functional block diagram of the document camera 200 and the projector 100 in the first embodiment. The document camera 200 includes an operation unit 270, first image information indicating a first image obtained by imaging an imaging target, and a partial change image indicating a partial change image obtained by changing a part of the first image. The image capturing unit 280 that generates information and an output unit 290 that outputs image information from the image capturing unit 280 to the projector 100 are included.

  The projector 100 includes region information indicating different regions between the first image and the partial change image based on the image information input unit 110 that inputs image information from the document camera 200, the first image information, and the partial change image information. 124, an area data generation unit 130 that generates 124, a storage unit 120 that stores image data 122, area data 124, and the like, a control unit 140 that performs various controls, an image generation unit 150 that generates various images, The projector 160 includes a projection unit 160 that projects the image. Further, the image information input unit 110, the storage unit 120, the area data generation unit 130, the control unit 140, and the image generation unit 150 are formed as the image processing apparatus 102.

  Note that the projector 100 and the document camera 200 may implement the functions of these units using the following hardware. For example, the projector 100 includes an image information input unit 110 such as a USB interface and a wireless LAN unit, a storage unit 120 such as a RAM, an area data generation unit 130, a control unit 140 such as a CPU, an image generation unit 150 such as an image processing circuit, and the like. The projection unit 160 may be mounted using a lamp, a liquid crystal panel, a liquid crystal driving circuit, a lens, or the like.

  Further, for example, the document camera 200 may be mounted using an operation button or the like for the operation unit 270, a CMOS camera or the like for the imaging unit 280, a USB interface, a wireless LAN unit, or the like for the output unit 290. The transmission path between the projector 100 and the document camera 200 may be a wireless transmission path such as a wireless LAN or a wired transmission path such as a USB cable.

  Further, the projector 100 may implement the functions of the area data generation unit 130 and the like by reading a program stored in the information storage medium 300. As such an information storage medium 300, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD, or the like can be applied.

  Next, a processing procedure of the projector 100 when a different area between the original image and the partial change image is displayed is described. FIG. 2 is a flowchart illustrating a processing procedure of the projector 100 according to the first embodiment.

  The user pastes a sticky note with an asterisk instructed to generate a partially hidden image on the upper left of the base paper on which the two questions and the answers to each question are written, and a yellow sticky note on the answer part. The base paper is placed on the mounting table of the camera 200. Note that the sticky note paper is a paper that can be attached and detached.

  The imaging unit 280 captures an imaging target placed on the mounting table at all times or at regular time intervals, and generates image information indicating a captured image. The output unit 290 outputs image information to the projector 100 at all times or at regular time intervals.

  FIG. 3 is a diagram illustrating an example of the original image 400 in the first embodiment. FIG. 4 is a diagram illustrating an example of the partial change image 410 in the first embodiment. For example, the original image 400 is a captured image of a raw paper, and the partial change image 410 includes a mark (instruction image) 420 indicating a sticky note with a star mark and sticky note images 430 and 431 indicating a yellow sticky note. Including.

  The control unit 140 determines whether the image information is input from the document camera 200 by the image information input unit 110 (step S1), and determines whether the projector 100 is in the operable mode when the image information is input (step S1). Step S2). The projector 100 is normally in the normal mode, the partial non-display mode when the partial change image 410 is input, and the operable mode when the partial non-display image is being projected and returned to the state before the change according to the operation. Shall be set to Since the first time is a normal mode, it is not an operable mode. The mode may be set by the controller 140 changing the value of the flag stored in the controller 140 or the storage unit 120, for example.

  The image information input unit 110 stores the image information as a part of the image data 122 in the storage unit 120 (step S4). Based on the image data 122, the control unit 140 determines whether or not there is a mark 420 in the latest image information (step S5). For example, the control unit 140 may determine the presence or absence of the mark 420 by searching for RGB values in a predetermined region at the upper left of the image.

  When there is the mark 420, the control unit 140 sets the projector 100 to the partial non-display mode (step S6). As described above, when the user sticks a sticky note with a star mark on the upper left of the base paper, the projector 100 is set to the partial non-display mode.

  Next, the user removes the sticky note attached to the base paper and places the base paper on the mounting table of the document camera 200. The projector 100 inputs original image information indicating an original image (original paper image).

  In this case, the control unit 140 determines that there is no mark in the determination in step S5, and determines whether the mode is the partial non-display mode (step S7). In this case, since it is the partial non-display mode, the control unit 140 causes the region data generation unit 130 to generate the region data 124. The area data generation unit 130 generates area data 124 based on the image data 122. Specifically, for example, the area data generation unit 130 generates area data 124 indicating different areas in the original image 400 and the partial change image 410 based on the original image information and the partial change image information included in the image data 122. (Step S8).

  The area data 124 may be, for example, data indicating the upper left coordinate position, width, and height of the mark 420 and data indicating the upper left coordinate position, width, and height of the sticky note images 430 and 431.

  In the partial non-display mode, the image generation unit 150 generates a partial non-display image (third image) based on the image data 122 and the region data 124, and the projection unit 160 projects the image. (Step S9).

  FIG. 5 is a diagram illustrating an example of an image 500 in the first embodiment. For example, the image generation unit 150 fills the mark 420 with a color around the mark 420 (for example, white) based on the region data 124, and the sticky note images 430 and 431 for any color (for example, black). , Surrounding colors, etc.) to generate an image (third image) 500. In the image 500, the portion of the mark 420 is filled with white as the surrounding color, and the portions of the sticky note images 430 and 431 are filled with black. In other words, in the image 500, the answer portion to which the sticky note is pasted so as to be hidden by the user is changed compared to the original image 400.

  The control unit 140 sets the projector 100 to the operable mode when the partially non-displayed image 500 is projected (step S10).

  Next, the user presses an operation button of the document camera 200. The output unit 290 outputs operation information from the operation unit 270 to the projector 100. The input unit 190 inputs the operation information.

  If the information input to the image processing apparatus 102 is not image information, the control unit 140 determines whether the information is operation information (step S12). If it is operation information, the control unit 140 determines whether or not the projector 100 is in an operable mode (step S13).

  When the operation mode is enabled, the image generation unit 150 generates an image whose non-display is canceled (returned to the state before the change) based on the operation information, the image data 122 of the original image, and the region data 124, and the projection unit 160 projects the image (step S14).

  FIG. 6 is a diagram illustrating another example of the image 501 in the first embodiment. FIG. 7 is a diagram illustrating another example of the image 502 in the first embodiment. For example, when the user operates the operation button once in a state where the image 500 is projected, the image generation unit 150 generates an image (fourth image) 501 in which the first painted area is unfilled. . When the user operates the operation button twice, the image generation unit 150 generates an image (fourth image) 502 in which the first and second fill areas are unfilled. Note that the order of the filled areas may be determined according to, for example, the upper left coordinate position indicated by the area data 124.

  In this way, the user can display the answers in order by operating his / her buttons while the answer part is temporarily hidden.

  When image information indicating a new image is input in the operable mode, the control unit 140 sets the projector 100 to the normal mode (step S3). When image information is input in a mode other than the partial non-display mode, the image generation unit 150 generates a normal image based on the image data 122, and the projection unit 160 projects the image (step S11). ).

  The projector 100 determines whether or not to end by turning off the power button or the like (step S15).

  As described above, according to the present embodiment, the projector 100 generates area data 124 indicating different areas in two images and generates an area change image that hides the different areas, so that the user can There is no need to generate a change image. Thus, the projector 100 can easily generate an image in which a part of the image is hidden according to the user's intention.

  Further, according to the present embodiment, the projector 100 generates a region change image when the instruction image (mark 420) is included, and generates a normal image when the instruction image is not included. An image can be generated and projected according to the intention.

  Further, according to the present embodiment, the projector 100 can return to the original state after the area is once painted and projected. Thereby, the projector 100 can generate an image that also displays the answer portion after generating the image in a state where the answer portion of the image indicating the problem and the answer is hidden.

  In particular, according to the present embodiment, the user can present and answer a plurality of problems with two readings by simply performing a task of attaching a sticky note to a base paper and a task of removing a sticky note. The projector 100 and the document camera 200 can be used more easily without performing complicated operations such as image editing.

(Second embodiment)
In the first embodiment, the image processing apparatus 102 is included in the projector 100, but the function of the image processing apparatus 102 may be implemented in the document camera. In the first embodiment, two types of paper are imaged. However, the document camera or the like can also exhibit the same effect as the first embodiment by imaging one type of paper.

  Next, an embodiment will be described in which a document camera is the main body and the same processing as that of the first embodiment is executed by imaging one type of paper.

  FIG. 8 is a functional block diagram of the document camera 201 and the projector 101 in the second embodiment. The document camera 201 includes an operation unit 271, an imaging unit 281, an image processing device 202 similar to the image processing device 102, and an output unit 291.

  The image processing apparatus 202 includes an image information input unit 210, a storage unit 220 that stores image data 222, region data 224, and the like, a region data generation unit 230, a control unit 240, and an image generation unit 250. It is configured.

  The projector 101 includes an input unit 191 that inputs image information and the like from the document camera 201, an image generation unit 152 that generates an image based on the image information, and a projection unit 161 that projects an image. .

  Note that the hardware configuration of each unit is the same as that of the first embodiment, and thus description thereof is omitted. Further, the document camera 201 may read the program from the information storage medium 301 and implement the function of the image processing apparatus 202.

  Next, a processing procedure of the document camera 201 when a region having a target color is filled and displayed will be described. FIG. 9 is a flowchart showing the processing procedure of the document camera 201 in the second embodiment.

  The user pastes a sticky note with an asterisk instructed to generate a partially hidden image on the upper left of the base paper on which the two questions and the answers to each question are written, and paints the answer part semi-transparently with a yellow marker . FIG. 10 is a diagram illustrating an example of an original image (first image) 401 in the second embodiment. In the original image 401 in this case, as shown in FIG. 10, a mark (instruction image) 420 is displayed, and the answer portion is semitransparently painted with a yellow marker.

  The image information input unit 210 determines whether or not there is an operation based on the information from the operation unit 271 (step P1), and inputs the image information (first image information) from the imaging unit 281 when there is no operation. And it memorize | stores in the memory | storage part 220 as image data 222 (step P2).

  The control unit 240 determines whether or not the mark 420 is included in the image based on the image data 222 (step P3). When the mark 420 is included in the image, the region data generation unit 230 generates region data 224 based on the image data 222 in accordance with a control command from the control unit 240 (step P4). Specifically, for example, the area data generation unit 230 temporarily hides an area surrounded by a color that matches the color of the area that should be temporarily hidden (here, the color of the marker by which yellow is applied to the base paper). The area to be displayed may be determined.

  Based on the image data 222 and the region data 224, the image generation unit 250 generates image information (for example, an RGB signal) indicating a partially non-displayed image (third image) (step P5). The partially non-displayed image is, for example, an image similar to the image 500 in FIG.

  The control unit 240 sets the document camera 201 to the operable mode when image information indicating a partially hidden image is generated (step P6). The output unit 291 outputs image information to the projector 101 (step P11).

  The input unit 191 inputs image information from the document camera 201, the image generation unit 152 generates an image based on the image information, and the projection unit 161 projects the image. Thereby, an image similar to the image 500 is projected.

  The user presses the operation button of the document camera 201 to indicate the answer to question 1. When there is an operation, the control unit 240 determines whether or not it is an operable mode (step P9). In the case of the operable mode, the image generation unit 250 indicates an image in which the first painted region is unfilled based on the operation information, the image data 222, and the region data 224 in accordance with a control command from the control unit 240. Image information is generated (step P10). The output unit 291 outputs the image information to the projector 101 (Step P11).

  The input unit 191 inputs image information from the document camera 201, the image generation unit 152 generates an image based on the image information, and the projection unit 161 projects the image.

  FIG. 11 is a diagram illustrating an example of an image 503 in the second embodiment. In the image (fourth image) 503 in which the filling of the first filling area is released (returned to the state before the change) 503, the first answer portion that was the first filling area is translucent yellow. The state (the state before the change) is displayed, and the second filled area is displayed in black.

  In addition, when the user operates the operation button twice, the image generation unit 250 generates image information indicating an image in which the first and second painted areas are unfilled. In this case, the projector 101 projects an image that displays the two answer parts in a yellow translucent state.

  When the user places a base paper without the mark 420 on the mounting table of the document camera 201, the image generation unit 250 generates image information based on the image data 222 (step P7), and the control unit 240 controls the document camera 201. Is set to the normal mode (step P8), and the output unit 291 outputs the image information to the projector 101 (step P11).

  As described above, according to the present embodiment, the document camera 201 can achieve the same functions and effects as the projector 100 of the first embodiment. In addition, according to the present embodiment, the document camera 201 can generate image information indicating a partial change image by capturing one type of base paper, so that the user can perform a presentation or the like more efficiently. .

  In addition, according to the present embodiment, the user can display an image in which the marker portion is temporarily hidden by simply painting the portion that is temporarily hidden with the marker, so that complicated operations such as image editing are performed. The projector 101 and the document camera 201 can be used more easily without performing the above.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A various deformation | transformation is possible. For example, the processing of the first embodiment may be executed mainly by the document camera, or the processing of the second embodiment may be executed by the projector. Further, the first embodiment and the second embodiment may be combined. For example, the document camera may determine an area that is temporarily hidden, notify the projector of information indicating the area, and the projector may project an image while hiding the area that is temporarily hidden based on the information.

  If it is determined that there is a mark (step S3, step P3), the projectors 100 and 101 project an image that allows the user to select whether or not to perform partial non-display, and the operation units 270 and 271 perform user operations. Depending on the operation information indicating the selection may be generated.

  According to this, the projectors 100 and 101 can project an image more reliably according to the user's intention by performing partial non-display according to the user's selection.

  Further, the instruction image is not limited to the mark 420, and may be an arbitrary color, an arbitrary pattern, or an arbitrary shape. For example, the instruction image may be a barcode, a two-dimensional code, or the like, or may be a two-dimensional code that indicates a color or the like of an area that should be temporarily hidden. In addition, the instruction image is not essential, and the image generation unit 150 may generate a third image by painting different areas between the first image and the second image. The image generation unit 250 may A third image may be generated by painting a region having a target color or the like in this image.

  In addition, the region to be temporarily hidden may be a region having at least one of an arbitrary color, an arbitrary pattern, and an arbitrary shape. The user may specify a color, pattern, or shape that is temporarily hidden. For example, the control unit 240 may determine an area having a color that matches the color of the instruction image (for example, an asterisk) as an area to be temporarily hidden.

  Further, the change from the first image in the third image is not limited to filling, and may be, for example, addition of an underline or a pattern, a change in color or the like, blinking, or the like. In addition, the user may specify how to change the area. For example, the control unit 240 may determine how to change the region to be changed according to the change method specified by the instruction image (for example, a two-dimensional code).

  In the above-described embodiment, a method of canceling the non-display of one non-display area for each operation is adopted. However, a method of canceling the non-display of all non-display areas by a single operation. May be adopted. The operation for canceling the non-display of the non-display area is not limited to the operation with the document cameras 200 and 201. For example, the operation with the projectors 100 and 101, the operation with the remote controller, the mouse, or the like may be used. Good.

  The apparatus for generating the image information described above is not limited to the document cameras 200 and 201, and may be a digital camera, a digital video camera, a mobile phone with a camera, a scanner, or the like. Further, the above-described apparatus for generating an image is not limited to the projectors 100 and 101, and may be a PC (Personal Computer), a television, or the like, for example. In addition, the image processing apparatuses 102 and 202 may be mounted on these apparatuses.

  Further, the projectors 100 and 101 are not limited to liquid crystal projectors (transmission type, reflection type such as LCOS), and may be, for example, a projector using DMD (Digital Micromirror Device). DMD is a trademark of Texas Instruments Incorporated.

It is a functional block diagram of the document camera and projector in a 1st Example. It is a flowchart which shows the process sequence of the projector in a 1st Example. It is a figure which shows an example of the original image in a 1st Example. It is a figure which shows an example of the partial change image in a 1st Example. It is a figure which shows an example of the image in a 1st Example. It is a figure which shows another example of the image in a 1st Example. It is a figure which shows another example of the image in a 1st Example. It is a functional block diagram of the document camera and projector in a 2nd Example. It is a flowchart which shows the process sequence of the document camera in a 2nd Example. It is a figure which shows an example of the original image in a 2nd Example. It is a figure which shows an example of the image in a 2nd Example.

Explanation of symbols

  100, 101 Projector, 102, 202 Image processing device, 110, 210 Image information input unit, 120, 220 Storage unit, 122, 222 Image data, 124, 224 Area data, 130, 230 Area data generation unit, 140, 240 Control 150, 250 Image generation unit, 160 Projection unit, 200, 201 Document camera, 270, 271 Operation unit, 280, 281 Imaging unit, 290, 291 Output unit, 300, 301 Information storage medium, 400, 401 Original image ( First image), 410 Partial change image (second image), 420 mark (instruction image), 430, 431 Sticky note image, 500 images (third image), 501 to 503 images (fourth image)

Claims (10)

An image information input unit for inputting first image information indicating a first image and second image information indicating a second image;
A region data generation unit that generates region data indicating regions different between the first image and the second image based on the first image information and the second image information;
An image generation unit configured to generate a third image in which at least a part of the region in the first image is changed based on the region data and the first image information;
including,
Image processing device. An image information input unit for inputting first image information indicating the first image;
An area data generation unit that generates area data indicating an area having at least one of a target color, pattern, and shape included in the first image, based on the first image information;
An image generation unit configured to generate a third image in which at least a part of the region in the first image is changed based on the region data and the first image information;
including,
Image processing device. The image processing apparatus according to claim 1,
A controller that causes the image generator to generate the third image;
When the image information input by the image information input unit includes an instruction image indicating an instruction to generate the third image, the control unit causes the image generation unit to generate the third image, and the image information When the instruction image is not included in the image information input by the input unit, the image generation unit generates an image based on the image information.
Image processing device. The image processing apparatus according to claim 3.
The image generation unit generates an image in which a region other than the region of the instruction image is painted out as the third image.
Image processing device. The image processing apparatus according to any one of claims 1 to 4,
The image generation unit generates a fourth image in which at least a part of the region is returned to the state before the change based on the operation information, the region data, and the first image information.
Image processing device. An image processing apparatus according to claim 1;
A projection unit for projecting the image generated by the image generation unit;
including,
projector. An image processing apparatus according to claim 1;
An imaging unit for generating the first image information;
including,
Document camera. Computer
Based on the first image information indicating the first image and the second image information indicating the second image, region data indicating different regions between the first image and the second image is generated. An area data generation unit;
Based on the region data and the first image information, function as an image generation unit that generates a third image in which at least a part of the region in the first image is changed.
program. Computer
An area data generation unit that generates area data indicating an area having at least one of a target color, pattern, and shape included in the first image, based on first image information indicating the first image. When,
Based on the region data and the first image information, function as an image generation unit that generates a third image in which at least a part of the region in the first image is changed.
program. An information storage medium storing a computer-readable program,
A program according to any one of claims 8 and 9 is stored.
Information storage medium.

Images