JP5899993B2 - Image display device, image display system, and control method of image display device - Google Patents

Description

  The present invention relates to an image display device, an image display system, and a control method for the image display device.

  A computer, a projection display device (projector) that projects an image on a projection surface such as a screen, a selective transmission element that transmits light in a specific wavelength band, an imaging device that images a screen, and a part of the image A presentation system is known that includes an indicator bar (indicator) that emits infrared light from the tip (Patent Document 1). In such a presentation system (interactive system), it is possible to superimpose a drawn image drawn with a pointer (indicator) on a basic image.

JP 2011-28629 A

  In recent years, interactive systems that can use a plurality of indicators are known. However, in such an interactive system, when a plurality of indicators are used by a plurality of people, there is a case where they are erroneously drawn on a line or figure drawn by another person. In such a case, overwriting is performed, which may be inconvenient for the user. For this reason, there has been a demand for an interactive system that does not interfere with another person's drawing area when a plurality of persons use a plurality of indicators.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 An image display device according to this application example is an image display device, and includes a display unit that displays an image, a type detection unit that detects type information indicating the type of a pointer, and the display unit. A position detection unit that detects position information indicating a position indicated by the indicator in the displayed display image; a drawing unit that performs drawing in the display image according to the type information and the position information; and the display In the image, a drawing area setting unit that sets a drawing area that allows drawing by the indicator, and when the drawing area is set by the drawing area setting unit, the drawing performed by the drawing unit And a drawing restriction unit that restricts the region.

  According to such an image display device, the type detection unit detects the type information of the indicator. The position detection unit detects position information indicated by the indicator in the display image. The drawing unit performs drawing in the display image according to the type information and the position information. The drawing area setting unit sets a drawing area that enables drawing with an indicator in the display image. The drawing restriction unit restricts drawing within the drawing area when the drawing area is set. Thereby, the drawing by the indicator can be limited to the set drawing area. That is, drawing outside the drawing area can be avoided.

  Application Example 2 In the image display device according to the application example described above, the type detection unit detects the type information of the first indicator and the second indicator, and the position detection unit detects the first indicator. The position information indicating the position indicated by the indicator and the second indicator is detected, and the drawing area setting unit includes a first drawing area enabling drawing by the first indicator, and the second A second drawing area that allows drawing with the first indicator, and the drawing restriction unit restricts drawing with the first indicator within the first drawing area, and the second instruction. Drawing by a body is limited within the second drawing area.

  According to such an image display device, the type detection unit detects the type information of the first indicator and the second indicator. The position detection unit detects position information indicated by the first indicator and the second indicator in the display image. The drawing unit performs drawing in the display image according to the type information and the position information. The drawing area setting unit sets, in the display image, a first drawing area that allows drawing with the first indicator and a second drawing area that allows drawing with the second indicator. The drawing restriction unit restricts drawing by the first indicator within the first drawing area and restricts drawing by the second indicator to the second drawing area. As a result, if the first drawing area and the second drawing area are set to be different, it is possible to avoid overwriting the drawing area of another indicator. Therefore, when a plurality of indicators are used by a plurality of people, it is possible to avoid interference with the drawing area of another person.

  Application Example 3 In the image display device according to the application example, the position detection unit includes an imaging unit that captures a range including the display image displayed by the display unit and generates a captured image. The position information indicated by each indicator is detected in the display image based on the captured image generated by the imaging unit.

  According to such an image display device, the position detection unit includes the imaging unit, and detects position information indicated by the indicator in the display image based on the captured image. Accordingly, the image display device can be a projector having an imaging unit such as a camera.

  Application Example 4 In the image display device according to the application example, the image display device further includes a state control unit that switches to a drawing area setting state for setting the drawing area, and in the drawing area setting state, the display image includes the display area setting state. When an operation for specifying a range is performed by an indicator, the drawing area setting unit sets the drawing area based on the range specified by the operation.

  According to such an image display device, in the drawing area setting state, when an operation for designating a range is performed by the indicator in the display image, the drawing area setting unit performs the drawing area based on the designated range. Set. Thereby, since the drawing area can be set using the indicator, convenience is improved.

  Application Example 5 In the image display device according to the application example, an operation receiving unit that receives an operation, and a state control unit that switches to a drawing area selection state for selecting a pattern of a drawing area stored in advance And the drawing area setting unit sets the drawing area based on the selected drawing area pattern when a selection operation is performed by the operation receiving unit in the drawing area selection state. To do.

  According to such an image display device, when a selection operation is performed in a drawing area selection state in which a drawing area pattern stored in advance is selected, the drawing area setting unit performs drawing based on the selected drawing area pattern. Set the area. As a result, since the drawing area can be selected from the drawing area patterns stored in advance, the drawing area can be easily set.

  Application Example 6 The image display device according to the application example further includes an operation receiving unit that receives an operation, and a state control unit that switches to a drawing area numerical value input state for designating the drawing area by numerical information. In the drawing area numerical value input state, when a numerical value input operation is performed by the operation receiving unit, the drawing area setting unit sets the drawing area based on the input numerical value.

  According to such an image display device, when a numerical value input operation is performed in a drawing area numerical input state in which a drawing area is designated by numerical information, the drawing area setting unit sets the drawing area based on the input numerical value. To do. As a result, the drawing area can be set directly with a numerical value, so that a detailed drawing area can be set.

  Application Example 7 An image display system according to this application example is an image display system that includes an image display device that displays an image, an image supply device that supplies image information to the image display device, and an indicator. The image display device includes an image information input unit to which the image information is input, a display unit that displays a display image corresponding to the image information, and a type detection that detects type information indicating the type of the indicator. A position detection unit that detects position information indicating a position indicated by the indicator in the display image displayed by the display unit, a type information output unit that outputs type information of the indicator, and the instruction A position information output unit that outputs the position information of a body, and the image supply device includes an image information generation unit that generates the image information, a type information input unit that inputs the type information, and the position information A position information input unit to be input, a drawing unit that performs drawing in the image information based on the position information and the type information, and a drawing that sets a drawing area in which the drawing by the indicator is permitted in the image information An area setting unit, and a drawing restriction unit that restricts drawing performed by the drawing unit within the drawing area when the drawing area is set by the drawing area setting unit.

  According to such an image display system, the image display device includes an image information input unit, a display unit, a type detection unit, a position detection unit, a position information output unit, and a type information output unit. The type detection unit detects type information of the indicator. The position detection unit detects position information indicated by the indicator in the display image. The image supply apparatus includes an image information generation unit, a position information input unit, a type information input unit, a drawing unit, a drawing area setting unit, and a drawing restriction unit. The drawing unit performs drawing in the image information based on the position information and the type information. The drawing area setting unit sets a drawing area in which drawing by the indicator is permitted in the image information. When the drawing area is set, the drawing restriction unit restricts drawing by the drawing unit within the drawing area. Thereby, the drawing by the indicator can be limited to the set drawing area. That is, drawing outside the drawing area can be avoided.

  Application Example 8 An image display apparatus control method according to this application example is an image display apparatus control method including a display unit that displays an image, and a type detection that detects type information indicating the type of an indicator. A position detecting step for detecting position information indicating a position indicated by the indicator in the display image displayed by the display unit, and drawing in the display image in accordance with the type information and the position information. A drawing step to be performed; a drawing region setting step for setting a drawing region that allows drawing by the indicator in the display image; and the drawing region is set by the drawing region setting step. A drawing restriction step of restricting drawing to be performed within the drawing area.

  According to such a control method of the image display apparatus, it is possible to limit the drawing by the indicator to the set drawing area. That is, drawing outside the drawing area can be avoided.

  Further, when the image display device, the image display system, and the control method for the image display device described above are constructed using a computer provided in the image display device or the image display system, the above form and the above application example Can be configured in the form of a program for realizing the function or a recording medium on which the program is recorded so as to be readable by the computer. Recording media include flexible disk, HDD (Hard Disk Drive), CD-ROM (Compact Disk Read Only Memory), DVD (Digital Versatile Disk), Blu-ray Disc (registered trademark), magneto-optical disk, nonvolatile memory card The computer reads the image display device or the computer's internal storage (semiconductor memory such as RAM (Random Access Memory) and ROM (Read Only Memory)), and external storage (USB (Universal Serial Bus) memory, etc.) A variety of possible media can be utilized.

1 is a block diagram illustrating a configuration of a projector according to a first embodiment. Explanatory drawing of the menu image which selects a drawing area pattern. Explanatory drawing of the menu image which inputs the coordinate of a drawing area. Explanatory drawing of the projection image which designates a drawing area with a light-emitting pen. The flowchart of the drawing process of a projector. It is explanatory drawing of the relationship between a drawing area | region and a drawing figure, (a) is explanatory drawing of a drawing area | region, (b) is explanatory drawing of drawing operation, (c) is explanatory drawing of a drawing area | region and a drawing figure. The block diagram which shows the structure of the image display system which concerns on 2nd Embodiment. The flowchart of the drawing process of an image display system.

(First embodiment)
Hereinafter, as a first embodiment, a projector as an image display device that captures a projected image and detects a drawing operation in the projected image based on the captured image will be described.

FIG. 1 is a block diagram illustrating a configuration of the projector according to the first embodiment.
FIG. 1 shows a projector 100 including light emitting pens 501, 502, 503, and 504 as indicators, a personal computer (PC) 200, and a projection surface S such as a whiteboard.

  The projector 100 includes an image projection unit 10, a control unit 20, an operation reception unit 21, an image signal input unit 31, an image processing unit 32, a detection unit 50, and the like.

  The image projection unit 10 includes a light source 11, three liquid crystal light valves 12R, 12G, and 12B as light modulation devices, a projection lens 13 as a projection optical system, a light valve drive unit 14, and the like. The image projection unit 10 modulates the light emitted from the light source 11 with the liquid crystal light valves 12R, 12G, and 12B to form image light. The image light is projected from the projection lens 13 and displayed on the projection surface S or the like. To do. The image projection unit 10 and the projection surface S correspond to a display unit.

  The light source 11 includes a discharge-type light source lamp 11a made of an ultra-high pressure mercury lamp, a metal halide lamp, or the like, and a reflector 11b that reflects light emitted from the light source lamp 11a toward the liquid crystal light valves 12R, 12G, and 12B. ing. The light emitted from the light source 11 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and each color light of red R, green G, and blue B, which is the three colors of light, by a color separation optical system (not shown). After being separated into components, they are incident on the liquid crystal light valves 12R, 12G, and 12B, respectively.

  The liquid crystal light valves 12R, 12G, and 12B are configured by a liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. In the liquid crystal light valves 12R, 12G, and 12B, a plurality of pixels (not shown) arranged in a matrix are formed, and a driving voltage can be applied to the liquid crystal for each pixel. When the light valve driving unit 14 applies a driving voltage corresponding to the input image information to each pixel, each pixel is set to a light transmittance corresponding to the image information. For this reason, the light emitted from the light source 11 is modulated by transmitting through the liquid crystal light valves 12R, 12G, and 12B, and an image corresponding to the image information is formed for each color light. The formed color images are synthesized for each pixel by a color synthesis optical system (not shown) to form a color image, and then projected from the projection lens 13.

  The control unit 20 includes a CPU (Central Processing Unit), a RAM used for temporary storage of various data, and a non-volatile memory such as a mask ROM, flash memory, FeRAM (Ferroelectric RAM), etc. (Not shown) and functions as a computer. The control unit 20 performs overall control of the operation of the projector 100 by the CPU operating according to a control program stored in a nonvolatile memory.

  The operation receiving unit 21 receives an input operation from the user, and includes a plurality of operation keys for the user to give various instructions to the projector 100. The operation keys provided in the operation accepting unit 21 are a power key for switching power on / off, a menu key for switching display / non-display of a menu screen for performing various settings, and a cursor movement on the menu screen. Cursor keys to be displayed, determination keys for determining various settings, and the like. When the user operates (presses) various operation keys of the operation receiving unit 21, the operation receiving unit 21 receives this input operation and outputs an operation signal corresponding to the operation content of the user to the control unit 20. The operation receiving unit 21 may be configured using a remote control (not shown) capable of remote operation. In this case, the remote controller transmits an operation signal such as an infrared ray corresponding to the operation content of the user, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 20.

  The image signal input unit 31 is provided with an input terminal (not shown) for connection with the PC 200 via the cable C1, and an image signal is input from the PC 200. The image signal input unit 31 converts the input image signal into image information in a format that can be processed by the image processing unit 32, and outputs the image information to the image processing unit 32.

  The image processing unit 32 converts the image information input from the image signal input unit 31 into image data representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B, and outputs the image data to the light valve driving unit 14. Here, the converted image data is for each color light of R, G, B, and is composed of a plurality of pixel values corresponding to all the pixels of each liquid crystal light valve 12R, 12G, 12B. The pixel value determines the light transmittance of the corresponding pixel, and the intensity (gradation) of light emitted from each pixel is defined by the pixel value. Further, the image processing unit 32 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like on the converted image data based on an instruction from the control unit 20. Further, the image processing unit 32 generates image data such as a menu image based on an instruction from the control unit 20.

  The image processing unit 32 includes a drawing memory 32a and a drawing area information storage unit 32b. The drawing memory 32a stores drawing data based on drawing operations by the light-emitting pens 501, 502, 503, and 504. The image processing unit 32 at this time corresponds to a drawing unit. The drawing area information storage unit 32b stores drawing area information set for each of the light emitting pens 501, 502, 503, and 504. The drawing area information represents a drawing area in which drawing by each of the light emitting pens 501, 502, 503, and 504 is permitted in the drawing memory 32a (that is, in the projected image).

  The image processing unit 32 inputs position information and type information of the light-emitting pens 501, 502, 503, and 504 from the detection unit 50. Here, the type information is information indicating the type of the light-emitting pens 501, 502, 503, and 504 that are indicators, and different type information is assigned to the light-emitting pens 501, 502, 503, and 504, respectively. The position information is information representing the position indicated by the light-emitting pens 501, 502, 503, and 504 in the image (display image) displayed by the image projection unit 10. The image processing unit 32 determines whether or not the position where the drawing operation of the light emitting pens 501, 502, 503, and 504 is performed is within the range represented by the drawing area information, and stores the drawing data in the drawing memory 32a. . Then, the image processing unit 32 outputs image data based on the drawing data in the drawing memory 32 a to the light valve driving unit 14.

Here, the setting of the drawing area information will be described.
In the projector 100 according to the present embodiment, a plurality of drawing area patterns are stored in advance in a non-volatile memory (not shown) in the image processing unit 32.
FIG. 2 is an explanatory diagram of a menu image for selecting a drawing area pattern. When the menu key provided in the operation receiving unit 21 is pressed and the drawing area selection menu is selected, the control unit 20 instructs the image processing unit 32 to display the drawing area selection menu image M1 shown in FIG. . The state where the drawing area selection menu image M1 is displayed corresponds to the drawing area selection state. Further, the control unit 20 at this time corresponds to a state control unit.

  On the upper part of the drawing area selection menu image M1, a character string of “drawing area pattern” is displayed. In the center of the drawing area selection menu image M1, “not divided”, “pattern 1”, “pattern 2”, and “pattern 3” are displayed as selection candidates. “Pattern 1” to “Pattern 3” in the present embodiment represent various patterns obtained by dividing the drawing area into four. When the user selects a desired pattern from the drawing area pattern candidates displayed in the drawing area selection menu image M1, the control unit 20 instructs the image processing unit 32 to display the drawing area information. The storage unit 32b is caused to set information on the drawing area of the pattern.

In the projector 100, the position information of the drawing area can be numerically input.
FIG. 3 is an explanatory diagram of a menu image for inputting the coordinates of the drawing area. When the menu key provided in the operation accepting unit 21 is pressed and the drawing area coordinate input menu is selected, the control unit 20 instructs the image processing unit 32 to display the drawing area coordinate input menu image M2 shown in FIG. Let The state where the drawing area coordinate input menu image M2 is displayed corresponds to the drawing area numerical value input state.

  A character string “drawing area coordinate input” is displayed on the upper part of the drawing area coordinate input menu image M2. In the central portion of the drawing area coordinate input menu image M2, as a coordinate input area, "area 1" corresponding to the light-emitting pen 501, "area 2" corresponding to the light-emitting pen 502, and "area 3" corresponding to the light-emitting pen 503 are displayed. “Area 4” corresponding to the light-emitting pen 504 is displayed. Parentheses are displayed next to the character strings in the areas 1 to 4 so that the user can input numerical values of coordinates. In the drawing area coordinate input menu image M2, the user uses coordinate keys (positions) of the drawing areas for each of the light emitting pens 501, 502, 503, and 504 by using a cursor key provided in the operation reception unit 21, a numeric key provided in the remote controller, or the like. Information). The input drawing area information is stored in the drawing area information storage unit 32 b of the image processing unit 32 according to an instruction from the control unit 20.

Further, the projector 100 can set the drawing area by operating the light emitting pens 501, 502, 503, and 504 on the projection surface S.
FIG. 4 is an explanatory diagram of a projected image in which a drawing area is designated with the light emitting pen. When the menu key provided in the operation accepting unit 21 is pressed and the drawing area setting menu is selected, the control unit 20 instructs the image processing unit 32 to display the drawing area setting image M3 shown in FIG. The state where the drawing area setting image M3 is displayed corresponds to the drawing area setting state.

A character string “drawing area pen input” is displayed on the upper part of the drawing area setting image M3. A character string “END” is displayed below the drawing area setting image M3. On the projection surface S on which the drawing area setting image M3 is projected, the user performs an operation of drawing a frame using the light-emitting pens 501, 502, 503, and 504, and performs a pressing operation of “END”. The detection unit 50 detects position information and type information. Then, the image processing unit 32 sets the drawing area of each light-emitting pen in the drawing area information storage unit 32b based on the position information and the type information. In the present embodiment, the drawing area is associated with the light-emitting pen used for setting the drawing area. FIG. 4 shows a state in which the drawing area A1 is set by the light-emitting pen 501, and the drawing area A1 is associated with the light-emitting pen 501.
The control unit 20 and the image processing unit 32 described above correspond to a drawing area setting unit.

  Returning to FIG. 1, when the light valve driving unit 14 drives the liquid crystal light valves 12R, 12G, and 12B according to the image data input from the image processing unit 32, the liquid crystal light valves 12R, 12G, and 12B correspond to the image data. An image is formed, and this image is projected from the projection lens 13.

  The detection unit 50 includes an imaging unit 51, an image analysis unit 52, and a detection information generation unit 53. The detection unit 50 is controlled by the control unit 20. The detection unit 50 images the projection plane S, analyzes the image, and detects the positions and types of the light-emitting pens 501, 502, 503, and 504.

  The imaging unit 51 forms an image of light emitted from an imaging target and an imaging element (not shown) such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor on the imaging element. An imaging lens (not shown) is provided. The imaging unit 51 is arranged in the vicinity of the projection lens 13 of the projector 100 and images a range including an image projected on the projection plane S (hereinafter also referred to as “projected image”) at a predetermined frame rate. Then, the imaging unit 51 sequentially generates image information representing captured images (hereinafter also referred to as “captured images”) and outputs the image information to the image analysis unit 52.

  The image analysis unit 52 includes a processing device for image analysis, a memory, and the like (none of which are shown). The image analysis unit 52 analyzes the image information of the captured image input from the imaging unit 51. The image analysis unit 52 outputs the analysis result to the detection information generation unit 53. Note that the image analysis unit 52 converts position information on the captured image into position information on the image based on the image signal.

  The detection information generation unit 53 includes a position detection unit 53a and a light emitting pen identification unit 53b as a type detection unit. The position detection unit 53a detects position information of each of the light emitting pens 501, 502, 503, and 504 based on the analysis result of the image analysis unit 52. The light emitting pen identifying unit 53b detects (identifies) the type information of each light emitting pen 501, 502, 503, 504 based on the analysis result of the image analyzing unit 52. The detection information generation unit 53 outputs position information and type information of the light emitting pens 501, 502, 503, and 504 to the image processing unit 32.

  The light-emitting pens 501, 502, 503, and 504 include a pressure switch and a light-emitting diode that emits infrared light at the tip (pen tip) of a pen-shaped main body. When the user performs an operation (pressing operation) of pressing the pen tip of the light emitting pen against the projection surface S and presses the pressing switch, the light emitting diode emits light. The light emitting pens 501, 502, 503, and 504 have identification marks for identifying the type information by image analysis.

  The nonvolatile memory of the control unit 20 stores software (device driver) for using the light-emitting pens 501, 502, 503, and 504 as drawing devices (indicators). When the software is activated, the image processing unit 32 performs the drawing operation of the light-emitting pens 501, 502, 503, and 504 in the projection image based on the position information and type information input from the detection unit 50. Recognize each position. Then, the image processing unit 32 stores the drawing data in the drawing memory 32 a and outputs image data based on the drawing data to the light valve driving unit 14.

Next, drawing processing by the light emitting pen performed by the projector 100 will be described.
FIG. 5 is a flowchart of the drawing process of the projector 100.

  The imaging unit 51 of the projector 100 captures an image and generates a captured image (step S101). The image analysis unit 52 analyzes the captured image (step S102). And the position detection part 53a of the detection information generation part 53 detects position information based on an analysis result (step S103). Further, the light-emitting pen identifying unit 53b of the detection information generating unit 53 detects light-emitting pen type information (light-emitting pen information) based on the analysis result (step S104).

  Based on the position information and type information of the light emitting pen, the image processing unit 32 determines whether or not the detected light emitting pen can be drawn at the detected position (step S105). That is, it is determined whether or not the detected position information is included in the set drawing area stored in the drawing area information storage unit 32b. When drawing is possible at the detected position (step S105: YES), the image processing unit 32 performs drawing in the drawing memory 32a (step S106). The image processing unit 32 outputs image data based on the drawing data to the light valve driving unit 14 for display (projection) (step S107). The image processing unit 32 at this time corresponds to a drawing restriction unit.

  The detection unit 50 determines whether or not drawing has been completed (step S108). If drawing has not been completed (step S108: NO), the process proceeds to step S101. When the drawing is finished (step S108: YES), the drawing process is finished.

  If drawing is not possible at the detected position (step S105: NO), the image processing unit 32 does not perform drawing on the drawing memory 32a (step S109). Then, the process proceeds to step S107.

Here, drawing with the light emitting pen when the drawing area is set will be described.
6A and 6B are explanatory diagrams of the relationship between the drawing area and the drawing diagram. FIG. 6A is an explanatory diagram of the drawing area, FIG. 6B is an explanatory diagram of the drawing operation, and FIG. It is explanatory drawing.

  As shown in FIG. 6A, in the present embodiment, the drawing area stored in the drawing area information storage unit 32b is a first area A1 corresponding to the light-emitting pen 501 and a second area A2 corresponding to the light-emitting pen 502. The third area A3 corresponding to the light-emitting pen 503 and the fourth area A4 corresponding to the light-emitting pen 504 are divided and set. Note that the entire image that can be set as the drawing area is the entire image area PA.

  In this state, when the operation of drawing the triangle D1 on the projection surface S is performed using the light emitting pen 501 as shown in FIG. 6B, the projected image is as shown in FIG. 6C. Only the figure D2 of the portion included in the first area A1 (broken line) is included.

According to the first embodiment described above, the following effects can be obtained.
(1) The projector 100 can set a drawing area in which drawing is possible for each of the light emitting pens 501, 502, 503, and 504. When the drawing areas are set, the projector 100 restricts the drawing with the light-emitting pens 501, 502, 503, and 504 to the respective drawing areas. Thus, if the drawing area for each light-emitting pen is set to be different, it is possible to avoid overwriting the drawing area of another light-emitting pen. Therefore, when a plurality of light-emitting pens are used by a plurality of people, it is possible to avoid interference with another person's drawing area.

  (2) The projector 100 displays a drawing area selection menu image M1 for selecting a drawing area pattern stored in advance. When the user selects a desired pattern in the drawing area selection menu image M1, the projector 100 sets a drawing area based on the selected drawing area pattern. As a result, since the drawing area can be selected from the drawing area patterns stored in advance, the user can set the drawing area with a simple operation.

  (3) The projector 100 displays a drawing area coordinate input menu image M2 for inputting a drawing area by coordinate information. In the drawing area coordinate input menu image M2, when the user inputs coordinate information numerically, the projector 100 sets a drawing area based on the input coordinates. As a result, the drawing area can be set directly by a numerical value, so that the user can set a detailed drawing area.

  (4) The projector 100 displays a drawing area setting image M3 for causing the light emitting pens 501, 502, 503, and 504 to specify the drawing area within the projected image. When the user performs a drawing operation with the light emitting pen in the drawing area setting image M3, the projector 100 sets the drawing area based on the designated range. Thereby, since the drawing area can be set using the light emitting pen, the convenience for the user is improved.

  (5) Further, in the projector 100, the projection area can be used like a coloring picture by setting the drawing area in various shapes and causing the user to fill the drawing area.

(Second Embodiment)
In the second embodiment, a projector as an image display device that captures a projected image and detects a light-emitting pen in the projected image, and a personal computer (PC) as an image supply device that inputs a detection result and performs drawing processing. An image display system including the above will be described.

FIG. 7 is a block diagram illustrating a configuration of the image display system 1 according to the second embodiment.
FIG. 7 shows light-emitting pens 501, 502, 503, and 504 as projectors that transmit optical signals, a projector 300, a PC 400, and a projection plane S. In addition, about the same component as 1st Embodiment, the same number is used and the overlapping description is abbreviate | omitted.

  The projector 300 includes an image projection unit 10, a control unit 20, an operation reception unit 21, an input / output unit 35, an image processing unit 36, a detection unit 50, and the like.

  The input / output unit 35 is provided with an input terminal and an output terminal (both not shown) for connection with the PC 400 via the cables C2 and C3. An image signal is input from the PC 400 to the input terminal of the input / output unit 35. The input / output unit 35 converts the input image signal into image information in a format that can be processed by the image processing unit 36, and outputs the image information to the image processing unit 36. The input / output unit 35 corresponds to an image information input unit.

  From the output terminal, position information and type information of the light-emitting pens 501, 502, 503, and 504 are output to the PC 400 as detection information detected by the detection information generation unit 53 of the detection unit 50. The input / output unit 35 corresponds to a type information output unit and a position information output unit.

  The image processing unit 36 converts the image information input from the input / output unit 35 into image data representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B. In addition, the image processing unit 36 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like on the converted image data based on an instruction from the control unit 20, and the processed image data Is output to the light valve driving unit 14.

  The PC 400 includes a control unit 60, an operation unit 61, an image processing unit 62, a monitor 63, an input / output unit 70, and the like.

  The control unit 60 is configured by a storage device such as a CPU, ROM, RAM, and hard disk drive (all not shown). The storage device stores an OS (operating system) and application programs. The control unit 60 performs overall control of the operation of the PC 400 by the CPU operating according to a program stored in the ROM or the storage device. In the present embodiment, the storage device stores a drawing program for performing a drawing operation based on position information and type information of the light-emitting pens 501, 502, 503, and 504.

  The operation unit 61 includes a keyboard that receives an input operation from a user, and a pointing device such as a mouse.

  The input / output unit 70 includes an output terminal and an input terminal (both not shown) for connecting to the projector 300 via the cable C2. From the output terminal, the image signal generated by the image processing unit 62 is output to the projector 300.

  Information such as position information and type information is input from the projector 300 to the input terminal. The input / output unit 70 outputs input information to the image processing unit 62 and the control unit 60. The input / output unit 70 corresponds to a type information input unit and a position information input unit.

  The image processing unit 62 performs image signal generation, adjustment processing, drawing processing, and the like. The image processing unit 62 includes a drawing memory 62a and a drawing area information storage unit 62b. The drawing memory 62a stores drawing data based on drawing operations by the light emitting pens 501, 502, 503, and 504. The image processing unit 62 corresponds to an image information generation unit and a drawing unit.

  The drawing area information storage unit 62b stores drawing area information set for each of the light emitting pens 501, 502, 503, and 504. The drawing area information is a drawing area in which drawing is permitted in the drawing memory 62a. The image processing unit 62 inputs the position information and type information of the light-emitting pens 501, 502, 503, and 504 from the input / output unit 70, and the position where the light-emitting pens 501, 502, 503, and 504 are drawn is the drawing area. It is determined whether or not the information is within the range indicated, and the drawing data is stored in the drawing memory 62a. Then, the image processing unit 62 outputs an image signal based on the drawing data to the input / output unit 70. In addition, the image processing unit 62 outputs drawing data to the monitor 63.

  The monitor 63 is a display device. The monitor 63 displays an image based on the drawing data input from the image processing unit 62.

Here, a method for setting the drawing area information will be described.
In the PC 400 of this embodiment, a plurality of drawing area information patterns are stored in advance in a non-volatile memory (not shown) in the image processing unit 62. When the user operates the operation unit 61, the control unit 60 instructs the image processing unit 62 to output the drawing area selection menu image M1 as shown in the first embodiment to the projector 300 or the monitor 63. Display. In the drawing area selection menu image M1, the user selects a desired pattern from the displayed drawing area information pattern candidates, and the drawing area information storage unit 62b of the PC 400 stores the drawing area of the pattern. Information can be set.

In the image display system 1, the position information of the drawing area can be numerically input.
When the user operates the operation unit 61, the control unit 60 issues an instruction to the image processing unit 62, and outputs the drawing area coordinate input menu image M2 as shown in the first embodiment to the projector 300 and the monitor 63. To display. The user can input position information (coordinate information) of the drawing area for each light-emitting pen by using a key or the like provided on the operation unit 61 in the drawing area coordinate input menu image M2. The input drawing area information is stored in the drawing area information storage unit 62b of the PC 400.

Further, the image display system 1 can set the drawing area by operating the light emitting pens 501, 502, 503, and 504 on the projection surface S.
When the user operates the operation unit 61, the control unit 60 instructs the image processing unit 62 to output and display the drawing area setting image M3 as shown in the first embodiment on the projector 300. When the user operates the light emitting pens 501, 502, 503, and 504 on the projection surface S on which the drawing area setting image M3 is projected, the projector 300 detects position information and type information and outputs them to the PC 400. Then, the image processing unit 62 of the PC 400 sets the drawing area of each light emitting pen. The drawing area information is stored in the drawing area information storage unit 62b of the PC 400.
The control unit 60 and the image processing unit 62 described above correspond to a drawing area setting unit.

Next, the drawing process by the light emitting pen performed by the image display system 1 will be described.
FIG. 8 is a flowchart of the drawing process of the image display system 1.

  The imaging unit 51 of the projector 300 performs imaging and generates a captured image (step S201). The image analysis unit 52 of the projector 300 analyzes the captured image (step S202). Then, the position detection unit 53a of the detection information generation unit 53 of the projector 300 detects the position information based on the analysis result (step S203). Further, the light emitting pen identifying unit 53b of the detection information generating unit 53 detects light emitting pen type information (light emitting pen information) based on the analysis result (step S204). Here, the projector 300 outputs the position information and type information of the light emitting pen to the PC 400.

  The image processing unit 62 of the PC 400 determines whether or not the light-emitting pen can draw at the detected position based on the input position information and type information of the light-emitting pen (step S205). That is, it is determined whether or not the detected position information is included in the set drawing area stored in the drawing area information storage unit 62b. If drawing is possible at the detected position (step S205: YES), the image processing unit 62 of the PC 400 performs drawing in the drawing memory 62a (step S206). Then, the image processing unit 62 outputs an image signal based on the drawing data to the projector 300 for projection (display) (step S207). At this time, the image processing unit 62 also outputs and displays image data on the monitor 63. The image processing unit 62 at this time corresponds to a drawing restriction unit.

  The detection unit 50 determines whether or not drawing has been completed (step S208). If drawing has not been completed (step S208: NO), the process proceeds to step S201. When the drawing is finished (step S208: YES), the drawing process is finished.

  If drawing is not possible at the detected position (step S205: NO), the image processing unit 62 does not perform drawing on the drawing memory 62a (step S209). Then, the process proceeds to step S207.

According to the second embodiment described above, the following effects can be obtained.
(1) The image display system 1 can set a drawing area where drawing is possible for each of the light emitting pens 501, 502, 503, and 504. When the drawing areas are set, the image display system 1 restricts the drawing with the light emitting pens 501, 502, 503, and 504 to the respective drawing areas. Thus, if the drawing area for each light-emitting pen is set to be different, it is possible to avoid overwriting the drawing area of another light-emitting pen. Therefore, when a plurality of light-emitting pens are used by a plurality of people, it is possible to avoid interference with another person's drawing area.

  (2) The image display system 1 displays a drawing area selection menu image M1 for selecting a drawing area pattern stored in advance. When the user selects a desired pattern in the drawing area selection menu image M1, the image display system 1 sets a drawing area based on the selected drawing area pattern. As a result, since the drawing area can be selected from the drawing area patterns stored in advance, the user can set the drawing area with a simple operation.

  (3) The image display system 1 displays a drawing area coordinate input menu image M2 for inputting a drawing area by coordinate information. In the drawing area coordinate input menu image M2, when the user inputs coordinate information numerically, the image display system 1 sets a drawing area based on the input coordinates. As a result, since the drawing area can be set directly with a numerical value, the user can set a detailed drawing area.

  (4) The image display system 1 displays a drawing area setting image M3 for designating a drawing area range by the light-emitting pens 501, 502, 503, and 504 in the projected image. In the drawing area setting image M3, when the user operates with the light emitting pen, the image display system 1 sets the drawing area based on the designated range. Thereby, since the drawing area can be set using the light emitting pen, the convenience for the user is improved.

  (5) Further, in the image display system 1, it is possible to use the projected image like a coloring picture by setting the drawing area in various shapes and causing the user to fill it.

  In addition, it is not limited to embodiment mentioned above, It is possible to implement by adding various change, improvement, etc. A modification will be described below.

  (Modification 1) In the above embodiment, numerical values can be input using the drawing area as coordinate information. However, the projector 100 and the image display system 1 can be connected to a network, and the coordinates of the drawing area can be connected to the network from other electronic devices. Information may be entered.

  (Modification 2) In the above embodiment, numerical values can be input using the drawing area as coordinate information. However, an external storage medium such as a USB memory can be connected to the projector 100 or the image display system 1, and drawing can be performed from the external storage medium. You may input the coordinate information of an area | region.

  (Modification 3) In the above embodiment, the indicator is the light-emitting pens 501, 502, 503, and 504 that emit infrared light. However, the indicator is not limited to such a light-emitting pen. For example, an indicator that emits visible light may be used, or radio communication radio waves may be used. The indicator may be a user's finger.

  (Modification 4) In the above embodiment, the projector 100 and the image display system 1 having the four light emitting pens 501, 502, 503, and 504 are shown, but the number of light emitting pens is not limited to four. Further, the number of drawing areas may be set according to the number of light emitting pens.

  (Modification 5) In the above embodiment, the drawing areas to be set do not overlap. However, the drawing areas may be set to overlap. In this case, overlapping area portions may be drawn with a plurality of corresponding light-emitting pens, or may not be drawn.

  (Modification 6) In the above embodiment, an example in which the set drawing area is not displayed (projected) is shown. However, a frame representing each drawing area may be displayed. Further, the display color of the frame may be different from each other. In this way, the user using the light-emitting pen can determine in which area on the projection plane S he can draw.

  (Modification 7) In the above embodiment, the projectors 100, 300 and the PCs 200, 400 are connected by the cables C1, C2, C3, etc., but information may be input / output by wireless communication.

  (Modification 8) In the above embodiment, the projectors 100 and 300 display images based on the drawing data drawn in the drawing memories 32a and 62a. However, the projector 100 and 300 display image information from the outside (such as a video playback device). It is also possible to input and display an image based on the drawing data superimposed on the image based on the image information.

  (Modification 9) In the above embodiment, the light source 11 includes the discharge-type light source lamp 11a. However, an LED (Light Emitting Diode) light source, a solid light source such as a laser, and other light sources are used. You can also.

  (Modification 10) In the above-described embodiment, the projectors 100 and 300 use the transmissive liquid crystal light valves 12R, 12G, and 12B as the light modulators. It is also possible to use a modulation device. In addition, it is possible to use a micromirror array device that modulates light emitted from a light source by controlling the emission direction of incident light for each micromirror as a pixel.

  DESCRIPTION OF SYMBOLS 1 ... Image display system, 10 ... Image projection part (display part), 11 ... Light source, 11a ... Light source lamp, 11b ... Reflector, 12R, 12G, 12B ... Liquid crystal light valve, 13 ... Projection lens, 14 ... Light valve drive part , 20 ... control unit, 21 ... operation receiving unit, 31 ... image signal input unit, 32 ... image processing unit (drawing unit, drawing area setting unit, drawing restriction unit), 32a ... drawing memory, 32b ... drawing area information storage unit 35 ... I / O unit, 36 ... Image processing unit, 50 ... Detection unit, 51 ... Imaging unit, 52 ... Image analysis unit, 53 ... Detection information generation unit, 53a ... Position detection unit, 53b ... Light emitting pen identification unit (type) Detection unit), 60 ... Control unit (state control unit), 61 ... Operation unit, 62 ... Image processing unit, 62a ... Drawing memory, 62b ... Drawing area information storage unit, 63 ... Monitor, 70 ... Input / output unit, 100 ... Proji Compactors, 200 ... PC, 300 ... projector, 400 ... PC, 501,502,503,504 ... light-emitting pen, C1, C2, C3 ... cable.

Claims (7)

An image display device,
A display for displaying an image;
A type detection unit for detecting type information indicating the type of the indicator;
In a display image displayed by the display unit, a position detection unit that detects position information indicating a position indicated by the indicator;
A drawing unit for drawing in the display image according to the type information and the position information;
In the display image, a drawing area setting unit for setting a drawing area that enables drawing by the indicator;
When the drawing region is set by the drawing region setting unit, a drawing restriction unit that restricts drawing performed by the drawing unit within the drawing region;
Equipped with a,
The type detection unit detects the type information of the first indicator and the second indicator,
The position detection unit detects the position information indicating a position indicated by the first indicator and the second indicator;
The drawing area setting unit sets a first drawing area enabling drawing with the first indicator and a second drawing area enabling drawing with the second indicator;
The drawing limiting portion, the with drawing of the first indicator is restricted to the first drawing area, characterized that you limit the drawing by the second indicator in the second drawing area An image display device. The image display device according to claim 1 ,
The position detection unit includes an imaging unit that captures a range including the display image displayed by the display unit to generate a captured image, and the display is performed based on the captured image generated by the imaging unit. An image display device that detects the position information indicated by each of the indicators in an image. The image display device according to claim 1 or 2 ,
A state control unit that switches to a drawing area setting state for setting the drawing area;
In the drawing area setting state, when an operation for specifying a range is performed by the indicator in the display image, the drawing area setting unit sets the drawing area based on the range specified by the operation. An image display device characterized by setting. The image display device according to claim 1 or 2 ,
An operation reception unit for receiving operations;
A state control unit for switching to a drawing area selection state for selecting a drawing area pattern stored in advance;
Further comprising
In the drawing area selection state, when a selection operation is performed by the operation receiving unit, the drawing area setting unit sets the drawing area based on the selected drawing area pattern. apparatus. The image display device according to claim 1 or 2 ,
An operation reception unit for receiving operations;
A state control unit that switches to a drawing area numerical input state for designating the drawing area by numerical information;
Further comprising
In the drawing area numerical value input state, a numerical value input operation is performed by the operation receiving unit, and the drawing area setting unit sets the drawing area based on the input numerical value. An image display device for displaying an image;
An image supply device for supplying image information to the image display device;
An indicator,
An image display system comprising:
The image display device includes:
An image information input unit for inputting the image information;
A display unit for displaying a display image corresponding to the image information;
A type detection unit for detecting type information indicating the type of the indicator;
In a display image displayed by the display unit, a position detection unit that detects position information indicating a position indicated by the indicator;
A type information output unit for outputting type information of the indicator;
A position information output unit for outputting the position information of the indicator;
Have
The image supply device includes:
An image information generation unit for generating the image information;
A type information input unit for inputting the type information;
A position information input unit for inputting the position information;
A drawing unit for drawing in the image information based on the position information and the type information;
In the image information, a drawing area setting unit for setting a drawing area that permits drawing by the indicator,
When the drawing region is set by the drawing region setting unit, a drawing restriction unit that restricts drawing performed by the drawing unit within the drawing region;
I have a,
The type detection unit detects the type information of the first indicator and the second indicator,
The position detection unit detects the position information indicating a position indicated by the first indicator and the second indicator;
The drawing area setting unit sets a first drawing area enabling drawing with the first indicator and a second drawing area enabling drawing with the second indicator;
The drawing restriction unit restricts drawing by the first indicator within the first drawing area and restricts drawing by the second indicator within the second drawing area. Image display system. A control method for an image display device including a display unit for displaying an image,
A type detection step for detecting type information indicating the type of the indicator;
A position detecting step for detecting position information indicating a position indicated by the indicator in a display image displayed by the display unit;
A drawing step of drawing in the display image in accordance with the type information and the position information;
In the display image, a drawing area setting step for setting a drawing area that enables drawing by the indicator;
When the drawing area is set by the drawing area setting step, a drawing restriction step for restricting the drawing performed by the drawing step within the drawing area;
Equipped with a,
In the type detection step, the type information of the first indicator and the second indicator is detected,
In the position detection step, the position information indicating the position indicated by the first indicator and the second indicator is detected;
In the drawing area setting step, a first drawing area enabling drawing by the first indicator and a second drawing area enabling drawing by the second indicator are set,
Wherein in said drawing restriction step, as well as limit the drawing by the first indicator to the first drawing area, that you limit the drawing by the second indicator in the second drawing area A control method of the image display device.

Images