JP2011164878A - Projector, control method of projector, and image display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a projector which can instruct an image supplying device that supplies image information to the projector from a remote position, to provide a control method of the projector and an image display system. <P>SOLUTION: First, an imaging section images a projected image projected on a screen (S211). Next, an image recognizing section compares an original projected image with the projected image included in the pickup image imaged by the imaging section and determines whether or not there is a difference between the images (S212). When there is a difference, the image recognizing section determines whether or not a region with difference is one of two instructed regions (S213). As a result, if the region with difference is one of the two instructed regions, the image recognizing section refers to a correspondence table to recognize instruction information corresponding to the instructed region with difference (S214), and outputs the result to a controlling section. Then, the controlling section outputs this instruction information via a USB communication section to a computer (S215). <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a projector that projects an image, a projector control method, and an image display system.

  Conventionally, in order to operate a projector that projects an image on a screen or the like, it is necessary to operate an operation key provided on the projector. For example, a user who is giving a presentation near the screen operates the projector. Had to move close to the projector. On the other hand, if the remote controller is used, it is possible to operate the projector from a remote position. However, in this case, the user who operates the projector must carry the remote controller, which is not convenient. There is also a risk of losing the remote control. Therefore, in Patent Document 1, when a user performs a predetermined operation (operation) on an image projected on a screen or the like, the operation is imaged by an imaging unit, and image recognition is performed. Techniques for setting various functions have been proposed. According to this, even if the user is near the screen, the function setting of the projector can be performed while using the remote controller without using the remote control, so that convenience is improved.

JP-A-2005-141151

  However, when a projector projects an image based on image information supplied from an image supply device such as a computer, there are cases where it is desired to give various instructions not only to the projector but also to the image supply device. For this reason, a technique capable of giving an instruction from a remote position to an image supply apparatus that supplies image information to a projector is desired.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 A projector according to this application example includes a communication unit to which an image supply device is connected, image information input from the image supply device, and a first unit based on the image information input to the communication unit. An image projecting unit that projects one image onto a projection surface, an image capturing unit that captures a range including the first image projected onto the projection surface, and generates a second image, and generated by the image capturing unit A recognition unit for recognizing an instruction to the image supply device based on the second image that has been performed, and a control unit for outputting the instruction recognized by the recognition unit from the communication unit to the image supply device; It is provided with.

  According to this projector, the recognition unit recognizes an instruction for the image supply device based on the second image generated by the imaging unit, and the control unit causes the communication unit to output this instruction to the image supply device. For this reason, the user in the projection direction can issue an instruction to the image supply apparatus even at a position away from the image supply apparatus.

  Application Example 2 In the projector according to the application example described above, the projector further includes a table in which a predetermined area in the first image is associated with the instruction to the image supply device, and the recognition unit includes the image projection. When the first image projected by the section is compared with the first image included in the second image, and there is a difference in the predetermined area, the first image is associated with the table. It is desirable to recognize the instructions.

  According to this projector, an instruction for the image supply device is associated with a predetermined area in the first image. The recognizing unit compares the first image projected by the image projecting unit with the first image included in the second image, and when there is a difference in a predetermined area, a corresponding instruction Recognize In other words, the user only has to pick up an image different from the first image by holding the hand over a predetermined area in the first image being projected, and so on. Can be easily performed.

  Application Example 3 In the projector according to the application example described above, it is preferable that the projector further includes a setting unit that sets association between the predetermined area of the first image and the instruction to the image supply device.

  According to this projector, since the setting unit that sets the correspondence between the predetermined area in the first image and the instruction to the image supply apparatus is provided, the user gives a desired instruction to the image supply apparatus. Can be done.

  Application Example 4 In the projector according to the application example described above, it is preferable that the projector further includes a combining unit that superimposes an image for identifying the instruction on the predetermined area in the first image.

  According to this projector, since an image for identifying an instruction is superimposed on an area associated with an instruction, even when there are a plurality of areas associated with an instruction, these can be identified. Thus, the convenience of the user who gives instructions is improved.

  Application Example 5 In the projector according to the application example, the communication unit may perform communication conforming to the USB standard.

  Application Example 6 In the projector according to the application example described above, the control unit may repeatedly output the instruction a plurality of times when the recognition unit recognizes the instruction.

  Application Example 7 A projector control method according to this application example includes a communication unit to which an image supply device is connected and image information is input from the image supply device, and the image information input to the communication unit is included in the image information. Based on this, there is provided a projector control method for projecting a first image onto a projection plane, the imaging step for capturing a range including the first image projected on the projection plane and generating a second image. A recognition step for recognizing an instruction to the image supply device based on the second image generated in the imaging step, and the instruction recognized in the recognition step from the communication unit to the image supply device. And a control step for outputting the data.

  According to the projector control method, in the recognition step, an instruction to the image supply device is recognized based on the second image generated in the imaging step, and in the control step, the instruction is transmitted from the communication unit to the image supply device. Output. For this reason, the user in the projection direction can issue an instruction to the image supply apparatus even at a position away from the image supply apparatus.

  Application Example 8 In the projector control method according to the application example, the projector holds a table in which a predetermined area in the first image is associated with the instruction to the image supply device. In the recognition step, when the first image projected by the projector is compared with the first image included in the second image, and the predetermined region is different, It is desirable to recognize the instruction associated with the table.

  According to this projector control method, an instruction for the image supply device is associated with a predetermined area in the first image. In the recognition step, the first image projected by the projector is compared with the first image included in the second image, and when there is a difference in a predetermined area, the corresponding instruction is recognized. To do. In other words, the user only has to pick up an image different from the first image by holding the hand over a predetermined area in the first image being projected, and so on. Can be easily performed.

  Application Example 9 An image display system according to this application example is an image display system including a projector that projects and displays an image, and an image supply device that supplies image information to the projector. Is configured to project a first image on a projection plane based on the communication unit to which the image supply device is connected and the image information is input from the image supply device, and the image information input to the communication unit. Based on an image projection unit, an imaging unit that captures a range including the first image projected on the projection plane and generates a second image, and the second image generated by the imaging unit A recognition unit that recognizes an instruction for the image supply device, and a control unit that outputs the instruction recognized by the recognition unit from the communication unit to the image supply device. in front Characterized in that it operates based on the instruction input from the projector.

  According to this image display system, the recognition unit of the projector recognizes an instruction to the image supply device based on the second image generated by the imaging unit, and the control unit of the projector receives the instruction from the communication unit. Output to the supply device. For this reason, the user in the projection direction can issue an instruction to the image supply apparatus even at a position away from the image supply apparatus.

  When the projector and the control method described above are constructed using a computer provided in the projector, the form and the application example described above are a program for realizing the function, or the program is stored in the computer. It is also possible to constitute in the form of a recording medium or the like recorded so as to be readable by the user. Recording media include flexible disks, hard disks, optical disks such as CDs and DVDs, magneto-optical disks, memory cards and USB memories equipped with nonvolatile semiconductor memory, projector internal storage devices (semiconductor memories such as RAM and ROM), etc. Various media readable by the computer can be used.

The perspective view which shows an image display system. The block diagram which shows schematic structure of a computer. 1 is a block diagram showing a schematic configuration of a projector. It is explanatory drawing for demonstrating an instruction | indication area | region, (a) is a figure which shows the instruction | indication area | region set in the projection image, (b), (c) is a figure which shows the state which held the hand over the instruction | indication area | region. . The flowchart explaining operation | movement when a projector is connected to a computer. The flowchart explaining operation | movement of the projector which is projecting the image. 6 is a flowchart for explaining the operation of the projector when setting a correspondence table. It is a figure for demonstrating operation | movement of the projector at the time of setting a correspondence table, (a) is a figure for demonstrating the setting of the position of an instruction | indication area | region, (b) demonstrates the setting of the size of an instruction | indication area | region. Figure to do. It is a figure for demonstrating operation | movement of the projector at the time of setting a correspondence table, (a) is a figure for demonstrating the setting of the instruction information matched with an instruction | indication area | region, (b) is the automatic regular transmission of instruction information The figure for demonstrating the setting of a function. It is a figure for demonstrating operation | movement of the projector at the time of setting a correspondence table, (a) is a figure for demonstrating the setting of the display mode of an instruction | indication area | region, (b) is the icon displayed on an instruction | indication area | region. The figure for demonstrating a setting. It is a figure for demonstrating operation | movement of the projector at the time of setting a correspondence table, and is a figure which shows the instruction | indication area | region displayed on the input image.

Hereinafter, the image display system of the present embodiment will be described with reference to the drawings.
FIG. 1 is a perspective view showing an image display system of the present embodiment.
As shown in FIG. 1, the image display system 100 includes a computer 1 as an image supply device and a projector 2. The computer 1 is, for example, a notebook personal computer, and includes a liquid crystal display 16 that is a display device, a keyboard 20 that is an input device, and a touch pad 21 that is an input device (pointing device). Yes. The projector 2 receives image information supplied from the computer 1 and projects an image corresponding to the image information onto a projection surface such as a screen SC (hereinafter also simply referred to as a screen SC). In this embodiment, the computer 1 and the projector 2 are connected by a USB (Universal Serial Bus) cable 3, and image information and the like are supplied from the computer 1 to the projector 2 via the USB cable 3.

FIG. 2 is a block diagram illustrating a schematic configuration of the computer 1.
As shown in FIG. 2, the computer 1 includes a CPU (Central Processing Unit) 11, two bridge circuits (North Bridge 12 and South Bridge 13), a RAM (Random Access Memory) 14, a video controller 15, a liquid crystal display 16, A hard disk drive 17, an optical disk drive 18, a BIOS-ROM (Read Only Memory) 19 in which a BIOS (Basic Input / Output System) is written, a keyboard 20, a touch pad 21, a USB communication unit 22, and the like are provided.

  The CPU 11 controls the operation of the computer 1 by operating according to various programs read into the RAM 14.

  The north bridge 12 performs bridge processing between the CPU 11 and the south bridge 13, control of the RAM 14, control of the video controller 15, and the like. The RAM 14 is configured by a DRAM (Dynamic RAM), and stores an OS (Operating System), an application program, and the like read from the hard disk drive 17 and the like. The RAM 14 is used for temporary storage of various data during program execution.

  The video controller 15 controls display of images on the liquid crystal display 16. The video controller 15 includes a VRAM (Video RAM) 15 a, generates image information sequentially in units of frames (screens) on the VRAM 15 a based on instructions from the CPU 11, and outputs the generated image information to the liquid crystal display 16. Thus, an image based on the image information is displayed on the screen 16a (see FIG. 1) of the liquid crystal display 16.

  The liquid crystal display 16 includes a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates, a backlight unit that emits white light from the back side of the liquid crystal panel, and a drive circuit that drives the liquid crystal panel (both shown in FIG. (Not shown). A large number of pixels arranged in a matrix are formed on the inner surface of the liquid crystal panel. Each pixel includes three sub-pixels that can transmit red (R), green (G), and blue (B) light, and a driving voltage can be applied to the liquid crystal for each sub-pixel. ing. When the drive circuit applies a drive voltage corresponding to the image information input from the video controller 15 to each subpixel, each subpixel is set to a light transmittance corresponding to the image information. Therefore, the light emitted from the backlight unit is modulated by transmitting through the liquid crystal panel, and an image corresponding to the image information is displayed on the front side of the liquid crystal panel, that is, on the screen 16a of the liquid crystal display 16. .

  Various interface circuits are built in the south bridge 13, and a hard disk drive 17, an optical disk drive 18, a BIOS-ROM 19, a keyboard 20, a touch pad 21, a USB communication unit 22, and the like are connected to the south bridge 13.

  The hard disk drive 17 stores the installed OS, application programs, various data, and the like. The optical disc drive 18 reads data from an optical disc such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a Blu-ray Disc (registered trademark), and writes data to the optical disc.

  The BIOS-ROM 19 stores a BIOS. The BIOS includes a program that is read by the CPU 11 when the computer 1 is started up and performs various initialization processes and OS startup.

  The keyboard 20 is an input device that receives input of characters, control codes, and the like by key operations, and the touch pad 21 is a movement operation, a click operation, and a drag operation of a pointer PT (see FIG. 1) displayed on the liquid crystal display 16 or the like. An input device (pointing device) that receives input operations such as. The keyboard 20 and the touch pad 21 output an operation signal based on an operation performed by the user to the south bridge 13, and the south bridge 13 transmits the operation signal to the CPU 11 via the north bridge 12.

  The USB communication unit 22 includes a USB terminal (USB Type A terminal) (not shown), and is connected to an external peripheral device via the USB cable 3 (see FIG. 1). Then, the USB communication unit 22 performs data communication (USB communication) conforming to the USB standard with peripheral devices based on an instruction from the CPU 11. As described above, the projector 2 that is the supply destination of image information is connected to the USB communication unit 22 of the present embodiment as a peripheral device.

Next, a schematic configuration of the projector 2 will be described.
FIG. 3 is a block diagram illustrating a schematic configuration of the projector 2.
As shown in FIG. 3, the projector 2 includes an image projection unit 40, a control unit 50, an input operation unit 51, a USB communication unit 52, an image processing unit 53, a storage unit 54, an imaging unit 55, an image recognition unit 56, and the like. Has been.

  The image projection unit 40 includes a light source 41, three liquid crystal light valves 42R, 42G, and 42B as a light modulation device, a projection lens 43 as a projection optical system, a light valve drive unit 44, and the like. The image projection unit 40 modulates the light emitted from the light source 41 with the liquid crystal light valves 42R, 42G, and 42B to form an image (image light), and projects (emits) this image from the projection lens 43 to the screen. Display on SC.

  The light source 41 includes a discharge-type light source lamp 41a composed of an ultra-high pressure mercury lamp, a metal halide lamp, or the like, and a reflector 41b that reflects light emitted from the light source lamp 41a toward the liquid crystal light valves 42R, 42G, and 42B. ing. Light emitted from the light source 41 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and red (R), green (G), and blue, which are the three primary colors of light, by a color separation optical system (not shown). After being separated into each color light component of (B), it enters the liquid crystal light valves 42R, 42G and 42B, respectively.

  The liquid crystal light valves 42R, 42G, and 42B are each configured by a transmissive liquid crystal panel (not shown) in which liquid crystal is sealed between a pair of transparent substrates. A plurality of pixels arranged in a matrix are formed on the inner surface of the liquid crystal panel, and a driving voltage can be applied to the liquid crystal for each pixel. When the light valve driving unit 44 applies a driving voltage corresponding to the input image information to each pixel, each pixel is set to a light transmittance corresponding to the image information. Therefore, the light emitted from the light source 41 is modulated by transmitting through the liquid crystal light valves 42R, 42G, and 42B, and image light corresponding to the image information is formed for each color light. The formed image light of each color is combined for each pixel by a color combining optical system (not shown) to form a color image, and then enlarged and projected onto the screen SC by the projection lens 43.

  The control unit 50 includes a CPU, a RAM used for temporary storage of various data, a ROM including a nonvolatile memory, and the like, and the operation of the projector 2 is performed by the CPU operating according to a control program stored in the ROM. Oversee and control.

  The input operation unit 51 includes a plurality of operation keys for the user to give various instructions to the projector 2. The operation keys provided in the input operation unit 51 include a power key for switching the power on and off, a menu key for displaying a setting menu for performing various settings, an item selection using a setting menu, and the like. There are directional keys (four operation keys corresponding to up / down / left / right), a determination key for determining an item selected in a setting menu, a cancel key for canceling an operation, and the like. When the user operates various operation keys of the input operation unit 51, the input operation unit 51 outputs an operation signal corresponding to the operation content of the user to the control unit 50. The input operation unit 51 may be configured using a remote control (not shown) capable of remote operation. In this case, the remote control transmits an infrared operation signal corresponding to the user's operation content, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 50.

  The USB communication unit 52 includes a USB terminal (USB Type B terminal) (not shown), and is connected to an external host device (computer 1 in this embodiment) via the USB cable 3 (see FIG. 1). The USB communication unit 52 performs data communication (USB communication) according to the USB standard with the computer 1 based on an instruction from the control unit 50. When the image information is input from the computer 1 to the USB communication unit 52, the USB communication unit 52 outputs the input image information to the image processing unit 53.

  The image processing unit 53 defines the image information input from the USB communication unit 52 as image information representing the gradation of each pixel of the liquid crystal light valves 42R, 42G, and 42B, that is, a drive voltage applied to each pixel. Convert to image information. Furthermore, the image processing unit 53 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like based on an instruction from the control unit 50, and OSD (setting menu, message image, etc.) on a projected image. On-screen display) OSD processing or the like for superimposing and displaying an image is performed as necessary, and the processed image information is output to the light valve drive unit 44.

  When the light valve driving unit 44 drives the liquid crystal light valves 42R, 42G, and 42B according to the image information input from the image processing unit 53, the liquid crystal light valves 42R, 42G, and 42B display images (image light) corresponding to the image information. This image is projected from the projection lens 43 onto the screen SC. Hereinafter, an image projected from the image projection unit 40 (projection lens 43) is referred to as a “projection image”. An image based on the image information input from the computer 1 to the USB communication unit 52 is referred to as an “input image”. That is, when the OSD image is not superimposed, the input image is a projection image, and when the OSD image is superimposed, an image in which the OSD image is superimposed on the input image is a projection image.

  The storage unit 54 is configured by a non-volatile memory, and stores application programs and the like that are read and executed by the computer 1 when the projector 2 is connected to the computer 1. Specifically, the storage unit 54 includes an image supply program Pp for supplying image information from the computer 1 to the projector 2 by USB communication, and a setup program Ps for installing the image supply program Pp in the computer 1. It is remembered.

  The imaging unit 55 captures the front of the projector 2, that is, the direction in which the image is projected, and is an imaging element (not shown) composed of a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like. ) And an imaging lens (not shown) disposed in front of the imaging device. The imaging unit 55 captures a range including the image (projected image) projected from the image projection unit 40 based on an instruction from the control unit 50, and an image representing the captured image (captured image) as an imaging result. Generate information. Image information generated by the imaging unit 55 is output to the image recognition unit 56. Here, the imaging unit 55 is for imaging a user's instruction to the computer 1, and the user enters a hand, a pointing rod, or the like within a range where an image is projected, and uses this to capture the image. An instruction can be given to the computer 1 by causing the computer 1 to take an image.

  The image recognition unit 56 recognizes a user instruction to the computer 1 using the imaging result of the imaging unit 55. Specifically, the image recognition unit 56 projects a projected image (originally) projected from the image projection unit 40 based on the image information output from the image processing unit 53 and the image information output from the imaging unit 55. And the projection image included in the captured image captured by the imaging unit 55, and determines whether there is a difference between the two. For example, when the user enters a hand or a pointer within the range of the projected image projected from the image projection unit 40 onto the screen SC, the entered hand or pointer is included only in the captured image. Differences occur between images. The image recognizing unit 56 detects this difference and identifies an area having the difference.

  In the projected image, an area for instructing the computer 1 (hereinafter also referred to as “instruction area”) is set, and the image recognition unit 56 stores the instruction area and the content of the instruction. A correspondence table T is stored that associates the instruction information to be represented. When the image recognition unit 56 detects that there is a difference in the instruction area, the image recognition unit 56 refers to the correspondence table T, recognizes the corresponding instruction (instruction information), and outputs the recognition result to the control unit 50. To do. When the recognition result (instruction information) is input from the image recognition unit 56, the control unit 50 outputs the instruction information from the USB communication unit 52 to the computer 1.

  For example, as shown in FIG. 4A, in this embodiment, an instruction area A1 is set at the lower left position in the projection image Pa, and this instruction area A1 is used as instruction information for sending a page. It is associated. An instruction area A2 is set at the upper left position in the projection image Pa, and the instruction area A2 is associated with instruction information for returning a page. Then, as shown in FIG. 4B, when the user holds his hand over the instruction area A1 in front of the screen SC and the image recognition unit 56 recognizes this, the control unit 50 displays the instruction information for sending the page. Is output to the computer 1. Specifically, the control unit 50 outputs, as instruction information, a key code output by the keyboard when a page down key of the keyboard is pressed. Also, as shown in FIG. 4C, when the user holds the hand over the instruction area A2 in front of the screen SC and the image recognition unit 56 recognizes this, the control unit 50 displays the instruction information for returning the page. Is output to the computer 1. Specifically, the control unit 50 outputs, as instruction information, a key code output by the keyboard when a page up key of the keyboard is pressed.

Next, the operation of the image display system 100 will be described.
When the computer 1 is turned on, the CPU 11 performs a boot process according to the BIOS stored in the BIOS-ROM 19 and then starts the OS stored in the hard disk drive 17 (reads into the RAM 14). Start following the operation. Then, the CPU 11 instructs the video controller 15 to display a predetermined image (initial screen) on the screen 16 a of the liquid crystal display 16.

  The OS employed in the computer 1 of the present embodiment includes a GUI (Graphical User Interface), and the user can use a pointing device such as a touch pad 21 or a mouse (not shown) in addition to the keyboard 20. Various instructions can be given to the computer 1 by operating the pointer PT using.

  When the activation of the OS is completed, the computer 1 waits for various user operations. Then, the user can operate the keyboard 20, the touch pad 21, or the like to instruct activation of a desired application program, or connect a peripheral device such as the projector 2 to the USB communication unit 22.

  On the other hand, when the projector 2 is turned on, the control unit 50 of the projector 2 performs necessary initialization processing and turns on the light source 41. Then, it waits for the connection of the computer 1 to the USB communication unit 52.

  FIG. 5 is a flowchart for explaining the operation when the projector 2 is connected to the computer 1. When the computer 1 and the projector 2 are connected via the USB cable 3, the computer 1 and the projector 2 operate according to the flow shown in FIG.

  As shown in FIG. 5, first, the CPU 11 of the computer 1 detects the connection of the projector 2 and requests the projector 2 for configuration information (descriptor information) (step S101). Although not shown, the USB communication unit 52 of the projector 2 has a memory in which configuration information is stored. The configuration information includes a mass storage class and an HID (Human Interface Device) class. In other words, the projector 2 virtually operates as a storage device (for example, a CD-ROM) and also operates as an input device (HID device) such as a keyboard or a pointing device. This information is included. Then, the projector 2 outputs this configuration information to the computer 1 in response to a request from the computer 1 (step S201).

  Based on the configuration information input from the projector 2, the CPU 11 of the computer 1 recognizes that the projector 2 is compliant with the mass storage class and the HID class, and installs a general-purpose device driver that is standard on the OS. to start. Thereby, the USB connection between the computer 1 and the projector 2 is established (step S102). Thereafter, the computer 1 inputs and outputs data to and from the projector 2 by using this device driver. Can do.

  When the CPU 11 of the computer 1 recognizes the projector 2 as a storage device, it reads an automatic execution setting file from the projector 2 (step S103). The automatic execution setting file specifies a program (automatic execution program) that is automatically read and executed by the computer 1 (regardless of user operation) when a storage device or the like is connected to the computer 1. It is a file for. In the present embodiment, an automatic execution setting file (not shown) specifying the setup program Ps as an automatic execution program is stored in the storage unit 54 of the projector 2, and the projector 2 stores this automatic execution setting file in the computer 1. Output (step S202).

  Thereafter, the CPU 11 of the computer 1 reads the setup program Ps from the storage unit 54 of the projector 2 in accordance with the read automatic execution setting file. That is, the projector 2 outputs the setup program Ps stored in the storage unit 54 to the computer 1 (step S203). Then, the CPU 11 of the computer 1 activates the setup program Ps input from the projector 2 (step S104), and starts an operation according to this program.

  First, the CPU 11 reads a setting file (registry) in which installation information, various setting information, and the like are recorded from the hard disk drive 17, and refers to this setting file to determine whether or not the image supply program Pp has already been installed ( It is determined whether or not it has been installed (step S105). If it has not been installed yet (step S105: No), installation is performed (step S106). Specifically, the CPU 11 requests the projector 2 to output the image supply program Pp, and the control unit 50 of the projector 2 supplies the image supply stored in the storage unit 54 in response to a request from the computer 1. The program Pp is output from the USB communication unit 52 to the computer 1 (step S204). Then, the CPU 11 of the computer 1 writes the image supply program Pp input from the projector 2 in the hard disk drive 17. On the other hand, when the image supply program Pp is already installed (step S105: Yes), the CPU 11 does not execute the installation. Thereafter, the CPU 11 activates the installed (or already installed) image supply program Pp (step S107).

  The image supply program Pp is a program for supplying image information from the computer 1 to the projector 2 by USB communication. When the image supply program Pp is activated, the CPU 11 starts supplying image information to the projector 2. Specifically, the CPU 11 instructs the video controller 15 to capture an image displayed on the liquid crystal display 16. The captured image, that is, the image (image information) generated on the VRAM 15 a is packetized and output from the USB communication unit 22 to the projector 2. Thereby, the image projection unit 40 of the projector 2 starts projecting an image (input image) based on the image information input from the computer 1 (step S205). Thereafter, the CPU 11 causes the projector 2 to project the image displayed on the liquid crystal display 16 by repeating capture and output of image information regularly or irregularly.

  Thereafter, the user can start an arbitrary application program by operating the keyboard 20, the touch pad 21, or the like. The image displayed on the liquid crystal display 16 by this application program is also projected from the projector 2 by the image supply program Pp.

  FIG. 6 is a flowchart for explaining the operation of the projector 2 projecting an image. The projector 2 repeats the operation according to the flow shown in FIG. 6 periodically or irregularly while projecting an image.

  As shown in FIG. 6, first, in step S211, the imaging unit 55 captures a projection image projected on the screen SC. In step S212, the image recognition unit 56 compares the original projection image projected from the image projection unit 40 with the projection image included in the captured image captured by the imaging unit 55, and there is a difference between the two. Judge whether there is. If there is a difference, the process proceeds to step S213, and if there is no difference, the flow ends.

  When there is a difference and the process proceeds to step S213, the image recognition unit 56 determines that the difference area is one of the two indication areas A (instruction area A1 and instruction area A2) shown in FIG. Judge whether there is. If it is one of the two instruction areas A, the process proceeds to step S214. If it is neither of the two instruction areas A, or if both of the two instruction areas A are different, the flow Exit.

  When the process proceeds to step S <b> 214, the image recognizing unit 56 refers to the correspondence table T, recognizes the instruction information corresponding to the instruction area A having a difference, and outputs the instruction information to the control unit 50. In step S215, the control unit 50 outputs this instruction information from the USB communication unit 52 to the computer 1 and ends the flow. As a result, when there is a difference in the instruction area A1, the key code of the page down key is output to the computer 1, and when there is a difference in the instruction area A2, the key code of the page up key is output to the computer 1. Is output.

  When the instruction information (key code) is input from the projector 2, the CPU 11 of the computer 1 performs an operation based on the input instruction information in accordance with the application program activated at that time. For example, when the key code for the page down key is input, when the page down operation is performed and the key code for the page up key is input in the same manner as when the page down key is pressed on the keyboard. In the same manner as when the page up key is pressed on the keyboard, an operation for returning the page is performed.

Next, the correspondence table T held in the image recognition unit 56 of the projector 2 will be described.
The correspondence table T may hold the correspondence table T having predetermined contents in advance, but it is desirable that the contents can be arbitrarily set by the user.

  FIG. 7 is a flowchart for explaining the operation of the projector 2 when setting the correspondence table T. 8 to 11 are explanatory diagrams for explaining the operation of the projector 2 when setting the correspondence table T, and are diagrams showing the projected image Pa. When the user performs a predetermined operation on the input operation unit 51 to instruct the setting of the correspondence table T, the control unit 50 operates according to the flow of FIG.

  As shown in FIG. 7, first, the control unit 50 causes the user to set the indication area A (step S221). Specifically, the control unit 50 causes the image processing unit 53 to perform OSD processing, and as illustrated in FIG. 8A, the frame F for enclosing the designated area A and the movement of the frame F to the user. The prompt message image M1 is superimposed on the input image Pi. The user can move the frame F to an arbitrary position by operating a direction key provided in the input operation unit 51. When the user operates the determination key after moving the frame F to a desired position, the position of the frame F is determined. Thereafter, as shown in FIG. 8B, the control unit 50 displays a message image M2 that prompts the user to adjust (enlarge or reduce) the size of the frame F on the input image Pi. The user can adjust the size of the frame F by operating the direction keys of the input operation unit 51. When the user operates the enter key after adjusting the frame F to a desired size, the size of the frame F is determined. Thereby, the area surrounded by the frame F is set as the instruction area A. The position and size of the indication area A (frame F) can be expressed by using coordinates corresponding to the pixels of the liquid crystal light valves 42R, 42G, and 42B, for example.

  Next, the control unit 50 causes the user to set instruction information associated with the instruction area A (step S222). For example, the control unit 50 causes the image processing unit 53 to perform OSD processing so as to superimpose and display a message image M3 for prompting the selection of a key on the input image Pi as illustrated in FIG. The message image M3 includes an image of a keyboard having a plurality of keys, and the user can select any one key by operating the direction keys. When the user operates the determination key after selecting a desired key, the control unit 50 determines the key code of the selected key as instruction information.

  Next, the control unit 50 causes the user to set whether or not to enable the function of periodically repeating the transmission of the set instruction information (hereinafter also referred to as “automatic periodic transmission function”) (step S223). . The automatic periodic transmission function is a function in which once the user gives an instruction by holding the hand over the instruction area A or the like, the corresponding instruction information is periodically transmitted repeatedly. If this function is enabled, for example, It is possible to automatically perform page feed at a predetermined cycle. The control unit 50 causes the image processing unit 53 to perform OSD processing, and inputs a message image M4 for allowing the user to select whether or not to enable the automatic periodic transmission function, as shown in FIG. 9B. It is displayed superimposed on the image Pi. The user can select whether to enable or not by operating the direction key. When the user operates the enter key after selecting one, the setting of the automatic periodic transmission function is completed. . In addition, although illustration is abbreviate | omitted, when the automatic regular transmission function is validated, it is sufficient to make the user specify the repetition cycle. In addition, the number of repetitions may be specified by the user, or may be repeated until some operation (for example, operation of a cancel key) is performed.

  Next, the control unit 50 causes the user to set the display form of the designated area A (step S224). Specifically, the control unit 50 causes the image processing unit 53 to perform OSD processing, and as shown in FIG. 10A, the control unit 50 selects a message image M5 for selecting the display form of the instruction area A as the input image Pi. Overlay on top. In the message image M5, only the first item for displaying both the image (icon) for identifying the instruction associated with the instruction area A, the boundary line (frame) of the instruction area A, and the icon are displayed. The second item to be displayed, the third item to display only the icon in a semi-transparent state (a state in which dots constituting the icon are thinned out), the fourth item to display only the boundary line, and the fifth to display nothing The five items are included. The user can select any one item with the direction keys, and the display mode is determined by operating the enter key after selecting one item. Here, when an item for displaying an icon is selected, the contents of the associated instruction can be known from the icon, which improves convenience for the user who gives the instruction. However, since a part of the input image Pi is hidden by the icon and the icon may become annoying, in order to avoid such an inconvenience, the icon is made semi-transparent or only the boundary line is used. It is sufficient to select an item for displaying or displaying nothing. When nothing is displayed, the user needs to remember the position of the instruction area A and the corresponding instruction information.

  When the display form for displaying the icon is selected in step S224, the control unit 50 causes the user to set the icon (step S225). Specifically, the control unit 50 causes the image processing unit 53 to perform OSD processing, and as shown in FIG. 10B, displays a message image M6 that prompts the user to select an icon on the input image Pi. In the message image M6, a plurality of icons are arranged, and the user can select any one by the direction key. When the user operates the enter key after selecting the desired icon, the icon is decided. In addition, when the display form which displays an icon is not selected by step S224, the control part 50 does not perform this step (step S225).

  Thereafter, the control unit 50 displays the items determined in the above steps, that is, the position and size of the instruction area A, the instruction information, the automatic periodic transmission function setting result (whether it is valid), and the indication area A. The form and the selected icon are associated with each other and registered in the correspondence table T of the image recognition unit 56 (step S226).

  Next, as shown in FIG. 11, the control unit 50 displays the instruction area A set in step S221 on the input image Pi based on the display form set in step S224 (step S227), and the flow finish. Specifically, the control unit 50 causes the image processing unit 53 to perform OSD processing, and displays an image (icon or boundary line) according to the display form set in step S224, and the instruction area set in step S221. A is superimposed on A. If an item that displays nothing is selected in step S224, the control unit 50 does not execute this step (step S227).

  Thus, the setting of the correspondence table T is completed. The user can also register a plurality of designated areas A in the correspondence table T by repeating this operation a plurality of times.

  As described above, according to the image display system 100 of the present embodiment, the following effects can be obtained.

  (1) According to the image display system 100 of the present embodiment, the image recognition unit 56 of the projector 2 recognizes an instruction to the computer 1 based on a captured image generated by the imaging unit 55 capturing an image of the projection direction, The control unit 50 causes the computer 1 to output this instruction (instruction information) from the USB communication unit 52. For this reason, a user in the projection direction can give an instruction to the computer 1 even at a position away from the computer 1.

  (2) According to the image display system 100 of the present embodiment, an instruction for the computer 1 is associated with the instruction area A in the projection image, and the image recognition unit 56 converts the original projection image into the captured image. When there is a difference in the designated area A by comparing with the included projection image, the corresponding instruction is recognized. That is, since the user only has to pick up an image different from the original projected image by holding the hand over the designated area A in the projected image, the instruction to the computer 1 is easy. Can be performed.

  (3) According to the image display system 100 of the present embodiment, since the control unit 50 operates according to the flow shown in FIG. 7, it is possible to set the correspondence between the instruction area A and the instruction to the computer 1. The user can give a desired instruction to the computer 1.

  (4) According to the image display system 100 of the present embodiment, an image (icon) for identifying an instruction can be superimposed on the instruction area A. Therefore, even when there are a plurality of instruction areas A, these are identified. It is possible to improve the convenience of the user who gives instructions. Note that the image for identifying the instruction is not limited to an icon (a symbol, a graphic, or the like), and may be an image formed of a character string or the like representing the content of the instruction.

  (5) According to the image display system 100 of the present embodiment, the key code is output from the projector 2 to the computer 1 by the user holding his / her hand over the designated area A in the projected image. . For this reason, even if the power saving function or the security function of the computer 1 is set so that the image display is stopped or the screen saver is activated when there is no input operation for a predetermined time, the predetermined time elapses. It is possible to prevent the image display from being stopped and the screen saver from being activated by holding the hand over the instruction area A before the operation. That is, the user does not need to operate the keyboard 20 or the touch pad 21 or change the settings of the computer 1 in order to maintain the image display state. In addition, if the key code is output periodically (with a period shorter than the predetermined time) by the automatic periodic transmission function described above, the user may need to repeat the operation of holding the hand over the instruction area A. Disappear.

  (6) According to the image display system 100 of the present embodiment, if there is a difference between the two instruction areas A1 and A2, the flow is terminated without assuming that the instruction has been given by the user. (Refer to FIG. 6, step S213). For this reason, for example, when the user crosses the front of the projected image, it is possible to suppress erroneous recognition of this as an instruction.

  In the present embodiment, the USB communication unit 52 of the projector 2 corresponds to a communication unit, and the image recognition unit 56 corresponds to a recognition unit. Further, the control unit 50 when setting the correspondence table T according to the flow of FIG. 7 corresponds to the setting unit, and the image processing unit 53 when superimposing the OSD image corresponds to the combining unit. In addition, an image (projected image) projected by the image projection unit 40 corresponds to the first image, and an image (captured image) generated by imaging by the imaging unit 55 corresponds to the second image. Step S211 corresponds to an imaging step, steps S212 to S214 correspond to recognition steps, and step S215 corresponds to a control step.

(Modification)
Moreover, you may change the said embodiment as follows.

  In the above-described embodiment, the projector 2 outputs the key code output from the keyboard to the computer 1 as instruction information, but is not limited to this mode. For example, if an operation signal output by the mouse is output as instruction information, for example, when there is a difference in the instruction area A, it is possible to click at a predetermined position in the input image Pi. In order to realize this, instead of the key code, the coordinates of the position to be clicked (operation position) may be associated with the designated area and registered in the correspondence table T. If there is a difference in the designated area A, the projector 2 acquires the coordinates of the current position (current position) of the pointer PT from the computer 1 and moves the pointer PT from the current position to the operation position. The operation signal may be output to the computer 1 and then the operation signal corresponding to the click may be output. When the coordinates of the operation position to be clicked are registered in the correspondence table T, it is not easy for the user to directly input the coordinates. For this reason, for example, when the user performs a predetermined input operation on the input operation unit 51 of the projector 2, the projector 2 acquires the coordinates of the current position from the computer 1 and registers them as the coordinates of the operation position. You may make it the aspect to do. In this aspect, the user can easily register the operation position by performing a predetermined input operation in a state where the pointer PT is aligned with a desired operation position.

  In the above embodiment, the image (icon or boundary line) displayed in the instruction area A may be always displayed on the input image Pi, but is not limited to this mode. For example, a display state and a non-display state may be switched according to an input operation. Normally, when a state in which nothing is displayed is maintained and a predetermined operation is performed (for example, projection) For example, when a hand is inserted in the image Pa), it is possible to display only for a predetermined time.

  In the above embodiment, it is desirable not to recognize this as a user instruction when the user accidentally holds his hand over the instruction area A. For this purpose, when the state in which any one of the indication areas A is different continues for a predetermined time, or when the degree of difference (difference rate) in the indication area A is larger than a predetermined value, the user gives an instruction. It should be considered as made. The setting result may be stored in the correspondence table T so that the user can set the duration time and the difference rate.

  In the above embodiment, the aspect in which the original projection image projected from the image projection unit 40 and the projection image included in the captured image captured by the imaging unit 55 are compared and the instruction is recognized is shown. The instruction may be recognized based only on the image captured by the imaging unit 55 without comparing them.

  In the above-described embodiment, when the user enters a hand or a pointer within the range of the projection image projected from the image projection unit 40 onto the screen SC, the original projection image and the captured image captured by the imaging unit 55 are converted. Although there is a difference between the projection images included, the present invention is not limited to this mode. For example, even if a laser pointer or the like is used to irradiate light within the designated area A, a difference can be generated between the two images.

  In the above embodiment, the computer 1 is started after the image supply program Pp is installed in the hard disk drive 17. However, without being installed in the hard disk drive 17, the computer 1 is read from the storage unit 54 of the projector 2 each time and started. It is good also as an aspect to do.

  In the above embodiment, as an example of an image supply device, a computer 1 (integratedly provided with a liquid crystal display 16 as a display device, a keyboard 20 as an input device, and a touch pad 21 as an input device (pointing device). (Notebook personal computer) has been described, but the image supply device is not limited to a notebook personal computer. For example, it may be a portable information device such as a PDA (Personal Digital Assistant), or a configuration in which all or a part of a display device, a keyboard, and a pointing device are externally connected like a desktop personal computer. It may be a computer.

  In the above embodiment, the image information is supplied from the computer 1 to the projector 2 by USB communication. However, the present invention is not limited to USB communication as long as bidirectional communication is possible.

  In the above embodiment, the three-plate projector 2 using the three liquid crystal light valves 42R, 42G, and 42B as the light modulation device has been described, but the present invention is not limited to this. For example, it is possible to form an image with one liquid crystal light valve that includes sub-pixels that can transmit R light, G light, and B light in each pixel.

  In the above-described embodiment, the transmissive liquid crystal light valves 42R, 42G, and 42B are used as the light modulator, but a reflective light modulator such as a reflective liquid crystal light valve can also be used. In addition, it is possible to use a micromirror array device that modulates light emitted from a light source by controlling the emission direction of incident light for each micromirror as a pixel.

  In the above embodiment, the light source 41 is constituted by the discharge-type light source lamp 41a. However, the light source 41 can also be applied to a solid light source such as an LED (Light Emitting Diode) light source or other light sources.

  DESCRIPTION OF SYMBOLS 1 ... Computer, 2 ... Projector, 3 ... USB cable, 11 ... CPU, 12 ... North bridge, 13 ... South bridge, 14 ... RAM, 15 ... Video controller, 15a ... VRAM, 16 ... Liquid crystal display, 16a ... Screen, 17 DESCRIPTION OF SYMBOLS ... Hard disk drive, 18 ... Optical disk drive, 19 ... BIOS-ROM, 20 ... Keyboard, 21 ... Touchpad, 22 ... USB communication part, 40 ... Image projection part, 41 ... Light source, 41a ... Light source lamp, 41b ... Reflector, 42R , 42G, 42B ... liquid crystal light valve, 43 ... projection lens, 44 ... light valve drive unit, 50 ... control unit, 51 ... input operation unit, 52 ... USB communication unit, 53 ... image processing unit, 54 ... storage unit, 55 ... Imaging unit, 56 ... Image recognition unit, 100 ... Image display system, A, A1, A ... Indicating area, F ... Frame, M1, M2, M3, M4, M5, M6 ... Message image, PT ... Pointer, Pa ... Projected image, Pi ... Input image, Pp ... Image supply program, Ps ... Setup program, SC ... Screen, T ... correspondence table.

Claims (9)

A communication unit to which an image supply device is connected and image information is input from the image supply device;
An image projection unit that projects a first image on a projection surface based on the image information input to the communication unit;
An imaging unit that captures a range including the first image projected on the projection plane and generates a second image;
A recognition unit that recognizes an instruction to the image supply device based on the second image generated by the imaging unit;
A control unit that causes the communication unit to output the instruction recognized by the recognition unit to the image supply device;
A projector characterized by comprising: The projector according to claim 1,
A table associating a predetermined area in the first image with the instruction to the image supply device;
The recognizing unit compares the first image projected by the image projecting unit with the first image included in the second image, and there is a difference in the predetermined region. A projector that recognizes the instruction associated with the table. The projector according to claim 2,
The projector further comprising: a setting unit that sets association between the predetermined area of the first image and the instruction to the image supply device. The projector according to claim 2, wherein
The projector further comprising a combining unit that superimposes an image for identifying the instruction on the predetermined area in the first image. It is a projector as described in any one of Claims 1-4, Comprising:
The communication unit performs communication conforming to a USB standard. A projector according to any one of claims 1 to 5,
The control unit, when the recognition unit recognizes the instruction, repeatedly outputs the instruction a plurality of times. Control of a projector that is connected to an image supply device and includes a communication unit to which image information is input from the image supply device, and that projects a first image on a projection plane based on the image information input to the communication unit A method,
An imaging step of capturing a range including the first image projected on the projection plane to generate a second image;
A recognition step for recognizing an instruction to the image supply device based on the second image generated in the imaging step;
A control step of outputting the instruction recognized in the recognition step from the communication unit to the image supply device;
A projector control method comprising: The projector control method according to claim 7, comprising:
The projector holds a table in which a predetermined area in the first image is associated with the instruction to the image supply device;
In the recognition step, when the first image projected by the projector is compared with the first image included in the second image, and the predetermined region is different, A projector control method, comprising: recognizing the instruction associated with a table. An image display system comprising: a projector that projects and displays an image; and an image supply device that supplies image information to the projector.
The projector is
A communication unit to which the image supply device is connected and the image information is input from the image supply device;
An image projection unit that projects a first image on a projection surface based on the image information input to the communication unit;
An imaging unit that captures a range including the first image projected on the projection plane and generates a second image;
A recognition unit that recognizes an instruction to the image supply device based on the second image generated by the imaging unit;
A control unit that causes the communication unit to output the instruction recognized by the recognition unit to the image supply device;
The image supply system operates according to the instruction input from the projector.

Images