JP5970700B2 - Projector, projector control method, program, and projection system - Google Patents

Description

  The present invention relates to a projector that projects an image, a projector control method, a program, and a projection system.

  2. Description of the Related Art Conventionally, there has been known an apparatus that detects a pointing position and performs drawing or the like when a position pointing operation is performed by a device such as an electronic pen on a projection surface on which a projector projects an image (for example, Patent Document 1).

JP 2012-027769 A

In the above conventional example, it is convenient if other functions can be operated using a device used for drawing. However, when one device is assigned to a plurality of types of functions, for example, it is necessary to switch between a function executed by operating the device as a drawing function or another function. If this switching operation is a complicated operation, there is a problem that convenience is lost, but if it is configured to be switched by a simple operation, it may be difficult to realize because switching that is not intended by the user may occur. Met.
The present invention has been made in view of the above-described circumstances, and assigns a plurality of types of functions to a single device operation on a projection surface on which a projector projects an image, and easily switches between these types of functions. It is an object to provide a projector, a projector control method, a program, and a projection system that can be operated in a convenient manner.

In order to solve the above problems, the present invention is a projector that projects an image on a projection surface, and is detected by an operation detection unit that detects a position instruction operation on the projection surface by an indicator, and the operation detection unit. A drawing unit that generates or updates an image based on an operation position, a projection control unit that updates an image projected on the projection surface based on an image generated or updated by the drawing unit, and a posture of the indicator Based on the posture detection means to be detected and the posture detected by the posture detection means, if it is determined that the operation detected by the operation detection means is an operation in a state where drawing cannot be performed, the processing by the drawing means And a function control means for executing a predetermined function without executing the function.
According to the present invention, if a user can use a drawing function by using an indicator that performs a position pointing operation and operates in a mode in which drawing cannot be performed, functions other than drawing can be executed. Further, in order to execute a predetermined function, an operation in a mode in which drawing cannot be executed is necessary, and a function not intended by the user is not erroneously executed. Therefore, by changing the operation mode of the indicator, a plurality of types of functions can be executed by operating one indicator without performing a complicated switching operation.

According to the present invention, in the projector, a drawing mode in which an image is generated or updated by the drawing unit can be executed, and the function control unit draws an operation detected by the operation detection unit during the drawing mode. When it is determined that the operation cannot be performed, a predetermined function is performed.
According to the present invention, in a drawing mode in which an image is generated or updated by operating a pointer, a drawing function and a function other than drawing can be easily switched and executed.

According to the present invention, in the projector described above, the drawing mode and one or a plurality of operation modes for executing an operation other than drawing based on an indication position of the position indication operation detected by the operation detection unit are switched. It is possible.
According to the present invention, in a configuration capable of executing a plurality of operation modes, a drawing function and a function other than drawing can be easily switched and executed during execution of a drawing mode for generating an image by operating a pointer. be able to.

In the projector according to the aspect of the invention, the posture detection unit may detect a posture of the indicator and an operation of the indicator.
According to the present invention, it is possible to more accurately determine whether or not the operation is a mode in which drawing cannot be performed based on not only the posture of the pointer but also the movement of the pointer. For this reason, it is possible to easily switch and execute the drawing function and the function other than the drawing as intended by the user who uses the indicator, and further improvement in convenience can be expected.

According to the present invention, the projector includes an imaging unit that captures the indicator, and the orientation detection unit detects the orientation of the indicator based on a captured image of the imaging unit.
According to the present invention, the posture of the indicator can be detected accurately and promptly based on the photographed image. In addition, if the configuration is such that the pointing position of the indicator is detected based on the captured image of the imaging means, the imaging means can be used for both position detection and posture detection, so that there is an advantage that hardware can be used efficiently.
Here, the posture detection means may be configured to detect the posture of the indicator based on a state of a posture detector included in the pointer. In this case, the posture of the indicator can be detected more quickly and accurately.

In order to solve the above-described problem, the present invention provides a projector control method for projecting an image on a projection surface, wherein a position instruction operation on the projection surface by a pointer is detected, and the detected operation position is determined. An image is generated or updated based on the generated or updated image, the image projected on the projection surface is updated, the posture of the indicator is detected, and the detected posture of the indicator is used as a basis. When it is determined that the operation of the indicator is an operation in a mode in which drawing cannot be performed, a predetermined function is executed without executing image generation or update processing.
By executing the control method of the present invention, a user who uses the projector can use a drawing function by using a pointer that performs a position indicating operation, and can perform functions other than drawing by operating in a manner in which drawing cannot be performed. Can be executed. Further, in order to execute a predetermined function, an operation in a mode in which drawing cannot be executed is necessary, and a function not intended by the user is not erroneously executed. Therefore, by changing the operation mode of the indicator, a plurality of types of functions can be executed by operating one indicator without performing a complicated switching operation.

In order to solve the above problem, the present invention is a program executable by a computer connected to a projector that projects an image on a projection surface, and the computer is used to perform a position instruction operation on the projection surface by an indicator. Based on the drawing means for generating or updating an image based on the image, the projection control means for updating the image projected on the projection surface based on the image generated or updated by the drawing means, and the attitude of the indicator, When it is determined that the operation by the indicator is an operation in a mode in which drawing cannot be performed, the function is performed as a function control unit that executes a predetermined function without executing the processing by the drawing unit. It is a program.
When the computer of the present invention is executed by a computer, a user who uses the projector can use a drawing function by using a pointer that performs a position indicating operation, and if a user operates in a mode in which drawing cannot be performed, functions other than drawing Can be executed. Further, in order to execute a predetermined function, an operation in a mode in which drawing cannot be executed is necessary, and a function not intended by the user is not erroneously executed. Therefore, by changing the operation mode of the indicator, a plurality of types of functions can be executed by operating one indicator without performing a complicated switching operation.

In order to solve the above-described problem, the present invention provides a projection system including a projector that projects an image on a projection surface and a computer connected to the projector, and a position indication with respect to the projection surface by an indicator. An operation detecting means for detecting an operation, a drawing means for generating or updating an image based on the position of the operation detected by the operation detecting means, and an image generated or updated by the drawing means on the projection surface Projection control means for updating an image to be projected, attitude detection means for detecting the attitude of the indicator, and an operation detected by the operation detection means based on the attitude detected by the attitude detection means When it is determined that the operation cannot be performed, a function control function that executes a predetermined function without executing the processing by the drawing unit Characterized by comprising a and.
According to the projection system of the present invention, a user can use a drawing function by using a pointer that performs a position indicating operation, and can perform functions other than drawing if the user performs an operation in a state where drawing cannot be performed. Further, in order to execute a predetermined function, an operation in a mode in which drawing cannot be executed is necessary, and a function not intended by the user is not erroneously executed. Therefore, by changing the operation mode of the indicator, a plurality of types of functions can be executed by operating one indicator without performing a complicated switching operation.

  According to the present invention, by changing the operation mode of the indicator, it is possible to execute a plurality of types of functions by operating one indicator without performing a complicated switching operation.

It is a figure which shows the structure of the projection system which concerns on embodiment of this invention. It is a functional block diagram of each part which comprises a projection system. It is explanatory drawing which shows the example of the table which defines the response | compatibility with the operation mode of a projection system, and the function to perform. It is a flowchart which shows operation | movement of a projection system. It is a flowchart which shows operation | movement of a projection system.

Embodiments to which the present invention is applied will be described below with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a projection system 1 according to an embodiment to which the present invention is applied. The projection system 1 is configured by connecting a PC (personal computer) 100 to a projector 10 installed above a screen SC.
The projector 10 receives image data transmitted from the PC 100 as an image output device, and projects an image based on the image data onto a screen SC as a projection surface. The projector 10 is a short focus type, and is installed immediately above the screen SC and projects an image obliquely downward.

The projector 10 not only projects an image based on the image data transmitted from the PC 100 but also an image based on the image data stored in the projector 10 and an image generated inside the projector 10 as described later. Can be projected onto the screen SC.
The projector 10 can project whether the image data received from the PC 100 is still image data or moving image (video) data. The screen SC is not limited to a flat plate fixed to a wall surface, and the wall surface itself can be used as the screen SC.

In the projection system 1, an operation can be performed using the indicator 70 on the screen SC on which the projector 10 projects an image. The indicator 70 is, for example, a pen-type device, and the user uses the shaft portion 71 in his hand and presses the tip against the screen SC. An operation switch 72 for detecting a pressing operation is provided at the tip of the indicator 70. When the user presses the tip of the indicator 70 against the screen SC, the operation switch 72 is turned on. The user performs a position indicating operation by pressing the tip of the indicator 70 against the screen SC at an arbitrary position on the screen SC.
As will be described later, the projector 10 has a function of detecting the position of the indicator 70 on the screen SC. When the user performs a position instruction operation, a position where the tip of the indicator 70 is in contact with the screen SC is detected as an instruction position.

  The projection system 1 functions as an interactive whiteboard system that receives a position input operation performed by the user using the indicator 70 and reflects this operation on the projection image. Specifically, when the position designation operation performed by the user is detected, the projection system 1 draws a picture such as a straight line, a curve, or a polygon according to the designated position, and projects the drawn figure onto the screen SC. The projection system 1 can draw an image so as to overlap the projected image in a state where any image is projected on the screen SC, and starts drawing the image after shifting to a state where no image is projected. You can also. In addition, the image drawn by this function can be saved as image data, and only the drawn image can be saved as image data, and together with the projected image projected on the screen SC at the time of drawing. It can also be saved as a single image data.

Here, the projection system 1 generates an image in accordance with the indication position of the indicator 70 and projects the function by the projector 10 in either the “PJ mode” executed by the projector 10 or the “PC mode” executed by the PC 100. Is also feasible. In the “PJ mode”, the projector 10 detects the indication position of the indicator 70, generates an image according to the detected indication position, and projects it on the screen SC.
In the “PC mode”, the projector 10 performs an operation of projecting an image input from the PC 100 onto the screen SC, and the projector 10 does not perform drawing. In this PC mode, the projector 10 detects the indication position of the indicator 70 and transmits operation data indicating the detected indication position to the PC 100. Receiving this operation data, the PC 100 executes drawing for generating an image based on the coordinates of the designated position, and generates image data for display by individually or superimposing the drawn image on another image. The PC 100 outputs the generated display image data to the projector 10. Thereby, the image drawn according to the operation of the indicator 70 is projected onto the screen SC.

  The PJ mode can be executed by operating the projector 10. The PC mode can be executed by switching the projector 10 to the PC mode and causing the PC 100 to execute the function of controlling the projector 10 and the function of performing drawing. Therefore, switching from the PC mode to the PJ mode can be performed by operating the projector 10, and switching from the PJ mode to the PC mode is performed by operating both the projector 10 and the PC 100.

  A toolbar 201 is projected on the screen SC together with the projected image. On the toolbar 201, a plurality of function buttons 204 and the like for causing the projector 10 to execute various functions are arranged. When the position overlapping with any one of the function buttons 204 is instructed by the operation of the indicator 70, the projector 10 executes the function assigned to the corresponding function button 204.

  Further, the toolbar 201 is provided with a drawing mode switching button 202 and a PC operation mode switching button 203. The drawing mode switching button 202 is a button for switching between an operation mode (drawing mode) in which drawing is performed by operating the indicator 70, an operation mode in which settings related to drawing are performed, and the like. The PC operation mode switching button 203 is a button for switching between a PC operation mode in which the indicator 70 is used as a pointing device of the PC 100 and another operation mode. When the projection system 1 is operating in the PC mode, when the PC operation mode switching button 203 is operated, the PC 100 shifts to the PC operation mode, and projects the operation screen of the PC 100 onto the screen SC. The operation is executed using the pointing position of the pointer 70 as the input coordinates of the pointing device. In the PC operation mode, by operating the indicator 70, for example, data operations such as selection, editing, deletion, movement, and copying of data stored in the PC 100, execution instructions for application programs held by the PC 100, and the like can be performed. When the indicator 70 can be used, the tool bar 201 is always projected on the projection image in a superimposed manner or independently.

FIG. 2 is a functional block diagram of each part constituting the projection system 1.
The projector 10 includes an I / F (interface) unit 11 connected to an external device such as a PC 100, a video playback device, or a DVD playback device. The I / F unit 11 includes, for example, a USB interface, a wired or wireless LAN interface, a VGA terminal to which an analog video signal is input, a DVI (Digital Visual Interface) to which digital image data is input, a composite such as NTSC, PAL, and SECAM. An S video terminal to which a video signal is input, an RCA terminal to which a composite video signal is input, a D terminal to which a component video signal is input, an HDMI connector conforming to the HDMI (registered trademark) standard, and the like are provided. The projector 10 is connected to the PC 100 via a LAN interface or a USB interface provided in the I / F unit 11.

The projector 10 is roughly composed of a projection unit 20 that forms an optical image and an image processing system that processes image data. The projection unit 20 includes an illumination optical system 21, a light modulation device 22, and a projection optical system 23. The illumination optical system 21 includes a light source including a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, and the like. Further, the illumination optical system 21 may include a reflector for guiding the light emitted from the light source to the light modulation device 22 and an auxiliary reflector, and a lens group (not shown) for enhancing the optical characteristics of the projection light, a polarizing plate, Or you may provide the light control element etc. which reduce the light quantity of the light which the light source emitted on the path | route which reaches the light modulation apparatus 22. FIG.
The light modulation device 22 includes, for example, three transmissive liquid crystal panels corresponding to the three primary colors of RGB, and generates image light by modulating light transmitted through the liquid crystal panel. The light from the illumination optical system 21 is separated into three color lights of RGB, and each color light enters each corresponding liquid crystal panel. The color light modulated by passing through each liquid crystal panel is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 23.

  The projection optical system 23 is a zoom lens that enlarges / reduces the projected image and adjusts the focus, a zoom adjustment motor that adjusts the degree of zoom, a focus adjustment motor that adjusts the focus, and directs the projection light toward the screen SC. A concave mirror that reflects the light. The projection optical system 23 performs zoom adjustment and focus adjustment of the image light modulated by the light modulation device 22, guides the light passing through the lens group in the direction of the screen SC by the concave mirror, and forms an image on the screen SC. The projection unit 20 includes a projection optical system drive unit 16 that drives each motor included in the projection optical system 23 according to the control of the control unit 30, and a light source drive that drives a light source included in the illumination optical system 21 according to the control of the control unit 30. Part 14 is connected. The specific configuration of the projection optical system 23 is not limited to the above example. For example, by using a configuration that does not use a mirror including a concave mirror, the light modulated by the light modulation device 22 is projected onto the screen SC by a lens and imaged. It is also possible to make it.

  On the other hand, the image processing system is configured around a control unit 30 that integrally controls the entire projector 10, and includes a control program 36 executed by the control unit 30 and a storage unit 35 that stores data processed by the control unit 30. , An operation detection unit 17 for detecting an operation through the operation panel 19 and the remote control light receiving unit 18, an image processing unit 40 for processing an input image input through the I / F unit 11, and an image processed by the image processing unit 40 An optical modulator driving unit 15 that performs drawing by driving the optical modulator 22 based on the signal is provided.

The operation detection unit 17 is connected to the remote control light receiving unit 18 and the operation panel 19.
The remote control light receiving unit 18 receives, by the remote control light receiving unit 18, an infrared signal transmitted in response to a button operation by a remote control (not shown) used by the user of the projector 10. The remote control light receiving unit 18 decodes the infrared signal received from the remote control, generates operation data indicating the operation content of the remote control, and outputs the operation data to the control unit 30.
The operation panel 19 is provided in the exterior housing of the projector 10 and has various switches and indicator lamps. The operation detection unit 17 appropriately lights or blinks the indicator lamp of the operation panel 19 according to the operation state or setting state of the projector 10 according to the control of the control unit 30. When the switch of the operation panel 19 is operated, operation data corresponding to the operated switch is output from the operation detection unit 17 to the control unit 30.

The control unit 30 outputs the image data input from the I / F unit 11 to the image processing unit 40. The image processing unit 40 buffers the input image data, and appropriately executes various conversion processes such as interlace / progressive conversion, resolution conversion, and color conversion on the image data. A display control unit 42 that generates image data of the format described above, and a drawing processing unit 43 that develops an image for each frame in the frame memory 44 based on the image data processed by the display control unit 42. The image processing unit 40 outputs the image data expanded in the frame memory 44 to the light modulation device driving unit 15.
In the PJ mode, the drawing processing unit 43 (drawing means) performs editing to add or delete a graphic image to the image developed in the frame memory 44 in accordance with the coordinates of the pointing position of the pointer 70, thereby generating an image. Or update. Thereby, a figure corresponding to the operation of the indicator 70 is drawn and projected on the screen SC.

On the other hand, in addition to the operation switch 72 described above, the indicator 70 includes a posture switch 73 whose output is switched depending on the posture of the indicator 70. The posture switch 73 is, for example, a switch that is turned off when the shaft portion 71 (FIG. 1) is horizontal and turned on when the shaft portion 71 is tilted. Further, the posture switch 73 may be a switch whose resistance value changes depending on the inclination of the shaft portion 71, for example.
The indicator 70 includes a transmission unit 74 that outputs an infrared signal. The transmission unit 74 includes a light emitting unit such as an infrared LED, a light emission control circuit, and a power source. The transmission unit 74 periodically transmits an infrared signal in a state where the indicator 70 is turned on. The transmission unit 74 modulates and transmits an infrared signal according to the operation state (ON / OFF) of the operation switch 72 and the output state of the attitude switch 73. The transmission unit 74 transmits data indicating ON / OFF of the operation switch 72 and ON / OFF of the attitude switch 73 by, for example, a method compliant with the IrDA standard.

The projector 10 includes a position instruction operation detection unit 50 that detects an operation by the indicator 70. The position instruction operation detection unit 50 includes an imaging unit 51, a reception unit 52, a shooting control unit 53, a pointer detection unit 54, and a coordinate calculation unit 55. The position instruction operation detection unit 50 functions as an operation detection unit and a posture detection unit.
The imaging unit 51 (imaging means) is arranged in the same direction as the projection optical system 23, and has an angle of view that covers a range in which the projection optical system 23 projects an image on the screen SC, CCD, or CMOS. And an interface circuit that reads and outputs the detection value of the image sensor. In addition, the imaging control unit 53 causes the imaging unit 51 to perform imaging and generates captured image data. When the imaging unit 51 performs imaging under the control of the imaging control unit 53, the indicator 70 operated on or near the screen SC is imaged together with the image projected on the screen SC.
The receiving unit 52 receives and decodes the infrared signal transmitted by the transmitting unit 74 and outputs received data. The reception data output by the reception unit 52 includes data indicating the operation state of the operation switch 72 and the posture switch 73.

The indicator detection unit 54 detects the position of the indicator 70 based on the captured image data generated by the imaging control unit 53. The indicator detection unit 54 performs a process of detecting a shape similar to the indicator 70 from the captured image data and cutting out an image of the indicator 70, and specifies the direction in which the tip of the indicator 70 is facing. The indicator detection unit 54 detects the operation state of the operation switch 72 and the posture of the indicator 70 based on the reception data output from the reception unit 52. Thereby, the indicator detection unit 54 specifies the position of the indicator 70 and the posture of the indicator 70 in the captured image data.
The coordinate calculation unit 55 is based on the position of the indicator 70 and the orientation of the indicator 70 in the captured image data specified by the indicator detection unit 54, and the coordinates of the position indicated by the tip of the indicator 70 on the screen SC. That is, the coordinates of the indicated position are calculated. Here, the coordinates calculated by the coordinate calculation unit 55 are, for example, coordinates based on an area (projection area) on which the projection unit 20 projects a projection image on the screen SC. The coordinate calculation unit 55 outputs data indicating the calculated coordinates of the indicated position, the orientation of the indicator 70 identified by the indicator detection unit 54, the operation state of the operation switch 72, and the like to the control unit 30. In addition, the coordinate calculation unit 55 may output captured image data captured by the imaging unit 51 to the control unit 30.

The control unit 30 reads out and executes the control program 36 stored in the storage unit 35, thereby realizing the functions of the projection control unit 31, the detection control unit 32, the function control unit 33, and the output control unit 34. Each part of the projector 10 is controlled.
The projection control unit 31 (projection control means) detects the content of the operation performed by the operator based on the operation data input from the operation detection unit 17, and the image processing unit 40, the light modulation device according to this operation. The drive unit 15, the projection optical system drive unit 16, and the light source drive unit 14 are controlled to project an image on the screen SC. Further, the projection control unit 31 controls the projection optical system driving unit 16 to execute focus adjustment, zoom adjustment, aperture adjustment, and the like by the projection optical system 23.

  The detection control unit 32 controls the position indication operation detection unit 50 to execute detection of the indication position of the indicator 70 and detection of the orientation of the indicator 70, and the detected indication position and the orientation of the indicator 70 are detected. get. In addition, the detection control unit 32 controls the position instruction operation detection unit 50 to detect the operation state of the operation switch 72 provided in the indicator 70. Thereby, the detection control part 32 detects that the user performed operation using the indicator 70 and the state of the indicator 70 at the time of operation.

  Based on the attitude of the indicator 70, the detection control unit 32 distinguishes the operation of the indicator 70 into a normal operation and a special operation. The normal operation is an operation of pressing the tip of the indicator 70 against the screen SC. When the normal operation is performed, the image of the indicator 70 extracted from the photographed image data by the indicator detection unit 54 faces the screen SC, and the operation switch 72 is turned on. When the user performs drawing or gives an instruction to the tool bar 201 (FIG. 1), the normal operation by the indicator 70 is performed.

The special operation is an operation for placing the indicator 70 in a specific posture. This specific posture is, for example, an operation for making the posture incapable of drawing. Specifically, an operation for making the shaft portion 71 (FIG. 1) of the indicator 70 parallel to the screen SC, the shaft portion 71. Are parallel and horizontal to the screen SC, or an operation of moving the indicator 70 up and down or left and right while performing these operations. As another specific example, there is an operation in which the end portion of the indicator 70, that is, the end opposite to the operation switch 72 is directed to the screen SC. While these operations are being performed, the operation switch 72 cannot be pressed against the screen SC, which corresponds to “an operation that cannot perform drawing”. The state of the indicator 70 to be detected as a special operation and the detection conditions are set in advance and stored in the storage unit 35.
Of these operations, for example, the operation of making the shaft portion 71 parallel to the screen SC and the operation of making the shaft portion 71 parallel and horizontal to the screen SC are usually based on the state of the attitude switch 73. It can be detected separately from the operation. Further, the operation of directing the end portion of the indicator 70 toward the screen SC can be detected separately from the normal operation based on the orientation of the image of the indicator 70 extracted from the captured image data of the imaging unit 51. Further, the operation of moving the indicator 70 up and down or left and right in a state where the shaft portion 71 is parallel to the screen SC or the shaft portion 71 is parallel to the screen SC, By comparing the image of the indicator 70 in the captured image data of the imaging unit 51 with time, it can be detected separately from the normal operation. Further, since the special operation is an operation that cannot be drawn, it may be included in the detection condition for the special operation that the operation switch 72 is not turned on. In this way, specific conditions for detecting a special operation are stored in the storage unit 35.
The detection control unit 32 sets the conditions in which the image of the indicator 70 detected by the indicator detection unit 54 from the captured image data of the imaging unit 51, the detection state of the operation switch 72 and the posture switch 73, and the like are stored in the storage unit 35. Detect special operations when satisfied.

The function control unit 33 (function control means) controls the execution of the function of the projector 10 in accordance with the operation by the indicator 70 detected by the detection control unit 32 and the operation mode of the projector 10 at the time of the operation.
As described above, the projection system 1 is executed by switching between the PJ mode in which the projector 10 performs drawing and generates an image based on the operation of the indicator 70 and the PC mode in which the PC 100 performs drawing and generates an image. To do. In the PJ mode, the projector 10 switches between a drawing mode for drawing and a drawing setting mode for performing various settings related to the operation of the drawing mode. On the other hand, in the PC mode, the PC 100 switches between a drawing mode for drawing, a drawing setting mode for performing various settings related to the operation of the drawing mode, and the PC operation mode described above.
For example, when the projection system 1 is operating in the PJ mode and the projector 10 is executing the drawing mode, the function control unit 33 detects the normal position of the indicator 70 when the detection control unit 32 detects a normal operation. Are output to the image input unit 41 and the drawing processing unit 43 causes the drawing to be executed. In addition, when the projector 10 is executing the drawing setting mode and the detection control unit 32 detects a normal operation, the function control unit 33 sets the coordinates of the pointing position of the pointer 70 and the setting projected on the screen SC. Based on the position of an icon or the like on a work screen (not shown), the contents instructed by this operation are specified and settings are made.

If the detection control unit 32 detects a special operation when the projection system 1 is operating in the PJ mode, the function control unit 33 executes a function different from the normal operation. A function to be executed according to a special operation is assigned in association with each drawing mode and each operation mode other than the drawing mode. These functions are functions other than drawing. When a special operation is detected, the function control unit 33 executes a function assigned corresponding to the operation mode being executed.
Further, when the projection system 1 is operating in the PC mode, the function control unit 33 indicates the instruction of the indicator 70 detected by the position instruction operation detection unit 50 when the detection control unit 32 detects a normal operation and a special operation. The output control unit 34 causes the PC 100 to output data indicating the position and data indicating whether the detected operation is a special operation or a normal operation.

  The PC 100 includes a control unit 101 that centrally controls each unit of the PC 100. The control unit 101 is realized by a CPU, a ROM that stores a basic control program executed by the CPU, a RAM that temporarily stores a program executed by the CPU, data processed by the CPU, and the like. Further, the PC 100 displays on the monitor 108 the input unit 106 that detects an input operation using an input device including a pointing device such as a keyboard and a mouse, the content of the input operation detected by the input unit 106, the processing result of the control unit 101, and the like. Display unit 107, external interface 109 connected to I / F unit 11 of projector 10 via cable 1a, various programs including control program 111 executed by control unit 101, and processing by these programs And a storage unit 110 that stores data to be processed.

The control unit 101 executes functions of the device control unit 102, the image selection unit 103, the image output unit 104, and the drawing processing unit 105 by executing the control program 111.
The device control unit 102 executes processing for controlling the projector 10 in the PC mode, processing for receiving data transmitted from the projector 10, and the like.
When outputting image data to the projector 10, the image selection unit 103 selects image data to be output according to the operation detected by the input unit 106. For example, the image selection unit 103 may select image data directly designated by a user operation from image data (not shown) stored in the storage unit 110, or the storage unit 110 in a preset order. It is also possible to select the image data within.
The image output unit 104 (projection control means) outputs the image data selected by the image selection unit 103 to the projector 10. Further, the image output unit 104 may perform processing for converting the resolution and frame rate of the selected image data in accordance with the specifications of the projector 10.

Further, the device control unit 102 (function control unit), in the PC mode, data indicating the pointing position of the pointer 70 detected by the position pointing operation detection unit 50 of the projector 10, data regarding the posture of the pointer 70, and detection Data indicating whether the operated operation is a special operation or a normal operation is received from the projector 10. The device control unit 102 executes functions assigned in advance to the operation mode of the PC 100 and each of the normal operation and the special operation. For example, in the drawing mode in which the PC 100 performs drawing, the device control unit 102 outputs the coordinate data of the designated position to the drawing processing unit 105 and executes drawing for normal operation. Further, when the projector 10 detects a special operation in the drawing mode, switching to an operation mode other than the drawing mode is executed.
In the PC mode, the drawing processing unit 105 (drawing unit) executes a drawing process for generating or updating an image according to the coordinates of the pointing position of the indicator 70 from the device control unit 102 when the coordinates are input. Output data. The image data output from the drawing processing unit 105 is output to the projector 10 by the image output unit 104.

FIG. 3 is an explanatory diagram illustrating an example of a table that defines a correspondence between an operation mode of the projection system 1 and a function executed in response to an operation. This table is stored in the storage unit 35 of the projector 10 and the storage unit 110 of the PC 100, for example.
In the table illustrated in FIG. 3, for each of the PC mode and the PJ mode, a function executed in response to a normal operation and a function executed in response to a special operation are defined. For the PC mode, a drawing mode, a drawing setting mode, and a PC operation mode are set as operation modes executed by the PC 100. For the PJ mode, a drawing mode and a drawing setting mode are set as operation modes executed by the projector 10.

First, the PC mode will be described.
In the PC mode, the PC 100 can be switched between a drawing mode, a drawing setting mode for performing settings related to drawing, and a PC operation mode for processing the pointing position of the pointer 70 as the input coordinates of the pointing device of the PC 100. . When a normal operation of the indicator 70 is detected in the drawing mode, the device control unit 102 causes the drawing processing unit 105 to perform drawing, and causes the image output unit 104 to output the drawn image to the projector 10. In the PC operation mode, the process is executed using the coordinates of the designated position for normal operation as the input coordinates of the pointing device.
In addition, when a normal operation of the indicator 70 is detected in the drawing setting mode, the device control unit 102 determines the operation instruction position, a button on the toolbar 201 (FIG. 1) on the screen SC, and a setting screen (not shown). ) The position of the above icon or the like is collated, the content instructed by this normal operation is specified, and settings relating to drawing are performed according to the instruction. Here, the functions executed by the device control unit 102 include processing for saving an image drawn in the drawing mode, settings relating to drawing (type of figure to be drawn, line width, line color, as illustrated in FIG. , Texture, etc.), adjustment (calibration) between the actual designated position of the indicator 70 and the designated position detected by the projector 10 and the like. In addition, when the icon or button for instructing switching to the PC operation mode is operated in the drawing setting mode, the device control unit 102 executes switching to the PC operation mode.

  When the projector 10 detects a special operation of the indicator 70 in the drawing mode of the PC 100, the device control unit 102 executes a preset function. Here, the functions executed by the device control unit 102 include, for example, switching to the PC operation mode, processing for saving an image drawn in the drawing mode, changing settings related to drawing, calibration, etc., as illustrated in FIG. This is one function selected in advance. In the example of FIG. 3, it is defined that the device control unit 102 switches to the drawing mode when a special operation is detected in the PC operation mode.

Next, the PJ mode will be described.
In the PJ mode, the projector 10 can be executed by switching between a drawing mode and a drawing setting mode for performing settings related to drawing. When the normal operation of the indicator 70 is detected in the drawing mode, the function control unit 33 outputs the coordinates of the indicated position to the image processing unit 40 and causes the drawing processing unit 43 to perform drawing, and optically modulates the drawn image. The apparatus drive unit 15 is made to output.
When the normal operation of the indicator 70 is detected in the drawing setting mode, the function control unit 33 detects the operation instruction position, the button of the toolbar 201 (FIG. 1) on the screen SC, and the setting screen (not shown). The position of the upper icon or the like is collated, the content instructed by this normal operation is specified, and the setting related to the drawing is performed according to the instruction. Here, the functions executed by the function control unit 33 include, as illustrated in FIG. 3, processing for saving an image rendered in the rendering mode, modification of settings related to rendering, calibration, as illustrated in FIG. There are on / off switching of a function for freezing a projected image, switching between an annotation mode for drawing over a projected image and a whiteboard mode for drawing on a white background without drawing the projected image.

  When a special operation of the indicator 70 is detected in the drawing mode of the projector 10, the function control unit 33 executes a preset function. Here, the functions executed by the function control unit 33 include, as illustrated in FIG. 3, processing for saving an image rendered in the rendering mode, modification of settings related to rendering, calibration, as illustrated in FIG. 1 selected in advance from on / off switching of a function for freezing a projected image, switching between an annotation mode for drawing on a projected image and a whiteboard mode for drawing on a white background without drawing the projected image One function.

  As described above, in the projection system 1, the projector 10 can detect the normal operation of the indicator 70 and the special operation separately based on the posture of the indicator 70 or the posture and movement, and the special operation is performed. In such a case, drawing is not performed even in the drawing mode, and functions other than preset drawing are executed. For this reason, for example, when the operation of leveling the indicator 70 is performed while drawing is performed in the drawing mode, the image can be saved or the operation mode can be switched to the PC operation mode. As a result, the procedure of once designating another function after finishing the drawing mode can be omitted, and various functions can be easily executed without worrying about the operation mode being executed.

4 to 5 are flowcharts showing the operation of the projection system 1. 4 shows an operation when the PC 100 executes the drawing mode particularly in the PC mode, and FIG. 5 shows an operation when the projector 10 executes the drawing mode in the PJ mode.
Even in the PC mode, the projector 10 performs the operation by the indicator 70 and the detection of the posture of the indicator 70 by the control of 32, and when the normal operation or the special operation is detected, the coordinate data of the indication position by the indicator 70 and Operation data including data indicating normal operation or special operation is output to the PC 100.
The control unit 101 starts the drawing mode (step S11) and waits until operation data is received from the projector 10 (step S12). When the operation data is received (step S12), the device control unit 102 analyzes the received operation data to determine whether the operation is a special operation or a normal operation (step S13). If the operation data is a special operation (step S13; Yes) For example, according to the definition of the table of FIG. 3, the function assigned to the special operation in the drawing mode, that is, the function other than the drawing is executed (step S14), and this process is terminated.

On the other hand, when the operation data received from the projector 10 is normal operation data (step S13; No), the device control unit 102 acquires the coordinates included in the operation data (step S15), and sends the coordinates to the drawing processing unit 105. The coordinates are output and the drawing processing unit 105 executes drawing (step S16). Thereafter, the image output unit 104 generates image data of an image generated or updated by drawing and outputs the image data to the projector 10 to update the image being projected on the screen SC (step S17).
Thereafter, the control unit 101 determines whether or not an operation for ending the drawing mode has been performed (step S18). Switching from the drawing mode to another operation mode can be instructed not only by operation of the indicator 70 but also by operation of an input device connected to the input unit 106. When the drawing mode is continued (step S18; No), the control unit 101 returns to step S12. When switching from the drawing mode to another operation mode (step S18; Yes), the control unit 101 stores the image data of the image generated and updated by the drawing processing unit 105 in the storage unit 110 (step S18). S19), the operation mode is changed to the designated operation mode (step S20), and this process is terminated.

  In the PJ mode in which the projector 10 performs drawing, as shown in FIG. 5, when the control unit 30 starts the drawing mode (step S31), the detection control unit 32 controls the position instruction operation detection unit 50 to indicate Detection of normal operation or special operation by the body 70 is started (step S32). Here, the detection control unit 32 stands by until a normal operation or special operation by the indicator 70 is detected (step S33), and when a normal operation or special operation is detected (step S33; Yes), it is a normal operation or special operation. Is determined (step S34). If the detected operation is a special operation (step S34; Yes), the function control unit 33, for example, according to the definition of the table in FIG. 3, functions assigned to the special operation in the drawing mode, that is, other than drawing. The function is executed (step S35), and this process is terminated.

On the other hand, when the detected operation is a normal operation (step S34; No), the detection control unit 32 calculates the coordinates of the operation position (step S36), and outputs the calculated coordinates to the drawing processing unit 43 for drawing. Is executed (step S37). Thereafter, the image generated or updated by the drawing processing unit 43 is output to the light modulation device driving unit 15, and the image being projected on the screen SC is updated (step S38).
Thereafter, the control unit 30 determines whether or not an operation for ending the drawing mode has been performed (step S39). Switching from the drawing mode to another operation mode can be instructed not only by operating the indicator 70 but also by operating a remote controller (not shown) or the operation panel 19. When the drawing mode is continued (step S39; No), the control unit 30 returns to step S32. When switching from the drawing mode to another operation mode (step S39; Yes), the control unit 30 stores the image data of the image generated and updated by the drawing processing unit 43 in the storage unit 35 (step S39). (S40), the mode is changed to the designated operation mode (step S41), and this process is terminated.

As described above, according to the projection system 1 according to the embodiment to which the present invention is applied, the projector 10 that projects an image on the screen SC and the PC 100 connected to the projector 10 are provided. , A position indicating operation detecting unit 50 that detects a position indicating operation on the screen SC, and a drawing processing unit 43 that generates or updates an image based on the position of the operation detected by the position indicating operation detecting unit 50 in the PJ mode. A projection control unit 31 that updates an image projected on the screen SC based on the image generated or updated by the drawing processing unit 43, and detects the posture of the indicator 70 by the position instruction operation detection unit 50, A state in which the detected operation cannot be performed based on the detected posture by the control unit 33 If it is determined that the operation, executes a predetermined function without executing the processing by the drawing means.
In the PC mode, the PC 100 also generates a drawing processing unit 105 that generates or updates an image based on an operation of the indicator 70, and an image output unit that updates an image projected on the screen SC based on the generated or updated image. 104 and the posture of the indicator 70, when the projector 10 determines that the operation by the indicator 70 is an operation in which drawing cannot be performed, a predetermined process without executing the processing by the image output unit 104 is performed. A device control unit 102 that executes the function.
As a result, in the PC mode and the PJ mode, if the user can use the drawing function using the indicator 70 and operate the indicator 70 in such a manner that the drawing cannot be executed, the functions other than the drawing are executed. Can be made. Here, in order to execute a predetermined function, an operation in a mode in which drawing cannot be executed is necessary. Therefore, a function not intended by the user is not erroneously executed. Therefore, by changing the operation mode of the indicator 70, it is possible to execute a plurality of types of functions by operating one indicator 70 without performing a complicated switching operation.

The projector 10 can execute a drawing mode in which an image is generated or updated by the drawing processing unit 43 in the PJ mode, and the function control unit 33 draws an operation detected by the position instruction operation detection unit 50 during the drawing mode. For example, a predetermined function defined by the table of FIG. 3 is executed. Thereby, during the operation in the PJ mode, the drawing function and the function other than the drawing can be easily switched and executed in the drawing mode.
Further, the PC 100 can execute a drawing mode in which an image is generated or updated by the drawing processing unit 105 in the PC mode, and the device control unit 102 draws an operation of the indicator 70 by the projector 10 during the drawing mode. When it is determined that the operation cannot be performed, a predetermined function defined by the table of FIG. 3 is executed, for example. Thereby, even when operating in the PC mode, the drawing function and the function other than the drawing can be easily switched and executed in the drawing mode.

Further, in the PJ mode, the projector 10 can be switched between a drawing mode and one or a plurality of operation modes for executing an operation other than drawing. During the execution of the drawing mode, the projector 10 can be operated. A drawing function and a function other than drawing can be easily switched and executed.
In the PC mode, the PC 100 can be switched between a drawing mode and one or a plurality of operation modes for performing an operation other than drawing, and the drawing function and operation can be performed by operating the indicator 70 during the drawing mode. Functions other than drawing can be easily switched and executed.

  Since the position instruction operation detection unit 50 provided in the projector 10 detects the posture of the indicator 70 and the operation of the indicator 70, the drawing is performed based on not only the posture of the indicator 70 but also the operation of the indicator 70. It is possible to more accurately determine whether or not the operation is an operation that cannot be performed. For this reason, it is possible to easily switch and execute a drawing function and a function other than drawing as intended by the user who uses the indicator 70, and further improvement in convenience can be expected.

Since the position instruction operation detection unit 50 provided in the projector 10 detects the attitude of the indicator 70 based on the state of the attitude switch 73 provided in the indicator 70, the attitude of the indicator 70 is detected more quickly and accurately. it can.
Further, since the projector 10 includes the imaging unit 51 that captures the indicator 70, the position instruction operation detection unit 50 can also detect the posture of the indicator 70 based on the captured image of the imaging unit 51. is there. In this case, since the imaging unit 51 can be used for both position detection and posture detection, there is an advantage that hardware can be used efficiently.

The above-described embodiment is merely an example of a specific mode to which the present invention is applied, and the present invention is not limited. The present invention can be applied as a mode different from the above-described embodiment. For example, in the above-described embodiment, the projector 10 detects the normal operation and the special operation by the indicator 70 in the PC mode, calculates the coordinates of the indicated position, and transmits the operation data to the PC 100 as an example. However, the present invention is not limited to this. For example, in the PC mode, the projection image data, the captured image data captured by the imaging unit 51, and the data received from the indicator 70 are output from the projector 10 to the PC 100, and the PC 100 performs normal operations and special operations. It is good also as composition which detects operation.
In the above-described embodiment, the imaging unit 51 included in the position instruction operation detection unit 50 is arranged to face the same direction as the projection optical system 23 and captures the screen SC from above. It may be arranged separately from the main body of the projector 10, and in this case, the imaging unit 51 may take a picture from the side or front of the screen SC. Further, a plurality of imaging units 51 may be arranged, and the detection control unit 32 may detect the posture and position of the indicator 70 based on the captured image data of the plurality of imaging units 51.
Further, in the above-described embodiment, the configuration in which the indicator 70 includes the posture switch 73 for detecting the tilt has been described as an example. However, the posture switch 73 may be a gyro sensor, for example, and the tilt of the shaft portion 71 may be determined. It may be detected as an absolute value.

  In the above embodiment, the light modulation device 22 that modulates the light emitted from the light source has been described by taking as an example a configuration using three transmissive liquid crystal panels corresponding to RGB colors. However, the present invention is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a combination of one liquid crystal panel and a color wheel, and three digital mirror devices (DMD). You may comprise by the system using a DMD system etc. which combined one digital mirror device and the color wheel. Here, when only one liquid crystal panel or DMD is used as the light modulation device, a member corresponding to a combining optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and the DMD, any light modulation device capable of modulating light emitted from the light source can be employed without any problem.

Furthermore, in the above-described embodiment, the configuration in which an image is projected based on input image data input from the PC 100 to the I / F unit 11 has been described as an example. However, an image input from a device other than the PC 100 is projected. In this state, the PC mode or the PJ mode may be executed.
Moreover, each function part of the projection system 1 shown in FIG. 2 shows a functional structure, and a specific mounting form is not particularly limited. That is, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to adopt a configuration in which the functions of a plurality of function units are realized by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, specific detailed configurations of other parts of the projection system 1 can be arbitrarily changed without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Projection system, 10 ... Projector, 15 ... Light modulation apparatus drive part, 17 ... Operation detection part, 20 ... Projection part, 30 ... Control part, 31 ... Projection control part (projection control means), 32 ... Detection control part, 33 ... Function control unit (function control unit), 34 ... Output control unit, 35 ... Storage unit, 40 ... Image processing unit, 43 ... Drawing processing unit (drawing unit), 50 ... Position indication operation detection unit (operation detection unit, (Attitude detection means), 51 ... imaging unit (imaging means), 52 ... reception unit, 53 ... imaging control unit, 54 ... indicator detection unit, 55 ... coordinate calculation unit, 70 ... indicator, 71 ... shaft part, 72 ... Operation switch 73 ... Attitude switch 74 ... Transmission unit 100 ... PC (computer) 101 ... Control unit 102 ... Device control unit (function control means) 103 ... Image selection unit 104 ... Image output unit (projection control) Means), 105 Drawing processing unit (drawing means), 110 ... storage unit, 111 ... control program (program), 201 ... toolbar, SC ... screen (projection surface).

Claims (11)

A projector that projects an image on a projection surface,
Operation detecting means for detecting a position indicating operation with respect to the projection surface by an indicator;
Drawing means for generating or updating an image based on the position of the operation detected by the operation detection means;
A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
Imaging means for photographing the indicator;
Posture detection means for detecting the posture of the indicator based on a photographed image of the imaging means ;
When it is determined that the operation detected by the operation detection unit is an operation in a state in which drawing cannot be performed based on the posture detected by the posture detection unit, the processing by the drawing unit is not performed and a predetermined process is performed. Function control means for executing functions;
A projector characterized by comprising: A drawing mode for generating or updating an image by the drawing means can be executed,
2. The function control unit according to claim 1, wherein the function control unit executes a predetermined function when it is determined that the operation detected by the operation detection unit during the drawing mode is an operation in a mode in which drawing cannot be performed. The projector described.   The switchable mode can be executed by switching between the drawing mode and one or a plurality of operation modes for executing an operation other than the drawing based on the indicated position of the position indicating operation detected by the operation detecting means. 2. The projector according to 2.   The projector according to claim 1, wherein the posture detection unit detects a posture of the indicator and an operation of the indicator. A method of controlling a projector that projects an image on a projection surface,
Detecting a position indicating operation on the projection surface by an indicator;
Generate or update an image based on the position of the detected operation,
Based on the generated or updated image, the image projected on the projection surface is updated,
Shoot the indicator,
Detecting the posture of the indicator based on the photographed image ,
Based on the detected posture of the indicator, if it is determined that the operation of the indicator is an operation in a state where drawing cannot be performed, a predetermined function is executed without executing image generation or update processing To do,
A projector control method characterized by the above. A computer-executable program connected to a projector that projects an image onto a projection surface,
The computer,
Drawing means for generating or updating an image based on a position instruction operation on the projection surface by an indicator;
A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
When it is determined that the operation by the indicator cannot be performed based on the posture of the indicator detected based on the photographed image obtained by photographing the indicator, the processing by the drawing unit is performed. Function control means for executing a predetermined function without executing;
A program characterized by making it function. A projection system comprising: a projector that projects an image on a projection surface; and a computer connected to the projector,
Operation detecting means for detecting a position indicating operation with respect to the projection surface by an indicator;
Drawing means for generating or updating an image based on the position of the operation detected by the operation detection means;
A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
Imaging means for photographing the indicator;
Posture detection means for detecting the posture of the indicator based on a photographed image of the imaging means ;
When it is determined that the operation detected by the operation detection unit is an operation in a state in which drawing cannot be performed based on the posture detected by the posture detection unit, the processing by the drawing unit is not performed and a predetermined process is performed. Function control means for executing functions;
A projection system characterized by comprising:   A projector that projects an image on a projection surface,
  Operation detecting means for detecting a position indicating operation with respect to the projection surface by an indicator;
  Drawing means for generating or updating an image based on the position of the operation detected by the operation detection means;
  A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
  Posture detection means for detecting the inclination of the indicator;
  If it is determined that the operation detected by the operation detection unit is an operation in a state in which drawing cannot be performed based on the inclination detected by the posture detection unit, the processing by the drawing unit is not performed and a predetermined process is performed. Function control means for executing functions;
  A projector characterized by comprising:   A method of controlling a projector that projects an image on a projection surface,
  Detecting a position indicating operation on the projection surface by an indicator;
  Generate or update an image based on the position of the detected operation,
  Based on the generated or updated image, the image projected on the projection surface is updated,
  Detecting the tilt of the indicator,
  Based on the detected inclination of the indicator, if it is determined that the operation of the indicator is an operation that cannot perform drawing, a predetermined function is executed without executing image generation or update processing. To do,
  A projector control method characterized by the above.   A computer-executable program connected to a projector that projects an image onto a projection surface,
  The computer,
  Drawing means for generating or updating an image based on a position instruction operation on the projection surface by an indicator;
  A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
  Function control means for executing a predetermined function without executing processing by the drawing means when it is determined that the operation by the pointer is an operation in which drawing cannot be executed based on the inclination of the pointer When,
  A program characterized by making it function.   A projection system comprising: a projector that projects an image on a projection surface; and a computer connected to the projector,
  Operation detecting means for detecting a position indicating operation with respect to the projection surface by an indicator;
  Drawing means for generating or updating an image based on the position of the operation detected by the operation detection means;
  A projection control means for updating an image projected on the projection surface based on the image generated or updated by the drawing means;
  Posture detection means for detecting the inclination of the indicator;
  If it is determined that the operation detected by the operation detection unit is an operation in a state in which drawing cannot be performed based on the inclination detected by the posture detection unit, the processing by the drawing unit is not performed and a predetermined process is performed. Function control means for executing functions;
  A projection system characterized by comprising:

Images