JP2014182468A - Projector, projection system, and control method of projector - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make a projector project an image in which an image according to coordinates input from an electronic apparatus having a touch panel and coordinates input from an indication body is drawn on an input image .SOLUTION: A projector 1 includes: a projection part 104 configured to project an image indicated by a video signal; a coordinate data acquisition part 108 configured to acquire first coordinate data indicating coordinates of a point on a first image indicated by the video signal from a tablet terminal 4 having a touch panel 44; a coordinate data generation part 106 configured to acquire second coordinate data indicating coordinates of a point indicated through an indication body 3 by a user, on a projection surface on which the first image is projected; an integration part 110 configured to generate third coordinate data integrating the first coordinate data and the second coordinate data; an image data acquisition part 112 configured to acquire image data indicating a second image in which an image according to the third coordinate data is drawn on the first image; and an image data output part 114 configured to output the image data to the tablet terminal 4.

Description

  The present invention relates to a projector, a projection system, and a projector control method.

  A technique for transmitting an image from a terminal device such as a mobile phone to a projector using a wireless connection is known. Patent Document 1 describes that a portable terminal transmits projection data to a wirelessly connected projector. Patent Document 2 describes that an image of a portable terminal is projected on a screen in an easy-to-view manner via a server capable of wireless connection. There is also known an interactive projection system in which a user can perform pseudo writing using a pen-shaped indicator on a projection surface on which an image is projected.

JP 2003-198870 A JP 2009-98384 A

  In the above system, it was not possible to draw on the projection surface using a portable terminal. An object of the present invention is to cause a projector to project an image in which an image corresponding to coordinates input from an electronic device having a touch panel and coordinates input from an indicator is drawn on an input image.

  In order to solve the above-described problem, the present invention provides a first unit that indicates coordinates of a point on a first image indicated by the video signal from an electronic device having a projection unit that projects an image indicated by the video signal and a touch panel. A first coordinate data acquisition unit for acquiring coordinate data; and second coordinate data indicating the coordinates of a point designated by a user with an indicator on the projection surface on which the first image is projected by the projection unit. A third coordinate data acquisition unit, a first coordinate data acquired by the first coordinate data acquisition unit, and a second coordinate data acquired by the second coordinate data acquisition unit are integrated. An integration unit that generates coordinate data, and image data that acquires image data indicating a second image in which an image corresponding to the third coordinate data generated by the integration unit is drawn on the first image An acquisition unit; and And an image data output unit for outputting image data acquired by the acquisition unit to the electronic device, to provide a projector and an output unit for outputting an image signal to the projection portion indicating the second image. According to this projector, a second image in which an image corresponding to the coordinates input from the electronic device and the coordinates input from the indicator is drawn on the first image is projected.

  In another preferred aspect, the third coordinate data indicates one selected coordinate among the coordinates indicated by the first coordinate data and the coordinates indicated by the second coordinate data. According to this projector, when an image according to the coordinates input from the electronic device is drawn on the first image, and when an image according to the coordinates input from the indicator is drawn on the first image. And switch.

  In another preferred aspect, the third coordinate data indicates the coordinates indicated by the first coordinate data and the coordinates indicated by the second coordinate data, which are distinguished by different identifiers. . According to this projector, an image corresponding to the coordinates input from the electronic device and an image corresponding to the coordinates input from the indicator are drawn on the first image at a time.

  In another preferred aspect, the coordinate identifier indicated by the first coordinate data and the coordinate identifier indicated by the second coordinate data correspond to different input devices. According to this projector, the image corresponding to the coordinates input from the electronic device and the image corresponding to the coordinates input from the indicator are drawn by different input devices.

  Moreover, in another preferable aspect, the image data acquisition unit includes a coordinate data output unit that outputs the third coordinate data generated by the integration unit to an external device that is an input source of the video signal. The image data is acquired from the external device. According to this projector, an image corresponding to the coordinates input from the electronic device and the coordinates input from the indicator is drawn on the external device.

  In another preferable aspect, the image data is generated by combining the drawing unit that draws an image according to the third coordinate data, the first image, and the image drawn by the drawing unit. A synthesizing unit, and the image data acquiring unit acquires the image data from the synthesizing unit. According to this projector, an image corresponding to the coordinates input from the electronic device and the coordinates input from the indicator is drawn without using an external device.

  According to another aspect of the invention, there is provided a projector and an electronic device, the projector projecting an image indicated by the video signal, and coordinates of a point on the first image indicated by the video signal from the electronic device. A first coordinate data acquisition unit for acquiring first coordinate data indicating a second coordinate indicating a point indicated by a user on the projection surface on which the first image is projected by the projection unit; A second coordinate data acquisition unit that acquires coordinate data, the first coordinate data acquired by the first coordinate data acquisition unit, and the second coordinate data acquired by the second coordinate data acquisition unit are integrated. An integration unit that generates the generated third coordinate data, and image data indicating a second image in which an image corresponding to the third coordinate data generated by the integration unit is drawn on the first image To get image data An image data output unit that outputs the image data acquired by the image data acquisition unit to the electronic device, and an output unit that outputs a video signal indicating the second image to the projection unit, The electronic device includes a touch panel, a coordinate conversion unit that converts the coordinates of a point designated by a user on the touch panel into the coordinates of a point on a first image, and generates the first coordinate data. A coordinate data output unit that outputs the first coordinate data generated by the conversion unit to the projector, and a display control unit that causes the touch panel to display the second image indicated by the image data output from the projector; A projection system is provided. According to this projection system, a second image in which an image corresponding to the coordinates input from the electronic device and the coordinates input from the indicator is drawn on the first image is projected.

  According to the present invention, the projection unit projects the image indicated by the video signal, and first coordinate data indicating the coordinates of the point on the first image indicated by the video signal is obtained from an electronic device having a touch panel. A step of obtaining second coordinate data indicating coordinates of a point designated by a user on the projection surface on which the first image is projected, the first coordinate data, and the first A step of generating third coordinate data in which two coordinate data are integrated, and image data indicating a second image in which an image corresponding to the third coordinate data is drawn on the first image. And a step of outputting the image data to the electronic device, and a step of outputting a video signal indicating the second image to the projection unit. According to this projector control method, a second image in which an image corresponding to the coordinates input from the electronic device and the coordinates input from the indicator is drawn on the first image is projected.

The figure which shows the whole structure of projection system PS1. The block diagram which shows the functional structure of projection system PS1. The block diagram which shows the hardware constitutions of a projector. The block diagram which shows the hardware constitutions of PC. The block diagram which shows the hardware constitutions of a pointer. The block diagram which shows the hardware constitutions of a tablet terminal. The sequence chart which shows the process in projection system PS1. The flowchart which shows a resizing process. The figure which shows the whole structure of projection system PS2. The block diagram which shows the functional structure of projection system PS2. The sequence chart which shows the process in projection system PS2.

(Embodiment 1)
FIG. 1 is a diagram showing an overall configuration of a projection system PS1 according to the first embodiment of the present invention. The projection system PS1 includes a projector 1, a personal computer 2, an indicator 3, a tablet terminal 4, a controller RC, and a screen SC. The projector 1 is a device that projects an image (hereinafter referred to as “input image”) indicated by a video signal onto a screen SC. The projector 1 is a front projection type short-focus projector, and is disposed at a position relatively close to the screen SC. In the example of FIG. 1, the projector 1 is disposed on the upper part of the screen SC. The personal computer 2 (hereinafter referred to as “PC2”) outputs a video signal to the projector 1. The PC 2 is wired to the projector 1 via an image signal cable and a USB (Universal Serial Bus) cable. The PC 2 is an example of an external device that is an input source of a video signal to the projector 1. The indicator 3 is a pen-type or bar-shaped operation device used as a writing instrument when a user electronically writes handwritten characters or images on an image projected from the projector 1 (hereinafter referred to as “projected image”). It is. The projector 1 has a function of continuously specifying the position of the indicator 3 on the screen SC. The tablet terminal 4 is an electronic device used when a user writes handwritten characters and images electronically from a position away from the screen SC with respect to an input image. When the user operates the touch panel 44 of the tablet terminal 4, an image corresponding to the operation is drawn on the input image on the PC 2. The tablet terminal 4 is connected to the projector 1 via a wireless LAN (Local Area Network) such as Wi-Fi (Wireless Fidelity: registered trademark). The controller RC is a device for controlling the projector 1 wirelessly such as infrared communication, a so-called remote controller. The screen SC is a plane that displays a projected image.

  FIG. 2 is a block diagram showing a functional configuration of the projection system PS1. The indicator 3 includes a pressure detection unit 301 and a light emitting unit 302. The pressure detector 301 detects that the tip of the indicator 3 is pressed against the screen SC in accordance with the writing operation by the user. The light emitting unit 302 outputs light when the pressure detecting unit 301 detects that the tip of the indicator 3 is pressed against the screen SC.

  The projector 1 includes a video signal acquisition unit 101, an image adjustment unit 102, an image processing unit 103, a projection unit 104, an imaging unit 105, a coordinate data generation unit 106, a coordinate conversion unit 107, and a coordinate data acquisition unit. 108, a coordinate conversion unit 109, an integration unit 110, a coordinate data output unit 111, an image data acquisition unit 112, an image compression unit 113, and an image data output unit 114. The video signal acquisition unit 101 acquires the video signal output from the PC 2. The image adjustment unit 102 changes (resizes) the size (resolution) of the input image to a size corresponding to the projection unit 104. Hereinafter, the process of changing the size of the input image is expressed as “resizing process”. The image processing unit 103 performs predetermined image processing on the resized input image (hereinafter referred to as “resized image”). The image processing unit 103 outputs the resized image subjected to the image processing to the projection unit 104. The image processing unit 103 is an example of an output unit that outputs a video signal to the projection unit 104. The projection unit 104 projects the resized image that has been subjected to image processing onto the screen SC as a projection image.

  The imaging unit 105 captures the screen SC and generates image data indicating the projection image and the light output from the indicator 3. A coordinate data generation unit 106 (an example of a second coordinate data acquisition unit), based on the image data generated by the imaging unit 105, shows coordinate data indicating the coordinates of a point indicated by the indicator 3 on the projection image by the user. (Hereinafter referred to as “pen input data”). The pen input data is an example of second coordinate data in the present invention. The coordinate conversion unit 107 converts the coordinate system of the coordinates indicated by the pen input data generated by the coordinate data generation unit 106 into the coordinate system of the input image.

  The coordinate data acquisition unit 108 (an example of a first coordinate data acquisition unit) acquires coordinate data (hereinafter referred to as “touch input data”) indicating the coordinates of a point on the resized image from the tablet terminal 4. The touch input data is an example of first coordinate data in the present invention. The coordinate conversion unit 109 converts the coordinate system of the coordinates indicated by the touch input data acquired by the coordinate data acquisition unit 108 into the coordinate system of the input image. The integration unit 110 generates coordinate data (hereinafter referred to as “integrated coordinate data”) in which the pen input data generated by the coordinate data generation unit 106 and the touch input data acquired by the coordinate data acquisition unit 108 are integrated. To do. “Integration” means that coordinates input from a plurality of pointing devices (in this example, the indicator 3 and the tablet terminal 4) are converted into a format that can be decoded by an element using the coordinates (in this example, the drawing unit 203). That means. That is, in this example, the coordinate data is integrated in order to reflect the coordinates indicated by the pen input data and the coordinates indicated by the touch input data in one coordinate data. The integrated coordinate data is an example of third coordinate data in the present invention. The coordinate data output unit 111 outputs the integrated coordinate data generated by the integration unit 110 to the PC 2.

  The image data acquisition unit 112 acquires image data indicating a resized image from the image adjustment unit 102. Hereinafter, for convenience of explanation, an input image in which an image corresponding to the integrated coordinate data is not drawn is referred to as a “primary image”, and an image in which an image corresponding to the integrated coordinate data is drawn on the primary image is referred to as “ It is called “secondary image”. The image data acquired by the image data acquisition unit 112 indicates a resized image of a primary image or a secondary image. The image compression unit 113 compresses the image data acquired by the image data acquisition unit 112. The image data output unit 114 outputs the image data compressed by the image compression unit 113 to the tablet terminal 4.

  The PC 2 includes a video signal output unit 201, a coordinate data acquisition unit 202, and a drawing unit 203. The video signal output unit 201 outputs a video signal to the projector 1. The coordinate data acquisition unit 202 acquires integrated coordinate data output from the projector 1. The drawing unit 203 draws an image corresponding to the integrated coordinate data acquired by the coordinate data acquisition unit 202 on the primary image, and generates a secondary image.

  The tablet terminal 4 includes a coordinate conversion unit 401, a coordinate data output unit 402, an image data acquisition unit 403, and a display control unit 404. The coordinate conversion unit 401 converts the coordinates of the point designated by the user on the touch panel 44 into the coordinates of the point on the resized image, and generates touch input data indicating the coordinates. The coordinate data output unit 402 outputs the touch input data generated by the coordinate conversion unit 401 to the projector 1. The image data acquisition unit 403 acquires image data output from the projector 1. The display control unit 404 displays an image corresponding to the resized image indicated by the image data acquired by the image data acquisition unit 403 on the touch panel 44.

  FIG. 3 is a block diagram illustrating a hardware configuration of the projector 1. The projector 1 includes a central processing unit (CPU) 10, a read only memory (ROM) 11, a random access memory (RAM) 12, an IF (interface) unit 13, an image processing circuit 14, a projection unit 15, The image sensor 16, the light receiving unit 17, the operation panel 18, and the input processing unit 19 are included. The CPU 10 is a control device that controls each unit of the projector 1 by executing the control program 11A. The ROM 11 is a non-volatile storage device that stores various programs and data. The ROM 11 stores a control program 11A executed by the CPU 10. The RAM 12 is a volatile storage device that stores data. The RAM 12 includes frame memories 12a and 12b. The frame memory 12a is an area for storing one frame of the resized image. The frame memory 12b is an area for storing a projection image for one frame.

  The IF unit 13 communicates with external devices such as the PC 2 and the tablet terminal 4. The IF unit 13 has various terminals (for example, a VGA terminal, a USB terminal, a wired or wireless LAN interface, an S terminal, an RCA terminal, an HDMI (High-Definition Multimedia Interface: registered trademark) terminal) for connecting to an external device. Prepare. In the present embodiment, the IF unit 13 communicates with the PC 2 via a VGA terminal and a USB terminal. Specifically, the IF unit 13 acquires a video signal from the PC 2 via the VGA terminal, and outputs integrated coordinate data to the PC 2 via the USB terminal. The IF unit 13 extracts vertical and horizontal synchronization signals from the video signal acquired from the PC 2. The IF unit 13 also communicates with the tablet terminal 4 via a wireless LAN interface. The image processing circuit 14 performs resizing processing and predetermined image processing on the input image. The image processing circuit 14 writes the resized image in the frame memory 12a and the resized image after image processing (that is, the projection image) in the frame memory 12b.

  The projection unit 15 includes a light source 151, a liquid crystal panel 152, an optical system 153, a light source drive circuit 154, a panel drive circuit 155, and an optical system drive circuit 156. The light source 151 includes a lamp such as a high-pressure mercury lamp, a halogen lamp, or a metal halide lamp, or a light emitter such as an LED (Light Emitting Diode) or a laser diode, and irradiates the liquid crystal panel 152 with light. The liquid crystal panel 152 is a light modulation device that modulates light emitted from the light source 151 in accordance with image data. In this example, the liquid crystal panel 152 has a plurality of pixels arranged in a matrix. The liquid crystal panel 152 has, for example, an XGA (eXtended Graphics Array) resolution and a display area configured by 1024 × 768 pixels. In this example, the liquid crystal panel 152 is a transmissive liquid crystal panel, and the transmittance of each pixel is controlled according to image data. The projector 1 includes three liquid crystal panels 152 corresponding to the three primary colors RGB. The light from the light source 151 is separated into three color lights of RGB, and each color light enters the corresponding liquid crystal panel 152. The color light modulated by passing through each liquid crystal panel is synthesized by a cross dichroic prism or the like and emitted to the optical system 153. The optical system 153 enlarges the light modulated into the image light by the liquid crystal panel 152 and projects it onto the screen SC, a zoom lens that enlarges / reduces the projected image, and adjusts the focus, and adjusts the degree of zooming. It has a zoom adjustment motor, a focus adjustment motor for adjusting the focus, and the like. The light source driving circuit 154 drives the light source 151 according to the control of the CPU 10. The panel drive circuit 155 drives the liquid crystal panel 152 according to the image data output from the CPU 10. The optical system driving circuit 156 drives each motor included in the optical system 153 according to the control of the CPU 10.

  The image sensor 16 is a solid-state imaging element group that images the screen SC and generates image data. The image sensor 16 is configured by, for example, a CMOS image sensor or a CCD image sensor. The projector 1 includes a plurality of image sensors 16 (image sensor group), and these image sensors 16 capture the screen SC at an angle of view including a maximum range in which the projection unit 15 can project a projection image. The light receiving unit 17 receives the infrared signal transmitted from the controller RC, decodes the received infrared signal, and outputs the decoded infrared signal to the input processing unit 19. The operation panel 18 has buttons and switches for turning on / off the projector 1 or performing various operations. The input processing unit 19 generates information indicating the operation content by the controller RC or the operation panel 18 and outputs the information to the CPU 10.

  In the projector 1, the CPU 10 executing the program is an example of the coordinate data generation unit 106, the coordinate conversion unit 107, the coordinate conversion unit 109, the integration unit 110, the image data acquisition unit 112, and the image compression unit 113. The IF unit 13 controlled by the CPU 10 executing the program is an example of the video signal acquisition unit 101, the coordinate data acquisition unit 108, the coordinate data output unit 111, and the image data output unit 114. The image processing circuit 14 controlled by the CPU 10 executing the program is an example of the image adjustment unit 102 and the image processing unit 103. The projection unit 15 that is controlled by the CPU 10 that is executing the program is an example of the projection unit 104. The image sensor 16 controlled by the CPU 10 executing the program is an example of the imaging unit 105.

  FIG. 4 is a block diagram illustrating a hardware configuration of the PC 2. The PC 2 includes a CPU 20, a ROM 21, a RAM 22, an IF unit 23, a display unit 24, and an input unit 25. The CPU 20 is a control device that controls each part of the PC 2 by executing a program. The ROM 21 is a nonvolatile storage device that stores various programs and data. The RAM 22 is a volatile storage device that stores data. The IF unit 23 communicates with an external device such as the projector 1. The IF unit 23 includes various terminals for connecting to an external device. The display unit 24 includes a display device such as a liquid crystal display or an organic EL (Electroluminescence) display. The input unit 25 is an input device that accepts input from a user, and includes a keyboard, a mouse, a touch pad, various buttons, and the like. In the PC 2, the CPU 20 executing the program is an example of the drawing unit 203. The IF unit 23 controlled by the CPU 20 executing the program is an example of the video signal output unit 201 and the coordinate data acquisition unit 202.

  FIG. 5 is a block diagram showing a hardware configuration of the indicator 3. The indicator 3 includes a control unit 30, a pressure sensor 31, and an LED (Light Emitting Diode) 32. The control unit 30 is a control device that controls the operation of each unit of the indicator 3. The pressure sensor 31 is provided at the tip of the indicator 3 and detects the pressure applied to the tip of the indicator 3. The LED 32 outputs light having a wavelength unique to the indicator 3. In the indicator 3, the pressure sensor 31 controlled by the control unit 30 is an example of the pressure detection unit 301. The LED 32 controlled by the control unit 30 is an example of the light emitting unit 302.

  FIG. 6 is a block diagram illustrating a hardware configuration of the tablet terminal 4. The tablet terminal 4 includes a CPU 40, a ROM 41, a RAM 42, an IF unit 43, and a touch panel 44. The CPU 40 is a control device that controls each part of the tablet terminal 4 by executing a program. The ROM 41 is a nonvolatile storage device that stores various programs and data. The RAM 42 is a volatile storage device that stores data. The IF unit 43 communicates with an external device such as the projector 1. The IF unit 43 includes a wireless LAN interface for connecting to the projector 1. The touch panel 44 is an input device in which a panel for sensing coordinates is superimposed on a display surface such as a liquid crystal display. As the touch panel 44, for example, an optical, resistive film, capacitance type, or ultrasonic type touch panel is used. In the tablet terminal 4, the CPU 40 executing the program is an example of the coordinate conversion unit 401 and the display control unit 404. The IF unit 43 controlled by the CPU 40 executing the program is an example of the coordinate data output unit 402 and the image data acquisition unit 403.

  FIG. 7 is a sequence chart showing processing executed in the projection system PS1. In this example, the PC 2 executes a drawing program for drawing an image on an input image (here, an image displayed on the display unit 24). Under these circumstances, when drawing on an input image (and a projection image) is desired, a method of operating the input unit 25 (for example, a mouse) of the PC 2 and a method of performing a writing operation using the indicator 3 There is. However, in the method of operating the input unit 25 of the PC 2, since the projector 1 and the PC 2 are connected by wire, there is a distance limitation when drawing from a place away from the projector 1. Further, in the method of performing the writing operation using the indicator 3, it is necessary to directly touch the projection image projected on the screen SC, so that drawing cannot be performed from a place away from the screen SC. The projection system PS1 causes the tablet terminal 4 to function as a pointing device for operating the PC 2 and suppresses distance restrictions when performing drawing. The process illustrated in FIG. 7 is started when the PC 2 outputs a video signal (here, a video signal indicating a primary image) to the projector 1, for example. In the following, a case where the writing operation using the indicator 3 and the operation of the tablet terminal 4 are performed together by different users will be described as an example.

  In step SA1, the CPU 10 of the projector 1 acquires a video signal from the PC 2. In step SA2, the CPU 10 performs a resizing process on the input image. The CPU 10 changes the size of the input image to a size corresponding to the liquid crystal panel 152 by resizing processing.

  FIG. 8 is a flowchart showing specific processing contents of the resizing processing. Hereinafter, a case where the size of the input image is larger than the size of the liquid crystal panel 152 (when the input image is reduced) will be described as an example. In step SA201, the CPU 10 acquires the size of the input image. The image size referred to here is the number of pixels in the vertical and horizontal directions of the image. The video signal includes a signal indicating the size of the input image, and the CPU 10 acquires the size of the input image based on the signal. The CPU 10 stores the acquired size of the input image in the RAM 12. In step SA202, the CPU 10 acquires the size of the liquid crystal panel 152. Specifically, the CPU 10 reads information indicating the resolution of the liquid crystal panel 152 stored in the ROM 11 and acquires the size of the liquid crystal panel 152.

  In step SA203, the CPU 10 determines whether or not the aspect ratio of the input image is equal to the aspect ratio of the liquid crystal panel 152. Specifically, the CPU 10 calculates the aspect ratio of the input image and the aspect ratio of the liquid crystal panel 152 based on the size of the input image and the size of the liquid crystal panel 152, and compares these aspect ratios. When it is determined that the aspect ratio of the input image and the aspect ratio of the liquid crystal panel 152 are not equal (step SA203: NO), the CPU 10 shifts the processing to step SA204. When it is determined that the aspect ratio of the input image is equal to the aspect ratio of the liquid crystal panel 152 (step SA203: YES), the CPU 10 shifts the processing to step SA205. For example, when the size of the input image is 1280 × 800, the aspect ratio of the input image is 16:10. When the size of the liquid crystal panel 152 is horizontal 1024 × vertical 768, the aspect ratio of the liquid crystal panel 152 is 4: 3. Therefore, in this case, it is determined that the aspect ratio of the input image and the aspect ratio of the liquid crystal panel 152 are not equal.

（Ｌ１：入力画像の横方向の画素数、Ｌ２：入力画像の縦方向の画素数、Ｌ３：液晶パネル１５２の横方向の画素数、Ｌ４：液晶パネル１５２の縦方向の画素数）
ＣＰＵ１０は、算出されたオフセット値αを、ＲＡＭ１２に記憶する。上述のサイズの例では、Ｌ１＝１２８０、Ｌ２＝８００、Ｌ３＝１０２４、Ｌ４＝７６８であり、オフセット値α＝２１４となる。 In step SA204, the CPU 10 calculates an offset value α. The offset value is a value indicating the number of pixels in the horizontal direction that are uniformly removed from the input image in the resizing process. The CPU 10 reads the size of the input image and the size of the liquid crystal panel 152 from the RAM 12, and calculates the offset value α by the following equation (1), for example.

(L1: number of pixels in the horizontal direction of the input image, L2: number of pixels in the vertical direction of the input image, L3: number of pixels in the horizontal direction of the liquid crystal panel 152, L4: number of pixels in the vertical direction of the liquid crystal panel 152)
The CPU 10 stores the calculated offset value α in the RAM 12. In the above example of size, L1 = 1280, L2 = 800, L3 = 1024, L4 = 768, and the offset value α = 214.

  In step SA205, the CPU 10 determines whether or not the size of the input image considering the offset value α (hereinafter referred to as “input image after offset”) is equal to the size of the liquid crystal panel 152. Specifically, the CPU 10 reads the size of the input image and the offset value α from the RAM 12, and subtracts the offset value α from the number of pixels in the horizontal direction of the input image, thereby reducing the size of the input image after the offset. calculate. Then, the CPU 10 reads the size of the liquid crystal panel 152 from the ROM 11 and compares the size of the input image after the offset with the size of the liquid crystal panel 152. When it is determined that the size of the input image after the offset and the size of the liquid crystal panel 152 are not equal (step SA205: NO), the CPU 10 shifts the processing to step SA206. If it is determined that the size of the input image after the offset and the size of the liquid crystal panel 152 are equal (step SA205: YES), the CPU 10 shifts the processing to step SA207. In the example of the size described above, the size of the input image after the offset is 1066 × 800 in the horizontal direction, and the size of the projection image is 1024 × 768 in the vertical direction. Therefore, it is determined that the size of the input image after the offset and the size of the liquid crystal panel 152 are not equal.

ＣＰＵ１０は、算出された変換係数βを、ＲＡＭ１２に記憶する。上述の例では、Ｌ２＝８００、Ｌ４＝７６８であり、変換係数β＝０．９６となる。なお、変換係数βは、オフセット値αを用いて以下の式（３）により算出されてもよい。

In step SA206, the CPU 10 calculates a conversion coefficient β. The conversion coefficient is a value indicating a ratio between the size of the input image and the size of the liquid crystal panel 152. The CPU 10 reads the size of the input image and the size of the projection image from the RAM 12, and calculates the conversion coefficient β by the following equation (2), for example.

The CPU 10 stores the calculated conversion coefficient β in the RAM 12. In the above example, L2 = 800, L4 = 768, and the conversion coefficient β = 0.96. Note that the conversion coefficient β may be calculated by the following equation (3) using the offset value α.

ＣＰＵ１０は、リサイズ画像を示す画像データをフレームメモリー１２ａに書き込む。 In step SA207, the CPU 10 resizes the input image using the offset value α and the conversion coefficient β. Specifically, the CPU 10 converts the coordinates (x, y) of each pixel in the input image into coordinates (X, Y) by the following equation (4). “X” and “X” represent coordinates in the horizontal direction of the image, and “y” and “Y” represent coordinates in the vertical direction of the image.

The CPU 10 writes image data indicating the resized image in the frame memory 12a.

  Refer to FIG. 7 again. In step SA3, the CPU 10 compresses image data indicating the resized image. Specifically, the CPU 10 acquires image data by reading the image data from the frame memory 12a, and compresses the image data so as to correspond to the frequency band of the wireless LAN. The CPU 10 compresses the image data by, for example, JPEG (Joint Photographic Experts Group) method. The compression of the image data is performed, for example, every few frames or every predetermined time. The CPU 10 stores the compressed image data in the RAM 12. In step SA4, the CPU 10 reads the compressed image data from the RAM 12, and outputs the image data to the tablet terminal 4.

  In step SA5, the CPU 10 performs image processing on the resized image. Specifically, the CPU 10 reads out image data from the frame memory 12a and performs predetermined image processing (for example, processing for superimposing an OSD (On Screen Display) image on the resized image, keystone correction processing, frame rate conversion). Process or overdrive process). The CPU 10 writes image data indicating the resized image (projected image) after the image processing in the frame memory 12b. In step SA6, the CPU 10 drives the liquid crystal panel 152 according to the image data stored in the frame memory 12b. Specifically, the CPU 10 reads out image data from the frame memory 12 b and outputs it to the panel drive circuit 155.

  In step SA7, the CPU 10 detects that the writing operation using the indicator 3 has been performed on the projected image projected on the screen SC. Specifically, the CPU 10 controls the image sensor 16 to perform imaging at a predetermined time interval (for example, every 0.1 second). The CPU 10 analyzes the image data indicating the captured image and detects the writing operation by detecting the light output from the indicator 3. In step SA8, the CPU 10 generates pen input data. Specifically, the CPU 10 calculates the coordinates on the projected image of the point indicated by the indicator 3 based on the position of light in the captured image. The CPU 10 stores the generated pen input data in the RAM 12. The process of step SA8 is performed every time a writing operation is detected, and a plurality of pen input data are sequentially generated.

ＣＰＵ１０は、変換後の座標（ｘｉ，ｙｉ）をＲＡＭ１２に記憶する。 In step SA9, the CPU 10 performs a coordinate conversion process on the pen input data. The coordinate conversion process refers to converting the coordinate system of the coordinates indicated by the coordinate data into the coordinate system of the input image. Here, the CPU 10 converts the coordinate system of the coordinates of the projection image indicated by the pen input data into the coordinate system of the (original) input image before the resizing process. Specific processing is as follows. First, the CPU 10 converts coordinates on the projection image indicated by the pen input data into coordinates on the resized image. The conversion between the coordinates on the projection image and the coordinates on the resized image is performed using an expression determined according to the contents of the image processing performed in step SA5. For example, when the keystone correction process is performed on the resized image in step SA5, the CPU 10 performs a process of performing an inverse conversion of the keystone correction process, and the coordinates on the projection image are converted to the coordinates on the resized image. Convert to coordinates. Next, the CPU 10 converts the coordinates on the resized image after conversion into the coordinates in the original input image. Conversion between the coordinates (Xi, Yi) on the resized image and the coordinates (xi, yi) on the original input image uses the offset value α and the conversion coefficient β stored in the RAM 12 and the following equation ( 5).

The CPU 10 stores the converted coordinates (xi, yi) in the RAM 12.

  In step SA 10, the CPU 40 of the tablet terminal 4 displays an image corresponding to the resized image indicated by the image data acquired from the projector 1 on the touch panel 44. Specifically, the CPU 40 changes the size of the resized image indicated by the image data to a size corresponding to the touch panel 44 and displays the resized image whose size has been changed on the touch panel 44. By the process of step SA10, an image corresponding to the projection image is displayed on the touch panel 44. In step SA11, the CPU 40 generates touch input data. Specifically, the CPU 40 converts the physical coordinates of the point designated by the user on the touch panel 44 into the coordinates of the point on the resized image indicated by the image data. The process of step SA11 is performed when the touch panel 44 detects an operation by the user. The conversion between the physical coordinates on the touch panel 44 and the coordinates of the points on the resized image is performed using a predetermined formula. The CPU 40 stores the generated touch input data in the RAM 42. In step SA <b> 12, the CPU 40 reads touch input data from the RAM 42 and outputs it to the projector 1. Note that the processes in steps SA11 and SA12 are performed each time the touch panel 44 detects an operation by the user, and a plurality of touch input data are sequentially output to the projector 1.

  In step SA <b> 13, the CPU 10 of the projector 1 performs coordinate conversion processing on the touch input data acquired from the tablet terminal 4. Here, the CPU 10 converts the coordinate system of the coordinates of the resized image indicated by the touch input data into the coordinate system of the original input image. Specifically, the CPU 10 converts the coordinates (Xi, Yi) on the resized image indicated by the touch input data into the coordinates (xi, yi) in the original input image by the above formula (5). For example, in the above example of size, when the coordinates (Xi, Yi) indicated by the touch input data are (275, 480), the coordinates (xi, yi) in the original input image are (500, 500). . The CPU 10 stores the converted coordinates (xi, yi) in the RAM 12. The coordinates (xi, yi) obtained by the coordinate conversion process (step SA9) for the pen input data (hereinafter referred to as “pen input coordinates”) and the coordinate conversion process (step SA13) for the touch input data. Coordinates (xi, yi) (hereinafter referred to as “touch input coordinates”) are stored in the RAM 12 in a state distinguished from each other by different identifiers. That is, the pen input coordinates based on the pen input data and the touch input coordinates based on the touch input data are distinguished by different identifiers.

  In step SA14, the CPU 10 integrates the pen input data and the touch input data to generate integrated coordinate data. The integration of the pen input data and the touch input data is performed, for example, by selecting one of the pen input coordinates and the touch input coordinates. The CPU 10 selects the coordinates obtained by one of the series of writing operations using the indicator 3 and the series of operations on the touch panel 44 started first. Here, a series of writing operations using the indicator 3 is an operation from when the user presses the tip of the indicator 3 against the screen SC until it is released, or a plurality of these operations. An operation in which the time during which the tip of the indicator 3 is separated from the screen SC is shorter than a predetermined time. A series of operations on the touch panel 44 is an operation from when the user touches the touch panel 44 until it is released, or a set of these operations, and a time when the user does not touch the touch panel 44 is longer than a predetermined time. A short action. When one of a series of writing operations using the indicator 3 or a series of operations on the touch panel 44 is started in a state where there is no input from the indicator 3 and no input from the touch panel 44, until one of the series ends. , The coordinates obtained by the one are selected. The state in which there is no input from the indicator 3 refers to a state in which the time during which the user separates the tip of the indicator 3 from the screen SC is longer than a predetermined time. The state where there is no input from the touch panel 44 refers to a state where the user has not touched the touch panel 44 for a predetermined time or more. In the example illustrated in FIG. 7, a series of writing operations using the indicator 3 is started before a series of operations on the touch panel 44, and the CPU 10 selects pen input coordinates. The CPU 10 stores the generated integrated coordinate data in the RAM 12. In step SA15, the CPU 10 reads the integrated coordinate data from the RAM 12 and outputs it to the PC 2.

  In step SA16, the CPU 20 of the PC 2 draws an image according to the integrated coordinate data acquired from the projector 1 on the primary image. Specifically, the CPU 20 interpolates a plurality of coordinates (xi, yi) (hereinafter referred to as “integrated coordinates”) indicated by the integrated coordinate data, whereby the user designates the indicator on the screen SC (on the projection surface). An image (hereinafter referred to as “trajectory image”) corresponding to the point designated by 3 or the locus of the point designated by the user on the touch panel 44 is drawn. The CPU 20 stores the order in which the integrated coordinates sequentially output from the projector 1 are acquired in the RAM 22, and uses an image formed by interpolating a plurality of integrated coordinates in accordance with this order as a trajectory image. The order in which the integrated coordinates are acquired is stored in the RAM 22 together with the integrated coordinates when the CPU 20 acquires the integrated coordinate data from the projector 1. Then, the CPU 20 combines the trajectory image and the primary image to generate a secondary image. The CPU 20 stores image data indicating the secondary image in the RAM 22. In step SA <b> 17, the CPU 20 reads image data indicating a secondary image from the RAM 22, and outputs a video signal indicating the image data to the projector 1.

  In steps SA18 to SA22, the CPU 10 of the projector 1 performs the same processing as in steps SA2 to SA6 on the secondary image. By the process of step SA22, a projection image based on the secondary image is projected onto the screen SC. In step SA23, the CPU 40 of the tablet terminal 4 displays an image corresponding to the resized image of the secondary image on the touch panel 44 by the same processing as in step SA10. Through the above processing, the tablet terminal 4 can function as a pointing device for operating the PC 2. Thereby, an image corresponding to the writing operation using the indicator 3 or the operation of the touch panel 44 is drawn on the input image (and the projection image). Therefore, when drawing on the input image, the user can appropriately select a method for performing a writing operation using the indicator 3 and a method for operating the touch panel 44. According to the method of operating the touch panel 44, since drawing can be performed even from a place away from the screen SC, it is possible to suppress distance limitations when performing drawing. As an example of the use of the projection system PS1, in a school classroom, a teacher performs a writing operation on the screen SC and draws it on an input image, and a student operates the tablet terminal 4 at a distance from the screen SC to draw on the input image. It is possible to do.

(Embodiment 2)
FIG. 9 is a diagram showing an overall configuration of a projection system PS2 according to the second embodiment of the present invention. Hereinafter, the projection system PS2 will be described with a focus on the differences from the projection system PS1. In the projection system PS2, an AV device such as a DVD player 5 is used as a video signal source instead of the above-described PC2. The DVD player 5 outputs a video signal to the projector 1. The DVD player 5 is wired to the HDMI terminal of the projector 1 via a cable. In the projection system PS2, the projector 1 executes a drawing program for drawing an image on the input image. The tablet terminal 4 functions as a pointing device for operating the projector 1 when the projector 1 is executing a drawing program. When the user operates the touch panel 44, the projector 1 draws an image corresponding to the operation on the input image.

  FIG. 10 is a block diagram showing a functional configuration of the projection system PS2. The projector 1 includes a drawing unit 115 and an image data combining unit 116 instead of the coordinate conversion unit 109 and the coordinate data output unit 111 illustrated in FIG. The drawing unit 115 draws an image corresponding to the integrated coordinate data generated by the integration unit 110. The image data synthesis unit 116 synthesizes the image drawn by the drawing unit 115 and the resized image of the primary image, and generates image data indicating the secondary image. The image processing unit 103 performs predetermined image processing on the secondary image indicated by the image data generated by the image data combining unit 116. The image processing unit 103 outputs the secondary image on which the image processing has been performed to the projection unit 104. The image data acquisition unit 112 acquires the image data generated by the image data synthesis unit 116. In the projection system PS2, the coordinate conversion unit 107 converts the coordinate system of the coordinates indicated by the pen input data generated by the coordinate data generation unit 106 into the coordinate system of the resized image. In the projector 1 according to the second embodiment, the CPU 10 executing the program includes a coordinate data generation unit 106, a coordinate conversion unit 107, an integration unit 110, an image data acquisition unit 112, an image compression unit 113, a drawing unit 115, and an image. It is an example of the data composition unit.

  FIG. 11 is a sequence chart showing processing executed in the projection system PS2. In the following processing, for example, an instruction for causing the projector 1 to execute a drawing program is input in a state where the DVD player 5 outputs a video signal (here, a video signal indicating a primary image) to the projector 1. It starts with this. An instruction for executing the drawing program is input by the user operating the controller RC.

  In step SB 1, the CPU 10 of the projector 1 acquires a video signal from the DVD player 5. In steps SB2 to SB8, the CPU 10 performs the same processing as in steps SA2 to SA8.

  In step SB9, the CPU 10 converts coordinates on the projection image indicated by the pen input data into coordinates on the resized image. The conversion between the coordinates on the projection image and the coordinates on the resized image is performed using an expression determined according to the contents of the image processing performed in step SB5. The CPU 10 stores the coordinates (Xi, Yi) on the resized image after conversion in the RAM 12.

  In steps SB10 to SB12, the CPU 40 of the tablet terminal 4 performs the same processing as in steps SA10 to SA12. In step SB13, the CPU 10 of the projector 1 integrates the pen input data and the touch input data, and generates integrated coordinate data. Note that the pen input data and the touch input data integrated in step SB13 both indicate coordinates (Xi, Yi) on the resized image, and the integrated coordinates indicated by the integrated coordinate data are also coordinates on the resized image. (Xi, Yi) is shown. In step SB14, the CPU 10 draws an image corresponding to the integrated coordinate data. Specifically, the CPU 10 draws a trajectory image by interpolating a plurality of integrated coordinates (Xi, Yi). The CPU 10 stores the trajectory image in the RAM 12. In step SB15, the CPU 10 combines the trajectory image and the resized image of the primary image to generate a secondary image. Specifically, the CPU 10 reads the resized image of the primary image from the frame memory 12a and the trajectory image from the RAM 12, and synthesizes (overlays) the trajectory image on the resized image. The CPU 10 writes image data indicating the generated secondary image in the frame memory 12a.

  In Step SB16 to Step SB19, the CPU 10 performs the same processing as Step SB3 to Step SB6 on the secondary image. Through the above processing, the tablet terminal 4 can function as a pointing device for operating the projector 1. Thereby, an image corresponding to the writing operation using the indicator 3 or the operation of the touch panel 44 is drawn on the input image (and the projection image). According to the method of operating the touch panel 44, since drawing can be performed even from a place away from the screen SC, it is possible to suppress distance limitations when performing drawing.

<Modification>
The present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, some modifications will be described. Of the modifications described below, two or more may be used in combination.

(1) Modification 1
In the above-described embodiment, the integrated coordinate data indicates one of the pen input coordinates (or the coordinates indicated by the pen input data, the same applies hereinafter) and the touch input coordinates (or the coordinates indicated by the touch input data, the same applies hereinafter). An example was explained. This point, the integrated coordinate data, may indicate the coordinates of both the pen input coordinates and the touch input coordinates. In this case, the pen input coordinates and the touch input coordinates are distinguished from each other by different identifiers and stored in the RAM 12. In this case, the identifier for identifying pen input coordinates and the identifier for identifying touch input coordinates, which are distinguished from each other, may correspond to different input devices of the external device (or projector 1). For example, in addition to the hardware configuration described above, the PC 2 has a touch panel as an input device. An identifier for identifying pen input coordinates is provided on the mouse of the PC 2, and an identifier for identifying touch input coordinates is provided on the touch panel. It may correspond. According to this example, when the user performs a writing operation using the indicator 3, drawing is performed according to the mouse operation of the PC 2, and when the user operates the touch panel 44, drawing according to the operation of the touch panel of the PC 2 is performed. Is called.

(2) Modification 2
The process performed in the projection system is not limited to the process described in the embodiment. For example, compression of image data may be performed for each frame.
In the above-described embodiment, an example in which image data before image processing is read from the frame memory 12a and output to the tablet terminal 4 has been described. In this regard, the image data after the image processing is performed may be read from the frame memory 12b, and the image data obtained by performing a predetermined process on the read image data may be output to the tablet terminal 4. . For example, when the keystone correction process is performed on the resized image, the CPU 10 performs a process of performing reverse conversion of the keystone correction process on the image data after the keystone correction process, and the reverse conversion is performed. The image data may be output to the tablet terminal 4. In this case, the RAM 12 of the projector 1 does not necessarily have two frame memories.

Further, in the above-described embodiment, the processing example in the case where the writing operation using the indicator 3 is performed before the operation of the touch panel 44 has been described, but it goes without saying that the operation of the touch panel 44 is the indicator 3. It may be performed before the writing operation using. In this case, the processes shown in steps SA7 to SA9 (steps SB7 to SB9) are performed after the processes shown in steps SA11 and SA12 (steps SB11 and SB12).
Furthermore, in the above-described embodiment, an example in which an image corresponding to the integrated coordinate data is drawn on the primary image has been described. However, an image corresponding to the integrated coordinate data may be further drawn on the secondary image.

(3) Modification 3
In the above-described embodiment, the example in which the offset value α and the conversion coefficient β are calculated for each frame in the resizing process has been described. In this regard, while the video signal is continuously input to the projector 1, the input image may be resized using the same value as the offset value α and the conversion coefficient β calculated once. In this case, the CPU 10 stores the offset value α and the conversion coefficient β calculated once in the RAM 12 while the video signal is being input, and resizes a plurality of input images using these values.

(4) Modification 4
The above-described formulas (1) to (5) shown for the resizing process and the coordinate conversion process are merely examples, and the resizing process or the coordinate conversion process may be performed by a formula different from these formulas. For example, in the above-described embodiment, the case has been described in which the offset value is a value indicating the number of pixels in the horizontal direction that are uniformly removed from the input image. It may be a value indicating the number of directions. In this case, the offset value is calculated by an expression different from Expression (1). In the above-described embodiment, the example in which the input image is reduced in the resizing process has been described. However, the input image may be enlarged in the resizing process.

(5) Modification 5
The configuration of the projection system is not limited to the configuration described in the embodiment. For example, in the first embodiment, an example in which the IF unit 13 of the projector 1 outputs coordinate data to the PC 2 via the USB terminal has been described. However, the IF unit 13 outputs coordinate data via the wireless LAN interface. Also good. As another example, a plurality of tablet terminals 4 or a plurality of indicators 3 may be used in the projection system. In this case, each of the touch input coordinates obtained from the plurality of tablet terminals 4 or each of the pen input coordinates obtained from the plurality of indicators 3 may be distinguished by different identifiers. According to this example, drawing corresponding to different input devices of the external apparatus (or projector 1) is performed when the user operates a touch panel 44 and when another user operates the touch panel 44. In still another example, a video player may be used instead of the DVD player 5.

(6) Modification 6
The functional configuration of the projector 1 is not limited to the configuration shown in FIG. 2 or FIG. For example, the projector 1 may have both of the functional configurations shown in FIGS. In this case, the projector 1 performs the processing shown in FIG. 7 when the video signal input source is the PC 2 (that is, an external device that executes the rendering program), and the video signal input source is the DVD player 5 (that is, the rendering). In the case of an external device that does not execute the program, the processing shown in FIG. 11 is performed. In another example, the imaging unit 105 and the coordinate data generation unit 106 may be an external configuration of the projector 1. In this case, the projector 1 includes a coordinate data acquisition unit that acquires pen input data generated by the coordinate data generation unit 106.

(7) Modification 7
The hardware configuration of various devices used in the projection system is not limited to the configuration shown in FIGS. The various devices used in the projection system may have any hardware configuration as long as the processing of each step shown in FIGS. 7, 8, and 11 can be executed. For example, in the above-described embodiment, an example in which the projector 1 includes the three liquid crystal panels 152 has been described. However, the projector 1 is a method in which one liquid crystal panel 152 and a color wheel are combined, and three digital mirror devices ( (DMD), a single DMD and a color wheel, or the like.

  DESCRIPTION OF SYMBOLS 1 ... Projector, 2 ... Personal computer, 3 ... Indicator, 4 ... Tablet terminal, 101 ... Video signal acquisition part, 102 ... Image adjustment part, 103 ... Image processing part, 104 ... Projection part, 105 ... Imaging part, 106 ... Coordinate data generation unit 107 ... Coordinate conversion unit 108 108 Coordinate data acquisition unit 109 ... Coordinate conversion unit 110 ... Integration unit 111 ... Coordinate data output unit 112 ... Image data acquisition unit 113 ... Image compression unit 114 ... Image data output unit, 115 ... Drawing unit, 116 ... Image data synthesis unit, 201 ... Video signal output unit, 202 ... Coordinate data acquisition unit, 203 ... Drawing unit, 301 ... Pressure detection unit, 302 ... Light emission unit, 401 ... Coordinate conversion unit, 402 ... Coordinate data output unit, 403 ... Image data acquisition unit, 404 ... Display control unit, 10 ... CPU, 11 ... ROM, 12 ... RAM, 13 IF unit, 14 ... image processing circuit, 15 ... projection unit, 16 ... image sensor, 17 ... light receiving unit, 18 ... operation panel, 19 ... input processing unit, 151 ... light source, 152 ... liquid crystal panel, 153 ... optical system, 154 ... light source drive circuit, 155 ... panel drive circuit, 156 ... optical system drive circuit, 20 ... CPU, 21 ... ROM, 22 ... RAM, 23 ... IF unit, 24 ... display unit, 25 ... input unit, 30 ... control unit, 31 ... Pressure sensor, 32 ... LED, 40 ... CPU, 41 ... ROM, 42 ... RAM, 43 ... IF unit, 44 ... Touch panel.

Claims (8)

A projection unit that projects an image indicated by the video signal;
A first coordinate data acquisition unit that acquires first coordinate data indicating coordinates of a point on a first image indicated by the video signal from an electronic device having a touch panel;
A second coordinate data acquisition unit for acquiring second coordinate data indicating coordinates of a point designated by a user on the projection surface on which the first image is projected by the projection unit;
An integration unit for generating third coordinate data in which the first coordinate data acquired by the first coordinate data acquisition unit and the second coordinate data acquired by the second coordinate data acquisition unit are integrated; ,
An image data acquisition unit that acquires image data indicating a second image in which an image corresponding to the third coordinate data generated by the integration unit is drawn on the first image;
An image data output unit that outputs the image data acquired by the image data acquisition unit to the electronic device;
An output unit that outputs a video signal indicating the second image to the projection unit. 2. The projector according to claim 1, wherein the third coordinate data indicates one of coordinates selected from the coordinates indicated by the first coordinate data and the coordinates indicated by the second coordinate data. . The projector according to claim 1, wherein the third coordinate data indicates a coordinate indicated by the first coordinate data and a coordinate indicated by the second coordinate data, which are distinguished by different identifiers. The projector according to claim 3, wherein the coordinate identifier indicated by the first coordinate data and the coordinate identifier indicated by the second coordinate data correspond to different input devices. A coordinate data output unit that outputs the third coordinate data generated by the integration unit to an external device that is an input source of the video signal;
The projector according to claim 1, wherein the image data acquisition unit acquires the image data from the external device. A drawing unit for drawing an image according to the third coordinate data;
A synthesis unit that synthesizes the first image and the image drawn by the drawing unit and generates the image data;
The projector according to claim 1, wherein the image data acquisition unit acquires the image data from the synthesis unit. A projector and an electronic device,
The projector is
A projection unit that projects an image indicated by the video signal;
A first coordinate data acquisition unit that acquires, from the electronic device, first coordinate data indicating the coordinates of a point on the first image indicated by the video signal;
A second coordinate data acquisition unit for acquiring second coordinate data indicating coordinates of a point designated by a user on the projection surface on which the first image is projected by the projection unit;
An integration unit for generating third coordinate data in which the first coordinate data acquired by the first coordinate data acquisition unit and the second coordinate data acquired by the second coordinate data acquisition unit are integrated; ,
An image data acquisition unit that acquires image data indicating a second image in which an image corresponding to the third coordinate data generated by the integration unit is drawn on the first image;
An image data output unit that outputs the image data acquired by the image data acquisition unit to the electronic device;
An output unit that outputs a video signal indicating the second image to the projection unit;
The electronic device is
A touch panel;
A coordinate conversion unit that converts the coordinates of the point designated by the user on the touch panel into the coordinates of the point on the first image, and generates the first coordinate data;
A coordinate data output unit that outputs the first coordinate data generated by the coordinate conversion unit to the projector;
A projection control system comprising: a display control unit configured to display the second image indicated by the image data output from the projector on the touch panel. A step in which the projection unit projects an image indicated by the video signal;
Obtaining, from an electronic device having a touch panel, first coordinate data indicating the coordinates of a point on a first image indicated by the video signal;
Obtaining second coordinate data indicating the coordinates of a point designated by the user on the projection surface on which the first image is projected;
Generating third coordinate data in which the first coordinate data and the second coordinate data are integrated;
Obtaining image data indicating a second image in which an image corresponding to the third coordinate data is drawn on the first image;
Outputting the image data to the electronic device;
And a step of outputting a video signal indicating the second image to the projection unit.

Images