JP6296144B2 - Display device and display control method - Google Patents

Description

  The present invention relates to a display device that outputs information on a designated position in response to an operation that designates a position, and a display control method.

  2. Description of the Related Art Conventionally, when a specific position of an image displayed by a display device such as a projector is instructed, an apparatus that detects a designated position and displays a pointer or the like so as to correspond to the detected position is known (for example, Patent Document 1). This type of apparatus needs to be calibrated in order to make the indicated position coincide with the display position of a pointer or the like. In general, it is necessary to perform calibration again each time display conditions change, such as changing the display position of an image to be displayed. Therefore, the apparatus described in Patent Document 1 omits calibration by using position change data indicating the positional relationship before and after the change when the display position changes.

Japanese Patent No. 4272904

A display device that detects and outputs an indicated position as described above needs information regarding the resolution of an image to be displayed. For example, since the apparatus described in Patent Document 1 requires data indicating the relationship before and after the change when the display condition changes, the resolution of the image is determined by measuring the frequency of the input horizontal and vertical synchronization signals. Judging.
However, for example, when an image with an unknown resolution is input or when information regarding the resolution is erroneously determined, information regarding the correct resolution may not be obtained with respect to the input signal. In recent years, with the spread of digital broadcasting, high-quality video content, diversification of display devices including portable devices, etc., the types of screen resolutions are increasing, and images with resolutions that are not supported by display devices Is often entered. In such a case, there is a problem that the positional relationship between the indicated position and the image being displayed cannot be obtained accurately because information on resolution cannot be obtained with a conventional display device.
The present invention has been made in view of the above-described circumstances, and provides a display device and a display control method that have a function of specifying an instruction position with respect to a displayed image and can also handle an image with an unknown resolution. The purpose is to do.

In order to solve the above problems, the present invention provides a display unit that displays a supply image supplied from an image source on a display surface, a position detection unit that detects an indicated position on the display surface, and a displayable area on the display surface. The coordinate calculation means for calculating the first coordinates which are the coordinates of the indicated position in the image, and the first coordinates calculated by the coordinate calculation means as image position information indicating the position of the supply image on the display surface Based on the coordinate conversion means for converting to the second coordinates which are the coordinates in the supplied image, the output means for outputting the second coordinates obtained by the coordinate conversion means, and the processing for displaying the image for correction Correction means for correcting the image position information.
According to the present invention, in response to an instruction operation on the display surface on which an image is displayed, the instructed position can be detected, and the coordinates of the detected instructed position can be converted into coordinates in the supplied image and output. Since the image position information indicating the position of the supply image on the display surface can be corrected using the correction image, the resolution-related information is displayed, for example, when a supply image with an unknown resolution is displayed or when information regarding the resolution is misidentified. Even when accurate information cannot be obtained, coordinates can be accurately converted and output. Thereby, irrespective of the resolution of the supplied image, the coordinates of the position designated by the operation on the display surface on which the image is displayed can be output accurately.

In the display device according to the aspect of the invention, the coordinate conversion unit may calculate the first coordinate calculated by the coordinate calculation unit based on the resolution of the supplied image and the image position information. The correction means corrects the image position information.
According to the present invention, it is possible to detect an indicated position with respect to the display surface, accurately convert the detected indicated position into coordinates in the supplied image, and output.

In the display device according to the aspect of the invention, the correction image displayed by the display unit may be a monochrome background and a marker arranged at a predetermined position that is highly likely to be displayed in the displayable area. It is characterized by including.
According to the present invention, image position information can be corrected accurately and promptly using a marker located in a displayable area, and accurate coordinates can be output.

In the display device according to the aspect of the invention, the correction unit may include the indication position detected by the position detection unit in a state where the display unit displays the correction image on the display surface, and the correction unit. The image position information is corrected based on the position of the marker in the image.
According to the present invention, it is possible to display a correction image, accurately correct image position information based on the position designated by the operation on the display surface and the position of the marker, and to output accurate coordinates.

Further, in the display device according to the present invention, the correction unit detects a marker in the correction image displayed on the display surface by the display unit, and the detection unit detects the marker based on the detected position of the marker actually detected. The image position information is corrected.
According to the present invention, by detecting the marker, the image position information can be corrected and accurate coordinates can be output without depending on the instruction operation.

In the display device according to the present invention, the display unit further includes an image expansion unit that expands an image to be displayed on the display surface based on the supplied image in a memory corresponding to the displayable area. The correction unit detects the position of the marker in the image expanded in the memory, and corrects the image position information based on the detected position. It is characterized by that.
According to the present invention, by detecting the marker of the image developed in the memory, the image position information can be corrected and accurate coordinates can be output without depending on the instruction operation. Further, by detecting the marker from the image in the memory, the position of the marker can be specified quickly and accurately.

According to the present invention, in the display device, as the display unit, a light modulation unit that modulates light emitted from a light source, an image forming unit that forms a display image on the light modulation unit based on the supplied image, The projector includes: a projection unit that projects a display image formed by the image forming unit onto a projection surface serving as the display surface.
According to the present invention, in a projector that projects an image, a position instructed by an instruction operation on a projection surface can be accurately converted into coordinates in a supplied image and output.

In order to solve the above problem, the present invention displays a supply image supplied from an image source on a display surface, detects an indicated position on the display surface, and detects the indicated position in a displayable area on the display surface. First coordinates that are coordinates are calculated, and the calculated first coordinates are converted into second coordinates that are coordinates in the supply image based on image position information indicating the position of the supply image on the display surface. Converting, outputting the second coordinates obtained by the conversion, and correcting the image position information by a process of displaying the image for correction.
According to the present invention, in response to an instruction operation on the display surface on which an image is displayed, the instructed position can be detected, and the coordinates of the detected instructed position can be converted into coordinates in the supplied image and output. And since the image position information indicating the position of the supply image on the display surface can be corrected using the correction image, the resolution is displayed when the supply image of unknown resolution is displayed or when information regarding the resolution is misidentified. Even when accurate information on the information cannot be obtained, the coordinates can be accurately converted and output. Thereby, irrespective of the resolution of the supplied image, the coordinates of the position designated by the operation on the display surface on which the image is displayed can be output accurately.

Further, the present invention is a program executable by a computer that controls a display device that displays an image on a display surface, the computer displaying a supply image supplied by an image source on a display surface; Position detecting means for detecting an indicated position on the display surface; coordinate calculating means for calculating a first coordinate which is a coordinate of the indicated position in a displayable area of the display surface; and the coordinate calculated by the coordinate calculating means. A coordinate conversion unit that converts the first coordinate to a second coordinate that is a coordinate in the supply image based on image position information indicating the position of the supply image on the display surface, and the coordinate conversion unit. Further, an output unit that outputs the second coordinates and a correction unit that corrects the image position information by a process of displaying a correction image are operated. It can be implemented as a program.
It is also possible to implement the program as a recording medium that is recorded so as to be readable by a computer.

  According to the present invention, the display device that displays the supplied image can accurately output the coordinates of the position indicated by the operation on the display surface on which the image is displayed, regardless of the resolution of the supplied image.

It is a figure which shows the structure of the display system which concerns on embodiment of this invention. It is a block diagram which shows the functional structure of a projector. It is a block diagram which shows the functional structure of PC. It is a figure which shows the example which projected the image on the screen, (A) shows the state which projected the pointer according to the instruction | indication position, (B) shows the example which performed drawing according to the instruction | indication position. It is explanatory drawing which shows the mode of the process which detects and converts a coordinate. It is a flowchart which shows operation | movement of a projector. It is a figure which shows typically the structural example of the resolution table which defined the resolution which a projector respond | corresponds. It is a figure which shows the example of the projection state to a screen, (A) shows the example projected by the appropriate screen mode, (B) shows the example projected by the inappropriate screen mode. It is a figure which shows the structural example of the image for a correction | amendment, (A) shows the example in which the rectangle was included as a marker, (B) shows the example which used the pointer as a marker. It is a figure which shows the example of the correction process using the image for a correction | amendment, (A) shows the state before correction | amendment, (B) shows the state after correction | amendment. It is a flowchart which shows operation | movement of a projector.

Embodiments to which the present invention is applied will be described below with reference to the drawings.
FIG. 1 is a diagram illustrating a configuration of a display system 10 using a projector 11 according to an embodiment.
The projector 11 as a display device is connected to a PC (Personal Computer) 13 as an image supply device by an image signal cable or the like. For example, an analog image signal (analog RGB component video signal or the like) is input to the projector 11 from the PC 13 via a VGA terminal, and the projector 11 is a screen as a projection surface (display surface) based on the input image signal. A display image is projected onto the SC. The projector 11 is connected to the PC 13 via a communication cable or the like, and transmits / receives control data to / from the PC 13. The projector 11 can project whether the image input from the PC 13 is a still image or a moving image. The screen SC is not limited to a flat plate fixed to a wall surface, and the wall surface itself can be used as the screen SC. Here, a range in which an image is projected on the projector 11 is defined as an actual projection area 11B (displayable area).

  In the display system 10, while the image is projected by the projector 11, the user can hold the indicator 12 in his hand and perform an operation (position indication operation) for indicating an arbitrary position in the actual projection area 11 </ b> B of the screen SC. The indicator 12 is a pen-shaped or bar-shaped operation device, and is used to indicate an arbitrary position on the screen SC. The projector 11 has a function of detecting the tip position of the indicator 12 as will be described later, and outputs control data indicating the coordinates of the detected indicated position to the PC 13.

FIG. 2 is a block diagram illustrating a functional configuration of the projector 11.
The projector 11 is roughly divided into an image processing unit 110 that executes image processing for display based on an image input from the PC 13, and a projection unit 3 (display unit) that projects an image onto the screen SC according to control of the image processing unit 110. ), A position detection unit 150 that detects the indication position of the indicator 12 on the screen SC, a coordinate conversion unit 160 that converts the coordinates of the indication position detected by the position detection unit 150 into coordinates in the image data, and coordinate conversion The output part 101 (output means) which outputs the coordinate after the conversion which the part 160 converted to PC13, and the control part 103 which controls each of these parts are provided.
The control unit 103 includes a CPU, a non-volatile memory, a RAM, and the like (not shown). The control unit 103 reads out and executes a control program 105A stored in the storage unit 105 connected to the control unit 103, and controls each unit of the projector 11. . Further, by executing the control program 105A stored in the storage unit 105, the control unit 103 functions as the calibration execution unit 103A.

  103 A of calibration execution parts perform the calibration mentioned later, and represent the correspondence of the coordinate in picked-up image data, and the coordinate in the area | region (for example, actual projection area | region 11B) on the screen SC used as calibration object. Find parameters (coordinate transformation parameters). The storage unit 105 is configured by a magnetic or optical recording device or a semiconductor storage element, and stores various programs including a control program 105A and data such as various setting values.

An operation panel 41 and a remote control light receiving unit 45 are connected to the control unit 103.
The operation panel 41 includes various switches and indicator lamps, and is disposed in an exterior housing (not shown) of the projector 11. The control unit 103 appropriately turns on or blinks the indicator lamp of the operation panel 41 according to the operation state or setting state of the projector 11. When a switch on the operation panel 41 is operated, an operation signal corresponding to the operated switch is output to the control unit 103.
Further, the projector 11 receives an infrared signal transmitted by a remote controller (not shown) used by a user as an operator who operates the projector 11 in response to a button operation by the remote controller light receiving unit 45. The remote control light receiving unit 45 receives the infrared signal received from the remote control by the light receiving element, and outputs an operation signal corresponding to this signal to the control unit 103. The operation panel 41, the remote controller, and the like are operation units for the user to input operations on the projector 11. It is also possible to transmit an operation signal representing an operation on the projector 11 from the PC 13 to the projector 11 and control the projector 11 based on the operation signal. In this case, the PC 13 also functions as an operation unit for the user to input an operation on the projector 11.
The control unit 103 detects a user operation based on an operation signal input from the operation panel 41 or the remote control light receiving unit 45, and controls the projector 11 according to this operation.

The projector 11 is roughly divided into an optical system that forms an optical image and an image processing system that electrically processes an image signal. The optical system is a projection unit 30 (projection unit) including an illumination optical system 31, a light modulation device 32 (light modulation unit), and a projection optical system 33. The illumination optical system 31 includes a light source including a xenon lamp, an ultrahigh pressure mercury lamp, an LED (Light Emitting Diode), a laser, and the like. Further, the illumination optical system 31 may include a reflector for guiding the light emitted from the light source to the light modulation device 32 and an auxiliary reflector, and includes a lens group (not shown), a polarizing plate, Or you may provide the light control element etc. which reduce the light quantity of the light which the light source emitted on the path | route which reaches the light modulation apparatus 32. FIG.
The light modulation device 32 includes a modulation region that modulates incident light, and modulates light from the illumination optical system 31 in response to a signal from an image processing system described later. In the present embodiment, a case where the light modulation device 32 is configured using a transmissive liquid crystal panel will be described as an example. In this configuration, the light modulation device 32 includes three liquid crystal panels corresponding to the three primary colors of RGB in order to perform color projection. The light from the illumination optical system 31 is separated into three color lights of RGB, and each color light enters each corresponding liquid crystal panel. The color light modulated by passing through each liquid crystal panel is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 33.

The projection optical system 33 includes a zoom lens that performs enlargement / reduction of a projected image and a focus adjustment, a zoom adjustment motor that adjusts the degree of zoom, a focus adjustment motor that performs focus adjustment, and the like.
The projection unit 3 enters together with the projection unit 30 based on the image signal output from the projection optical system drive unit 121 that drives each motor included in the projection optical system 33 according to the control of the display control unit 107 and the display control unit 107. A light modulation device driving unit 119 that drives the light modulation device 32 to modulate light and a light source driving unit 117 that drives a light source included in the illumination optical system 31 according to the control of the control unit 103 are provided.

  On the other hand, the image processing system includes an image processing unit 110 that processes image data in accordance with control of the control unit 103 that controls the entire projector 11 in an integrated manner. The image processing unit 110 includes an image input unit 104 connected to the PC 13. The image input unit 104 is an interface to which image data is input. For example, a DVI (Digital Visual Interface) interface, a USB interface and a LAN interface to which a digital video signal is input, a composite video signal such as NTSC, PAL and SECAM. A general-purpose interface such as an S video terminal to which a video signal is input, an RCA terminal to which a composite video signal is input, a D terminal or a VGA terminal to which a component video signal is input, or an HDMI connector conforming to the HDMI (registered trademark) standard is used. it can. Note that the image input unit 104 may perform transmission / reception of image signals by wired communication, or may perform transmission / reception of image signals by wireless communication. Further, the image input unit 104 may be configured to include a DisplayPort established by VESA (Video Electronics Standards Association). Specifically, the image input unit 104 includes a DisplayPort connector or a Mini Displayport connector and an interface circuit compliant with the Displayport standard. It is good also as a structure. In this case, the projector 11 can be connected to the DisplayPort included in the PC 13 or a portable device having the same function as the PC 13.

In the present embodiment, a configuration in which an analog image signal is input from the PC 13 to a VGA terminal included in the image input unit 104 will be described. The image input unit 104 includes an A / D conversion circuit that converts an analog image signal input from the PC 13 into digital image data, and outputs the converted digital image data to the display control unit 107.
The image processing unit 110 processes the image input to the image input unit 104, develops the image in the frame memory 115 according to the control of the display control unit 107, and generates an image to be projected by the projection unit 30. A processing unit 113 is provided.

  The display control unit 107 determines a refresh rate, a horizontal resolution, and a vertical resolution of an analog image signal input from the PC 13 to the image input unit 104, and a screen on which the projector 11 can display a screen mode corresponding to the input signal. The mode is determined as one of a plurality of screen modes set in advance. The display control unit 107 determines a process necessary for display according to the screen mode determined by the image input unit 104, and controls the image processing unit 113 to execute the process. Under the control of the display control unit 107, the image processing unit 113 expands the image data input to the image input unit 104 in the frame memory 115, appropriately executes various conversion processes such as interlace / progressive conversion and resolution conversion, An image signal of a predetermined format for displaying the display image drawn in the memory 115 is generated and output to the display control unit 107. The projector 1 can also display the input image data by changing the resolution and aspect ratio, and can also display the input image data in dot-by-dot while maintaining the resolution and aspect ratio of the image data. is there. Further, the image processing unit 113 can execute various types of image processing such as keystone correction, color tone correction corresponding to a color mode, and image enlargement / reduction processing under the control of the display control unit 107. The display control unit 107 outputs the image signal processed by the image processing unit 113 to the light modulation device driving unit 119 and causes the light modulation device 32 to display the image signal. Further, the image processing unit 113 derives image position information (image position data) from information such as the resolution of the image data being displayed, the aspect ratio, the display size on the liquid crystal display panel of the light modulation device 32, and the obtained image. The position information is output to the coordinate conversion unit 160. The image position information is information indicating at which position in the actual projection area 11B the display image is projected (displayed). In other words, the image position information is information relating to the arrangement of the display image in the actual projection area 11B, and indicates the position (arrangement) of the display image in the actual projection area 11B. This image position information changes when the resolution of the image data output from the PC 13 to the projector 11 changes due to a change in the display resolution of the PC 13 (for example, when the setting related to the resolution is changed in the PC 13). The image position information can also be considered as information relating to the arrangement of images in the modulation area of the light modulation device 32.

  The control unit 103 executes the control program 105A and controls the display control unit 107 to execute keystone correction of the display image formed on the screen SC. Further, the control unit 103 controls the display control unit 107 based on an operation signal input from the operation panel 41 or the remote control light receiving unit 45 to execute a display image enlargement / reduction process.

  The projector 11 includes a position detection unit 150 (position detection means) that detects the coordinates of the indicated position indicated by the indicator 12 on the screen SC. The position detection unit 150 includes an imaging unit 153 that captures the screen SC, an imaging control unit 155 that controls the imaging unit 153, and a position detection processing unit that detects the indicated position of the indicator 12 based on the captured image of the imaging unit 153. 157 and a coordinate calculation unit 159 (coordinate calculation means) that calculates the coordinates of the indicated position detected by the position detection unit 151.

The imaging unit 153 is a digital camera that captures an angle of view including a maximum range (corresponding to a maximum projection area 11A described later) on which the projection unit 30 can project an image on the screen SC. To output the captured image data. In other words, the imaging unit 153 is set to be able to capture a range including the entire maximum projection area 11A. The imaging control unit 155 controls the imaging unit 153 to execute imaging in accordance with the control of the control unit 103. When the imaging unit 153 has mechanisms for adjusting zoom magnification, focus, and aperture during shooting, the shooting control unit 155 controls these mechanisms to execute shooting under preset conditions. After shooting, the shooting control unit 155 acquires the shot image data output by the imaging unit 153 and outputs it to the position detection processing unit 157. The captured image data output from the imaging unit 153 may be expressed in a format such as RGB or YUV, or may represent only a luminance component. Further, the shooting control unit 155 may output the shot image data output from the imaging unit 153 to the position detection processing unit 157 as it is, and adjust the resolution, convert it to a predetermined file format (JPEG, BMP, etc.), etc. Then, the data may be output to the position detection processing unit 157.
Note that the imaging unit 153 may be configured to capture visible light, or may be configured to capture invisible light (such as infrared light). When the imaging unit 153 can capture invisible light, the indicator 12 emits invisible light, and the imaging unit 153 images the invisible light emitted from the indicator 12, or the indicator 12 Is provided with a reflection part capable of reflecting non-visible light, projects non-visible light from the projector 11 to the screen SC under the control of the control part 103, and reflects the non-visible light reflected by the reflection part of the indicator 12. A configuration in which imaging is performed by the imaging unit 153 can be employed.

  The position detection processing unit 157 analyzes the captured image data input from the imaging control unit 155, and from this captured image data, the boundary between the outside of the actual projection region 11B and the actual projection region 11B, and the indicator 12 is displayed. An image is extracted and the position indicated by the indicator 12 is specified. The indication position of the indicator 12 is, for example, the position of the tip of the rod-like or pen-type indicator 12.

  The coordinate calculation unit 159 calculates coordinates based on the indication position of the indicator 12 detected by the position detection processing unit 157 and the coordinate conversion parameter obtained by the calibration execution unit 103A. Specifically, the coordinate calculation unit 159 obtains coordinates in the actual projection area 11B of the indicated position detected by the position detection processing unit 157, and outputs coordinate data (coordinate information) representing the calculated coordinates to the coordinate conversion unit 160. . In the following description, the coordinate data calculated by the coordinate calculation unit 159 and output from the position detection unit 150 is also referred to as “first coordinate data”. In the following description, the coordinate data may be simply referred to as “coordinates”. In the present embodiment, the first coordinate data represents coordinates normalized within the area to be calibrated on the screen SC. For example, if the entire actual projection area 11B is to be calibrated, the upper left vertex, the lower left vertex, and the lower right vertex of the actual projection area 11B are set with the upper left vertex of the actual projection area 11B as the origin (0, 0). The coordinates of the vertices can be expressed as (1, 0), (0, 1), and (1, 1), respectively. In this case, the coordinates of the center of the actual projection area 11B are represented as (0.5, 0.5).

  The coordinate conversion unit 160 converts the first coordinate data (first coordinate information) output from the position detection unit 150 into second coordinate data (second coordinate data) representing coordinates in image data input to the projector 11 by the PC 13. Information). Specifically, the coordinate conversion unit 160 converts the first coordinate data representing the coordinates on the screen SC based on the image position information output from the image processing unit 113 into the second coordinate data representing the coordinates in the input image data. Convert to The second coordinate data represents coordinates normalized in the image data. For example, assuming that the upper left vertex of the image data is the origin (0, 0), the coordinates of the upper right vertex, the lower left vertex, and the lower right vertex of the image data are (1, 0), (0, 1), respectively. It can be expressed as (1,1). In this case, the coordinates of the center of the image data are represented as (0.5, 0.5).

  The first coordinate data output from the position detection unit 150 represents coordinates detected based on the captured image data of the imaging unit 153, and these coordinates are coordinates on coordinate axes virtually provided on the screen SC. Can be represented. However, the correspondence between the coordinates on the screen SC and the coordinates on the captured image data is as follows: the distance between the projector 11 and the screen SC, the zoom rate in the projection optical system 33, the installation angle of the projector 11, the imaging device 5 and the screen SC. Affected by various factors such as distance. Therefore, the coordinates on the captured image data corresponding to a certain position on the screen SC change according to these elements. Therefore, in the projector 11 according to the present invention, the calibration execution unit 103A first executes calibration, and the correspondence relationship between the coordinates in the captured image data and the coordinates in the area on the screen SC to be calibrated. A coordinate transformation parameter representing is obtained. When the coordinate conversion parameter is obtained by the calibration execution unit 103A, the coordinate calculation unit 159 performs coordinate conversion based on the coordinate conversion parameter to obtain first coordinate data. Further, the coordinate conversion unit 160 converts the first coordinate data output from the coordinate calculation unit 159 based on the image position information, and outputs the converted coordinate data (second coordinate data) to the output unit 101. .

  The output unit 101 is connected to the PC 13 and is an interface that outputs the coordinate data after the conversion processing of the coordinate conversion unit 160 to the PC 13. For example, the output unit 101 includes a general-purpose interface such as a USB interface, a wired LAN interface, a wireless LAN interface, and IEEE1394. can do. Here, the image input unit 104 and the output unit 101 will be described as separate functional blocks, but it is of course possible to physically integrate them into one interface. For example, both functions of the output unit 101 and the image input unit 104 may be realized by a single USB interface. The output unit 101 is also connected to the image processing unit 113 included in the image processing unit 110, and can output the coordinates after the conversion processing of the coordinate conversion unit 160 to the image processing unit 110. The main power of the output unit 101 is controlled by the control unit 103. The coordinate data output by the output unit 101 is output to the PC 13 as data similar to the coordinate data output by a pointing device such as a mouse, trackball, digitizer, or pen tablet.

In the case where the PC 13 handles the coordinate data output from the output unit 101 in the same way as the coordinate data output by the general-purpose pointing device, a general-purpose device driver program corresponding to these general-purpose pointing devices is installed. Can be used. Generally, these general-purpose device driver programs are installed in advance as a part of the OS (operating system) of the PC 13, and therefore, when using the general-purpose device driver program, it is necessary to install the device driver program. Absent. In addition, since a general-purpose device driver program is used, it is not necessary to prepare a dedicated device driver program. On the other hand, information that can be exchanged between the projector 11 and the PC 13 is determined by the specifications of the general-purpose device driver program. It is limited to the range.
Further, a dedicated device driver program corresponding to the projector 11 may be prepared, and this device driver program may be installed in the PC 13 and used. In this case, while a dedicated device driver program is required, information that can be exchanged between the projector 11 and the PC can be arbitrarily set according to the specifications of the dedicated device driver program.

FIG. 3 is a block diagram showing a functional configuration of the PC 13.
As shown in FIG. 3, the PC 13 executes a control program to centrally control each part of the PC 13, a basic control program executed by the CPU 131, and a ROM 132 and CPU 131 storing data related to the program. RAM 133 for temporarily storing programs and data to be stored, storage unit 134 for storing programs and data in a nonvolatile manner, input unit 135 for detecting input operations and indicating input contents and operation signals to CPU 131, and CPU 131 A display unit 136 that outputs display data for displaying processing results and the like, and an external I / F 137 that transmits and receives data to and from an external device are provided, and these units are connected to each other by a bus. ing.

The input unit 135 includes an input I / F 141 having a connector and a power supply circuit, and the input device 142 is connected to the input I / F 141. The input I / F 141 includes a general-purpose interface for an input device such as a USB interface, and the input device 142 is a pointing device such as a keyboard or a mouse or a digitizer.
A communication cable connected to the projector 11 is connected to the input I / F 141, and the coordinates of the position indicated by the indicator 12 are input from the projector 11. Here, coordinate data output from the output unit 101 of the projector 11 is input to the input I / F 141 as data similar to coordinate data output from a pointing device such as a mouse, trackball, digitizer, or pen tablet. . Accordingly, the PC 13 can process the coordinate data input from the projector 11 as an input signal from the input device. For example, the PC 13 can perform an operation such as moving a mouse cursor or a pointer based on the coordinate data.

The display unit 136 includes an image output I / F 143 having a connector for outputting an image signal, and the image output cable connected to the monitor 144 and the projector 11 (not shown) is connected to the image output I / F 143. Is done. The image output I / F 143 is, for example, a VGA terminal that outputs an analog video signal, a DVI interface that outputs a digital video signal, a USB interface, a LAN interface, NTSC, PAL, and an S video terminal that outputs a composite video signal such as SECAM. , A RCA terminal that outputs a composite video signal, a D terminal that outputs a component video signal, a plurality of HDMI connectors compliant with the HDMI (registered trademark) standard, and the like, and the monitor 144 and the projector 11 are connected to the plurality of connectors, respectively. . Further, the image output I / F 143 may be configured to include a DisplayPort established by VESA, and specifically, may be configured to include a DisplayPort connector or a Mini Displayport connector and an interface circuit compliant with the Displayport standard. In this case, the PC 13 can output a digital video signal to the projector 11, the monitor 144, or another device via the Displayport. Note that the image output I / F 143 may perform transmission / reception of image signals by wired communication, or may perform transmission / reception of image signals by wireless communication.
In the present embodiment, a case where the display unit 136 outputs an analog image signal to the projector 11 via a VGA terminal included in the image output I / F 143 will be described.

  The storage unit 134 stores a display control program 13A that is executed by the CPU 131 and image data 13B that is output when the display control program 13A is executed. When executing the display control program 13A, the CPU 131 executes a process of transmitting the image data 13B to the projector 11. In this process, the CPU 131 reproduces the image data 13B, causes the display unit 136 to generate an analog image signal having a predetermined resolution and refresh rate, and outputs the analog image signal from the image output I / F 143. In addition, the storage unit 134 stores correction image data 13C output to the projector 11 in a correction process described later.

  Further, when the coordinates corresponding to the operation of the pointing device are input from the input unit 135 during the execution of the display control program 13A, the CPU 131 displays the pointer 12A (FIG. 1) at the position corresponding to the coordinates. Generate an image for Then, the CPU 131 generates image data in which the pointer 12A is superimposed on the image data 13B being reproduced, and outputs this image data to the projector 11 from the image output I / F 143.

  As described above, in the display system 10, the PC 13 executes a function of drawing the pointer 12 </ b> A on the image data output from the PC 13 to the projector 11.

4A and 4B are diagrams illustrating an example in which an image is projected onto the screen SC by the projector 11. FIG. 4A illustrates a state in which the pointer 12 </ b> A is projected according to the designated position of the indicator 12, and FIG. A state in which 12C is drawn is shown.
When a display image is projected using the entire modulation area of the light modulation device 32, an image is formed on the maximum projection area 11A indicated by a two-dot chain line in FIG. Except when the projector 11 is located in front of the screen SC, trapezoidal distortion occurs in the maximum projection area 11A as shown in FIG. Perform stone correction. After the keystone correction is performed, the display image is projected onto the actual projection area 11B that is a part of the maximum projection area 11A. The actual projection area 11B is normally set to have a rectangular shape on the screen SC and a maximum size within the maximum projection area 11A. Specifically, it is determined by the resolution of the modulation area of the light modulation device 32 (resolution of the liquid crystal display panel) and the degree of trapezoidal distortion, but it may not be the maximum size. If keystone distortion does not occur in the image projected from the projector 11, this keystone correction need not be executed. In this case, the actual projection area 11B coincides with the maximum projection area 11A.

  The calibration execution unit 103A of the projector 11 executes calibration in the actual projection area 11B after the keystone correction. In this calibration, the calibration execution unit 103A controls the image processing unit 113 to draw a predetermined calibration image. With the calibration image projected on the screen SC, the position detection unit 150 captures the screen SC under the control of the calibration execution unit 103A. 4A and 4B, the shooting range (view angle) 15A of the imaging unit 153 is indicated by a broken line. The imaging range 15A is preferably larger than the actual projection area 11B, and more preferably larger than the maximum projection area 11A. The calibration image is an image in which dots are arranged on a white background, for example, and is stored in advance in the storage unit 105 or the like. Note that the calibration image does not necessarily need to be stored in the storage unit 105 or the like, and it is necessary to execute calibration. The calibration execution unit 103A performs the calibration image every time calibration is performed. May be generated each time.

  The area of the screen SC to be calibrated may be the entire actual projection area 11B or a part of the actual projection area 11B. As a case where a part of the actual projection area 11B is a calibration target, when the aspect ratio of the display image of the projector 11 and the aspect ratio of the screen SC are different (for example, the display resolution of the projector 11 is WXGA and the screen SC In the case where the aspect ratio is 4: 3), the display image of the projector 11 may be displayed so that the vertical width thereof matches the vertical width of the screen SC. In this case, it is conceivable that the area included in the screen SC in the actual projection area 11B of the projector 11 is a calibration target, and the other areas are excluded from the calibration target.

The calibration execution unit 103A detects the contour of the display image in the captured image data, that is, the boundary between the outside of the actual projection region 11B and the actual projection region 11B, and the dots in the captured image data, and the position in the capturing range 15A. That is, the correspondence relationship between the position in the captured image data and the position on the actual projection area 11B is specified. The calibration execution unit 103A obtains a coordinate conversion parameter used by the coordinate calculation unit 159 based on the correspondence between the position on the captured image specified by the calibration and the position on the actual projection area 11B. The coordinate conversion parameter includes data for associating coordinates in the area on the screen SC (actual projection area 11B) to be calibrated with coordinates obtained on the captured image data. The coordinate calculation unit 159 can convert the coordinates obtained on the captured image data into coordinates in the actual projection area 11B based on the coordinate conversion parameters. A coordinate calculation process is performed based on the coordinate conversion parameters.
Since the calibration is performed by the control unit 103 executing a calibration program (not shown) stored in the storage unit 105, it is not necessary to install and execute the calibration program in the PC 13. Further, the calibration may be a process that is automatically performed by the calibration execution unit 103A based on the captured image data, or may be a process that requires a user operation on the image for calibration. Further, the projector 11 may use these processes in combination. As a user's operation on the calibration image, an operation in which the user designates dots included in the calibration image with the indicator 12 may be considered.

  The position detection unit 150 performs shooting in a state where an image is projected on the actual projection area 11B, and is orthogonal with the corner (upper left vertex) of the actual projection area 11B as the origin, as indicated by a broken arrow in the figure. Coordinates are virtually set to obtain the coordinates of the tip position (indicated position) of the indicator 12 in this coordinate system. The orthogonal coordinates are set based on the coordinate conversion parameters obtained by the above calibration. Thereafter, when the coordinates of the tip of the indicator 12 in the image data displayed in the actual projection area 11B are obtained by the coordinate conversion unit 160, for example, the pointer 12A shown in FIG. Is displayed. The pointer 12A is drawn as a symbol indicating the tip position of the indicator 12. Further, the menu bar 12B is a GUI that can be operated by the indicator 12, and when the indicator 12 indicates a button arranged on the menu bar 12B, drawing of a figure such as a line and saving of the drawn figure data are performed. It is possible to perform operations such as erasing, copying, moving a drawn handwritten image, an operation for undoing the previous operation (undo), an operation for re-executing the operation canceled by undo (redo), and the like. As a specific example, by moving the indicator 12 from the position shown in FIG. 4A to the position shown in FIG. 4B, the drawing figure 12C is drawn along the locus of the tip of the indicator 12. . The drawing figure 12C is drawn by the PC 13 according to the coordinate data indicating the indication position of the indicator 12, for example, like the pointer 12A and the menu bar 12B.

  FIGS. 5A and 5B are explanatory diagrams showing a state of processing in which the projector 11 detects the coordinates of the designated position and converts them into coordinates in the image data. FIG. 5A is an initial diagram of a series of operations. FIG. 5B shows a state in which the resolution of the display image is changed from the state of FIG. In the following description, a case where no trapezoidal distortion is generated in the image projected by the projector 11 and an image displayed in the entire modulation area of the light modulation device 32 is displayed in the actual projection area 11B will be described. . At this time, the actual projection area 11B coincides with the maximum projection area 11A, and the resolution of the image displayed in the actual projection area 11B is equal to the resolution of the liquid crystal display panel of the light modulation device 32.

  In the example shown in FIG. 5A, the resolution of the liquid crystal display panel of the light modulation device 32 and the resolution of the image displayed in the actual projection area 11B are both set to 1280 × 800 dots, and the image is input from the PC 13. In this example, a signal is projected in a display mode (WXGA) with a resolution of 1280 × 800 dots, and a display image 201 of 1280 × 800 dots is displayed in the actual projection area 11B. The position detection unit 150 sets an XY orthogonal coordinate system in which the upper left corner of the actual projection area 11B is the origin, the right direction is the X axis direction, and the lower direction is the Y axis direction, and the indicator 12 in the actual projection area 11B. The coordinates of the indicated position are (X1n, Y1n). The first coordinate data output from the coordinate calculation unit 159 represents the coordinates (X1n, Y1n) of the designated position.

The coordinates (X1n, Y1n) of the indicated position are coordinates (normalized coordinates) normalized in the actual projection area 11B. Specifically, the coordinate X1n in the X-axis direction of the designated position represents the ratio of the length WP1 from the left side of the projectable area 11B to the designated position with respect to the lateral width W1 of the actual projection area 11B. The coordinate Y1n in the Y-axis direction of the designated position represents the ratio of the length HP1 from the upper side of the projectable area 11B to the designated position with respect to the vertical width H1 of the actual projection area 11B. Here, W1, WP1, H1, and HP1 are represented by the number of pixels.
In this case, the coordinates (X1n, Y1n) are calculated by the following formulas (1) and (2).
X1n ＝ WP1 ÷ W1 (1)
Y1n ＝ HP1 ÷ H1 (2)
For example, in the example shown in FIG. 5A, it is assumed that WP1 = 400 and HP1 = 300. Since the resolution of the display image 201 is 1280 × 800 dots, W1 = 1280 and H1 = 800. Therefore, it can be expressed as X1n = 400 ÷ 1280≈0.313 and Y1n = 300 ÷ 800 = 0.375. At this time, the coordinates of the upper left vertex, the upper right vertex, the lower left vertex, and the lower right vertex of the actual projection region 11B are (0, 0), (1, 0), (0, respectively). , 1) and (1, 1). In the state of FIG. 5A, the actual projection area 11B and the area where the display image 201 is displayed coincide with each other. Therefore, the coordinates (X1n, Y1n) are considered as normalized coordinates in the display image 201. You can also

  Here, when the display mode is changed to XGA (resolution of 1024 × 768 dots), the projector 11 has the vertical resolution (768 dots) of the image data up to the vertical resolution (800 dots) of the liquid crystal display panel. Scale the image data to be magnified. Since this scaling is performed in the same manner in both the vertical and horizontal directions, the horizontal resolution (1024 dots) of the image data is scaled to 1024 × (800 ÷ 768) ≈1066 dots. As a result, a display image 202 of 1066 × 800 dots is projected onto the screen SC as shown in FIG. Since the aspect ratio and resolution of the display image 202 are different from the aspect ratio and resolution of the display image 201 (the display image 202 has a lower resolution than the display image 201), the area on which the display image 202 is projected is an actual projection. It does not match the area 11B. In the example shown in FIG. 5B, the area where the display image 202 is projected in the actual projection area 11 </ b> B is smaller than the display image 201. Further, the position of the projector 11 is changed so that the scaled image is displayed in the center as much as possible. Therefore, in the actual projection area 11B, the position of the upper left vertex of the display image 201 does not match the position of the upper left vertex of the display image 202.

  When the resolution changes due to the change of the display mode, as shown in FIGS. 5A and 5B, the indication position 12 is displayed even if the indication body 12 on the screen SC does not move and the indication position itself does not move. The relative position with respect to the image is changed. Therefore, the coordinates (X1n, Y1n) of the designated position normalized with the upper left vertex of the display image 201 as the origin, and the coordinates (X2n, Y2n) of the designated position normalized with the upper left vertex of the display image 202 as the origin. Is different. For example, in the coordinate system having the upper left corner of the display image 202 shown in FIG. 5B as the origin, the coordinates of the indication position of the indicator 12 are (X2n, Y2n), which is different from (X1n, Y1n). In this case, when the pointer 12A is displayed in accordance with the coordinates (X1n, Y1n) of the designated position in the actual projection area 11B calculated by the position detection unit 150 based on the captured image data of the imaging unit 153, the pointer 12A is the actual designated position. It will deviate from.

  For example, in the example of FIG. 5B, the upper left vertex of the display image 202 is 107 pixels to the right of the upper left vertex of the display image 201 (107 = (1280-1066) / 2). Accordingly, if the length from the left side of the display image 202 to the designated position is WP2, and the length from the top side of the display image 202 to the designated position is HP2, WP2 = WP1-107 = 400-107 = 293, HP2 = HP1 = 300. Since the resolution of the display image 202 is 1066 × 800 dots, the horizontal width W2 and the vertical width H2 of the display image 202 are W2 = 1066 and H2 = 800. Accordingly, the coordinates (X2n, Y2n) of the designated position normalized with the upper left vertex of the display image 202 as the origin are expressed as X2n = (400−107) ÷ 1066≈0.275, Y2n = 300 ÷ 800 = 0.375. . Thus, if X1n ≠ X2n and the resolution of the display image changes, the normalized coordinates of the indicated position also change.

  Therefore, when the pointer is displayed at the coordinates (X1n, Y1n) = (0.313, 0.375) in the coordinate system having the upper left corner of the display image 202 after the change as the origin, the pointer 12A ′ is positioned away from the tip of the indicator 12. It will be displayed. This is because, when the PC 13 draws the pointer 12A, the drawing is performed with the upper left corner of the image as the origin based on the normalized coordinates output from the position detection unit 150. Thus, the PC 13 cannot display the pointer 12A in accordance with the coordinates obtained with the actual projection area 11B as a reference. Therefore, the projector 11 uses the coordinate conversion unit 160 to convert the coordinates (X1n, Y1n) of the indicated position calculated by the coordinate calculation unit 159 of the position detection unit 150 so that the resolution of the display image can be changed. The coordinates (X2n, Y2n) of the designated position in the display image being displayed, that is, the coordinates based on the origin on the image being displayed are converted.

  The coordinate conversion unit 160 converts the coordinates (X1n, Y1n) to the coordinates (X2n, Y2n) based on the image position information input from the image processing unit 113. This image position information is information relating to the arrangement of images in the modulation region of the light modulation device 32. In the present embodiment, the modulation area of the light modulation device 32 corresponds to the actual projection area 11B on the screen SC. Therefore, the image position information indicates the position (arrangement) of the display image with respect to the actual projection area 11B. In the present embodiment, the image position information indicates the position (arrangement) and size of the display image with respect to the actual projection area 11B. Based on the image position information, the coordinate conversion unit 160 obtains the coordinates of the designated position in the display image. For example, in the example shown in FIG. 5, W1, H1, W2, and H2 correspond to image position information. Further, the coordinates (XO1, YO1) = (0, 0) of the upper left corner of the display image 201 and the coordinates (XO2, YO2) = (107, 0) of the upper left corner of the display image 202 also correspond to the image position information. XO1, YO1, XO2, and YO2 are not normalized coordinates, and in the actual projection area 11B (or the modulation area of the light modulation device 32), the top left vertex (or the light modulation device) of the actual projection area 11B. The position of the upper left vertex of the display image is represented by the number of pixels, with the upper left vertex of the 32 modulation areas as the origin. In the example shown in FIG. 5, the image position information (XO1, YO1, W1, H1) of the display image 201 is (0, 0, 1280, 800), and the image position information (XO2, YO2, W2, and the display image 202). H2) = (107, 0, 1166, 800).

  The coordinates (X2n, Y2n) calculated by the coordinate conversion unit 160 are information for specifying the position in the image data when the PC 13 draws the pointer 12A, the menu bar 12B, or the drawing figure 12C in the processing target image data. Available. Therefore, the pointer 12A, the menu bar 12B, and the drawing figure 12C can be accurately drawn in accordance with the position indicated by the indicator 12 without being affected by the resolution of the display image, the zoom rate, or the like.

  As described above, the position and size of the display image displayed in the actual projection area 11B are affected by the resolution of the image to be displayed. For example, when the resolution of an image signal input from the PC 13 changes while an image is projected based on an analog image signal input from the PC 13, the image position information changes. Here, the image position information is information relating to the arrangement of the image arrangement area (area where the display images 201 and 202 are projected (displayed)) with respect to the actual projection area 11B. In other words, the image position information is information indicating the position (arrangement) of the display image with respect to the actual projection area 11B (displayable area) and the resolution of the display image. Since the image position information changes when a process that changes the projection state is executed, the projector 11 changes the size (resolution) or aspect ratio of the actual projection area 11B, or changes the zoom magnification. This also changes when the display position of the image is changed (moved), when multi-screen display processing is performed, and the like.

Each time the projection state (display state) of the display image by the projection unit 30 changes, the coordinate conversion unit 160 acquires information from the image processing unit 113 and updates the image position information, and based on the updated image position information. To convert coordinates.
For example, the image position information is updated at the following timing.
When the control unit 103 detects an input of an image signal from the PC 13.
When the control unit 103 detects a change in information (image resolution or the like) related to the image signal input from the PC 13.
-When the resolution of the projected image is changed in the projector 1.
-When the aspect ratio of the projected image is changed in the projector 11.
When the digital zoom function for enlarging / reducing the image drawn by the light modulation device 32 by the image processing of the image data to be projected is executed or canceled.
-When the display position of the display image with respect to the actual projection area 11B is changed.
-When the above-mentioned digital zoom function is used to enlarge or further cancel or release the function of changing the image display position by image processing.
When the tele-wide function for enlarging / reducing the projection size of the entire image including the image and background drawn by the light modulation device 32, that is, the entire actual projection area 11B, by performing image processing of the image data is executed or canceled.
-When the picture shift function for reducing the image by the digital zoom function and changing the display position of the image by image processing is executed or canceled.
・ When simultaneous display of multiple images is executed or canceled.
When the output destination for outputting coordinates from the coordinate conversion unit 160 is changed from the image processing unit 110 to the PC 13 (output unit 101) or vice versa.
Changing the resolution, changing the aspect ratio, and executing and canceling various functions are all performed by the image processing unit 110 under the control of the control unit 103. Note that the timings listed above are merely examples, and it is of course possible to update the image position information at other timings.

FIG. 6 is a flowchart showing the operation of the projector 11, and particularly shows the operation of detecting the position indicated by the indicator 12 and outputting the coordinates of the indicated position.
The operation shown in FIG. 6 is performed every predetermined time after the projector 11 is started or when the display of the pointer 12A or the menu bar 12B is instructed by the operation of the operation panel 41 or the remote control light receiving unit 45. Repeatedly.

First, it is determined whether or not calibration is necessary (step S11). This determination may be performed based on a user instruction indicating whether or not calibration is necessary. The calibration execution unit 103A automatically determines whether or not calibration is necessary, You may do this automatically. When calibration is necessary (step S11; Yes), calibration is executed as described with reference to FIG. 4A (step S12). That is, an image for calibration is drawn by the image processing unit 113, shooting is performed by the position detection unit 150 in a state in which the image for calibration is projected, and the actual projection area 11B in the obtained captured image data is displayed. By detecting feature points (dots and the like) included in the contour and the calibration image, the correspondence between the image drawn by the image processing unit 113 and the captured image data is obtained. The calibration need only be performed once after the use of the projector 11 is started, and does not need to be performed again unless a specific event occurs. For example, in the following cases (1) to (3), it is necessary to newly perform calibration.
(1) When keystone correction is performed.
(2) When the installation conditions of the projector 11 change. For example, when the relative position (including the orientation) of the projector 11 with respect to the screen SC has changed.
(3) When optical conditions change. For example, when the focus or zoom state of the projection optical system 33 changes. When the optical axis of the projection optical system 33 or the imaging unit 153 is shifted due to a change with time or the like.
When these events occur, the correspondence relationship between the position on the captured image data in the initial state and the position on the image drawn by the image processing unit 113, which is the reference for the coordinate conversion unit 160 to calculate the coordinates, changes ( That is, since the coordinate conversion parameter changes), it is necessary to perform calibration again. Conversely, if these events do not occur, it is not necessary to perform calibration again. Therefore, if the above events have not occurred between the previous use of the projector 11 and the current use, calibration is performed. In addition, the coordinate conversion parameters obtained in the previous calibration can be reused. As a method for determining whether the calibration execution unit 103A needs to perform the calibration, for example, a method for determining based on the presence / absence of operation of a switch instructing execution of keystone correction on the operation panel 41, a projector There is a method in which a sensor for detecting tilt and movement is provided in 11, and a determination is made based on a change in the detection value of the sensor. Further, when the focus and zoom are adjusted in the projection optical system 33, the calibration execution unit 103A may automatically execute the calibration. In addition, a corresponding switch may be provided on the operation panel 41 or an operation unit such as a remote control so that the user can perform an operation for instructing execution of calibration by knowing a change in the installation position of the projector 11 and optical conditions. .

  When the imaging control unit 155 causes the imaging unit 153 to capture a range including the actual projection area 11B under the control of the control unit 103, the position detection processing unit 157 acquires captured image data (step S13), and based on the captured image data. Then, the indication position of the indicator 12 is detected (step S14). Subsequently, the coordinate calculation unit 159 calculates the coordinates of the indicated position detected by the position detection processing unit 157 (step S15). The coordinates calculated in step S15 are the coordinates in the actual projection area 11B, and are the coordinates (X1n, Y1n) described in FIG.

The coordinate conversion unit 160 determines whether or not the image position information needs to be updated (step S16). If the update is necessary, the coordinate conversion unit 160 acquires information from the image processing unit 113 and updates the image position information (step S17). . The process in step S17 is not limited to the process after step S15, and may be executed as needed at the timing illustrated above.
Thereafter, the coordinate conversion unit 160 performs processing for converting the coordinates calculated by the coordinate calculation unit 159 into coordinates in the image data of the display image (step S18). The coordinates after conversion are the coordinates (X2n, Y2n) described in FIG.
The coordinate conversion unit 160 outputs the converted coordinates to the PC 13 (step S19), and ends this process.

FIG. 7 is a diagram schematically illustrating a configuration example of a resolution table that defines resolutions supported by the projector 11.
In this resolution table, the resolution and refresh rate of the input image that can be displayed by the projector 11 are set and stored in the storage unit 105, for example. In the resolution table illustrated in FIG. 7, a plurality of screen modes (display modes) having different resolutions and refresh rates are set from a VGA mode with a resolution of 640 × 480 to an SXGA + mode with a resolution of 1400 × 1050.
The display control unit 107 selects one of the screen modes set in the resolution table based on the resolution and refresh rate of the analog image signal input to the image input unit 104, and displays an image in the selected screen mode. Perform the process. When the display control unit 107 selects a screen mode whose resolution does not match the number of pixels of the liquid crystal panel of the light modulation device 32, for example, according to the parameter stored in the storage unit 105 in advance in association with the screen mode, the display control unit 107 In step 113, resolution conversion processing is executed. Further, when the aspect ratio of the selected screen mode is different from that of the liquid crystal panel of the light modulation device 32, the image processing unit 113 also performs a process of adding a black belt-like non-display area around the image.

If the resolution of the analog image signal input to the image input unit 104 does not match any of the screen modes set in the resolution table, the display control unit 107 selects a screen mode that is closer to the screen mode. For this reason, if the resolution of the analog image signal input from the PC 13 cannot be detected correctly, or if the resolution is unknown, a screen mode whose resolution is significantly different from that of the input analog image signal is selected. There is.
FIG. 8 is a diagram illustrating an example of a projection state on the screen SC, where (A) illustrates an example of projection in an appropriate screen mode, and (B) illustrates an example of projection in an inappropriate screen mode.

When an appropriate screen mode is selected for the analog image signal input to the image input unit 104, the correction image 210 has a resolution or the like so as to be within the actual projection area 11B as shown in FIG. The image is adjusted and projected as an image 204.
On the other hand, when an inappropriate screen mode is selected, for example, as shown in FIG. 8B, the image is adjusted such that the aspect ratio changes unnaturally. The portion does not fit in the actual projection area 11B. This is because the difference between the resolution of the selected screen mode and the resolution of the image signal actually input to the image input unit 104 is too large in the vertical direction and / or horizontal direction of the screen. Even if the difference between the resolution of the selected screen mode and the resolution of the image signal actually input to the image input unit 104 is accidentally small, an unnatural change in the aspect ratio or the actual projection area 11B If the user sees an image on the screen SC and feels uncomfortable, it cannot be said that the projection state is appropriate.
As described above, when the appropriate screen mode is not selected, the projector 11 recognizes a resolution different from the actual resolution as the resolution of the image signal input to the image input unit 104. Accordingly, since the image position information described above is not accurate, the coordinate conversion unit 160 cannot accurately convert the coordinates of the position indicated by the indicator 12.

Therefore, when the projector 11 cannot accurately detect (recognize) the resolution of the image signal input from the PC 13, the projector 11 corrects the information related to the resolution according to the operation by the user via the operation panel 41 or the remote controller. It has.
FIG. 9 is a diagram showing a configuration example of a correction image 210 used for correcting information relating to resolution. (A) shows an example in which a square is included as a marker, and (B) uses a pointer as a marker. Here is an example.

The correction image 210 is an image in which a square marker 211 is arranged on a background painted in white or other single color, and has a rectangular outline as a whole. In the correction image 210, it is desirable that the marker 211 be within the actual projection area 11 </ b> B no matter what screen mode the correction image 210 is displayed. For example, when the correction image 210 is displayed in the screen mode of the lowest resolution set in the resolution table (in the example of FIG. 7, the resolution is 640 × 480 VGA mode), the marker 211 is smaller than the actual projection area 11B. In addition, the entire marker 211 does not come out of the actual projection area 11B. More specifically, the number of pixels of the actual projection region 11B is the number of pixels of the square that is the marker 211 and the number of pixels from the end of the correction image 210 to the contour of the marker 211 both in the vertical direction and in the horizontal direction. Is not exceeded. In this case, the number of pixels in the actual projection area 11B is preferably based on the screen mode having the smallest number of pixels in the resolution table (in the example of FIG. 7, the number of pixels in the VGA mode is 640 × 480).
The correction image 210 shown in FIG. 9A is a typical example, and the marker 211 is arranged at substantially the center of the correction image 210. The size of the marker 211 is the correction image 210 in both the vertical direction and the horizontal direction. The total number of pixels is one third, and the number of pixels of one third of the correction image 210 is a number that does not exceed the number of pixels of the actual projection area 11B.

In the correction process using the correction image 210, the position of a specific point (reference point) of the marker 211 in the correction image 210 is used as described later. The simplest and most accurate method is to use the four vertices 212, 213, 214, and 215 of the marker 211 as reference points. Since at least a part of the vertices 212, 213, 214, and 215 needs to be projected into the actual projection area 11B, the number of pixels of the correction image 210 is set as described above. The positions of the vertices 212, 213, 214, and 215 in the correction image 210 are predetermined positions. The projector 11 can use information on the specified position, and is stored in the storage unit 105, for example. This information is, for example, information representing the positions of the vertices 212, 213, 214, and 215 in coordinates with the corner of the correction image 210 as the origin, or the total number of pixels of the correction image 210 and the correction image 210. This information includes the number of pixels from the end to each vertex 212, 213, 214, 215. Further, the information regarding the specified position may be information indicating the ratio of the size of the marker 211 to the size of the correction image 210.
Note that the positions of the vertices 212, 213, 214, and 215 in the correction image 210 may be changeable. In this case, the PC 13 and the projector 11 need to hold common information regarding the positions of the changed vertices 212, 213, 214, and 215.

The PC 13 stores correction image data 13 </ b> C (FIG. 3) that is image data of the correction image 210 in the storage unit 134. When the user operates the operation panel 41 or the remote control of the projector 11 to instruct execution of correction processing, a control signal instructing the start of correction processing is output from the projector 11 to the PC 13. When the CPU 131 of the PC 13 receives the control signal instructing the start of the correction process from the projector 11, the CPU 131 reads the correction image data 13C from the storage unit 134 and displays an analog image signal for displaying the correction image data 13C. The image data is generated by the unit 136 and output from the image output I / F 143 to the monitor 144 and the projector 11. In this case, the display control program 13A executed by the PC 13 is a program having a function corresponding to the correction process.
The PC 13 outputs the correction image 210 at the same resolution and the same refresh rate as the image signal that has been output to the projector 11 until then. Therefore, the projector 11 projects the correction image 210 without changing the screen mode.

10A and 10B are diagrams illustrating an example of correction processing using the correction image 210. FIG. 10A illustrates a state before correction, and FIG. 10B illustrates a state after correction. 10A and 10B, the shooting range 15A of the imaging unit 153 is indicated by a broken line.
When the projector 11 cannot correctly detect the resolution of the input image signal, the display state of the correction image 210 is such that the aspect ratio is distorted or a part of the correction image 210 is actual as shown in FIG. It is in a state of protruding from the projection area 11B. The vertices 212, 213, 214, and 215 that deviate outside the actual projection area 11B are not imaged on the screen SC and cannot be used for the correction process. For this reason, it is necessary that at least two or more of the vertices 212, 213, 214, and 215 of the marker 211 are projected on the actual projection area 11B.

The control unit 103 controls the shooting control unit 155 of the position detection unit 150 to perform shooting by the imaging unit 153 in a state where the correction image 210 is displayed. When the captured image data is output from the imaging control unit 155, the control unit 103 causes the pattern detection unit 156 to perform processing for detecting the vertices 212, 213, 214, and 215 in the captured image data. The pattern detection unit 156 detects the positions of the vertices 212, 213, 214, and 215 in the captured image data, and outputs the detected positions to the coordinate calculation unit 159. For example, the pattern detection unit 156 extracts the boundary between the monochrome background and the marker 211 based on the color of each pixel of the captured image data, and detects the vertices 212, 213, 214, and 215 based on the shape of the boundary. .
Since the correspondence relationship between the shooting range 15A, the position on the actual projection region 11B, and the position in the input image is determined by the calibration described above, the control unit 103 performs pattern detection based on this correspondence relationship. The positions of the vertices 212, 213, 214, and 215 detected by the unit 156 are converted into positions in the correction image 210 that is an input image.

The control unit 103 corrects the correction image based on the positions of the vertices 212, 213, 214, and 215 in the converted correction image 210 and the specified positions of the vertices 212, 213, 214, and 215 in the correction image 210. The relative positions of the four corner vertices 210 with respect to the actual projection area 11B are grasped.
For example, the control unit 103 obtains the number of pixels between the currently displayed vertices based on the calculated positions of the vertices 212, 213, 214, and 215 in the correction image 210 and / or the distance between the vertices. Based on the obtained number of pixels between the vertices and the specified positions where the vertices 212, 213, 214, and 215 are arranged in the correction image 210, the control unit 103 sets the correction image 210 for the actual projection area 11B. The relative position (that is, the top left vertex position, the horizontal width, and the vertical width of the correction image 210 in the actual projection area) is calculated. The parameter calculated here is correct image position information. The calculated correct image position information is used, for example, in the process of FIG.

Further, the control unit 103 outputs the resolution obtained based on the correction image 210 to the display control unit 107, selects an appropriate screen mode corresponding to this resolution, and updates the display on the screen SC. Also good. Thus, the correction image 210 is displayed at an appropriate position, size, and aspect ratio as shown in FIG. After the display is updated, the control unit 103 causes the image capturing unit 153 to perform image capturing again in order to confirm the success of the correction process, and performs processing for obtaining the resolution of the correction image 210 based on the captured image data. Good.
Also, for example, when there is a large discrepancy between the resolution of the image signal and the screen mode set in the resolution table, and there is no applicable screen mode, a new screen mode is created or a message indicating that there is no applicable screen mode is displayed. An OSD display may be used.

  In the above method, the control unit 103 automatically detects the vertices 212, 213, 214, and 215 based on the captured image data of the imaging unit 153, but the user designates the vertices 212, 213, 214, and 215. The body 12 may be used for pointing. In this case, the control unit 103 may cause the position detection unit 150 to detect the indicated position of the indicator 12 and perform the above processing with the indicated position as the positions of the vertices 212, 213, 214, and 215. In this case, image processing for extracting the vertices 212, 213, 214, and 215 from the photographed image data is not necessary, so that correction processing can be executed promptly.

In the example described above, the PC 13 stores the correction image data 13C of the correction image 210 in the storage unit 134, and outputs the correction image 210 to the projector 11 by the function of the display control program 13A that is a dedicated program executed by the PC 13. As described above, a general-purpose program can be executed by the PC 13 and a correction image can be generated as necessary.
A correction image 220 shown in FIG. 9B is an image in which a pointer 221 is arranged on the background. In the display system 10, as described with reference to FIG. 4B, the coordinates of the position detected by the projector 11 by the position detection unit 150 are output to the PC 13, and the PC 13 is set to a position corresponding to the input coordinates. A pointer 12A or the like is displayed. In this case, the PC 13 acquires a coordinate input from the projector 11 using a general-purpose device driver program for using a pointing device such as a mouse, and displays a pointer 12A at a position corresponding to the coordinate. Do. In this case, the display control program 13A need not be a dedicated program.
In this configuration, when the projector 11 outputs the coordinates of a predetermined position, for example, one third from the top of the entire screen and one third from the left end of the screen, the PC 13 uses the correction position shown in FIG. 9B. An image 220 is generated and output to the projector 11. In the correction image 220, pointers 221 are arranged corresponding to the coordinates input from the projector 11. That is, a pointer 221 that can be used as a reference point is arranged at a position designated by the projector 11. As described above, even if the PC 13 does not execute the dedicated program, the correction image 220 including the pointer 221 as a marker that can be used as a reference point is output based on the information output from the projector 11 to the PC 13. Can do. When the PC 13 displays the pointer 221 based on the coordinates indicating the specified position input from the projector 11, the pointer 221 may be moved from the current position to the specified position. In this way, the user can easily recognize the position of the pointer 221.

  In this method, since it is difficult to change the background color of the correction image 220 by controlling the projector 11, the user points the tip position of the pointer 221 with the indicator 12, and the projector 11 detects the indicated position. It is good also as composition which performs amendment processing. In this case, the processing load for extracting the pointer 221 from the captured image data of the imaging unit 153 can be reduced, and even when the background color of the correction image 220 or an image other than the pointer 221 is displayed on the background, the correction process is promptly performed. Can be done. In this case, the projector 11 outputs the coordinates of at least two points to the PC 13 to display the pointer 221 at these two points, and the user points the position of the two points on the actual projection area 11B with the indicator 12. preferable.

  The control unit 103 causes the imaging unit 153 to perform imaging while the correction image 220 is projected, and extracts the pointer 221 from the captured image data. Then, for example, based on the tip position of the pointer 221 and the length of the pointer 221, the number of pixels, that is, the resolution of the entire correction image 220 is calculated in the same manner as the above processing. When the correction image 220 is used, the correction process can be performed only by changing the coordinates output from the projector 11 to the PC 13 without the PC 13 executing a dedicated program.

FIG. 11 is a flowchart showing the operation of the projector 11, and particularly shows the correction process.
The control unit 103 as correction means starts correction processing in accordance with the operation of the operation panel 41 or the remote controller (step S21), outputs control information or coordinates to the PC 13, and accordingly the PC 13 to the projector 11 On the other hand, a correction image is input (step S22). The projector 11 starts projecting a correction image (step S23), and determines whether or not to automatically detect a reference point used for correction processing (step S24).

Here, when it is set to automatically detect the position of the reference point (step S24; Yes), the control unit 103 causes the image capturing unit 153 to capture the screen SC and uses the captured image data as a reference point as a reference point. 212, 213, 214, 215 or the position of the tip of the pointer 221 is automatically detected (step S25), and the resolution of the image for correction is calculated by the above-described method based on the detected position of the reference point. The information is corrected (step S26), and this process is terminated.
Note that after correcting the image position information, the screen mode may be selected in accordance with the calculated resolution of the correction image, and the image projected on the screen SC may be updated.

  On the other hand, when the position of the reference point is designated manually (step S24; No), the control unit 103 detects the position of the indicator 12 when the indicator 12 indicates the vertices 212, 213, 214, and 215. Detected by the unit 150 (step S27), the detected indication position is specified as the position of the reference point (step S28), the process proceeds to step S26, and the resolution of the image for correction is calculated based on the position of the reference point; Correct the image position information.

  As described above, the display system 10 according to the embodiment to which the present invention is applied includes the projection unit 3 that displays the display image on the screen SC, the position detection unit 150 that detects the indicated position with respect to the display image on the screen SC, The coordinate calculation unit 159 that calculates the first coordinate that is the coordinate of the designated position in the displayable region (for example, the actual projection region 11B) in the screen SC, and the first coordinate calculated by the coordinate calculation unit 159 are used as the screen. Based on the image position information indicating the position of the display image in the SC, the coordinate conversion unit 160 that converts to the second coordinate that is the coordinate in the image data, and the output that outputs the second coordinate obtained by the coordinate conversion unit 160 And a control unit 103 that corrects information related to the resolution of the supplied image by a process of displaying the correction image. Since the image position information used for the conversion can be corrected using the correction image, even when accurate information about the resolution cannot be obtained, such as when displaying an image with an unknown resolution input from the PC 13, Accurately convert coordinates and output. Thereby, the coordinates of the position instructed by the operation on the screen SC can be accurately output regardless of the resolution of the input image.

  In addition, the coordinate conversion unit 160 converts the first coordinates calculated by the coordinate calculation unit 159 into second coordinates based on the image position information. For example, the coordinate conversion unit 160 performs coordinate conversion using image position information that reflects the display resolution of the projection unit 30 and the resolution of the image data. Thus, even if the resolution of the image data changes, the coordinates of the designated position can be accurately converted and output.

Further, the correction image displayed by the projection unit 3 includes, for example, a monochrome background and a marker 211 arranged at a predetermined position that is likely to be displayed in the actual projection area 11B. The marker 211 located at 11B can be detected and the correction process can be executed promptly.
The projector 11 can also project the correction images 210 and 220 input from the PC 13 onto the screen SC and automatically detect the marker 211 and the pointer 221 based on the captured image data obtained by capturing the screen SC. .
In the correction process, it is also possible to detect the reference point by the user's position instruction operation. That is, the control unit 103 displays the indication position detected by the position detection unit 150 and the position of the pointer 221 in the correction images 210 and 220 with the projection unit 3 displaying the correction images 210 and 220 on the screen SC. Based on the information, the information about the resolution can be corrected.

  In addition, the said embodiment is only an example of the specific aspect to which this invention is applied, This invention is not limited, It is also possible to apply this invention as an aspect different from the said embodiment. For example, in the above-described embodiment, the correction image actually projected on the screen SC is captured by the imaging unit 153, and the position of the reference point is detected from the captured image data. However, the present invention is not limited to this. Instead, a marker as a reference point is detected from the image data developed by the image processing unit 113 (image development means) in the frame memory 115 (memory) based on the image signal of the correction image input from the PC 13. It is also possible to correct the image position information. In this case, the position of the marker can be quickly and accurately specified without being affected by the projection state on the screen SC or the shooting condition by the imaging unit 153.

In the configuration of the above-described embodiment, the imaging unit 153 and the imaging control unit 155 included in the position detection unit 150 can be replaced with an imaging device (such as a digital camera) externally connected to the projector 11. The imaging apparatus in this case may be any apparatus that executes imaging under the control of the control unit 103 and outputs the captured image data to the position detection processing unit 157. Further, a general-purpose interface such as a USB can be used as an interface for connecting the image pickup apparatus and the projector 11 and can be easily realized. Further, the position detection unit 150 may be externally connected to the projector 11. In this case, the position detection unit 150 can be an apparatus independent of the projector 11.
In the configuration of the above embodiment, the image source is not limited to the PC 13, and various portable or stationary devices that can output images can be used via the image input unit 104. An image stored in the storage unit 105 by the projector 11 may be projected as an image source.

In the configuration of the above-described embodiment, the indicator 12 is not limited to a rod-shaped or pen-shaped one. For example, the user's finger can be used as the indicator 12 to detect the indicated position. is there.
Furthermore, in the configuration of the above embodiment, the configuration in which the position detection unit 150 detects the position indicated by the indicator 12 based on the captured image data has been described as an example. However, the present invention is not limited to this, and for example, As a configuration in which a pressure-sensitive or capacitive touch panel is provided on the screen SC as a display surface or a display screen in another display method, and the touch of the user's finger or bar as the indicator 12 is detected by this touch panel. Also good.

Further, the indicator 12 may be provided with an operator such as a button, and an operation signal may be transmitted from the indicator 12 to the projector 11 when the operator is pressed. The indicator 12 emits light of a predetermined wavelength (invisible light or visible light) according to the operation when the operation element is operated, and stops emitting light when the operation is released. It can also be. In this case, it is possible to determine whether or not the operation of the indicator 12 is performed by determining whether or not light is emitted from the indicator 12 based on the captured image data captured by the imaging unit 153. Therefore, the position detection processing unit 157 can detect not only the indication position of the indicator 12 but also whether or not an operation has been performed on the operator (whether or not the operator has been pressed).
Further, in the above example, a configuration has been described in which the light of a predetermined wavelength is emitted when the operation element is operated, and the light emission is stopped when the operation is released. Not limited to. For example, the indicator 12 can be configured to always emit light of a predetermined wavelength in a predetermined pattern and emit light by changing the light emission pattern to a different pattern when the operation element is operated. In this case, since the indicator 12 always emits light in a predetermined pattern, the position detection processing unit 157 can always detect the indication position of the indicator 12. The position detection processing unit 157 can detect whether or not an operation has been performed on the operation element based on the light emission pattern.
Further, information indicating that the operation element has been operated and information indicating that the operation on the operation element has been released may be output from the projector to the PC as control data. For example, the projector outputs information indicating that the operation element has been operated to the PC as information indicating that the mouse has been left-clicked, and left-clicking information indicating that the operation on the operation element has been released. It may be output to the PC as information indicating that has been released. Further, the projector 11 may output the operation information to the PC 13 as information representing an operation of a pointing device other than the mouse (for example, a digitizer).

In the above embodiment, the configuration in which the control unit 103 functions as the calibration execution unit 103A has been described as an example. However, the present invention is not limited to this. For example, the position detection unit 50 may include some or all of the functions of the calibration execution unit 103A. In particular, when the position detection unit 150 is an imaging device externally connected to the projector 11 and this imaging device functions as the calibration execution unit 103A, the projector 11 needs to have a configuration corresponding to the calibration execution unit 103A. There is no.
In addition, a device externally connected to the projector 11 may function as the position detection unit 150, the calibration execution unit 103A, and the coordinate conversion unit 160. Furthermore, a device externally connected to the projector 11 may function as the position detection unit 150 and the coordinate conversion unit 160.

  Further, in the above embodiment, the size of the marker 211 arranged in the correction image 210 is described as being one third of the entire correction image 210 in both the vertical direction and the horizontal direction. It is not limited to this. At least one of the vertical size and the horizontal size of the marker 211 may be larger or smaller than one third of the entire correction image 210 size.

  In the above embodiment, an example in which the four vertices of the marker 211 arranged in the correction image 210 are used as reference points has been described. However, the method of using the marker 211 is not limited to this. For example, of the four vertices of the marker 211, two vertices existing on the same diagonal can be used as reference points.

  Moreover, although the said embodiment demonstrated the example in which the projector 11 discriminate | determines whether a reference point is detected automatically, the detection method of a reference point is not restricted to this. The projector 11 may be configured to always automatically detect the reference point or may be configured to always manually.

  In the above embodiment, the coordinates (X1n, Y1n) and the coordinates (X2n, Y2n) are normalized in the range of 0 to 1, but the normalization method is not limited to this. For normalization of these coordinates, any logically defined value (for example, a range of 0 or more and 32767 or less) can be used.

  Furthermore, in the above-described embodiment, the configuration in which the PC 13 and the projector 11 are wiredly connected by a cable or the like has been described as an example, but the connection form between the projector 11 and the PC 13 is arbitrary. For example, the projector 11 and the PC 13 are connected to each other by wireless communication using a wireless LAN, Bluetooth (registered trademark) or the like, or by wire communication using a general-purpose data communication cable such as a USB or a wired LAN. It is good also as a structure which transmits / receives.

  In the above-described embodiment, as an example of the means for modulating the light emitted from the light source, the light modulation device 32 uses a configuration using three transmissive or reflective liquid crystal panels corresponding to RGB colors. However, the present invention is not limited to this, for example, a system using one liquid crystal panel and a color wheel, a system using three digital mirror devices (DMD), and a single digital mirror device. And a DMD system combining a color wheel and the like. Here, when only one liquid crystal panel or DMD is used as the display unit, a member corresponding to a synthetic optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and the DMD, any configuration that can modulate the light emitted from the light source can be used without any problem.

  Further, the display device of the present invention is not limited to a projector that projects an image on the screen SC, and the image / image is displayed on a liquid crystal monitor or a liquid crystal television that displays an image / image on a liquid crystal display panel, or a plasma display panel (PDP). Monitor device or television receiver for displaying the image, self-light emission of the monitor device or television receiver for displaying an image / image on an organic EL display panel called OLED (Organic light-emitting diode), OEL (Organic Electro-Luminescence), etc. Various display devices such as a type display device are also included in the image display device of the present invention. In this case, the liquid crystal display panel, the plasma display panel, and the organic EL display panel correspond to display means, and the display screen corresponds to the display surface. More specifically, the entire area where the image can be displayed corresponds to the actual projection area 11B or the maximum projection area 11A of the above embodiment.

Further, each functional unit of the projector 11 shown in FIG. 2 and each functional unit of the PC 13 shown in FIG. 3 show functional configurations realized by cooperation of hardware and software. A specific mounting form is not particularly limited. Therefore, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to realize a function of a plurality of function units by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, specific detailed configurations of other parts of the display system 10 including the projector 11 and the PC 13 can be arbitrarily changed without departing from the spirit of the present invention.
In addition, the control program 105A stored in the storage unit 105 in the above embodiment may be downloaded from another apparatus connected to the projector 11 via a communication network and executed, or may be stored in a portable recording medium. The control program 105A may be recorded, and the above programs may be read from the recording medium and executed. Similarly, the display control program 13A stored in the PC 13 may be downloaded and executed by the PC 13 from another device, or the display control program 13A recorded on a portable recording medium may be downloaded. The PC 13 may be configured to read and execute.

  DESCRIPTION OF SYMBOLS 3 ... Projection unit (display means), 10 ... Display system, 11, 51 ... Projector (display device), 11A ... Maximum projection area, 11B ... Actual projection area (displayable area), 11C ... Non-display area, 12 ... Instruction , 13 ... PC (image source), 30 ... projection section (projection means), 31 ... illumination optical system (light source), 32 ... light modulation device (light modulation means), 101 ... output section (output means), 103 ... Control unit (correction unit), 105A ... control program, 107 ... display control unit, 110 ... image processing unit (image forming unit), 113 ... image processing unit (image development unit), 115 ... frame memory (memory), 150 ... Position detection unit (position detection means), 151... Position detection section, 153... Imaging section, 157... Position detection processing section, 159... Coordinate calculation section (coordinate calculation means), 160. Coordinate transformation means), SC ... screen (projection surface, the display surface).

Claims (7)

A display device connected to an image source that outputs a supply image for displaying a pointer at a position corresponding to the coordinates when coordinates corresponding to an operation of the pointing device are input;
Display means for displaying on the display surface supply image supplied by the image source,
Position detecting means for detecting an indicated position on the display surface;
Coordinate calculating means for calculating first coordinates which are coordinates of the indicated position in the displayable area of the display surface;
Coordinate conversion for converting the first coordinates calculated by the coordinate calculating means into second coordinates that are coordinates in the supplied image based on image position information indicating the position of the supplied image in the displayable area. Means,
Output means for outputting the second coordinates obtained by the coordinate conversion means to the image source as coordinate data of the pointing device ;
Correction means for correcting the image position information;
With
It said correction means, the third coordinates representing the position of the defined is outputted from said output means to said image source, said supply image the pointer was located at a position where said image source correspond to said third coordinate When the image is generated and output, the supply image output from the image source is displayed on the display surface by the display means, and the image position information is corrected based on the position of the pointer on the display surface. A display device.   The coordinate conversion unit converts the first coordinate calculated by the coordinate calculation unit into the second coordinate based on the resolution of the supplied image and the image position information. The display device according to claim 1. Wherein the correction means includes a fourth coordinate that indicates the position of the defining, and said third coordinate is output from the output unit to the image source, the image source is the third coordinate and the fourth coordinate the corresponding said supply image by placing the pointer position is displayed on the display surface by the display unit, the position of the pointer on the display surface of the third coordinate, the display of the fourth coordinates The display device according to claim 1, wherein the image position information is corrected based on a position of the pointer on a surface.   The correction means causes the position detection means to detect an indicated position when a user designates the pointer on the display surface, and corrects the image position information based on the detected designated position. Item 4. The display device according to any one of Items 1 to 3. The image position information is information corresponding to the resolution and screen mode of the supplied image,
The correction means calculates the resolution of the supplied image based on the tip position of the pointer on the display surface and the length of the pointer, and corrects the image position information using the calculated resolution of the supplied image. The display device according to claim 1, wherein the display device is a display device. As the display means,
A light modulation means for modulating light emitted from the light source;
Image forming means for forming a display image on the light modulation means based on the supplied image;
The display device according to claim 1, wherein the display device includes a projection unit that projects a display image formed by the image forming unit onto a projection surface as the display surface. . A display control method by a display device connected to an image source that outputs a supply image for displaying a pointer at a position corresponding to the coordinates when coordinates corresponding to an operation of the pointing device are input,
Display supply image supplied by the image source on the display surface,
Detecting the indicated position on the display surface;
Calculating first coordinates which are coordinates of the indicated position in the displayable area of the display surface;
The calculated first coordinates are converted into second coordinates, which are coordinates in the supply image, based on image position information indicating the position of the supply image in the displayable area,
Outputting the second coordinates obtained by the conversion to the image source as coordinate data of the pointing device ;
When correcting the image position information, a third coordinate indicating a specified position is output to the image source;
When the image source generates and outputs the supply image in which the pointer is arranged at a position corresponding to the third coordinate, the supply image output by the image source is displayed on the display surface;
Correcting the image position information based on the position of the pointer on the display surface;
A display control method characterized by the above.

Images