JP2022118884A - projection device - Google Patents

Abstract

To provide a technique which allows a user to grasp the occurrence of a positional deviation of a graphic before execution of processing of causing the positional deviation of the graphic.SOLUTION: A projection device according to the present invention comprises: projection means which projects an input image to a projection surface; reception means which receives a user operation; processing means which changes the projection state of the input image according to the user operation; detection means which detects a position indicated by an indication body on the projection surface; and control means which performs control such that the projection means projects the input image and projects a graphic to a position corresponding to the position detected by the detection means. When the change of the projection state according to the user operation affects a correspondence between the detection position where the indication body is detected and the projection position where the graphic is projected, the control means performs control such that a prescribed notification is performed to the user before the change of the projection state.SELECTED DRAWING: Figure 2

Description

The present invention relates to projection devices.

As a technology related to projection devices such as projectors, when a user indicates a position within a projection plane using an indicator such as an electronic pen, there is a technology that detects the position indicated by the indicator and generates and projects graphics. It has been proposed (for example, Patent Document 1). If the graphic is projected at the position indicated by the pointer, the user can feel as if it were written by hand, which improves convenience. On the other hand, if the graphic is projected at a position deviated from the position indicated by the pointer, convenience may be impaired.

Graphic misalignment (graphic deviation from the position indicated by the pointer) can be reduced by calibration. The projection apparatus disclosed in Japanese Patent Application Laid-Open No. 2002-200003 determines whether or not calibration is necessary after starting or operating the projection apparatus, and executes calibration if necessary.

JP 2013-88840 A

However, in the projection apparatus disclosed in Patent Document 1, when the user instructs execution of processing that causes graphic positional deviation, such as keystone correction processing, the processing and calibration are always executed. Therefore, the instructed processing or calibration is executed even if the user does not want it.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a technology that enables a user to understand that a graphic position shift will occur before executing a process that causes the graphic position shift.

The projection apparatus of the present invention comprises projection means for projecting an input image onto a projection plane, acceptance means for accepting a user operation, processing means for changing a projection state of the input image in accordance with the user operation, and projection plane projection means. Detecting means for detecting the position indicated by the pointer, and control for controlling the projecting means to project the input image and to project a graphic at a position corresponding to the position detected by the detecting means. means, wherein a change in the projection state according to the user operation affects a correspondence relationship between a detection position where the pointer is detected and a projection position where the graphic is projected; The control means is characterized in that it performs control such that a predetermined notification is given to the user before the projection state is changed.

According to the present invention, it is possible to let the user know that the graphics will be misaligned before executing the process that causes the graphics to be misaligned.

It is a block diagram which shows the structural example of a projection apparatus. 4 is a flowchart showing an example of menu processing; FIG. 5 is a schematic diagram showing an example of a positional deviation determination table; It is a schematic diagram which shows an example of a display (projection). FIG. 5 is a schematic diagram showing an example of a positional deviation determination table; FIG. 5 is a schematic diagram showing an example of a positional deviation determination table;

<Example 1>
Embodiment 1 of the present invention will be described below. FIG. 1 is a block diagram showing a configuration example of a projection device 100 (projector) according to the first embodiment. In FIG. 1, thin arrows represent the flow of various data used for control, and thick arrows represent the flow of image data. In FIG. 1, the control unit 101 is configured by a microcontroller, an arithmetic device such as an ASIC (Application Specific Integrated Circuit), an FPGA (field-programmable gate array), or the like. Similarly, the imaging control unit 111, the pointer discrimination unit 113, the position detection unit 114, the coordinate calculation unit 115, the graphics generation unit 116, and the graphics editing unit 117 are also configured by arithmetic devices such as microcontrollers, ASICs, and FPGAs. be. The image processing unit 122, the image synthesizing unit 123, the image correcting unit 124, the projection control unit 125, and the light source control unit 126 are also configured by arithmetic units such as microcontrollers, ASICs, and FPGAs. These components are configured as hardware or software in the computing device.

The control unit 101 is connected to each component in the projection apparatus 100 via a control bus, and controls each component and performs various arithmetic processes necessary for the operation of the projection apparatus 100 .

The storage unit 102 is a storage device such as a RAM (Random Access Memory), SSD (Solid State Drive), HDD (Hard Disk Drive), or the like. The storage unit 102 stores various images and various information necessary for the operation of the projection device 100 .

The operation unit 103 is a reception unit that receives an operation (user operation) performed by the user on the projection device 100 . For example, the operation unit 103 includes operation devices such as buttons and a mouse, and their control circuits. The operation unit 103 transmits the operation performed by the user to the control unit 101, and the control unit 101 controls each component of the projection device 100 according to the transmitted operation. The operating device may or may not be detachable from the projection device 100 . The operation device may be a separate device from the projection device 100, such as a remote controller.

The communication unit 104 communicates (transmits and receives data) with an external device (external device) of the projection device 100 . For example, the communication unit 104 includes communication standard terminals such as USB (Universal Serial Bus) and LAN (Local Area Network), and processing circuits thereof. The communication unit 104 may be capable of wireless communication using a wireless LAN or the like.

The imaging control unit 111 controls the imaging unit 112 . For example, the imaging control unit 111 switches ON/OFF of the imaging unit 112, or instructs the imaging unit 112 to start imaging (imaging instruction).

The imaging unit 112 includes an imaging device such as an image sensor or an infrared sensor, and captures an image of an area including at least a projection surface (screen). Projecting device 100 projects an input image (an image input to projecting device 100) when the user indicates a position within the projection plane with an indicator such as an electronic pen.
can be projected onto the projection surface, and the graphic can be projected at a position corresponding to the position indicated by the pointer. The projection device 100 can also edit the graphics at the position corresponding to the indicated position in accordance with the instruction with the pointer. In the first embodiment, for such operation, the pointer is detected and distinguished (identified) from an image (sensor image) obtained by imaging. In the following description, "graphic" means a graphic with pointers.

The indicator discrimination unit 113 detects and discriminates (identifies) the indicator from the sensor image obtained by the imaging unit 112 . For example, when a plurality of indicators differ in light emission patterns, light emission wavelengths, etc., the indicator discrimination unit 113 detects sensor images based on differences in light emission patterns, light emission wavelengths, etc. among the indicators. Detect and discriminate the indicator from. In Example 1, the pointer discriminating unit 113 detects, from the sensor image, an area indicating the light emission pattern, the light emission wavelength, and the like of the pointer as the area of the pointer. Note that the pointer determination unit 113 may determine the pointer at the position detected by the position detection unit 114 without detecting the pointer. When the shapes of the indicators are different among a plurality of indicators, the indicator discrimination unit 113 may detect and discriminate the indicators by pattern matching using the shapes of the indicators.

In Example 1, the user causes the indicator to emit light when performing an operation (instruction) using the indicator. Then, as described above, the pointer discriminating unit 113 detects an area showing the light emission pattern, the light emission wavelength, and the like of the pointer in the sensor image as the area of the pointer. Therefore, in the first embodiment, the pointer identifying unit 113 detects and identifies the pointer when the projection surface is operated by the pointer. Therefore, the processing of the pointer discrimination unit 113 can be said to be part of the processing of detecting the operation by the pointer. In the first embodiment, the control unit 101 uses the pointer discrimination unit 113, the position detection unit 114, and the coordinate calculation unit 115 to detect the operation by the pointer (the position indicated by the pointer on the projection plane). The position is detected by the pointer discrimination unit 113 and the position detection unit 114). Note that the method of detecting the operation by the pointer is not particularly limited. For example, during operation by the pointer, the pointer may transmit predetermined information, and the communication unit 104 may receive predetermined information from the pointer. Then, the control unit 101 may determine whether or not the pointer has been operated, depending on whether the communication unit 104 has received predetermined information.

A position detection unit 114 detects the position of the pointer from the sensor image obtained by the imaging unit 112 . For example, the position detection unit 114 detects the position of the indicator by detecting a region indicating the light emission pattern or wavelength of the indicator, or by image analysis such as pattern matching using the shape of the indicator. If there are multiple indicators, the positions of the multiple indicators are detected. Note that the position detection unit 114 may detect the position of the pointer by a method other than image analysis. For example, a sensor such as a pressure sensor or an electrostatic sensor may be provided on the projection plane, and the communication unit 104 may acquire the output value of the sensor. Then, the position detection unit 114 may detect the position of the pointer based on the obtained output value.

The coordinate calculation unit 115 coordinate-transforms the position detected by the position detection unit 114 (the position of the pointer in the sensor image) into a position in the projection image (image projected onto the projection plane, for example, the input image). . In order to perform this coordinate conversion accurately, the control unit 101 performs coordinate conversion calibration. For example, the control unit 101 projects a specific projection image including a pattern at a predetermined position onto the projection plane from the projection unit 129 in order to perform calibration. Then, the control unit 101 uses the imaging unit 112 to acquire a sensor image in a state where a specific projection image is projected (displayed), and uses the position detection unit 114 to detect the position of the pattern in the sensor image. to detect. After that, the control unit 101 compares the position of the pattern in the sensor image with the position of the pattern in the specific projection image, and corrects the parameter of coordinate transformation (for example, transformation matrix) (calibration).

The graphics generation unit 116 generates graphics according to the operation by the indicator. In Example 1, the graphics generation unit 116 draws graphics on the drawing plane using the position (the position of the indicator within the projection image) obtained by the coordinate calculation unit 115 . The graphic generator 116 also generates an OSD (On Screen Display) such as a menu.

The graphic editing unit 117 edits graphics (graphics drawn on the drawing plane) according to the operation by the pointer. Graphic editing includes, for example, erasing, enlarging, reducing, and/or moving graphics. Enlarging and reducing a graphic can also be said to change the size of the graphic.

The image input unit 121 takes in an image (input image; image data) from outside the projection device 100 . The image input unit 121 includes an image input circuit compatible with image communication standards such as HDMI (High-Definition Multimedia Interface) (registered trademark), DisplayPort (registered trademark), and USB.

The image processing unit 122 performs image processing (enlargement/reduction processing, color gamut conversion processing, brightness correction processing, etc.) on the input image, and outputs the image after the image processing. An image (an image after image processing) output from the image processing unit 122 is assumed to be an acquired image. Note that the input image may be used as the acquired image without performing the image processing of the image processing unit 122 .

The image synthesizing unit 123 superimposes a drawing plane or OSD on the image output from the image processing unit 122 (for example, alpha synthesizing) to generate a synthesized image.

The image correction unit 124 corrects the composite image according to the state of the projection device 100 and the projection plane, and outputs the corrected image. The image correction unit 124 performs, for example, keystone correction processing for correcting the image shape so that the image appears rectangular when projected obliquely, picture shift processing for correcting the projection position, and the like.

The projection control section 125 controls the light modulation section 128 based on the image (image data) output from the image correction section 124 . For example, the projection control unit 125 converts the image data output from the image correction unit 124 according to the characteristics of the light modulation element (for example, liquid crystal element, mirror, etc.) included in the light modulation unit 128, and converts the image data after conversion. , the optical modulation unit 128 is controlled in accordance with . The projection control unit 125 can also change the state of the optical system (projection lens, etc.) of the projection unit 129 according to an instruction from the control unit 101 .

The light source control section 126 controls the light source section 127 . For example, the light source control unit 126 switches ON/OFF (lighting/extinguishing) of the light source unit 127 and changes the light emission brightness (light emission intensity; light emission amount) of the light source unit 127 .

The light source unit 127 emits light for projecting an image. The light source unit 127 includes light sources such as lamps, LEDs (Light Emitting Diodes), and lasers, and optical elements such as lenses and mirrors. The light source unit 127 irradiates the light modulating unit 128 with light. The light source unit 127 may include a plurality of light sources with different emission colors (for example, three light sources of a red light source, a green light source, and a blue light source), or may include one light source (for example, a white light source). The light source unit 127 may include a color wheel for changing (switching) the color of light emitted from the light source.

The light modulation section 128 modulates the light projected from the light source section 127 so that an image based on the image data output from the image correction section 124 is projected onto the projection plane. The method of the optical modulation unit 128 may be any of LCD (Liquid Crystal Display) method, LCOS (Liquid Crystal On Silicon) method, DLP (Digital Light Processing) (registered trademark) method, and the like. The light modulating section 128 includes a light modulating panel (a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Mirror Device), etc.), a lens, a mirror (including a prism), and the like. The light modulating section 128 may include a plurality of light modulating panels respectively corresponding to a plurality of colors (for example, three colors of red, green, and blue), or may include one light modulating panel.

The projection unit 129 includes a projection lens and outputs the light modulated by the light modulation unit 128 to the outside of the projection device 100 . The image is thereby projected onto the projection plane. When a graphic is generated by the pointer, the graphic and the input image (specifically, the acquired image) are projected together (together) on the projection plane.

Calibration for the coordinate calculator 115 will be described. If the graphic is projected at the position indicated by the pointer, the user can feel as if it were written by hand, which improves convenience. On the other hand, if the graphic is projected at a position deviated from the position indicated by the pointer, convenience may be impaired. Hereinafter, the deviation of the graphic from the position indicated by the indicator will be referred to as "graphic position deviation". Calibration is a process of correcting the correspondence between the detected position of the pointer and the projected position of the graphic so as to reduce the positional deviation of the graphic. The indicator detection position is the position at which the indicator (the position indicated by the indicator) is detected, and the graphic projection position is the position at which the graphic is projected.

The calibration described above is a process performed for one projection state of the input image, and a change in the projection state may cause a graphic position shift. For example, after starting to use a calibrated projection device, a user who finds it difficult to see the input image may change the settings of the projection device so that the input image is enlarged and projected, or the projection position of the input image is shifted. may change. Such a setting change can be easily made from the menu of the projection device, but when the setting change is executed, the projection state of the input image changes and the position of the graphic is shifted.

A conventional technique has been proposed in which when a user instructs execution of a process that causes a positional displacement of graphics, the process and calibration are always executed. However, since calibration is generally performed while projecting a plurality of images, calibration takes a relatively long time. During calibration, the user cannot normally use the projection device, such as viewing desired content or operating the projection device. Therefore, some users do not want to perform the specified processing if the specified processing causes the graphics to be displaced. Some users think so. However, even in the case of such users, according to the conventional technology, processing instructed by the user and calibration are executed. In other words, even if the user does not want it, the instructed processing and calibration are executed. In addition, execution of calibration that is not desired by the user unnecessarily prolongs the time during which the projection apparatus cannot be used normally.

Therefore, in the first embodiment, the user is made aware of the fact that the graphics will be misaligned before executing the processing that causes the graphics to be misaligned, by means of the processing described below. By doing so, convenience can be improved. For example, a user who does not want to perform an instructed process if it causes a positional deviation of graphics can instruct cancellation of the instructed process. A user who wants to accept the positional deviation of the graphics and perform the instructed processing but does not want to perform the calibration can not instruct the execution of the calibration. In other words, it is possible to suppress execution of processing that the user does not desire (instructed processing or calibration). By suppressing the execution of calibrations that are not desired by the user, it is possible to shorten the time during which normal use of the projection device is not possible (preventing unnecessary calibrations from preventing normal use of the projection device). can). It should be noted that a user who does not tolerate graphic positional deviation can use the projection apparatus 100 with the graphic positional deviation reduced by instructing execution of calibration.

FIG. 2 is a flowchart illustrating an example of menu processing according to the first embodiment. For example, when the user gives an instruction to start displaying a menu, the projection device 100 projects the menu onto the projection plane, and the processing in FIG. 2 starts. It is assumed that an input image has been input from the image input unit 121 into the projection device 100 at the start of the processing in FIG. In Example 1, the graphic generating unit 116 generates a menu according to an instruction from the control unit 101, and the image synthesizing unit 123 superimposes the menu on the input image. Also, when the pointer is not used, the projection device 100 can be used as a normal image projection device, but the operation mode of the projection device 100 is set to the pointer use mode (the operation mode in which the pointer is used). shall be Then, it is assumed that calibration for the coordinate calculation unit 115 (calibration for reducing positional deviation of the graphic; calibration of the correspondence relationship between the detected position of the pointer and the projected position of the graphic) has been executed. .

In step S<b>201 , the control unit 101 uses the operation unit 103 to determine whether or not a user operation (state change operation) instructing execution of processing (control) for changing the projection state of the input image has been performed. Execution of processing (control) for changing the projection state of the input image is instructed from the menu. When a state change operation has been performed, the operation unit 103 notifies the control unit 101 of the state change operation. Therefore, based on the notification from the operation unit 103, the control unit 101 can determine whether the state change operation has been performed. The control unit 101 waits until it determines that the state change operation has been performed, and when determining that the state change operation has been performed, the process proceeds to step S202.

In step S<b>202 , the control unit 101 determines whether or not the process (the process instructed by the user) corresponding to the state change operation performed in step S<b>201 causes the positional deviation of the graphics. In the first embodiment, the image processing unit 122, the image correction unit 124, the projection control unit 125, and the like perform processing (control) for changing the projection state of the input image in accordance with the state change operation. The determination in step S202 can also be said to be a determination as to whether or not the change in the projection state according to the state change operation in step S201 affects the correspondence relationship between the detected position of the pointer and the projected position of the graphic.

The determination in step S202 is performed using, for example, a positional deviation determination table. FIG. 3 is a schematic diagram illustrating an example of a positional deviation determination table according to the first embodiment; The positional deviation determination table in FIG. 3 indicates whether or not the positional deviation of graphics is caused for each process that the user can instruct from the menu. The positional deviation determination table is created in advance and recorded in the storage unit 102 . The control unit 101 reads out the positional displacement determination table from the storage unit 102 and uses it to determine whether or not the processing according to the state change operation in step S201 causes graphic positional displacement.

If the control unit 101 determines that the processing corresponding to the state change operation in step S201 causes the positional deviation of the graphics, the processing advances to step S204. Further, when the control unit 101 determines that the processing corresponding to the state change operation in step S201 does not cause the positional deviation of the graphic, the processing proceeds to step S203.

In step S203, the control unit 101 uses the image processing unit 122, the image correction unit 124, the projection control unit 125, and the like to execute processing according to the state change operation in step S201. Specifically, the control unit 101 instructs the image processing unit 122, the image correction unit 124, the projection control unit 125, etc. to change the settings in response to the state change operation in step S201. Then, the control unit 101 terminates the menu processing.

In step S204, the control unit 101 determines whether or not the operation mode of the projection device 100 is set to the warning display mode. The warning display mode is an operation mode in which a predetermined notification is given to the user when it is determined that the processing in response to the state change operation in step S201 causes a positional deviation of graphics. In the first embodiment, the predetermined notification to the user is assumed to be the display (projection) of predetermined information such as a warning, but the notification method is not particularly limited, and may be, for example, the output of sound or lighting/flashing of a lamp. good too. A setting value indicating whether the warning display mode is enabled or disabled is stored in the storage unit 102. The control unit 101 reads out the setting value of the warning display mode from the storage unit 102, and controls the projection apparatus 100 according to the setting value. is set to the warning display mode. The control unit 101 can change (switch) the set value of the warning display mode. In other words, the control unit 101 can set in advance whether or not to issue a predetermined notification when the processing in response to the state change operation in step S201 causes a positional deviation of graphics. For example, the control unit 101 changes the setting value of the warning display mode in accordance with a user's operation using a menu or the like.

When the control unit 101 determines that the operation mode of the projection device 100 is set to the warning display mode, the process proceeds to step S205. Further, when the control unit 101 determines that the operation mode of the projection device 100 is not set to the warning display mode, the processing proceeds to step S207.

In step S205, the control unit 101 gives a predetermined notification to the user. As described above, predetermined information such as a warning is displayed (projected) as a predetermined notification to the user. The predetermined notification is not particularly limited, but in the first embodiment, the predetermined notification includes a notification that calibration will be required again if the processing corresponding to the state change operation in step S201 is executed. Further, the predetermined notification includes an inquiry as to whether or not to execute the processing corresponding to the state change operation in step S201 (whether or not to change the projection state).

In step S<b>206 , the control unit 101 determines the user's selection result for the inquiry in step S<b>205 based on the notification from the operation unit 103 . If the control unit 101 determines that the user has selected to execute processing (change the projection state of the input image) according to the state change operation in step S201, the process proceeds to step S207. If the control unit 101 determines that the user has selected not to execute the process corresponding to the state change operation in step S201 (not to change the projection state of the input image), the control unit 101 ends the menu processing. In this case, neither processing corresponding to the state change operation nor calibration is performed.

In step S207, the control unit 101 uses the image processing unit 122, the image correction unit 124, the projection control unit 125, and the like to execute processing according to the state change operation in step S201. Specifically, the control unit 101 instructs the image processing unit 122, the image correction unit 124, the projection control unit 125, etc. to change the settings in response to the state change operation in step S201.

In step S208, the control unit 101 performs calibration for the coordinate calculation unit 115 (calibration for reducing positional deviation of the graphic; calibration of the correspondence relationship between the detected position of the pointer and the projected position of the graphic). Run.

It should be noted that the control unit 101 allows the user to determine whether or not to execute calibration when the user selects execution of processing (change of the projection state of the input image) according to the state change operation in response to the inquiry in step S205. You may contact Then, the control unit 101 may not execute calibration when the user does not select execution of calibration, and may execute calibration when the user selects execution of calibration.

In addition, the control unit 101 determines in advance whether or not to execute calibration when the user selects execution of processing (change of the projection state of the input image) according to the state change operation in response to the inquiry in step S205. It may be configurable. For example, a set value indicating whether or not to execute calibration is stored in the storage unit 102, and the control unit 101 changes the set value according to a user operation using a menu or the like. Then, in step S208, the control unit 101 does not execute calibration when the setting is made not to perform calibration, and executes calibration when the setting is made to perform calibration. good.

The positional deviation determination table of FIG. 3 will be described in more detail. As described above, the misregistration determination table in FIG. 3 indicates whether or not a misregistration of the graphics occurs for each process that the user can instruct from the menu. Specifically, the misregistration determination table in FIG. 3 indicates that optical zoom processing, optical shift processing, enlargement/reduction processing, keystone correction processing, and picture shift processing cause graphic misregistration. The misregistration determination table in FIG. 3 indicates that aspect ratio change processing, luminance correction processing, and color gamut conversion processing do not cause misregistration. Among the plurality of processes shown in FIG. 3, the optical zoom process and the optical shift process are performed by the projection control unit 125, and the remaining processes are performed by the image processing unit 122 or the image correction unit 124. FIG.

The optical zoom processing is processing for changing the state of the optical system (projection lens, etc.) of the projection unit 129 so that the size of the input image on the projection plane is changed. The optical shift process is a process of changing the state of the optical system of the projection unit 129 so that the position of the input image on the projection plane is changed. The enlargement/reduction process is a process for changing the size of the input image, the keystone correction process is a process for changing the shape of the input image, and the aspect ratio change process is a process for changing the aspect ratio of the input image. Picture shift processing is processing for changing the position of the input image, luminance correction processing is processing for changing the luminance of the input image, and color gamut conversion processing is processing for changing the color gamut of the input image. For example, the image processing unit 122 performs enlargement/reduction processing and keystone correction processing so that the size, position, shape, etc. of the input image are changed within the range of the panel surface (display surface) of the light modulation panel of the light modulation unit 128. , aspect ratio change processing, picture shift processing, and the like. By doing so, the size, position, shape, etc. of the input image on the projection plane are changed.

4A to 4D are schematic diagrams showing an example of display (projection) according to the first embodiment. Here, it is assumed that the operation mode of the projection device 100 is set to the warning display mode.

FIG. 4A shows the state before the menu is displayed. In FIG. 4A, a presentation material including a bar graph is displayed as an input image. Furthermore, the comment is displayed on the input image as a graphic drawn by the user using the pointer.

FIG. 4B shows a state in which the menu image is displayed. When the user instructs display of a menu using the operation unit 103 in the state shown in FIG. 4A, the state transitions to the state shown in FIG. 4B. As described above, the graphic generation unit 116 generates a menu, and the image synthesizing unit 123 overlays the menu on the input image.

The menu shown in FIG. 4B includes four main items: "image quality", "setting", "network", and "initialization". When the user selects any of the four main items, the sub-items corresponding to the selected main item are displayed. In FIG. 4B, the selected item is indicated by a thick line. In FIG. 4B, "setting" is selected, and sub-items corresponding to "setting" include "distortion correction", "zoom", "picture shift", "aspect ratio change", and "sound ” are displayed. In FIG. 4B, "picture shift" is selected. When the user selects and determines a sub-item in the state of FIG. 4B, the state transitions to a state in which preparations for processing corresponding to the sub-item are made. When the user performs an operation to close the menu, the state transitions (returns) to the state shown in FIG. 4(A).

FIG. 4C shows a state in which preparations are made for processing corresponding to sub-items determined by the user. Specifically, FIG. 4C shows a state in which the user selects and determines "picture shift" and the "picture shift" setting screen is displayed. In FIG. 4C, the black rectangular range indicates the current range (projection range) in which the input image is projected. The user can change the projection range (projection position) of the input image vertically and horizontally within the gray rectangular range by operating a four-way key (not shown) included in the operation unit 103 .

In the misregistration determination table of FIG. 3, "picture shift" (picture shift processing) is indicated as processing that causes graphic misregistration. Therefore, when the user changes and determines the projection position of the input image in the state of FIG. 4(C), the state transitions to the state of FIG. 4(D). If the user cancels the execution of the process or decides without changing the projection position of the input image, the state transitions (returns) to the state shown in FIG. 4B.

Here, consider a case where the operation mode of the projection device 100 is not set to the warning display mode. In that case, if the user changes and determines the projection position of the input image in the state of FIG. do.

Next, consider the case where the process corresponding to the user-determined sub-item is not a process that causes graphic misalignment. For example, consider a case where the sub-item determined by the user is "aspect ratio change" (aspect ratio change processing). In that case, when the user instructs the execution of the aspect ratio change processing, the aspect ratio change processing is executed, and then the state transitions to the state shown in FIG. 4(A). That is, it does not transition to the state of FIG. 4(D). Also, no calibration is performed.

FIG. 4D shows a state in which a predetermined notification is given to the user. In FIG. 4D, a message is displayed indicating that the calibration will be required again if the user instructed process (user picture shift process; user specified process) is executed. This message also indicates an inquiry as to whether or not to perform user-specified processing. Further, in FIG. 4(D), two buttons "Yes" and "No" are displayed for the user to answer this inquiry.

If the user selects "yes", the user-specified processing and calibration are executed in order, and then the state transitions to the state shown in FIG. 4(A). If the user selects "No", neither user-designated processing nor calibration is executed, and the state transitions to the state shown in FIG. 4(A) or 4(B).

It should be noted that if the user is aware that the graphic will be misaligned, there is a high possibility that the user will not use the indicator after the user designation process. Therefore, when the user selects "yes", the control unit 101 may cancel the setting of the pointer use mode and erase the graphics from the projection surface.

As described above, according to the first embodiment, when a user-specified process causes a positional deviation of graphics, a predetermined notification is sent to the user before executing the user-specified process. In other words, if a change in the projection state (projection state of the input image) according to the user's operation causes a positional deviation of the graphics, the user is notified before the projection state is changed. This makes it possible for the user to understand that the graphics will be misaligned. As a result, it is possible to suppress the execution of processing that the user does not desire (user-designated processing and calibration), thereby improving convenience. By suppressing the execution of calibrations that are not desired by the user, it is possible to shorten the time during which normal use of the projection device is not possible (preventing unnecessary calibrations from preventing normal use of the projection device). can). Further, since the predetermined notification is not performed before the execution of the process that does not cause the positional deviation of the graphics, it is possible to prevent the predetermined notification from interfering with the user's operation.

<Example 2>
A second embodiment of the present invention will be described below. In the following, points (configuration, processing, etc.) that differ from the first embodiment will be described in detail, and descriptions of points that are the same as the first embodiment will be omitted as appropriate. In Example 1, it was determined whether or not the positional deviation of graphics would occur according to the type of user-designated processing. In the second embodiment, the amount of change in the projection state of the input image is further taken into account to determine whether or not there will be a graphic position shift. Specifically, in step S202 of FIG. 2, the control unit 101 determines whether or not the amount of change in the projection state due to the user-designated process is equal to or greater than a first threshold value, and determines whether the user-designated process causes a graphic position shift. It is determined whether or not to bring about

FIG. 5 is a schematic diagram illustrating an example of a positional deviation determination table according to the second embodiment; The position deviation determination table in FIG. 5 shows the range of allowable change amount (change amount of input image projection state) for each process that the user can specify from the menu, and the range for not allowable position deviation of the graphic. and the range of the amount of change. For example, tolerating the positional deviation of graphics means that the positional deviation occurs only to the extent that it does not affect the operation by the pointer. Not allowing positional deviation of graphics means that a positional deviation that affects the operation by the pointer occurs. In FIG. 5, the range of scales that can be set by the user from the menu is shown as the range of the amount of change, and the minimum amount of change is one scale.

As an example, consider the case of picture shift processing. According to the positional deviation determination table of FIG. 5, when the amount of change in the projection state of the input image is within the range of ±1, that is, when the input image is shifted by one scale in either the up, down, left, or right direction, the graphic position Deviations are allowed. If the amount of change in the projection state is outside the range of ±1, that is, if the input image shifts in either the up, down, left, or right direction by two scales or more, the positional deviation of the graphic is not allowed. Therefore, in step S202 of FIG. 2, the control unit 101 determines that the user-designated processing does not cause graphic position deviation when the amount of change in the projection state is within the range of ±1. Then, the control unit 101 determines that the user-designated processing causes the positional deviation of the graphic when the change amount of the projection state is outside the range of ±1.

Next, consider the case of luminance correction processing. In this case, no matter how the amount of change in the projection state of the input image is set, the positional deviation of the graphics does not occur. Therefore, in the positional deviation determination table of FIG. 5, the entire range of the amount of change in the projection state is the range in which the positional deviation of the graphic is allowed. Then, in step S202 in FIG. 2, the control unit 101 determines that the user-designated processing does not cause the positional deviation of the graphics, regardless of the amount of change in the projection state.

When the user greatly changes the projection state of the input image, there is a high possibility that the projection scene (projection conditions) has changed significantly, such as a change in the installation location of the projection device 100 or a change in the projection destination (projection plane). And if the projection scene changes greatly, there is a high possibility that the graphics will not be necessary. Therefore, the control unit 101 may perform control to erase the graphics from the projection surface when the amount of change in the projection state by the user-specified process is equal to or greater than the second threshold, which is larger than the first threshold.

As described above, according to the second embodiment, the amount of change in the projection state of the input image is compared with the threshold value to determine whether or not the user-designated processing causes graphic position deviation. By doing so, it is possible to reduce the frequency with which predetermined notifications and calibration are performed, thereby further improving convenience.

<Example 3>
A second embodiment of the present invention will be described below. In the following, points (configuration, processing, etc.) that differ from the first embodiment will be described in detail, and descriptions of points that are the same as the first embodiment will be omitted as appropriate. In Example 1, it was determined whether or not the positional deviation of graphics would occur according to the type of user-designated processing. In the third embodiment, a plurality of processes are classified into a plurality of process groups, and a user-specified process determines the process groups to determine whether or not there will be a graphic position shift.

FIG. 6 is a schematic diagram of an example of a positional deviation determination table according to the third embodiment. The misregistration determination table in FIG. 6 indicates whether or not there will be a misregistration of graphics for each processing group. Specifically, the misregistration determination table in FIG. 6 indicates that optical processing and position/size processing result in graphic misregistration. The positional deviation determination table in FIG. 6 indicates that luminance/color processing, input processing, and communication processing do not cause positional deviation.

The optical processing is processing for changing the state of the optical system (projection lens, etc.) of the projection unit 129, and includes optical zoom processing, optical shift processing, and the like. The luminance/color processing is processing for changing at least one of luminance and color of an input image, such as luminance correction processing and color gamut conversion processing. Input processing is processing for selecting an input image. Position/size processing is processing for changing at least one of the size and position of an input image, such as enlargement/reduction processing and picture shift processing. Communication processing is processing for communicating with an external device.

In step S202 of FIG. 2, the control unit 101 determines the operation group to which the user-designated operation belongs. In other words, the control unit 101 determines whether or not the user-designated operation includes changing the state of the optical system, or whether or not the user-designated operation includes changing at least one of the size and position of the input image. . When the correspondence between processing groups and processes is predetermined, the control unit 101 can determine the processing group to which the user-specified process belongs based on the correspondence. The control unit 101 may determine the processing group to which the user-designated processing belongs based on the details (operations, etc.) of the user-designated processing, such as determining that processing using the projection unit 129 is optical processing.

Then, the control unit 101 determines whether or not the user-designated operation causes the positional deviation of the graphic based on the determined operation group and the positional deviation determination table of FIG. 6 . For example, an optical shift process is determined to be an optical process and is determined to result in graphic misalignment. Then, a predetermined notification is made to the user.

As described above, according to the third embodiment, it is managed for each processing group whether or not to cause a graphic position shift. Even with this configuration, the same effect as in the first embodiment can be obtained.

The above-described embodiments (including modifications) are merely examples, and configurations obtained by appropriately modifying or changing the above-described configurations within the scope of the gist of the present invention are also included in the present invention. . A configuration obtained by appropriately combining the configurations described above is also included in the present invention.

<Other Examples>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

100: projection device 101: control unit 103: operation unit 114: position detection unit 122: image processing unit 124: image correction unit 125: projection control unit 129: projection unit

Claims (16)

projection means for projecting an input image onto a projection plane;
receiving means for receiving user operations;
a processing unit that changes the projection state of the input image according to the user operation;
detection means for detecting a position indicated by the pointer on the projection plane;
control means for controlling the projection means to project the input image and to project a graphic at a position corresponding to the position detected by the detection means;
has
When the change in the projection state in accordance with the user operation affects the correspondence relationship between the detection position where the pointer is detected and the projection position where the graphic is projected, the control means controls the projection 1. A projection device that performs control such that a predetermined notification is given to a user before a state change. 2. The projection device according to claim 1, wherein said predetermined notification to said user is projection of predetermined information by said projection means. 3. The projection apparatus according to claim 1, wherein the predetermined notification includes a notification that calibration of correspondence between the detected position of the pointer and the projected position of the graphic is required. The control means determines whether or not to perform the predetermined notification when the change in the projection state according to the user operation affects the correspondence relationship between the detected position of the pointer and the projected position of the graphic. 4. The projection apparatus according to any one of claims 1 to 3, characterized in that it is possible to set . 5. The projection device according to any one of claims 1 to 4, wherein the predetermined notification includes an inquiry as to whether or not to change the projection state. The control means is characterized in that, when the user selects to change the projection state in response to the inquiry, the control means performs calibration of a correspondence relationship between the detected position of the pointer and the projected position of the graphic. 6. The projection device according to claim 5. 7. The projection according to claim 6, wherein said control means can set whether or not to execute said calibration when said user selects to change said projection state in response to said inquiry. Device. The control means determines whether or not to calibrate the correspondence relationship between the detected position of the pointer and the projected position of the graphic when the user selects to change the projection state in response to the inquiry. 6. The projection device according to claim 5, wherein the user is queried. 9. The control means according to any one of claims 5 to 8, wherein, when the user selects to change the projection state in response to the inquiry, the control means performs control so as to erase the graphic from the projection plane. 2. Projection device according to item 1. The control means determines whether or not the amount of change in the projection state according to the user operation is equal to or greater than a first threshold, and determines whether or not the change in the projection state corresponds to the detection position of the pointer and the projection of the graphic. 10. The projection apparatus according to any one of claims 1 to 9, wherein it is determined whether or not there is an influence on the correspondence relationship with the position. The control means controls to erase the graphic from the projection surface when the amount of change in the projection state according to the user operation is equal to or greater than a second threshold larger than the first threshold. 11. The projection device according to claim 10, characterized in that: The control means determines whether the change in the projection state according to the user operation includes a change in the state of the optical system of the projection means, and determines whether the change in the projection state includes a change in the state of the optical system of the projection means. 12. The projection device according to any one of claims 1 to 11, wherein it is determined whether or not there is an influence on the correspondence relationship between the position and the projection position of the graphic. The control means determines whether or not the change in the projection state according to the user operation includes a change in at least one of the size and position of the input image on the projection plane, and changes the projection state. 12. The projection apparatus according to any one of claims 1 to 11, wherein it is determined whether or not the change affects the correspondence relationship between the detected position of the pointer and the projected position of the graphic. controlling the input image to be projected onto the projection plane;
a step of accepting a user operation;
changing the projection state of the input image according to the user operation;
a step of detecting a position indicated by an indicator in the projection plane;
projecting the input image and controlling to project a graphic at a position corresponding to the position where the pointer is detected;
When changing the projection state according to the user operation affects the correspondence relationship between the detection position where the pointer is detected and the projection position where the graphic is projected, before changing the projection state A method of controlling a projection device, comprising: controlling to give a predetermined notification to a user. A program for causing a computer to function as each means of the projection apparatus according to any one of claims 1 to 13. A computer-readable storage medium storing a program for causing a computer to function as each means of the projection apparatus according to any one of claims 1 to 13.

Images