JP7439682B2 - Image correction method and projector - Google Patents

Description

The present invention relates to an image correction method and a projector.

2. Description of the Related Art Conventionally, it has been proposed that a projector project, on a projection surface, a projection image in which the shape of an input image is corrected. For example, Patent Document 1 discloses a system in which auxiliary lines are displayed on the user interface screen of a computer connected to a projector, and the user changes the shape of the auxiliary lines to correct the shape of the projected image. There is. This system reduces the area of the user interface screen and displays the protruding auxiliary line when the auxiliary line protrudes from the display range of the display.

Japanese Patent Application Publication No. 2004-320661

However, since conventional systems require the use of a computer, the shape of the input image cannot be corrected using only a projector. Also, here, if part of the input image is located outside the projection area, which is the largest area that the projector can project, the projector includes the entire image, including the auxiliary lines, in the projection area. Assume that the image including the reduced auxiliary line is projected onto the projection surface. According to this method, the shape of the image including the auxiliary lines is different before and after the reduction. Therefore, it is difficult to correct the input image into a desired shape according to the state of the projection surface.

An image correction method according to one aspect of the present invention is an image correction method performed by a projector, in which a first image including a plurality of candidate points, which are candidates for display position correction, is set to a maximum size that can be projected by the projector. projecting a second image reduced in size to a size included in a projection area, which is an area of Among them, accepting a first input for selecting a target point whose display position is to be corrected, and a third image obtained by enlarging the second image to the size of the first image after accepting the first input. projecting on the projection surface, receiving a second input for changing the display position of the target point while the third image is being projected on the projection surface, and based on the second input, , and projecting a projection image whose shape has been corrected from an input image onto the projection surface.

Further, a projector according to one aspect of the present invention is a projector, and includes a light source that emits light, a light modulation device that generates modulated light by modulating the light, and a lens that emits the modulated light. at least one processing device, the at least one processing device is configured to project a first image including a plurality of candidate points that are candidates for correcting display positions into an area of maximum size that can be projected by the projector. A second image reduced to a size such that the outer periphery of the first image is included in a projection area is projected onto the projection surface by controlling the light modulation device; receiving a first input for selecting a target point whose display position is to be corrected among the plurality of candidate points; projecting a third image enlarged to the size of the first image onto the projection surface by controlling the light modulation device; and in a state where the third image is projected onto the projection surface. , receiving a second input for changing the display position of the target point, and controlling the light modulation device to project a projected image with the shape of the input image corrected based on the second input, onto the projection surface. To project and to perform.

FIG. 1 is a diagram showing a display system 1. FIG. The figure which shows an example of input image IG. FIG. 1 is a diagram showing the configuration of a projector 10. The figure which shows an example of the grid|lattice image KG of an initial state. The figure which shows an example of the memory content of grid coordinate information KCI of an initial state. The figure which shows an example of the grid|lattice image KG after update. The figure which shows an example of the memory content of the grid coordinate information KCI after an update. FIG. 2 is a diagram showing an example of a projection device 16. FIG. FIG. 3 is a diagram showing the functions of the projector 10. The figure which shows an example of reduced grid image SKG. FIG. 7 is a diagram illustrating an example of specifying a grid point GP farthest from the outer periphery of the projection area PA and an example of calculating a reduction rate RR. The figure which shows the example of projection of the reduced grid image SKG. The figure which shows an example of adjustment image AG. The figure which shows the example of projection of adjustment image AG. The figure which shows an example of the several unit area UA included in the input image IG. The figure which shows an example of the several unit area|region UA after correction|amendment. 2 is a flowchart showing the operation of the projector 10. 2 is a flowchart showing the operation of the projector 10. The figure which shows the example of projection of adjustment image AG. The figure which shows the example of projection of projection image CG. The figure which shows the example of projection of the image which superimposed the reduced input image SIG on the reduced grid image SKG. The figure which shows the example of projection of the image which superimposed the auxiliary|assistant image HG in a 1st aspect on the adjustment image AG. The figure which shows the example of projection of the image which superimposed the auxiliary|assistant image HG in a 2nd aspect on the adjustment image AG. The figure which shows the example of generation of the reduced grid image information SKGI in a 5th modification. The figure which shows the example of projection of the reduced grid image SKG when the grid image KG is reduced according to reduction rate RR_j. The figure which shows the example of projection of the reduced lattice image SKG when the lattice image KG is reduced according to reduction rate RR_i. The figure which shows an example of the target point selection mode in a 6th modification. The figure which shows an example of the target point adjustment mode in a 6th modification.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. However, in each figure, the dimensions and scale of each part are appropriately different from the actual ones. Furthermore, since the embodiments described below are preferred specific examples of the present invention, various technically preferable limitations are attached thereto, but the scope of the present invention is limited to the present invention in particular in the following description. Unless otherwise specified, it is not limited to these forms.

1. First Embodiment A display system 1 according to this embodiment will be described.

1.1. Overview of Display System 1 FIG. 1 is a diagram showing the display system 1. As shown in FIG. Display system 1 includes an image providing device 4 and a projector 10. In this embodiment, a projector 10 will be described in which the shape of an image to be projected can be corrected by a user's operation using the projector 10 without using a screen of a computer.

The image providing device 4 provides the projector 10 with input image information IGI indicating the input image IG. The projector 10 performs geometric correction processing on the input image information IGI to generate projection image information CGI in which the shape of the input image IG is corrected, and projects the projection image CG indicated by the projection image information CGI onto the projection surface SC. do. The projected image information CGI is an example of "image information indicating a projected image." The image providing device 4 is a device that includes a communication device that outputs image information to the projector 10, such as a smartphone, a personal computer, or a USB (Universal Serial Bus) memory. Note that the projected image information CGI may be stored in the storage device 14 of the projector 10, and in that case, the image providing device 4 may not be provided.

The X-axis and Y-axis shown in FIG. 1 are orthogonal to each other. The X-axis and Y-axis are parallel to the projection surface SC. In the example of FIG. 1, of the two directions along the X-axis, the direction toward the right toward the projection surface SC is referred to as the +X direction, and the direction toward the left toward the projection surface SC is referred to as the −X direction. The +X direction and the -X direction may be collectively referred to as the vertical or vertical direction below. Similarly, of the two directions along the Y-axis, the downward direction in FIG. 1 is referred to as the +Y direction, and the upward direction in FIG. 1 is referred to as the -Y direction. The +Y direction and the -Y direction may be collectively referred to as horizontal in the following.

Geometric correction processing is processing for geometrically correcting the shape of an image. Image distortion can be corrected by performing geometric correction processing. There are two situations in which image distortion occurs: The first situation is when the projection surface SC is a curved surface or when the projection surface SC is uneven. The second situation is a case where the projector 10 projects from a position other than the front of the projection surface SC. Furthermore, the geometric correction process can also be used to not display parts of the input image IG that the user does not want to display. Using FIG. 2, an example of an input image IG having a portion that the user does not want to be displayed is shown.

FIG. 2 is an example of the input image IG. As shown in FIG. 2, the input image IG includes a display target image ITG that the user wants to display. Furthermore, the input image IG includes a band-shaped black image BG1 added to the top of the display target image ITG, and a band-shaped black image BG2 added to the bottom of the display target image ITG. Black image BG1 and black image BG2 are images that the user does not want to display. A state in which band-shaped black images are added at the top and bottom is sometimes called letterbox.

By executing the geometric correction process and correcting the shape of the input image IG so that only the display target image ITG is displayed within the projection area PA, the projector 10 displays the black image BG1 and the black image BG2 on the projection surface SC. may not be displayed. The projection area PA is the largest area that can be projected by the projector 10. The projection surface SC has a sufficiently large area compared to the projection area PA. The shape of the projection area PA is rectangular. However, the shape of the projection area PA is not limited to a rectangle, but may be a parallelogram, a circle, or the like.

1.2. Configuration of the projector 10 FIG. 3 is a diagram showing the configuration of the projector 10. The projector 10 includes at least one processing device 12 , a storage device 14 , an input device 15 , a projection device 16 , and a communication device 18 . Each element of projector 10 is interconnected by a bus 19 for communicating information.

The processing device 12 is a computer such as a CPU. CPU is an abbreviation for Central Processing Unit. Note that the processing device 12 may be configured by one or more processors.

The storage device 14 is composed of a magnetic storage device, a flash ROM (Read only memory), or the like. The storage device 14 is a recording medium readable by the processing device 12, and stores a plurality of programs including a control program executed by the processing device 12, grid image information KGI indicating the grid image KG, grid coordinate information KCI, and the processing device Stores various information used by 12. The grid image KG is an example of a "first image." The grid image KG includes a plurality of grid points GP. The plurality of grid points GP are candidates for a target point TP whose display position is to be corrected. The grid coordinate information KCI indicates the coordinates of each of a plurality of grid points GP included in the grid image KG. These coordinates are coordinates on the XY plane that includes the projection area PA. The shape of the grid image KG may be changed by a user's operation. The grid coordinate information KCI is updated in accordance with changes in the grid image KG. An example of the grid image KG in the initial state is shown using FIGS. 4 and 5, and an example of the grid image KG after updating is shown using FIGS. 6 and 7.

FIG. 4 is a diagram showing an example of a grid image KG in an initial state. The grid image KG includes a plurality of grid points GP. The grid point GP is an example of a "candidate point." The grid image KG shown in FIG. 4 includes line segments connecting adjacent grid points GP along the X-axis and the Y-axis. Note that the grid image KG does not need to include line segments connecting adjacent grid points GP. In the following description, it is assumed that the grid image KG includes grid points GP and line segments connecting adjacent grid points GP along the X-axis and the Y-axis. In FIG. 4, in order to avoid complication, only some of the plurality of grid points GP are shown with symbols. The size of the grid image KG in the initial state substantially matches the projection area PA. Grid point GP_0 included in grid image KG illustrated in FIG. 4 is located at the upper left vertex of grid image KG, and grid point GP_n-1 is located at the lower right vertex of grid image KG. In the following description, when distinguishing elements of the same type, reference numerals are used, such as grid point GP_0 and grid point GP_n-1. On the other hand, when elements of the same type are not distinguished, only common symbols among the reference symbols are used, such as grid point GP. n is an integer of 1 or more depending on the size of the projection area PA and the interval between adjacent grid points GP. In the following, an example will be described in which the number of pixels in the horizontal direction is 1280 and the number of pixels in the vertical direction is 800 in the projection area PA. For example, if the interval between adjacent grid points GP in the horizontal direction is 160 pixels, and the interval between adjacent grid points GP in the vertical direction is 100 pixels, the number of grid points GP arranged in the horizontal direction is (1280 pixels). ÷160)+1=9, and the number of grid points GP arranged in the vertical direction is (800÷100)+1=9. Therefore, n is 9×9=81.

FIG. 5 is a diagram illustrating an example of the storage contents of the grid coordinate information KCI in the initial state in the storage device 14. The lattice coordinate information KCI is information that associates lattice point identification information that identifies the lattice point GP with coordinate information that indicates the coordinates of the lattice point GP. The grid coordinate information KCI has n records. As shown in FIG. 5, record KCIR_0 indicates that the coordinates of grid point GP_0 are (0,0). Record KCIR_n-1 indicates that the coordinates of grid point GP_n-1 are (1279,799).

FIG. 6 is a diagram showing an example of the updated grid image KG. FIG. 6 shows a grid image KG after the positions of the grid points GP_i and GP_j have been updated with respect to the grid image KG in the initial state. Further, in FIG. 6, the projection area PA is indicated by a broken line in order to show the positional relationship between the updated grid image KG and the projection area PA. Actually, the grid image KG does not need to include a frame indicating the projection area PA. Grid point GP_i and grid point GP_j included in grid image KG illustrated in FIG. 6 are located outside the projection area PA. i and j are integers from 0 to n-1.

FIG. 7 is a diagram showing an example of the stored contents of the updated grid coordinate information KCI. Record KCIR_i shown in FIG. 7 indicates that the coordinates of grid point GP_i are (gp_ix, -40), and record KCIR_j indicates that the coordinates of grid point GP_j are (-160, gp_jy). gp_ix is an integer from 0 to 1279. gp_jy is an integer from 0 to 799. In this way, the grid point GP may be located outside the projection area PA.

The explanation returns to FIG. 3. The input device 15 is a device for a user to input information. The input device 15 is a plurality of buttons including, for example, a function list display key, an up key, a down key, a left key, a right key, an enter key, and a cancel key. Hereinafter, the up key, down key, left key, and right key will be collectively referred to as direction keys. Alternatively, the input device 15 may be composed of one or more types of devices such as a pointing device and a touch panel. Alternatively, the projector 10 may communicate with the aforementioned remote controller having a plurality of buttons instead of the input device 15. In the following description, the input device 15 will be described as a plurality of buttons including a function list display key, a direction key, an enter key, and a cancel key.

The projection device 16 projects the projection image CG onto the projection surface SC. The size of the projection image CG is the size included in the projection area PA. The configuration of the projection device 16 will be explained using FIG. 8.

FIG. 8 is a diagram showing an example of the projection device 16. The projection device 16 includes a light source 161, three liquid crystal light valves 162R, 162G, and 162B that are an example of a light modulation device, a lens 163 that is an example of a projection optical system, a light valve drive section 164, and the like. The projection device 16 generates modulated light by modulating the light emitted from the light source 161 with a liquid crystal light valve 162 under the control of the processing device 12, and enlarges and projects the projection image CG from a lens 163. The image is displayed on the projection surface SC.

The light source 161 includes a light source section 161a formed from a xenon lamp, an ultra-high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, or the like, and a reflector 161b that reduces variations in the direction of light emitted by the light source section 161a. include. The light emitted from the light source 161 has variations in brightness distribution reduced by an integrator optical system (not shown), and is then separated into color light components of red, green, and blue, which are the three primary colors of light, by a color separation optical system (not shown). be done. The red, green, and blue color light components enter liquid crystal light valves 162R, 162G, and 162B, respectively.

The liquid crystal light valve 162 is constituted by a liquid crystal panel or the like in which liquid crystal is sealed between a pair of transparent substrates. A rectangular pixel region 162a is formed in the liquid crystal light valve 162 and is made up of a plurality of pixels 162p arranged in a matrix. In the liquid crystal light valve 162, it is possible to apply a driving voltage to the liquid crystal for each pixel 162p. When the light valve drive section 164 applies a drive voltage according to the projection image information CGI to each pixel 162p, each pixel 162p is set to a light transmittance according to the projection image information CGI. Therefore, the light emitted from the light source 161 is modulated by passing through the pixel area 162a, and a projection image CG to be projected onto the projection surface SC is formed for each color light. The size of the projection area PA depends on the size of the pixel area 162a.

The explanation returns to FIG. 3. The communication device 18 is hardware having a communication circuit for communicating with the image providing device 4 or other devices such as a remote controller via a communication network. The communication device 18 is capable of, for example, wireless communication via Wi-Fi (registered trademark), Ethernet (registered trademark), IEEE1394, HDMI (registered trademark, HDMI: High-Definition Multimedia Interface), USB, infrared communication, Bluetooth ( It may also include a connector or antenna compatible with communication standards such as (registered trademark), and a communication circuit.

1.3. Functions of the projector 10 The processing device 12 functions as the determination section 121, the generation section 122, the control section 124, and the reception section 126 by reading a control program from the storage device 14 and executing the read control program.

The generation unit 122 generates image information. The generation unit 122 includes a first generation unit 1222 and a second generation unit 1224. The control unit 124 controls the liquid crystal light valve 162. The control unit 124 includes a first control unit 1242 and a second control unit 1244. The reception unit 126 receives user operations. The reception section 126 includes a first reception section 1262 and a second reception section 1264.

FIG. 9 is a diagram showing the functions of the projector 10. The projector 10 has two operation modes: a target point selection mode and a target point adjustment mode. The target point selection mode is a mode in which a target point TP whose display position is to be corrected is selected from among a plurality of grid points GP. The target point adjustment mode is a mode for changing the display position of the selected target point TP. Each of the target point selection mode and target point adjustment mode will be described below.

1.3.1. Target Point Selection Mode When the input device 15 receives an input indicating a request to perform geometric correction processing, the projector 10 transitions to the target point selection mode. As an input example for executing the geometric correction process, when the function list display key is pressed, the projector 10 displays a character string indicating each of a plurality of processes including the geometric correction process on the projection surface SC. The user selects a character string indicating the geometric correction process by operating the direction keys and the enter key. The user's selection of a character string indicating geometric correction processing corresponds to an input indicating a request to perform geometric correction processing.

When transitioning to the target point selection mode, the determination unit 121 determines whether there is a grid point GP located outside the projection area PA among the plurality of grid points GP included in the grid image KG. As a specific determination method, the determining unit 121 refers to the grid coordinate information KCI, sets the variable k to 0, and determines whether the grid point GP_k is located outside the projection area PA. k is an integer. In this embodiment, the determination unit 121 determines that the grid point GP_k is located within the projection area PA when the coordinates of the grid point GP_k satisfy the following conditions, and when the conditions are not satisfied, the determination unit 121 determines that the grid point GP_k is located within the projection area PA. It is determined that the location is not within the PA.

0≦gp_kx≦1279 and 0≦gp_ky≦799

However, gp_kx is the X coordinate value of grid point GP_k, and gp_ky is the Y coordinate value of grid point GP_k.

The determination unit 121 increases the variable k by 1 when the grid point GP_k is located within the projection area PA. After increasing the variable k by 1, the determining unit 121 determines whether the grid point GP_k is located outside the projection area PA if the variable k is less than n. After incrementing the variable k by 1, if the variable k matches n, the determining unit 121 determines that there is no grid point GP located outside the projection area PA.

On the other hand, when the grid point GP_k is located outside the projection area PA, the determination unit 121 determines that there is a grid point GP located outside the projection area PA. For example, when the lattice coordinate information KCI is in the state shown in FIG. 7, the determination unit 121 determines that the result is positive. Further, when the grid coordinate information KCI is in the state shown in FIG. 5, the determining unit 121 determines that the result is negative. Hereinafter, a case where the result of the determination by the determination unit 121 is affirmative and a case where the result of the determination by the determination unit 121 is negative will be described respectively.

1.3.1.1. When there is a grid point GP located outside the projection area PA When the determination unit 121 determines that there is a grid point GP located outside the projection area PA, the first generation unit 1222 converts the grid image KG into the projection area PA Reduced grid image information SKGI indicating a reduced grid image SKG reduced to a size included in is generated. The reduced grid image SKG is an example of a "second image". The reduced grid image information SKGI is an example of "image information indicating the second image." In the first embodiment, the first generation unit 1222 reduces the grid image KG while maintaining the aspect ratio of the grid image KG.

FIG. 10 is a diagram showing an example of a reduced grid image SKG. The reduced grid image SKG shown in FIG. 10 is an image obtained by reducing the grid image KG shown in FIG. 6. The reduced grid image SKG includes a plurality of grid points SGP. Furthermore, the reduced grid image SKG includes line segments connecting the grid points SGP. Furthermore, the reduced grid image SKG includes a selection cursor CUS used to select the target point TP. In FIG. 10, the projection area PA is indicated by a broken line to show the positional relationship between the reduced grid image SKG and the projection area PA. Actually, the reduced grid image SKG does not need to include a frame indicating the projection area PA. The selection cursor CUS shown in FIG. 10 is a frame surrounding one grid point SGP among the plurality of grid points SGP.

The plurality of lattice points SGP correspond to the plurality of lattice points GP on a one-to-one basis. For example, grid point SGP_0 corresponds to grid point GP_0, grid point SGP_i corresponds to grid point GP_i, grid point SGP_j corresponds to grid point GP_j, and grid point SGP_n-1 corresponds to grid point GP_n-1. In the example of FIG. 10, the selection cursor CUS is located on grid point SGP_j+1 located next to grid point SGP_j in the +X direction.

The first generation unit 1222 generates reduced grid image information SKGI indicating the reduced grid image SKG by reducing the grid image KG so that the grid points GP_j included in the grid image KG touch the outer periphery of the projection area PA. The lattice point GP_j is the lattice point GP farthest from the outer periphery of the projection area PA among the plurality of lattice points GP located on the outer periphery of the lattice image KG shown in FIG. Grid point GP_j is an example of a "second candidate point."

In order to generate the reduced grid image information SKGI, the first generation unit 1222 identifies the grid point GP that is farthest from the outer periphery of the projection area PA, calculates the reduction rate RR based on the identified grid point GP, and calculates the By reducing the grid image KG using the determined reduction ratio, reduced grid image information SKGI is generated.

Regarding the identification of the lattice point GP farthest from the outer periphery of the projection area PA, for example, the first generation unit 1222 determines, according to the position of each lattice point GP_m of the plurality of lattice points GP located on the outer periphery of the lattice image KG, It is specified which positional relationship each grid point GP_m has among the eight positional relationships with the projection area PA shown below. Then, the first generation unit 1222 calculates the distance D from each grid point GP_m to the outer periphery of the projection area PA using a calculation formula according to the specified positional relationship, and selects the grid point GP with the largest distance D from the projection area. It is specified as the grid point GP that is farthest from the outer periphery of the area PA. m is an integer from 0 to n-1.

The first positional relationship is such that the grid point GP_m is located in the −Y direction with respect to the projection area PA. When 0≦gp_mx≦1279 and gp_my<0 are satisfied, the grid point GP_m is in the first positional relationship with respect to the projection area PA. gp_mx is the X coordinate value of grid point GP_m. gp_my is the Y coordinate value of grid point GP_m. When the grid point GP_m is in the first positional relationship with the projection area PA, the first generation unit 1222 calculates -gp_my as the distance D.

The second positional relationship is such that the grid point GP_m is located in a direction between the -Y direction and the +X direction with respect to the projection area PA. When gp_mx>1279 and gp_my<0 are satisfied, grid point GP_m is in the second positional relationship with respect to projection area PA. When the grid point GP_m is in the second positional relationship with the projection area PA, the first generation unit 1222 calculates ((gp_mx−1279) ² +gp_my ² ) ^0.5 as the distance D.

The third positional relationship is such that the grid point GP_m is located in the +X direction with respect to the projection area PA. When gp_mx>1279 and 0≦gp_my≦799 are satisfied, grid point GP_m is in the third positional relationship with respect to projection area PA. When the grid point GP_m is in the third positional relationship with the projection area PA, the first generation unit 1222 calculates gp_mx−1279 as the distance D.

The fourth positional relationship is such that the grid point GP_m is located in a direction between the +Y direction and the +X direction with respect to the projection area PA. When gp_mx>1279 and gp_my>799 are satisfied, grid point GP_m is in the fourth positional relationship with respect to projection area PA. When the grid point GP_m is in the fourth positional relationship with the projection area PA, the first generation unit 1222 calculates ((gp_mx-1279) ² + (gp_my-799) ² ) ^0.5 as the distance D. .

The fifth positional relationship is such that the grid point GP_m is located in the +Y direction with respect to the projection area PA. When 0≦gp_mx≦1279 and gp_my>799 are satisfied, the grid point GP_m is in the fifth positional relationship with respect to the projection area PA. When the grid point GP_m is in the fifth positional relationship with the projection area PA, the first generation unit 1222 calculates gp_my−799 as the distance D.

The sixth positional relationship is a relationship in which the grid point GP_m is located in a direction between the +Y direction and the -X direction with respect to the projection area PA. When gp_mx<0 and gp_my>799 are satisfied, grid point GP_m is in the sixth positional relationship with respect to projection area PA. When the grid point GP_m is in the sixth positional relationship with the projection area PA, the first generation unit 1222 calculates (gp_mx ² +(gp_my−799) ² ) ^0.5 as the distance D.

The seventh positional relationship is such that the grid point GP_m is located in the −X direction with respect to the projection area PA. When gp_mx<0 and 0≦gp_my≦799 are satisfied, grid point GP_m is in the seventh positional relationship with respect to projection area PA. When the grid point GP_m is in the seventh positional relationship with the projection area PA, the first generation unit 1222 calculates -gp_mx as the distance D.

The eighth positional relationship is a relationship in which the grid point GP_m is located in a direction between the -Y direction and the -X direction with respect to the projection area PA. When gp_mx<0 and gp_my<0 are satisfied, grid point GP_m is in the eighth positional relationship with respect to projection area PA. When the grid point GP_m is in the eighth positional relationship with the projection area PA, the first generation unit 1222 calculates (gp_mx ² +gp_my ² ) ^0.5 as the distance D.

Regarding calculation of the reduction rate RR, the first generation unit 1222 calculates the reduction rate RR by, for example, executing equation (1) below.

However, the center of gravity G in equation (1) is the center of gravity of the projection area PA. The center of gravity refers to a point in a target shape where the sum of first moments becomes zero, and in the case of a rectangular shape, it refers to the intersection of diagonals. The intersection C is the intersection of the line segment connecting the grid point GP_m farthest from the outer periphery of the projection area PA and the center of gravity G of the projection area PA, and the outer periphery of the projection area PA. |G−GP_m| indicates the length of a line segment connecting the center of gravity G to the grid point GP_m farthest from the outer periphery of the projection area PA. |GC| indicates the length of the line segment connecting the center of gravity G and the intersection C.

Expression (1) is expressed as the coordinates of the grid point GP_m farthest from the outer periphery of the projection area PA (gp_mx, gp_my), the coordinates of the intersection C (pa_cx, pa_cy), and the coordinates of the center of gravity G (gx, gy). When expressed using , it can be transformed into equation (2).

A specific example of specifying the grid point GP farthest from the outer periphery of the projection area PA and a specific example of calculating the reduction ratio RR will be described using FIG. 11.

FIG. 11 is a diagram showing an example of specifying the grid point GP farthest from the outer periphery of the projection area PA and an example of calculating the reduction ratio RR. The grid points GP shown in FIG. 11 are a plurality of grid points GP located on the outer periphery of the grid image KG. To simplify the explanation, only lattice point GP_i and lattice point GP_j will be explained among the plurality of lattice points GP located on the outer periphery of lattice image KG. Grid point GP_i is in the first positional relationship among the eight positional relationships described above. Therefore, since the distance D_i of the grid point GP_i is -gp_my, referring to the grid coordinate information KCI shown in FIG. 7 , the distance D_i=-gp_my=-(-40)=40. On the other hand, grid point GP_j is in the seventh positional relationship. Since the distance D_j of the grid point GP_j is -gp_mx, referring to the grid coordinate information KCI shown in FIG. 7 , the distance D_j=-gp_mx=-(-160)=160. Therefore, since the distance D_j is larger than the distance D_i, the first generation unit 1222 specifies that the grid point GP farthest from the outer periphery of the projection area PA is the grid point GP_j. Next, the first generation unit 1222 calculates the reduction rate RR according to equation (2). FIG. 11 shows the center of gravity G of the projection area PA, the line segment L connecting the coordinates of the grid point GP_j and the center of gravity G of the projection area PA, and the intersection C with the outer periphery of the projection area PA.

The first generation unit 1222 generates reduced grid image information SKGI indicating the reduced grid image SKG by reducing the grid image KG according to the reduction rate RR.

The first control unit 1242 controls the liquid crystal light valve 162 so that the reduced grid image SKG is projected onto the projection surface SC. Specifically, the first control unit 1242 controls the liquid crystal light valve 162 to modulate the light emitted from the light source 161 according to the reduced grid image information SKGI. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the reduced grid image SKG onto the projection surface SC.

The first receiving unit 1262 receives an input for selecting a target point TP from among the plurality of grid points GP while the reduced grid image SKG is being projected onto the projection surface SC. The input for selecting the target point TP is an example of a "first input."

FIG. 12 is a diagram showing an example of projection of the reduced grid image SKG. The diagram shown in FIG. 12 shows a state in which the reduced grid image SKG shown in FIG. 10 is projected onto the projection surface SC. Furthermore, in FIG. 12, the projection area PA is indicated by a broken line to indicate the position of the projection area PA with respect to the projection surface SC. In the example of FIG. 12, the selection cursor CUS is located on the grid point SGP_j+1. For example, when the user presses the left key once, the selection cursor CUS moves to the grid point SGP_j located next to the grid point SGP_j+1 in the −X direction. The first receiving unit 1262 receives a press input of the enter key as an input for selecting the target point TP. When the enter key is input, the processing device 12 selects the grid point GP surrounded by the selection cursor CUS as the target point TP.

1.3.1.2. When there is no grid point GP located outside the projection area PA The explanation returns to FIG. 9. When the determination unit 121 determines that there is no grid point GP located outside the projection area PA, the first control unit 1242 projects the grid image KG onto the projection surface SC. Specifically, the first control unit 1242 controls the liquid crystal light valve 162 to modulate the light emitted from the light source 161 according to the grid image information KGI. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the grid image KG onto the projection surface SC.

The first receiving unit 1262 receives an input for selecting a target point TP from among the plurality of grid points GP while the grid image KG is being projected onto the projection surface SC.

1.3.2. Target Point Adjustment Mode When the first reception unit 1262 receives an input for selecting a target point TP, the projector 10 transitions to the target point adjustment mode. In the target point adjustment mode, the judgment result of the judgment unit 121 is positive and the reduced grid image SKG is projected on the projection surface SC, and the judgment result of the judgment unit 121 is negative and the grid image KG is projected on the projection surface SC. The operation is different depending on when the image is being projected. Each case will be explained.

1.3.2.1. When the reduced grid image SKG is projected on the projection surface SC When the reduced grid image SKG is projected on the projection surface SC and the transition is made to the target point adjustment mode, the second control unit 1244 controls whether the adjusted image AG is The liquid crystal light valve 162 is controlled so that the image is projected onto the surface SC. Adjusted image AG is an example of a "third image." As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the adjusted image AG onto the projection surface SC.

FIG. 13 is an example of the adjusted image AG. The adjusted image AG is an image obtained by enlarging the reduced grid image SKG to the size of the grid image KG. Specifically, the adjustment image AG includes an enlarged image of the reduced grid image SKG and a correction cursor CUC instead of the selection cursor CUS. The image obtained by enlarging the reduced grid image SKG has two aspects as shown below. The first aspect is an image obtained by actually enlarging the reduced grid image SKG. The second aspect is the grid image KG itself. Although either the first mode or the second mode may be used as long as the following processing is possible, the following description will be made assuming that the image obtained by enlarging the reduced grid image SKG is the first mode. The processing device 12 generates adjusted image information AGI indicating the adjusted image AG based on the reduced grid image information SKGI.

The correction cursor CUC is used to change the display position of the target point TP. The correction cursor CUC shown in FIG. 13 is composed of a frame surrounding the target point TP and four substantially equilateral triangles whose sides are adjacent to each other with respect to the four sides of this frame. In the example of FIG. 13, the correction cursor CUC is located on the grid point GP_j. That is, FIG. 13 shows a case where the grid point GP_j is the target point TP.

The adjusted image AG shown in FIG. 13 includes a portion located outside the projection area PA. Specifically, grid point GP_i, grid point GP_j, and correction cursor CUC are located outside the projection area PA.

The second receiving unit 1264 receives an input for changing the display position of the target point TP while the adjusted image AG is being projected onto the projection surface SC. The input that changes the display position of the target point TP is an example of a "second input."

FIG. 14 is an example of projection of the adjusted image AG. The diagram shown in FIG. 14 shows a state in which the adjusted image AG shown in FIG. 13 is projected onto the projection surface SC. Furthermore, in FIG. 14, the projection area PA is indicated by a broken line to indicate the position of the projection area PA with respect to the projection surface SC. Of the adjusted images AG, the images included in the projection area PA are projected onto the projection surface SC. Grid point GP_i, grid point GP_j, and correction cursor CUC are located outside the projection area PA and are therefore not displayed on the projection surface SC.

The second reception unit 1264 receives a user's input of pressing a direction key as an input for changing the display position of the target point TP. For example, when the second reception unit 1264 receives an input of pressing the up key once, the positions of the grid point GP_j and the correction cursor CUC move in the -Y direction. However, the lattice point GP_j and the correction cursor CUC after the movement are located outside the projection area PA, and therefore are not displayed on the projection surface SC. In the example of FIG. 14, the part of the image displayed in the projection area PA that is updated when the user presses the up key once is the line segment between grid point GP_j and grid point GP_j+1. After updating, the slope of this line segment changes.

The second generation unit 1224 generates projection image information CGI indicating a projection image CG with the shape of the input image IG corrected, based on an input for changing the display position of the target point TP. The processing of the second generation unit 1224 will be explained using FIGS. 15 and 16.

FIG. 15 is a diagram illustrating an example of a plurality of unit areas UA included in the input image IG. Grid point GP_a, grid point GP_a+1, grid point GP_a+2, grid point GP_b, grid point GP_b+1, grid point GP_b+2, grid point GP_c, grid point GP_c+1, and grid point GP_c+2 shown in FIG. 15 are unit area UA1, unit area UA2. , located at the apex of each of unit area UA3 and unit area UA4. a, b, and c are integers from 0 to n-2. Further, a grid point GP_b is located next to the grid point GP_a in the +Y direction, and a grid point GP_c is located next to the grid point GP_b in the +Y direction. Unit area UA1, unit area UA2, unit area UA3, and unit area UA4 are part of input image IG. As shown in FIG. 15, each unit area UA before correction has a rectangular shape.

FIG. 16 is a diagram illustrating an example of a plurality of unit areas UA after correction. FIG. 16 shows a state in which the shapes of a plurality of unit areas UA have already been deformed. Specifically, in FIG. 16, lattice point GP_b+1 moves in the -Y direction, and unit area UA1, unit area UA2, unit area UA3, and unit area UA4 are deformed. The second generation unit 1224 generates image information indicating an image obtained by correcting the image in the unit area UA before transformation so that it fits in the unit area UA after transformation. Further, the second generation unit 1224 generates projection image information CGI indicating the projection image CG by deleting a portion located outside the projection area PA from the image corrected to fit within the transformed unit area UA. generate.

Furthermore, the second generation unit 1224 updates the grid image information KGI and the grid coordinate information KCI based on the changed display position of the target point TP. After generating the projection image information CGI, the projector 10 ends the geometric correction process. After the geometric correction process is completed, the control unit 124 controls the liquid crystal light valve 162 so that the projection image CG is projected onto the projection surface SC. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the geometrically corrected projection image CG onto the projection surface SC.

1.3.2.2. When the grid image KG is being projected onto the projection surface SC When the transition to the target point adjustment mode is made while the grid image KG is being projected onto the projection surface SC, the second control unit 1244 controls whether the adjustment image AG is on the projection surface SC. The liquid crystal light valve 162 is controlled so that the image is projected onto the screen. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the adjusted image AG onto the projection surface SC. The second receiving unit 1264 receives an input for changing the display position of the target point TP while the adjusted image AG is being projected onto the projection surface SC.

The second generation unit 1224 generates projection image information CGI indicating a projection image CG with the shape of the input image IG corrected, based on the changed display position of the target point TP. Furthermore, the second generation unit 1224 updates the grid image information KGI and the grid coordinate information KCI based on the changed display position of the target point TP. After generating the projection image information CGI, the projector 10 ends the geometric correction process. After the geometric correction process is completed, the control unit 124 controls the liquid crystal light valve 162 so that the projection image CG is projected onto the projection surface SC. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the projection image CG onto the projection surface SC.

1.4. Operation of the projector 10 The operation of the projector 10 will be explained using FIGS. 17 and 18.

17 and 18 are flowcharts showing the operation of the projector 10. In step S1, the processing device 12 receives an input indicating a request to perform geometric correction processing. If this input is accepted, the projector 10 transitions to target point selection mode. After transitioning to the target point selection mode, the processing device 12 determines in step S3 whether or not there is a grid point GP located outside the projection area PA among the plurality of grid points GP included in the grid image KG. . The process in step S3 corresponds to the determination unit 121.

When the result of the determination in step S3 is affirmative, that is, in the case of Yes in step S3, the processing device 12 generates reduced grid image information SKGI indicating the reduced grid image SKG including the selection cursor CUS in step S5. . The process in step S5 corresponds to the first generation unit 1222. After the process in step S5 is completed, the processing device 12 controls the liquid crystal light valve 162 in the process in step S7 so that the reduced grid image SKG is projected onto the projection surface SC based on the reduced grid image information SKGI. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the reduced grid image SKG onto the projection surface SC.

On the other hand, if the result of the determination in step S3 is negative, that is, in the case of No in step S3, the processing device 12 causes the grid image KG including the selection cursor CUS to be projected onto the projection surface SC in step S9. Then, the liquid crystal light valve 162 is controlled. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the grid image KG onto the projection surface SC. The process in step S7 and the process in step S9 correspond to the first control unit 1242.

After completing the processing in step S7 or after completing the processing in step S9, the processing device 12 waits for an input by a user operation in step S11. In step S13, the processing device 12 determines whether a direction key press input by the user is received as an input by the user's operation. If it is determined that the user's press input of the direction key has been received, that is, if Step S13 is Yes, the processing device 12 moves the selection cursor CUS in accordance with the press input of the direction key in Step S15. After completing the process in step S15, the processing device 12 returns the process to step S11.

If it is determined that the user's press input of the direction key has not been accepted, that is, if step S13 is No, the processing device 12 determines in step S17 whether or not the press input of the enter key has been accepted. If the press input of the enter key is not received, that is, if step S17 is No, for example, if the press input of a key other than the enter key and the direction key is accepted, the processing device 12 returns the process to step S11. . A case where step S17 is Yes corresponds to the first reception unit 1262.

If it is determined that the press input of the enter key has been received, that is, if Step S17 is Yes, the projector 10 transitions to the target point adjustment mode, and in Step S21, the processing device 12 displays the reduced grid image SKG on the projection surface SC. is being projected. If it is determined that the reduced grid image SKG is being projected onto the projection surface SC, that is, if step S21 is Yes, the processing device 12 enlarges the reduced grid image SKG to the size of the grid image KG in step S23. Then, an adjusted image AG is generated. After completing the process in step S23, the processing device 12 controls the liquid crystal light valve 162 in step S25 so that the adjusted image AG is projected onto the projection surface SC. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the adjusted image AG onto the projection surface SC.

If it is determined that the reduced grid image SKG is not projected on the projection surface SC, that is, if step S21 is No, then in step S27, the processing device 12 creates an adjusted image AG in which the correction cursor CUC is superimposed on the grid image KG. The liquid crystal light valve 162 is controlled so that the image is projected onto the projection surface SC. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the adjusted image AG onto the projection surface SC. The process in step S25 and the process in step S27 correspond to the second control unit 1244.

After completing the processing in step S25 or after completing the processing in step S27, the processing device 12 waits for an input by a user operation in step S29. In step S31, the processing device 12 determines whether or not a direction key press input is received as an input by a user's operation. If it is determined that the direction key press input has been received, that is, if step S31 is Yes, the processing device 12 moves the correction cursor CUC and the position of the target point TP in step S33 according to the direction key press input. change. After completing the process in step S33, the processing device 12 generates projection image information CGI obtained by correcting the input image IG in accordance with the changed position of the target point TP in step S35. The process in step S35 corresponds to the second generation unit 1224. After completing the process in step S35, the processing device 12 returns the process to step S29.

If it is determined that the press input of the direction key has not been accepted, that is, if step S31 is No, the processing device 12 determines in step S37 whether or not the press input of the enter key has been received. If it is determined that the press input of the enter key has been received, that is, if step S37 is No, for example, if the press input of a key other than the enter key and the direction key has been received, the processing device 12 returns the process to step S29. return.

If it is determined that the press input of the enter key has been received, that is, if Step S37 is Yes, then in Step S39, the processing device 12 projects a character string inquiring whether all corrections have been completed onto the projection surface SC. . For example, a character string that asks whether all corrections have been completed is ``If all corrections have been completed, press the OK key, and if there are still parts to be corrected, press the Cancel key.'' be. In step S41, the processing device 12 waits for an input by a user's operation. In step S43, the processing device 12 determines whether or not a press input of the enter key has been received. If it is determined that the enter key press input is not accepted, that is, if step S43 is No, specifically, if the cancel key is pressed, the process returns to step S3.

If it is determined that the pressing input of the enter key has been received, that is, if Step S43 is Yes, then in Step S45, the processing device 12 causes the projection image CG indicated by the projection image information CGI to be projected onto the projection surface SC. , controls the liquid crystal light valve 162. As a result of controlling the liquid crystal light valve 162, the projection device 16 projects the projection image CG onto the projection surface SC. After completing the process in step S45, the processing device 12 ends the series of processes shown in FIGS. 17 and 18.

1.5. Summary of the First Embodiment As described above, the projector 10 projects the projection image CG, which has the shape of the input image IG corrected, onto the projection surface SC. The processing device 12 included in the projector 10 includes a first generation section 1222, a first control section 1242, a first reception section 1262, a second control section 1244, a second reception section 1264, and a second generation section 1224. Function. The first generation unit 1222 converts a grid image KG including a plurality of grid points GP, which are candidates for correcting the display position, into a size included in a projection area PA, which is the largest area that can be projected by the projector 10. Reduced grid image information SKGI indicating the reduced reduced grid image SKG is generated. The grid point GP is an example of a "candidate point." The grid image KG is an example of a "first image." The reduced grid image SKG is an example of a "second image". The reduced grid image information SKGI is an example of "image information indicating the second image." The first control unit 1242 controls the liquid crystal light valve 162 to project the reduced grid image SKG onto the projection surface SC. The first receiving unit 1262 receives an input for selecting a target point TP whose display position is to be corrected from among the plurality of grid points GP while the reduced grid image SKG is being projected onto the projection surface SC. The input for selecting the target point TP is an example of a "first input." After receiving the input to select the target point TP, the second control unit 1244 controls the liquid crystal light valve 162 to project an adjusted image AG obtained by enlarging the reduced grid image SKG to the size of the grid image KG on the projection surface SC. Project. Adjusted image AG is an example of a "third image." The second receiving unit 1264 receives an input for changing the display position of the target point TP while the adjusted image AG is being projected onto the projection surface SC. The input that changes the display position of the target point TP is an example of a "second input." The second generation unit 1224 generates projection image information CGI indicating a projection image CG with the shape of the input image IG corrected, based on the changed display position of the target point TP. The projected image information CGI is an example of "image information indicating a projected image." The control unit 124 controls the liquid crystal light valve 162 to project the projection image CG onto the projection surface SC.

According to the first embodiment, when selecting the target point TP, the reduced grid image SKG is projected onto the projection surface SC, so the user can select the grid point GP, which would normally be located outside the projection area PA. Easy to choose. However, if the coordinates of the target point TP are changed while the reduced grid image SKG is projected, the reduced grid image SKG and the grid image KG actually used for correction have different shapes, so the user must It is difficult to correct the input image IG into a desired shape. For example, if the surface of a three-dimensional object is the projection plane SC, even if the reduced grid image SKG is projected onto the three-dimensional object and the display position of the target point TP is changed, the reduced grid image SKG will have a different size from the grid image KG. Therefore, the input image IG cannot be corrected to match the shape of the three-dimensional object. Therefore, in the first embodiment, since the display position of the target point TP is changed while the adjustment image AG is being projected, the display position of the target point TP is changed while maintaining the shape of the grid image KG actually used for correction. This makes it easy for the user to correct the input image IG into a desired shape. The projector 10 can both confirm the overall shape of the grid image KG and match the shape of the input image IG by changing the display position of the target point TP, without being connected to a computer having a screen.

In the input image IG shown in FIG. 2, when the black image BG1 and the black image BG2 are not displayed, an example of projection of the adjusted image AG updated by the user is shown in FIG. FIG. 20 shows a projection example of the projection image CG indicated by the projection image information CGI generated based on the projection image information CGI.

FIG. 19 is a diagram showing an example of projection of the adjusted image AG. In order to prevent the black image BG1 and the black image BG2 from being displayed, the user moves the display position of the lattice point GP group located furthest in the +Y direction in the adjusted image AG in the +Y direction so that it is outside the projection area PA. Adjust accordingly. Similarly, the user moves the display position of the group of lattice points GP located in the -Y direction in the adjusted image AG in the -Y direction and adjusts it so that it is outside the projection area PA.

FIG. 20 is a diagram showing an example of projection of the projection image CG. The second generation unit 1224 generates projection image information CGI based on the adjusted image AG shown in FIG. 19. Since the black image BG1 and the black image BG2 are located outside the projection area PA, the black image BG1 and the black image BG2 are not displayed on the projection surface SC. On the projection surface SC, an image is displayed in which the lower part of the display target image ITG is stretched in the +Y direction, and the upper part of the display target image ITG is stretched in the −Y direction.

Furthermore, projecting the reduced grid image SKG onto the projection surface SC includes reducing the grid image KG so that the first grid point among the plurality of grid points GP touches the outer periphery of the projection area PA. The first lattice point is a lattice point among the plurality of lattice points GP that is located on the outer periphery of the lattice image KG and is farthest from the outer periphery of the projection area PA. The first grid point is an example of a "second candidate point."

By projecting the reduced grid image SKG obtained by reducing the grid image KG so that the first grid point is in contact with the outer periphery of the projection area PA onto the projection surface SC, the grid point that is not further away than the first grid point is Compared to a mode in which a reduced grid image SKG obtained by reducing the grid image KG so that it touches the outer periphery of the projection area PA, more grid points SGP tend to be displayed on the projection surface SC. . Therefore, the user can easily select more grid points GP.

2. Modifications Each of the above embodiments can be modified in various ways. Specific modes of modification are illustrated below. Two or more aspects arbitrarily selected from the following examples may be combined as appropriate within the scope of not contradicting each other. In addition, in the modified examples illustrated below, the reference numerals referred to in the above description will be used for elements whose operations and functions are equivalent to those in the embodiment, and detailed descriptions of each will be omitted as appropriate.

2.1. First Modified Example In the first embodiment, when the determination result of the determination unit 121 is negative, the projection device 16 projects the adjusted image AG onto the projection surface SC, but the present invention is not limited to this. For example, if the result of the determination by the determination unit 121 is negative, the grid image KG may be projected. In other words, the projector 10 does not need to display the correction cursor CUC. In order to indicate the target point TP, for example, the projection device 16 projects a grid image KG in which the color of the target point TP and the color of grid points GP other than the target point are different from each other. Similarly, the projector 10 does not have to display the selection cursor CUS. For example, the projection device 16 displays a grid image KG in which the color of the currently selected grid point GP is different from the color of grid points other than the currently selected grid point GP among the plurality of grid points GP. Project.

As described above, the processing device 12 included in the projector 10 in the first modification includes the determination section 121, the first generation section 1222, the first control section 1242, the first reception section 1262, the second reception section 1264, and the first generation section 1222. 2 generation section 1224. The determination unit 121 determines whether there is a grid point GP located outside the projection area PA among the plurality of grid points GP included in the grid image KG. If the result of the determination by the determination unit 121 is positive, the first generation unit 1222 generates reduced grid image information SKGI indicating the reduced grid image SKG. When the determination unit 121 determines that there is no grid point GP located outside the projection area PA, the first control unit 1242 projects the grid image KG onto the projection surface SC. The first receiving unit 1262 receives an input for selecting a target point TP from among the plurality of grid points GP while the grid image KG is being projected onto the projection surface SC. The second receiving unit 1264 receives an input for changing the display position of the target point TP while the grid image KG is being projected onto the projection surface SC. The second generation unit 1224 generates projection image information CGI indicating a projection image CG with the shape of the input image IG corrected, based on an input for changing the display position of the target point TP. The control unit 124 projects the projection image CG onto the projection surface SC.

According to the first modification, since the grid image KG is projected when there is no grid point GP located outside the projection area PA, the target point TP is projected with the shape of the grid image KG actually used for correction. You can choose.

2.2. Second Modified Example In each aspect described above, the processing device 12 generates a reduced input image SIG by reducing the input image IG according to the size of the reduced grid image SKG with respect to the size of the grid image KG, and converts the input image IG into a reduced input image SIG. The liquid crystal light valve 162 may be controlled to project an image on which the reduced input image SIG is superimposed. The reduced input image SIG is an example of a "fourth image". The first lattice points in this modification may be the same as or different from the first lattice points in other embodiments and modifications. The "first lattice point" in the second modification is an example of the "first candidate point."

In the second modification, when the grid image KG is superimposed on the input image IG, the relationship between the position of the first portion of the input image IG and the position of the first grid point among the plurality of grid points GP, and the first The position of the portion of the reduced input image SIG corresponding to the portion and the position of the first lattice point in the reduced lattice image SKG match. The first portion is an arbitrary portion within the input image IG.

FIG. 21 is a diagram showing an example of projection of an image in which the reduced input image SIG is superimposed on the reduced grid image SKG. According to the second modification, the user can select the target point TP whose display position is to be corrected while viewing the reduced input image SIG. In addition, since the reduced grid image SKG and the reduced input image SIG are reduced at the same reduction rate, the relationship between the position of the grid point GP included in the grid image KG and the position of a part of the input image IG is This matches the relationship between the position of the grid point SGP included in the grid image SKG and the position of a portion of the reduced input image SIG. For example, a portion of the reduced input image SIG corresponding to a portion of the input image IG that overlaps with a grid point SGP_j included in the grid image KG overlaps with a grid point SGP_j included in the reduced grid image SKG. Therefore, according to the second modification, compared to the mode in which the input image IG is superimposed on the reduced grid image SKG, the user can easily find the grid point GP corresponding to the position where the user wants to change the shape of the input image IG. can be specified.

2.3. Third Modified Example In each of the above-described aspects, the processing device 12 may control the liquid crystal light valve 162 to project an image in which the input image IG is superimposed on the adjustment image AG.

2.4. Fourth Modified Example In each aspect described above, the processing device 12 controls the liquid crystal light valve so as to project an image in which an auxiliary image HG that assists input to change the display position of the target point TP is superimposed on the adjustment image AG. 162 may be controlled. The auxiliary image HG has, for example, the following two aspects.

FIG. 22 is a diagram showing an example of projection of an image in which the auxiliary image HG in the first aspect is superimposed on the adjusted image AG. The auxiliary image HG in the first aspect is an image including a correction cursor CUC and a target point TP located outside the projection area PA. The auxiliary image HG shown in FIG. 22 shows an example in which the target point TP is a grid point GP_j. The position at which the auxiliary image HG is superimposed in the first aspect may be any part within the projection area PA, but it is preferable that the correction cursor CUC be away from the original position. Upon receiving the direction key press input, the processing device 12 changes the positions of the grid point GP_j and the correction cursor CUC, and updates the auxiliary image HG.

In the first embodiment, when the target point TP is outside the projection area PA, even if the user presses the direction key, the image within the projection area PA may not change; You may be worried whether you were able to press the button. By superimposing the auxiliary image HG in the first aspect on the adjustment image AG, even if the target point TP is outside the projection area PA, the auxiliary image HG in the first aspect is updated when the direction key is pressed. The user can confirm that the arrow key was actually pressed. Furthermore, by viewing the auxiliary image HG in the first mode, the user can confirm that the display position of the target point TP has been changed. In addition, if the auxiliary image HG is displayed at a position away from the original position of the correction cursor CUC, the part of the adjustment image AG near the correction cursor CUC will be displayed on the projection surface SC, so the user can press the direction key. It is easy to check the change in the shape of the adjusted image AG when the adjustment is made.

FIG. 23 is a diagram showing an example of projection of an image in which the auxiliary image HG in the second aspect is superimposed on the adjusted image AG. The auxiliary image HG in the second aspect is an image showing the direction key pressed by the user. The auxiliary image HG shown in FIG. 23 is an arrow pointing in the -X direction, indicating that the up key has been pressed. The position at which the auxiliary image HG is superimposed in the second aspect may be any part within the projection area PA, but it is preferably closer to the original position of the correction cursor CUC. Upon receiving the direction key press input, the processing device 12 changes the positions of the grid point GP_j and the correction cursor CUC, and superimposes the auxiliary image HG indicating the pressed direction key on the adjustment image AG. After superimposing the auxiliary image HG on the adjustment image AG, the processing device 12 stops superimposing the auxiliary image HG after a predetermined number of seconds have elapsed.

By superimposing the auxiliary image HG in the second mode on the adjustment image AG, even if the target point TP is outside the projection area PA, the auxiliary image HG in the second mode is displayed when the direction key is pressed. The user can confirm that the arrow key was actually pressed.

2.5. Fifth Modified Example In each aspect described above, the first generation unit 1222 calculates the distance D from each grid point GP_m of the plurality of grid points GP located on the outer periphery of the grid image KG to the outer periphery of the projection area PA, Although the reduction ratio RR is calculated by specifying the grid point GP with the largest distance D as the grid point GP farthest from the outer periphery of the projection area PA, the present invention is not limited thereto. For example, the first generation unit 1222 calculates the reduction rate RR for each grid point GP_m of the plurality of grid points GP located on the outer periphery of the grid image KG, and reduces the grid image KG according to the smallest reduction rate RR. By doing so, reduced grid image information SKGI indicating the reduced grid image SKG may be generated.

FIG. 24 is a diagram showing an example of generation of reduced grid image information SKGI in the fifth modification. To simplify the explanation, in FIG. 24, only the grid points GP_i and GP_j will be described among the plurality of grid points GP located on the outer periphery of the grid image KG. Furthermore, to simplify the explanation, the coordinate values of the center of gravity G are (600, 400), the coordinate values of the grid point GP_i are (600, 0), and the coordinate values of the grid point GP_j are (-40, 400). That is, the description will be made assuming that the distance D_i from the lattice point GP_i to the outer periphery of the projection area PA and the distance D_j from the lattice point GP_j to the outer periphery of the projection area PA are the same value, which is 40.

Further, an intersection C_i shown in FIG. 24 is an intersection between a line segment L_i connecting the grid point GP_i and the center of gravity G of the projection area PA and the outer periphery of the projection area PA. The coordinate value of the intersection C_i is (600,0). Similarly, an intersection C_j shown in FIG. 24 is an intersection between a line segment L_j connecting the grid point GP_j and the center of gravity G of the projection area PA and the outer periphery of the projection area PA. The coordinate value of the intersection C_j is (0,400). The reduction rate RR_i of the lattice point GP_i is determined from the equation (1) as shown in the following equation (3).

Similarly, the reduction rate RR_j of the lattice point GP_j is determined by the equation (1) as shown in the following equation (4). Note that in the fifth modification, grid point GP_i is an example of a "first candidate point." Line segment L_i is an example of a "first line segment." The reduction rate RR_i is an example of a "first ratio." Grid point GP_j is an example of a "second candidate point." Line segment L_j is an example of a "second line segment." The reduction rate RR_j is an example of a "second ratio."

To simplify the explanation, the magnitude relationship between the reduction rate RR_i and the reduction rate RR_j will be explained using specific numerical values. Assuming that |G-GP_i| in equation (3) is 440 and |GC_i| is 400, the reduction rate RR_i is approximately 0.90. Similarly, if |G−GP_j| in equation (4) is 680 and |GC_j| is 640, the reduction rate RR_j is calculated to be approximately 0.94. Therefore, the first generation unit 1222 specifies that the reduction rate RR_i is smaller than the reduction rate RR_j. The first generation unit 1222 generates reduced grid image information SKGI indicating the reduced grid image SKG by reducing the grid image KG according to the reduction rate RR_i. Note that in the above explanation, the comparison was made using specific numerical values, but if the width of the projection area PA in the horizontal direction is longer than the width of the projection area PA in the vertical direction, the reduction rate RR_i will be the same as the reduction rate RR_j. smaller in comparison.

Note that in the above description, the first generation unit 1222 specifies the magnitude relationship between the reduction rate RR_i and the reduction rate RR_j, but it does not specify the magnitude relationship between the square value of the reduction rate RR_i and the square value of the reduction rate RR_j. It's okay. Since the reduction rate RR_i and the reduction rate RR_j are positive values, the magnitude relationship between the reduction rate RR_i and the reduction rate RR_j is the same as the magnitude relationship between the square value of the reduction rate RR_i and the square value of the reduction rate RR_j. This is because there is. The first generation unit 1222 specifies the smaller square value of the square value of the reduction rate RR_i and the square value of the reduction rate RR_j, and reduces the grid image KG according to the positive square root value of the specified square value. Grid image information SKGI may also be generated. By identifying the smaller of the square value of the reduction rate RR_i and the square value of the reduction rate RR_j, the first generation unit 1222 can reduce the number of square root calculation processes.

The first generation unit 1222 calculates a reduction rate RR for each grid point GP_m of a plurality of grid points GP located on the outer periphery of the grid image KG, and reduces the grid image KG according to the smallest reduction rate RR. , reduced lattice image information SKGI indicating a reduced lattice image SKG such that all of the plurality of lattice points GP located on the outer periphery of the lattice image KG are included within the projection area PA can be generated. Using FIGS. 25 and 26, an example in which a reduced grid image SKG is projected when the grid image KG is reduced according to the reduction ratio RR_j, and a reduced grid image SKG is projected when the grid image KG is reduced according to the reduction ratio RR_i. An example is shown.

FIG. 25 is a diagram showing a projection example of a reduced grid image SKG when the grid image KG is reduced according to the reduction ratio RR_j. In the example of FIG. 25, among all the grid points SGP included in the reduced grid image SKG, the grid point SGP_i is located outside the projection area PA, so the grid point SGP_i is not displayed on the projection surface SC.

FIG. 26 shows an example of projection of the reduced grid image SKG when the grid image KG is reduced according to the reduction ratio RR_i. In the example of FIG. 26, all the grid points SGP included in the reduced grid image SKG are located within the projection area PA, so all the grid points SGP are displayed on the projection surface SC. Note that if three or more grid points GP are located outside the projection area PA, at least some of the grid points can be All the grid points SGP can be displayed by using the smallest reduction ratio among the reduction ratios of all the grid points GP.

As described above, in the fifth modification, projecting the reduced grid image SKG onto the projection surface SC means that among the plurality of grid points GP, the first reduction rate RR1 of the first grid point located on the outer periphery of the grid image KG and the This includes reducing the grid image KG according to the smaller reduction ratio of the second reduction ratio RR2 of the two grid points. The first lattice point in the fifth modification is an example of a "second candidate point," and the second lattice point is an example of a "third candidate point." The first reduction rate RR1 is an example of a "first ratio," and the second reduction ratio RR2 is an example of a "second ratio." The first reduction ratio RR1 is the length from the intersection of the first line segment and the outer periphery of the projection area PA to the center of gravity G with respect to the length of the first line segment connecting the first grid point and the center of gravity G of the projection area PA. This is the percentage of The second reduction rate RR2 is the ratio of the length from the intersection of the second line segment and the outer periphery of the projection area PA to the center of gravity G to the length of the second line segment connecting the second candidate point and the center of gravity G. .
According to the fifth modification, the first generation unit 1222 can generate reduced grid image information SKGI indicating a reduced grid image SKG in which the first grid point and the second grid point are included in the projection area PA.

2.6. Sixth Modified Example In each of the above-mentioned aspects, the first image is an image including a plurality of grid points GP, and an example of a plurality of candidate points is a plurality of grid points GP, but the invention is not limited to this. . For example, the first image is an image in which the selection cursor CUSa in the sixth modified example is superimposed on the monochrome image MG, and the plurality of candidate points may be all points within this monochrome image MG.

FIG. 27 is a diagram illustrating an example of the target point selection mode in the sixth modification. The selection cursor CUSa has the shape of an arrow, and the tip of the arrow indicates the point selected as the target point TP. For example, when the user presses the left key once, the selection cursor CUSa moves in the -X direction by a predetermined number of pixels within the monochrome image MG. The first receiving unit 1262 receives a press input of the enter key as an input for selecting the target point TP. When the enter key is input, the processing device 12 selects the point at the tip of the selection cursor CUSa as the target point TP.

FIG. 28 is a diagram illustrating an example of the target point adjustment mode in the sixth modification. In the target point adjustment mode, the adjusted image AGa in the sixth modification includes a target point TP and eight grid points GP surrounding the target point TP. However, as shown in FIG. 28, when the target point TP is located on the outer periphery of the monochromatic image MG, the target point TP and part of the eight grid points GP are displayed in the projection area PA. The second reception unit 1264 receives a user's input of pressing a direction key as an input for changing the display position of the target point TP. The subsequent processing is the same as in the first embodiment.

2.7. Seventh Modified Example In the above-described aspect, the first generation unit 1222 reduces the grid image KG while maintaining the aspect ratio of the grid image KG, but the present invention is not limited to this. For example, the first generation unit 1222 may reduce the grid image KG so that the reduced grid image SKG is as large as possible without maintaining the aspect ratio of the grid image KG.

2.8. Other Modifications In the projection device 16 in each of the above embodiments, a liquid crystal light valve was used as the light modulation device, but the light modulation device is not limited to the liquid crystal light valve and can be changed as appropriate. For example, the light modulation device may have a configuration using three reflective liquid crystal panels. Further, the light modulation device may have a configuration such as a system using one liquid crystal panel, a system using three digital mirror devices (DMD), a system using one digital mirror device, or the like. When only one liquid crystal panel or DMD is used as a light modulation device, a member corresponding to a color separation optical system or a color synthesis optical system is not required. Furthermore, in addition to liquid crystal panels and DMDs, any structure capable of modulating light emitted by a light source can be employed as a light modulation device.

Further, in each of the above embodiments, all or part of the elements realized by the processing device 12 executing a program are implemented by hardware using an electronic circuit such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific IC). It may be realized by hardware or by cooperation between software and hardware. It is also specified as an image correction method for the projector 10 according to each of the above-mentioned aspects.

DESCRIPTION OF SYMBOLS 1... Display system, 10... Projector, 12... Processing device, 14... Storage device, 121... Determination part, 122... Generation part, 124... Control part, 126... Reception part, 161... Light source, 161a... Light source part, 162... Liquid crystal light valve, 163... Lens, 164... Light valve drive section, 1222... First generation section, 1224... Second generation section, 1242... First control section, 1244... Second control section, 1262... First reception section, 1264...Second reception unit, AG...Adjusted image, AGI...Adjusted image information, CG...Projected image, GP...Grid point, HG...Auxiliary image, IG...Input image, IGI...Input image information, KG...Grid image, KGI ... Grid image information, PA... Projection area, SC... Projection surface, SIG... Reduced input image, SKG... Reduced grid image, SKGI... Reduced grid image information, TP... Target point.

Claims (7)

An image correction method performed by a projector,
A second image obtained by reducing the first image including a plurality of candidate points, which are candidates for correcting the display position, to a size included in the projection area, which is the largest area that the projector can project, is displayed on the projection surface. and
receiving a first input for selecting a target point whose display position is to be corrected from among the plurality of candidate points in a state where the second image is projected on the projection surface;
After receiving the first input, projecting a third image obtained by enlarging the second image to the size of the first image onto the projection surface;
receiving a second input for changing the display position of the target point in a state where the third image is projected on the projection surface;
projecting a projection image with the shape of the input image corrected on the projection surface based on the second input;
Image correction method.
determining whether there is a candidate point located outside the projection area among the plurality of candidate points included in the first image;
projecting the second image onto the projection surface when it is determined that there is a candidate point located outside the projection area;
projecting the first image onto the projection surface when it is determined that there is no candidate point located outside the projection area;
receiving the first input and the second input in a state where the first image is projected on the projection surface;
projecting the projected image onto the projection surface based on the second input;
The image correction method according to claim 1.
Projecting the second image onto the projection surface includes projecting the second image superimposed on a fourth image obtained by reducing the input image,
The relationship between the position of the first part of the input image and the position of the first candidate point among the plurality of candidate points when the first image is superimposed on the input image, and the relationship corresponding to the first part The position of the portion of the fourth image and the position of the first candidate point in the second image match;
The image correction method according to claim 1 or 2.
Projecting the second image onto the projection surface means that, among the plurality of candidate points, a second candidate point located on the outer periphery of the first image and furthest from the outer periphery of the projection area is reducing the first image so as to be in contact with the outer periphery of the area;
The image correction method according to any one of claims 1 to 3.
Projecting the second image onto the projection surface includes a first proportion of second candidate points located on the outer periphery of the first image and a second proportion of third candidate points among the plurality of candidate points. reducing the first image according to a small percentage;
The first ratio is the length from the intersection of the first line segment and the outer periphery of the projection area to the center of gravity with respect to the length of the first line segment connecting the second candidate point and the center of gravity of the projection area. is the proportion of
The second ratio is a ratio of the length from the intersection of the second line segment and the outer periphery of the projection area to the center of gravity with respect to the length of the second line segment connecting the third candidate point and the center of gravity. be,
The image correction method according to any one of claims 1 to 3.
superimposing and projecting an auxiliary image that assists the second input on the third image;
The image correction method according to any one of claims 1 to 5.
A projector,
a light source that emits light;
a light modulation device that generates modulated light by modulating the light;
a lens that emits the modulated light;
at least one processing device;
has
The at least one processing device comprises:
A first image including a plurality of candidate points that are candidates for correcting the display position is reduced to a size such that the outer periphery of the first image is included in a projection area that is the largest area that can be projected by the projector. Projecting a second image onto a projection surface by controlling the light modulation device;
receiving a first input for selecting a target point whose display position is to be corrected from among the plurality of candidate points in a state where the second image is projected on the projection surface;
After receiving the first input, projecting a third image obtained by enlarging the second image to the size of the first image onto the projection surface by controlling the light modulation device;
receiving a second input for changing the display position of the target point in a state where the third image is projected on the projection surface;
controlling the light modulation device to project a projection image with the shape of the input image corrected on the projection surface based on the second input;
projector.

Images