Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T3/00—Geometric image transformations in the plane of the image
  • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
  • G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2101/00—Still video cameras

Definitions

• Image processing apparatus image processing method, and program
• the present invention relates to an image processing apparatus and an image processing method for converting an original image stored in a predetermined recording medium into an enlarged image that has been enlarged around a reference point set in the screen And a program for causing a computer to execute this image processing.
• image processing software is executed, and processing such as enlargement processing is performed on image data of an image captured by a digital camera or the like (hereinafter referred to as an original image). It is done to give various image effects!
• Japanese Patent Application Laid-Open No. 2005-130350 has field memory means for storing a series of image data configured so that one screen is composed of two fields in units of fields, and writing image data to the field memory means.
• An image processing apparatus is described in which image processing can be performed in units of fields by performing reading within one access cycle, and the memory capacity in image processing can be greatly reduced.
• Digital power cameras and the like are equipped with such an image processing device in order to give an image effect to the original image.
• a digital camera equipped with an image processing device according to Japanese Patent Application Laid-Open No. 2005-130350 is an original in such processing.
• the image data of the image and the image data of the processed image are stored in the same field memory.
• the present invention has been proposed in view of such circumstances, and saves the original image data when performing processing for converting the image data of the original image stored in the recording medium into the image data of the enlarged image. It is an object of the present invention to provide an image processing apparatus, an image processing method, and a program that reduce the storage capacity required for the purpose.
• One embodiment of the present invention proposed to solve the technical problem as described above is based on an original image stored in a predetermined recording medium with a reference point set in the screen as a center.
• An image processing apparatus for converting into an enlarged image subjected to enlargement processing, wherein a selection process for selecting a processing target pixel from a coordinate point farthest from the reference point from among pixels constituting the enlarged image A calculation processing unit for calculating the coordinate point of the original image mapped to the coordinate point of the processing target pixel selected by the selection processing unit, and the coordinates of the original image calculated by the calculation processing unit.
• the pixel value of the pixel of the original image is read from the recording medium, and the pixel value of the pixel of the original image read by the read processing unit is used to Interpolate pixel values
• the pixel value of the processing target pixel interpolated by the inter-processing unit and the interpolation processing unit is located at the same coordinate point as each pixel of the enlarged image that is not selected as the processing target pixel in the recording medium.
• an image for converting an original image stored in a predetermined recording medium into an enlarged image subjected to an enlargement process centered on a reference point set in the screen A processing method, from among the pixels constituting the enlarged image, from the reference point Starting from the farthest coordinate point, select the pixel to be processed, calculate the coordinate point of the original image mapped to the coordinate point of the selected pixel to be processed, and calculate the coordinate point of the original image
• the pixel value of the pixel of the original image is read out from the recording medium
• the pixel value of the pixel of the processing target pixel is interpolated using the pixel value of the pixel of the read original image
• the interpolated processing target A storage area in which the pixel value of each pixel of the original image is stored at the same coordinate point as each pixel of the enlarged image that is not selected as the processing target pixel in the recording medium.
• an image for converting an original image stored in a predetermined recording medium into an enlarged image subjected to an enlargement process centered on a reference point set in the screen A program for causing a computer to execute processing, a selection processing step of selecting a processing target pixel from a coordinate point farthest from the reference point from among pixels constituting the enlarged image, and the selection processing
• a reading processing step for reading out the pixel value of the pixel from the recording medium, and an interpolation processing step for interpolating the pixel value of the processing target pixel using the pixel value of the pixel of the original image read out in the reading processing step A reading processing step for reading out the pixel value of the pixel from the recording medium, and an interpolation processing step for interpolating the pixel value of the processing target pixel using the pixel value of the pixel of the original image read out in the reading processing step.
• the present invention selects a processing target pixel from a pixel farthest from the reference point from among pixels constituting the enlarged image, and calculates a coordinate point of the original image mapped to the coordinate point of the selected processing target pixel.
• the pixel value of the pixel of the original image is read from the recording medium according to the calculated coordinate point of the original image, and the pixel value of the pixel to be processed is interpolated using the pixel value of the pixel of the read original image.
• the pixel value of the processing target pixel is other than the storage area in which the pixel value of each pixel of the original image located at the same coordinate point as each pixel of the enlarged image not selected as the processing target pixel in the recording medium is stored. Write to.
• the present invention is an expansion that is not selected as a processing target pixel in the recording medium. Since the pixel value of each pixel of the original image located at the same coordinate point as each pixel of the large image is written to a storage area other than the storage area, the storage capacity required to save the image data of the original image is reduced. Can do.
• FIG. 1 is a block diagram showing a configuration of a digital camera according to the present embodiment.
• FIG. 2A is a diagram showing an original image P1
• FIG. 2B is a diagram showing a corrected image P2 obtained by performing tilt correction on the original image P1.
• FIG. 3 is a block diagram showing a configuration of an image processing unit.
• FIG. 4 is a diagram showing a coordinate space of an original image.
• FIG. 5 is a diagram schematically showing processing of the bilinear interpolation method.
• FIG. 6 is a diagram schematically showing memory storage management according to a conventional memory control method.
• FIG. 7A is a diagram schematically illustrating memory storage management according to the first memory control method
• FIG. 7B is a schematic diagram illustrating memory storage management according to the second memory control method.
• FIG. 8B shows the original image P3 according to the first memory control method.
• FIG. 6 is a diagram showing a corrected image P4 that has been subjected to upper trapezoid correction processing.
• FIG. 9A is a diagram showing an original image P5
• FIG. 9B is a diagram showing a corrected image P6 obtained by performing upper trapezoid correction processing on the original image P5 according to the first memory control technique.
• FIG. 10A is a view showing an original image P7 covered toward the reference point (xO, yO).
• OB is a diagram showing a corrected image P8 obtained by performing fisheye correction processing on the original image P7.
• FIG. 11 is a flowchart showing processing steps of an image processing unit that performs fish-eye correction processing according to the second memory control method.
• FIG. 12 is a flowchart showing a horizontal line processing step of an image processing unit that performs fisheye correction processing according to the second memory control method of the image processing unit.
• the digital camera 100 includes an optical lens 110, a solid-state imaging device 120, a signal processing unit 130, a memory 140, an image processing unit 150, and a recording medium 160.
• the display unit 170 is provided.
• the optical lens 110 condenses light from the subject on the solid-state imaging device 120 through an opening (not shown).
• the solid-state image sensor 120 receives the light collected by the optical lens 110 and reads an electrical signal.
• the solid-state imaging device 120 converts the read electrical signal from an analog format to a digital format and supplies the signal to the signal processing unit 130.
• the solid-state imaging device 120 is not limited to any structure, whether it is a CCD structure or a C MOS structure.
• the signal processing unit 130 performs predetermined signal processing on the digital electrical signal supplied from the solid-state imaging device 120 and outputs image data. Specifically, the signal processing unit 130 outputs image data obtained by performing signal processing such as white balance, gamma correction, and luminance / color difference conversion on a digital electrical signal. The signal processing unit 130 supplies the image data converted by the signal processing to the memory 140.
• the memory 140 is a main memory of the image processing unit 150, temporarily stores the image data supplied from the signal processing unit 130, and stores the stored image data in the image processing unit 150, the recording medium 160, and the display unit. Supply to 170.
• the image processing unit 150 performs image processing such as enlargement processing on the image data stored in the memory 140 and writes it back to the memory 140.
• the display unit 170 displays the image data supplied from the memory 140. In addition to displaying an image captured by the digital camera 100, the display unit 170 also displays a GUI (Graphic User Interface) screen for operating the digital camera 100.
• GUI Graphic User Interface
• the digital camera 100 performs image processing for giving a predetermined image effect to the image data, in addition to the processing for storing the image data in the recording medium 160 and the processing for displaying the image data on the display unit 170.
• the image processing unit 150 reads out image data to be processed from the recording medium 160 to the memory 140. Then, the image processing unit 150 performs a process for giving an image effect to the image data read to the memory 140. Thereafter, when the processing on the image data to be processed is completed, the image processing unit 150 supplies the processed image data to the recording medium 160 and the display unit 170 via the memory 140.
• the image processing unit 150 performs predetermined processing on not only the image data stored in the recording medium 160 but also the image data stored in the recording medium 160 before the image processing unit 150 performs processing for storing the image data. Let's give it an image effect.
• the image data stored in the recording medium 160 is converted into an enlarged image that has been enlarged around the reference point set in the screen.
• the following description will be given focusing on the operation of the image processing unit 150.
• FIG. 2A shows a processing target image (hereinafter referred to as an original image P1) in which the image area near the edge of the imaging screen is raised toward the vertical axis at the center of the imaging screen due to the characteristics of the optical lens 110 when imaging the image. Call it.)
• the image processing unit 150 performs a process for enlarging the original image P1 around the vertical axis in order to correct the tilt of the original image P1. That is, the image processing unit 150 performs an enlargement process on the original image P1 covered in the vertical axis direction of the screen center around the vertical axis, and corrects the tilt as shown in FIG. This is referred to as corrected image P2.
• the image processing unit 150 includes a processing unit as described below in order to perform a tilt correction process on the original image. That is, the image processing unit 150 includes a selection processing unit 151, a coordinate conversion processing unit 152, a memory control unit 153, and an interpolation processing unit 154, as shown in FIG.
• the selection processing unit 151 selects a pixel to be processed (hereinafter referred to as a processing target pixel) from the corrected image set to the same image size as the original image, and selects the selected processing target pixel. Is supplied to the coordinate conversion processing unit 152 for each pixel.
• the coordinate conversion processing unit 152 uses a mapping function to be described later for each pixel constituting the corrected image. The coordinate point of the original image mapped to the coordinate point is calculated. Then, the coordinate conversion processing unit 152 supplies data relating to the coordinate points of the original image to the memory control unit 153.
• the memory control unit 153 performs data read / write processing with respect to the memory 140.
• the memory control unit 153 reads out the pixel values of the pixels of the original image from the memory 140 according to the data regarding the coordinate points of the original image supplied from the coordinate conversion processing unit 152 and supplies the pixel values to the interpolation processing unit 154. Further, the memory control unit 153 writes the output result from the interpolation processing unit 154 described later in the memory 140.
• the interpolation processing unit 154 uses the pixel value of the pixel of the original image supplied from the memory control unit 153 to interpolate the pixel value of the pixel of the corrected image, and obtains data regarding the pixel value of the pixel of the corrected corrected image. This is supplied to the memory control unit 153. A specific interpolation processing method performed by the interpolation processing unit 154 will be described later.
• the operation of the selection processing unit 151 differs depending on the characteristics of the tilt generated in the original image.
• the tilt characteristics of the original image can be broadly divided into two types. Therefore, the image processing unit 150 performs the conversion process from the original image to the corrected image by dividing into two types of trapezoid correction process and fish-eye correction process.
• the coordinate space of the original image is as shown in Fig. 4, where the coordinate point of the pixel at the upper left corner of the screen is the origin, the length of each side of the unit pixel is 1, width in the x 'direction, y' Assume that height pixels are arranged in the direction.
• the coordinate point of the pixel at the upper left corner of the screen is the origin, the length of each side of the unit pixel is 1, widt h in the X direction, and height in the y direction.
• And processing (called right trapezoid correction processing).
• the image processing unit 150 sets the reference point (xO, yO) as the coordinate point ((width—1) / 2, height—1) in the upper trapezoid correction process, and the reference point ( X 0, yO) is the coordinate point ((width— 1) / 2, 0), and the reference point (xO, yO) is the coordinate point (width— 1, (height— 1) / In the case of right trapezoid correction processing, the reference point (xO, yO) is set to the coordinate point (0, (height — 1) / 2), and the enlargement process is performed around the reference point.
• the fisheye correction process is a process for correcting a tilt of an original image that appears in an original image generally captured by a fisheye lens.
• This is a process for correcting the original image that is raised toward the axis.
• the fish-eye lens is an optical lens having a wide viewing angle. Therefore, the image processing unit 150 performs an enlargement process centering on the reference point (xO, yO) set in the screen as the fisheye correction process.
• the coordinate conversion processing unit 152 performs the following processes according to the trapezoid correction process and the fisheye correction process described above.
• the coordinate conversion processing unit 152 maps it to the coordinate point (X, y) of the pixel of the corrected image by the following equations (1) and (2). Find the coordinates ( ⁇ ', y') of the original image.
• a, b, c, d, e, f, g, and h are constants determined according to the degree of tilt of the original image.
• the coefficient c2 is 1 ⁇ vol / 300
• the coefficient vol is a coefficient determined according to the strength of the fisheye effect.
• the coordinate conversion processing unit 152 calculates the coordinate point of the original image mapped to the coordinate point of the processing target pixel according to the trapezoidal correction process and the fisheye correction process, and supplies it to the memory control unit 153. To do.
• the memory control unit 153 reads out the pixel values of the pixels of the four original images positioned around the calculated coordinate point Z of the original image and supplies them to the interpolation processing unit 154.
• the pixels of these four original images are pixels A, B, C, and D located at the upper left, upper right, lower left, and lower right with respect to the coordinate point Z, respectively.
• the interpolation processing unit 154 calculates the pixel value of the coordinate point Z from the pixel values of the pixels A, B, C, and D of the original image supplied from the memory control unit 153 according to the bilinear interpolation method.
• the pixel value at coordinate point Z is interpolated from the pixel values of four pixels A, B, C, and D in the original image.
• the horizontal line connecting B is Z1
• the ratio between the distance from pixel A to pixel Z1 and the distance from pixel Z1 to pixel B is d: (1-d) (0 ⁇ d ⁇ l)
• the distance from the pixel C to the pixel Z2 and the distance from the pixel Z2 to the pixel D are The ratio of is d: (1—d).
• the ratio of the distance from the pixel Z1 to the pixel Z and the distance from the pixel Z to the pixel Z2 is e: (1-e) (0 ⁇ e ⁇ l).
• the pixel value P (Z1) of the pixel Z1 is calculated from the following equation (7), and the pixel value P (Z2) is calculated from the equation (8).
• the pixel values of pixels A, B, C, and D are P (A), P (B), P (C), and P (D), respectively.
• P (Zl) (ld) XP (A) + dXP (B)
• the pixel value ⁇ ( ⁇ ) of the coordinate point ⁇ is calculated from the following equation (9) using the calculation results obtained by equations (7) and (8).
• the interpolation processing unit 154 calculates the pixel value ⁇ ( ⁇ ) of the coordinate point ⁇ ⁇ ⁇ ⁇ by the bilinear interpolation method described above. Then, the interpolation processing unit 154 sets the calculated pixel value ⁇ ( ⁇ ) of the coordinate point ⁇ to the pixel value of the current processing target pixel. Further, the interpolation processing unit 154 supplies the pixel value of the processing target pixel to the memory control unit 153.
• the memory control unit stores in the storage area 2 excluding the storage area in which the image data of the original image is stored in advance in the memory (hereinafter referred to as storage area 1). Then, data relating to the pixel value of each pixel of the corrected image is written.
• the image data of the original image and the image data of the corrected image are stored in different storage areas. For this reason, the image processing unit does not need to consider in what order the processing target pixel is selected from the plurality of pixels constituting the corrected image. That is, when such a memory control method is followed, the image processing unit does not have a risk of overwriting the original image stored in the memory even if the processing starts from the pixel of the corrected image located at any coordinate point. .
• a storage area for saving the image data of the original image must be secured in the memory, or a frame memory for saving other than the memory must be provided in the image processing unit.
• a larger storage area for saving must be secured as the number of pixels increases.
• FIG. 3 is a diagram schematically showing a first memory control method for overwriting a part of 1 as image data of a corrected image and writing the image data of the corrected image on the memory 140.
• FIG. 7B is a diagram schematically showing a second control method for overwriting the entire storage area 1 in which the image data of the original image is stored as the image data (storage area 2) of the corrected image.
• the image processing unit 150 When the storage area of the memory 140 is managed by the control method 2 and the second control method, the image processing unit 150 generates an image of the original image necessary for the unprocessed pixels among the processing target pixels constituting the corrected image. Data is stored on memory 140! /, Must be! / ... For this reason, the image processing unit 150 must select the processing target pixels from the respective pixels constituting the corrected image in an appropriate order, and convert the original image into the corrected image. Therefore, the following will be described as focusing on the operation of the selection processing unit 151 that selects the appropriate processing target pixel described above.
• the selection processing unit 151 differs in the selection order of the processing target pixels depending on the type of tilt generated in the original image. Specifically, the selection processing unit 151 selects different processing target pixels by dividing into the two types of trapezoid correction processing and fish-eye correction processing described above.
• FIG. 8B is a corrected image P4 obtained by performing tilt correction on the original image P3.
• the coordinate point (X, y) of the original image that can be mapped to the coordinate space of the corrected image is an image area indicated by dots in the screen of the original image in FIG. 8A. Therefore, in the screen of the original image P3, indicated by the dots in Fig. 8A! /, NA!
• the relationship of ⁇ 'always holds between the coordinate point ( ⁇ ', y ') of the original image and the coordinate point (X, y) of the corrected image.
• the relationship X ⁇ ⁇ 'always holds between the coordinate point ( ⁇ ', y ') of the original image and the coordinate point (X, y) of the corrected image.
• the image processing unit 150 selects a processing target coordinate using the relationship established between the coordinate point ( ⁇ ′, y ′) of the original image and the coordinate point (X, y) of the corrected image. .
• the selection processing unit 151 is directed vertically downward from the coordinate point (0, 0) of the pixel located at the upper left corner, which is the point farthest from the reference point (xO, yO).
• the processing target pixels are sequentially selected, and data relating to the coordinate points of the processing target pixels is supplied to the coordinate conversion processing unit 152. That is, the selection processing unit 151 sequentially selects pixels to be processed from the left end to the right end in the processing forward direction A1 in the uppermost pixel row in the screen.
• the selection processing unit 151 performs such horizontal processing on the pixel columns arranged in the horizontal direction from the upper end of the screen toward the processing forward direction A2.
• the memory control unit 153 selects the pixel value of the current processing target pixel as the processing target pixel in the memory 140 before.
• the pixel value of each pixel of the original image located at the same coordinate point as each pixel of the enlarged image that has not been written can be written to other than the storage area in which the pixel value is stored.
• the selection processing unit 151 can select all the processing target pixels so that the relationship y ⁇ y ′ is always established. Therefore, the memory control unit 153 constructs an original image corresponding to at least one horizontal line from the pixel values of the processing target pixels subjected to the sequential interpolation processing. Pixels can be saved and written to memory 140.
• the selection processing unit 151 selects the processing target pixel from the horizontal pixel row at the lower end of the screen toward the upper vertical side, so that an original image for at least one horizontal line is selected.
• the power S can be converted from the original image to the corrected image simply by retracting the pixels that make up.
• the selection processing unit 151 forms an original image for at least one vertical line by selecting a processing target pixel from the vertical pixel column at the right end of the screen toward the left side of the screen. It is possible to convert the original image into a corrected image by simply saving the pixels. Further, in the case of right trapezoid correction processing, the selection processing unit 151 selects a processing target pixel from the vertical pixel row at the left end of the screen toward the horizontal right side, thereby obtaining an original image for at least one vertical line. Converting the original image to the corrected image simply by saving the constituent pixels can be done with the power S.
• the image processing unit 150 stores the pixel value of each pixel of the original image located at the same coordinate point as each pixel of the enlarged image not selected as the processing target pixel in the storage area of the memory 140. Since the data is written in a storage area other than the storage area, it is possible to reduce the storage capacity required for saving the image data of the original image that has been conventionally required.
• FIG. 9A shows the original image P5.
• the selection processing unit 151 coordinates the pixel located at the upper right end in the screen of the corrected image P6 that is the point farthest from the reference point ( ⁇ , yO). Select the pixel to be processed in sequence along one of the Cartesian coordinates starting from the reference point (0, 0) and the reference point (xO, yO) as the origin. Supply to part 152.
• the selection processing unit 151 performs such horizontal processing on the pixel rows arranged in the horizontal direction from the upper end of the screen toward the processing forward direction B3.
• trapezoid correction processing other than upper keystone correction processing The selection order of the processing target pixels will be described later.
• FIG. 10A shows the original image P7 that is draped toward the reference point (xO, yO) on the coordinate point ( ⁇ ′, y ′).
• FIG. 10B shows a corrected image P8 obtained by performing tilt correction on the original image P7.
• the image area at the top of the screen of the original image P7 which is not indicated by the dots in the figure, becomes an area that cannot be mapped to the coordinate point of the corrected image! / . Therefore, the following relationship is established between the original image P7 and the corrected image P8 for each of the upper left, upper right, lower left, and lower right regions with respect to the reference point (xO, yO).
• the selection processing unit 151 uses the relationship established between the coordinate point (X, y,) of the original image and the coordinate point (X, y) of the corrected image described above to determine the coordinates of the processing target coordinate. Make a selection.
• the image processing unit 150 selects all the pixels constituting the corrected image as processing target pixels.
• the selection processing unit 151 sets the reference point (xO, yO Starting from the coordinate point farthest from), each pixel constituting the enlarged image is selected as a processing target pixel toward one axis on the orthogonal coordinates with the reference point (xO, yO) as the origin.
• the memory control unit 153 sets the pixel value of the processing target pixel of the original image located at the same coordinate point as that coordinate point. It can be written into the storage area of the memory 140 where the pixel values of the pixels are stored.
• the image processing unit 150 can manage the storage area of the memory 140 by the second control method, a storage area for saving the image data of the original image on the memory 140 is required! /.
• the selection processing unit 151 secures a storage area for saving the pixel value of the original image on the orthogonal coordinates with the reference point (X, y) as the origin, and the reference point described above.
• the fish-eye correction process can be used regardless of whether or not these coordinate points coincide with the coordinate points of any pixel.
• the image processing unit 150 can perform the correction processing without securing a storage area for saving the image data of the original image.
• Such processing performed by the image processing unit 150 force S is specifically executed according to the correction processing program shown in FIG.
• the correction processing program described below will be described with particular attention to the operation of the selection processing unit 151 among the processing units included in the image processing unit 150.
• both the original image and the corrected image are assumed to be composed of width pixels in the horizontal direction and height pixels in the vertical direction.
• the coordinate point of the pixel located at the upper left corner on the screen is the origin.
• step S11 the selection processing unit 151 sets a reference point (xO, yO) as an initial setting.
• the selection processing unit 151 selects the coordinate point ((width—D / 2, height—1) when the upper trapezoid correction process is performed, and the coordinate point ((width—1) / 2 when the lower trapezoid correction process is performed.
• the coordinate point (width— 1, (height-1) / 2) is applied to the left trapezoid correction process, and the coordinate point (0, (height— 1) / 2) is set to the reference point (xO, yO), respectively, and when performing the fisheye correction process, the selection processing unit 151 converts the arbitrary coordinate point (Xc, Yc) to the reference point (xO, yO). Set to yO).
• step S12 the selection processing unit 151 selects a pixel located at the coordinate point (0, 0) of the corrected image as a processing target pixel.
• the selection processing unit 151 determines whether or not the coordinate point of the current pixel to be processed satisfies the condition y ⁇ yO (step S13), and determines that this condition is satisfied. 1 In accordance with the horizontal line processing shown in 2, select pixels for one horizontal line as processing target pixels and perform correction processing (step S14), and increment the y component of the processing target pixels (step S14). Step SI 5), and return to Step SI 3 processing.
• the selection processing unit 151 determines whether or not the coordinate point of the current processing target pixel satisfies the condition x ⁇ xO (step S101), and determines that the condition is satisfied, the process proceeds to step S102. move on.
• step S 102 the selection processing unit 151 supplies data relating to the coordinate point of the processing target pixel to the coordinate conversion processing unit 152. Note that the image processing unit 150 performs correction processing on the processing target pixel and writes it in the memory 140.
• the selection processing unit 151 increments the value of X at the coordinate point of the processing target pixel (step S102), returns to the determination processing in step S101, and then returns to step S101. Steps S102 and S103 are repeated until the condition shown in (2) is not satisfied, and then the X value of the coordinate point of the processing target pixel is set to (width—1) (Step S104). Subsequently, the selection processing unit 151 determines whether or not the coordinate point (X, y) of the current processing target pixel satisfies the condition of ⁇ > ⁇ (step S105), and determines that this condition is satisfied. Then, it progresses to step S106.
• step S106 the selection processing unit 151 supplies data regarding the coordinate point of the processing target pixel to the coordinate conversion processing unit 152.
• correction processing is performed on the processing target pixel, and the memory control unit 153 is written in the memory 140 in accordance with the second memory control method.
• the selection processing unit 151 decrements the value of X at the coordinate point of the processing target pixel (step S107), returns to the determination processing in step S105, and in step S105
• the processes in steps S106 and S107 are repeated until the indicated condition is not satisfied, and the horizontal line process is terminated.
• the selection processing unit 151 When the selection processing unit 151 repeatedly performs the processing of step S14 and step S15 and the condition of step S13 is not satisfied, the y value of the processing target pixel is set to (height—1) (step S16). .
• the selection processing unit 151 determines whether or not the coordinate point of the current pixel to be processed satisfies the condition y> yO! / (Step S17). When the determination is made, pixels for one horizontal line are selected as pixels to be processed according to the horizontal line processing shown in FIG. 12 (step S18). Thereafter, the selection processing unit 151 decrements the y component of the pixel to be processed ((scan Step S 19) and the process returns to Step S 17. The selection processing unit 151 repeats Steps S18 and S19 and proceeds to Step S20 when the condition of Step S17 is not satisfied.
• step S20 the selection processing unit 151 determines whether or not both the ⁇ component and the yO component of the reference point ( ⁇ , yO) set in step S11 are integers. In this determination process, it is determined whether or not the reference point (xO, yO) matches the coordinate point of an arbitrary pixel. Therefore, the selection processing unit 151 does not satisfy such a condition regarding the reference point with respect to the trapezoidal correction process, and thereafter ends this processing step. That is, the selection processing unit 151 performs the processing of steps S21 to S30 described below only when fisheye correction processing is performed and the reference point (xO, yO) matches the coordinate point of an arbitrary pixel.
• step S20 When the condition shown in step S20 is satisfied, the selection processing unit 151 sets the y component of the pixel to be processed to yO (step S21), and processes pixels for one horizontal line according to the horizontal line processing shown in FIG.
• the target pixel is selected and corrected (step S22), and then the coordinate point of the target pixel is set to the coordinate point (xO, 0) (step S23).
• the selection processing unit 151 determines whether or not the coordinate point of the current processing target pixel satisfies the condition y ⁇ y0 (step S24), and determines that this condition is satisfied. Proceed to step S25. In step S25, the selection processing unit 151 supplies data regarding the coordinate point of the processing target pixel to the coordinate conversion processing unit 152. Note that the image processing unit 150 performs correction processing on the processing target pixel and writes the correction target pixel in the memory 140 according to the second control method. When the correction processing related to the current processing target pixel is completed, the selection processing unit 151 increments the y value of the coordinate point of the processing target pixel (step S26), returns to the determination processing of step S24, and returns to step S24. The processes in steps S25 and S26 are repeated until the indicated condition is not satisfied, and then the y value of the coordinate point of the processing target pixel is set to (height-1) (step S27).
• the selection processing unit 151 determines whether or not the coordinate point (X, y) of the current pixel to be processed satisfies the condition y> yO (step S28). If judged, the process proceeds to step S29. In step S28, the selection processing unit 151 supplies data relating to the coordinate point of the processing target pixel to the coordinate conversion processing unit 152. In the image processing unit 150, correction processing is performed on the processing target pixel, and the measurement is performed according to the second control method. Will be written to Mori 140. When the correction process for the current pixel to be processed is completed, the selection processing unit 151 decrements the y value of the coordinate point of the pixel to be processed (step S30), and returns to the determination process of step S28.
• step S29 and step S30 is repeated until the condition indicated in S28 is not satisfied, and this processing step is completed.
• the selection processing unit 151 performs the tilt correction processing. Select the pixel to be processed in an appropriate order according to the type. Even if the image processing unit 150 stores the pixel value of each pixel constituting the corrected image in the memory 140 while rewriting the pixel value of the pixel of the original image located at the same coordinate point as each coordinate point, the correction is performed. It is possible to perform a correction process in which the data of each pixel constituting the original image necessary for conversion into an image is not overwritten before the correction process.
• the digital camera 100 including the image processing unit 150 does not need a storage area for saving the image data of the original image. Therefore, the digital camera 100 can reduce the storage capacity of the memory 140 as compared with the conventional one.

Landscapes

• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Image Processing (AREA)
• Editing Of Facsimile Originals (AREA)
• Storing Facsimile Image Data (AREA)
• Studio Devices (AREA)

Priority Applications (2)

Applications Claiming Priority (2)

Publications (1)

Family

ID=39200368

Family Applications (1)

Country Status (5)

Families Citing this family (14)

Citations (2)

Family Cites Families (13)

• 2006
  • 2006-09-21 JP JP2006256069A patent/JP4470930B2/ja active Active
• 2007
  • 2007-08-24 US US12/442,185 patent/US8094230B2/en not_active Expired - Fee Related
  • 2007-08-24 WO PCT/JP2007/066457 patent/WO2008035539A1/ja not_active Ceased
  • 2007-08-24 CN CN2007800353092A patent/CN101518045B/zh not_active Expired - Fee Related
  • 2007-08-29 TW TW096132078A patent/TW200818860A/zh not_active IP Right Cessation

Patent Citations (2)

Also Published As

Similar Documents

Legal Events