US20070041634A1 - Image capturing apparatus, image processing apparatus and image processing method - Google Patents

Image capturing apparatus, image processing apparatus and image processing method Download PDF

Info

Publication number
US20070041634A1
US20070041634A1 US11/500,430 US50043006A US2007041634A1 US 20070041634 A1 US20070041634 A1 US 20070041634A1 US 50043006 A US50043006 A US 50043006A US 2007041634 A1 US2007041634 A1 US 2007041634A1
Authority
US
United States
Prior art keywords
image
lattice point
point data
data table
matrix coefficient
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/500,430
Other languages
English (en)
Inventor
Masami Sugimori
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SUGIMORI, MASAMI
Publication of US20070041634A1 publication Critical patent/US20070041634A1/en
Priority to US13/087,521 priority Critical patent/US9083890B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/64—Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor
    • H04N1/646—Transmitting or storing colour television type signals, e.g. PAL, Lab; Their conversion into additive or subtractive colour signals or vice versa therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding

Definitions

  • the present invention relates to image processing in an image capturing apparatus such as a digital camera.
  • U.S. Pat. No. 5,073,818 discloses a printer having a look-up table circuit for image processing. According to this U.S. Pat. No. 5,073,818, because the file size increases when the entire look-up table is stored, a look-up table for actual image conversion is generated from correction functions.
  • the present invention has been made in view of the above problems, and provides an image capturing apparatus for image processing using a lattice point data table, in which a necessary memory capacity for storage of lattice point data table or the like is reduced.
  • an image capturing apparatus for performing digital processing on an image obtained by image capturing, comprising:
  • a conversion unit adapted to perform conversion processing on image data using a lattice point data table
  • a holding unit adapted to hold a matrix coefficient set for performing the conversion processing by matrix operation
  • a setting unit adapted to calculate values of respective lattice points of the lattice point data table using the matrix coefficient set, and set the values in the lattice point data table used by the conversion unit.
  • FIG. 1 is a block diagram showing the entire image capturing apparatus according to a first embodiment of the present invention
  • FIG. 2 is a block diagram showing the details of an image processor 7 b in the image capturing apparatus in FIG. 1 ;
  • FIGS. 3A-3E illustrates color interpolation in image processing according to the first embodiment
  • FIG. 4 illustrates a three-dimensional lattice point data table according to the first embodiment
  • FIG. 5 is a block diagram showing a functional construction for raw image file generation according to the first embodiment
  • FIG. 6 is a flowchart showing raw image file generation processing according to the first embodiment
  • FIG. 7 is a block diagram showing the construction of an image processing apparatus according to the first embodiment
  • FIG. 8 is a block diagram showing a functional construction for raw data processing in the information processing apparatus according to the first embodiment
  • FIG. 9 is a flowchart showing raw image file processing in the information processing apparatus according to the first embodiment.
  • FIG. 10 is a block diagram showing the functional construction for the raw image file generation according to a second embodiment of the present invention.
  • FIG. 11 is a flowchart showing the raw image file generation processing according to the second embodiment.
  • FIGS. 12A and 12B illustrate thumbnail image generation according to the first embodiment.
  • FIG. 1 is a block diagram showing the construction of a digital camera according to a first embodiment of the present invention.
  • light passed through an image capturing lens 1 is formed into an image on an image capture device 4 via an infrared cut-off filter 2 and an optical LPF 3 .
  • the image capture device 4 a CCD sensor, a CMOS sensor or the like may be used.
  • photodiode sensors are two-dimensionally arrayed on a photoreception surface of the image capture device 4 . For example, one color is allocated to one sensor by a color filter where respective R (red), G (green) and B (blue) primary color filters are arrayed in a predetermined pattern. Otherwise, it may be arranged such that the image capture device 4 is prepared in correspondence with the number of primary colors, and one color is allocated to one image capture device.
  • a CPU 15 performs the following image capturing operation.
  • light image-formed on the image capture device 4 is converted by the respective sensors to electric charges corresponding to incident light quantities.
  • a signal generated by a timing generator 16 is supplied to a horizontal driver 17 for horizontal driving and a vertical driver 18 for vertical driving.
  • the horizontal driver 17 and the vertical driver 18 supply a driving signal to the image capture device 4 in accordance with the signal from the timing generator 16 .
  • the electric charges accumulated in the sensors are transmitted from the image capture device 4 and sequentially converted to voltage signals.
  • the voltage signals are sampled and gain-controlled by a correlated double sampling/gain controller (hereinbelow, abbreviated to “CDS/AGC”) 5 , then converted to digital signals by an A/D converter 6 .
  • the image data converted to digital signals by the A/D converter 6 is inputted into an image processing IC 7 .
  • a WB circuit 7 a calculates data for white balance for the input image data.
  • the data for white balance and the image data are temporarily stored into the memory 8 .
  • the image data stored in the memory 8 is inputted into the image processing IC 7 again, and subjected to the following three processings.
  • the image data converted to the digital signals is subjected to lossless compression (reversible compression) by a lossless compression unit 7 d , and sent as raw data to a CPU bus 10 .
  • lossless compression reversible compression
  • the image data converted to the digital signals is changed to a thumbnail image having a size smaller than the original image size by down sampling such as thinning processing by the thumbnail generator 7 c , and sent to the CPU bus 10 .
  • the down sampling is performed by averaging the raw image data in block units.
  • the three-dimensional lattice point data table is synonymous with a three-dimensional look-up table.
  • the lossless-compressed raw data and the JPEG-compressed image data are stored into a memory 9 via the CPU bus 10 .
  • the CPU 15 generates a raw image file having the raw data stored in the memory 9 accompanied by the JPEG compressed image.
  • the JPEG compressed image is attached as preview data of the raw data.
  • the generated raw image file is stored into an external memory 14 removably connected via an interface 13 .
  • the three-dimensional lattice point data table 7 e is used for generation of a preview JPEG image generated at the same time of generation of the raw data and attached to the raw image file.
  • three-dimensional lattice point data of the three-dimensional lattice point data table 7 e is generated from high-order matrix coefficients.
  • the matrix coefficients as a basis of the three-dimensional lattice point data table 7 e are also attached to the raw image file.
  • control program to realize the above processing by the CPU 15 is stored in the memory 8 or the memory 9 .
  • FIG. 2 is a block diagram showing the details of the image processor 7 b.
  • the image data inputted from the memory 8 is first supplied to the white balance processor 7 b 1 .
  • the white balance processor 7 b 1 performs white balance processing on the image data using a white balance coefficient.
  • the white balance coefficient is calculated by the CPU 15 based on the data for white balance calculated by the WB circuit 7 a .
  • the white balance coefficient is stored in the memory 8 , and set in the register of the IC 7 in accordance with necessity. Otherwise, it may be arranged such that the white balance processing is performed on the input image data using a preset white balance coefficient (e.g., a white balance coefficient previously set in correspondence with a light source such as daylight, tungsten, fluorescent lamp or the like).
  • the white-balance-processed image data is inputted into the color interpolation unit 7 b 2 , and subjected to color interpolation processing.
  • R, G and B planes are generated from the data patterns ( FIG. 3A ) and ( FIG. 3B ) where RGB are arrayed in lattice.
  • RGB plane image data is subjected to color optimization by a masking processor 7 b 3 using, e.g., 3 ⁇ 3 matrix operation (expression (1)).
  • R′ m 11 ⁇ R+m 12 ⁇ G+m 13 ⁇ B
  • G′ m 21 ⁇ R+m 22 ⁇ G+m 23 ⁇ B
  • B′ m 31 ⁇ R+m 32 ⁇ G+m 33 ⁇ B (1)
  • the image data is supplied via the masking processor 7 b 3 to a gamma converter 7 b 4 .
  • the gamma converter 7 b 4 performs gamma conversion on the image data.
  • a YUV converter 7 b 5 converts the RGB signal image data gamma-converted by the gamma converter 7 b 4 into YUV signals of luminance and color difference components, thereby generates Y, Cb and Cr planes ( FIG. 3D ).
  • the conversion to the YUV signals is performed for false color processing and edge emphasis processing.
  • the luminance signal (Y) among the YUV signals is edge-emphasized by an edge emphasis circuit 7 b 9 . Further, the color difference component signals (UV) among the YUV signals are subjected to noise processing by a median filter 7 b 8 .
  • the edge-emphasized Y signal and the noise-processed UV signals are inputted into the three-dimensional lattice point data table 7 e and color-converted.
  • the YUV data outputted from the three-dimensional lattice point data table 7 e is JPEG-compressed by the JPEG compression unit 7 f.
  • FIG. 4 illustrates a part of the three-dimensional lattice point data table.
  • RGB signals are inputted
  • YUV signals are inputted.
  • the YUV signals may be converted to RGB signals within the three-dimensional lattice point data table 7 e , otherwise, a YUV three-dimensional lattice point data table may be used.
  • P1 [128, 128, 128] holds
  • P2 [160, 128, 128] holds
  • P3 [128, 160, 128] holds
  • P4 [160, 160, 128] holds
  • P5 [128, 128, 160] holds
  • P6 [160, 128, 160] holds
  • P7 [128, 160, 160] holds
  • P8 [160, 160, 160] holds.
  • interpolation is performed in other three positions (P3-P4, P5-P6, P7-P8), and the value of Red in the point [155, 155, 140] is determined.
  • weighting is performed using inverse proportion of distances between the respective line segments P1-P2, P3-P4, P5-P6 and P7-P8 and the point [155, 155, 140] and averaging is performed. These calculations are also performed regarding Green and Blue, thus, RGB values in the point [155, 155, 140] are determined.
  • Red ⁇ m ⁇ ⁇ 01 ⁇ R + m ⁇ ⁇ 02 ⁇ G + m ⁇ ⁇ 03 ⁇ B + ⁇ m ⁇ ⁇ 04 ⁇ R ⁇ R + m ⁇ ⁇ 05 ⁇ G ⁇ G + m ⁇ ⁇ 06 ⁇ B ⁇ B ⁇ + ⁇ m ⁇ ⁇ 07 ⁇ R ⁇ G + m ⁇ ⁇ 08 ⁇ R ⁇ B + m ⁇ ⁇ 09 ⁇ G ⁇ B ⁇ + ⁇ m ⁇ ⁇ 10 ⁇ R ⁇ R ⁇ G + m ⁇ ⁇ 11 ⁇ R ⁇ R ⁇ B + m ⁇ ⁇ 12 ⁇ R ⁇ R ⁇ R + ⁇ m ⁇ ⁇ 13 ⁇ R ⁇ G ⁇ G + m ⁇ ⁇ 14 ⁇ G ⁇ G ⁇ B + m ⁇ ⁇ 15 ⁇ G ⁇ G ⁇ G + ⁇ m
  • the calculation processing requires 19 coefficients, 45 multiplications and 18 additions. Further, similar calculations are performed for Green and Blue.
  • the three-dimensional lattice point data table is not directly stored, but a high-order matrix coefficient set as a basis of the three-dimensional lattice point data table is stored within the camera. Then the three-dimensional lattice point data table is generated using the high-order matrix coefficient set. For example, the above m01-m19 matrix coefficient set is stored, and prior to development processing, R, G and B values of the respective lattice points of the three-dimensional lattice point data table are substituted into the expression (3) and Red values in the respective lattice points are obtained. Similarly, Green and Blue values in the respective lattice points are obtained. In this manner, the three-dimensional lattice point data is generated, and the generated data is set in the three-dimensional lattice point data table 7 e.
  • FIG. 5 is a block diagram showing a functional construction for setting of the three-dimensional lattice point data table according to the first embodiment.
  • FIG. 6 is a flowchart showing three-dimensional lattice point data table setting processing by the CPU 15 .
  • a matrix acquisition unit 51 a mapping unit 52 and an image file generation unit 53 are functions realized by executing the control program stored in the memory 8 or 9 by the CPU 15 .
  • the matrix acquisition unit 51 obtains a matrix coefficient set.
  • the matrix coefficient set is stored in e.g. the memory 9 . Note that in FIG.
  • plural matrix coefficient sets are stored in the memory 9 , and one appropriate matrix coefficient set is selected in accordance with an image-captured scene (a landscape scene, a portrait scene or the like) selected by a user.
  • the mapping unit 52 calculates the values in the respective lattice points of the three-dimensional lattice data table 7 e using the matrix coefficient set obtained at step S 501 and sets the values in the three-dimensional lattice point data table 7 e .
  • a 9-grid lattice point data table where the respective lattice point data include three 1-byte values is generated from a 3 ⁇ 19 matrix coefficient set.
  • step S 504 lossless-compressed raw image data and JPEG-compressed JPEG image data are generated by the image processing IC 7 and stored into the memory 9 .
  • the image file generator 53 obtains the lossless-compressed raw image data and the JPEG-compressed JPEG image data from the memory 9 .
  • step S 505 the image file generator 53 generates a raw image file using the lossless-compressed raw data, the JPEG image data and the matrix coefficient set obtained from the memory 9 .
  • the JPEG image data and the matrix coefficient set are recorded in the raw image file as attendant information.
  • the generated raw image file is stored in the external memory 14 .
  • the image file generator 53 obtains all the matrix coefficient sets and records them as attendant information in the raw image file. Note that it may be arranged such that only the matrix coefficient set used in generation of the lattice point data of the three-dimensional lattice point data table 7 e is recorded as attendant information in the raw image file.
  • any data may be used as long as it is not subjected to at least main image processing such as white balance processing, color separation processing to separate data into luminance and color signals, or color interpolation processing on output signals from a Bayer array.
  • main image processing such as white balance processing, color separation processing to separate data into luminance and color signals, or color interpolation processing on output signals from a Bayer array.
  • the raw image file is not limited to the above raw image file structure as long as attendant information including raw data and matrix coefficient set and JPEG image data are mutually linked.
  • step S 503 to S 506 are repeated. Note that when the matrix coefficient set is changed due to change of image-captured scene or the like, the processing from step S 501 is performed, and a three-dimensional lattice point data obtained by using a new matrix coefficient set is set in the three-dimensional lattice point data table.
  • the data amount of the raw image file can be reduced.
  • the three-dimensional lattice point data table on the digital camera side has been described as above, however, the construction to generate a three-dimensional lattice point data table from the above-described matrix coefficients can be applied to an application which operates on an information processing apparatus.
  • FIG. 7 is a block diagram showing the construction of an image processing apparatus.
  • a CPU 501 realizes respective processings by executing a program stored in a ROM 502 or RAM 503 .
  • the ROM 502 holds a basic input/output system, a boot program and the like in the information processing apparatus.
  • the RAM 503 functions as a main memory of the CPU 501 .
  • a program installed in an external storage device 504 to be executed by the CPU 501 , is loaded into the RAM 503 .
  • a display 505 performs various displays under the control of the CPU 501 .
  • An input device 506 has a keyboard, a pointing device and the like.
  • An interface 507 is connectable with, e.g., the external memory 14 of the digital camera, for reading a raw image file recorded in the external memory 14 into the RAM 503 or the external storage device 504 .
  • FIG. 8 is a block diagram showing a functional construction for image processing realized by the information processing apparatus.
  • the respective units are functions realized by executing a control program loaded in the RAM 503 by the CPU 15 .
  • FIG. 9 is a flowchart showing image processing performed by the information processing apparatus (CPU 15 ).
  • a raw image file generated by the above-described image file generator 53 is obtained.
  • the matrix acquisition unit 58 obtains a matrix coefficient set from a header of the image file. As described above, when plural matrix coefficient sets are recorded, one of them is selected by the user. For example, the application causes the user to select an image-captured scene, and a matrix coefficient set is selected in accordance with the selected scene.
  • the mapping unit 59 calculates values corresponding to the respective lattice points of a three-dimensional lattice point data table 512 (three-dimensional lattice point data) using the matrix coefficient set obtained by the matrix acquisition unit 58 . Then, the three-dimensional lattice point data is set in the three-dimensional lattice point data table 512 . Note that the mapping unit 59 generates a 33-grid lattice point data table where the respective lattice point data include three 2-byte values from a 3 ⁇ 19 matrix coefficient set.
  • step S 604 the raw data acquisition unit 510 obtains raw data from the raw image file, and at step S 605 , image processing using the lattice point data table 512 is performed on the obtained raw data, and a processed image 513 is obtained. That is, step S 605 corresponds to a processor using the image processor 511 and the three-dimensional lattice point data table 512 .
  • a preview display of the image is produced using the JPEG image written in the raw image file (written in the header of the image file).
  • a raw image file is structured so as to have the three-dimensional lattice point data table 512 as above as data
  • the data amount exceeds 210 Kbytes.
  • the three-dimensional lattice point data is stored for plural sets in the memory in the camera and all the lattice point data are written as attendant information into a raw image file by image-sensing data, it is apparent that much time is required for image file writing.
  • the data amount of image file can be reduced and writing time can be reduced by storing a high-order matrix coefficient set (e.g., 3 ⁇ 19 matrix coefficients) as a basis of a three-dimensional lattice point data table.
  • a three-dimensional lattice point data table having grids corresponding to a necessary number of grids can be generated from the matrix coefficients.
  • a three-dimensional lattice point data table in the camera has nine points per one dimension, while the application can generate a three-dimensional lattice point data table having 33 points per one dimension from the same matrix coefficient set. Accordingly, high precision can be maintained in the application.
  • There is a difference in precision between color representation inside the camera and that in the application however, it is effective that priority is given to the color representation precision in the application, while priority is given to high-speed processing on amount-reduced data inside the camera.
  • the digital camera itself performs development processing and generates JPEG data, or the digital camera generates raw data.
  • the raw data is obtained by performing lossless compression or the like on output from CCD or CMOS sensor array without execution of main image processing such as white balance processing.
  • Such raw data is used in desirable imaging by image processing with an information processing apparatus outside the camera.
  • the image processing on the raw data in the information processing apparatus may be the same as the image processing within the camera, however, image processing in the information processing apparatus may not especially be the same as the image processing within the camera. It may be arranged such that image processing which cannot be performed with hardware is realized on an application so as to provide a more excellent image.
  • the number of lattice points of the three-dimensional lattice point data table is not necessary the same as that of the hardware of the camera.
  • the processing by the digital camera (CPU 15 ) according to the second embodiment is as shown in FIGS. 10 and 11 .
  • a data setting unit 61 and an image file generator 62 in FIG. 10 are functions realized by executing a control program by the CPU 15 .
  • the data setting unit 61 obtains three-dimensional lattice point data to be used from the memory 9 , and sets the data in the three-dimensional lattice point data table 7 e .
  • three-dimensional lattice point data to be used is selected in correspondence with e.g. an image-captured scene selected by the user.
  • the three-dimensional lattice point data is held in the memory 9 as shown in FIG. 10 .
  • the three-dimensional lattice point data and the matrix coefficient sets are respectively linked with each other.
  • step S 703 an image file generator 62 obtains the lossless-compressed raw data and the JPEG-compressed image data from the memory 9 .
  • the lossless-compressed raw data and the JPEG-compressed image data are generated by the image processing IC 7 and stored in the memory 9 .
  • step S 704 the image file generator 62 obtains a matrix coefficient set corresponding to the three-dimensional lattice point data table 7 e used in the JPEG compression from the memory 9 .
  • the image file generator 62 generates an image file using the lossless-compressed raw data, the JPEG-compressed image data, and the matrix coefficient set obtained at step S 704 .
  • the generated image file is recorded in the external memory 14 . Note that, as in the case of the first embodiment, when there are plural matrix coefficient sets in the memory 9 , all the matrix coefficient sets may be attached to the raw image file, or it may be arranged such that only the matrix coefficient set used in the generation of the lattice point data of the three-dimensional lattice data table 7 e is attached.
  • step S 702 to S 706 are repeated. Note that when the three-dimensional lattice point data table is changed due to change of image-captured scene or the like, the processing from step S 701 is performed, and the three-dimensional lattice point data table is set using new three-dimensional lattice point data.
  • an image signal is subjected to image processing by the image processor 7 b , and three-dimensional lattice point data to be set in the three-dimensional lattice point data table 7 e is obtained from the memory 9 . Since it is unnecessary to calculate the three-dimensional lattice point data from a matrix coefficient set as in the case of the first embodiment, image storage processing in the camera can be performed at a high speed. On the other hand, as in the case of the first embodiment, a matrix coefficient set is stored in a raw image file. Accordingly, the application software on the information processing apparatus side performs a similar operation to that in the first embodiment.
  • a JPEG image and a matrix coefficient set are attached to a raw image file, further, three-dimensional lattice point data used in the generation of the JPEG image may be recorded in the file.
  • the application can grasp the three-dimensional lattice point data used in the generation of the JPEG image, and can use and reproduce the data.
  • necessary lattice point data of three-dimensional lattice point data table can be calculated by performing high-order matrix operation as a basis of the three-dimensional lattice data table. Accordingly, in a digital camera having a three-dimensional lattice point data table, it is unnecessary to directly hold the lattice point data used in the three-dimensional lattice point data table. Further, when data converted using the three-dimensional lattice point data table stands among lattice points, as calculation can be made from peripheral lattice points including the input data, the interval between lattice points can be rough. Accordingly, the amount of data stored inside the camera can be minimized.
  • the matrix coefficient set utilized by the application and the three-dimensional lattice point data table utilized inside the camera can be adapted to the respective image processings by the application and the camera. Accordingly, images having the same color representation can be obtained by both image processings.
  • the matrix coefficients include data depending on the individual camera or camera model such as bias error in sensor output and color filter characteristic. Accordingly, the characteristics of individual camera or camera model are absorbed in the matrix coefficients, the user can perform appropriate color representation merely by selecting a preferred image-captured scene without consideration of such characteristics of individual camera or camera model. In the application software, the same image as that obtained by image sensing a predetermined chart can be obtained.
  • the data of the three-dimensional lattice point data table may be L*, a*, b* or X, Y, Z as well as Red, Green, Blue or Y, U, V.
  • the three-dimensional lattice point data table 7 e is positioned in the last of the calculation processing for color-representation, however, the three-dimensional lattice point data table as described above may be used in other conversion processing.
  • an image file is delivered from the digital camera to the information processing apparatus via the external memory, however, the image file may be transferred using communication such as USB. Further, the information processing apparatus may be a printer.
  • the dimension of the lattice point data table is not limited to the three dimension.
  • the present invention is apparently applicable to a fouror more dimensional lattice point data table, or two-dimensional or one-dimensional lattice point data table (two-dimensional look-up table or one-dimensional look-up table).
  • the present invention can be implemented as a system, an apparatus, a method, a program or a storage medium. More particularly, the present invention can be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device.
  • the present invention can be implemented by supplying a software program directly or indirectly to a system or apparatus, reading the supplied program code with a computer of the system or apparatus, and then executing the program code, thereby the functions of the foregoing embodiments are implemented.
  • the supplied program corresponds to the flowcharts in the figure described in the embodiments.
  • the program code installed in the computer also implements the present invention.
  • the claims of the present invention also cover a computer program for the purpose of implementing the functions of the present invention.
  • the program may be executed in any form, such as an object code, a program executed by an interpreter, or script data supplied to an operating system.
  • Example of storage media that can be used for supplying the program are a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a non-volatile type memory card, a ROM, and a DVD (a DVD-ROM and a DVD-R).
  • a floppy (registered trademark) disk a hard disk
  • an optical disk a magneto-optical disk
  • an MO a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a non-volatile type memory card, a ROM, and a DVD (a DVD-ROM and a DVD-R).
  • a client computer can be connected to a website on the Internet using a browser of the client computer, and the computer program of the present invention or an automatically-installable compressed file of the program can be downloaded to a recording medium such as a hard disk.
  • the program of the present invention can be supplied by dividing the program code constituting the program into a plurality of files and downloading the files from different websites.
  • a WWW World Wide Web
  • a storage medium such as a CD-ROM
  • an OS or the like running on the computer may perform all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.
  • a CPU or the like mounted on the function expansion board or function expansion unit performs all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.
  • the memory capacity necessary for storage of the lattice point data table can be reduced.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Television Signal Processing For Recording (AREA)
US11/500,430 2005-08-17 2006-08-08 Image capturing apparatus, image processing apparatus and image processing method Abandoned US20070041634A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/087,521 US9083890B2 (en) 2005-08-17 2011-04-15 Image capturing apparatus, image processing apparatus and image processing method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005236734A JP4721415B2 (ja) 2005-08-17 2005-08-17 撮像装置、情報処理装置、情報処理システム及び画像処理方法並びに制御プログラム及びコンピュータ読み取り可能な記憶媒体
JP2005-236734 2005-08-17

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/087,521 Division US9083890B2 (en) 2005-08-17 2011-04-15 Image capturing apparatus, image processing apparatus and image processing method

Publications (1)

Publication Number Publication Date
US20070041634A1 true US20070041634A1 (en) 2007-02-22

Family

ID=37767387

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/500,430 Abandoned US20070041634A1 (en) 2005-08-17 2006-08-08 Image capturing apparatus, image processing apparatus and image processing method
US13/087,521 Expired - Fee Related US9083890B2 (en) 2005-08-17 2011-04-15 Image capturing apparatus, image processing apparatus and image processing method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/087,521 Expired - Fee Related US9083890B2 (en) 2005-08-17 2011-04-15 Image capturing apparatus, image processing apparatus and image processing method

Country Status (2)

Country Link
US (2) US20070041634A1 (enExample)
JP (1) JP4721415B2 (enExample)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080211924A1 (en) * 2007-02-09 2008-09-04 Canon Kabushiki Kaisha Image capturing apparatus, information processing apparatus, and control methods thereof
US20080291319A1 (en) * 2007-04-11 2008-11-27 Red.Com, Inc. Video camera
US20100013963A1 (en) * 2007-04-11 2010-01-21 Red.Com, Inc. Video camera
US20140176743A1 (en) * 2012-12-20 2014-06-26 Thomson Licensing Method, apparatus and system for publishing creative looks as three-dimensional lookup tables
US9521384B2 (en) 2013-02-14 2016-12-13 Red.Com, Inc. Green average subtraction in image data
CN114928730A (zh) * 2022-06-23 2022-08-19 湖南国科微电子股份有限公司 图像处理方法和图像处理装置
US11503294B2 (en) 2017-07-05 2022-11-15 Red.Com, Llc Video image data processing in electronic devices

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5258808B2 (ja) * 2010-02-03 2013-08-07 キヤノン株式会社 画像処理方法及び画像処理装置

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5073818A (en) * 1987-12-23 1991-12-17 Minolta Camera Kabushiki Kaisha Method for processing color image and apparatus therefor
US5757974A (en) * 1996-04-15 1998-05-26 The United States Of America As Represented By The Secretary Of The Navy System and method for data compression
US5956467A (en) * 1996-12-17 1999-09-21 Eastman Kodak Company Encoding color image data for multipass color printers
US5987167A (en) * 1996-03-29 1999-11-16 Nec Corporation Color image display method and apparatus
US6215561B1 (en) * 1997-02-28 2001-04-10 Seiko Epson Corporation Image processing apparatus and image processing method
US20020027603A1 (en) * 2000-09-01 2002-03-07 Seiko Epson Corporation Apparatus, method, signal and computer program product configured to provide output image adjustment for image files
US20020044293A1 (en) * 2000-10-13 2002-04-18 Seiko Epson Corporation Apparatus, method and computer program product for providing output image adjustment for image files
US20030034986A1 (en) * 2001-03-15 2003-02-20 Kenji Fukasawa Color space converting apparatus and method of color space conversion
US20030156194A1 (en) * 1996-12-24 2003-08-21 Mitsubishi Denki Kabushiki Kaisha Color characteristic measurement apparatus, color characteristic measurement method, and picked up image data storage medium
US20040090537A1 (en) * 2002-11-07 2004-05-13 Ryoji Kubo Image sensing apparatus
US20040141192A1 (en) * 2003-01-17 2004-07-22 Rodolfo Jodra Proof-document formatting to enable full-capability remote proofing in a completely standard proofing station
US20050046883A1 (en) * 2003-08-29 2005-03-03 Pentax Corporation Color-space transformation-matrix calculating system and calculating method
US20070195350A1 (en) * 2006-02-17 2007-08-23 Canon Kabushiki Kaisha Image processing file setting system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3907810B2 (ja) * 1998-01-07 2007-04-18 富士フイルム株式会社 ３次元ルックアップテーブルの補正法およびこれを行う画像処理装置ならびにこれを備えたデジタルカラープリンタ
JP2000230862A (ja) * 1998-12-10 2000-08-22 Fuji Photo Film Co Ltd 色票作成方法および装置
JP2002016874A (ja) * 2000-04-28 2002-01-18 Fuji Photo Film Co Ltd 画像処理方法および装置並びにそのためのプログラムを記録した記録媒体
JP2002010095A (ja) * 2000-06-23 2002-01-11 Matsushita Electric Ind Co Ltd カラー画像処理方法及びカラー画像処理装置
WO2002076085A1 (en) * 2001-03-15 2002-09-26 Seiko Epson Corporation Image processing device
JP3793121B2 (ja) * 2002-07-04 2006-07-05 キヤノン株式会社 撮像装置及び画像信号処理方法及びプログラム及び記憶媒体
JP3962642B2 (ja) * 2002-07-08 2007-08-22 キヤノン株式会社 画像処理装置およびその方法
EP1389003B1 (en) * 2002-08-08 2014-01-15 Canon Kabushiki Kaisha Color conversion table generation method and apparatus
US7844109B2 (en) * 2003-09-24 2010-11-30 Canon Kabushiki Kaisha Image processing method and apparatus
JP2005175975A (ja) * 2003-12-12 2005-06-30 Canon Inc 画像処理装置
JP2005354372A (ja) * 2004-06-10 2005-12-22 Olympus Corp 画像記録装置、画像記録方法、画像処理装置、画像処理方法、及び画像処理システム
US7576889B2 (en) * 2004-10-26 2009-08-18 Xerox Corporation Cascade of matrix-LUT for color transformation
JP4677323B2 (ja) * 2004-11-01 2011-04-27 キヤノン株式会社 画像処理装置及び画像処理方法
US8334910B2 (en) * 2007-02-09 2012-12-18 Canon Kabushiki Kaisha Image capturing apparatus, information processing apparatus, and control methods thereof
WO2008128205A1 (en) * 2007-04-13 2008-10-23 Presler Ari M Digital cinema camera system for recording, editing and visualizing images

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5073818A (en) * 1987-12-23 1991-12-17 Minolta Camera Kabushiki Kaisha Method for processing color image and apparatus therefor
US5987167A (en) * 1996-03-29 1999-11-16 Nec Corporation Color image display method and apparatus
US5757974A (en) * 1996-04-15 1998-05-26 The United States Of America As Represented By The Secretary Of The Navy System and method for data compression
US5956467A (en) * 1996-12-17 1999-09-21 Eastman Kodak Company Encoding color image data for multipass color printers
US20030156194A1 (en) * 1996-12-24 2003-08-21 Mitsubishi Denki Kabushiki Kaisha Color characteristic measurement apparatus, color characteristic measurement method, and picked up image data storage medium
US6215561B1 (en) * 1997-02-28 2001-04-10 Seiko Epson Corporation Image processing apparatus and image processing method
US20020027603A1 (en) * 2000-09-01 2002-03-07 Seiko Epson Corporation Apparatus, method, signal and computer program product configured to provide output image adjustment for image files
US20020044293A1 (en) * 2000-10-13 2002-04-18 Seiko Epson Corporation Apparatus, method and computer program product for providing output image adjustment for image files
US20030034986A1 (en) * 2001-03-15 2003-02-20 Kenji Fukasawa Color space converting apparatus and method of color space conversion
US20040090537A1 (en) * 2002-11-07 2004-05-13 Ryoji Kubo Image sensing apparatus
US20040141192A1 (en) * 2003-01-17 2004-07-22 Rodolfo Jodra Proof-document formatting to enable full-capability remote proofing in a completely standard proofing station
US20050046883A1 (en) * 2003-08-29 2005-03-03 Pentax Corporation Color-space transformation-matrix calculating system and calculating method
US20070195350A1 (en) * 2006-02-17 2007-08-23 Canon Kabushiki Kaisha Image processing file setting system

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8334910B2 (en) * 2007-02-09 2012-12-18 Canon Kabushiki Kaisha Image capturing apparatus, information processing apparatus, and control methods thereof
US20080211924A1 (en) * 2007-02-09 2008-09-04 Canon Kabushiki Kaisha Image capturing apparatus, information processing apparatus, and control methods thereof
US9019393B2 (en) 2007-04-11 2015-04-28 Red.Com, Inc. Video processing system and method
US8358357B2 (en) 2007-04-11 2013-01-22 Red.Com, Inc. Video camera
US7830967B1 (en) 2007-04-11 2010-11-09 Red.Com, Inc. Video camera
US8174560B2 (en) 2007-04-11 2012-05-08 Red.Com, Inc. Video camera
US8237830B2 (en) 2007-04-11 2012-08-07 Red.Com, Inc. Video camera
US20100013963A1 (en) * 2007-04-11 2010-01-21 Red.Com, Inc. Video camera
US9230299B2 (en) 2007-04-11 2016-01-05 Red.Com, Inc. Video camera
US9792672B2 (en) 2007-04-11 2017-10-17 Red.Com, Llc Video capture devices and methods
US8872933B2 (en) 2007-04-11 2014-10-28 Red.Com, Inc. Video camera
US8878952B2 (en) 2007-04-11 2014-11-04 Red.Com, Inc. Video camera
US20100265367A1 (en) * 2007-04-11 2010-10-21 Red.Com, Inc. Video camera
US20080291319A1 (en) * 2007-04-11 2008-11-27 Red.Com, Inc. Video camera
US9787878B2 (en) 2007-04-11 2017-10-10 Red.Com, Llc Video camera
US9436976B2 (en) 2007-04-11 2016-09-06 Red.Com, Inc. Video camera
US9245314B2 (en) 2007-04-11 2016-01-26 Red.Com, Inc. Video camera
US9596385B2 (en) 2007-04-11 2017-03-14 Red.Com, Inc. Electronic apparatus
US20140176743A1 (en) * 2012-12-20 2014-06-26 Thomson Licensing Method, apparatus and system for publishing creative looks as three-dimensional lookup tables
US9521384B2 (en) 2013-02-14 2016-12-13 Red.Com, Inc. Green average subtraction in image data
US9716866B2 (en) 2013-02-14 2017-07-25 Red.Com, Inc. Green image data processing
US10582168B2 (en) 2013-02-14 2020-03-03 Red.Com, Llc Green image data processing
US11503294B2 (en) 2017-07-05 2022-11-15 Red.Com, Llc Video image data processing in electronic devices
US11818351B2 (en) 2017-07-05 2023-11-14 Red.Com, Llc Video image data processing in electronic devices
US12301806B2 (en) 2017-07-05 2025-05-13 RED Digital Cinema, Inc. Video image data processing in electronic devices
CN114928730A (zh) * 2022-06-23 2022-08-19 湖南国科微电子股份有限公司 图像处理方法和图像处理装置

Also Published As

Publication number Publication date
JP2007053544A (ja) 2007-03-01
US9083890B2 (en) 2015-07-14
US20110193992A1 (en) 2011-08-11
JP4721415B2 (ja) 2011-07-13

Similar Documents

Publication Publication Date Title
US9083890B2 (en) Image capturing apparatus, image processing apparatus and image processing method
US20080013787A1 (en) Imaging apparatus, image processor, image filing method, image processing method and image processing program
JP4325552B2 (ja) 画像処理装置、画像処理方法及び画像処理プログラム
CN1806425A (zh) 具有减小的图像缓冲存储器和最小处理用于通过服务中心回收的数字照相机
US20040247175A1 (en) Image processing method, image capturing apparatus, image processing apparatus and image recording apparatus
JP2004173010A (ja) 撮像装置、画像処理装置、画像記録装置、画像処理方法、プログラム及び記録媒体
JP2004304712A (ja) 画像処理方法及び装置
JP2008236726A (ja) 撮像装置、撮像システム、撮像方法及び画像処理装置
CN101682788B (zh) 信号处理方法和信号处理系统
WO1999023817A1 (en) Dual mode digital camera for video and still operation
JP4497945B2 (ja) 撮像装置
US8334910B2 (en) Image capturing apparatus, information processing apparatus, and control methods thereof
US7728886B2 (en) Image recording apparatus and method
JP3793121B2 (ja) 撮像装置及び画像信号処理方法及びプログラム及び記憶媒体
CN100418376C (zh) 摄影设备及图像处理方法
EP1679660B1 (en) History adding device for generating history-added image file, electronic camera, and image processing program for processing history-added image file
JP4533287B2 (ja) 色処理方法およびその装置
JP5552795B2 (ja) 撮像装置、画像処理装置およびプログラム
US7469059B1 (en) Reorganization of raw image data for processing
JP4752421B2 (ja) 画像レタッチ方法、画像レタッチ装置及び画像レタッチプログラム
JP2010124114A (ja) デジタルカメラおよび画像データ処理プログラム
JP4307862B2 (ja) 信号処理方法、信号処理回路、及び撮像装置
JP5138057B2 (ja) 撮像装置及び情報処理装置及び画像処理方法
JP2000217124A (ja) 撮像装置及び前記撮像装置における画像処理方法
JP2006203573A (ja) 撮像装置、画像処理装置及び画像記録装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SUGIMORI, MASAMI;REEL/FRAME:018145/0543

Effective date: 20060804

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION