JP2006148436A - Imaging apparatus, electronic processing terminal, and image processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing system capable of reducing processing time. <P>SOLUTION: A digital camera 1 and a PC 10 are interconnected via a USB cable 11 or the like for communication. The PC 10 transmits image data of a RAW image and an arithmetic parameter to the digital camera 1 via the cable 11, and when the image data are already present in the digital camera 1, the PC 1 transmits only the arithmetic data. The image data received by the digital camera 1 are sequentially processed in a white balance section, a pixel interpolation section, a color space conversion section; a gamma conversion section, a YCrCb conversion section; an edge emphasis section, an LPF section, and an RGB conversion section on the basis of the arithmetic parameter. The digital camera 1 transmits the image data subjected to the processes above to the PC 10 via the cable 11. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to processing of image data captured by a digital camera.

  As a file format of image data captured by a digital camera, a JPEG format or a TIFF format is known. However, when the file is generated in the JPEG format or the TIFF format, there is a problem that the image data is deteriorated. In the following, the file generation procedure and the reason for deterioration will be described.

  In a digital camera, image data captured by a CCD is converted into a digital format by an AD conversion unit. Then, after performing shading correction, white balance control, pixel interpolation, color space conversion, and γ conversion as necessary, YCrCb conversion is performed to generate a luminance image and a color difference image. Sharpness adjustment (edge enhancement) is performed on the luminance image, and smoothing is performed on the color difference image.

  In the JPEG format, the luminance image and the color difference image are generated as an image file (JPEG file) after being subjected to JPEG compression. Further, in the TIFF format, the luminance image and the color difference image are generated as an image file (TIFF file) after being subjected to RGB conversion.

  The data size after AD conversion usually has a bit length larger than 8 bits, but the bit length gradually decreases in the above image processing (for example, data originally having a 12-bit length is 10 bits after color space conversion). The bit length becomes 8 bits after γ conversion). Finally, in the JPEG format or the TIFF format, the bit length of the image data is 8 bits for each of R (red), G (green), and B (blue).

  If the bit length becomes small and a digit loss occurs, it means that the data is deteriorated. Further, JPEG compression is irreversible compression, and image degradation occurs due to compression.

  The RAW format is used as a file format for preventing such image deterioration. In the RAW format, image data converted into a digital format by the AD converter is generated as an image file (RAW file) after only shading correction. Therefore, no compression is performed and the number of missing digits can be minimized, so that image deterioration can be reduced.

  An image file generated in the digital camera is transferred to an electronic processing terminal such as a PC (personal computer), and can be browsed using an image processing application called a viewer in JPEG or TIFF, and further image processing can be performed. The RAW file can be browsed after the development processing, and since the above-described various processing has not been performed in advance, it is possible to perform image processing with high accuracy and high flexibility.

  As described above, in the RAW format, the image data after AD conversion is generated as an image file after only shading correction is performed. Therefore, when developing the RAW file on the PC, it is necessary to perform image processing on the RAW file such as white balance control, pixel interpolation, color space conversion, and γ conversion on the PC. At this time, since the RAW file has a large bit length and therefore a large amount of data, there is a problem that the processing time becomes long.

  The present invention has been made to solve the above problems, and an object thereof is to provide an image processing system capable of reducing processing time.

  In order to solve the above-described problem, an image processing system according to the invention described in claim 1 is an image processing system including an imaging device and an electronic processing terminal that can be connected to the imaging device. By an instruction means for instructing a predetermined process, an information request means for making an information request as to whether or not the image data to be subjected to the predetermined process is stored in the imaging apparatus, and the information request means Information providing means for providing information on whether or not the storage is performed in response to the information request, and the predetermined processing when the storage is denied in the information provision by the information providing means Specialized in a specific image processing function including the pre-processing data transmission means for transmitting the image data to the imaging device, a reception means for receiving the transmitted image data, and the predetermined processing. Processing means for obtaining the processed image data by performing the predetermined processing on the received image data, and post-processing data transmission means for transmitting the processed image data to the electronic processing terminal It is characterized by having.

  An image processing system according to a second aspect of the present invention is an image processing system including an imaging device and an electronic processing terminal connectable to the imaging device, and an instruction for instructing predetermined processing on the image data Means, information requesting means for making an information request as to whether or not the image data to be subjected to the predetermined processing is stored in the imaging apparatus, and the information request by the information requesting means in response to the information request In the information provision by the information provision means, the information provision means includes information provision means for providing information as to whether or not storage is performed, and specialized processing means specialized for a specific image processing function including the predetermined processing. Processing means for obtaining processed image data by performing the predetermined processing on the image data stored in the imaging apparatus when the storage is affirmed; and the processed image data Characterized by having a a processed data transmitting means for transmitting to the electronic processing terminal.

  According to a third aspect of the present invention, there is provided an imaging apparatus comprising: instruction means for instructing predetermined processing on image data; and whether or not the image data to be subjected to the predetermined processing is stored. An information requesting means for making an information request; and an unprocessed data transmitting means for transmitting the image data to be subjected to the predetermined processing when the storage is denied in providing information in response to the information request. An imaging apparatus that can be connected to a processing terminal, the information providing means for providing the information as to whether or not the storage is performed in response to the information request by the information requesting means, and the transmitted image data Receiving means for receiving and specialized processing means specialized for a specific image processing function including the predetermined processing, and performing the predetermined processing on the received image data to obtain processed image data Characterized in that it has a management unit, and processed data transmitting means for transmitting the processed image data to the electronic processing terminal.

  According to a fourth aspect of the present invention, there is provided an electronic processing terminal that determines whether or not the storage is being performed in response to an information request regarding whether or not image data to be subjected to predetermined processing is being stored. Information providing means for providing information, receiving means for receiving the image data, and specialized processing means specialized for a specific image processing function including the predetermined processing, and the received image data An electronic processing terminal that can be connected to an imaging apparatus having processing means for performing predetermined processing to obtain processed image data, and post-processing data transmission means for transmitting the processed image data, to the image data An instruction means for instructing the predetermined processing, an information requesting means for requesting the information, and the image to be subjected to the predetermined processing when the storage is denied in the information provision by the information providing means And having a pre-processing data transmitting means for transmitting over data to the imaging apparatus.

  An image pickup apparatus according to a fifth aspect of the present invention is directed to an instruction unit that instructs a predetermined process on image data, and whether or not the image data that is a target of the predetermined process is stored. An information requesting unit for requesting information, and an information processing unit that can be connected to an electronic processing terminal and that provides information on whether or not the storage is performed in response to the information request by the information requesting unit Providing means, and specialized processing means specialized for a specific image processing function including the predetermined processing, and when the storage is affirmed in the information provision by the information provision means, Processing means for obtaining the processed image data by performing the predetermined processing on the stored image data, and post-processing data transmission means for transmitting the processed image data to the electronic processing terminal. It is characterized in.

  In addition, the electronic processing terminal according to the invention described in claim 6 determines whether or not the storage is performed in response to an information request whether or not the image data to be subjected to the predetermined processing is stored. Information providing means for providing information, and specialized processing means specialized for a specific image processing function including the predetermined processing, and when the storage is affirmed in the information provision by the information providing means, Connectable to an imaging device having processing means for obtaining the processed image data by performing the predetermined processing on the stored image data and post-processing data transmission means for transmitting the processed image data An electronic processing terminal, comprising: instruction means for instructing the predetermined processing on the image data; and information request means for making the information request.

  Further, an image processing system according to a seventh aspect of the present invention is the image processing system according to the first aspect, wherein the pre-processing data transmission means sets a parameter for specifying a processing content of the predetermined processing. It transmits to an imaging device, It is characterized by the above-mentioned.

  An electronic processing terminal according to an eighth aspect of the invention is the electronic processing terminal according to the fourth aspect, wherein the pre-processing data transmission means sets the parameter for specifying the processing content of the predetermined processing. It transmits to an imaging device, It is characterized by the above-mentioned.

  An image processing system according to the invention described in claim 9 is the image processing system according to claim 2, further comprising means for transmitting a parameter for specifying the processing content of the predetermined processing. And

  An electronic processing terminal according to a tenth aspect of the present invention is the electronic processing terminal according to the sixth aspect, further comprising means for transmitting a parameter designating processing content of the predetermined processing to the imaging apparatus. It is characterized by having.

  An image processing system according to an eleventh aspect of the present invention is the image processing system according to the second aspect, wherein the image data is stored in a removable recording medium.

  An image pickup apparatus according to a twelfth aspect of the present invention is the image pickup apparatus according to the fifth aspect, wherein the image data is stored in a removable recording medium.

  An electronic processing terminal according to a thirteenth aspect of the present invention is the electronic processing terminal according to the sixth aspect, wherein the image data is stored in a removable recording medium.

  In the present invention, the predetermined processing is performed not by the electronic processing terminal but by specialized processing means included in the imaging apparatus. Since this specialized processing means is specialized for a specific image processing function including a predetermined process, the processing time can be reduced as compared with the case where a general-purpose function processing means in the electronic processing terminal is used.

  In the present invention, when image data to be subjected to predetermined processing is stored in the imaging apparatus, transmission of image data from the electronic processing terminal is omitted. Therefore, the processing efficiency can be improved.

<First Embodiment>
<Configuration>
FIG. 1 is a block diagram showing an image processing system according to the first embodiment of the present invention. As shown in FIG. 1, a digital camera 1 as an imaging device and a PC (personal computer) 10 as an electronic processing terminal are connected via a cable 11 for performing communication such as USB.

  The digital camera 1 includes a lens 2 and a finder window 6 on the front surface. Further, the digital camera 1 includes a power button 4 and a shutter button 5 on the upper surface thereof. Further, the digital camera 1 is provided with a media insertion slot 3 on the side surface to which a media 7 that is a storage means (recording medium) composed of a memory card or the like can be attached and detached.

  The PC 10 includes a monitor 14 for outputting information to the user as an image and a keyboard 15 for the user to input information. Further, the PC 10 includes a media insertion slot 12 into which the media 7 can be attached and detached on the front of the main body.

  FIG. 2 is a rear view of the digital camera 1. As shown in FIG. 2, the digital camera 1 includes a finder window 6, a mode switching dial 22, an up / down / left / right key 23, an LCD (liquid crystal monitor) 24, and an enter button 25 on the back surface thereof.

  The viewfinder window 6 is a window for the user to view the subject. The mode switching dial 22 is a dial for switching modes such as a still image capturing mode for capturing a still image, a moving image capturing mode for capturing a moving image, and a playback mode for reproducing the captured image. The up / down / left / right key 23 is a key for selecting various operations such as changing the zoom magnification. The LCD 24 is a screen for displaying image data. The determination button 25 is a button for determining an operation.

  FIG. 3 is a diagram showing a detailed configuration of the digital camera 1.

  In FIG. 3, image data captured by the CCD 32 via the lens 2 is converted into a digital format by the AD conversion unit 37 and then processed by the image data processing unit 33. The image data processed in the image data processing unit 33 is displayed on the LCD 24, written to the medium 7, or temporarily stored in the memory 34 that is a built-in temporary storage unit.

  The lens 2, CCD 32, AD converter 37, image data processor 33, LCD 24, media 7, and memory 34 are controlled by the CPU 31. Further, the image data processing unit 33 can process not only the image data from the AD conversion unit 37 but also the image data stored in the medium 7 or the memory 34.

  The CPU 31 also includes an external I / F (interface) 35 for transmitting / receiving image data and the like to / from the outside through communication such as USB via the cable 11, a power control unit 36 for performing power control of the entire digital camera 1, The entire digital camera 1 including the flash unit 38 as the light emitting means is controlled. The power supply control unit 36 supplies power by using any of the external I / F 35, the AC power supply port 39, and the built-in battery 40.

  Next, processing performed by the image processing unit 33 when image data is generated as a RAW file, a JPEG file, or a TIFF file will be described with reference to FIG.

  In the CCD 32, image data is generated by imaging through the lens 2.

  The generated image data is converted into a digital format by the AD conversion unit 37.

  The image data converted into the digital format is corrected by the shading correction unit 51 in the light amount drop in the area corresponding to the periphery of the lens 2.

  The RAW file is generated as it is in the RAW format for the image data that has been corrected for light loss. As will be described later with reference to FIG. 14, the RAW file includes RAW format image data, tag information such as imaging information, and thumbnail image data. In the JPEG format or TIFF format, the white balance unit 52 performs white balance control using a predetermined gain corresponding to each color of R (red), G (green), and B (blue).

  Pixels of the image data subjected to white balance control are interpolated by the pixel interpolation unit 53. That is, as shown in FIG. 4, when the CCD 32 uses a single plate method in which only one kind of color corresponds to one pixel, such interpolation is necessary.

  The image data in which the pixels are interpolated is subjected to color space conversion into, for example, an sRGB space, if necessary, in the color space conversion unit 54.

  The γ conversion unit 55 corrects the γ value of the image data that has undergone color space conversion.

  The image data on which the γ value has been corrected is converted from the RGB format to the YCrCb format by the YCrCb conversion unit 56. As a result, luminance Y (luminance image data) and color differences (color difference image data) Cr and Cb are generated.

  The generated luminance image data is subjected to sharpness adjustment in the edge enhancement unit 57. The generated color difference image data is smoothed by the LPF unit 58.

  In the JPEG format, the JPEG compression unit 59 performs JPEG compression on the luminance image data that has undergone sharpness adjustment and the color difference image data that has undergone smoothing. In the TIFF format, the luminance image data subjected to sharpness adjustment and the color difference image data subjected to smoothing are converted into the RGB format by the RGB conversion unit 60.

  The image data subjected to JPEG compression or the image data converted into the RGB format is filed as a JPEG file or TIFF file having tag information and thumbnail image data, respectively, and then recorded on the medium 7.

  FIG. 5 is a diagram showing a detailed configuration of the PC 1.

  In FIG. 5, the control unit 41 includes a memory 42 that is a built-in temporary storage unit, an external I / F 43 for transmitting / receiving image data and the like to / from the outside through communication such as USB via the cable 11, It controls the entire PC 10 including a power control unit 44 for power control and a recording hard disk 45.

  The control unit 41 also includes a white balance unit 52a, a pixel interpolation unit 53a, a color space conversion unit 54a, a γ conversion unit 55a, a YCrCb conversion unit 56a, an edge enhancement unit 57a, an LPF unit 58a, a JPEG compression unit 59a, and an RGB conversion. The part 60a is provided.

  These processing units of the control unit 41 have the same functions as the processing units having the same name provided in the image processing unit 33 in FIG. However, while the control unit 41 performs software processing on the image data using a general-purpose function processing unit, the image processing unit 33 is provided by an ASIC or the like provided with a specialized processing unit specialized for a specific image processing function. Thus, the image data is processed by hardware. Therefore, in the processing of image data, the processing speed of the image processing unit 33 is faster than the processing speed of the control unit 41. The image processing system according to the present invention pays attention to this point, and transmits image data from the PC 10 to the digital camera 1 for processing in the image processing unit 33 in processing of image data in a PC image processing application called a viewer. It is characterized by making it.

<Overall operation>
Hereinafter, the overall operation of the image processing system shown in FIG. 1 will be described. In this image processing system, the PC 10 receives an image file generated in the digital camera 1 via the cable 11. The means for receiving is not limited to the cable 11, and a wireless LAN or the like may be used, or the medium 7 may be replaced. In the following operation, the external I / F 43 of the PC 10 functions as a pre-processing data transmission unit that transmits image data to be processed to the digital camera 1. The external I / F 35 of the digital camera 1 functions as a receiving unit that receives image data and the like transmitted from the PC 10, and also serves as a post-processing data transmission unit that transmits processed image data that has been processed to the PC 10. Function. The image processing unit 33 of the digital camera 1 functions as a processing unit specialized for the image processing function. The control unit 41 of the PC 10 functions as an instruction unit that instructs processing on image data.

  First, the basic operation of the image processing system will be described with reference to FIG.

  As shown in FIG. 6A, when the user starts up the viewer on the PC 10, the name of the image data and a thumbnail image obtained by reducing the image data are displayed on the monitor 14. That is, a folder tree including a plurality of image data names is displayed in the folder tree display area 61, and a plurality of thumbnail images 63 to 67 included in each image file are displayed in the thumbnail display area 62.

  Next, as shown in FIG. 6B, when the user selects, for example, a thumbnail image 66 from the thumbnail images 63 to 67 by input from the keyboard 15, an image 66 a corresponding to the thumbnail image 66 is displayed on the monitor 14. The entire screen is displayed.

  Next, the user sets a desired calculation parameter for processing the image 66 a by inputting from the keyboard 15 or the like. As the calculation parameters, a gain in white balance control, a γ value in γ conversion, an edge enhancement strength, a smoothing range in LPF, a weighting coefficient, and the like can be set.

  Next, as shown in FIG. 6C, the PC 10 displays on the monitor 14 an image 66b generated by processing the image 66a based on the set calculation parameter. Thereby, the user can select an arbitrary image and perform processing with desired calculation parameters. FIG. 6C shows a case where the γ value is adjusted so as to lower the luminance as a whole.

  Next, the detailed operation of the image processing system will be described using the flowchart of FIG.

  First, in step S1, thumbnail images 63 to 67 (and a folder tree) are displayed on the monitor 14.

  Next, the process proceeds to step S2, and the user selects the thumbnail image 66.

  In step S3, the PC 10 determines whether the image 66a corresponding to the thumbnail image 66 is in the RAW format (RAW image). If the image 66a is a RAW image, the process proceeds to step S4. If the image 66a is not a RAW image, the process proceeds to step S5.

  In step S4, the expansion process of the image 66a which is a RAW image (conversion process to a displayable image expression format) is performed. At this time, the image data and calculation parameters of the image 66 a are transmitted from the PC 10 to the digital camera 1 via the cable 11. As the calculation parameter, for example, a parameter set as a default in the PC 10 may be used. Further, if it is assumed that image processing is performed in a later step, it is only necessary that the image can be displayed at this point, so that a calculation parameter for development may be provided in the camera.

  Image data received by the digital camera 1 includes a white balance unit 52, a pixel interpolation unit 53, a color space conversion unit 54, a γ conversion unit 55, a YCrCb conversion unit 56, an edge enhancement unit 57, an LPF unit 58, and an RGB conversion unit. At 60, processing is performed in order based on the calculation parameters. The image data subjected to these processes is transmitted from the digital camera 1 to the PC 10 via the cable 11. Then, the process proceeds to step S7.

  In step S5, the PC 10 determines whether the image 66a is in the JPEG format (JPEG image). If the image 66a is a JPEG image, the process proceeds to step S6, JPEG decompression is performed, and then the process proceeds to step S7. If the image b is not a JPEG image, the image b is in the TIFF format (TIFF image), and development and JPEG decompression are unnecessary, and the process directly proceeds to step S7.

  In step S7, the image 66a is displayed on the monitor 14. In other words, when displaying the image 66a from the image file generated by the digital camera 1, in the JPEG image and the TIFF image, the development processing including the processing after the white balance control is unnecessary, but in the RAW image The unfolding process including the process after the white balance control is necessary. Therefore, it is possible to reduce the processing time in the RAW image by performing the expansion processing in the image processing unit 33 having a higher processing speed instead of the control unit 41.

  Next, the process proceeds to step S8, and the PC 10 uses the monitor 14 to ask the user whether to perform predetermined image processing of the image 66a. The user answers whether or not to process the image 66a by an input from the keyboard 15 or the like. If the process is to be performed, the process proceeds to step S9. If the process is not to be performed, the process returns to step S2 to select a desired thumbnail image from the thumbnail images 63 to 67 again.

  In step S9, the user sets desired calculation parameters for processing the image 66a by input from the keyboard 15 or the like.

  Next, in step S10, the PC 10 determines whether the image 66a is a RAW image. If the image 66a is a RAW image, the process proceeds to step S11. If the image 66a is not a RAW image, the process proceeds to step S12.

  In step S11, image processing of the image 66a which is a RAW image is performed. At this time, the image processing is performed on the raw image data before the expansion processing is performed in step S4. Therefore, the RAW image data corresponding to the image 66a and the calculation parameters set in step S9 are transmitted from the PC 10 to the digital camera 1 via the cable 11.

  A RAW image received by the digital camera 1 includes a white balance unit 52, a pixel interpolation unit 53, a color space conversion unit 54, a γ conversion unit 55, a YCrCb conversion unit 56, an edge enhancement unit 57, an LPF unit 58, and an RGB conversion unit. At 60, processing is performed sequentially based on the calculation parameters. Here, development processing and image processing are performed. The image data subjected to these processes is transmitted from the digital camera 1 to the PC 10 via the cable 11. Then, the process proceeds to step S15.

  In step S12, the PC 10 determines whether the image 66a is a JPEG image. If the image 66a is a JPEG image, the process proceeds to step S13, JPEG decompression is performed, and then the process proceeds to step S14. If the image 66a is not a JPEG image, the image 66a is a TIFF image and does not require JPEG decompression, and the process directly proceeds to step S14.

  In step S14, image processing of image data corresponding to the image 66a which is a JPEG image or a TIFF image is performed in the PC 10.

  A JPEG image or a TIFF image does not require white balance control and pixel interpolation, and the subsequent processing only needs to be performed with parameters set. That is, among the color space conversion unit 54, the γ conversion unit 55, the YCrCb conversion unit 56, the edge enhancement unit 57, and the LPF unit 58, the processing set based on the calculation parameters is performed in order. Then, the process proceeds to step S15.

  In step S15, the result of image processing is displayed. Thereby, the user can confirm whether the desired result was obtained. Then, the process proceeds to step S16.

  In step S16, the PC 10 asks the user whether or not to save the image. If so, the process proceeds to step S17. If not, the process ends.

  In step S17, the RAW image processed in step S11 or the JPEG image or TIFF image processed in step S14 generates a file of a corresponding format, and is stored in the memory 42 or the medium 7 by the PC 10. Through the above steps S1 to S17, a series of operations of the viewer is completed.

<Deployment processing>
As described above, in the image processing system according to the present embodiment, the digital camera 1 executes the RAW image expansion processing instead of the PC 10. Below, the operation | movement in this expansion | deployment process is demonstrated using FIGS.

  First, the operation of the PC 10 will be described using the flowchart of FIG.

  First, in step S21, the PC 10 determines whether or not the digital camera 1 is connected. If it is connected, the process proceeds to step S22. If it is not connected, the process proceeds to step S25.

  Next, in step S22, the PC 10 determines whether or not the digital camera 1 is busy (other processing is being executed). If it is busy, the process proceeds to step S25. If it is not busy, the digital camera 1 can execute image processing, and the process proceeds to step S23.

  In step S23, the PC 10 transmits the image data and calculation parameters to the digital camera 1, and proceeds to step S24. That is, in steps S <b> 21 to S <b> 23, the PC 10 refers to information about the digital camera 1 to determine whether the digital camera 1 can execute image processing and performs transmission control.

  In step S24, the PC 10 instructs the digital camera 1 to execute image processing. Then, the processed image data is received from the digital camera 1.

  In step S <b> 25, the PC 10 performs image processing by itself using the control unit 41 without transmitting image data to the digital camera 1. In this case, although it takes more time than the processing by the digital camera 1, it is executed by software processing in the PC 10. The operation of the PC 10 is completed through the above steps S21 to S25.

  Next, the operation of the digital camera 1 will be described using the flowchart of FIG.

  First, in step S31, the digital camera 1 determines whether image data and calculation parameters have been received from the PC 10. And only when it receives, it progresses to step S32.

  In step S <b> 32, the digital camera 1 stores the received image data and calculation parameters in the memory 34 or the medium 7. If the image data is processed, the amount of data increases. However, if the capacity of the storage means is insufficient to store the processed image data, the digital camera 1 stores the data with insufficient capacity. The PC 10 is notified that it cannot. The determination of whether or not storage is possible may be performed by the PC 10 instead of the digital camera 1. Specifically, in the flowchart shown in FIG. 8, following step S22, the PC 10 determines whether the storage capacity of the digital camera 1 is sufficient to store the processed image data. To judge through. Then, if it is sufficient, the process proceeds to step S23, and if it is insufficient, the process proceeds to step S25.

  In step S33, the digital camera 1 determines whether a calculation start command (processing start signal) has been received from the PC 10. And only when it receives, it progresses to step S34.

  In step S34, the digital camera 1 performs processing on the received image data based on the received calculation parameter.

  In step S35, the digital camera 1 stores the calculation result (processed image data) in the memory 34 or the medium 7.

  In step S36, the digital camera 1 transmits a calculation end command to the PC 10.

  In step S37, the digital camera 1 determines whether an arithmetic result transmission command (transmission request signal) has been received from the PC 10. And only when it receives, it progresses to step S38.

  In step S <b> 38, the digital camera 1 transmits the calculation result (processed image data) to the PC 10.

  Through the above steps S31 to S38, the operation of the digital camera 10 is completed. In the above description, the case where processing is performed on one image (66a) has been described. However, when processing is performed on a plurality of images, steps S31 to S38 are repeated for the number of cycles equal to the number of images. Good. Alternatively, steps S31 to S38 may be performed for only one cycle by collectively sending a plurality of image data to the digital camera 1, performing computations, and returning to the PC 10.

  As described above, in the image processing system according to the present embodiment, the expansion process is performed not by the general-purpose function processing unit (control unit 41) in the PC 10, but by the specialized processing unit (image processing unit 33) in the digital camera 10. . Therefore, the processing time can be reduced.

Second Embodiment
In the operation shown in the flowchart of FIG. 9 in the first embodiment, only the part of the digital camera 1 related to computation and communication (transmission / reception of image data) is used. Therefore, in this operation, power supply may be stopped for portions of the digital camera 1 that are not related to computation and communication.

  FIG. 10 is a flowchart showing the operation of the digital camera 1 according to the second embodiment of the present invention. FIG. 10 is obtained by adding step S31-1 prior to step S31 and step S38-1 subsequent to step S38 in FIG.

  In step S31-1, the digital camera 1 uses the power supply control unit 36 to stop power supply to unnecessary parts not related to computation and communication, and perform setting to switch the power supply to an optimal one. Further, in step S38-1, the digital camera 1 uses the power supply control unit 36 to restart the power supply of the portion where the power supply has been stopped and return the power supply to the original state before switching.

  FIG. 11 is a flowchart showing a detailed procedure of step S31-1.

  First, in step S311, the power supply control unit 36 stops power supply to the CCD 32, the flash unit 38, and the like that are not necessary for calculation and communication. That is, the power supply control unit 36 as the power supply control unit according to the present invention selectively supplies power to the reception unit, the processing unit, and the post-processing data transmission unit.

  Next, in step S <b> 312, the power supply control unit 36 determines whether an AC power supply is connected to the AC power supply port 39. If an AC power source is connected, the process proceeds to step S313, and the AC power source is selected as the power source. If the AC power source is not connected, the process proceeds to step S314.

  Next, in step S <b> 314, the power supply control unit 36 determines whether the PC 10 is connected to the external I / F 35 of the digital camera 1 with the cable 11. If the PC 10 is connected, the process advances to step S315 to select the PC 10 as a power source. Here, power is supplied from the PC 10 through the external I / F 35. When PC10 is not connected, it progresses to step S316 and the internal battery 40 (electric storage means) is selected as a power supply.

  As described above, in the image processing system according to the present embodiment, the digital camera 1 reduces power consumption by stopping power supply to a portion not related to computation and communication during computation, and the AC power source, the PC 10, A power source is selected in the order of the built-in battery 40 and priorities. Therefore, by supplying power from the outside of the digital camera 1 as much as possible, the operation can be stabilized as compared with the case where only the built-in battery 40 is used.

  The power supply control unit 35 performs control to switch to another power supply in which no abnormality has occurred according to the procedure shown in steps S312 to S316 in FIG. 11 when an abnormality occurs in the power supply during the calculation. Also good. As a result, the operation can be further stabilized.

<Third Embodiment>
In the operation shown in the flowchart of FIG. 8 in the first embodiment, if it is determined in step S21 that the digital camera 1 is connected, and it is determined in step S22 that the digital camera 1 is not busy, the PC 10 is determined in step S23. After transmitting the image data and calculation parameters to the digital camera 1, the expansion process is executed in the digital camera 1 in step S24. However, depending on the contents of the expansion process, it may be faster to perform the process with the PC 10 instead of the digital camera 1.

  FIG. 12 is a flowchart showing the operation of the digital camera 1 according to the third embodiment of the present invention. FIG. 12 is obtained by adding step S21-1 prior to step S21 in FIG.

  In step S21-1, the PC 10 determines whether the development process is faster with the digital camera 1 or faster with the PC 10. This determination is made based on the calculation capability of the digital camera 1, the calculation capability of the PC 10, the communication time required for data transmission / reception between the digital camera 1 and the PC 10, and the calculation amount. That is, the calculation times predicted by the following equations (1) and (2), that is, the first prediction time T1 and the second prediction time T2, are calculated and compared.

1st prediction time T1 = computation amount / computing capability of digital camera 1 + communication time (1)
Second prediction time T2 = calculation amount / calculation capacity of PC10 (2)
In Expressions (1) and (2), the computing capabilities of the digital camera 1 and the PC 10 are obtained from the number of processor clocks, memory capacity, and the like of each. The calculation amount is determined from the data amount and the calculation content, and the data amount is obtained from the number of pixels of the image. The communication time can be obtained by dividing the data amount by the speed of the communication line (cable 11) between the digital camera 1 and the PC 10.

  If T1 <T2, the PC 10 determines that it is faster to perform the expansion process with the digital camera 1, and proceeds to step S21. Further, when T1> T2, the PC 10 determines that it is faster to perform the expansion process by itself, and proceeds to step S25, where the expansion process is performed by the PC 10.

  As described above, in the image processing system according to the present embodiment, when the PC 10 determines that it is faster to perform the expansion process by itself, the PC 10 performs the expansion process by itself without transmitting image data to the digital camera 1. I do. Therefore, in addition to the effect of the first embodiment, the processing time can be further reduced.

<Fourth embodiment>
In the operation shown in the flowchart of FIG. 9 in the first embodiment, when the digital camera 1 receives a calculation start command from the PC 10 in step S33, the digital camera 1 proceeds to step S34 and tries to execute the calculation. However, as described above, the image processing unit 33 is specially configured for the image processing function. Therefore, the processing speed is higher than the CPU 31, but the degree of freedom of calculation is small. Therefore, depending on the contents of the calculation, even if it can be executed by the control unit 41, it cannot be executed by the image processing unit 33 and an error may occur.

  FIG. 13 is a flowchart showing the operation of the PC 10 according to the fourth embodiment of the present invention. FIG. 13 is obtained by adding steps S33-1 to S33-2 between step S33 and step S34 in FIG. 10 and further adding steps S33-3 to S33-4 branching from step S33-2. It is.

  In step S33-1, the digital camera 1 analyzes whether the calculation parameter stored in step S32 is within a range that can be processed by the image processing unit 33. As this range, for example, the white balance control gain is 0.5 to 2.0, the γ value is 1.0 to 2.0, the edge enhancement gain is 1.0 to 2.0, and the LPF The smoothing size is determined based on the configuration of the image processing unit 33, such as ± 3.

  Next, the process proceeds to step S33-2, and when these calculation parameters are within the above range, it is determined that the calculation is possible, and the process proceeds to step S34 where the digital camera 1 executes the calculation. If these calculation parameters are not within the above range, it is determined that the calculation is impossible, and the process proceeds to step S33-3 to transmit a calculation impossible command from the digital camera 1 to the PC 10. And it progresses to step S33-4 and makes PC10 perform a calculation.

  As described above, in the image processing system according to the present embodiment, when it is determined that the digital camera 1 cannot perform the calculation, the PC 10 performs the calculation. Therefore, there is an effect that errors associated with computation can be reduced.

  In the above description, it has been described that the calculation is executed by the PC 10 when the calculation parameter is not within the executable range in step S33-2. Alternatively, the optimal calculation parameter within the executable range is selected. By using it, the digital camera 1 may execute an approximate calculation. For example, when the γ value is 2.5, which exceeds the upper limit value, the digital camera 1 performs processing by using the upper limit value of 2.0 as the γ value. As a result, it is possible to reduce the processing time while reducing errors associated with the calculation.

  Further, in the above description, it has been described that the analysis and determination of steps S33-1 to S33-2 are performed by the digital camera 1, but this determination is performed by the PC 10 before transmitting image data and calculation parameters to the digital camera 1. May do. When the PC 10 makes the determination and the calculation in the digital camera 1 is impossible, it is possible to prevent image data and calculation parameters from being transmitted from the PC 10 to the digital camera 1. Therefore, the processing efficiency of the image processing system can be improved.

<Fifth Embodiment>
In the unfolding operation shown in the flowchart of FIG. 9 in the first embodiment, the digital camera 1 receives image data and calculation parameters from the PC 10 in step S32. The image data and the calculation parameter may be generated as different files, or may be combined as a single data in the RAW format.

  FIG. 14 is a schematic diagram showing the configuration of a RAW file according to the fifth embodiment of the present invention. The RAW file has a configuration in which tag information D2 (header part) and thumbnail information D3 are added to the image data body D1. The tag information D2 is added including management parameters in addition to management information such as the date when the image data main body D1 was imaged and its size. The thumbnail information D3 is data having a relatively small number of pixels for displaying the thumbnail image 66 in FIG.

  As described above, in the image processing system according to the present embodiment, the calculation parameters are described in the tag information D2, so that the RAW image data and the calculation parameters can be handled as one piece of data. Therefore, it is possible to easily handle RAW image data and calculation parameters.

  In the flowchart of FIG. 9, the digital camera 1 waits for the calculation start command in step S33 and the calculation result transmission command in step S37, and proceeds to the next step. As shown in steps S41 to S45, the process may proceed to the next step without waiting for these commands. In FIG. 15, when the reception of the RAW file is confirmed in step S41, the digital camera 1 automatically executes a calculation and transmits the calculation result (processed image data) to the PC 10. As a result, the operation can be simplified and the processing time can be further reduced.

<Sixth Embodiment>
In the operation shown in the flowchart of FIG. 9 in the first embodiment, the digital camera 1 exchanges data with the PC 10 via the cable 11. However, this data exchange may be performed using the medium 7 instead of the cable 11. That is, the media 7 in which image data and calculation parameters are written in the PC 10 is pulled out from the media insertion slot 12 and inserted into the media insertion slot 3 of the digital camera 1, so that data can be transferred from the PC 10 to the digital camera 1. .

  FIG. 16 is a flowchart showing the operation of the digital camera 1 according to the sixth embodiment of the present invention.

  First, in step S <b> 51, the digital camera 1 determines whether image data exists on the medium 7. If the image data exists, the process proceeds to step S52. If the image data does not exist, the operation ends.

  In step S <b> 52, the digital camera 1 determines whether a calculation parameter exists in the medium 7. When the calculation parameter exists, the process proceeds to step S53, and when the calculation parameter does not exist, the operation ends.

  In step S53, the digital camera 1 performs a calculation based on the detected image data and calculation parameters.

  In step S54, the digital camera 1 writes the calculation result (the image data on which the calculation has been performed) to the medium 7. Through the above steps S51 to S54, the operation of the digital camera 1 is completed.

  Thus, in the image processing system according to the present embodiment, the digital camera 1 receives data by using the medium 7 instead of the cable 11 in the first embodiment. Therefore, the PC 10 does not need to communicate with the digital camera 1 while the digital camera 1 is executing calculations, and can execute other jobs. Therefore, it is possible to further improve the processing efficiency.

<Seventh embodiment>
In the operation shown in the flowchart of FIG. 12 in the third embodiment, it is determined that the calculation is faster in the digital camera 1 than the calculation in the PC 10 in step S21-1, and the digital camera 1 is connected in step S21. If it is determined in step S22 that the digital camera 1 is not busy, the PC 10 transmits image data and calculation parameters to the digital camera 1 in step S23, and then the digital camera 1 executes processing in step S24. Is done. However, when image data to be calculated already exists in the digital camera 1, transmission of image data may be omitted and only calculation parameters may be transmitted.

  FIG. 17 is a flowchart showing the operation of the PC 10 according to the seventh embodiment of the present invention. FIG. 17 is obtained by adding steps S22-1 to S22-2 between step S22 and step S23 in FIG. 12, and further adding step S22-3 branched from step S22-2.

  In step S <b> 22-1, the PC 10 searches whether there is image data to be calculated in the digital camera 1. This search is performed based on attribute information such as the name of the data file, the date of creation, and the capacity. That is, the PC 10 requests the digital camera 1 to provide file attribute information. The digital camera 1 retrieves the contents of the media 7 inserted into the media insertion slot 12 to obtain file attribute information and provides it to the PC 10. The PC 10 checks whether the same file as the image data to be calculated is stored in the digital camera 1 using this attribute information. If the same file as the image data is stored, the process proceeds to step S22-3, and if not stored, the process proceeds to step S23. In step S22-3, the PC 10 omits transmission of image data to the digital camera 1, and only transmits calculation parameters (and calculation start commands).

  In general, in imaging with the digital camera 1 and image processing (development by the viewer) in the PC 10, after imaging with the digital camera 1, the digital camera 1 and the PC 10 are connected, and image data in the digital camera 1 is stored. The procedure of taking in the PC 10 is performed by the user. Accordingly, when image processing is performed by connecting the digital camera 1 that has performed imaging to the PC 10 immediately after imaging, there is a possibility that image data to be calculated already exists in the digital camera 1.

  As described above, in the image processing system according to the present embodiment, when image data to be calculated exists in the digital camera 1, transmission of image data from the PC 10 is omitted. Therefore, the processing efficiency can be further improved.

1 is a configuration diagram illustrating an image processing system according to a first embodiment of the present invention. It is a rear view of a digital camera. It is a figure which shows the detailed structure of a digital camera. It is a figure which shows the structure of CCD. It is a figure which shows the detailed structure of PC. It is a figure which shows the basic operation | movement of an image processing system. It is a flowchart which shows the detailed operation | movement of an image processing system. It is a flowchart which shows operation | movement of PC. It is a flowchart which shows operation | movement of a digital camera. It is a flowchart which shows operation | movement of the digital camera which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the detailed operation | movement of a digital camera. It is a flowchart which shows operation | movement of the digital camera which concerns on 3rd Embodiment of this invention. It is a flowchart which shows operation | movement of PC concerning 4th Embodiment of this invention. It is a schematic diagram showing the format of the RAW data which concerns on 5th Embodiment of this invention. It is a flowchart which shows operation | movement of a digital camera. It is a flowchart which shows operation | movement of the digital camera which concerns on 6th Embodiment of this invention. It is a flowchart which shows operation | movement of PC concerning 7th Embodiment of this invention.

Explanation of symbols

1 Digital Camera 2 Lens 3 Media Slot 4 Power Button 5 Shutter Button 6 Viewfinder Window 7 Media 10 PC (Personal Computer)
11 Cable 12 Media insertion port 14 Monitor 15 Keyboard 22 Mode switching dial 23 Up / down / left / right key 24 LCD (LCD monitor)
25 OK button 31 CPU
32 CCD
33 Image data processing unit 34, 42 Memory 35, 43 External I / F (interface)
36 Power control unit 37 AD conversion unit 38 Flash unit 39 AC power supply port 40 Built-in battery 41 Control unit 44 Power supply control unit 45 Hard disk 51 Shading correction unit 52 White balance unit 53 Pixel interpolation unit 54 Color space conversion unit 55 γ conversion unit 56 YCrCb Conversion unit 57 Edge enhancement unit 58 LPF unit 59 JPEG compression unit 60 RGB conversion units 63 to 67 Thumbnail images 66a and 66b Image D1 Image data body D2 Tag information D3 Thumbnail information

Claims (13)

An image processing system comprising an imaging device and an electronic processing terminal connectable to the imaging device,
Instruction means for instructing predetermined processing to the image data;
Information requesting means for making an information request as to whether storage of the image data to be subjected to the predetermined processing is performed in the imaging apparatus;
Information providing means for providing information as to whether or not the storage is performed in response to the information request by the information requesting means;
Pre-processing data transmission means for transmitting the image data to be subjected to the predetermined processing to the imaging device when the storage is denied in the information provision by the information provision means;
Receiving means for receiving the transmitted image data;
Processing means specialized for a specific image processing function including the predetermined processing, and processing means for obtaining processed image data by performing the predetermined processing on the received image data;
An image processing system comprising: post-processing data transmission means for transmitting the processed image data to the electronic processing terminal. An image processing system comprising an imaging device and an electronic processing terminal connectable to the imaging device,
Instruction means for instructing predetermined processing to the image data;
Information requesting means for making an information request as to whether storage of the image data to be subjected to the predetermined processing is performed in the imaging apparatus;
Information providing means for providing information as to whether or not the storage is performed in response to the information request by the information requesting means;
Specialization processing means specialized for a specific image processing function including the predetermined processing is provided, and the storage is performed in the imaging device when the storage is affirmed in the information provision by the information provision means Processing means for performing the predetermined processing on the image data to obtain processed image data;
An image processing system comprising: a post-processing data transmission unit configured to transmit the processed image data to the electronic processing terminal. Instruction means for instructing predetermined processing to the image data;
Information requesting means for requesting information as to whether or not the image data to be subjected to the predetermined processing is stored;
An image processing apparatus connectable to an electronic processing terminal comprising: pre-processing data transmission means for transmitting the image data to be subjected to the predetermined processing when the storage is denied in providing information in response to the information request There,
Information providing means for providing the information as to whether or not the storage is being performed in response to the information request by the information requesting means;
Receiving means for receiving the transmitted image data;
Processing means specialized for a specific image processing function including the predetermined processing, and processing means for obtaining processed image data by performing the predetermined processing on the received image data;
An image processing apparatus comprising: a post-processing data transmission unit configured to transmit the processed image data to the electronic processing terminal. Information providing means for providing information on whether or not the storage is performed in response to an information request on whether or not the image data to be subjected to predetermined processing is stored;
Receiving means for receiving the image data;
Processing means specialized for a specific image processing function including the predetermined processing, and processing means for obtaining processed image data by performing the predetermined processing on the received image data;
An electronic processing terminal that can be connected to an imaging apparatus having post-processing data transmission means for transmitting the processed image data,
Instruction means for instructing the predetermined processing on the image data;
Information requesting means for making said information request;
Pre-processing data transmission means for transmitting the image data to be subjected to the predetermined processing to the imaging device when the storage is denied in the information provision by the information provision means. Processing terminal. Instruction means for instructing predetermined processing to the image data;
An information requesting means for making an information request as to whether or not the image data to be subjected to the predetermined processing is stored, and an imaging apparatus connectable to an electronic processing terminal,
Information providing means for providing information as to whether or not the storage is performed in response to the information request by the information requesting means;
Specialization processing means specialized for a specific image processing function including the predetermined processing is provided, and the storage is performed in the imaging device when the storage is affirmed in the information provision by the information provision means Processing means for performing the predetermined processing on the image data to obtain processed image data;
An image processing apparatus comprising: a post-processing data transmission unit configured to transmit the processed image data to the electronic processing terminal. Information providing means for providing information on whether or not the storage is performed in response to an information request on whether or not the image data to be subjected to predetermined processing is stored;
The image data that includes specialized processing means specialized for a specific image processing function including the predetermined processing, and in which the storage is performed when the storage is affirmed in the information provision by the information provision means Processing means for performing the predetermined processing to obtain processed image data;
An electronic processing terminal that can be connected to an imaging apparatus having post-processing data transmission means for transmitting the processed image data,
Instruction means for instructing the predetermined processing on the image data;
Information requesting means for making said information request;
An electronic processing terminal comprising: The image processing system according to claim 1,
The image processing system, wherein the pre-processing data transmission means transmits a parameter designating processing content of the predetermined processing to the imaging device. The electronic processing terminal according to claim 4,
The electronic processing terminal characterized in that the pre-processing data transmission means transmits a parameter designating processing content of the predetermined processing to the imaging device. The image processing system according to claim 2,
An image processing system, further comprising means for transmitting a parameter for specifying a processing content of the predetermined processing. The electronic processing terminal according to claim 6,
An electronic processing terminal further comprising means for transmitting a parameter designating processing content of the predetermined processing to the imaging apparatus. The image processing system according to claim 2,
The image processing system, wherein the image data is stored in a removable recording medium. The imaging apparatus according to claim 5,
An image pickup apparatus, wherein the image data is stored in a detachable recording medium. The electronic processing terminal according to claim 6,
The electronic processing terminal, wherein the image data is stored in a removable recording medium.

Images