JP2003309796A - Digital camera and digital picture reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve the photographing and reproduction performance of a digital camera while taking the external utilization of a photographic picture into consideration. <P>SOLUTION: A processing section is provided to reflect the editing of data for display prepared from external output picture data and operation, such as instructions on the number of recording pixels to the external output picture data. The processing section processes the external output picture data or externally outputs information for processing by relating to the picture data. When electronic zoom or the like is done, a thinning rate in preparing the data for display is reduced to retain the picture quality of the data for display. The external output picture data is Raw data. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a digital camera and a digital image reproducing apparatus.

[0002]

2. Description of the Related Art Various proposals have been made for digital cameras and digital image reproducing apparatuses.

For example, as a proposal regarding a digital camera, Japanese Patent Application No. 2000-255699 first creates VGA image data corresponding to the display resolution of the digital camera based on the main image data, and then the main image data and the VGA image data are generated. It has been proposed that a VGA image is displayed on a display device when the image is recorded on a memory card and is reproduced and displayed, and the main image data is read into a buffer memory during the display.

Further, in the digital camera, the zoom range is expanded by so-called electronic zoom. Regarding the electronic zoom, JP-A-4-373270 and JP-A-20
01-45364, Japanese Patent Laid-Open No. 2001-111880, and the like, measures for reducing the resolution when an image is enlarged and displayed by electronic zoom are being studied.

[0005]

SUMMARY OF THE INVENTION An object of the present invention is to improve the shooting and reproduction of an image in a digital camera while keeping in mind the use of the shot image outside.

[0006]

In order to solve the above-mentioned problems, the present invention provides a display data creating section for creating display data for image data output to the outside, and a display data displayed on the display section. There is provided a digital camera having a processing unit that reflects an operation of an operation unit on data to corresponding image data output to the outside. In response to the operation of the operation unit, the processing unit processes the image data to be output to the outside, or outputs the information for processing the image data to the outside in association with the image data. A specific example of the operation of the operation unit is an instruction for editing image data or recording the image data.

As described above, according to the present invention, display data is created for the image data output to the outside, and this is displayed on the display section. This eliminates the need to process the image data itself so that it can be displayed, and the operation can be reflected on the image data by operating the display data.

According to the detailed feature of the present invention, the storage unit for storing the display data is provided even after the image data is output to the outside, and the reproduction based on the display data in the storage unit is possible. Become.

Further, according to the detailed feature of the present invention, the image data output to the outside is Raw data from the image pickup unit, and the Raw data is manipulated through an operation on the display data without performing interpolation compression. The operation of the department can be reflected.

The image data can be output to the outside by storing the image data in a removable storage medium mounted on the mounting portion and taking it out.

According to the detailed feature of the present invention, the display data creating section corrects the display data based on the operation of the operation section with respect to the display data displayed on the display section. As a result, the same correction as that reflected on the image data output to the outside by the operation of the operation unit can be added to the display data.

According to another feature of the present invention, the image display unit while preventing the image deterioration due to the instruction of the image data output to the outside and the instruction of the image data output to the outside from the instruction of the instruction unit. There is provided a digital camera, comprising: a display data creation unit that creates display data for display in. As a result, the image quality of the display data can be kept good even if the image data deteriorates.

Specific examples of the image deterioration caused by the instruction of the instruction unit include a case where an instruction to use a partial area of the image data is given by electronic zooming or trimming, or a recording pixel of the image data is thinned out. This occurs when these images are reproduced in a predetermined size when an instruction to reduce the number is given. On the other hand, the display data is
Specifically, it is created by reducing the number of pixels of image data by thinning out or the like. In such a case, according to the detailed feature of the present invention, when the instruction from the instruction unit reduces the number of pixels of the image data, the degree of reducing the number of pixels of the image data when creating the display data. Are alleviated (including the case where the number of pixels is not reduced) to create the display data.

The features of the present invention can be applied not only to a digital camera but also to a digital image reproducing device, and are particularly useful for a handy type digital image reproducing device having a small display section.

The detailed features of the present invention will be more apparent from the embodiments of the invention described below with reference to the drawings.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below. FIG. 1 is a block diagram of a digital camera system according to a first embodiment of the present invention. The digital camera is configured as a digital camera-integrated mobile phone 1 and is integrated in the mobile phone. Further, the important part of the function of the digital camera is provided in the server center 2 having a function as an image storage device, and the digital camera integrated mobile phone 1 and the digital camera integrated mobile phone 1 are provided by the wireless communication 3 via the Internet using a public communication line. The server center 2 cooperates to fulfill the function of a digital camera. As a specific example of the wireless communication 3,
A method of connecting to the provider from the mobile phone line and connecting to the server center 2 via the Internet, a method of connecting to the provider's LAN by short-range wireless communication, and then connecting to the server center 2 via the Internet, and a dedicated line for the server center A method of connecting by wireless communication is possible.

The digital camera-integrated mobile phone 1 is controlled by
It is controlled by the processing unit 4, and during a normal call, the telephone mode is selected on the operation unit 6 while looking at the menu on the LCD display unit 5, and the other party is called by the ten keys provided on the operation unit 6. Dial. When a transmission operation is performed by the operation unit 6 after confirming the dial destination, a calling signal is transmitted from the communication unit 7, and when the call is connected, the transmission / reception unit 8 makes a call. If the telephone number of the other party is stored in the telephone directory of the storage unit 9, it is possible to make a call simply by selecting a menu on the operation unit 6 while looking at the LCD display unit 5. The buffer 5a holds display data sent from the control / processing unit 4, and unless the display data in the buffer 5a is rewritten by the control / processing unit 4, the LCD display unit 5 displays the same display. Continued.

On the other hand, in the case of using as a digital camera, the photographing mode or the reproduction mode is selected by the operation section 6 while looking at the menu of the LCD display section 5. At this time, the calling and connection to the server center 2 contracted in advance are automatically performed, and the digital camera-integrated mobile phone 1 and the server center 2 are constantly connected during the subsequent use as a digital camera. Becomes

When the photographing mode is selected, the optical image from the lens (not shown) is repeatedly converted into an electronic image signal by the image pickup unit 11 having an image sensor for about 3 million images. Until the shutter release is performed, thinning-out reading is performed from the image pickup unit 11 under the control of the control / processing unit 4, and this is digitally converted into thinned-out image data by the A / D conversion unit 10 and then transmitted to the control / processing unit 4. Sent. The control / processing unit 4 converts the thinned-out image data into display image data and sends it to the buffer 5a. Since the imaging unit 11 repeatedly performs imaging, thinned-out image data is also repeatedly sent to the control / processing unit 4, and the buffer 5a is rewritten one after another by new display image data. by this,
The image repeatedly captured by the image capturing unit 11 is monitored as a moving image by the LCD display unit 5, and the LCD display unit 5 functions as a finder when used as a digital camera.

When the key assigned as the shutter release button is pressed on the operation unit 6, the control / processing unit 4 controls the reading from the image pickup unit 11 to read all pixels. Digitally converted. The digital data in this state is used by the image pickup unit 1
R because it is the raw data output from the image sensor 1
This is called aw data. The Raw data from the A / D conversion unit 10 is directly sent to the Raw data temporary storage unit 12 and temporarily stored without being subjected to processing such as interpolation and white balance adjustment. The Raw data temporary storage unit 12 is a non-volatile memory and retains the memory even when the digital camera-integrated mobile phone 1 is powered off. When the storage of Raw data is completed, the reading of the imaging unit 11 returns to the thinning-out reading, and the moving image monitor by the LCD display unit 5 is restarted.

The Raw data temporary storage unit 12 stores 1
It has a capacity of 0 images and can store up to 10 images according to the operation of the shutter release button.
However, since the digital camera-integrated mobile phone 1 is always connected to the server center 2, the Raw data temporary storage unit 12 can be operated by operating the shutter release button.
The Raw data stored in is immediately transmitted from the control / processing unit 4 to the communication unit 13 of the server center 2 via the communication unit 7 without being subjected to processing such as interpolation and white balance adjustment and compression processing. To be done. Transmission speed is 20M
If it is about bps, the transmission of Raw data of 3 million pixels is completed within a few seconds. When the transmission is completed and the confirmation is confirmed, the transmitted Raw data is erased from the Raw data temporary storage unit 12 or can be overwritten. Therefore, as long as the connection is always maintained, it is rare that a plurality of Raw data are simultaneously stored in the Raw data temporary storage unit without being transmitted.

The capacity of 10 images in the Raw data temporary storage unit is for continuous shooting or when a failure occurs in the constant connection with the server center. For example, in the case of continuous shooting in which the next image is captured before the transmission of one image is completed, a plurality of Raw data may be simultaneously stored in the Raw data temporary storage unit 12, but the Raw data is As long as the Raw data is stored in the temporary storage unit 12 and the connection is always maintained, R
Since the aw data is transmitted one after another, if the shutter release is interrupted for a while during the continuous shooting, the transmission of the raw data stored in the raw data temporary storage unit 12 proceeds during that time, and the raw data temporary storage unit 12 continues. The free space of is increasing. Also, if there is a problem with the constant connection,
As soon as the constant connection becomes possible, the transmission of Raw data will start automatically. In either case, automatic transmission is continued until it is confirmed that the transmission of all Raw data stored in the Raw data temporary storage unit 12 is completed and the new storage capacity of the Raw data temporary storage unit 12 becomes empty.

The Raw data sent to the server center 2 is sent from the communication unit 13 to the image processing server 15 via the information distribution server 14. When connecting the digital camera-integrated mobile phone 1 and the server center 2, information about who owns the digital camera-integrated mobile phone and what model it is sent to the server center, and the connection record is sent to the user server 16. Will be recorded. The image processing server 15 obtains information such as the color filter array of the image sensor in the image pickup unit 11 based on the record of the user server 16, and interpolates the received Raw data, which is suitable for the image sensor of the image pickup unit 11. Image signals for each color such as R, G, and B are created by performing processing. The image processing server further performs necessary image processing such as white balance adjustment and edge enhancement processing,
The resulting image data is sent to the image conversion server 17 via the information distribution server 14.

The image conversion server 17 performs recording format conversion processing and compression processing on the sent image data to create compressed image data. On the other hand, the image conversion server 17 performs thinning processing on the image data from the image processing server, and based on mobile communication data to be sent to the digital camera-integrated mobile phone 1 when a reproduction request is made, and based on a predetermined standard. Create thumbnail data. The mobile communication data may be compressed according to the Internet image communication standard. The above data is stored in one image folder as one image and is sent to the image recording server 18. FIG. 2 is a table showing the data structure inside such an image folder. Note that the RAW data is deleted by the image conversion server 17 at the time when the compressed image data is created and is stored in the image recording server unless the digital camera-integrated mobile phone 1 gives a special instruction to save the RAW data. It will not be sent. Therefore, in this case, the data amount in the Raw data column of FIG. 2 is empty.

A file name is given to each data in FIG. 2 so that it can be understood that the data is for the same image even if each data is processed separately. Note that each data in FIG. 2 may be put together in one file having such a structure.

The processing of each server in the server center 2 can be designated in advance from the digital camera integrated mobile phone 1. The above-mentioned instruction as to whether or not it is necessary to save the RAW data is one example, and if the setting is made by the operation unit 6 while looking at the menu of the LCD display unit 5, the specified content is set via the communication unit 7 and the communication unit 13. Be transmitted to. From the digital camera-integrated mobile phone 1, the compression rate, the image size, the color balance, the degree of contour enhancement, and the like can be specified, and these are also displayed on the LCD display unit 5.
While viewing the menu, the setting is made by the operation unit 6 and transmitted to the server center 2. Each server in the server center 2 processes, converts, and stores an image based on these designations.

Instead of the designation from the digital camera, image data such as various compression ratios, image sizes, color balances, and degree of contour enhancement are used in the image processing server 15 and the image conversion server 17 on the server center 2 side. Can be created and stored in the image storage server 18, and those suitable for designation from the digital camera-integrated mobile phone 1 or the like can be appropriately output. In this case, a plurality of types of compressed data and mobile communication data in FIG. 2 will be prepared.

In the above configuration, when the key assigned as the shutter release button is pressed and the reading from the image pickup section 11 becomes all pixel reading, A
Raw data is also output from the / D conversion unit 10 to the control / processing unit 4. The control / processing unit 4 thins out and samples it to create data for mobile communication, and further thins it out to create a thumbnail. The created mobile communication data and thumbnails are common to the standard in FIG. 2 created by the server center 2. Further, a file name associated with Raw data for the same image transmitted to the server center 2 is attached to the mobile communication data and the thumbnail. If you give it back, a mobile phone with a built-in digital camera 1
The mobile communication data and thumbnails created internally are given the same file names as those for the mobile communication data and thumbnails created by the server center 2 based on the transmitted Raw data. .

The mobile communication data and thumbnails created by the control / processing unit 4 are stored in the storage unit 9.
Since the storage unit 9 is non-volatile, it does not disappear even if the power switch of the digital camera-integrated mobile phone 1 is turned off. In this way, when the shutter release is performed, Raw data for the same image is stored in the Raw data temporary storage unit 12, and mobile communication data and thumbnails are stored in the storage unit 9. That is, image data other than the compressed data in FIG. 2 is created and held in the digital camera integrated mobile phone.
The mobile communication data and thumbnails stored in the storage unit 9 are intended for reproduction on the digital camera-integrated mobile phone 1, and correspond to when the connection with the server center 2 is impossible, and the server center. The aim is to avoid unnecessary connections between the two.

Next, reproduction of an image by the digital camera-integrated mobile phone 1 will be described. When the reproduction mode is selected on the operation unit 6 and a thumbnail request is required, the server center 2 is connected. When the thumbnail request is transmitted to the server center 2, thumbnails corresponding to the latest predetermined number of images or all images taken on the same day are transmitted from the image storage server 18 to the communication unit 13 via the information distribution server 14 to the communication unit. Sent to 7. A predetermined number of these thumbnails are controlled by the control / processing unit 4 in the buffer 5
sent to a and displayed on the LCD display unit 5. When the number of sent thumbnails is larger than the predetermined number that can be displayed on the LCD display unit 5 at one time, the operation unit 6 can scroll the thumbnails.

In the above, when thumbnails are stored in the storage unit 9, thumbnails in the storage unit 9 are preferentially displayed on the LCD display unit 5 prior to the thumbnail request to the server center 2, and other thumbnails are displayed. Only when the request is made, the server center 2 is connected and the thumbnail is requested as described above.

When one of the thumbnails displayed on the LCD display unit 5 is selected by the operation unit 6, the mobile communication data corresponding to the selected thumbnail is the digital camera-integrated mobile phone 1.
If not, connection is made to the server center 2 and a request for mobile communication data corresponding to the selected thumbnail is made. In response to this, the mobile communication data of the corresponding image in the image storage server 18 is sent from the communication unit 13 to the communication unit 7 via the information distribution server 14. The data for mobile communication is sent to the buffer 5a under the control of the control / processing unit 4 and displayed on the LCD display unit 5. If the mobile communication data is compressed data, the image data is expanded using the expansion function for Internet images in the control / processing unit 4,
It is sent to the buffer 5a. Similarly, every time one thumbnail is selected, corresponding mobile communication data is sent from the server center 2 and displayed on the LCD display unit 5.

Also in the above, when the mobile communication data corresponding to the specified thumbnail is stored in the storage unit 9, instead of requesting the mobile communication data from the server center 2, the mobile communication data in the storage unit 9 is requested. Is displayed on the LCD display unit 5, and when there is no mobile communication data corresponding to the designated thumbnail, the server center 2 is requested for mobile communication data as described above.

The mobile communication data sent from the server center 2 is normally only held by the control / processing section, and the use as a digital camera is terminated and the constant connection with the server center 2 is cut off. At this time, or when the power switch of the digital camera integrated mobile phone 1 is turned off, the digital camera integrated mobile phone 1 loses its power. However, if necessary, it can be immediately reproduced again by the supply from the server center 2.

The mobile communication data once received can be set to be stored in the storage unit 9. With such a setting, even if communication with the server center is impossible in the reproduction mode, only the mobile communication data received can be reproduced by the digital camera-integrated mobile phone 1. Furthermore, it is possible to prevent unnecessary connection to the server center 2.

The thumbnails are stored in the storage unit 9 once sent to the digital camera-integrated mobile phone 1. Therefore, as long as an image is selected from the sent thumbnails, it is not necessary to request the server center 2 to send the thumbnails. When the number of thumbnails stored in the storage unit 9 exceeds a predetermined number, the oldest thumbnail is deleted and replaced with a thumbnail newly supplied from the server center unless otherwise specified.

As described above, the digital camera-integrated mobile phone 1 leaves the functions of image processing, image conversion, and image storage to the server center 2, and has a light structure for acquiring high-quality image data. LCD display 5
With regard to the display at, it can be used in the same manner as a normal digital camera.

Reproduction of thumbnails and data for mobile communication held in the server center 2 is not limited to the digital camera-integrated mobile phone 1 that has taken a picture, but also another digital camera-integrated mobile phone or a browsing device that is qualified to browse. It is possible to access and play the server center 2 from any qualifying mobile device.

When the purpose is only browsing from the digital camera-integrated mobile phone 1 or other mobile device, only the thumbnail or mobile communication data is supplied from the server center 2 as described above. On the other hand, when a print order is placed from the digital camera-integrated mobile phone 1 or another digital camera-integrated mobile phone or mobile device that is qualified to acquire an image, compressed data is supplied from the server center 18 to the inside of the server center. The data is output by the printer provided or the compressed data is sent to the print service organization at a remote place via the communication unit 13. At this time, the print size can be specified from the digital camera integrated mobile phone 1 or the mobile device. In this case, Raw
If the data is an image file stored in the image storage server, the following processing can be performed instead of outputting the compressed data of the image storage server 18. That is, the image conversion server 17 causes the image storage server 18 to generate print data more suitable for the designated print size.
Is newly created based on the Raw data of, and this is compressed and output.

The compressed data is also provided when there is a request for viewing or downloading from a personal computer that is qualified to view / acquire images. In the case of a file in which Raw data is stored, Raw data can be supplied if requested.

In the digital camera-integrated mobile phone 1, when a thumbnail is displayed and a specific thumbnail is designated from the operation unit 6 to delete data, the thumbnail of the image and the mobile communication data Is deleted from the storage unit 9. At the same time, the information on the data deletion operation by the operation unit 6 is provided in the server center 2.
And the entire file of the corresponding image in the image storage server 18, that is, compressed data, mobile communication data, thumbnails, and Raw data if there is Raw data.
w Delete all of the data.

FIG. 3 is an external view of the digital camera-integrated mobile phone 1 in the system as described above, and parts corresponding to those in FIG. The digital camera-integrated mobile phone 1 includes a first body 20 having an operation unit 6 and an LC.
The second body 21 has the D display portion 5, and the second body 21 can be folded toward the front surface at the first hinge portion 22. The operation unit 6 includes a menu operation unit 23, a numeric keypad 24, a transmission operation unit 25, and the like. On the other hand, the microphone 26 that constitutes the transmitter / receiver unit 8 has
7 is also arranged on the second body. First body 2
0 and the second body 21 are folded by the first hinge portion 22, each operation portion and the LCD display portion 5 shown in FIG.
Are all protected inside.

The second body 21 further includes a second hinge portion 28.
Is provided, and by pressing the lock button 29, the upper part from the second hinge part 28 can be folded to the back side. As a result, the first body 2
0 and the second body 21 can be folded back to back,
In that state, the lock button 29 is automatically locked.

The lens 30 for forming an image on the image sensor of the image pickup section 11 is provided on the first body 20. Therefore, FIG.
When the lens 30 faces the same direction as the LCD display unit 5 as described above, it is possible to image itself while checking the LCD display unit 5. Also, in such a state,
It is also possible to use the digital camera-integrated mobile phone 1 as a videophone. That is, the menu operation unit 2
When the videophone mode is selected by 3, the image pickup unit 1
The moving image thinned-out image data, which is thinned out and read from 1, digitally converted by the A / D conversion unit 10 and sent to the control / processing unit 4, is sent to the communication partner via the communication unit 7 while the moving image is compressed by the control / processing unit 4. To be Meanwhile, the communication unit 7
The moving picture information received from the other party via the call is sent to the buffer 5a while being expanded by the control / processing section 4 and displayed on the LCD display section 5.

On the other hand, when the first body 20 and the second body 21 are folded back to back and locked, the lens 30 faces the back surface of the LCD display unit 5, so that the object to be imaged with the lens 30 directed is the LCD display unit 5. The LCD display unit 5 can be made to function as a finder of a digital camera. That is, in this case, it is as easy to use as a normal digital camera. The control / processing unit 4 detects the state in which the first body 20 and the second body 21 are folded back to back and is automatically locked, and the control / processing unit 4 reproduces the image captured in the state of FIG. At the time of display, the image is displayed rotated by 90 degrees. This is the first body 20
This is because when the second body 21 is folded back to back, the LCD display unit 5 can be used while being held in a landscape orientation like a normal digital camera. On the other hand, when reproducing an image taken with the first body 20 and the second body 21 folded back to back in a state as shown in FIG. 3, it is possible to rotate the image signal by 90 degrees and view it on a vertically long screen. It can be so. When such an image is rotated by 90 degrees, the layout of code information such as menus is automatically changed so that the entire vertically and horizontally long screens are fully used. To deal with vertical and horizontal discrepancies by prioritizing that the entire image can be seen rather than using the entire horizontally long screen.

A strobe 31 is provided on the first body 20 for the case where the first body 20 and the second body 21 are folded back to back and used in the same manner as a normal digital camera. This strobe is configured to be capable of emitting light only when the first body 20 and the second body 21 are folded back to back and the locked state is automatically detected. It prevents the light from being inadvertently emitted when the face may be close.
When used as a normal digital camera, one of the buttons of the operation unit 6 such as the ten-key pad 24 may be assigned as the shutter release button, and the antenna 32 on the side surface of the second body 21 may be used also. . In this case, the antenna 32 is configured to be pushed in a little further from the normal storage position, and the shutter release is applied accordingly.

In the above embodiment, the image processing server 15, the image conversion server 17, and the image storage server 18
Is not only a separate server as shown in FIG. 1, but is a single server when it is more convenient to perform comprehensive processing by the same server. Further, the user server 16 also manages charging for each digital camera-integrated mobile phone for services such as image processing, image compression, and image storage.

Further, the server center 1 does not have to be one, and if the same one is provided in each region and the digital camera-integrated mobile phone 1 can access the nearest server center, The processing speed can be increased.
In this case, data is appropriately exchanged between the server centers as needed. For example, when a print request for compressed data is received, the compressed data is transferred from the server center that stores files to the server center that is most convenient for print delivery, and is output by a printer in the transfer destination server center. In order to enable such management, even if a plurality of server centers are provided, each server center shares management information of image data stored in all server centers. Further, it is possible to speed up the processing by providing a plurality of server centers and sharing the functions. For example, it is possible that the first server center is in charge of only image processing and the result is transmitted to another server center in charge of image compression. Further, it is possible to jointly outsource image processing and image compression to a central server center, and a local server center can receive raw data and take charge of image storage only.

Services such as image processing and image compression provided by the server center 2 are not fixed. That is, when an improved version such as image processing or image compression is made, or when a new method is proposed, a notification to that effect is sent to the digital camera-integrated mobile phone 1, and a menu on the display unit 5 is displayed as necessary. Displayed on the screen. Therefore, the user can receive the service of the new digital camera function without replacing the digital camera-integrated mobile phone 1, and if the user does not want the service, he / she can select from the menu to reduce the charge. You can also do it. In the case of a mere bug correction, the service version is updated at the discretion of the server center 1 without giving detailed notification.

When the digital camera-integrated mobile phone 1 is stolen or lost, the service center is requested to stop the service by contacting the server center 1. As a result, the digital camera-integrated mobile phone 1 cannot store more than 10 images of Raw data and cannot use them. Further, since the data which can be stored in the storage unit 9 and which can be browsed on the LCD display unit 5 is limited to the data having a very small size such as the thumbnail and the data for mobile communication, it is impossible to record the image having the image quality worthy of the name of the camera. Therefore, the economic value is remarkably reduced, and it is possible to avoid the involuntary charge from the server center.

The cooperation between the digital camera-integrated mobile phone 1 and the server center 2 has been described above. However, in the embodiment shown in FIG. 1, the digital camera-integrated mobile phone 1 and another mobile phone with an image communication function are connected. Cooperation is also possible. L
When the still image shooting mode dedicated to mobile communication is selected with the operation unit 6 while looking at the menu of the CD display unit 5 and the key assigned as the shutter release button in the operation unit 6 is pressed, the thinning-out reading is performed from the image pickup unit 11, A
One of the thinned image data that is digitally converted by the / D conversion unit 10 and sent to the control / processing unit 4 is compressed by the control / processing unit 4 as a still image and stored in the storage unit 9.
This image data is the same as the mobile communication data in FIG. 2, but is not sent to the server center 2 and is sent directly to another mobile phone with an image communication function via the communication unit 7. On the other hand, the compressed still image information from the other party received via the communication unit 7 is stored in the storage unit 9 and is also expanded by the control / processing unit 4, sent to the buffer 5a and displayed on the LCD display unit 5. To be done. When the still image shooting mode dedicated to mobile communication is selected in this way, all pixels are not read from the image capturing unit 11 when capturing a still image, and data for mobile communication cannot be sent to the server center 2. Instead, it is stored inside the digital camera-integrated mobile phone 1. Further, also during communication, image data is directly exchanged between mobile phones with an image communication function such as the digital camera-integrated mobile phone 1.

FIG. 4 is a main flowchart of the digital camera-integrated mobile phone 1 in the above embodiment. When the power switch is turned on in step S1, it is checked in step S2 whether the digital camera integrated mobile phone 1 is already registered in the server center. When the power switch is turned on for the first time after newly purchasing the digital camera-integrated mobile phone 1, or when the predetermined registration processing is not completed, the process proceeds to step S3, and the connection to the server center 2 is automatically performed. When connection is completed, step S4
In step S5, the predetermined registration / initialization process is performed, and when the process is completed, the connection with the server center 2 is disconnected.

On the other hand, when it is determined in step S2 that the digital camera-integrated mobile phone 1 has been registered, various interrupts are enabled in steps S6 to S10 and the standby state is entered in step S11.

FIG. 5 shows the registration in step S4 of FIG.
/ It is a flowchart which shows the detail of the process performed by the server center 2 in the initialization process. Step S
When the process starts at 21, a predetermined user registration process is performed at step S22. Next, after the purchase of the digital camera-integrated mobile phone 1 or the previous connection from the digital camera-integrated mobile phone 1 to the server center 2, the firmware of the digital camera-integrated mobile phone 1 is upgraded. It is checked in step S23 whether or not the result has been met. If there is a new version of firmware, data is sent from the server center 2 in step S24 to rewrite the firmware of the digital camera integrated mobile phone 1 and update the version. As a result, the firmware in the digital camera-integrated mobile phone 1 is always updated to the latest version, the function is improved, and the trouble is promptly corrected.

In step S25, usage / billing conditions are set. Specifically, a menu of functions of the server center 2 that can be used by the user is displayed on the LCD display unit 5 of the digital camera-integrated mobile phone 1 together with the charging conditions.
According to the instruction from the server center 2, the use / charge condition desired by the user is set from the operation unit 6. This usage / billing condition can be arbitrarily changed later.

In step S26, the digital camera-integrated mobile phone 1 is instructed by the instruction signal from the server center 2.
Each function of is checked once. The check items are both the unique function in the digital camera integrated mobile phone 1 and the function related to the cooperation between the digital camera integrated mobile phone 1 and the server center 2. These are indispensable when a new digital camera-integrated mobile phone 1 is purchased.

In step S27, the digital camera-integrated mobile phone 1 is instructed by the instruction signal from the server center 2.
Shooting test by. This is for checking whether or not the digital camera-integrated mobile phone 1 works well with the server center 2 at the time of purchasing a new digital camera-integrated mobile phone 1. When the above is completed, the registration / initialization process ends in step S28.

FIG. 6 is a flow chart showing details of the photographing test in step S27 of FIG. When the shooting test starts in step S31, first step S31
At 32, the server center 2 sends a signal to the digital camera integrated mobile phone 1 to request the user to take a picture. After the request, start the timer, step S
At 33, it is checked whether a predetermined time has elapsed after the timer was started. If not, step S
Proceeding to 34, it is checked whether or not the Raw data image taken by the user is received. If not received, the process returns to step S33, and thereafter, steps S33 and S44 are repeated until the predetermined time elapses, and the user waits for the photographing.

When the Raw data image is received from the user within the predetermined time, the process proceeds to step S35, and the received R image is received.
The image processing server 15, the image conversion server 17, and the image storage server 18 are caused to function on the aw data. When these are completed, the thumbnail is transmitted to the digital camera integrated mobile phone 1 in step S36. After the transmission, the timer is started, and it is checked in step S37 whether a predetermined time has elapsed after the timer was started.
If it has not elapsed, the process proceeds to step S38, and it is checked whether the user has operated the thumbnail designation by the operation unit 6. If no thumbnail has been designated, the process returns to step S37, and thereafter, steps S37 and S38 are repeated until the predetermined time elapses, and the thumbnail designation by the user is waited.

When the user designates a thumbnail within a predetermined time, the process proceeds to step S39, and the mobile communication data is transmitted to the digital camera integrated mobile phone 1. If the confirmation can be confirmed, the process proceeds to step S40, authentication of completion of the photographing test is performed, and the photographing test is ended in step S41. If the authentication in step S40 is not performed, the user registration is not performed, and the next time the power switch of the digital camera integrated mobile phone 1 is turned on, the process proceeds from step S2 to step S3 in FIG.

On the other hand, step S33 or step S
In 37, if there is no response from the user even after the lapse of a predetermined time, the process jumps to step S41, and the photographing test is immediately terminated. In these cases, the shooting test is not certified.

FIG. 7 is a flow chart showing details of the user registration process in step S22 of FIG. When the process starts in step S51, the product number is checked / input in step S52. Specifically, the product number data is sent from the digital camera integrated mobile phone 1 to the server center 2. At the server center 2,
If the product number is already registered when the user purchases the digital camera-integrated mobile phone 1, this is checked, and if nothing is registered, the sent product number is updated. To enter.

Next, in step S53, the image pickup unit information is checked / input. This information relates to information such as the color filter array of the image sensor in the image pickup unit 11 of the digital camera-integrated mobile phone 1, and the image processing server 1
5 is indispensable when performing interpolation processing or the like on the RAW data sent. With respect to these pieces of information, communication between the digital camera-integrated mobile phone 1 and the server center 2 checks information uniquely determined from the product number, and individual input from each digital camera-integrated mobile phone 1.

The above steps S52 and S5
When the user registration process starts, the process 3 is automatically performed by the communication between the digital camera integrated mobile phone 1 and the server center 2.

In step S54, it is checked whether personal information such as the user's name, sex, age, address and telephone number has already been input. If it has not been input, in step S55 a signal is sent to the digital camera integrated mobile phone 1 to request the user to input information. After the request, the timer is started, and it is checked in step S56 whether a predetermined time has elapsed after the timer was started. If it has not elapsed, the process proceeds to step S57, and it is checked whether or not the user has completed the input of predetermined user information using the operation unit 6. If not completed, the process returns to step S56, and thereafter, steps S56 and S57 are repeated until the predetermined time elapses, and the completion of the user information input is awaited.

When the input of the user information is completed within the predetermined time, the process proceeds to step S58, the user registration completion authentication is performed, and the user registration process ends in step S59. If the authentication in step S58 is not performed, the user registration is not performed, and the next time the power switch of the digital camera integrated mobile phone 1 is turned on, the process proceeds from step S2 to step S3 in FIG.

On the other hand, in step S56, if the input of the user information is not completed even after the lapse of the predetermined time, the process jumps to step S59 and the user registration process is immediately terminated. In this case, user registration completion authentication is not performed.

FIG. 8 shows the portable telephone 1 with a built-in digital camera when the operation section 6 is operated and the photographing mode is selected in the standby state of step S11 in FIG.
3 is a flowchart of the operation of FIG. When the shooting mode interrupt is activated by the menu selection of the operation unit 6 and the flow starts in step S61, the display of the LCD display unit 5 is started in step S62, and the image of the thinning-out reading by the image pickup unit 11 is displayed and the LCD display unit 5 is displayed. Functions as a finder. Next, in step S63, the release interrupt is enabled.

In step S64, it is checked whether or not the digital camera-integrated mobile phone 1 and the server center 2 are connected, and if they are not connected, the call to the server center 2 is started in step S65. After the calling is started, the timer is started, and it is checked in step S66 whether a predetermined time has elapsed after the timer was started. If it has not elapsed, the process proceeds to step S67 to check whether the connection to the server center 2 is successful. If the connection is not established, the process returns to step S66, and thereafter, steps S66 and S67 are repeated until the predetermined time elapses, and the connection to the server center 2 is waited.

If the connection to the server center 2 is successful within the predetermined time, it is checked in step S68 whether or not the untransmitted Raw data remains in the Raw data temporary storage unit 12. If there is Raw data that has not been transmitted, step S
After performing the transmission process in 69, the process proceeds to step S70. The transmission process in step S69 is similar to steps S84 and S85 in FIG. 9 described later. On the other hand, if there is no Raw data remaining in step S68, the process directly proceeds to step S70. In step S70, it is checked whether the initialization process has been completed. this is,
Specifically, it corresponds to the test completion authentication in step S40 of FIG. 6 or the user registration completion authentication in step S58 of FIG. 7, and it is determined that initialization is not performed without any of these authentications. If so, the initialization process is performed in step S71, and the process proceeds to step S72 to wait for the release operation and wait. On the other hand, when it is determined in step S70 that the initialization process is completed, the process directly proceeds to step S72. This initialization process is similar to that of FIG.

When it is determined in step S64 that the digital camera-integrated mobile phone 1 is connected to the server center 2, the process directly jumps to step S72 and stands by. If the connection to the server center 2 cannot be established even after the lapse of the predetermined time in step S66, the intermittent call initiation process is performed in step S73,
It jumps to step S72 and stands by. Intermittent call processing refers to the server center 2 while the shooting mode is continued.
Until a successful connection is made with step S65.
It is a process for repeating the operation from.

FIG. 9 is a flow chart showing the operation when a release interrupt occurs. When the release interrupt is triggered by the operation of the operation unit 6 and the flow starts in step S76, all pixels are read out from the image pickup unit 11, and in Step S77, the Raw data temporary storage unit performs temporary storage of Raw data for all pixel readout. To be done.
Along with this, the thumbnails are stored in the storage unit 9 in step S78. Further, in step S79, the storage unit 9 stores the mobile communication data. The above thumbnails and mobile communication data are stored in the image capturing unit 1.
Ra for reading all pixels from 1 to the control / processing unit 4
It is created by thinning out w data in the control / processing unit 4.

In step S80, it is checked whether the mobile phone 1 with a built-in digital camera is connected to the server center 2. If the connection is not established, a call is made to the server center 2 in step S81. After the calling is started, the timer is started, and it is checked in step S82 whether a predetermined time has elapsed after the timer was started. If it has not elapsed, the process proceeds to step S83 to check whether the connection to the server center 2 is successful. If the connection is not made, the process returns to step S82, and thereafter, steps S82 and S83 are repeated until the predetermined time elapses, and the connection to the server center 2 is waited.

If the connection to the server center 2 is successful within the predetermined time, the photographed Raw data is transmitted to the server center 2 in step S84. If the transmission is successful, a new Raw is added to the Raw data in step S85.
A process to the effect that data may be overwritten is performed and step S8 is performed.
Wait for the next release at 6 and wait. This is substantially equivalent to deleting the transmitted data from the Raw data temporary storage unit 12 and reserving the capacity for storing new Raw data.

If the digital camera-integrated mobile phone 1 is connected to the server center 2 in step S80, the process directly jumps to step S84 to execute the transmission. In addition, if it is not possible to connect to the server center 2 within the predetermined time in step S82, the process proceeds directly to step S86.
Fly to and wait. In this case, untransmitted Raw data remains in the Raw data temporary storage unit.

FIG. 10 is a flowchart of the operation of the digital camera integrated mobile phone 1 when the operation section 6 is operated and the reproduction mode is selected in the standby state of step S11 in FIG. When a reproduction mode interruption is caused by the menu selection of the operation unit 6, step S9
The flow starts at 1 and the display on the LCD display unit 5 is started at step S92 to prepare for the display of thumbnails. In step S93, it is checked whether or not there is a thumbnail in the storage unit 9, and if there is no thumbnail, it is checked in step S94 whether the digital camera integrated mobile phone 1 is connected to the server center 2. If not connected, step S
At 95, the call to the server center 2 is started. After the calling is started, the timer is started, and it is checked in step S96 whether a predetermined time has elapsed after the timer was started. If it has not elapsed, the process proceeds to step S97,
Check if the connection to the server center 2 is successful. If the connection is not established, the process returns to step S96, and thereafter, steps S96 and S97 are repeated until the predetermined time elapses, and the connection to the server center 2 is waited.

If the connection to the server center 2 is successful within a predetermined time, it is checked in step S98 whether untransmitted Raw data remains in the Raw data temporary storage unit 12. If there is Raw data that has not been transmitted, step S
After performing the transmission process in 99, the process proceeds to step S100.
The transmission process in step S99 is similar to the above-described steps S84 and S85 in FIG. If there is no untransmitted Raw data in step S98, the process directly proceeds to step S100.

In step S100, the server center 2
A predetermined number of thumbnails are received from step S101
Then, they are stored in the storage unit 9. And step S10
2. Enable thumbnail designation interrupt in step S10
Wait at 3.

If there is a thumbnail in the storage unit 9 in step S93, the process directly jumps to step S102 to enable thumbnail interruption. Further, in step S94, the digital camera-integrated mobile phone 1 is transferred to the server center 2
If it is determined that the connection with the
Jump to 00 to receive the thumbnail.

Furthermore, when the connection to the server center 2 cannot be made within the predetermined time in step S96,
It directly jumps to step S103 and stands by. In this case, it means that the reproduction mode is not set, but in practice, some kind of thumbnail is stored in the storage unit 9, and such an operation does not occur. This operation is to prevent the flow from hanging when there is no thumbnail in the storage unit 9 and the connection to the server center 2 cannot be made due to some accident.

Incidentally, from step S93 to step S10.
When the user jumps to step 2 and enters the standby state and wants a thumbnail other than the one existing in the storage unit 9, the flow from step S94 can be entered by inputting that effect from the operation unit 6.

FIG. 11 is a flow chart showing the operation when a thumbnail designation interrupt occurs. When one of the thumbnails is specified by the operation of the operation unit 6, the flow starts in S111, and it is checked in step S112 whether there is mobile communication data corresponding to the thumbnail specified in the storage unit 9. If there is no designated data, the call to the server center 2 is started in step S113. After the calling is started, the timer is started, and it is checked in step S114 whether a predetermined time has elapsed after the timer was started. If it has not elapsed, the process proceeds to step S115 to check whether the connection to the server center 2 is successful. If the connection is not established, the process returns to step S114, and thereafter, steps S114 and S115 are repeated until the predetermined time elapses, and the connection to the server center 2 is waited for.

If the connection to the server center 2 is successful within the predetermined time, the process proceeds to step S116, the mobile communication data corresponding to the designated thumbnail is received from the server center 2, and this is stored in the storage unit in step S117. Store in 9. Then, in step S118
Is displayed on the LCD display unit 5 in step S1.
It enters the standby state at 19.

When it is determined in step S112 that the mobile communication data corresponding to the designated thumbnail is stored in the storage unit 9, the process directly jumps to step S118 to display it on the LCD display unit 5. Also, step S1
When the connection to the server center 2 cannot be made within the predetermined time at 14, the process jumps to step S119 to enter the standby state.

FIG. 12 is a flowchart showing the operation when the digital camera-integrated mobile phone 1 receives a communication. When a call is made to the digital camera-integrated mobile phone 1 from the outside, the flow starts in step S121, and in step S122, it is checked whether the digital camera-integrated mobile phone 1 is connected to the server center 2.
If there is no connection, there is no problem, so the flow advances to step S123 to start reception. After starting reception, step S124
Check whether or not a specific number is input from the sender within a predetermined time. The input of this specific number is carried out as a countermeasure against the case where the digital camera-integrated mobile phone 1 is lost or stolen. If the user makes a call to the digital camera-integrated mobile phone 1 from the outside and connects, It is something to enter.

When it is confirmed in step S124 that the specific number has been input, the normal mode interrupt is prohibited in step S125. As a result, the digital camera-integrated mobile phone 1 thereafter does not have the shooting mode interrupt, the playback mode interrupt, and the phone mode interrupt even if the operation unit 6 is operated, and the normal operation as a digital camera and a mobile phone is prevented. Can no longer be used. Note that reception interrupts are not prohibited.

Further, in step S126, the disconnection interrupt is prohibited. As a result, thereafter, the mobile phone having the digital camera-integrated mobile phone 1 cannot operate the operation unit 6 to turn off the power switch.

After the above, the evidence collection photographing interrupt is enabled in step S127. After that, this interruption occurs when one having the digital camera-integrated mobile phone 1 operates any one of the operation units 6, and the photographing mode interruption is automatically issued, and after the release interruption becomes possible, the interruption is automatically performed. The release interrupt is applied. As a result, shooting is automatically performed and Raw data is transmitted to the server center 2. As can be seen from FIG. 3, the face of the person who operates the operation unit 6 is normally about 50 cm away from the lens 30, so that the digital camera-equipped mobile phone 1 can be obtained by the above automatic photographing. A photograph of the person's face is automatically taken and sent to the server center 2 to become an evidence photograph. Even if the user notices this and tries to turn off the power switch, the transmission to the server center 2 cannot be stopped because the disconnection interrupt is prohibited in step S126.

After changing the functions of the digital camera-integrated mobile phone 1 as described above, the reception connection is disconnected and the phone is disconnected in step S128. Immediately after that, step S
In 129, the shooting mode interrupt is automatically set,
After the release interrupt becomes possible, the release interrupt is automatically applied in step S130 to perform the first evidence-gathering photographing. In this way, the evidence collection photography can be performed by calling the digital camera integrated mobile phone 1 from the outside, and after the evidence collection photography interruption is enabled in step S127,
The operation is repeatedly performed according to the operation of the operation unit 6 by the one having the digital camera-integrated mobile phone 1. Although the flow ends in step S131, if the release interrupt is correctly received in step S130,
It does not reach step S131 but jumps to step S76 in FIG.

If the specific number is not input in step S124, the call is a normal call.
The normal telephone mode is set at 32, and the flow ends at step S131. If the server center 2 which is the digital camera-integrated mobile phone 1 is being connected in step S122, the connected output is returned to the transmitting side in step S133, and the LCD indicates that there is an incoming call in step S134.
It is displayed on the display unit 5, and the flow ends in step S131. In other words, in this case, it is treated as busy and reception is not performed. In addition, looking at the incoming call information display performed in step S134, when the telephone mode is switched to the telephone mode by the operation unit 6 while the other party is making a call, a disconnection interruption occurs and the connection to the server center 2 is cut off. Reception of the outgoing call starts, and the call becomes possible.

FIG. 13 is a flow chart showing the operation when a disconnection interrupt for the connection with the server center 2 is issued. When the power switch is turned off or the telephone mode is switched by the operation unit 6, a disconnection interrupt occurs and the flow starts in step S141. In step S142, the Raw data that has not been transmitted at that time is R.
It is checked whether or not it remains in the aw data storage unit 12, and if it remains, it is determined that transmission is in progress and the process proceeds to step S143. In step S143, it is checked whether or not a disconnection interruption has occurred due to switching to the telephone mode. If the mode is not the telephone mode, it means that the disconnection interrupt has been generated by turning off the power switch, so the process proceeds to step S144, and it is checked whether Raw data still remains. If it still remains, the transmission has not been completed, and thus the transmission is awaited in step S144. When the transmission is completed, the process proceeds to step S145, the connection to the server center 2 is cut off, and the flow ends in step S146. In this way, when the disconnection interrupt due to the power switch being turned off occurs when the RAW data remains, the connection to the server center 2 is disconnected after waiting for the transmission of the RAW data.

On the other hand, if it is determined in step S143 that a disconnection interruption has occurred due to switching to the telephone mode, the process proceeds to step S147, and transmission interruption processing is performed. In the transmission interruption process, first, the raw data transmission is immediately stopped, and overwriting of the raw data is prohibited. Therefore, when the connection with the server center 2 is made next time, the Raw data is retransmitted from the beginning. Further, in the transmission interruption process of step S147, the server center 2 side is also notified of the interruption of the transmission, and the server center 2 receives the Raw partially received.
The data is canceled, and it is considered that the Raw data was not transmitted from the beginning for the image. After performing the above processing, the connection with the server center 2 is promptly cut off in step S145 to cope with the switching to the telephone mode. This allows the user to make an emergency telephone call.

FIG. 14 is a main flow of the server center 2. When the flow starts in step S151,
In step S152, it is confirmed whether a new service is newly prepared in the server center 2. The new service is improvement or addition of functions of the digital camera-integrated mobile phone 1. If there is a new service, a program for actually proposing a new service to the digital camera-integrated mobile phone 1 is prepared in step S153, and the proposal interruption is enabled in step S154.

In step S155, the registration / initialization process interruption is enabled, and corresponds to the case where there is a connection from the digital camera integrated mobile phone 1 for the purpose of the registration / initialization process in FIG. Further, in step S156, it is possible to enable the photographing interruption, and correspond to the case where there is a connection from the digital camera integrated mobile phone 1 according to the photographing mode interruption of FIG. Further, in step S157, reproduction interruption is enabled,
This corresponds to the case where there is a connection from the digital camera-integrated mobile phone 1 according to the reproduction mode interrupt of FIG. A step S158 enables a contract change interrupt for a contract change operation from the operation unit 6 during connection with the digital camera-integrated mobile phone 1. After enabling these interrupts, a standby state is set in step S159.

FIG. 15 is a flowchart showing the operation when the digital camera-integrated mobile phone 1 is connected to the server center 2. Connection for the purpose of registration / initialization processing in FIG. 5, or shooting mode interrupt in FIG.
If the digital camera-integrated mobile phone 1 is connected according to the reproduction mode interrupt of step 1, the flow starts in step S161, and the connected digital camera-integrated mobile phone is identified in step S162 and related. The user server information is confirmed. The information items confirmed at this time are the same as the information checked / input in step S52 and step S53 in FIG.

When the confirmation of the information of the user server is completed, it is checked in step S163 whether it is a photographing interruption. If it is not a shooting interruption, register in step S164 /
It is further checked if it is an initialization interrupt. Registration /
If the interrupt is an initialization interrupt, the process in FIG.
When the registration / initialization processing in step 1 is performed and this is completed, it is checked in step S166 whether the proposal interruption is enabled. If the proposal interruption is possible, the process proceeds to step S167 to perform service proposal processing.
Specifically, a proposal interruption is made, the contents of the new service proposal are sent to the digital camera-integrated mobile phone 1, and according to the user's response, whether or not to provide the new service, and if so, what are the usage / billing conditions? Or something.

When the service proposal process is completed, step S
Proceeding to 168, when there is a defect such as a bug in the firmware of the digital camera-integrated mobile phone, the firmware is automatically rewritten to the revised version as necessary. Whether or not this rewriting has been completed can be checked by the information of the user server confirmed in step S162, so this processing is performed only for those that have not been rewritten. After the above processing, the flow ends in step S169.

If it is not a registration / initialization interrupt in step S164, it is a reproduction interrupt. Therefore, in step S170, processing for responding to the reproduction mode interrupt of FIG. 10 is performed, and the flow advances to step S166. On the other hand, if the shooting interrupt is determined in step S163, the process responding to the shooting mode interrupt in FIG. 8 is performed in step S171, and the process jumps to step S168. In the image capturing process in step S171, the information necessary for control from the server center 2 is utilized, if necessary, among the information of the user server regarding the digital camera integrated mobile phone 1 confirmed in step S162.

Note that, in the above, the proposal interrupt is performed for the reproduction mode interrupt as in the case of the registration / initialization interrupt if the proposal interrupt is possible, whereas the proposal interrupt is possible for the shooting mode interrupt. However, I refrain from proposing interruptions. This is for the user who made the shooting mode interrupt,
This is because it does not interfere with the photo opportunity.

FIG. 16 is a block diagram of the second embodiment of the present invention, and the same parts as those of the first embodiment in FIG. 1 are designated by the same reference numerals. The second embodiment in FIG. 16 is not configured as a digital camera integrated mobile phone, but is configured as a digital camera back 42 for a silver halide film camera 41. The fact that a part of the functions of the digital camera is provided in the server center 2 and the point that the digital camera cooperates with the server center 2 by the wireless communication 3 is the same as in the first embodiment. The detailed configuration of the server center 2 in FIG. 16 is the same as that in FIG.

The silver salt film camera 41 has a normal structure, but the replaceable back cover is removed and the digital camera back 22 is attached instead. As a result, a subject image formed by the photographing optical system 43 is formed on the image sensor 44. Unlike the first embodiment, the digital camera back 42 itself does not have a taking lens. The image sensor 44 is a large area type provided directly on the focal plane of the photographing optical system 43.

As an alternative to the above, a reduction re-imaging optical system is provided in front of the image sensor 44 as the structure of the digital camera back 42 side to reduce and re-image the image of the focal plane of the photographing optical system. The image sensor 44 is formed on the secondary focal plane of the optical system.
The image sensor 44 can be of a small area type.

As described above, the digital camera back 42 mounted on the silver halide camera 41 constitutes a digital camera as a whole. The silver salt film camera 41 and the digital camera back 42 are electrically coupled by an interface 45 and an interface 46,
The control / processing unit 47 of the silver film camera 41 is in digital communication with the control / processing unit 4 of the digital camera back 42. The control / processing unit 47 of the silver salt film camera 41 receives an operation signal from the operation unit 48, and controls the shutter mechanism 49 and the focusing mechanism and zooming mechanism of the photographing optical system 43. Therefore, in the second embodiment, the shutter release is performed by the shutter release button in the operation unit 48 of the silver halide film camera 41, and the shutter release signal issued by the shutter release button causes the control / processing unit 47, the interface 45 and the interface 46 to be released. Controlled through
/ It is transmitted to the processing unit 4. As a result, the reading from the imaging unit 11 becomes all-pixel reading, which is digitally converted by the A / D conversion unit 10 and stored in the Raw data temporary storage unit 12. Other operations such as storage of thumbnail data and mobile communication data in the storage unit 9 and transmission of Raw data from the Raw data temporary storage unit 12 to the server center 2 are described in the flowcharts of FIGS. 2 and 4 to 15. It is similar to the first embodiment, including the one shown.

The silver salt camera 41 is provided with a photometric and colorimetric section 51 for measuring the light passing through the photographing optical system. Based on the photometric information, the shutter speed and the aperture are controlled to adjust the exposure and the color. Colorimetric information such as temperature is recorded in the information recording section of the magnetic recording layer or film cartridge coated on the film and provided to the laboratory as print information. When the digital camera back 42 is attached to the silver salt camera 41, the color measurement information from the photometric color measurement unit 51 at the time of shutter release is the control / processing unit 47 and the interface 4.
It is also sent to the control / processing unit 4 via 5 and 46. This colorimetric information is sent to the server center 2 together with the Raw data when the Raw data is sent to the server center 2. The image processing server 15 shown in FIG. 1 in the server center 2 performs white balance adjustment based on the sent colorimetric information such as color temperature.

The LCD display section 50 of the digital camera back 42 is larger than that in the first embodiment, and is horizontally arranged. Therefore, the number of thumbnails that can be displayed is increased, the mobile communication data can be displayed large, and the two screens can be displayed in parallel by operating the operation unit 6.

It is also possible to request the server center 2 to transmit the compressed data of FIG. 2 by operating the operation unit 6. In this case, when confirming that the request is from the digital camera back, the server center 2 recreates the compressed data into a smaller file size suitable for display on the LCD display unit 50 and transmits it.

As described above, in the second embodiment, the back cover of a normal silver-salt film camera is removed and the photographing optical system 4 is used.
By arranging the image sensor 44 instead of the silver salt film on the focal plane of No. 3, it functions as a digital camera. Further, the essential configuration of the digital camera back 42 is an image sensor with a high pixel count and a communication function, and like the first embodiment, the server center 2 is responsible for image processing, image conversion including compression, and image storage. Therefore, the digital camera back 42 can have a simple structure despite having a high-quality image pickup function.

FIG. 17 is a block diagram of the third embodiment of the present invention, and the same parts as those of the second embodiment in FIG. 16 are designated by the same reference numerals. The third embodiment shown in FIG. 17 has basically the same configuration as the second embodiment shown in FIG. 16, but the third embodiment of FIG. The configuration is further simplified. The fact that a part of the functions of the digital camera is provided in the server center 2 and that the digital camera cooperates with the server center 2 by the wireless communication 3 is the same as in the first and second embodiments. 17, the detailed configuration of the server center 2 is the same as that of FIG. 1, and the detailed configuration of the silver halide film camera 41 is the same as that of FIG.

The difference between FIG. 17 and FIG. 16 is that a short-distance communication unit 62 for exchanging signals with the mobile phone 60 is provided instead of the communication unit 7. The short-distance communication unit 62 is specifically composed of a short-distance radio communication unit, and is connected to the short-distance communication unit 63 provided in the mobile phone 60 by a short-distance radio communication 64. This simplifies the configuration of the digital camera back 61, and eliminates the need to make a mobile phone contract and have a telephone number with the digital camera back 61 itself.

In the mobile phone 60, the short-range communication section 63 is configured to send and receive digital signals to and from the normal mobile phone function section 65, and the wireless communication 3 by the mobile phone function section 65 allows the server center 2 to communicate. Connecting. In this way, the digital camera back 61 via the short-range communication unit 62, the short-range communication unit 63, and the mobile phone function 65.
And the server center 2 can cooperate.

Since the user usually carries the mobile phone 60, the appearance in which the digital camera back 61 is attached to the silver halide camera 41 is as convenient as the normal digital camera for the user, and the user can use the mobile phone 60. You can concentrate on shooting without being aware of the operation. For example, when the digital camera back 61 is set to the shooting mode, the process proceeds to step S65 according to the flowchart of FIG. 8, and the control unit 4 causes the mobile phone function unit 65 of the mobile phone 60 to connect to the server center 2 via the short-range communication units 62 and 63. To make a call to. Below, according to the flow chart, if the connection is successful, the digital camera bag and the server center 2 are always connected. As for other functions, the relationship between the control unit 4 and the communication unit 7 in FIG. 16 (equal to the relationship in FIG. 1) and the control unit 4 and the mobile phone function unit via the short-range communication units 62 and 63 in FIG. It can be understood by replacing it with the relationship with 65.

The short-range communication section 62 and the short-range communication section 63 may be infrared communication means instead of the short-range radio wave communication means. If wireless communication is not desired, the shortest distance communication unit 62 and the short distance communication unit 63 may be provided with cable connectors, respectively, and the two may be directly connected by a cable. Will be configured. In this case, a mobile phone holder is provided on the digital camera back 61 so that the mobile phone 60 and the digital camera 61 can be handled integrally.

Further, in order to further simplify the structure of the digital camera back, in FIG.
The CD display unit 50, the buffer 5a, etc. are omitted, and the LCD display unit originally provided in the mobile phone 60 is used for display, and the memory provided for the original function of the mobile phone 60 is also used for storage. Utilize the department. As a result, the essential configuration of the digital camera back 61 is essentially only the peripheral device including the image sensor with a high pixel count and its output interface, and the configuration of the digital camera back becomes simpler and lower in cost.

FIG. 18 is a table showing another embodiment of the data structure inside the image folder. Raw data and mobile communication data are the same as in FIG. Unlike FIG. 2, the compressed data and the thumbnails are collected as a general-purpose image file according to a predetermined standard such as EXIF, and header information is added. Header information includes items such as camera name, user information such as the photographer, file version designation by the photographer, shooting date, shutter speed, aperture, focal length, shooting information such as whether flash is used, etc. when creating a general-purpose image file. It contains the necessary information. These pieces of information are sent together with Raw data to the server center 2 from the digital camera integrated mobile phone of FIG. 1 or the digital camera back of FIG. 16 or FIG.
When the image conversion server 2 creates compressed data and thumbnails and puts them together in a general-purpose image file, they are written in the header section of the general-purpose image file as header information. This allows the server center 2 to create a general-purpose image file according to a predetermined standard.

In the above embodiments, FIG. 1 has been described as a digital camera-integrated mobile phone, but if the transmitter / receiver 8 and the telephone mode are omitted, the embodiment is a digital camera. On the other hand, although FIGS. 16 and 17 have been described as the digital camera back to be mounted on the silver halide camera, if both are fixed, it becomes an embodiment dedicated to the digital camera. Therefore, the features of the present invention are not necessarily limited to the digital camera integrated mobile phone or the digital camera back.

FIG. 19 is a block diagram relating to the fourth embodiment of the present invention, and the portions common to the first embodiment in FIG. 1 are designated by the same reference numerals. In addition,
The digital camera 71 shown in FIG. 19 is not a digital camera-integrated mobile phone like that shown in FIG. 1 and does not have a voice call function. However, it is optional to configure the mobile phone with a digital camera by adding the handset 8 as shown in FIG. Further, the function of the storage unit 9 in FIG. 1 is included in the control / processing unit 72 in FIG. 19 and is not shown separately. Further, the image pickup unit 11 and the A / D conversion unit 10 in FIG. 1 are integrated as an image pickup unit 73 in FIG. 19, and digital image data is directly output from the image pickup unit 73, and a Raw data temporary storage unit 1
2 and the control / processing unit 72.

Now, the fourth embodiment in FIG. 19 is
Instead of transmitting Raw data to the outside as in FIG. 1, the Raw data is stored in the mass storage unit 74 and stored in the digital camera 7.
Hold within 1. For this purpose, the large-capacity storage unit 74 is composed of a small hard disk device having a storage capacity of a gigabyte level or a nonvolatile solid-state memory. The RAW data in the large-capacity storage unit 74 is stored in the home-use personal computer 7 after the digital camera 71 is brought home after use.
Input to the personal computer 75 by connecting to 5.
Specifically, by connecting the input / output unit 76 of the digital camera 71 to the input / output unit 78 of the personal computer 75 by the high-speed digital cable 77, the Ra of the mass storage unit 74 is increased.
The w data is input to the control / processing unit 79 of the personal computer 75 via the control / processing unit 72 and "developed".

The encryption processing section 8 of the digital camera 71
0 indicates the Raw data temporary storage unit 12 to the large capacity storage unit 7
When storing Raw data in 4, the encryption process is applied to this. Raw from the digital camera 1 to the personal computer 75
As described above, data is normally input directly by the high-speed digital cable 77. However, when the storage capacity of the large-capacity storage unit runs out or when the user wants to immediately send Raw data, the communication unit 7 can be used. In some cases, Raw data may be transmitted to the personal computer 75 via the public line via the public line. The cryptographic processing unit 80 is intended to maintain security in this case. With this configuration, the image data cannot be obtained unless it is input to the personal computer 75 and the code is decrypted. Therefore, the security of the image data itself is possible, and even if the digital camera 71 alone is taken away, it is useless. It has an anti-theft effect and is suitable for commercialization as a rental camera. The operation unit 81 is
Although the configuration is basically the same as that of the operation unit 6 in FIG. 1, operations compatible with the digital camera 71 are possible.

The encrypted Raw data input to the control / processing unit 79 of the personal computer 75 is returned to the regular Raw data by the decryption function 82. The interpolation function 83 uses this R
Interpolation processing suitable for the image sensor of the image pickup unit 73 is performed on the aw data to create image signals for each color such as R, G, and B. The image processing function 84 performs necessary image processing such as white balance adjustment and edge enhancement processing on the image signal for each color. The image conversion function 85 performs recording format conversion processing and compression processing on the image data that has undergone image processing to create compressed image data. The image conversion function 85 further performs thinning processing on the image data that has undergone image processing to create "data for mobile communication" and thumbnail data based on a predetermined standard. The above data is stored in one image folder as one image folder and stored in the storage unit 86. The structure is similar to that shown in FIG. 2, for example. The “mobile communication data” is input / output unit 78 for viewing the image with the digital camera 71.
From the control / processing unit 72 via the high-speed digital cable 77
Can be transferred to and stored in.

The personal computer 75 also functions as an image storage device, and uses the operation unit 87 such as a keyboard and a mouse and the display unit 88 such as a monitor to search and appreciate the image data stored in the storage unit 86 and give a print instruction. It can be performed. The functions of these image storage devices are executed by the album function 89.

The function of the control / processing unit 79 as described above is
The program software is installed on the personal computer 75 from the input / output interface 90. The input / output interface 90 is specifically a CD-ROM drive or a communication function, and the above-mentioned program is a CD-ROM that stores this.
The program itself that can be downloaded via the ROM or the communication function is commercialized as a set with the digital camera 71.

The digital camera 7 immediately after the photographing is performed.
For reproduction at 1, the same Raw data stored in the Raw data temporary storage unit 12 at the image capturing timing is input from the image capturing unit 73 to the control / processing unit 72. The Raw data is thinned by the control / processing unit 72, and the display data and thumbnail data of an image size suitable for display on the LCD display unit 5 (corresponding to “mobile communication data” in the first embodiment). And is stored in association with the Raw data stored in the Raw data temporary storage unit 12. The reproduction by the digital camera 71 is performed based on the display data and the thumbnail data thus stored in the storage unit (corresponding to the storage unit 9 in FIG. 1) in the control / processing unit 72. Since the reproduction in the digital camera 71 is only performed within the small screen of the LCD display unit 5, such a small amount of data is sufficient, and it is necessary to compare raw data with full-scale interpolation and image processing for storage. Then, the load on the digital camera 71 is remarkably reduced, and the processing time is shortened, so that continuous shooting is also possible.

Further, the configuration and control of the LCD display unit 5
If the functions such as the creation of the display data in the processing unit 72 are omitted at all, the digital camera 71 does not perform the reproduction, and the image is confirmed after being “developed” by the personal computer 75, The configuration of the digital camera 71 becomes simpler. This usability is familiar to users of silver halide cameras. Furthermore, according to the present invention, an image cannot be obtained unless "developed" by a personal computer, so all the images are collected in the personal computer through the act of "developed" and managed by the album function, so it is dissipated. There is no.

FIG. 20 is a block diagram relating to the fifth embodiment of the present invention, and the same parts as those of the fourth embodiment of FIG. 19 are designated by the same reference numerals. Figure 2
The fifth embodiment of 0 is similar to the fourth embodiment.
The digital camera 101 and the personal computer 102 are used, but the mass storage unit 74 in FIG. 19 is configured as a removable mass storage medium 103. The large-capacity storage medium 103 is constituted by a card-type removable hard disk drive or a non-volatile solid-state memory card. The mass storage medium 103 is the storage medium slot 1
04 is removable, after use, remove the mass storage medium 103 from the digital camera 101 brought home,
This is the storage medium slot 10 of the personal computer 102 in the home.
R of the mass storage medium 103
The aw data is input to the personal computer 102. PC 10
The RAW data input to No. 2 is “developed” by the control / processing unit 79 in the same manner as in FIG. The details are
The description is omitted because it is the same as in FIG.

Raw data is input to the personal computer 102 by using the large-capacity storage medium 103 as the digital camera 101.
It is also possible to connect the input / output units 76 and 78 with a high-speed digital cable in the same manner as in FIG.

FIG. 21 is a block diagram relating to the sixth embodiment of the present invention, and the portions common to the third embodiment in FIG. 17 are assigned the same numbers. Since the personal computer 75 has the same configuration as that of the fourth embodiment in FIG. 19, illustration of the configuration other than the control / processing unit 79 and the input / output unit 78, and illustration of the internal configuration of the control / processing unit 79 are omitted.

The sixth embodiment shown in FIG. 21 is similar to that shown in FIG.
Similar to the third embodiment in FIG. 19, the combination of the silver halide camera 41 and the digital camera back 111 fulfills the function of a digital camera. However, as in the fourth embodiment in FIG. 19, Raw data is transmitted to the outside. Instead of being stored in the digital camera back 111, it is stored in the mass storage unit 112 and held in the digital camera back 111. For this purpose, the mass storage unit 1
Similar to the fourth embodiment, 12 is composed of a small hard disk device having a storage capacity of a gigabyte level or a non-volatile solid-state memory. Raw data of the large-capacity storage unit 111 is input to the personal computer 75 by connecting the digital camera back 111 brought back home after use to the personal computer 75 in the home. Specifically, the input / output unit 113 of the digital camera back 111 is connected to the input / output unit 78 of the personal computer 75 by the high-speed digital cable 77.
By connecting to the RAW of the mass storage unit 112.
The data is input to the control / processing unit 79 of the personal computer 75 via the control / processing unit 114 and “developed”. Other functions are the same as those in the third embodiment.

FIG. 22 is a block diagram relating to the seventh embodiment of the present invention, and the same parts as those of the sixth embodiment of FIG. 21 are designated by the same reference numerals. Further, since the personal computer 102 has the same configuration as that of the fifth embodiment in FIG. Illustration is omitted.

The seventh embodiment shown in FIG. 22 comprises a digital camera back 121, a silver halide film camera 41 and a personal computer 102 as in the sixth embodiment, but the large capacity storage section 112 shown in FIG. In the same manner as the above, the removable mass storage medium 103 is configured. The large-capacity storage medium 103 is composed of a card-type removable compact hard disk drive or a non-volatile solid-state memory card, as in FIG. The large-capacity storage medium 103 is attachable / detachable to / from the storage medium slot 122, and the digital camera bag 1 brought back home after use.
The large capacity storage medium 103 is taken out from the storage device 21 and is inserted into the storage medium slot 105 of the personal computer 102 in the home to input the raw data of the large capacity storage medium 103 to the personal computer 102. The Raw data input to the personal computer 102 is the same as in FIG.
9 "develop". The details are the same as those in FIG. 19, and thus the description is omitted.

To input Raw data to the personal computer 102, the large-capacity storage medium 103 is inserted into the storage medium slot 122 of the digital camera back 121 as shown in FIG.
It is also possible to connect the input / output units 113 and 78 with a high-speed digital cable as in the case of 1.

FIG. 23 is an image storage flow of the personal computer in the fourth to seventh embodiments. Image data input to the input / output unit 78 via the high-speed digital cable 77, or the mass storage medium 1 via the storage medium slot 105.
When the image data is input from 03, the flow starts from step S171. In step S172,
Checks for pending data. In addition,
The “holding data” will be described later. If there is no reserved data, the process proceeds to step S173, and the input data is Ra.
Identify whether it is w data.

If it is Raw data in step S173, the process proceeds to step S174, and the digital camera (including "digital camera back". The same applies hereinafter) is identified based on the input data. In step S175, based on this identification, the processing software commercialized as a set with the digital camera and installed in the personal computer is selected and activated. Here, it is assumed that the personal computer is compatible with image data from a plurality of digital cameras, and a plurality of processing software that is a set with each digital camera is installed in the personal computer.
In step S175, one of the plurality of processing software is selected. As described above, the input data includes information necessary for identifying the digital camera, and appropriate processing such as interpolation is performed based on the information.

In steps S176 to S178, according to the processing software selected in step S175,
The decryption process, the interpolation process, and the image process are performed for each image data, and when these processes are completed, the image of the process result is displayed on the display unit 88 in step S179. In step S180, it is checked whether or not there is a storage operation from the operation unit 87 within a predetermined time from the start of display. If there is a storage operation, step S1
In step 81, the image is converted by image conversion processing, and the image data is saved in step S182, and the process proceeds to step S183. On the other hand, if there is no storage operation within the predetermined time in step S180, a confirmation message is displayed on the display unit 88, and if there is an input from the operation unit 87 that there is no intention to store an image, the process directly proceeds to step S183. . As a result, the input image data is not saved but deleted. If the judgment cannot be made at that time, if "hold" is input from the operation unit 87 within a predetermined time, the process proceeds to step S186, and the image data is temporarily saved as "hold data" without being compressed. It

In step S183, it is checked whether Raw data still remains in the input data,
If it remains, the process returns to step S174 to start the process for the next RAW data, and hereafter, from step S174 to step S1 until all RAW data are processed.
Repeat 83. If no unprocessed Raw data remains, the process proceeds to step S184. In this case, if only Raw data captured by the same digital camera is used, it is redundant to perform the processing of step S174 and step S175 each time, but the mass storage medium is inserted into a different digital camera for use. As a result, the flow returns from step S183 to step S174 in order to take measures against the case where Raw data from different image capturing units coexist and to process "hold data".

In step S184, a comprehensive album process is performed. This processing is for uniformly handling all the image data input in the personal computer in the comprehensive album, and regardless of the processing software selected in step S175, the image data saved in step S182 is processed. Move to general album. As a result, all the data input to the personal computer will be accumulated in the general album, and the desired image data can be found without fail by searching the general album with the album software. When the comprehensive album conversion process is completed, step S18
In step 5, the image storage flow ends.

By the way, in step S172, when the "holding data" previously held is temporarily stored, the process jumps to step S179 to display the data and prompts the final processing in step S180.
The following processing is as described above, and usually unprocessed Ra
Since there is w data, steps S183 to S1
Returning to 74, a predetermined process is performed.

Further, in step S173, Raw
If it is not the data, it means that the compressed image data which has already been processed in the normal image format has been input to the personal computer, and therefore the process jumps to step S184 to perform the comprehensive album processing. As described above, in the image storage flow of the personal computer in FIG. 23, regardless of whether the input image data is the image data that has been already compressed in the normal image format or the RAW data, all the image data is stored. Images are stored so that they can be handled uniformly according to the comprehensive album.

Also in the above fourth to seventh embodiments, when the image data is handled by the general-purpose image file according to the predetermined standard as described with reference to FIG. 18, the camera name, the user information such as the photographer, the photographing The header information required as an item when creating a general-purpose image file is input to the personal computer together with Raw data, such as designation of a file version by a person, shooting date, shutter speed, aperture, focal length, shooting information such as whether or not a flash is used. These data are written as header information in the header portion of the general-purpose image file when compressed data and thumbnails are created and put together into a general-purpose image file in image conversion on a personal computer. This allows the personal computer side to create a general-purpose image file according to a predetermined standard.

FIG. 24 is a block diagram showing the main part of the eighth embodiment of the present invention. The eighth embodiment has a configuration similar to that of the first to seventh embodiments, in which the contents of the control / processing unit are changed.
Therefore, in FIG. 24, only the control / processing unit 131 is shown together with its internal configuration, and the other parts are not shown. Further, because of the above relationship, the eighth embodiment enables seven kinds of embodiments in which the control / processing unit is changed in each of the first to seventh embodiments. further,
A configuration for receiving Raw data and performing an interpolation process in accordance with a change in the content of the control / processing unit 131 (for example, the function of the server center 2 in the first embodiment of FIG. 1, the personal computer in the fifth embodiment of FIG. 20). (Functions of 102) and the like are changed (simplification of functions), and details thereof will be described later.

First, in the case of the first embodiment shown in FIG. 1, the contents of changes in the control / processing unit 131 in FIG. 24 will be described. The input / output unit 132 is connected to the respective components 5a and 6 to 12 of the digital camera integrated type telephone 1 in FIG. The central processing unit 133 performs a predetermined process based on a program stored in the program storage unit 134 such as a camera function, controls the components 5a and 6 to 12 via the input / output unit 132, and data with these components. Also, exchange signals.

As described above, some of the functions of the control / processing unit 131 are stored in the program storage unit 13 such as the camera function.
4 is executed by the central processing unit 133. On the other hand, the processing circuit unit 135 implements another part of the function of the control / processing unit 131 by a hard logic circuit.

For example, as described above, when the photographing mode is selected in FIG. 1, thinning-out reading is performed from the image pickup unit 11 under the control of the control / processing unit 4 until the shutter release is performed. This is digitally converted into thinned image data by the A / D conversion unit 10 and sent to the control / processing unit 4. In the control / processing unit 131 of FIG. 24, which corresponds to the control / processing unit 4 of FIG. 1, the thinned image data is processed by the interpolation circuit unit 136 of the processing circuit unit 135, and an image for each color such as R, G, and B is obtained. While creating the signal,
This is converted into display image data and sent from the input / output unit 132 to the buffer 5a.

Further, as described above, in FIG. 1, when the shutter release is performed, the reading from the image pickup section 11 becomes the all pixel reading under the control of the control / processing section 4, and this is the A / D conversion section. Digitally converted by 10 and sent to the Raw data temporary storage unit 12 for temporary storage. When the storage of Raw data is completed, the reading of the imaging unit 11 returns to the thinning-out reading, and the moving image monitor by the LCD display unit 5 is restarted, but the control / processing unit 131 of FIG.
Then, before that, a process of displaying the imaging result on the LCD display unit is performed for a predetermined time. For this processing, the Raw data immediately after the imaging stored in the Raw data temporary storage unit 12 is sent to the control / processing unit 131 and thinned by the thinning circuit unit 137 of the processing circuit unit 135. The degree of thinning is the imaging unit 1
This is almost the same as the case of thinning-out reading from 1, and the amount of data is reduced to an extent sufficient for display on the LCD display unit 5. The thinned image data from the thinning circuit unit 137 is processed by the interpolation circuit unit 136 to create image signals for each color such as R, G, and B, and is converted into display image data to be input / output unit 132. To the buffer 5a. After displaying the image data thus captured for a predetermined time, the moving image monitor by the LCD display unit 5 based on the thinning-out reading of the image capturing unit 11 is restarted. The data processed by the interpolation circuit unit 136 is stored in the storage unit 9 in FIG. 1 and used for reproduction in the digital camera integrated mobile phone.

As described above, in FIG. 1, the Raw data temporary storage unit 12 is operated by operating the shutter release button.
The Raw data stored in is immediately transmitted from the control / processing unit 4 to the communication unit 13 of the server center 2 via the communication unit 7 without being subjected to processing such as interpolation and white balance adjustment and compression processing. To be done. At this time, in FIG. 24, the program storage unit 1 such as the interpolation function of the control / processing unit 131 is used.
The program stored in R 38
Communication section 1 of server center 2 together with aw data
3 is sent. As described above, the program stored in the program storage unit 138 such as the interpolation function is not executed by the control / processing unit 131 itself, but is prepared in the control / processing unit 131 exclusively for execution by the server center 2. It is what The program stored in the program storage unit 138 such as the interpolation function performs R, G, and R on the RAW data by performing an interpolation process suitable for the image sensor.
This is for generating an image signal for each color such as B and performing image processing such as white balance adjustment and edge enhancement processing to obtain uncompressed general-purpose image data that can be handled by the server center 2. By transmitting a program such as an interpolation function to the server center 2 together with Raw data as in the eighth embodiment in FIG. 24, the configuration of the server center 2 is simplified as follows.

That is, in the first embodiment shown in FIG. 1, when the digital camera-integrated mobile phone 1 and the server center 2 are connected, information about who owns the digital camera-integrated mobile phone and what model the digital camera-integrated mobile phone is owned. I am sending it to the server center. Then, the image processing server 15 and the user server 16
Based on the recording of the information, information such as the color filter array of the image sensor in the image pickup unit 11 is obtained, and interpolation processing suitable for the image sensor of the image pickup unit 11 is performed on the received Raw data, and R, G, B Image signal for each color such as white balance adjustment, contour enhancement processing, etc.
Necessary image processing is performed. As described above, in the first embodiment of FIG. 1, a plurality of programs such as interpolation functions are prepared in advance, and who owns what type of mobile phone with a built-in digital camera connected to the server center 2. By identifying, a program such as an interpolation function suitable for the model is selected and processed.

On the other hand, according to the eighth embodiment of FIG. 24, the program itself such as the interpolation function necessary for processing the raw data into the general-purpose image data is also transmitted to the server center 2. Even if the server center does not have a program such as an interpolation function suitable for a mobile phone with a built-in digital camera in advance,
R sent even when receiving w data
The image processing server 15 can easily process the aw data into general-purpose image data. Since the output of the image processing server 15 is general-purpose image data, the image conversion server 17
It is possible to easily create compressed image data and the like by performing recording format conversion processing and compression processing on the sent image data.

The program storage unit 138 for the interpolation function etc.
It is possible to store other programs to be used in the server center and send them together with the server center. For example, when RAW data is losslessly compressed and transmitted, a decompression program for decompressing the RAW data to restore it to RAW data, a program necessary for creating an image file at the server center, etc. It can be stored in the storage unit 138 and transmitted together with the server center.

The content of the control / processing unit 131 of the eighth embodiment has been described above according to the first embodiment of FIG.
The same applies to transmitting the Raw data to the outside as in the second embodiment of FIG. 16 and the third embodiment of FIG. 17, as well as the fourth to seventh embodiments of FIGS. 19 to 22. Instead, the present invention can also be applied to the case of an embodiment in which the personal computer 75 in the home is used for input.

That is, as in the fourth embodiment of FIG. 19 and the sixth embodiment of FIG. 21, when Raw data is input to the personal computer 75 from the large-capacity storage section of the digital camera by the high-speed digital cable 77. , Raw data, the program stored in the program storage unit 138 such as the interpolation function of FIG. 24 is also input.

On the other hand, the fifth embodiment of FIG. 20 and FIG.
By inserting the mass storage medium 103 taken out from the digital camera into the storage medium slot 105 of the personal computer 102 as in the second embodiment of the second embodiment, the Raw data stored in the mass storage medium 103 is stored in the personal computer 102. When inputting, the program stored in the program storing section 138 for interpolation function etc. of FIG. 24 is also inputted to the mass storage medium 103 so that the personal computer 102 can receive the program for interpolation function etc. together with Raw data. To

Note that in the eighth embodiment of FIG. 24 as described above, when the program such as the interpolation function is already input to the server center or the personal computer, the transmission or input can be omitted. .

FIG. 25 is a flow chart of the release interrupt when the control / processing unit is changed according to the eighth embodiment in the case of the first embodiment. Similar to FIG. 9, when a release interrupt is generated by the operation of the operation unit 6, the flow starts from step S191.
In step S192, imaging / connection processing is performed,
The contents are from step S77 to step S79 in FIG.
Up to the processing relating to imaging and the processing relating to the connection from step S80 to step S83 are the same. In step S193, it is checked whether or not the connection to the server center could not be made. If it is already connected or if the connection to the server center is successful as a result of the call, the process proceeds to step S194.

In step S194, it is checked whether or not the program stored in the program storing unit 138 such as the interpolation function has been transmitted to the server center. If not transmitted, the process proceeds to step S195. In step S195, the program such as the interpolation function is transmitted to the server center. In step S196, a decompression program for decompressing the reversibly compressed Raw data and returning it to the Raw data is also transmitted to the server center. Also, step S
At 198, the program necessary for creating the image file at the server center is also transmitted. Step S1
In 98, the fact that these programs have been transmitted to the server center is recorded, and the flow proceeds to step S199. On the other hand, if the program such as the interpolation function has been transmitted in step S194, the process directly proceeds to step S199.

In step S199, the Raw data stored in the Raw data temporary storage unit 12 is losslessly compressed, and is transmitted to the server center in step S200. In step S201, the Raw successfully transmitted
With respect to the data, processing is performed to the effect that new Raw data may be overwritten in the Raw data temporary storage unit, and step S2 is performed.
At 02, wait for the next release and wait. On the other hand, if the connection to the server center cannot be established in step S193, the process directly jumps to step S202 and stands by. In this case, untransmitted Raw data remains in the Raw data temporary storage unit.

The flowchart of FIG. 25 can be commonly applied to the second embodiment of FIG. 16 and the third embodiment of FIG. 17 in which the communication unit communicates with the server center as in the first embodiment. . Further, it can be similarly applied to an embodiment in which the personal computer communicates with a high-speed digital cable as in the fourth embodiment of FIG. 19 or the sixth embodiment of FIG.

As described above, according to the embodiment shown in FIG.
Since the latest program is also sent when the Raw data is sent according to the release, even if it is a server center or a PC that does not have a program in advance, it is possible to perform an appropriate interpolation or the like for the received Raw data. Can be processed.

FIG. 26 is a main flowchart of the digital camera when the control / processing unit is changed according to the eighth embodiment of the fifth embodiment of FIG. 20 or the seventh embodiment of FIG. . When the control / processing unit according to the eighth embodiment is changed in these embodiments, the functions of the cryptographic processing units 80 and 82 may be omitted. Hereinafter, the fifth embodiment of FIG. 20 will be described by taking as an example the case where the control / processing unit is changed according to the eighth embodiment.

When the power switch is turned on by operating the operation section 81, the flow starts from step S211, and in step S212, it is checked whether or not the large capacity storage medium 103 is inserted in the storage medium slot 104. If it is inserted, the process proceeds to step S213, and it is checked whether or not the program stored in the program storage unit 138 such as the interpolation function has been input to the mass storage medium 103.

If already input, the process proceeds to step S214, and it is checked whether or not the program input to the mass storage medium 103 is the same as the latest program stored in the program storage unit 138 such as the interpolation function. If it is not the latest program, step S21
Go to 5 or later. On the other hand, if the program has not been input to the mass storage medium 103 in step S213, the process directly proceeds to step S215.

In step S 215, the latest interpolation function program etc. stored in the interpolation function program storage unit 138 is input to the mass storage medium 103 via the storage medium slot 104. In step S216, the latest decompression program stored in the program storage unit 138 such as the interpolation function is input to the mass storage medium 103 via the storage medium slot 104. Further, in step S217, the latest file creation program stored in the program storage unit 138 such as the interpolation function is input to the mass storage medium 103 via the storage medium slot 104. When the above program is input, step S
Proceed to 218.

On the other hand, if the large capacity storage medium 103 is not inserted in the storage medium slot 104 in step S212, the process directly jumps to step S218. Also, step S2
Even if the program input to the mass storage medium 103 in 14 is the same as the latest program stored in the program storage unit 138 such as the interpolation function, the process directly jumps to step S218.

As described above, as long as the same program as the program stored in the program storage unit 138 such as the interpolation function has been input to the mass storage medium 103 inserted in the storage medium slot 104, the program is It is held in the mass storage medium 103. On the other hand, when the program is not input to the mass storage medium 103 or is not the latest even if input, the latest function stored in the program storage unit 138 such as the interpolation function in response to power-on. This corresponds to the case where a program is input to the mass storage medium 103 and a new mass storage medium or a mass storage medium to which an old version of the program is input is inserted into the medium slot 104.

The photographing mode interrupt is enabled in step S218, the reproduction mode interrupt is enabled in step S219, and the digital camera enters the standby state in step S220.

In this way, since the latest program is always input to the mass storage medium 103 together with Raw data, this is the medium slot 10 of the personal computer 102.
5, the latest program is installed from the mass storage medium 103 to the control / processing unit 79 of the personal computer 75, and the Raw data received from the mass storage unit 103 can be interpolated.

FIG. 27 is a block diagram of the fifth embodiment of FIG.
14 is a flowchart of another embodiment relating to a release interrupt when the control / processing unit is changed according to the fourth embodiment. When a release interrupt is generated by the operation of the operation unit 6, the flow starts from step S231. In steps S232 to S234, similar to steps S77 to S79 in FIG. 9,
Raw data is temporarily stored, thumbnails are stored, and data for mobile communication is stored. In the case of the fifth embodiment, “data for mobile communication” means display data having an image size suitable for display on the LCD display unit 5 of the digital camera 101, and a display unit similar to the LCD display unit 5. Although it is possible to transfer by a communication means for the purpose of displaying on another device having the above, it is not always necessary to assume the transfer, and it may be handled exclusively for the purpose of displaying on the LCD display unit 5.

In step S235, the raw data in the raw data temporary storage unit 12 is losslessly compressed by the control / processing unit 131. In step S236, the central processing unit 133 accesses the interpolation function program storage unit. Then, in step S237, a data file in which the program of the interpolation function program storage unit 138 is embedded in the lossless compressed data is created.

At step S238, step S237.
Transfer the data file created in. Figure 20
In the case of the fifth embodiment, it corresponds to the writing process of the data file to the mass storage medium 103 via the medium slot 104. In step S239, the Raw data temporarily stored in the Raw data temporary storage unit 12 is overwritten with respect to the Raw data for which the transfer processing is completed, and in step S240, the process waits for the next release and waits.

As described above, in the embodiment shown in FIG. 27, the program storage unit 13 for the interpolation function etc. is provided for each individual image file.
Since programs such as interpolation function, decompression program, file creation program, etc. stored in 8 are embedded, no matter where the individual image files are transferred, interpolation processing etc. are performed to reproduce images and create files. be able to. Note that the embodiment of FIG. 27 can be commonly applied to any of the first to seventh embodiments when the control / processing unit is changed according to the eighth embodiment. For example, in the case of the first embodiment of FIG. 1, the content of the file transfer process of step S238 of FIG. 27 is a transmission process to the server center. Also, FIG.
In the case of the fourth embodiment of No. 9, step S238 of FIG.
The contents of the file transfer process of the high-speed digital cable 77
This is an input process to the personal computer 75 via.

The image file in which the program is embedded is a self-execution type, and when the image file received by a personal computer or a server center is opened, the embedded program is automatically started. RAW
Executes data interpolation processing. For self-executable files, in addition to embedding the program in the image file,
It can also be created by a method of combining the image file and the program into one file and adding a command to execute the program when the file is opened.

FIG. 28 is a flow chart showing the contents of the file creation program stored in the program storage unit for the interpolation function and the like. This file creation program is shown in Figure 2.
5, the transmission in step S197, the input in step S217 in FIG. 26, or the step S23 in FIG.
It is used for embedding in the file in 7 and is executed when creating an image file in the server center or personal computer.

When the execution of the file creation program is started in step S251, the RAW image of the target image is read.
Image information such as data and management information such as general-purpose image file creation items are taken into the processing memory of the server center or the personal computer in step S252. Step S
In 253, from the captured information, user information such as a camera name and a photographer, designation of a file version by the photographer, photographing date, title, photographing information such as shutter speed, aperture, focal length, use of flash, and the like, Take out management information such as. In addition, steps S254 and S25
In step 5 and step S256, shooting date information, photographer information, and title information are extracted from the management information. If there is no corresponding information in steps S253 to S256, the step is skipped.

In step S257, step S252
The image information taken in is written in a general-purpose image file. In step S258, the header information of the general-purpose image file is written based on the items necessary for creating the general-purpose image file among the management information extracted in step S253. The header information is used when searching for an image file in an image management program for general-purpose image files.

In steps S259 to S260, the file creation date, the file creator and the file name common to the files handled by the server center or the personal computer are given.

First, in step S259, step S
The file creation date is added based on the shooting date information extracted in 254. Normally, at the server center or the personal computer, the date when the image data is taken in and the file is actually created is automatically added to the file as the file creation date. However, in step S259, the "file creation date" of the image file is not the date on which the image data was captured to create the file, but the date the image was taken. As a result, even in a server center or a personal computer in which the image management program for general-purpose image files is not installed, the image data that is important for the image file is taken as a key by the general search function of the OS basic program. Can be searched.

In step S260, step S255
The name of the file creator is added based on the photographer information extracted in. Usually, in the server center or the personal computer, the file creator name is automatically given to the file based on a separate setting. However, step S26
By 0, the "file creator" of the image file is not unique to the settings of the server center or the personal computer,
Be an actual photographer. As a result, even in a server center or a personal computer in which the image management program for general-purpose image files is not installed, the image data can be keyed to the photographer who is important for the image file by the general search function of the OS basic program. Can be searched.

In step S261, step S256 is performed.
A file name is given based on the title information extracted in. Usually, in the server center or the personal computer, the file name is automatically given to the file based on the separate setting. However, in step S261, the file name of the image file is not automatically given by the server center or the personal computer, but becomes the file name input by the photographer with the camera at the time of photographing. As a result, even in a server center or a personal computer in which an image management program for general-purpose image files is not installed, the file name given by the camera at the time of shooting is used as a key by the general search function of the OS basic program. Image data can be searched.

After the common file creation date, file creator and file name are assigned to the files handled by the server center or the personal computer as described above, the flow ends in step S262. Note that step S2
From 59 to step S260, if there is no corresponding information, the step is skipped and step S2 is performed.
62.

FIG. 29 is a block diagram relating to the ninth embodiment of the present invention, and the same parts as those of the fifth embodiment of FIG. 20 are designated by the same reference numerals. Note that the image pickup unit 11 and the A / D conversion unit 10 are not integrated as the image pickup unit 73, but are separately illustrated as in FIG. 1. Further, although not shown, the communication unit 7 and the cryptographic processing unit 80 are provided similarly to FIG. Also, PC 1
Since 02 is the same configuration as that of the fifth embodiment in FIG. 20, the configuration other than the control / processing unit 79, the input / output unit 78, and the storage medium slot 105 is illustrated, and the control / processing unit 7
Illustration of the internal configuration of 9 is omitted.

In the ninth embodiment shown in FIG. 29, the digital camera 141 has a nonvolatile large capacity for storing a large amount of display data and thumbnail data of a small file size used for display on the LCD display section 5. Storage unit 1
42 is provided.

In FIG. 29, similar to the fifth embodiment of FIG. 20, the same Raw data stored in the Raw data temporary storage unit 12 at the image pickup timing is sent from the image pickup unit 73 to the control / processing unit 72. Entered in. This Raw
The data is thinned by the control / processing unit 72, converted into display data and thumbnail data, and stored in the large-capacity storage unit 142 in association with the Raw data stored in the Raw data temporary storage unit 12. The reproduction by the digital camera 71 is performed based on the display data and the thumbnail data stored in the large capacity storage unit 142.

The large-capacity storage section 142 has a storage capacity that is practically inexhaustible for display data and thumbnail data having a small file size, and has a large capacity.
It is possible to store display data and thumbnail data for all images that 41 has captured in the past. Therefore, the digital camera 141 functions as a portable image database using the LCD display unit 5 as a browsing display unit.

On the other hand, the Raw data stored in the Raw data temporary storage unit 12 is transferred to the mass storage medium 103 via the storage medium slot 104 at the same timing as the external transmission in FIG. In this way, Raw data and small file size image data for the same image are associated with each other, and the large capacity storage medium 10
3 and the mass storage unit 142. The Raw data stored in the large-capacity storage medium 103 is not directly used for reproduction in the digital camera 141, and the Raw data is merely used for the purpose of being used outside the digital camera 141. 103
Memorized in. Therefore, during reproduction, the mass storage unit 142
Even when the display data and the thumbnail data are read from the RAW data, the Raw data in the mass storage medium 103 is not read.

The digital camera 141 in the ninth embodiment of FIG. 29 enables the photographing mode interrupt and the reproduction mode interrupt and waits when the power is turned on in the same manner as steps S218 and S219 of the flowchart of FIG. Further, in the ninth embodiment, when a release interrupt is issued, step S23 in the flowchart of FIG. 27.
Similar to 2 to step S234, Raw data is temporarily stored, thumbnails are stored, mobile communication data (display data) is stored, and Raw data is stored in the mass storage medium 103 and waits. However, step S
Thumbnail storage in 233 and step S234
Storage of mobile communication data (display data) is performed in the large-capacity storage unit 142.

Also, in the thumbnail storage step of step S233, the large capacity storage unit 14 associates the information for specifying the large capacity storage medium 103 with the thumbnail.
2 (same as step S320 in FIG. 33 described later). This is because the mass storage medium 103 is later taken out from the digital camera 141 and the other mass storage unit 1 is used.
This is to specify in which large-capacity storage unit 103 the Raw data corresponding to the thumbnail stored in the large-capacity storage unit 142 is stored when it is exchanged with 03.

FIG. 30 is a reproduction mode interruption flowchart in the ninth embodiment. When the reproduction mode is selected by the operation of the operation unit 81, the flow starts in step S271, and the reproducible thumbnail display process is performed in step S272. As described above, in the ninth embodiment, display data and thumbnail data for all images previously captured by the digital camera 141 are stored in the large capacity storage section. Step S272 is a process of restricting reproducible thumbnails and displaying reproducible thumbnails in order to protect privacy when a plurality of users use the digital camera 141.
The details will be described later. In step S272, as a result, reproducible thumbnails are displayed and the operation unit 81 can be used for scrolling.

In step S273, it is checked whether one of the thumbnails has been designated. Until the thumbnail is designated, steps S272 and S27 are performed.
Repeat 3. When one of the thumbnails is designated, the flow proceeds to step S274, and it is checked whether or not the image data corresponding to the designated thumbnail is stored in the mass storage medium 103. If it is stored, the process proceeds to step S275, and it is checked whether the image of the corresponding large-capacity storage medium is "developed". If not “developed”, the captured Raw data is stored in the large-capacity storage unit 10.
3 means that it is stored in step 3, so step S2
Proceeding to 76, when the image is displayed, preparation is made to display "undeveloped". Note that "developed" means that the image data corresponding to the specified thumbnail in the mass storage medium 103 is not Raw data,
This means that the data has been subjected to interpolation compression processing. The occurrence of such a case will be described later.

[0187] In step S277, it is checked whether display data corresponding to the designated thumbnail is stored in the large-capacity storage unit 142. If not stored, display data is created in step S278. The occurrence of such a case will be described later.

In step S279, it is checked whether or not the display data corresponding to the designated thumbnail exists in the large-capacity storage section 142 or the large-capacity storage medium 103 or is created by being created in step S278. A case in which there is no display data will be described later, but since it normally exists, step S28
In step 0, the display data corresponding to the designated thumbnail is displayed. At this time, a display indicating “undeveloped” prepared in step S276 is added to the display data, and the image corresponding to the designated thumbnail is “undeveloped” and is still in the storage medium 103. Warn that it has not been retrieved from.

In step S281, the mass storage unit 14
A large-capacity storage unit addition process is performed to additionally store display data and the like that are not included in No. 2 from the large-capacity storage medium 103.
For example, the display data created in step S278 is additionally stored in the large-capacity storage unit 142 together with the corresponding thumbnail and header information. If there is already data in the mass storage unit 142, step S281.
Then nothing is done.

In step S282, it is checked whether the next image has been designated by the operation of the operation unit 81.
If not specified, it is checked in step S283 whether thumbnail display is requested by the operation unit 81, and if not specified, the process returns to step S279. After that, steps S279 to S283 are repeated until the next image is designated or the thumbnail display is not requested, and the same display image is continuously displayed.

On the other hand, when the next image is designated by the operation of the operation unit 81 in step S282, step S2
Returning to step S74, the next image based on the predetermined order is checked from step S274. Also, step S2
When the thumbnail display is requested in 83, the process returns to step S272 to display the thumbnail and waits for the thumbnail designation in step S273.

By the way, in step S274, when the image data corresponding to the designated thumbnail is not stored in the mass storage medium 103, it means that the image has already been taken out from the digital camera 141. Proceeding to step S284, when the image is displayed, preparation is made to display that "developed". Then, in this case, when displaying the display data in step S280, a display indicating that "developed" prepared in step S284 is added to the display data, and the image corresponding to the designated thumbnail is "developed". Is notified.

Also, in step S275, if the image data of the large-capacity storage medium 103 corresponding to the designated thumbnail is "developed", the flow proceeds to step S284, and when the image is displayed. "Developed"
Prepare to display that. Also in this case, when displaying the display data in step S280, step S28 is performed.
A display indicating “developed” prepared in 4 is added to the display data to notify that the image corresponding to the designated thumbnail is “developed”.

If the display data corresponding to the designated thumbnail is stored in the large-capacity storage unit 142 in step S277, step S278 is skipped and step S279 is reached. In this case also, by adding the display of "undeveloped" prepared in step S276 to the display data, it is warned that the image of the storage medium 103 corresponding to the designated thumbnail is "undeveloped". .

In step S279, the display data corresponding to the designated thumbnail is stored in the large capacity storage section 142.
Alternatively, if it does not exist in the mass storage medium 103 and it is desired to be created in step S278, step S2
In step 85, the designated thumbnail is enlarged and displayed instead of the display data. Also in this case, step S28
A display indicating that “developed” prepared in 4 is attached.

FIG. 31 is a table of the data structure of the ninth embodiment and the data stored in each section, and is shown in FIG.
It is a summary of the various cases that the 0 playback mode interrupt function is trying to address. 31 shows that the function of FIG. 30 is not limited to the large-capacity storage medium 103 in which the image captured by the digital camera 141 itself is stored, but the large-capacity storage medium 103 in which the image captured by another digital camera is stored. It also corresponds to.

First, the case where the mass storage medium 103 is not inserted in the storage medium slot 104 will be considered. In this case, as shown in FIG.
The reproduction is performed based on the header information, the thumbnail, and the display data stored in No. 2. Looking at FIG. 30,
Reproduction is performed by the flow from step S274 to step S284 to step S280.

Next, the reproduction when the mass storage medium 103 in which the image photographed by the digital camera 141 itself is stored is inserted in the storage medium slot 104 will be examined. Also in this case, the reproduction is performed based on the header information, the thumbnail, and the display data stored in the large capacity storage unit 142.

In this case, the "undeveloped" image may be stored in the large capacity storage medium 103. This "undeveloped" image data includes Raw data, header information, thumbnails, and display data, as shown in the "Self-image undeveloped" column in FIG. (In some cases, an embodiment in which the large-capacity storage medium 103 does not have display data is possible.) Note that the thumbnails and display data of the large-capacity storage medium 103 are those created by the digital camera 141. ing.

There is a possibility that the image of "developed" is stored in the large capacity storage medium 103. This "developed" image data includes header information, thumbnails, compressed data, and display data, as shown in the "Self-developed" column in FIG. (In some cases, an embodiment in which the large-capacity storage medium does not have display data is possible.) The compressed data is created by the personal computer 102, and the thumbnail and the display data are created by the digital camera 141. It is a thing. (Note that the thumbnail and the display data may be created by the personal computer 102.) As described above, the large-capacity storage medium 103 to be inserted into the storage medium slot 104 of the digital camera 141 is once stored. Taken out from the digital camera 141 and inserted into the personal computer 102,
It is also assumed that the compressed data that has been “developed” is returned to the large-capacity storage medium 103 and then inserted again into the digital camera 141. When a new image is taken after that, a case where “developed” and “undeveloped” images are mixedly stored in the large-capacity storage medium 103 may occur.

Now, under the above background, FIG.
That the thumbnail specified in step S273 of step S273 exists in the mass storage medium 103 in step S274.
If it is found in step S275, it is checked in step S275 whether it is "developed", and the display in each case is prepared in step S276 or step S284 depending on the result. It should be noted that the determination in step S <b> 274 is based on the header information of the large capacity storage unit 142 and the large capacity storage medium 103.
This is done depending on whether or not the header information of is matched. It should be noted here that the reproduction is performed based on the display data of the large capacity storage unit 142 and the Raw data of the large capacity storage medium 103 is processed regardless of whether it is “undeveloped” or “developed”. That is, the display data is not obtained by decompressing the compressed data. This allows the LCD display unit 5 to display quickly.

Next, the large-capacity storage medium 10 in which an image not taken by the digital camera 141 itself is stored
Consider the playback when 3 is inserted in the storage medium slot 104. FIG. 31 shows an embodiment of the large-capacity storage medium 103 that does not have display data, and shows “undeveloped” and “developed” as shown in the columns of “undeveloped other image” and “developed other image”. The example shows the case where the data of “” are mixed. Since the image is not taken by the digital camera 141 itself, in principle, the header information, thumbnails, and display data as shown in FIG. 31 are not stored in the large-capacity storage unit 142. Therefore, the thumbnail is reproduced based on the information in the mass storage medium 103.

If it is found in step S275 that the image data corresponding to the thumbnail designated in step S273 of FIG. 30 is "developed", step S275 is executed.
The process goes to step S279 via 284. At this time,
Since the display data does not exist anywhere and the digital camera 141 does not have the function of expanding and displaying the compressed data, the thumbnail is enlarged and displayed on the LCD display unit 5 in step S285. It should be noted that even if the large-capacity storage medium 103 in which the image not captured by the digital camera 141 itself is stored, if the embodiment having the display data is inserted into the storage medium slot 104, The display image can be displayed by proceeding from step S279 to step S280.

On the other hand, the image data "undeveloped" corresponding to the thumbnail specified in step S273 of FIG.
If it is found in step S275 that step S276 is reached, then step S277 is reached. Then, in this case, since the display data corresponding to the large capacity storage unit 142 is not stored, the process proceeds to step S278, and the display data is created based on the Raw data of the large capacity storage unit 103. It should be noted that even if the large-capacity storage medium 103 in which the image not captured by the digital camera 141 itself is stored and the one having the embodiment having the display data is inserted into the storage medium slot 104, step S278 is performed. Since the display image can be displayed by skipping step S279 from step S279, the display data can be displayed more quickly than when the display data is created from Raw data.

FIG. 32 is a flow chart showing details of the reproducible thumbnail display processing of step S272 of FIG. This flowchart is for determining whether or not all the thumbnails stored in the large-capacity storage unit 142 and the large-capacity storage medium 103 can be reproduced one by one. When the flow starts from step S291, it is determined whether the same thumbnail corresponding to the first thumbnail stored in the large-capacity storage unit 142 exists in the large-capacity storage medium 103 in step S292. Check is done. If this is not the case, the flow advances to step S293, and it is checked whether or not the thumbnail exists in the mass storage medium 103. If this is not the case, it means that the thumbnail is stored in the large-capacity storage unit 142 but does not exist in the large-capacity storage medium 103, and thus the process proceeds to step S294.

[0206] The large-capacity storage medium 103 in which the raw data corresponding to the thumbnails stored in the large-capacity storage unit 142 stores the corresponding Raw data at the time of shooting
The storage medium specifying information information for specifying is stored. This information is a code unique to each mass storage medium 103, and a name given by the user is added to this in some cases. In step S294, the mass storage unit 1
Based on the storage of 42, preparation is made to display such storage medium specifying information. The storage medium specifying information thus prepared is added to the display of the display image in step 280 of FIG. This makes it possible to know which mass storage medium 103 taken out from the digital camera 141 stores the image data corresponding to the designated thumbnail, and it is easy to find the mass storage medium.

At step S295, it is checked whether the thumbnail requires a password for reproduction. If the thumbnail requires the password, it is checked in step S296 whether the thumbnail stored in the header of the mass storage unit 142 matches the input password. The password may be input each time it is played back, but normally, once the user of the digital camera sets it, it will be saved unless it is changed, and the thumbnail that matches the password can be played back and a new password will be created. The password is stored in the header of the image to be shot.

If the password is appropriate in step S296, the process proceeds to step 297, the thumbnail is determined to be a displayable thumbnail and added to the display target, and the process proceeds to step S298. On the other hand, if the password is not appropriate in step S296, the thumbnail is determined to be a non-display thumbnail in step S299, excluded from the display targets, and the process proceeds to step S298. As a result, when a plurality of users use the digital camera 141, only the thumbnails that match the password set by themselves can be played back, and there is no fear that other users will play back the images taken by themselves. , It is also possible to play back images taken by other users and not infringe privacy. Therefore, the display data and the thumbnail data for all the images captured by the digital camera 141 in the past are stored in the large-capacity storage unit 1.
Despite being stored in 42, a plurality of users can respect the privacy of each other while
1 can be used.

[0209] In step S292, the mass storage unit 1
If the thumbnail stored in 42 and the same thumbnail corresponding to the large-capacity storage medium 103 are present, the process directly jumps to step S297. As a result, even thumbnails of the large-capacity storage unit 142 taken by users with different passwords can be reproduced when the large-capacity storage medium 103 in which the corresponding image is stored is inserted. This is as convenient as apparently borrowing another person's large-capacity storage medium 103 and playing it back with the digital camera 141.

If it is determined in step S293 that the thumbnail exists in the mass storage medium 103, it is determined that the thumbnail does not exist in the mass storage unit 142 but exists in the mass storage medium 103. means. Also in this case, the mass storage medium 103 is used for reproduction.
It is determined that is inserted into the digital camera, and the process directly jumps to step S297.

If the thumbnail is stored in the large-capacity storage unit 142 but does not exist in the large-capacity storage medium 103, the process goes to step S295. If the thumbnail does not require a password, the digital camera is selected. No matter who is using it, the process directly jumps to step S297. If the user of the digital camera 141 once sets whether or not such a password is required, it is saved unless it is changed, and if the password is not required, the fact is indicated in the header portion of a newly captured image. Remembered.

[0212] In step S298, it is checked whether or not there is a next thumbnail. If not, step S300.
Then, the reproducible thumbnail display processing is ended, and the flow shifts to step S273 in FIG. On the other hand, if there is a next thumbnail, the process returns to step S292, and thereafter, as long as there is the next thumbnail, steps S292 to S299 are repeated.

FIG. 33 shows the step S28 in FIG.
It is a flow chart which shows the details of the large-capacity storage part addition processing of No. 1. This flowchart is for leaving the recording in the large-capacity storage unit 142 when the large-capacity storage medium 103 in which an image which is not captured by the digital camera 141 itself is stored is inserted and reproduced in the storage-medium slot 104. It is a thing. When the flow starts from step S311, new display data not stored in the mass storage unit 142 in step S312 (created in step S278 of FIG. 30 or stored in the mass storage medium 103) is displayed. It is checked whether it is displayed. If it is not new display data, step S
Proceeding to 313, it is checked whether or not a new thumbnail (those stored in the large-capacity storage medium 103) that is not stored in the large-capacity storage unit 142 is enlarged. When the new thumbnail is enlarged and displayed, the process proceeds to step S314, and it is checked whether the thumbnail is permitted to be stored in the digital camera 141. If it can be stored, in step S315, processing is performed to the effect that the thumbnail may be stored in the large-capacity storage unit 142 without a password, and the process proceeds to step S316. In step S316, it is checked again whether or not the thumbnail is permitted to be stored in the digital camera 141. In this case, the thumbnail can be stored.
Passes through as is.

On the other hand, if it is determined in step S312 that new display data is displayed, the process directly proceeds to step S316. If the new display data can be stored, it is checked in step S317 whether the storage is permitted only for the user on condition that the password is given. If the password is required, In step S318, a process of adding and storing the password of the user is performed, and the process proceeds to step S319. On the other hand, if the password is not required and all the users of the digital camera 141 can reproduce it, step S318 is skipped and the process proceeds to step S319. In the case of the new display data, the header information, the thumbnail, and the display data are stored in the large-capacity storage unit 142 in step S319.

If it is a new thumbnail, step S31.
From step 6 to step S317, since no password is required, the process directly goes to step S319, and in step S319, header information and thumbnails are stored in the large-capacity storage unit 142.

In step S320, information for specifying the large-capacity storage medium 103 in which the original image is stored is stored in the large-capacity storage unit 142 in association with the thumbnail. As a result, even for an image that is not captured by the digital camera 141 itself, which mass storage medium 103 stores the image if it is an image that has been reproduced once by the digital camera 141 is stored. Identification becomes easy.

After the processing of step S320, step S
In step 321, the large-capacity storage unit addition processing ends, and the process proceeds to step S282 in FIG. If the thumbnail is not a new thumbnail in step S313, there is no target to be processed, so the process immediately jumps to step S321 and the process ends.
Further, even when the image is not permitted to be stored in step S314 or step S316, the process immediately jumps to step S321 to end the process.

As described above, Raw is used in the ninth embodiment.
Even after the data is taken out to the outside, the corresponding display data is stored in the large-capacity storage unit 141 and the digital camera 14
Held at 1. In the ninth embodiment, the Raw data is stored in the exchangeable large-capacity storage medium 103 and taken out, but the method of taking out the Raw data to the outside is not limited to this. For example, various embodiments are possible such as one transmitting via a wireless communication unit as shown in FIG. 1 and one connecting with a cable to output as shown in FIG.

The advantage of the ninth embodiment that the corresponding display data is held in the digital camera even after the image data is taken out is not limited to the case where the Raw data is taken out. The present invention can also be applied to the case where data subjected to interpolation compression processing in a digital camera is stored in the large-capacity storage medium 103 and is taken out.

34 to 36 are flowcharts relating to the tenth embodiment of the present invention. In the tenth embodiment, electronic zoom and trimming can be designated. Since these functions have properties added to the first to ninth embodiments, the description of the entire embodiment will be omitted, and only the part relating to the designation of the added electronic zoom or trimming will be described. Here, the "electronic zoom" is a process of enlarging by cutting the central part of the image captured without changing the focal length of the lens system, as opposed to "optical zoom" by the zoom lens in which the focal length of the lens system changes. This means that a pseudo-zoom effect is obtained. The content of the process is the same as that of the trimming, although the difference is that the process is performed at the time of shooting, not after shooting.

As described above, an instruction as to whether or not it is necessary to save the Raw data extracted from the digital camera, the compression rate of the image processed outside the digital camera, the image size, the color balance, and the degree of edge enhancement. The designation such as can be set in advance by the operation unit while looking at the menu of the LCD display unit in the digital camera. The electronic zoom and trimming designations in the tenth embodiment are similar functions.

FIG. 34 is a flow chart when a release interrupt occurs in the tenth embodiment, and when the flow starts from step S331, step S33.
At 2, Raw data is temporarily stored. This is shown in FIG.
This is the same function as step S77 in step S232 and step S232 in FIG. In step S333, it is checked whether or not the electronic zoom operation has been performed before the release. If the electronic zoom is performed, in step S334, unnecessary peripheral portions are extracted from the Raw data according to the degree of zoom setting to the tele side. Discard the data. This makes it possible to reduce the amount of Raw data to be output to the outside. When it is confirmed in step S333 that the electronic zoom to the tele side is not performed, step S334 is skipped.

In step S335, it is checked whether or not an operation for reducing the number of recording pixels has been performed before the release. Normally, in a digital camera, a rough image quality may be sufficient depending on the purpose of the image, so that the recording pixel number can be set. However, in step S335, the setting for reducing the recording pixel number is performed by such setting. It is to see whether or not it is. When the reduction of the number of recording pixels is designated, Raw data is thinned in step S336. This makes it possible to reduce the amount of Raw data to be output to the outside. Note that step S33
When it is confirmed in 5 that the operation of reducing the number of recording pixels is not performed, step S336 is skipped.

In step S337, step S333.
From step S336 to step S336, the display data and the thumbnail are created based on the Raw data, which will be described in detail later. In step S338, the thumbnail created in step S337 is stored, and in step S339, the display data created in step S337 is stored. Note that the raw data-attached main part is discarded in step S334 and step S3.
If the Raw data thinning of No. 36 has not been performed, in step S337, display data and thumbnail creation processing is performed based on the Raw data temporarily stored in step S332.

[0225] In step S340, step S334 is performed.
The transfer processing of the Raw data after step S336 and the thumbnail and display data created at step S337 is performed. When applied to the fifth embodiment of FIG. 20, this “transfer process” corresponds to a process of writing a data file to the mass storage medium 103 via the medium slot 104.

At step S341, a transfer process of instruction data to the outside is performed. This instruction data includes, in addition to an instruction for image enlargement and interpolation when the Raw data unnecessary portion is discarded in step S334 by electronic zoom, an instruction as to whether or not Raw data needs to be saved, an image compression rate, and an image size. , And various instructions that are set by the digital camera and executed outside the digital camera, such as designation of color balance and degree of contour enhancement. After the above processing, the flow ends in step S342 to enter the standby state.

FIG. 35 is a flow chart when an edit interruption occurs in the tenth embodiment. The edit interruption can be made by operating the operation unit while reproducing the display data corresponding to the “undeveloped” Raw data in the reproduction mode. While FIG. 34 shows the settings at the time of shooting, FIG. 35 shows that the trimming for cutting out a part of the image and the change in the number of recording pixels can be performed by editing after shooting.

[0228] An edit interrupt is issued, and step S351
When the flow starts from step S352, the confirmation of the editing operation is awaited in step S352. The edit operation is performed based on the display data displayed on the LCD display unit, and the effect of the edit is not determined until the edit operation is confirmed. When the editing operation is confirmed by ending the editing or canceling the editing, step S353.
Then, it is checked whether or not the correction is made by the editing operation. If there is a correction, the process proceeds to step S354 and R
The aw data is called. When the Raw data is in the temporary storage unit, the target Raw data is simply specified, but when the target Raw data is in the mass storage medium, this is called to the Raw data temporary storage unit.

In step S355, it is checked whether or not the correction by the editing operation is trimming. If the correction was made by trimming, step S3
Proceeding to 56, the data that is no longer needed due to the trimming is deleted from the Raw data and discarded. This makes it possible to reduce the amount of Raw data to be output to the outside. When it is confirmed in step S355 that the correction is not trimming, step S356 is skipped.

[0230] In step S3357, it is checked whether the correction by the editing operation is a reduction in the number of recording pixels. If the correction is to roughen the number of recording pixels, step S35.
8, the Raw data is thinned out. This makes it possible to reduce the amount of Raw data to be output to the outside. When it is confirmed in step S357 that the correction is not the reduction of the number of recording pixels, step S336 is skipped.

At step S359, step S356.
And Raw that has gone through either or both of step S358
The display data and the thumbnail are created based on the data. This content is described in step S337 of FIG.
This is the same as the above, and the details will be described later. Step S360
Then, the original thumbnail is overwritten with the thumbnail created in step S359 to update the storage. In step S361, the initial display data is overwritten with the display data created in step S359 to update the storage. .

At step S362, step S356.
The RAW data updated through step S358 and the thumbnail and display data updated in steps S360 and S361 are transferred. By this transfer processing, the file originally transferred is overwritten and updated. It should be noted that it is possible to instruct the original file and the edited file to coexist. When applied to the fifth embodiment of FIG. 20, this “transfer process” corresponds to a process of writing a data file to the mass storage medium 103 via the medium slot 104.

In step S363, transfer update of instruction data for the outside is performed. Similar to step S341 of FIG. 34, the update data includes Raw enlargement and interpolation instructions as necessary when the Raw data unnecessary portion is discarded by trimming in Step S334, as well as Raw
Includes various instructions that are set by the digital camera and executed outside the digital camera, such as instructions regarding whether data storage is required, image compression ratio, image size, color balance, and degree of edge enhancement. .

After the above processing, in step S364, the flow is ended and the standby state is entered. If the edited result is not corrected in step S353, nothing is done and the process directly goes to step S364.

FIG. 36 is a flow chart showing details of the display data / thumbnail creation processing in step S337 of FIG. 34 or step S359 of FIG. When the process starts in step S371, step S3
At 72, it is checked by electronic zoom or trimming whether unnecessary portions of Raw data are discarded and the area of the image is reduced. If the area is reduced, the thinning rate at the time of creating the display data is set to be reduced in step S373. Even if the number of pixels of the raw data is small due to the area reduction due to electronic zoom or trimming, the number of pixels of the display data is the same as when the area of the raw data is not reduced, and the image quality of the display data is reduced. The purpose is not to damage.

At step S374, it is checked whether or not the number of recording pixels of Raw data has been reduced by the setting of the number of recording pixels reduction. If the number of recorded pixels of Raw data has decreased, the thinning rate at the time of creating display data is set in step S375. Even if the number of recorded pixels of Raw data is reduced, the number of pixels of display data is set to be the same as that when the number of recorded pixels of Raw data is not reduced so that the image quality of the display data is not deteriorated. It is for doing.

At step S376, step S373.
Alternatively, Raw data is thinned out at a small thinning rate based on the settings of step S374 or both of them, and display data is created. If it is confirmed in step S372 that there is no area reduction and that there is no decrease in the number of recording pixels in step S374, the Raw data is thinned at the initial thinning rate in step S376 to create display data. As described above, the file size and the image quality of the display data created in step S376 are the same regardless of the progress.

In step S377, the display data is further thinned out to create a thumbnail, the processing is ended in step S378, and step S338 in FIG. 34 or FIG.
Then, the process proceeds to step S360.

In the above, if the thinning rate is not changed, the image quality is degraded when the image in which the area is reduced by electronic zoom or trimming or the image in which the number of recording pixels is reduced by the setting is enlarged to the normal screen size. To do. Figure 3
The configuration of 6 is for preventing this. Note that the thinning rate is changed continuously as much as possible under the condition of thinning that is suitable for converting Raw data into image signals for each color such as R, G, and B, and the effective pixels in the target screen area are changed. It is desirable that the number does not change, but
It may be roughly changed step by step. In the simplest case, the degree of thinning is set to two steps, and when the area is reduced to a certain level or more or the number of recording pixels is reduced, the thinning rate is changed from the first step. Even if the second step is changed to a lower value, the advantages of the present invention can be obtained.

In the above tenth embodiment, steps S334 and 336 of FIG. 34 or step S35 of FIG.
6. In step S358, the discarding or unnecessary thinning of Raw data is actually executed in the digital camera, but the embodiment of the present invention is not limited to this. In other words, instead of actually discarding or thinning out unnecessary parts of the Raw data, the Raw data itself is passed to the outside without being processed, and the external device that receives the Raw data performs the effect of electronic zoom or trimming or the specified thinning operation. The instruction setting for execution may be performed only in each of the above steps. In this case, R passed to the outside
On the other hand, the amount of aw data cannot be reduced, but RAW data without information loss can be received externally, so that the degree of freedom of external information use is expanded.

Further, in this case, for one Raw data, the original display image and the Ra for performing the effect of electronic zoom or trimming or the designated thinning-out operation are performed.
It is possible to allow the display image after editing accompanied by the instruction setting to w data to coexist.

Although the tenth embodiment has been described as a digital camera, the configurations of FIGS. 35 and 36 can be implemented as a digital image reproducing apparatus. It is particularly useful as a handy type digital image reproducing device.

The functions in each of the above embodiments can be realized by an application program of a computer other than the embodiments specifically mentioned. In that case, a computer in which this application program is installed and a computer connected as necessary are connected. The peripheral device is the device described above. Therefore, the application program itself distributed on the Internet or the like for realizing the functions of the present invention or a recording medium such as a CD-ROM in which the application program is recorded is also an object of the present invention.

[Brief description of drawings]

FIG. 1 is a block diagram of a first embodiment according to the present invention.

FIG. 2 is a table showing a data structure of an image folder.

FIG. 3 is an external view of a digital camera-integrated mobile phone according to the first embodiment.

FIG. 4 is a main flowchart of a mobile phone integrated with a digital camera.

FIG. 5 is a flowchart showing details of registration / initialization processing.

FIG. 6 is a flowchart showing details of a shooting test.

FIG. 7 is a flow chart showing details of user registration processing.

FIG. 8 is a flowchart of an operation when a shooting mode is selected.

FIG. 9 is a flowchart showing an operation when a release interrupt occurs.

FIG. 10 is a flowchart when a reproduction mode is selected.

FIG. 11 is a flowchart showing an operation when a thumbnail designation interrupt is applied.

FIG. 12 is a flowchart when the mobile phone with a built-in digital camera receives it.

FIG. 13 is a flowchart when a disconnection interrupt with the server center is taken.

FIG. 14 is a main flowchart of the server center.

FIG. 15 is a flowchart when the server center 2 is connected.

FIG. 16 is a block diagram of a second embodiment according to the present invention.

FIG. 17 is a block diagram of a third embodiment according to the present invention.

FIG. 18 is a table showing another embodiment of a data structure of an image folder.

FIG. 19 is a block diagram of a fourth embodiment according to the present invention.

FIG. 20 is a block diagram of a fifth embodiment according to the present invention.

FIG. 21 is a block diagram of a sixth embodiment according to the present invention.

FIG. 22 is a block diagram of a seventh embodiment according to the present invention.

FIG. 23 is an image storage flowchart of the personal computer according to the fourth to seventh embodiments.

FIG. 24 is a block diagram of the essential parts of an eighth embodiment of the present invention.

FIG. 25 is a flowchart of a release interrupt of the first embodiment, which is a modification of the eighth embodiment.

FIG. 26 is a main flowchart of the fifth embodiment, which is a modification of the eighth embodiment.

FIG. 27 is a flowchart of a release interrupt according to the fifth embodiment, which is a modification of the other embodiment according to the eighth embodiment.

FIG. 28 is a flowchart of a file creation program according to the eighth embodiment.

FIG. 29 is a block diagram of a ninth embodiment according to the present invention.

FIG. 30 is a playback mode interrupt flowchart in the ninth embodiment.

FIG. 31 is a table of data stored in each unit and the data structure of the ninth embodiment.

32 is a detailed flowchart of the reproducible thumbnail display process of FIG. 30. FIG.

FIG. 33 is a detailed flowchart of the large-capacity storage unit addition processing of FIG. 30.

FIG. 34 is a flowchart when a release interrupt occurs in the tenth embodiment.

FIG. 35 is a flowchart when an edit interrupt is issued in the tenth embodiment.

FIG. 36 is a flowchart showing details of display data / thumbnail creation processing.

[Explanation of symbols]

1 Digital camera integrated mobile phone 2 server centers 5 LCD display 6 Operation part 7 Digital camera integrated mobile phone communication section 8 Handset 9 memory 11 Imaging unit 12 Raw data temporary storage 13 Server Center Communications Department 15 Image processing server 16 user server 17 Image conversion server 18 Image storage server 22 First hinge part 28 Second hinge part 29 Lock button 30 lenses 31 Strobe 41 Silver salt film camera 42 digital camera back 60 mobile phones 61 digital camera back 62 Digital camera back short-range communication section 63 Mobile phone short-distance communication unit 65 Mobile phone function 71 digital camera 74 Mass storage 75 PC 77 high speed digital cable 79 Control / processing unit 101 digital camera 102 PC 103 mass storage medium 104 storage medium slot 105 storage medium slot 111 digital camera back 112 mass storage 121 digital camera back 122 storage medium slot 131 Control / Processing Unit 132 Input / output unit 133 Central processing unit 134 Program storage unit for camera functions, etc. 135 Processing circuit section 136 Interpolation circuit 137 Thinning circuit 138 Interpolation program store 141 digital camera 142 mass storage

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) // H04N 101: 00 H04B 7/26 MF term (reference) 5C022 AA13 AB66 AC00 AC03 AC13 AC69 AC80 5C052 GA01 GA05 GA08 GA09 GB01 GC05 GE06 5C053 FA05 FA08 FA14 FA23 FA27 GA11 GB21 HA29 LA01 LA03 LA11 LA14 5K067 AA21 BB04 BB21 DD52 EE02 FF02 FF23 HH23

Claims (31)

[Claims] 1. An image pickup unit, an output unit for outputting image data based on the output of the image pickup unit to an outside, an image display unit, and an image display unit for displaying the image data output to the outside on the image display unit. A display data creation unit that creates display data, an operation unit, and a processing unit that reflects the operation of the operation unit with respect to the display data displayed on the display unit to corresponding image data that is output to the outside. A digital camera characterized by having. 2. The digital camera according to claim 1, further comprising a storage unit that stores the display data even after the image data is output to the outside. 3. The processing unit processes the image data output to the outside in response to the operation of the operation unit with respect to the display data displayed on the display unit. Digital camera described in. 4. The processing unit associates information for processing the image data with the image data in response to an operation of the operation unit on the display data displayed on the display unit, and outputs the output unit. The digital camera according to claim 1, wherein the digital camera further outputs the digital signal to the outside. 5. The digital camera according to claim 1, wherein the operation of the operation unit is editing of the image data. 6. The operation of the operation unit is an instruction for recording the image data.
The digital camera according to any one of 1. 7. The digital camera according to claim 1, wherein the image data output to the outside is Raw data from the image pickup unit. 8. The output unit is a mounting unit for a removable storage medium, and the image data is output to the outside by being stored in the removable storage medium mounted in the mounting unit. The digital camera according to any one of claims 1 to 7. 9. The display data creation unit corrects the display data based on an operation of the operation unit on the display data displayed on the display unit. The digital camera according to any one of 1. 10. An image pickup section, an output section for outputting image data based on the output of the image pickup section to an outside, an instruction section for image data to be output to the outside, an image display section, and an outside. A digital camera, comprising: a display data creation unit that creates display data for display on the image display unit while preventing image deterioration of the image data due to an instruction from the instruction unit. 11. The digital camera according to claim 10, wherein the display data creating unit creates the display data by reducing the number of pixels of image data. 12. When the instruction from the instruction unit is to reduce the number of pixels of image data, the display data creating unit reduces the degree of reduction of the number of pixels of image data to reduce the display data from the image data. 12. The digital camera according to claim 11, wherein the digital camera is created. 13. The digital camera according to claim 12, wherein the instruction from the instruction unit is to use a partial area of the image data. 14. The instruction of the instruction unit to use a partial area of image data is to obtain a pseudo telephoto effect by cutting and enlarging a part of an image. 13. Digital camera according to item 13. 15. The digital camera according to claim 13, wherein the instruction of the instruction unit to use a partial area of the image data is to trim a part of the image. 16. The digital camera according to claim 12, wherein the instruction from the instruction unit is to reduce the number of recording pixels outside the image data. 17. The digital camera according to claim 10, wherein the image data output to the outside is Raw data from the image pickup unit. 18. The output unit is a mounting unit for a removable storage medium, and the image data is output to the outside by being stored in the removable storage medium mounted in the mounting unit. The digital camera according to any one of claims 10 to 17. 19. A storage unit for image data, an image display unit,
A display data creation unit that creates display data for display on the image display unit for the image data in the storage unit, an operation unit, and an operation unit for the display data displayed on the display unit. A digital image reproducing apparatus, comprising: a processing unit for reflecting an operation on the image data of the storage unit. 20. The processing unit processes the image data of the storage unit in response to an operation of the operation unit with respect to the display data displayed on the display unit. Digital image reproduction device. 21. The processing unit associates information for processing the image data in response to an operation of the operation unit with respect to the display data displayed on the display unit with the image data, and the storage unit. 20. The digital image reproducing device according to claim 19, wherein the digital image reproducing device is stored in. 22. The digital image reproducing apparatus according to claim 19, wherein the operation of the operation unit is editing of the image data. 23. The digital image reproducing apparatus according to claim 19, further comprising a mounting section, wherein the storage section is a removable storage medium mounted on the mounting section. 24. The display data creation unit corrects the display data based on an operation of the operation unit on the display data displayed on the display unit. The digital image reproducing device according to any one of 1. 25. An image data storage unit, an instruction unit for the image data in the storage unit, an image display unit, and a display on the image display unit while preventing image deterioration due to an instruction from the instruction unit. And a display data creating section for creating display data for the display based on the image data. 26. The digital image reproducing apparatus according to claim 25, wherein the display data creating section creates the display data by reducing the number of pixels of the image data. 27. When the instruction from the instruction unit is to reduce the number of pixels of the image data, the display data creating unit reduces the degree of reducing the number of pixels of the image data to reduce the display data from the image data. 27. The digital image reproducing device according to claim 26, wherein 28. The digital image reproducing apparatus according to claim 27, wherein the instruction from the instruction unit is to use a partial area of the image data. 29. The digital image reproducing apparatus according to claim 27, wherein the instruction from the instruction unit is to reduce the number of recording pixels of image data. 30. The digital image reproducing apparatus according to claim 25, further comprising a mounting unit, wherein the storage unit is a removable storage medium mounted on the mounting unit. 31. A program for realizing the function according to any one of claims 1 to 30.