JP2003101987A - Program providing device and image pickup system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup system without the need of finding a required program from many programs at the time of downloading a new function to an image pickup device. SOLUTION: An image gateway 400 selects an extension function to be provided corresponding to an operation state of the image pickup device 100, reports it to the image pickup device 100, provides the image pickup device 100 with the program of the extension function corresponding to a request from the image pickup device 100 and updates charging information to the image pickup device 100. The operation state of the image pickup device 100 is a photographing state of still images, the photographing state of moving images and a reproducing state, etc.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a program providing apparatus and an image capturing system for providing a program to an image capturing apparatus.

[0002]

2. Description of the Related Art Conventionally, an image pickup device such as an electronic camera for recording, reproducing and communicating still images and moving images using a memory card having a solid-state memory device as a recording medium has already been put on the market, and the taken images have been recorded. An imaging system has also been constructed, which is transmitted from an imaging device to a WWW server connected to a wide area network such as the Internet, stored, and widely disclosed on the WWW server.

According to these image pickup systems, it is possible to download and use the image stored in the WWW server from the WWW server to the client computer connected to the Internet.

On the other hand, an image pickup apparatus has been put on the market in which a predetermined program is stored in a WWW server and is downloaded and used via the Internet.

According to these image pickup devices, it is possible to modify the program and add new functions even after purchasing the image pickup device.

[0006]

In such a conventional image pickup system, when a new function is downloaded from the WWW server to the image pickup apparatus, it is necessary to find a necessary program from many programs, which is very difficult. It was complicated and inconvenient.

Also, for the WWW server side, in order to avoid complicated operations on the side of the image pickup device, it is necessary to place importance on providing programs that provide general functions. There is a problem that it is not possible to provide an extension function that takes individual consideration into consideration.

[0008]

In an image pickup system according to the present invention, firstly, an image pickup apparatus having an image pickup means and an operation mode notifying means, and an image information management having a charge managing means and an extended function providing means. And a communication network that communicates between the image pickup apparatus and the image information management apparatus, and the image pickup apparatus reports the operating state of the image pickup apparatus to the image information management apparatus by means of operation mode notification means. The image information management apparatus selects one or a plurality of extended functions provided by the extended function providing unit and notifies the imaging apparatus according to the reported operating state of the imaging apparatus. Requests the program of the extended function arbitrarily selected from the notified single or plural extended functions to the extended function providing means, and the image information management device is In response to these requests, the extended function providing unit provides the extended function program to the image pickup apparatus and updates the billing information of the billing management unit.

With the above means, the contents of the extended function program provided by the WWW server to the image pickup apparatus via the Internet can be changed according to the operation mode setting state of the image pickup apparatus.

As a result, it is possible to provide an image pickup system without the problem that it is necessary to find a necessary program from among many programs when a new function is downloaded from the WWW server to the image pickup apparatus.

Further, it becomes possible to provide an image pickup system without a problem that the WWW server side cannot provide an extended function for individually considering a wide range of users of the image pickup apparatus.

[0012]

1 is a diagram showing the overall system configuration of an embodiment of the present invention.

Reference numeral 100 is an image pickup device such as an electronic camera having an antenna 112.

Reference numeral 400 is an image information management device such as an image gateway, and 500 is an information processing device such as a client computer or a mobile information device or a mobile phone that is normally used by a user. In the present embodiment, the image information management device (image gateway) 400 is the same as the image pickup device 1 in the image pickup device 100.
00 functioning as a program providing device that provides the extended program of 00.

Reference numeral 600 is the Internet, 602 is the Internet and an image information management apparatus (image gateway) 400.
604 is a network that connects the Internet and an information processing apparatus (client computer) 500. 610, 620 and 630 are WWW servers that are connected to the Internet and store and distribute various content information. 700 is a telephone base station. 702 is a packet network including a mobile phone network, and 702 is a network connecting the packet network 700 and the image information management apparatus (image gateway) 400.

The image pickup apparatus 100 includes various networks such as a WWW server 610, a WWW server 620, a WWW server 630, and an information processing apparatus 500 via a packet network 700, a network 702, an image information management apparatus 400, a network 602, and the Internet 600. It is possible to send and receive images and commands to and from the device.

<Description of Configuration of Imaging Device 100> Next, referring to FIG.
The imaging device 100 described above will be described with reference to FIG.

Reference numeral 10 is a photographing lens, 12 is a shutter having a diaphragm function, 14 is an image pickup device for converting an optical image into an electric signal, and 16 is an A / D converter for converting an analog signal output of the image pickup device 14 into a digital signal. is there.

Reference numeral 18 denotes an image pickup device 14, an A / D converter 16,
A timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22.

A memory control circuit 22 includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The compression / expansion circuit 32 is controlled. The data of the A / D converter 16 is passed through the image processing circuit 20 and the memory control circuit 22, or the data of the A / D converter 16 is passed directly through the memory control circuit 22, and the image display memory 24 or the memory 3 is displayed.
Written to zero.

Reference numeral 24 is an image display memory, 26 is a D / A converter, and 28 is an image display section composed of a TFT LCD or the like. The image data for display written in the image display memory 24 is D
The image is displayed on the image display unit 28 via the / A converter 26.

Reference numeral 30 is a memory for storing the photographed still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and moving images for a predetermined time. This makes it possible to write a large amount of images in the memory 30 at high speed even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot. The memory 30 can also be used as a work area of the system control circuit 50.

32 is an adaptive discrete cosine transform (ADCT)
A compression / decompression circuit for compressing / decompressing image data by, for example, reading the image stored in the memory 30 and performing compression processing or decompression processing, and processing-completed data to the memory 3
Write to 0.

Reference numeral 34 denotes an encryption / decryption circuit, which performs an encryption process on the image data photographed and stored in a predetermined region of the memory 30 as necessary, and also performs an encryption process to perform a predetermined region of the memory 30. Decoding processing is performed when the image data stored in is reproduced and displayed. The image data that has been encrypted is the image information management device (image gateway).
The encryption / decryption means 422 included in 400 can also perform the decryption. These encryption / decryption processing operations are executed in cooperation with billing database information in the billing means 420 provided in the image information management apparatus (image gateway) 400 described later.

Reference numeral 40 denotes an exposure control means for controlling the shutter 12 having a diaphragm function, which also has a flash light control function in cooperation with the flash 48.

Reference numeral 42 is a distance measurement control means for controlling the focusing of the taking lens 10, 44 is a zoom control means for controlling the zooming of the taking lens 10, and 46 is a barrier control means for controlling the operation of the protection means 102 which is a barrier. .

Reference numeral 48 denotes a flash, which also has an AF auxiliary light projection function and a flash light control function. Exposure control means 4
0, the distance measurement control unit 42 is controlled by using the TTL method, and the system control circuit 50 causes the exposure control unit 40 and the distance measurement control unit 42 to operate based on the calculation result of the captured image data calculated by the image processing circuit 20. Control against.

Reference numeral 50 is a system control circuit for controlling the entire image pickup apparatus 100, and 52 is a memory for storing constants, variables, programs and the like for the operation of the system control circuit 50.

Reference numeral 54 denotes a display unit such as a liquid crystal display device and a speaker for displaying operating states and messages using characters, images, voices, etc. according to the execution of the program in the system control circuit 50. A single or multiple locations are installed near the operation part of the device for easy visual confirmation.
It is composed of a combination of LED, sound generator, etc.

Of the display contents of the display section 54, what is displayed on the LCD or the like is, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, a remaining image display. Possible number display, shutter speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, buzzer setting display, clock battery level display, battery level display, error display,
Information display by a plurality of digits, recording media 200 and 21
There are 0 attachment / detachment status display, communication I / F operation display, date / time display, display showing connection status with external computer, etc.

Reference numeral 56 is an electrically erasable / recordable non-volatile memory, and for example, an EEPROM, a flash memory or the like is used.

Reference numeral 58 is identification information, which is used for authentication when communicating with the image information management apparatus (image gateway) 400 via the communication means 110, the antenna 112, the packet network 700, and the network 702, and / or of the captured image data. Stores various identification information for charge management when storing / retrieving. The identification information is stored in the image information management device (image gateway) 400.
It is used when updating the billing information database when performing various services to the imaging device 100.

Reference numerals 60, 62, 64, 66, 68, 70, and 72 are operation means for inputting various operation instructions of the system control circuit 50, such as switches, dials, touch panels, pointing by visual axis detection, and voice recognition. It is composed of a single device or a combination of a plurality of devices.

Here, a concrete description of these operating means will be given.

60 is a power switch (main switch)
Thus, it is possible to switch and set each mode of power-on and power-off of the image processing apparatus 100. Further, the power-on and power-off settings of various accessory devices connected to the image processing apparatus 100 can also be switched and set together.

Reference numeral 62 denotes a shutter switch SW1, which is turned on during operation of a shutter button (not shown), and is AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash).
Instruct to start operation such as processing.

Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed, and the image sensor 1
2 is an exposure process for writing image data to the memory 30 via the A / D converter 16 and the memory control circuit 22, a development process using calculation in the image processing circuit 20 and the memory control circuit 22, and a memory 30. The image data is read from the storage medium 200, compressed by the compression / expansion circuit 32, and stored in the recording medium 200.
It is instructed to start the operation of a series of processes of recording the image data.

Reference numeral 66 is a selection / selection switch, which can set selection and switching of various functions when shooting and / or reproducing and / or executing communication.

Reference numeral 68 denotes a decision / execution switch, which can set the decision and execution of various functions when shooting and / or reproducing and / or executing communication.

Reference numeral 70 denotes an operation unit including various buttons and a touch panel, which includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, and menu movement (Plus) button, Menu move- (Minus) button, Playback image move + (Plus) button, Playback image- (Minus) button, Shooting image quality selection button, Exposure compensation button, Date / time setting button, Image display ON / OFF There are a button, a compression mode switch, a quick review switch for setting a quick review function for automatically reproducing and displaying image data taken immediately after shooting on the image display unit 28, and the like.

In the compression mode switch, JP
CCD RAW to select the compression rate of EG compression or to digitize the image sensor signal as it is and record it on the recording medium
A switch for selecting a mode. For the JPEG compression mode, for example, a normal mode and a fine mode are prepared.

In the JPEG compression mode, the image sensor 1
4 read out from the A / D converter 16 and the image processing circuit 2
0, the image data written in the memory 30 is read out via the memory control circuit 22, compressed by the compression / expansion circuit 32 to the set compression rate, and a predetermined encryption processing is performed by the encryption / decryption circuit 34 as necessary. After performing the recording medium 2
Recording at 00.

In the CCD RAW mode, the image data is read out line by line in accordance with the pixel array of the color filter of the image sensor 14, and the A / D converter 16 and the memory control circuit 2 are read.
The image data written in the memory 30 is read via 2, and the encryption / decryption circuit 34 performs a predetermined encryption process as necessary, and then records the image on the recording medium 200.

Reference numeral 72 denotes a mode dial switch, which can switch and set each function mode such as an automatic photographing mode, a photographing mode, a panoramic photographing mode, a reproducing mode, a multi-screen reproducing / erasing mode, and a PC connection mode. In the description of the present embodiment, it is assumed that the image capturing apparatus 100 has a shooting mode, a playback mode, and a browsing / downloading mode.

Reference numeral 80 denotes a power supply control means, which is a battery detection circuit, DC
-It is composed of a DC converter, a switch circuit that switches the blocks to be energized, and the like, detects whether or not a battery is installed, the type of battery, and the remaining battery level, and based on the detection result and the instruction from the system control circuit 50, the DC- It controls the DC converter and supplies the required voltage to each unit including the recording medium for the required period.

Reference numeral 82 is a connector, 84 is a connector, 86 is a primary battery such as an alkaline battery or a lithium battery, a NiCd battery,
It is a power source consisting of a secondary battery such as a NiMH battery and a Li-ion battery, and an AC adapter.

Reference numeral 90 is an interface with a recording medium such as a memory card or hard disk, and 92 is a connector for connecting with a recording medium such as a memory card or hard disk.

Reference numeral 102 denotes a protection means that is a barrier that covers the image pickup unit including the lens 10 of the image pickup apparatus 100 to prevent the image pickup unit from being soiled or damaged.

Reference numeral 104 denotes an optical finder, which enables photographing using only the optical finder without using the electronic finder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, such as focus display, camera shake warning display, flash charge display, shutter speed display,
Aperture value display, exposure compensation display, etc. are installed.

Reference numeral 110 denotes a communication means having a mobile phone communication function such as a PDC system, a CDMA system, a W-CDMA system and a PHS system.

The communication means 110 is an RS232C, USB, I
It may be configured to have various communication functions such as EEE1394, P1284, SCSI, modem, LAN, wireless communication such as Bluetooth, and the like.

Reference numeral 112 denotes the image pickup apparatus 1 by the communication means 110.
In the case of wireless communication or a connector for connecting 00 to another device, it is an antenna.

Reference numeral 200 is a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory and a magnetic disk, an interface 204 with the imaging device 100, and a connector 206 for connecting to the imaging device 100. It should be noted that the recording medium 200 is described as a configuration incorporated in the image pickup apparatus 100 in this embodiment.

<Description of Configuration of Image Information Management Device 400> Next, the above-described image information management device 400 will be described with reference to FIG. In this embodiment, the image information management device 400
Functions as an expansion program providing apparatus that provides the imaging apparatus 100 with an expansion program for the imaging apparatus.

Reference numeral 402 is a control means for controlling the entire image information management apparatus.

Reference numeral 404 denotes a storage means, which is a main storage memory for the control means 402 to execute various applications.
Generally, SDRAM, RDRAM, etc. are used.

Reference numeral 406 is a display means composed of a liquid crystal display device, a speaker and the like, and displays necessary characters, images, sounds and the like according to the execution of the program by the control means 402.

Reference numeral 408 denotes an operating means composed of a keyboard, a microphone, etc., which inputs various settings necessary for the operation of the image information management apparatus 400 and / or various operation instructions to the control means 402.

Reference numeral 410 is a recording means for accumulating a plurality of applications for the control means 402 to operate, which is under the control of the above-mentioned control means 402.
Generally, a hard disk or the like is used.

A bus 412 connects the control means 402, the storage means 404, the display means 406, the operation means 408, the recording means 410, the communication means 414, the communication means 416, the image storage means 418, and the charging means 420, and controls them. Means 402
Is to transfer the processed data to each unit, or to transfer data at high speed between each unit (DMA transfer).

Reference numeral 414 is a network means for connecting the image information management apparatus 400 to the network 702, and is for transmitting / receiving data to / from the network. The network to be connected is generally Ethernet (registered trademark) or the like. Image information management device 40
0 is a packet network 7 including a mobile telephone network such as a telephone base station via the network means 414 and the network 702.
00 can be connected.

Reference numeral 416 is a network means for connecting the image information management apparatus 400 to the network 602, and is for transmitting / receiving data to / from the network. The network to be connected is generally Ethernet or the like. The image information management device 400 can be connected to the Internet 600 via the network unit 416 and the network 602.

Reference numeral 418 denotes an image storage means, which is the image pickup apparatus 100.
The captured image data transmitted from the packet network 700,
Data can be sequentially stored in a predetermined area via the network 702, the communication unit 414, and the bus 412.

Further, in response to a request from the image pickup apparatus 100 and / or the information processing apparatus (client computer, portable information equipment, mobile phone, etc.) 500, the photographed image data stored in a predetermined area of the image storage means 418 is sequentially read. , Bus 412, communication means 414, network 702, packet network 700, or bus 41
2, it can be sent via the communication means 416, the network 602, the Internet 600, and the network 604.

The image data storing / retrieving operation in the image storing means 418 is executed in cooperation with the charging database information management operation in the charging means 420.

Reference numeral 420 denotes a charging means, which stores image data when the image data photographed by the image pickup apparatus 100 is stored in the image storage means 418 and / or when the image data stored in the image storage means 418 is retrieved. Equipment to be taken out (imaging device 100 and / or information processing device 50
The identification / authentication of 0) is performed, and update management of the accounting database included in the accounting means 420 can be performed according to the authentication result and the storage / retrieval operation of the image data.

Then, in order to register billing identification information for billing the image pickup apparatus 100 and / or the information processing apparatus 500, the image pickup apparatus 100 and / or the information processing apparatus 50.
Based on the identification information transmitted from 0, the billing database included in the billing means 420 can be updated.

The other WWW servers 610, 620,
The identification / authentication is performed as a configuration capable of storing and / or retrieving image data from 630 and the like, and the charging means 42 is operated according to the authentication result and the storage / retrieval operation of these image data.
It is also possible to manage the update of the accounting database included in 0. In addition, other WWW servers 610, 620, 6
It may be configured to share information of the charging database with 30 or the like.

Further, the charging means 420 is the imaging device 100.
It is possible to store the user registration information of the image pickup apparatus 100 sent from the device, and provide various extended functions to the image pickup apparatus 100 from the extended function program storage unit 424 according to the registered user information.

Reference numeral 422 denotes an encryption / decryption means, which is the image pickup device 10.
0 and / or image data transmitted from the information processing device 500 can be subjected to encryption processing or decryption processing as necessary. These encryption / decryption processing operations are executed in cooperation with the charging database information in the charging means 420. The encrypted image data can be decrypted by the encryption / decryption circuit 34 included in the imaging device 100. In this case also, the decoding process is executed in cooperation with the charging database information in the charging means 420.

Reference numeral 424 is an expanded function program storage means,
Various extended functions can be provided to the image pickup apparatus 100 according to the user information of the image pickup apparatus 100 registered in the charging unit 420.

<Description of Operation of Imaging Device 100> FIGS. 4 and 5
Referring to, the imaging device 10 in the embodiment of the present invention
The operation of 0 will be described.

The system control circuit 50 initializes flags, control variables, etc. by turning on the power source such as battery replacement.
The system control circuit 50, which performs initialization processing of each part of the imaging device 100 (S1001), judges the setting position of the power switch 60, and if the power switch 60 is set to the power OFF state (S1002), the display unit of each display part The display is changed to an end state, necessary parameters including a flag, a control variable and the like, a setting mode and a setting mode are recorded in the non-volatile memory 56, and the power supply control unit 80 controls each unit of the image processing apparatus 100 including the image display unit 28. After performing a predetermined termination process such as cutting off unnecessary power (S1003), the process returns to S1002.

If the power switch 60 is set to power ON (S1002), the process proceeds to S1004.

The system control circuit 50 includes the power supply control means 8
It is determined whether there is a problem in the operation of the image pickup apparatus 100 based on the remaining capacity of the power supply 86 configured by a battery or the like or the operating condition (S1004). If there is a problem, the display unit 54 and / or the image display unit 28 After a predetermined warning is displayed by using an image or a sound using (S1005), the process returns to S1002.

If there is no problem with the power supply 86 (S100
4) and proceeds to S1006. The system control circuit 50 determines the state of the identification information 58 and / or the charging registration execution flag stored in a predetermined area of the non-volatile memory 56, and the imaging device 100 causes the image information management device (image gateway) 40.
It is determined whether or not the charging information necessary for enjoying the various services provided by 0 has been registered (S10).
06).

If the charging registration execution flag is set (S1006), the system control circuit 50 determines that the charging registration has already been executed, and proceeds to S1010.

If the charging registration execution flag is cleared (S1006), the system control circuit 50 determines that the charging registration has not been executed yet, and the charging means provided in the image information management apparatus (image gateway) 400. A billing registration process for registering necessary billing management information with respect to 420 is executed (S1007), and the process proceeds to S1008. Details of this charging registration process S1007 will be described later.

The system control circuit 50 judges the state of the error flag stored in the internal memory of the system control circuit 50 or the memory 52 (S1008), and the charging registration process S
If the error flag is set as a result of the execution of 1007, a predetermined warning is displayed by an image or voice using the display unit 54 and / or the image display unit 28 (S1009), and then the process returns to S1002.

If the error flag is not set as a result of the execution of the charging registration process S1007 (S1
008), the system control circuit 50 causes the charge registration process S1.
It is judged that 007 has ended normally, and a series of processing is completed
Return to S1002.

The system control circuit 50 uses the recording medium 200.
It is determined whether or not the operation state of (3) has a problem in the operation of the image pickup apparatus 100, particularly the recording / reproducing operation of the image data with respect to the recording medium (S1010). If there is a problem, the display unit 54 and / or the image display unit 28 is used. After a predetermined warning is displayed by an image or sound (S1005), the process returns to S1002.

If there is no problem in the operating state of the recording medium 200 (S1010), the process proceeds to S1011. The system control circuit 50 uses the display unit 54 to display various setting states of the image pickup apparatus 100 with images and sounds. If the image display of the image display unit 28 is ON, the image display unit 28
Is also used to display various setting states of the image pickup apparatus 100 by images and voice (S1011).

The system control circuit 50 judges the setting position of the mode dial 72, and if the normal photographing mode is set (S1012), the normal photographing mode process is executed (S1013), and if the process is finished. Return to S1002.
Details of the normal shooting mode process S1013 will be described later.

The system control circuit 50 judges the setting position of the mode dial 72, and if the movie shooting mode is set (S1014), the movie shooting mode process is executed (S1015), and if the process is finished. S1002
Return to. Details of this movie shooting mode processing S1015 will be described later.

The system control circuit 50 judges the setting position of the mode dial 72, and if the panoramic shooting mode is set (S1016), the panoramic shooting mode process is executed (S1017), and if the process is finished. S1002
Return to. Details of this panorama shooting mode processing S1017 will be described later.

The system control circuit 50 judges the setting position of the mode dial 72, and if the monochrome shooting mode is set (S1018), the monochrome shooting mode process is executed (S1019), and if the process is finished. Return to S1002.
Details of the monochrome shooting mode processing S1019 will be described later.

The system control circuit 50 judges the setting position of the mode dial 72, and if the mode dial 72 is set to the reproduction mode (S1020), reproduces and displays the photographed image data and displays an image as necessary. Playback mode processing of sending (storing) to the information management apparatus (image gateway) 400 is executed (S102).
1) If the processing is completed, the process returns to S1002. Details of this reproduction mode processing S1021 will be described later.

If the mode dial 72 is not set to any of the normal photographing mode, the movie photographing mode, the panoramic photographing mode, the monochrome photographing mode, or the reproduction mode (S1012, S1014, S101).
6, S1018, S1020) and S1002.

FIG. 6 shows a detailed flowchart of the charging registration process in S1007 of FIG.

The system control circuit 50 uses the image display unit 28.
A billing registration screen is displayed on (S1901), and the process proceeds to S1902.

If the user of the image pickup apparatus 100 operates the selection / selection switch 66, the determination / execution switch 68, the operation unit 70, etc. to select the charging registration input item (S1902), The system control circuit 50 switches the display of the charging registration input screen displayed on the image display unit 28 according to the selection of the charging registration input item (S1903), and proceeds to S1904.

The system control circuit 50 controls the image pickup apparatus 100.
The selection / switch switch 66 and the decision / execution switch 6 corresponding to the charging registration input screen displayed by the user of the
8. Accept the charging registration information input by operating the operation unit 70 (S1904), and if there is no problem with the received charging registration input information (S1905), store it in the internal memory of the system control circuit 50 or the memory 52. Then (S1906), the process proceeds to S1907.

If the next charging registration item is to be input (S1907), the process returns to S1902 to continue the processing.

When the necessary charging registration items have been input (S1907), the process proceeds to S1908. The system control circuit 50 reads out the device-specific information necessary for charging registration from the identification information 58 (S1908), and at the same time, step S190.
6, the internal memory of the system control circuit 50 or the memory 5
The billing input contents stored in 2 are read (S1909),
Communication means 110, antenna 112, packet network 700,
The device-specific information and the billing input contents are transmitted to the image information management device (image gateway) 400 via the network 702 to transmit the billing registration information (S1910).

Here, as the device-specific information used for charging registration, there are a manufacturer code, a model code, a serial number of the image pickup apparatus 100, information about a function to be equipped, and the like. In addition, there are shooting history information or the like that informs the registration status of the user of the imaging apparatus 100 up to now and / or the usage status of the imaging apparatus 100 up to now.

At the time of the accounting registration information transmission process in step S1910, the image information management device (image gateway)
If there is no error notification from 400 (S191)
1) The charging registration processing routine S1007 is ended.

Image information management device (image gateway) 4
If there is an error notification from S00 (S1911), the system control circuit 50 uses the display unit 54 and / or the image display unit 28 to display a predetermined warning with an image or sound (S1912), and then performs the charging registration process. Routine S100
Finish 7.

By carrying out this charge registration process, the image pickup apparatus 100 becomes an image information management apparatus (image gateway) 4
It is possible to enjoy various services provided by 00.

FIGS. 7 and 8 are detailed flowcharts of the normal photographing mode process in S1013 of FIG.

The system control circuit 50 is stored in the internal memory of the system control circuit 50 or the memory 52 when the extended function setting operation is performed by the user by operating various switches provided in the operation unit 70 (S1101). Set the operation mode information to the normal shooting mode (S11
02), extended function download processing for transmitting this operation mode information to the image information management apparatus (image gateway) 400 and downloading the extended function program corresponding to the transmitted operation mode information from the image information management apparatus (image gateway) 400 Is executed (S1103), and S1
Proceed to 104. This extended function download process S110
Details of 3 will be described later.

The system control circuit 50 operates the various switches provided in the operation unit 70 to change various settings relating to photographing by the user (S110).
4) Then, the operation setting related to shooting is changed according to the changed contents (S1105).

If the shutter switch SW1 is not pressed (S1106), the system control circuit 50 ends the normal photographing mode processing routine S1013.

If the shutter switch SW1 is pressed (S1106), the system control circuit 50 performs distance measurement processing to focus the photographing lens 10 on the subject, and performs photometry processing to determine the aperture value and shutter time. Yes (S1
107). In the photometric processing, the flash is set if necessary. Details of the distance measurement / photometry processing S1107 will be described later.

Without pressing the shutter switch SW2 (S
1108), and if the shutter switch SW1 is also released (S1109), the normal shooting mode processing routine
The process ends in S1013.

If the shutter switch SW2 is pressed (S1108), the system control circuit 50 causes the image sensor 1
2, an exposure process for writing the image data captured in the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22 or directly from the A / D converter via the memory control circuit 22; And the memory control circuit 22 and, if necessary, the image processing circuit 20, the memory 30
The image capturing process written in is read out and the photographing process including the developing process for performing various processes is executed (S1110).
The details of this photographing process S1110 will be described later.

When the photographing process S1110 is completed, the system control circuit 50 reads the photographed image data written in the memory 30, and uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to set a predetermined pixel. Development processing such as interpolation processing and color conversion processing is performed, and the image data subjected to the development processing is stored in a predetermined area of the memory 30 (S111).
1) and proceeds to S1112.

The system control circuit 50 reads out the image data stored in the predetermined area of the memory 30 and uses the compression / expansion circuit 32 to perform the compression process for the image compression process according to the set mode. The compressed image data is stored in a predetermined area of the memory 30 (S111
2) proceeds to S1113.

The system control circuit 50 reads the compressed image data stored in the predetermined area of the memory 30, performs the predetermined encryption processing using the encryption / decryption circuit 34 (S1113), and outputs the identification information. Add (S111
4), store the processed image data in a predetermined area of the memory 30, and proceed to S1115.

The image data encrypted in step S1113 can be decrypted by the encryption / decryption means 422 included in the image information management device (image gateway) 400. At this time, the decoding process is executed in cooperation with the charging database information in the charging means 420.

As described above, the encryption processing linked to the accounting management in the accounting means 420, the image storage management in the image storage means 418 and the decryption processing in the encryption / decryption means 422 of the image information management apparatus (image gateway) 400. The imaging device 1
By doing so, the image capturing apparatus 100 can enjoy various services provided by the image information management apparatus (image gateway) 400, for example, image management services by uploading and / or downloading captured image data.

The system control circuit 50 reads the compressed image data written in the memory 30 and, via the interface 90 or 94 and the connector 92 or 96,
Recording is performed on the recording medium 200 or 210 such as a memory card or a CompactFlash (registered trademark) card (S1).
115).

The system control circuit 50 repeats the current processing until the shutter switch SW1 is released (S1116). If the shutter switch SW1 is released (S1116), the system control circuit 50 finishes a series of shooting operations and ends the normal shooting mode processing routine S1013.

FIG. 9 shows the distance measurement / measurement in S1107 of FIG.
The detailed flowchart of a photometric process is shown.

The system control circuit 50 reads the charge signal from the image pickup device 14 and sequentially reads the photographed image data into the image processing circuit 20 via the A / D converter 16 (S12).
01). Using this sequentially read image data, the image processing circuit 20 uses a TTL (through the lens) type AE.
(Automatic exposure) processing, EF (flash pre-flash) processing, AF
A predetermined calculation used for (autofocus) processing is performed.

Using the calculation result in the image processing circuit 20,
The system control circuit 50 performs AE control using the exposure control means 40 until it is determined that the exposure (AE) is appropriate (S1202) (S1203).

Using the measurement data obtained by the AE control, the system control circuit 50 determines whether or not a flash is necessary (S1204).
Set the flag and charge the flash 48 (S12
05).

If it is determined that the exposure (AE) is appropriate (S1
202), measurement data and / or setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52.

Using the calculation result in the image processing circuit 20 and the measurement data obtained by the AE control, the system control circuit 50
Until the white balance (AWB) is judged to be appropriate (SWB
1206), the color processing parameters are adjusted using the image processing circuit 20, and AWB control is performed (S1207).

If it is determined that the white balance (AWB) is appropriate (S1206), the measurement data and / or the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52. The system control circuit 50 measures the distance (AF) by using the measurement data obtained by the AE control and the AWB control.
Until AF is determined to be in focus (S1208), AF control is performed using the distance measurement control means 42 (S1209).

If it is determined that the distance measurement (AF) is in focus (S1
208), the measurement data and / or the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52, and the distance measurement / photometry processing routine S1107 ends.

FIG. 10 is a detailed flowchart of the photographing process in S1110 of FIG.

In accordance with the photometric data stored in the internal memory of the system control circuit 50 or the memory 52, the system control circuit 50 causes the exposure control means 40 to open the shutter 12 having the aperture function according to the aperture value and the image pickup device. 10 is exposed (S1301, S1302).

Flash 48 by flash flag
It is determined whether or not is necessary (S1303), and if necessary, the flash is emitted (S1304).

The system control circuit 50 waits for the exposure end of the image pickup device 12 according to the photometric data (S1305), closes the shutter 12 (S1306), reads the charge signal from the image pickup device 14, and the A / D converter 16 displays the image. The captured image data is written to the memory 30 via the processing circuit 20 and the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22 (S1307). When the series of processing is completed, the photographing processing routine S1110
To finish.

11 and 12 are detailed flowcharts of the movie shooting mode process in S1015 of FIG.

The system control circuit 50 is stored in the internal memory of the system control circuit 50 or the memory 52 when the extended function setting operation is performed by the user by operating various switches provided in the operation unit 70 (S1601). Set the operation mode information to movie shooting mode (S
1602), extended function download processing for transmitting this operation mode information to the image information management apparatus (image gateway) 400 and downloading an extended function program corresponding to the transmitted operation mode information from the image information management apparatus (image gateway) 400 Is executed (S1603),
It proceeds to S1604. This extended function download process S1
Details of 603 will be described later.

The system control circuit 50 operates the various switches of the operation unit 70 to change various settings relating to photographing by the user (S160).
4) Then, the operation setting related to shooting is changed according to the changed contents (S1605).

If the shutter switch SW1 is not pressed (S1621), the system control circuit 50 ends the movie shooting mode processing routine S1015. If the shutter switch SW1 is pressed (S162
1), the system control circuit 50 performs distance measurement processing to focus the taking lens 10 on the subject, and performs photometry processing to determine the aperture value and shutter time (S1622).
In the photometric processing, the flash is set if necessary. The details of the distance measurement / photometry processing S1622 are as described above with reference to FIG.

Without pressing the shutter switch SW2 (S
1623) and if the shutter switch SW1 is also released (S1624), the movie shooting mode processing routine S1015 ends.

If the shutter switch SW2 is pressed (S1623), the system control circuit 50 causes the image sensor 1
2, an exposure process for writing the image data captured in the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22 or directly from the A / D converter via the memory control circuit 22; And the memory control circuit 22 and, if necessary, the image processing circuit 20, the memory 30
The image data written in is read out, and a photographing process including a developing process for performing various processes is executed (S1625).
The details of this photographing process S1625 are as described above with reference to FIG.

When the photographing process S1625 is completed, the system control circuit 50 reads the photographed image data written in the memory 30, and uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to set a predetermined pixel. Development processing such as interpolation processing and color conversion processing is performed, and the image data subjected to the development processing is stored in a predetermined area of the memory 30 (S162).
6) and proceeds to S1627.

The system control circuit 50 reads out the image data stored in the predetermined area of the memory 30 and, using the compression / expansion circuit 32, carries out the compression processing for performing the image compression processing according to the set mode. The compressed image data is stored in a predetermined area of the memory 30 (S162).
7) and proceeds to S1628.

The system control circuit 50 reads the compressed image data stored in the predetermined area of the memory 30, performs the predetermined encryption processing using the encryption / decryption circuit 34 (S1628), and outputs the identification information. Add (S162
9), store the processed image data in a predetermined area of the memory 30, and proceed to S1630. Note that step S16
The image data encrypted in 28 can be decrypted by the encryption / decryption means 422 included in the image information management device (image gateway) 400. At this time, the decoding process is executed in cooperation with the charging database information in the charging means 420.

As described above, the encryption processing in cooperation with the accounting management in the accounting means 420, the image storage management in the image storage means 418 and the decryption processing in the encryption / decryption means 422 of the image information management apparatus (image gateway) 400. The imaging device 1
By doing so, the image capturing apparatus 100 can enjoy various services provided by the image information management apparatus (image gateway) 400, for example, image management services by uploading and / or downloading captured image data.

The system control circuit 50 reads the compressed image data written in the memory 30 and, via the interface 90 or 94 and the connector 92 or 96,
Recording is performed on the recording medium 200 or 210 such as a memory card or a compact flash card (S1630).

The system control circuit 50 determines that the movie recording operation has not passed the preset recording time (S1).
631), recording medium 2 for continuing movie shooting operation
If the remaining amount of 00 is sufficient (S1632), S
Proceed to 1633.

The system control circuit 50 determines if the movie recording operation has passed a preset recording time (S1).
631), or if the remaining amount of the recording medium 200 is insufficient to continue the movie shooting operation (S163).
2) After a series of movie shooting operations, the movie shooting mode processing routine S1015 ends.

If the shutter switch SW2 is still pressed (S1633), the process returns to S1625 to continue the series of movie shooting operations.

If the shutter switch SW2 is still released (S1633, S1634), S1625.
Return to and continue the series of movie shooting operations.

If the shutter switch SW2 is pressed again (S1633, S1634), the system control circuit 5
In 0, the series of movie shooting operations is completed, and the movie shooting mode processing routine S1015 ends.

13 and 14 are detailed flowcharts of the panoramic photography mode process in S1017 of FIG.

The system control circuit 50 is stored in the internal memory of the system control circuit 50 or the memory 52 when the extended function setting operation is performed by the user by operating various switches provided in the operation unit 70 (S1701). Set the operation mode information to the panorama shooting mode (S
1702), extended function download processing for transmitting this operation mode information to the image information management apparatus (image gateway) 400 and downloading the extended function program corresponding to the transmitted operation mode information from the image information management apparatus (image gateway) 400 Is executed (S1703),
Proceeds to S1704. This extended function download process S1
Details of 703 will be described later.

The system control circuit 50 operates the various switches of the operation unit 70 to change various settings relating to photographing by the user (S170).
4) Then, the operation setting related to shooting is changed according to the changed contents (S1705), and the process proceeds to S1706.

The system control circuit 50 uses the image display unit 28.
The panorama shooting mode selection screen is displayed on (S170
6) and proceeds to S1707. The user of the image pickup apparatus 100 can select an arbitrary mode from a plurality of panoramic shooting modes by looking at the panorama mode selection screen displayed on the image display unit 28. 2X for panoramic shooting mode
There are 2 panorama modes, horizontal panorama mode, vertical panorama mode, etc. By overlaying multiple shots, you can create a two-dimensionally expanded panoramic image, a horizontally expanded panoramic image, or a vertically expanded panoramic image. You can do it.

Information indicating the positional relationship is added to each of a series of captured images, and the images are combined by the image processing apparatus itself or after the images are transferred to a computer or the like, and one panorama is formed. It is possible to create images.

When the panorama mode is selected by the selection / selection switch 66 and the decision / execution switch 68 (S1707), the system control circuit 50 initializes flags, parameters and variables according to the selected panorama mode. Initial settings such as setting of a memory area and reading of a display screen as a user interface are performed (S1708), the panoramic shooting screen is displayed on the image display unit 28 (S1709), and the process proceeds to S1710.

If the end of the panorama mode is selected by operating the operation unit 70 and / or the selection / switching switch 66 and / or the decision / execution switch 68 (S17).
10) The system control circuit 50 ends the panorama shooting mode processing routine S1017 after performing a series of panorama shooting set end processing (S1711).

If the end of the panorama mode is not selected (S1710), the process proceeds to S1712. When it is necessary to select the next image area in performing a series of panoramic photographing (S1712), the system control circuit 50 selects the image area as needed (S1713) and according to the selected image area. If it is necessary to change the screen layout by switching the screen layout, the screen layout is switched and displayed. In the second and subsequent panoramic shots, the already shot shooting area is set to the quick review display state and By setting the next shooting area moved for shooting to the through display state, it becomes possible to display the reproduced image of the already shot image and the image to be shot next in a partially overlapped manner. This allows the user of the image processing apparatus 100 to easily determine the next shooting composition.

The system control circuit 50 sets the through display state in which the picked-up image data is sequentially displayed (S17).
14) and proceeds to S1721. In the through display state, the image sensor 12, the A / D converter 16, the image processing circuit 2
0, the image display memory 24 via the memory control circuit 22.
Data sequentially written to the memory control circuit 22, D
An electronic viewfinder function is realized by sequentially displaying in the above-mentioned photographing area of the image display unit 28 via the / A converter 26.

If the shutter switch SW1 is not pressed (S1721), the system control circuit 50 ends the panoramic photography mode processing routine S1017. If the shutter switch SW1 is pressed (S172
1), the system control circuit 50 performs distance measurement processing to focus the taking lens 10 on the subject, and performs photometry processing to determine the aperture value and shutter time (S1722).
In the photometric processing, the flash is set if necessary. The details of the distance measurement / photometry processing S1722 are as described above with reference to FIG.

Without pressing the shutter switch SW2 (S
1723) and if the shutter switch SW1 is also released (S1724), the panoramic shooting mode processing routine S1017 ends.

If the shutter switch SW2 is pressed (S1723), the system control circuit 50 causes the image sensor 1
2, an exposure process for writing the image data captured in the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22 or directly from the A / D converter via the memory control circuit 22; And the memory control circuit 22 and, if necessary, the image processing circuit 20, the memory 30
The image capturing process written in is read out and the photographing process including the developing process for performing various processes is executed (S1725).
The details of this photographing process S1725 are as described above with reference to FIG.

When the photographing process S1725 is finished, the system control circuit 50 sets the display state of the image display unit 28 to the quick review display state (S1726), and S17
Proceed to 27. In the quick review state, the image data stored in the predetermined area of the memory 30 is read out, the memory control circuit 22 and, if necessary, the image processing circuit 20 are read.
Display image processing is performed using, and the image data transferred to the image display memory 24 is displayed in the above-described shooting area of the image display unit 28 via the memory control circuit 22 and the D / A converter 26, thereby performing shooting. It realizes an electronic viewfinder function that automatically reproduces images.

The system control circuit 50 reads the photographed image data written in the memory 30, and uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to develop predetermined pixel interpolation processing and color conversion processing. After processing, the image data subjected to development processing is stored in a predetermined area of the memory 30 (S1727), and the process proceeds to S1728.

The system control circuit 50 reads out the image data stored in the predetermined area of the memory 30 and, using the compression / expansion circuit 32, carries out a compression process for performing an image compression process according to the set mode. The compressed image data is stored in a predetermined area of the memory 30 (S172
8) and proceeds to S1729.

The system control circuit 50 reads the compressed image data stored in the predetermined area of the memory 30, performs the predetermined encryption processing using the encryption / decryption circuit 34 (S1729), and outputs the identification information. Add (S173
0), the processed image data is stored in a predetermined area of the memory 30, and the process proceeds to S1731. Note that step S17
The image data encrypted in 29 can be decrypted by the encryption / decryption unit 422 included in the image information management device (image gateway) 400. At this time, the decoding process is executed in cooperation with the charging database information in the charging means 420.

As described above, the encryption processing linked to the accounting management in the accounting means 420, the image storage management in the image storage means 418 and the decryption processing in the encryption / decryption means 422 of the image information management apparatus (image gateway) 400. The imaging device 1
By doing so, the image capturing apparatus 100 can enjoy various services provided by the image information management apparatus (image gateway) 400, for example, image management services by uploading and / or downloading captured image data.

The system control circuit 50 reads the compressed image data written in the memory 30 and, via the interface 90 or 94 and the connector 92 or 96,
Recording is performed on the recording medium 200 or 210 such as a memory card or a compact flash card (S1731).

The system control circuit 50 repeats the current processing until the shutter switch SW1 is released (S1732). If the shutter switch SW1 is released (S1732), the system control circuit 50 finishes a series of shooting operations, and the panorama shooting mode processing routine S101.
Finish 7.

FIGS. 15 and 16 show S1019 of FIG.
5 is a detailed flowchart of the monochrome shooting mode process in FIG.

The system control circuit 50 is stored in the internal memory of the system control circuit 50 or the memory 52 when the extended function setting operation is performed by the user by operating various switches provided in the operation unit 70 (S1801). Set the operation mode information to monochrome shooting mode (S18
02), extended function download processing for transmitting this operation mode information to the image information management device (image gateway) 400 and downloading an extended function program corresponding to the transmitted operation mode information from the image information management device (image gateway) 400 Is executed (S1803), S1
Proceed to 804. This extended function download process S180
Details of 3 will be described later.

The system control circuit 50 operates the various switches of the operation unit 70 to change various settings relating to the photographing by the user (S180).
4) Then, the operation setting related to shooting is changed according to the changed contents (S1805).

If the shutter switch SW1 is not pressed (S1806), the system control circuit 50 terminates the monochrome shooting mode processing routine S1019. If the shutter switch SW1 is pressed (S1806), the system control circuit 50 performs distance measurement processing to perform photographing lens 1
The focus of 0 is set on the subject, and photometry processing is performed to determine the aperture value and shutter time (S1807). In the photometric processing, the flash is set if necessary. The details of the distance measuring / photometric processing S1807 are as described above with reference to FIG.

[0165] Without pressing the shutter switch SW2 (S
1808), and if the shutter switch SW1 is also released (S1809), the monochrome shooting mode processing routine S1019 ends. If the shutter switch SW2 is pressed (S1808), the system control circuit 50
Image sensor 12, A / D converter 16, image processing circuit 20,
An exposure process for writing the image data captured in the memory 30 via the memory control circuit 22 or directly from the A / D converter via the memory control circuit 22, and the memory control circuit 22 and, if necessary, an image processing circuit. Using 20
The image data written in the memory 30 is read out, and a shooting process including a developing process for performing various processes is executed (S1).
810). The details of the shooting process S1810 are as described above with reference to FIG.

When the photographing process S1810 is completed, the system control circuit 50 reads the photographed image data written in the memory 30, and uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to set a predetermined pixel. Development processing such as interpolation processing and color conversion processing is performed, and the image data subjected to the development processing is stored in a predetermined area of the memory 30 (S181).
1) and proceeds to S1812.

The system control circuit 50 reads out the image data stored in the predetermined area of the memory 30 and uses the compression / expansion circuit 32 to perform the compression process for the image compression process according to the set mode. The compressed image data is stored in a predetermined area of the memory 30 (S181).
2) proceeds to S1813.

The system control circuit 50 reads the compressed image data stored in the predetermined area of the memory 30, performs the predetermined encryption processing using the encryption / decryption circuit 34 (S1813), and outputs the identification information. Add (S181
4), the processed image data is stored in a predetermined area of the memory 30, and the process proceeds to S1815. Note that step S18
The image data encrypted in 13 can be decrypted by the encryption / decryption unit 422 included in the image information management device (image gateway) 400. At this time, the decoding process is executed in cooperation with the charging database information in the charging means 420.

As described above, the encryption processing linked with the accounting management in the accounting means 420, the image storage management in the image storage means 418 and the decryption processing in the encryption / decryption means 422 of the image information management device (image gateway) 400. The imaging device 1
By doing so, the image capturing apparatus 100 can enjoy various services provided by the image information management apparatus (image gateway) 400, for example, image management services by uploading and / or downloading captured image data.

The system control circuit 50 reads the compressed image data written in the memory 30 and, via the interface 90 or 94 and the connector 92 or 96,
Recording is performed on the recording medium 200 or 210 such as a memory card or a compact flash card (S1815).

The system control circuit 50 repeats the current processing until the shutter switch SW1 is released (S1816). If the shutter switch SW1 is released (S1816), the system control circuit 50 finishes a series of shooting operations and ends the monochrome shooting mode processing routine S1019.

17 and 18 are S1021 of FIG.
6 shows a detailed flowchart of the reproduction process in FIG.

The system control circuit 50 is stored in the internal memory of the system control circuit 50 or the memory 52 when the user performs an extended function setting operation by operating various switches provided in the operation unit 70 (S1801). The operation mode information is set to the reproduction mode (S140
2), an extended function download process of transmitting this operation mode information to the image information management apparatus (image gateway) 400 and downloading an extended function program corresponding to the transmitted operation mode information from the image information management apparatus (image gateway) 400 Is executed (S1403), and S140
Go to 4. Details of this extended function download processing S1803 will be described later.

The system control circuit 50 operates the various switches of the operation unit 70 to change various settings relating to reproduction by the user (S140).
4) Then, the operation setting regarding reproduction is changed according to the changed contents (S1405).

The system control circuit 50 transfers the selected image data from a predetermined area of the memory 30 or the recording medium 200.
Stored in a predetermined area of the memory 30 and then read (S1
406), the setting state of the billing identification information included in the read image data is determined (S1407). If the billing identification information is set correctly (S1407), S140
Proceed to 9.

If the billing identification information is not set correctly (S1407), the system control circuit 50 uses the display unit 54 and / or the image display unit 28 to display a predetermined warning by an image or a sound ( S1408), S
Proceed to 1417.

The system control circuit 50 reads out the image data stored in the predetermined area of the memory 30, and the encryption / decryption circuit 34 performs a predetermined decryption process (S1409).
After performing a predetermined decompression process by the compression / decompression circuit 32 (S1410), a predetermined image process is performed using the memory control circuit 22 and the image processing circuit 20 as necessary,
Reproduction display is performed by the image display unit 28 via the memory control circuit 22 and the D / A converter 26 (S1411), and S1 is displayed.
Proceed to 412.

The system control circuit 50 is set by the user to store (upload) the image storage to the image storage means 418 provided in the image information management apparatus (image gateway) 400 by operating various switches provided in the operation unit 70. If so (S1412), the process proceeds to S1413.
If the image storage transmission (upload) is not set (S1412), the process proceeds to S1417.

The system control circuit 50 uses the image storage means 4
No. 18 information about the operational setting status of the image pickup apparatus 100 for notifying the image information management apparatus 400 that the setting for uploading the image data to the image pickup apparatus 100 has been made, and the upload of the image data to the image storage unit 418. After adding predetermined storage information necessary for the image data to the image data (S1413), the image data is transmitted to the image information management apparatus (image gateway) 400 via the communication unit 110, the antenna 112, the packet network 700, and the network 702. (S1414), the process proceeds to S1415.

In this way, the photographed image data linked with the accounting management in the accounting means 420 of the image information management apparatus (image gateway) 400, the image storage management in the image storage means 418 and the decryption processing in the encryption / decryption means 422. The image capturing apparatus 100 performs various types of services provided by the image information management apparatus (image gateway) 400 by performing the encryption processing and the captured image data transmission processing on the image capturing apparatus 100.
For example, it becomes possible to enjoy an image management service by uploading captured image data.

During the image data transmission processing in step S1414, the image information management device (image gateway) 4
If there is no error notification from 00 (S1415),
It proceeds to S1417.

Image information management device (image gateway) 4
If there is an error notification from 00 (S1415), the system control circuit 50 uses the display unit 54 and / or the image display unit 28 to display a predetermined warning by an image or sound (S1416), and then performs a reproduction processing routine. The process ends in S1021.

If the next image is to be reproduced and / or uploaded to the image information management device (image gateway) 400 (S1417), the process returns to S1406 to repeat the series of processes. If the series of processes is completed without reproducing and / or uploading the next image to the image information management apparatus (image gateway) 400 (S1417), the reproduction processing routine S1021 is ended.

19 and 20 show S110 of FIG.
3, S1603 of FIG. 11, S1703 of FIG. 10, and FIG.
18 is a detailed flowchart of the extended function download process in S1803 of FIG. 17 and S1403 of FIG.

The system control circuit 50 adds the operation mode information of the image pickup apparatus 100 stored in the internal memory of the system control circuit 50 or the memory 52 (S150).
1), communication means 110, antenna 112, packet network 7
00, an extended function menu request notification for requesting an extended function menu according to the operation mode is transmitted to the image information management device (image gateway) 400 via the network 702 (S1502), and the process proceeds to S1503.

When the system control circuit 50 receives a command or data from the image information management device (image gateway) 400 (S1503), the process proceeds to S1504. At the time of the extended function menu request notification processing in step S1502, the image information management device (image gateway) 400
If there is no error notification from S1504, S15
Proceed to 06. Image information management device (image gateway) 4
If there is an error notification from 00 (S1504), the system control circuit 50 sets an error flag and stores it in the internal memory of the system control circuit 50 or the memory 52 (S1505), and ends the extended function download processing routine. To do.

The system control circuit 50 receives the extended function menu from the image information management apparatus (image gateway) 400 and stores it in a predetermined area of the memory 30 (S1).
506), the extended function selection screen is displayed on the image display unit 28 (S1507), and the process proceeds to S1508.

When the user selects a function to be extended by operating various switches provided in the operation unit 70 (S1508), the system control circuit 50 communicates with the communication means 110, the antenna 112, the packet network 700, and the network 702. The selected extended function download request notification is transmitted to the image information management device (image gateway) 400 via (S1509), and the process proceeds to S1510. If the user has not selected a function to be expanded (S1508), the expanded function download processing routine ends.

When the system control circuit 50 receives a command or data from the image information management device (image gateway) 400 (S1510), the process proceeds to S1511. If there is no error notification from the image information management apparatus (image gateway) 400 during the selective extended function download request notification processing in step S1509 (S151).
1) proceeds to S1513.

Image information management device (image gateway) 4
If there is an error notification from 00 (S1511), the system control circuit 50 sets an error flag and stores it in the internal memory of the system control circuit 50 or the memory 52 (S1512), and ends the extended function download processing routine. To do.

The system control circuit 50 receives the extended function program data from the image information management apparatus (image gateway) 400, stores the extended function program data in a predetermined area of the memory 30 (S1513), and expands the extended function program data corresponding to the received extended function program data. The function is added to the menu and / or the operation mode and stored in the internal memory of the system control circuit 50 or the memory 52 (S1514), and the process proceeds to S1515.

If the next extended function is selected (S151)
5) and returns to S1507. If the next extended function is not selected (S1515), the extended function download processing routine ends.

21 to 25 are examples of menu screens of the image pickup apparatus according to the embodiment of the present invention.

FIG. 21 shows an example of the menu screen in the normal photographing mode.

FIG. 21A shows an example of the shooting menu screen in the normal shooting mode, in which the long-time noise reduction function, which is an extended function, is not set yet.

FIG. 21 (b) is an example of a screen in which the long-time noise reduction function and the bulb photographing function can be selected in the extended function menu setting during the extended function download processing in S1103 of FIG. The example which selected the noise reduction function per second is shown.

The display contents of this extended function menu are transmitted from the image information management apparatus 400 in accordance with the notified operating state of the image pickup apparatus 100, that is, the normal photographing mode, as a result of notifying the extended information menu request to the image information management apparatus 400. It was done.

FIG. 21C shows a display example of the shooting menu after the program for the long-time noise reduction function is downloaded in this extended function menu.

As a result of notifying the image information management device 400 of the extended function download request, the program of the long-time noise reduction function has a function of the image information management device 400 according to the operation state of the image pickup device 100, that is, the normal photographing mode. It was sent from.

FIG. 22 is an example of a menu screen in the movie shooting mode.

22 (a) and 22 (b) are examples of the shooting menu screen in the movie shooting mode, in which the addition mode of the moving image recording pixel number, which is an extended function, is not set yet.

FIG. 22 (c) shows an example of a screen on which it is possible to select the number of moving image recording pixels and the addition of a fader function in the extended function menu setting during the extended function download processing in S1603 of FIG. An example in which addition of the number of pixels is selected is shown.

The display contents of the extended function menu are transmitted from the image information management device 400 in accordance with the notified operating state of the image pickup device 100, that is, the movie shooting mode, as a result of notifying the image information management device 400 of the extended function menu request. It was done.

FIG. 22D shows a display example of the shooting menu after downloading the program for adding the number of moving image recording pixels in this extended function menu.

[0205] This program for adding the number of pixels for recording moving images is
As a result of notifying the image information management apparatus 400 of the extended function download request, the image information management apparatus 40 is notified according to the operation state of the image pickup apparatus 100, that is, the movie shooting mode.
It was sent from 0.

FIG. 23 is an example of a menu screen in the panoramic shooting mode.

FIGS. 23A and 23B are examples of the shooting menu screen in the panoramic shooting mode, in which the additional mode of the panorama function, which is an extended function, is not set yet.

FIG. 23 (c) is an example of a screen in which the panoramic function addition can be selected in the expanded function menu setting during the expanded function download processing in S1703 of FIG. Shows.

The display contents of the extended function menu are transmitted from the image information management apparatus 400 in accordance with the notified operating state of the image pickup apparatus 100, that is, the panoramic shooting mode, as a result of the notification of the extended function menu request to the image information management apparatus 400. It was done.

FIG. 23 (d) shows a display example of the shooting menu after the program for adding the panorama function is downloaded in this extended function menu.

As a result of notifying the image information management device 400 of the extended function download request, the program for adding the panorama function determines that the image information management device 400 is in accordance with the operation state of the image pickup device 100, that is, the panoramic shooting mode.
It was sent from.

FIG. 24 is an example of a menu screen in the monochrome shooting mode.

FIG. 24A shows an example of the shooting menu screen in the monochrome shooting mode, in which the sepia mode function which is an extended function is not set yet.

FIG. 24 (b) shows an example of a screen in which the sepia mode addition can be selected in the extended function menu setting during the extended function download processing in S1803 of FIG. 15, and in this example, the sepia mode addition is selected. Shows.

The display contents of the extended function menu are transmitted from the image information management apparatus 400 in accordance with the notified operating state of the image pickup apparatus 100, that is, the monochrome photographing mode, as a result of notifying the image information management apparatus 400 of the extended function menu request. It was done.

FIG. 24C shows a display example of the shooting menu after downloading the program of the sepia mode function in this extended function menu.

As a result of notifying the image information management device 400 of the extended function download request, this sepia mode function program is transmitted from the image information management device 400 in accordance with the operation state of the image pickup device 100, that is, the monochrome photographing mode. It is a thing.

FIG. 25 is an example of a menu screen in the reproduction mode.

FIG. 25A shows an example of the reproduction menu screen in the reproduction mode, in which the wipe function of the slide show reproduction, which is an extended function, is not set yet.

FIG. 25 (b) shows an example of a screen in which the addition of the wipe function for slide show reproduction can be selected in the extended function menu setting during the extended function download processing in S1403 of FIG. 17, and here the wipe function for slide show reproduction is selected. The example which selected addition is shown.

The display contents of the extended function menu are transmitted from the image information management apparatus 400 in accordance with the notified operation state of the image pickup apparatus 100, that is, the reproduction mode, as a result of notifying the extended information menu request to the image information management apparatus 400. It is a thing.

FIG. 22C shows a display example of the shooting menu after downloading the program for the wipe function of slide show reproduction in the extended function menu.

As a result of notifying the image information management device 400 of the extended function download request, this sepia mode function program is transmitted from the image information management device 400 in accordance with the notified operating state of the image pickup device 100, that is, the reproduction mode. It is a thing.

<Description of Operation of Image Information Management Device 400> FIGS. 26 and 27 show the image information management device 400 of this embodiment.
The flowchart of the main routine of is shown.

The operation of the image information management apparatus 400 will be described with reference to FIGS. 26 and 27.

When the image information management device 400 is turned on, the control means 402 initializes flags, registers, control variables, etc., and executes a control program such as an operating system stored in a part of the area of the recording means 410 on the bus 412. It is read into the storage unit 404 via the and executed. Then, the control unit 402 initializes each unit of the image information management device 400 (S2001).

The control means 402 determines whether or not a command, data, or the like has been notified from the image pickup apparatus 100 via the packet network 700, the network 702, and the network means 414 (S2002). If there is a notification of a command or data (S2002), the control means 40
2 receives a command and / or image data and / or their additional information from the image pickup apparatus 100, and stores the storage means 40.
4 and / or a predetermined area of the recording unit 410 (S2003).

If the command and / or the data requesting the charging registration to the charging information database of the charging means 420 is not received from the image pickup apparatus 100 (S200).
4) and proceed to S2008. If a command and / or data requesting charging registration to the charging information database included in the charging means 420 is received from the imaging device 100 (S
2004), the control unit 402 stores and registers in a predetermined area of the billing information database included in the billing unit 420 based on the received device-specific information and / or the billing input content (S2005).

As described above, by using the identification information unique to the image pickup apparatus 100 to register the account of the image pickup apparatus 100 in the billing information database, the billing management in the billing unit 420 and the image storage management in the image storing unit 418 are performed. Also, various services provided by the image information management apparatus (image gateway) 400 that cooperates with the decryption processing by the encryption / decryption means 422, for example, an image management service by uploading and / or downloading captured image data,
00 can be provided.

[0230] If the registration in the accounting database is normally performed (S2006), the process returns to S2002. If registration in the billing database is not successful (S20
06), the control means 402, via the communication means 414, the network 702, and the packet network 700, the imaging device 10
The image pickup apparatus 1 sends an error notification regarding a charge registration request from 0.
00 (S2007) and returns to S2002.

If the command for uploading the captured image data and the data of the storage information for performing the upload process have not been received from the image capturing apparatus 100 (S
2008), the process proceeds to S2013.

If a command for requesting upload of photographed image data and data of storage information for performing upload processing are received from the image pickup apparatus 100 (S200
8), the control unit 402 determines the setting state of the billing identification information included in the received upload image data (S2).
009).

If the billing identification information is set correctly (S2009), the process proceeds to S2010. If the billing identification information is not set correctly (S2009), the control unit 402 controls the communication unit 414, the network 702,
An error notification relating to an image data upload request from the image capturing apparatus 100 is returned to the image capturing apparatus 100 via the packet network 700 (S2012), and the process returns to S2002.

The control unit 402 receives the image data from the image pickup apparatus 100 and stores it in a predetermined area of the storage unit 404 and / or the recording unit 4.
The image data stored in the predetermined area of 10 is read out and
The data is recorded in a predetermined area of the image storage unit 418 via 12 (S2010), and the image capturing apparatus 1 included in the charging unit 420 corresponds to the recorded image data of the image capturing apparatus 100.
The accounting information database for 00 is updated (S2
011) and returns to S2002.

As described above, the image information management device (image gateway) 4 is operated by linking the charge management in the charge means 420 and the image storage management in the image storage means 418.
00 provides various services such as an image management service by uploading captured image data.
Can be provided to 0.

If the command requesting the download of the selected extended function program is not received from the image pickup apparatus 100 (S2013), the process proceeds to S2019.

When the command requesting the download of the selected extended function program is received from the image pickup apparatus 100 (S2013), the control means 402 displays the charging identification information and the operation mode information included in the received selected extended function download request notification. Determine the setting status (S201
4). If the billing identification information and the operation mode information are set correctly (S2014), the process proceeds to S2015.

If the billing identification information and the operation mode information are not set correctly (S2014), the control means 402 causes the selected expansion from the image pickup apparatus 100 via the communication means 414, the network 702 and the packet network 700. An error notification relating to the request to download the function program is returned to the imaging device 100 (S2018), and S200
Return to 2.

The control means 402 reads the extended function program requested by the image pickup apparatus 100 from a predetermined area of the extended function program storage means 424 according to the operation mode information attached to the selected extended function download request notification, and stores it. A predetermined area of the means 404 and / or the recording means 41
After storing in the predetermined area of 0 (S2015), the stored extended function program is read out and transmitted to the image pickup apparatus 100 via the communication unit 414, the network 702, and the packet network 700 (S2016), and the image pickup apparatus 10
In accordance with the extended function program transmitted to 0, the charging information database regarding the imaging device 100 included in the charging unit 420 is updated (S2017), and the process returns to S2002.

As described above, the operation mode information and billing means 420 attached to the selected extended function download request notification
In accordance with various services provided by the image information management apparatus (image gateway) 400, for example, operation mode information of the image capturing apparatus 100, by linking the charging management in the computer and the storage management of the extended function program in the extended function program storage unit 424. It is possible to provide the extended function service to the imaging device 100 by downloading the extended function program.

If the command for requesting the download of the extended function menu is not received from the image pickup apparatus 100 (S2019), the process returns to S2002. When the command requesting the download of the selected extended function menu is received from the imaging device 100 (S2019), the control unit 40
2 determines the setting state of the billing identification information and the operation mode information included in the received extended function menu request notification (S
2020).

If the billing identification information and the operation mode information are set correctly (S2020), the process proceeds to S2021. If the billing identification information and the operation mode information are not set correctly (S2020), the control means 402
Returns an error notification regarding the extended function menu request from the image pickup apparatus 100 to the image pickup apparatus 100 via the communication unit 414, the network 702, and the packet network 700 (S2023), and returns to S2002.

The control means 402 controls the image pickup apparatus 1 according to the operation mode information attached to the extended function menu request notification.
00 to determine the list content of the extended function programs that can be provided in the extended function menu (S2021), and the determined extended function menu is sent via the communication unit 414, the network 702, and the packet network 700.
It transmits to 0 (S2022), and returns to S2002. The extended function program storage unit 424 stores the extended function program according to the operation mode of the image pickup apparatus 100, and S
In 2021, a list of extended function programs according to the operation mode of the image pickup apparatus 100 (list of extended function titles)
From the extended function program storage means 424,
It transmits to the imaging device 100 via the communication means 414.

As described above, the operation mode information attached to the extended function menu request notification, the charging management in the charging means 420, and the extended function program storage management in the extended function program storage means 424 are made to cooperate with each other, whereby image information management is performed. The imaging device 10 provides various services provided by the device (image gateway) 400, for example, a service of providing an extended function menu according to operation mode information of the imaging device 100.
Can be provided to 0.

As described above, according to the embodiment of the present invention, the operation mode information attached to the extended function menu request notification, the charging management in the charging means 420, and the extended function program in the extended function program storage means 424. By coordinating the storage management, various services provided by the image information management apparatus (image gateway) 400, for example, a service of providing an extended function menu according to the operation mode information of the imaging apparatus 100 can be provided to the imaging apparatus 100. It will be possible.

Further, by linking the operation mode information attached to the selected extended function download request notification, the charging management in the charging means 420 and the expanded function program storage management in the expanded function program storage means 424, the image information management apparatus It is possible to provide the image capturing apparatus 100 with various services provided by the (image gateway) 400, for example, the extended function service by downloading the extended function program according to the operation mode information of the image capturing apparatus 100.

The embodiment of the present invention has been described above with reference to FIGS. 1 to 27.

In the description of the embodiment, the image pickup apparatus 100 and the image information management apparatus (image gateway) 4 are used.
00, information processing device (client computer) 50
0 has been described as a single configuration, but the imaging device 1
00 may be a single or multiple configuration, image information management device (image gateway) 400 may be a single or multiple configuration, and information processing device (client computer) 500 may be a single or multiple configuration.

The packet network 700 including the mobile phone base station may have either a single structure or a plurality of structures.

Further, the image pickup apparatus 100 has been described as a structure in which the image pickup function portion and the communication function portion including the communication means 110 having the mobile phone function are integrated, but the image pickup function portion and the communication function portion are separate bodies. There is no problem with the configuration. In this case, the imaging function part and the communication function part may be configured to be able to communicate with each other by wired communication such as USB or wireless communication such as Bluetooth.

The recording medium 200 is not limited to a memory card such as a PCMCIA card or a compact flash, a hard disk, a micro DAT, a magneto-optical disk, a CD-R.
It may be configured by an optical disk such as a CD or a CD-WR, a phase change optical disk such as a DVD, or the like.

There is no problem if the recording medium 200 is a composite medium in which a memory card and a hard disk are integrated. Further, a part of the composite medium may be detachable.

In the description of the embodiment, the recording medium 200 is described as being built in the image pickup apparatus 100, but it may be separately connected to the image pickup apparatus 100 and can be arbitrarily connected.

In addition, the recording medium 200 is attached to the image pickup apparatus 100.
However, a single or a plurality of arbitrary numbers may be incorporated or connectable.

Further, an object of the present invention is to supply a storage medium having a program code of software for realizing the functions of the above-described embodiments to a system or apparatus, and to supply the computer (or CPU or M of the system or apparatus).
It is also achieved by the PU) reading and executing the program code stored in the storage medium. in this case,
The program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD
-R, magnetic tape, non-volatile memory card, ROM, etc. can be used. In addition, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. This also includes a case where some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing. Furthermore, after the program code read from the storage medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function is executed based on the instruction of the program code. This also includes a case where the CPU or the like provided in the expansion board or the function expansion unit performs some or all of the actual processing and the processing realizes the functions of the above-described embodiments.

[0256]

As can be easily understood from the above description, according to the present invention, the contents of the extended function program provided to the image pickup apparatus via the communication network are changed according to the operation mode setting state of the image pickup apparatus. It becomes possible to do.

As a result, it is possible to provide an image pickup system without the problem that it is necessary to find a necessary program from among many programs when a new function is downloaded to the image pickup apparatus.

Further, it is possible to provide an image pickup system which does not have a problem that it is not possible to provide an extended function that individually considers a wide range of users of the image pickup apparatus.

[Brief description of drawings]

FIG. 1 is an overall configuration block diagram of an embodiment of the present invention.

FIG. 2 is a configuration block diagram of an image pickup apparatus according to the present embodiment.

FIG. 3 is a configuration block diagram of an image information management device (image gateway) according to the present embodiment.

FIG. 4 is a flowchart of a main routine of the image pickup apparatus according to the present embodiment.

FIG. 5 is a flowchart of a main routine of the image pickup apparatus according to the present embodiment.

FIG. 6 is a part of a flowchart of a charge registration processing routine of the image pickup apparatus according to the present embodiment.

FIG. 7 is a flowchart of a normal shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 8 is a flowchart of a normal shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 9 is a flowchart of a distance measurement / photometry processing routine of the image pickup apparatus according to the present embodiment.

FIG. 10 is a flowchart of a shooting processing routine of the image pickup apparatus according to the present embodiment.

FIG. 11 is a part of a flowchart of a movie shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 12 is a part of a flowchart of a movie shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 13 is a part of a flowchart of a panoramic shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 14 is a part of a flowchart of a panoramic shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 15 is a flowchart of a monochrome shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 16 is a flowchart of a monochrome shooting mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 17 is a flowchart of a reproduction mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 18 is a flowchart of a reproduction mode processing routine of the image pickup apparatus according to the present embodiment.

FIG. 19 is a flowchart of an extended function download processing routine of the image pickup apparatus according to the present embodiment.

FIG. 20 is a flowchart of an extended function download processing routine of the image pickup apparatus according to the present embodiment.

FIG. 21 is an explanatory diagram of a menu screen in the normal shooting mode of the image pickup apparatus according to the present embodiment.

FIG. 22 is an explanatory diagram of a menu screen in the movie shooting mode of the image pickup apparatus according to the present embodiment.

FIG. 23 is an explanatory diagram of a menu screen in a panoramic shooting mode of the image pickup apparatus according to the present embodiment.

FIG. 24 is an explanatory diagram of a menu screen in a monochrome shooting mode of the image pickup apparatus according to the present embodiment.

FIG. 25 is an explanatory diagram of a menu screen in a reproduction mode of the image pickup apparatus according to the present embodiment.

FIG. 26 is a flowchart of a main routine of the image information management device (image gateway) in the present embodiment.

FIG. 27 is a flowchart of a main routine of the image information management device (image gateway) in the present embodiment.

[Explanation of symbols]

100 imaging device 400 Image information management device (image gateway) 600 Internet 700 packet network

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/907 G06F 9/06 640A // H04N 101: 00 650C 660C F term (reference) 5B076 BB06 BB17 FC10 5C022 AA13 AB01 AB15 AB21 AB65 AC01 AC13 AC42 AC52 AC54 AC69 5C052 GA02 GA03 GA07 GA08 GB06 GC03 GC05 GD03 GD09 GE06 GE08 5C053 FA08 FA27 FA29 FA30 GA11 GB06 GB36 HA22 HA30 JA21 KA01 KA24 KA25 LA02 LA14 52025 BD09

Claims (21)

[Claims] 1. A program providing apparatus that communicates with an image capturing apparatus via a communication network, and notifying means for selecting an extended function to be provided and notifying the image capturing apparatus according to an operating state of the image capturing apparatus. Providing means for providing a program for the extended function to the image pickup device in response to a request from the image pickup device, and updating charging information for the image pickup device according to the provision of the program for the extended function from the providing means A program providing device having a charge management means. 2. The operation state of the image pickup apparatus is a still image shooting state, and the extended function is a function related to a still image shooting mode and / or a setting of a still image shooting operation. The program providing device according to 1. 3. The operation mode of the image pickup apparatus is a moving image shooting state, and the extended function is a function related to a moving image shooting mode and / or a moving image shooting operation setting. Program providing device. 4. The operation mode of the image pickup apparatus is a panoramic shooting mode, and the extended function is a function related to a panoramic shooting mode and / or a panoramic shooting operation setting. Program providing device. 5. The operation state of the image pickup apparatus is a special effect photography state, and the extended function is a function related to the setting of the special effect photography mode and / or the special effect photography operation. The program providing device according to 1. 6. The program according to claim 1, wherein the operation state of the imaging device is a reproduction state of a captured image, and the extended function is a function related to a reproduction mode and / or a reproduction operation setting. Providing device. 7. The program providing device according to claim 1, wherein the communication network is a mobile phone network and / or an internet network. 8. A program providing method for providing a program to an image pickup apparatus via a communication network, wherein an extended function to be provided is selected according to an operation state of the image pickup apparatus, and the image pickup apparatus is notified. Characterized in that a program for an extended function is provided to the image capturing apparatus in response to a request from the image capturing apparatus, and charging information for the image capturing apparatus is updated according to the provision of the program for the extended function from the providing unit. Program providing method. 9. A program providing program for providing a program to an image pickup apparatus via a communication network, or a program providing program, wherein the extended function to be provided is selected according to an operation state of the image pickup apparatus, and the image pickup apparatus is provided. And, in response to a request from the image pickup apparatus, provide an extended function program to the image pickup apparatus, and update billing information for the image pickup apparatus according to the provision of the extended function program from the providing unit. A program providing program or a storage medium storing the program. 10. An imaging device that communicates with a program providing device via a communication network, the extended function requesting unit requesting an extended function from the program providing device according to an operation state of the imaging device, and the program providing device. A program request means for requesting the program of the extended function to the program providing apparatus according to the extended function reported from the apparatus; and a receiving means for receiving the program of the extended function provided by the program providing apparatus. A characteristic imaging device. 11. The image pickup apparatus according to claim 10, wherein the image pickup apparatus is capable of executing the program of the extended function received by the receiving unit. 12. The image pickup apparatus according to claim 10, wherein the image pickup apparatus further includes a display unit that displays the extended function notified from the program providing apparatus. 13. The operation state of the image pickup device is a still image shooting state, and the extended function is a function related to a still image shooting mode and / or a setting of a still image shooting operation. The imaging device described. 14. The operation mode according to claim 10, wherein the operation state of the image pickup device is a moving image shooting state, and the extended function is a function related to setting of a moving image shooting mode and / or a moving image shooting operation. Imaging device. 15. The method according to claim 10, wherein the operation state of the image pickup apparatus is a panoramic shooting state, and the extended function is a function related to a panoramic shooting mode and / or a panoramic shooting operation setting. Imaging device. 16. The operation mode of the image pickup apparatus is a special effect shooting mode, and the extended function is a function related to a setting of a special effect shooting mode and / or a special effect shooting operation. The imaging device according to. 17. The image pickup apparatus according to claim 10, wherein the operation state of the image pickup apparatus is a playback state of a captured image, and the extended function is a function related to a playback mode and / or a playback operation setting. apparatus. 18. The image pickup apparatus according to claim 10, wherein the communication network is a mobile phone network and / or an internet network. 19. A method of controlling an image pickup device, which communicates with a program provision device via a communication network, comprising: requesting an extended function according to an operating state of the image pickup device, from the program provision device. A method for controlling an image pickup apparatus, comprising: requesting a program for an extended function from the program providing apparatus according to a reported extended function, and receiving the program for the extended function provided from the program providing apparatus. 20. A control program for an imaging device, which communicates with a program providing device via a communication network, or a storage medium storing the program, wherein the program providing device is provided with an extended function according to an operating state of the imaging device. Requesting the program of the extended function to the program providing apparatus according to the extended function reported from the program providing apparatus, and receiving the program of the extended function provided from the program providing apparatus. A control program for an imaging device or a storage medium storing the program. 21. An image pickup system comprising an image pickup device and an image information management device communicating with the image pickup device via a communication network, wherein the image pickup device indicates an operation state of the image pickup device by the image information management device. The image information management device, the image information management device, according to the operation state of the imaging device reported, performs the selection of the extended function and notifies the imaging device, and the imaging device is notified. Request an extended function program arbitrarily selected from the extended functions to the image information management device, and the image information management device provides the extended function program to the imaging device in response to a request from the imaging device. In addition, the imaging system is characterized in that the charging information of the charging management means is updated.