JP2002176615A - Imaging system, digital camera, information processing unit and processing method for photographed image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging system that can confirm the result of composting, in advance. SOLUTION: A communication circuit 22 of a camera 10 transmits a composition instruction command to an information processing unit 30. The information processing unit 30 transmits an image selected from sample images stored in a storage device 34 or an image generated by an operator to the camera 10, in accordance with the instruction of the operator. The camera 10 temporarily stores data to be composited, which are received from the information processing unit 30 to a RAM of a storage device 16 and executes image composite photographing processing. In the composite photographing processing, the data to be composited and a photographed image are displayed overlapping on an electronic viewfinder and an imaging 14 outputs the data to be composited and the photographed image, that have been overlapped with each other to a control circuit 12, in response to shutter operation. The control circuit 12 compresses the composited image data from the imaging section 14, in compliance with the JPEG system and stores the result to a flash memory of the storage device 16 as a JPEG file.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging system, a digital camera, an information processing apparatus, and a method for processing a captured image.

[0002]

2. Description of the Related Art In a conventional digital camera, a capture process is executed by using a liquid crystal display panel provided in the camera body as an electronic viewfinder and operating a shutter switch while displaying an image of a subject on a monitor. The photographed image data is recorded in a built-in memory or a memory card.

When it is desired to combine a captured image with other image data (including graphic data), it is common to use another information device having an image combining function, for example, a personal computer. As a method of transferring the photographed image data to the computer, a method of removing the memory card for recording the photographed image data from the camera and connecting it to the computer, and connecting the camera body and the computer with a communication cable, and connecting the camera body to the computer There is a method for transferring image data.

[0004] A digital camera having an image synthesizing function is also known, and such a camera can perform photographing while checking the synthesis result. That is, by displaying the subject image on the monitor in a state where the image of the combination source is overlapped on the screen of the electronic viewfinder, the image after combination can be confirmed in advance on the electronic viewfinder, so that the preferable composition or Shutter operation is performed. After that, the combining process is actually executed.

When it is desired to add additional information such as text data and numerical data to a photographed image, similarly, the photographed image data is transferred to another information device and added to the other information device, or the digital camera itself is used. This can be achieved by any of the methods using a digital camera having an information adding function.

In a conventional digital camera, a storage location (directory) and a storage file name in a memory for storing photographed image data are predetermined in each digital camera, and cannot be freely determined by a user.

[0007]

In the prior art, if image synthesis processing or information addition processing is performed on an information device other than a camera, a photographed image must be transferred to the information device, which is troublesome. Operation was required. If the camera itself has an image synthesis processing function or an information addition processing function, the trouble of transferring captured images is eliminated, but since the camera is designed and manufactured with emphasis on portability, the number of operation keys is small, so It is very troublesome to use a camera to create the original image data or graphic data and to create the additional information data.

If the captured image can be stored in a desired directory with a desired file name, the image synthesizing process or the information adding process becomes easy. However, in the conventional example, such selection is impossible.

An object of the present invention is to provide an image pickup system, a digital camera, an information processing apparatus, and a method for processing a photographed image, which solve such inconveniences.

[0010]

An imaging system according to the present invention is an imaging system comprising a digital camera and an information processing device interlocked with the digital camera.
The digital camera, an imaging unit that changes an optical image into an image signal, and data to be synthesized that transmits data indicating the start of imaging processing to the information processing apparatus prior to imaging, and synthesizes the captured image from the information processing apparatus. A first communication means for receiving the image data, an electronic viewfinder for displaying the received data to be combined with the output image of the imaging means, and combining the data to be combined with an image taken by the imaging means in response to a shutter operation. The information processing apparatus includes a combining unit, and a storage medium that stores a combined image output from the combining unit. The information processing device communicates with the combined data storage unit that stores the combined data and the first communication unit. Communication means for transmitting designated data to be stored stored in the data-to-be-synthesized according to an instruction from the digital camera; Characterized by including the.

[0011] A digital camera according to the present invention includes an image pickup means for converting an optical image into an image signal, and transmits data indicating the start of image pickup processing to an external information processing apparatus prior to image pickup. A communication unit for receiving data to be combined with an image; an electronic viewfinder for combining and displaying the received data to be combined with an output image of the imaging unit; It is characterized by comprising a synthesizing means for synthesizing synthesized data, and a storage medium for storing a synthesized image output from the synthesizing means.

[0012] An information processing apparatus according to the present invention comprises a data-to-be-synthesized storage means for storing data-to-be-synthesized to be synthesized with a photographed image, and a communication means for communicating with an external camera. Communication means for transmitting the specified combined data stored in the combined data to the camera.

A method for processing a photographed image according to the present invention comprises the steps of: an instruction step of a digital camera for instructing an information processing apparatus to transmit data to be combined with a photographed image; A receiving step of receiving the data to be transmitted, a combining display step of combining and displaying the data to be combined received in the receiving step with a photographed image on an electronic viewfinder, and the combined data to a photographed image according to a shutter operation. And synthesizing and recording on a storage medium.

An imaging system according to the present invention is an imaging system including a digital camera and an information processing device interlocked with the digital camera, wherein the digital camera converts an optical image into an image signal, A first communication unit that receives additional information to be added to the captured image from the information processing apparatus, an additional unit that adds the additional information to an image captured by the imaging unit, and information that is output from the additional unit. A storage medium, wherein the information processing device is an additional information creating means for creating the additional information data, and a communication means for communicating with the first communication means, wherein the additional information is provided in accordance with an instruction from the digital camera. And a second communication means for transmitting to the digital camera.

[0015] A digital camera according to the present invention comprises: an image pickup means for converting an optical image into an image signal; a communication means for receiving additional information to be added to a photographed image from an external information processing apparatus; And a storage medium for storing information output from the adding means.

[0016] An information processing apparatus according to the present invention includes additional information creating means for creating additional information data to be added to a captured image, and transmitting means for transmitting the additional information to a digital camera. .

A method for processing a photographed image according to the present invention comprises the following steps: an instruction step of a digital camera for instructing an information processing apparatus to transmit additional information;
A transmitting step in which the information processing apparatus creates and transmits additional information; an adding step of the digital camera for adding the additional information transmitted from the information processing apparatus to a captured image; Recording the image on a storage medium.

An image pickup system according to the present invention is an image pickup system comprising a digital camera and an information processing device interlocked with the digital camera, wherein the digital camera converts an optical image into an image signal, A storage medium capable of storing an image captured by the imaging unit, a communication unit receiving storage location information of the captured image from the information processing apparatus, and a storage medium according to the storage location information of the captured image received from the information processing apparatus. A storage control unit configured to store an image captured by the imaging unit at the storage location, wherein the information processing apparatus specifies a storage location to store a new captured image; and a storage location specification unit. Communication means for transmitting storage location information specified by the means to the digital camera.

According to the digital camera of the present invention, an image pickup means for converting an optical image into an image signal, a storage medium capable of storing an image taken by the image pickup means, and storage location information of the taken image from an external information processing device are provided. It is characterized by comprising communication means for receiving, and storage control means for storing an image captured by the imaging means in a storage location of the storage medium according to storage location information of the captured image received from the information processing apparatus.

An information processing apparatus according to the present invention comprises a storage location designating means for designating a storage location where a captured image is to be stored, and a communication means for transmitting storage location information designated by the storage location designating means to a digital camera. It is characterized by having.

According to the method of processing a photographed image according to the present invention, a digital camera instruction step instructing the information processing apparatus to transmit storage location information of the photographed image, and the storage step in the information processing apparatus according to the instruction step. A determining step of determining the location information, a transmitting step of transmitting the storage location information determined in the determining step to the digital camera, and a storage location of the storage medium according to the storage location information transmitted from the information processing device. And storing the captured image.

[0022]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a schematic block diagram of a first embodiment of the present invention. Reference numeral 10 denotes a digital camera, and reference numeral 30 denotes an information processing device having an image synthesizing function. Both the camera 10 and the information processing device 30 are battery-powered portable type and can be used outdoors.

The camera 10 includes a control circuit 12, an imaging unit 1,
4, a storage device 16, a display device 18, operation keys 20, and a communication circuit 22. The photographing unit 14, the storage device 16, the display device 18, the operation keys 20, and the communication circuit 22 are connected to the control circuit 12, and the control circuit 12 controls them overall.
The control circuit 12 also performs digital processing including compression of captured image data from the imaging unit 14, interprets and executes commands received by the communication circuit 22, performs control corresponding to instructions from the operation keys 20, and the like.

The image pickup section 14 includes a photographing lens, an image pickup device, and a digital image processing circuit. The image sensor converts an optical image obtained by the photographing lens into an electric signal. The digital image processing circuit digitizes an image signal output from the image sensor, performs exposure correction and white balance correction, converts the signal into a YUV format, and outputs the converted YUV format. The imaging unit 14 also has a composite photographing function (described later) that combines other graphic data with the photographed image.

The storage device 16 is photographed by the photographing unit 14,
A flash memory for storing image data compressed by the control circuit 12, a ROM (read only memory) for storing a control program executed by the control circuit 12, etc .; (Random access memory) for temporarily storing The storage device 16 also
A connection means for connecting an external memory card is provided.

The display device 18 includes a D / A converter for converting digital image data in YUV format into an NTSC analog signal, and a TFT color liquid crystal display panel (LC).
D) and its control circuit and drive circuit. The TFT color LCD is about 1.8 inches in size and has a QVGA size (320 × 240 dots) pixels capable of displaying an NTSC image.

The operation keys 20 include various switches for instructing an operation mode and the like, and a shutter switch for photographing. When an operator operates a predetermined operation key, the control circuit 12 operates according to a corresponding program.

The communication circuit 22 can transmit and receive image data and control commands to and from an external communication device. In the case of wireless communication, the communication circuit 22 includes an antenna and an RF module.

The information processing device 30 includes a control circuit 32, a storage device 34, a display device 36, a tablet 38, and a communication circuit 40. The storage device 34, the display device 36, the tablet 38, and the communication circuit 40 are connected to the control circuit 32, and the control circuit 32 controls them overall.

The control circuit 32 controls communication by the communication circuit 40 and can create graphic data and text data to be used for composite photographing, and controls each section according to an operation command input from the tablet 38.

The storage device 34 includes a ROM (Read Only Memory) for storing a control program executed by the control circuit 32 and the like, graphic data created by the control program as a work area, and used for composite photography.
RA that temporarily stores data such as text and numerical values
M (random access memory) and a flash memory for storing samples of image and graphic data used for synthesis.

The display device 36 includes a conversion means for converting various graphic data into digital RGB signals, and
It includes a TFT color liquid crystal display panel (LCD) and its control circuit and drive circuit. The TFT color LCD has a VGA size (640 × 480 dots) of 4 inches or more, and can display an image with high definition.

The tablet 38 is a TFT of the display unit 36.
It is integrated with the color LCD, and the operator can input a desired instruction to the control circuit 32 by operating the tablet 38 with a pen or the like.

The communication circuit 40 can transmit and receive image data and control commands to and from the communication circuit 22. In the case of wireless communication, the communication circuit 40 includes an antenna and an RF module.

The control processing procedure of this embodiment will be described in detail with reference to the flowcharts of FIG.

FIG. 2 shows a flowchart of the main processing in the camera 10. It is checked whether or not there is an instruction for a composite photographing operation by the operation keys 20 (S1). If the composite photographing mode is not set (S1), corresponding processing such as normal photographing processing, reproduction processing, editing processing, and environment setting processing is executed. (S2). In the case of the composite shooting mode (S1), a combining instruction command is transmitted from the communication circuit 22 to a predetermined communication partner (here, the communication circuit 40 of the information processing device 30) (S3). The communication partner is registered in the camera 10 in advance.

For example, the power of the communication partner is not turned on,
If a transmission error occurs due to factors such as the communication partner not being in the reception mode and the communication partner not being in a place where communication is possible (S4), error processing is executed and the process is terminated (S4).
8). In this error processing, an error message is displayed on the display device of the camera 10, and the operator is allowed to select a desired operation from retransmission, cancellation of the composite imaging processing, switching to the normal imaging mode, and the like.

If there is no transmission error (S4), the communication circuit 22 is switched to the reception mode and waits for a reply from the communication partner (S5). If a certain period of time elapses without any reply from the communication partner (S6, S7), various factors (for example, the power of the communication partner is turned off, the communication partner cancels the communication, or the communication partner cannot reply) And that the communication partner is out of the communicable place) and is not considered to be in a communicable state, executes error processing, and ends (S8).

When the data to be combined is received from the communication partner (here, the information processing device 30) (S6), the received data to be combined is temporarily stored in the RAM of the storage device 16 (S6).
9). An image combining photographing process is executed (S10). The composite photographing process is performed through a finder process (the display device 1 of the camera 10).
8 is used as an electronic viewfinder, while the input image from the photographing lens is being monitored and displayed, the combined data temporarily stored in the RAM is overlapped and displayed. When the shutter switch is depressed, the imaging unit 14 superimposes the data to be combined on the image signal from the imaging element and generates a series of processing until the image data in the YUV format is generated. FIG. 3 illustrates a state in which data to be combined is superimposed on a captured image to obtain a combined image.

As shown in FIG. 3, there are two methods for synthesizing the photographed image and the data to be synthesized, as shown in FIG. And a method of combining data to be combined as semi-transparent. The operator can select and designate in advance what kind of combining method is to be adopted.

The control circuit 12 controls the YUV
Format composite image data is compressed by the JPEG method (S1
1), and save it as a JPEG file in the flash memory of the storage device 16 (S12).

FIG. 4 shows a flowchart of the main processing of the information processing apparatus 30. It is determined whether or not the mode is a mode in which the image capturing process is executed in cooperation with the camera 10 (composite capturing mode) (S21).
1), execute the corresponding processing and end (S22).

In the case of the composite photographing mode (S21), the communication circuit 40 is switched to the reception mode, and a command from the camera 10 is awaited (S23). When the command of the composite photographing instruction is received (S24), a menu item indicating a method of creating image data is displayed on the screen (S25), and the operator is made to select (S26). The menu includes a method of (1) manually creating data to be combined (image data or graphic data) to be combined with a captured image using a tool or the like; and (2) a storage device 3 in advance.
No. 4 to select from the data stored.

When manual creation is selected (S2
6) The data to be combined is created by image processing software such as an image editor, a graphic editor, and a paint tool. FIG. 5 is a schematic diagram of a pattern for creating data to be combined. Desired characters and graphics are written on the tablet 38 integrated with the display device 36 with a pen 42 or the like. The entry shape is input as image data, and is displayed on the screen of the display device 36 as it is following the entry. The created data is stored in the RA of the storage device 34.
M is temporarily stored (S30) and transmitted from the communication circuit 40 to the camera 10 (S31).

If manual creation is not selected (S26), a list of sample images stored in the flash memory of the storage device 34 is displayed as shown in FIG. The operator selects a desired sample image from the list display (S29). The selected sample image is temporarily stored in the RAM of the storage device 34 (S30), and transmitted from the communication circuit 40 to the camera 10 (S31).

FIG. 6 is a display example of a list screen of images and graphic data. Each image 44 is displayed in a small size, but is stored in the flash memory of the storage device 34 in a full size (640 × 480 dots). A frame 46 indicating the selected state is displayed together with the selected image 44. When you touch the pen on the desired image,
The image touched by the pen is selected and displayed with a frame. Recruit icon 4 with any image selected
When the pen 8 is touched with a pen, the image selected at that time is adopted as the data to be combined. When the user touches the selected image again with the pen or double-touches the desired image with the pen, the image is displayed in full size on the entire screen. Thereby, the composite image can be confirmed in detail.

In the above embodiment, when performing composite photography, a command for instructing execution of composite photography is transmitted from the camera 10 to the information processing apparatus 30, and then the data to be composed is created (selected) in the information processing apparatus 30. However, the present invention is not limited to this. For example, the to-be-combined data created by the information processing device 30 includes image data captured by the camera 10, its pixel size, and a capturing direction (horizontal or vertical)
Must be consistent with For this purpose, parameters indicating various shooting conditions may be added to the command transmitted from the camera 10 to the information processing device 30.

FIG. 7 is a flowchart showing a case where a parameter indicating a seed photographing condition is added in the command transmission process (S3). The photographing size (the number of photographing pixels) is selected (S41). For example, UXGA
Size (1600 x 1200 dots), SXGA (12
80 × 1024 dots), XGA (1024 × 768 dots), and VGA (640 × 480 dots). Next, the photographing direction is selected (S42). The shooting direction is
Either portrait photography or landscape photography. In these selection processes, options are displayed on the display device 18 of the camera 10, a method in which an operator operates the cursor keys to select, or options are assigned to dials or keys, and the operator directly operates the dials or keys. Use the method you choose.

Transmission data reflecting the selected condition is created (S43) and transmitted from the communication circuit 22 to the information processing device 30 as an instruction command for the composite photographing operation (S4).
4).

FIG. 8 shows an example of the structure of the transmission data created in S43. 50 is a code indicating a command for instructing composite shooting. Upon receiving the command, the information processing device 30 interprets the code and executes a process for composite shooting. 52 is a parameter indicating a shooting size, and 54 is a parameter indicating a shooting direction. Two bytes each in the vertical and horizontal directions are allocated to the shooting size parameter 52. For example, in the case of the UXGA size, 0 × 0640 and 0 ×
0460 is stored. Parameter 54 indicating shooting direction
In the case of horizontal shooting, 0 is stored, and in the case of vertical shooting, 1 is stored.

The information processing device 30 creates (selects) the data to be combined according to the parameters added to the command from the camera 10. In the case of manual creation, an image size and direction that match the designated shooting size and direction are set as default values for image creation. When selecting from the list display, image samples having an image size and direction matching the designated shooting size and direction are displayed as a list as options.

In the above-described embodiment, the camera 10 receives the data to be combined for performing the composite photographing of the image from the information processing apparatus 30 and uses the data for the finder processing of the camera 10. Not limited. That is, in the embodiment shown in FIG. 1, various information to be added to the captured image data is created by the information processing device 30, transmitted to the camera 10, and the various information is added and stored at the same time as the image is captured by the camera 10. be able to. The various types of information to be added include, for example, data specifying the size / number of sheets for printing or print service, text data such as a comment on a photographed image, and numerical data such as photographing conditions. It consists of necessary information. The additional information created by the information processing device 30 includes information unique to the camera 10, for example, the manufacturer and lot number, the name of the owner, and shooting conditions. Camera 1 prior to the creation process
0 may be transmitted.

FIG. 9 is a flowchart of the operation of the camera 10 when the additional information created by the information processing device 30 is transmitted to the camera 10 and added to the photographed image.

It is checked whether or not an instruction for an information-added photographing operation has been given by the operation keys 20 (S51). If the mode is not the information-added photographing mode (S51), corresponding processing, for example, normal photographing processing, reproduction processing, editing processing, and environment setting Processing and the like are executed (S52). In the case of the information addition shooting mode (S5
1), an information addition instruction command is created (S53), and transmitted from the communication circuit 22 to a predetermined communication partner (here, the communication circuit 40 of the information processing device 30) (S54). The communication partner is registered in the camera 10 in advance. As shown in FIG. 10, the information addition instruction command includes, as parameters, information determined in advance by the camera 10, for example, information such as the manufacturer and lot number of the camera 10, the name of the owner, and shooting conditions. Are added.

FIG. 10 shows an example of the structure of an information addition instruction command. Reference numeral 60 denotes a code indicating a command for instructing information-added shooting. Upon receiving this command, the information processing device 30 interprets the code 60 and executes a process for information-added shooting. Reference numeral 62 denotes a block in which data unique to the camera 10 is stored. The data specific to the camera 10 is
For example, it includes a manufacturer, a lot number, a model name, and a firmware version. Reference numeral 64 denotes a block in which personal data (address and name) indicating the owner of the camera 10 is stored. Reference numeral 66 denotes data of setting information of shooting size and image quality (for example, shooting size (number of pixels) and image quality (conditions such as JPEG compression ratio) set before the shooting operation)
Is a block in which is stored. 68 is
Other setting values for photographing, for example, values such as white balance, exposure adjustment, and shutter speed, or correction values thereof. Setting values fixed in advance by setting of a shooting mode and the like are also included in the shooting setting values 68.

For example, the power of the communication partner is not turned on.
When a transmission error occurs due to factors such as the communication partner not being in the reception mode and being out of the place where the communication partner can communicate (S55), error processing is executed and the process ends (S59). In this error processing, an error message is displayed on the display device of the camera 10, and the operator is allowed to select a desired operation from retransmission, cancellation of the information-added shooting mode, switching to the normal shooting mode, and the like.

If there is no transmission error (S55), the communication circuit 22 is switched to the reception mode and waits for a response from the communication partner (S56). If a certain period of time elapses without any reply from the communication partner (S57, S58), various factors (for example, the power of the communication partner is turned off, the communication partner cancels the communication, or the communication partner cannot reply) And that the communication partner is out of the communicable place) and is not considered to be in a communicable state, executes error processing, and ends (S59).

When the additional information data is received from the communication partner (here, the information processing device 30) (S57), the received additional information data is temporarily stored in the RAM of the storage device 16 (S60). An image photographing process is executed (S61). The photographing process includes a series of processes from when the operator presses a shutter switch, the image capturing unit 14 performs a predetermined process on an image signal from the image sensor to generate YUV format image data.

The control circuit 12 controls the YUV
Format image data is compressed by the JPEG method (S62),
An extended JPEG file is created by adding the additional information data temporarily stored in the RAM (S63).
The G file is stored in the flash memory of the storage device 16 (S64).

FIG. 11 shows the data structure of an extended JPEG file. Reference numeral 70 denotes additional information data that holds text data and numerical data in a table structure. Reference numeral 72 denotes a JPEG header that holds image compression parameters and tables, and 74 denotes image data compressed by the JPEG method.

FIG. 12 shows an information processing apparatus 3 corresponding to FIG.
0 shows a flowchart of a main process. It is determined whether or not the mode for executing the image photographing process (information-added photographing mode) in cooperation with the camera 10 (S71), and in the other modes (S71), the corresponding process is executed and the process ends (S72). ).

In the case of the information addition photographing mode (S7
1), the communication circuit 40 is switched to the reception mode and the camera 1
It waits for a command from 0 (S73). When a command for instructing information addition photographing is received (S74), information to be added to the photographed image is created (s75). The created information includes camera-specific information transferred from the camera body 10 as described with reference to FIG. 10, and if necessary, corrects this information and further adds other information. In this creation process, the operator inputs data of various types of additional information. For example, the operator selects and inputs necessary input items by a menu method. A system in which the operator answers what is heard in the Q & A system may be used.
As shown in (1), a method may be used in which an operator writes data in a required frame on the format screen display.

The created additional information data is stored in the storage device 3
4 is temporarily stored in the RAM of the communication circuit 4 (S76).
0 is transmitted to the camera 10 (S77).

FIG. 13 shows an example of a format screen for inputting additional information. Reference numeral 80 denotes a frame for entering information unique to the camera, such as a manufacturer, a lot number, a model name, and a firmware version. In this frame 80, data previously transmitted from the camera 10 is automatically set as an initial value. Has been entered. Reference numeral 82 denotes an entry frame for personal data, for example, an operator's name and address. Reference numeral 84 denotes an entry frame for a title of image data. 86
Is a frame for entering a comment for the image data. These data are added to the captured image as text data. Numeral 88 denotes a frame in which shooting conditions are entered. Numerical data of various conditions set at the time of shooting, such as an exposure value, a zoom value, a shutter speed, an image size, and a quality, are input. Reference numeral 90 denotes a frame for entering printing conditions, in which the number of prints, size, other printing conditions, and the like are input. In each of the entry boxes 80 to 90, data can be input using pen-operated character recognition or a Kana-Kanji conversion system.

FIG. 14 shows a format example in the process (S77) of transmitting various information input on the screen shown in FIG. 13 to the camera 10. 100 is camera-specific information,
102 is the owner's personal data, 104 is information on the shooting size and image quality, 106 is the shooting set value additionally corrected, 10
Reference numeral 8 denotes printing condition data, 110 denotes information necessary for a print order at a print service lab or the like, 112 denotes text data of a title of a captured image, and 114 denotes text data of a comment on the captured image.

In this embodiment, data indicating the storage location of the captured image (storage device to be stored, its storage location and file name) is transferred from the camera 10 to the information processing device 30 and displayed on the screen of the information processing device 30. By causing the operator to change the selection, and transferring the changed information to the camera 10, the captured image can be stored in the specified location with the specified file name.

FIG. 15 shows a flowchart of the main processing of the camera 10 for the operation. It is determined whether or not a file designation shooting operation mode for designating a save destination and a file name of a shot image is designated by the operation key 20 (S81). If the file designation shooting operation mode is not set (S81), a corresponding process, for example, Then, a normal photographing process, a reproducing process, an editing process, an environment setting process and the like are executed (S82). In the case of the file designation shooting mode (S8
1) The data of the storage area information including the information of the directory tree structure and the file name is created (S83). The message is transmitted to the communication partner (here, the communication circuit 40 of the information processing device 30) (S84). The communication partner is registered in the camera 10 in advance.

For example, the power of the communication partner is not turned on.
If a transmission error occurs due to factors such as the communication partner not being in the reception mode and the communication partner not being in a place where communication is possible (S85), error processing is executed and the process ends (S89). In this error processing, an error message is displayed on the display device of the camera 10, and the operator is allowed to select a desired operation from retransmission, canceling the file-specified photographing process, switching to the normal photographing mode, and the like.

If there is no transmission error (S85), the communication circuit 22 is switched to the reception mode and waits for a reply from the communication partner (S86). If a certain period of time elapses without any reply from the communication partner (S87, S88), various factors (for example, the power of the communication partner has been turned off, the communication partner has canceled communication, or the communication partner cannot reply) And that the communication partner is out of the communicable place) and is not considered to be in a communicable state, executes error processing, and ends (S89).

When the file designation data is received from the communication partner (here, the information processing device 30) (S87), the received file designation data is temporarily stored in the RAM of the storage device 16 (S90). An image photographing process is executed (S9)
1). The photographing process includes a series of processes from when the operator presses a shutter switch, the image capturing unit 14 performs a predetermined process on an image signal from the image sensor to generate YUV format image data.

The control circuit 12 controls the YUV
Format image data is compressed by the JPEG method (S92),
With reference to the file designation data temporarily stored in the RAM, the JPEG file is stored in the designated file storage location of the flash memory of the storage device 16 with the designated file name (S93).

FIG. 16 shows a flowchart of the main processing of the information processing apparatus 30 corresponding to FIG. Camera 10
It is determined whether or not the mode is a mode in which the image photographing process is executed in cooperation with the process (file designated photographing mode) (S101). If the mode is another mode (S101), the corresponding process is executed and the process ends (S102).

In the case of the file designated photographing mode (S1
01), the communication circuit 40 is switched to the reception mode, and waits for data from the camera 10 (S103). When the information of the file storage area is received from the camera 10 (S10
4), the received information, that is, the storage device 16 of the camera 10
Is displayed on the display device 36 (S105). For example, FIG.
As shown in FIG. 7, there is a method of displaying a list of the directory structure and the file name and the like in a tree structure, or a method of displaying the directory and the file name as text and arranging them from the top.

The operator specifies the storage location and file name of the image data shot by the camera 10 with reference to the display information (S106). For example, there is a method of directly specifying displayed data with a pen, or a method of inputting a storage location and a file name by text. The specified or input storage area information data is transmitted from the communication circuit 40 to the camera 10 (S107).

In FIG. 17, reference numeral 120 denotes an area for displaying a directory tree structure and a list of files stored therein, and 122 denotes an area for designating and inputting a file name and displaying a designation information determination icon. 124,12
6 is a directory. The directory 126 is displayed with a frame indicating that it is in the selected state. The selected directory can be changed by touching the displayed part of the directory name with a pen. Selected directory 1
26, the file name of the image file included in the
As shown in FIG. 8, they are displayed in a list. Reference numeral 130 denotes a text input box for inputting a file name of an image captured by the camera 10, and a file name can be freely specified by inputting a character in the box 130 with a pen. 1
32 is an icon for instructing determination of input data,
After specifying the directory and inputting the file name,
By touching the determination icon 132 with a pen,
File save destination information is determined.

As the main processing of the camera 10, the photographing operation is performed after transmitting the instruction data for performing the photographing processing to the information processing apparatus 30, but the photographing operation is performed by transmitting the instruction data to the information processing apparatus 30 or transmitting the information. The reception of the data from the processing device 30 may be performed in advance. That is, the camera 10
After the photographing process is first performed, the instruction data may be transmitted to the information processing apparatus 30 and the information from the information processing apparatus 30 may be received, or the instruction data may be transmitted from the camera 10 to a communication partner to perform the photographing. It may execute and receive information from the information processing device 30.

Although the embodiment in which the camera 10 and the information processing device 30 are wirelessly connected has been described, it goes without saying that a wired connection may be used. The information processing device 30 may be a stationary device. The information processing apparatus 30 may be configured to automatically turn on the power when detecting data reception even in the power-off state, and to receive data after switching to the shooting processing mode. As a method for adding information to an image, additional information data is added to JPEG compressed image data and extended JP
Although the embodiment in which EG data is used has been described, other additional methods may be used, for example, separate files associated with each other. Although the tablet 38 integrated with the display device 36 has been illustrated as an operation means of the information processing device 30, for example, a full keyboard of a typewriter arrangement, various dedicated keys, and a pointing device such as a mouse and a trackball may be used.

When a wireless connection is made, information for specifying an information processing apparatus to which data to be combined is to be transmitted may be transmitted from the camera. Because, when there are multiple devices that can transmit the data to be combined,
Executable processing differs for each device, or stored data differs, so specifying the device can prevent an error. Also, from the viewpoint of protection of security and privacy, it is not preferable to issue a transmission request to a stranger processing device. Therefore, it is better to transmit information specifying an information processing device.

[0080]

As can be easily understood from the above description, according to the present invention, when performing composite photographing, the subject and its composition can be confirmed in the composite state on the electronic viewfinder, so that the composite result is photographed. You can easily confirm before. Since the data to be combined used in the composition is created or selected by the information processing device linked with the camera and transmitted to the camera,
Composite imaging can be easily performed without impairing the operability of the camera.

Also, when other information such as text or numerical data is added to the photographed image, the information to be added is created by another device and transmitted to the camera, so that the operability of the camera is not impaired. It is possible to easily add desired information to a captured image and record it.

Further, the photographed image can be saved with a designated storage location and a designated file name if necessary by a simple operation.

By designating an information processing apparatus for exchanging information with the camera in advance, unnecessary errors can be prevented, security can be enhanced, and privacy can be protected.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of an embodiment of the present invention.

FIG. 2 is a flowchart of a main process of the camera 10 in a first operation of the present embodiment.

FIG. 3 is a schematic view showing a state of synthesis.

FIG. 4 is a flowchart of a main process of the information processing apparatus 30 in a first operation of the embodiment. Flow chart showing control procedure

FIG. 5 is a schematic diagram showing a state where characters are written with a pen.

FIG. 6 is a display example of a list screen of images and graphic data to be combined data.

FIG. 7 is a flowchart of a transmission data creation procedure when a shooting size and a shooting direction are transferred from the camera 10 to the information processing apparatus 30.

FIG. 8 shows information on a shooting size and a shooting direction by a camera 10.
3 is an example of the structure of transmission data when the data is transmitted to the information processing apparatus 30 from the server.

FIG. 9 is a flowchart of a main process of the camera 10 in a second operation of the embodiment.

FIG. 10 is a structural example of data transmitted from the camera to the information processing device 30 in S54.

FIG. 11 is a structural example of extended JPEG data.

12 is a flowchart of a main process of the information processing apparatus 30 corresponding to FIG.

FIG. 13 is an example of an input screen for additional information.

FIG. 14 is a data structure example of additional information transmitted from the information processing device 30 to the camera 10;

FIG. 15 illustrates a camera 10 according to a third operation of the present exemplary embodiment.
6 is a flowchart of a main process of FIG.

16 is a flowchart of a main process of the information processing device 30 corresponding to FIG.

FIG. 17 is a display example of a storage location of an image file.

[Explanation of symbols]

 10: Digital camera 12: Control circuit 14: Imaging unit 16: Storage device 18: Display device 20: Operation key 22: Communication circuit 30: Information processing device 32: Control circuit 34: Storage device 36: Display device 38: Tablet 40: Communication circuit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) // H04N 101: 00 H04N 5/91 J F term (Reference) 5C022 AA13 AB68 AC03 AC42 AC69 5C023 AA11 AA14 AA34 AA37 AA38 BA11 CA03 CA08 DA04 DA08 EA03 5C053 FA08 FA27 FA29 GB12 GB36 KA04 KA24 KA26 LA02 LA06 LA11 LA15 5C062 AA01 AA14 AB17 AB23 AB38 AC24 AC41 AC42 BA04 5C076 AA12 AA14 BA01 BA03 BA05 BA06 CA02

Claims (42)

[Claims] An imaging system comprising a digital camera and an information processing device interlocked with the digital camera, the digital camera comprising: an imaging unit configured to convert an optical image into an image signal; First communication means for transmitting data indicating the start of the process to the information processing apparatus and receiving data to be combined to be combined with the captured image from the information processing apparatus; and transmitting the received data to be combined to an output image of the imaging means. An electronic viewfinder for synthesizing and displaying; synthesizing means for synthesizing the data to be synthesized with an image captured by the imaging means in response to a shutter operation; and a storage medium for storing the synthetic image output from the synthesizing means. The information processing device is a combined data storage unit that stores the combined data, and a communication unit that communicates with the first communication unit. Imaging system characterized by comprising a second communication means for transmitting the combined data of the designated stored in the be-combined data storing means in accordance with an instruction from the digital camera. 2. The digital camera according to claim 1, wherein the first communication unit transmits information on the photographing condition to the information processing apparatus, and the second communication unit transmits data to be combined that matches the photographing condition to the digital camera. 3. The imaging system according to claim 1. 3. The imaging system according to claim 2, wherein the information on the imaging condition includes information on an imaging size and an imaging direction. 4. The imaging system according to claim 1, wherein the first communication unit and the second communication unit are each a wireless communication unit. 5. The imaging system according to claim 4, wherein the digital camera transmits information designating the information processing apparatus to which the data to be combined is transmitted. 6. An image pickup means for converting an optical image into an image signal, and data indicating the start of image pickup processing transmitted to an external information processing apparatus prior to image pickup, and the image processing apparatus synthesizes the data with the photographed image from the information processing apparatus. A communication unit for receiving data; an electronic viewfinder for combining and displaying the received combined data with an output image of the imaging unit; and a combining unit for combining the combined data with an image captured by the imaging unit in response to a shutter operation. And a storage medium for storing a combined image output from the combining means. 7. The digital camera according to claim 6, wherein the communication unit transmits information on a shooting condition to the information processing device. 8. The digital camera according to claim 7, wherein the information on the shooting condition includes information on a shooting size and a shooting direction. 9. The digital camera according to claim 6, wherein said communication means is a wireless communication means. 10. The digital camera according to claim 6, wherein said communication means transmits information designating said information processing apparatus to which said data to be synthesized is transmitted. 11. Combined data storage means for storing combined data to be combined with a photographed image, and communication means for communicating with an external camera, and a designation for storing the combined data in accordance with a transmission instruction from the camera. And a communication unit for transmitting the data to be combined to the camera. 12. The information processing apparatus according to claim 11, wherein the communication unit transmits the to-be-synthesized data that matches the shooting condition to the camera in accordance with shooting condition information from the camera. 13. The information processing apparatus according to claim 12, wherein the information on the shooting conditions includes information on a shooting size and a shooting direction. 14. An instruction step of a digital camera for instructing an information processing apparatus to transmit data to be combined with a captured image, and receiving the data to be combined transmitted from the information processing apparatus according to the instruction step. A combining step of combining the combined data received in the receiving step with the captured image on the electronic viewfinder, and combining the combined data with the captured image according to the shutter operation, and recording the combined data on the storage medium. Recording a captured image. 15. The method according to claim 14, wherein the instructing step transmits information on a photographing condition to the information processing apparatus, and the transmitting step creates or selects combined data matching the photographing condition and transmits it. Processing method of captured image. 16. The method according to claim 15, wherein the information on the shooting conditions includes information on a shooting size and a shooting direction. 17. An imaging system comprising a digital camera and an information processing apparatus interlocked with the digital camera, wherein the digital camera is configured to convert an optical image into an image signal, and to add the image signal to the captured image. A first communication unit that receives the additional information from the information processing apparatus; an additional unit that adds the additional information to an image captured by the imaging unit; and a storage medium that stores information output from the additional unit. An information processing unit for generating the additional information data; and a communication unit for communicating with the first communication unit, wherein the additional information is transmitted to the digital camera according to an instruction from the digital camera. An imaging system, comprising: 18. The first communication means transmits information unique to the digital camera to the information processing apparatus, and the additional information creating means creates additional information by referring to information unique to the digital camera. The imaging system according to claim 17, wherein: 19. The imaging system according to claim 17, wherein each of the first communication unit and the second communication unit is a wireless communication unit. 20. The imaging system according to claim 19, wherein the digital camera transmits information designating the information processing device that transmits the additional information. 21. An imaging unit for converting an optical image into an image signal, a communication unit for receiving additional information to be added to a captured image from an external information processing device, and adding the additional information to an image captured by the imaging unit. And a storage medium for storing information output from the adding means. 22. The digital camera according to claim 20, wherein the communication unit transmits camera-specific information to the information processing device. 23. The digital camera according to claim 20, wherein the storage medium stores the captured image and the additional information in different files. 24. The digital camera according to claim 20, wherein said communication means is a wireless communication means. 25. The digital camera according to claim 24, wherein said communication means transmits information designating said information processing apparatus to which said additional data is to be transmitted. 26. An information processing apparatus comprising: additional information creating means for creating additional information data to be added to a captured image; and transmitting means for transmitting the additional information to a digital camera. 27. The apparatus according to claim 26, further comprising receiving means for receiving camera unique information from said digital camera, wherein said additional information creating means creates said additional information by referring to said camera unique information. Information processing device. 28. A digital camera instruction step for instructing the information processing apparatus to transmit the additional information, a transmission step in which the information processing apparatus creates and transmits the additional information in accordance with the instruction step, An additional step of adding the additional information transmitted from the apparatus to the captured image, and a recording step of recording the captured image to which the additional information has been added on a storage medium. Processing method. 29. The digital camera transmits information unique to the digital camera to the information processing device, and the information processing device creates the additional information by referring to the information unique to the digital camera. Item 30. The method for processing a captured image according to Item 28. 30. The method according to claim 28, wherein the additional information is recorded on the storage medium in a file separate from the captured image. 31. An imaging system comprising a digital camera and an information processing device interlocked with the digital camera, wherein the digital camera converts an optical image into an image signal, and an image captured by the imaging device. A storage medium capable of storing the information, a first communication means for receiving storage location information of the captured image from the information processing apparatus, and a storage location of the storage medium according to the storage location information of the captured image received from the information processing apparatus; A storage control unit for storing an image captured by the imaging unit, wherein the information processing device is configured to specify a storage location in which a new captured image is to be stored; And a second communication unit for transmitting storage location information to the digital camera. 32. The first communication means transmits a storage structure and a file name of a captured image in the storage medium to the information processing apparatus, and the information processing apparatus further transmits the captured image in the storage medium from the digital camera. 32. The imaging system according to claim 31, further comprising: receiving means for receiving a storage structure and a file name of the image data; and display means for displaying a storage structure and a file name of a captured image in the storage medium. 33. The imaging system according to claim 31, wherein each of the first communication unit and the second communication unit is a wireless communication unit. 34. The imaging system according to claim 33, wherein the digital camera transmits information designating the information processing device to which the storage location information is transmitted. 35. An imaging device for converting an optical image into an image signal, a storage medium capable of storing an image captured by the imaging device, a communication device receiving storage location information of the captured image from an external information processing device, A digital camera, comprising: a storage control unit that stores an image captured by the imaging unit in a storage location of the storage medium according to storage location information of a captured image received from the information processing apparatus. 36. The digital camera according to claim 35, wherein the communication unit transmits a storage structure and a file name of the captured image in the storage medium to the information processing device. 37. The digital camera according to claim 35, wherein the communication unit is a wireless communication unit. 38. The digital camera according to claim 37, wherein said communication means transmits information designating said information processing device to which said storage location information is transmitted. 39. A storage location specifying means for specifying a storage location where a captured image is to be stored, and communication means for transmitting storage location information specified by the storage location specifying means to the digital camera. Information processing device. 40. A receiving means for receiving a storage structure and a file name of a captured image in the storage medium from the digital camera, and a display means for displaying a storage structure and a file name of the captured image in the storage medium. 40. The information processing apparatus according to claim 39, wherein 41. An instruction step of the digital camera for instructing the information processing apparatus to transmit storage location information of a captured image, a determining step of determining the storage location information in the information processing apparatus according to the instruction step, A transmitting step of transmitting the storage location information determined in the determination step to the digital camera, and according to the storage location information transmitted from the information processing device,
Storing a captured image in a storage location of a storage medium. 42. The instruction step instructs the information processing apparatus to transmit storage location information of a captured image together with information on a storage structure and a file name of an image in the storage medium, and the determination step includes: 42. The method according to claim 41, further comprising the step of displaying a storage structure and a file name of the captured image on the medium.