JPH1023317A - Image pickup picture processor and method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup picture processor and a method for selectively controlling an image pickup operation for the extraction, recognition, and tracking of a specific subject by either a remote control or a control on a camera by communication control from an outside terminal equipment. SOLUTION: In an image pickup system, at least more than one cameras 1, plural terminal equipments 21, display device 22, and printer 25 are connected with a data communication bus 24. The terminal equipment 21 is provided with a mouse 23 or a display device 26. In this image pickup system, a focus state is controlled, and a processing for segmenting a specific subject from a picture on different image pickup conditions is stably operated at a high speed regardless of an illumination condition. At the time of image pick-up by plural image pickup condition setting, the control of the image pickup condition based on a set parameter and the recording of the image pickup parameter at that time are operated. After the end of the image pickup operation in a subject extraction mode, the segmenting processing is operated on a segmentation condition. After the end of the processing, the segmented picture is recorded in a picture recording and reproducing part in a camera main body, and displayed on a finder display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a captured image processing apparatus and method for processing an image obtained by controlling an imaging parameter to extract, recognize, and track a specific subject.

[0002]

2. Description of the Related Art Conventionally, in an image pickup section of this kind of image pickup image processing apparatus, with the digitization of signal processing, a luminance level, Color conversion, white balance processing,
In addition to relatively simple processing such as quantization size conversion, an edge extraction function and an image extraction function using a sequential growth method of color components (Technical Report of the Institute of Television Engineers of Japan, vol. 18, pp. 1)
3-18, 1994).

In a technique for extracting an image based on a difference from a background image, Japanese Patent Laid-Open No. Hei 6-253197 discloses a method in which an aperture control unit is set so that an average luminance is appropriate when a background image is photographed. It is shown that the current image is imaged using the same set values as above, and the object image is extracted based on the difference data.

[0004]

However, in the conventional image pickup system, a command communication control section for appropriately controlling the image pickup mode from the outside when the object is extracted in the image pickup section, or an image for extracting the object in the image pickup section. In this case, it is not possible to set an optimal imaging condition for image extraction because of not having a function of controlling an imaging parameter necessary for performing the operation.
Therefore, changes in lighting conditions for the purpose of image extraction,
It has not been possible to optimally set the imaging conditions according to the shooting conditions, such as whether or not the subject has moved and whether or not the imaging unit itself has moved.

Further, when a camera is operated from a remote location to extract a specific subject, communication control means, a communication method, a control command, and the like have not been established. In particular, setting the appropriate angle of view, focusing,
It has not been possible to automatically or interactively set optimal imaging conditions such as lighting conditions (for example, whether or not strobe light is emitted).

For example, the optimal setting of the angle of view is important to eliminate unnecessary background areas as much as possible and to efficiently perform image extraction processing. A camera for automatically or interactively performing this processing is important. Since the communication control and the imaging control method with the terminal device have not been established, the function cannot be realized.

Therefore, the present invention can selectively control an imaging operation for extracting, recognizing, tracking, and the like of a specific subject by either remote operation by communication control from an external terminal device or operation on a camera. It is a first object to provide a captured image processing apparatus and method.

Further, the present invention provides a captured image processing apparatus and method capable of setting appropriate imaging conditions centering on a subject based on image data when performing imaging for subject extraction by remote control. Is a second purpose.

It is a third object of the present invention to provide a photographed image processing apparatus and method for realizing optimization and automation of a photographing method for extracting a subject based on image data.

It is a fourth object of the present invention to provide a captured image processing apparatus and method for performing image capturing (image capture) for subject extraction at an arbitrary time and timing from an external terminal device.

It is a fifth object of the present invention to provide a captured image processing apparatus and method capable of speeding up processing from image capturing to object extraction and enabling high-speed display on a display of a camera or a terminal device. .

It is a sixth object of the present invention to provide a captured image processing apparatus and method for controlling a series of processes from setting of imaging conditions to display of an extracted image on a terminal device side.

It is still another object of the present invention to provide a photographed image processing apparatus and method capable of remotely controlling photographing parameters for extracting a subject from outside without using a cord.
The purpose of.

According to the present invention, an image pickup operation control program is recorded on a recording medium and supplied from outside, and a picked-up image capable of automatically recovering the same image pickup operation (processing procedure inside the camera) for extracting a subject. It is an eighth object to provide a processing apparatus and method.

Further, the present invention provides an image processing apparatus and method for recording imaging control data on a recording medium and supplying the same from outside, and for automatically recovering the same imaging conditions for subject extraction. As a ninth object.

It is a tenth object of the present invention to provide a captured image processing apparatus and method capable of automatically recovering the same imaging operation later when the imaging operation for extracting a subject is manually performed. I do.

[0017]

According to another aspect of the present invention, there is provided a photographing image processing apparatus comprising: a photographing parameter control unit for controlling a photographing parameter; and a photographing mode setting unit for setting a photographing mode. Imaging means having: a first image processing means for calculating comparison data between a plurality of images in which the imaging parameters are controlled; and a second image processing means for discriminating the calculated comparison data and classifying an image area. Computing means, and terminal means having data communication means for performing data communication with the imaging means, wherein the imaging parameter control means, based on a signal from the terminal means or a signal from the imaging mode setting means, It is characterized in that the imaging parameters are controlled.

An image pickup device according to a second aspect of the present invention includes an image pickup unit having an image pickup parameter control unit for controlling an image pickup parameter and an image processing unit for calculating comparison data between a plurality of images in which the image pickup parameters are controlled. In a captured image processing apparatus comprising: an arithmetic unit having an instruction selecting unit for instructing a subject position in an image; and a terminal unit for performing data communication with the imaging unit, the arithmetic unit includes a subject position from the instruction selecting unit. The imaging parameter control signal is generated based on a signal and image data in a predetermined size area centered on the position, and the imaging parameter control unit includes:
An imaging condition is controlled based on the imaging parameter control signal, and the terminal unit extracts a specific subject image by processing an image obtained under the imaging condition.

According to a third aspect of the present invention, in the captured image processing apparatus according to the first aspect, the imaging parameter control means performs imaging centering on a substantially uniform area of a predetermined characteristic amount of the image data. The imaging parameters are controlled as described above.

According to a fourth aspect of the present invention, in the captured image processing apparatus according to the first aspect, the data communication unit includes a synchronous unit that transfers image data in synchronization with the image capturing unit. The means processes the image data received via the data communication means.

According to a fifth aspect of the present invention, there is provided a photographed image processing apparatus comprising: an image pickup means having a finder display means; an image display means for displaying an image picked up by the image pickup means; And an operation unit having an area determination processing unit that determines an area of the designated image. The area determination processing unit processes the image data captured by the imaging unit, A cutout process is performed centering on a position or an area in an image frame output from the selection unit, and the image display unit or the finder display unit displays an extracted image signal from the calculation unit.

According to a sixth aspect of the present invention, there is provided a captured image processing apparatus comprising: an imaging parameter control unit for controlling an imaging parameter; a memory unit for storing captured image data; and an image captured by the imaging unit. Image display means, an instruction selection means for designating the displayed image, an arithmetic means having an area determination processing means for determining an area of the designated image, and a data communication means for performing data communication with the imaging means The imaging parameter control means receives control data from the terminal means via the data communication means or inputs the control data from the memory means, and the area determination processing means Comparison between a plurality of images obtained by imaging under two or more imaging conditions of standard imaging conditions and non-standard imaging conditions set by parameter control means Data is calculated, a cutout process is performed centering on a position or area in an image frame output from the instruction selecting means, and the image display means displays an image signal output from the arithmetic means. Features.

According to a seventh aspect of the present invention, in the captured image processing apparatus according to the first aspect, the data communication unit includes a transmission / reception unit of a signal by an electromagnetic wave or a line and a communication procedure control unit. An imaging mode setting means for setting an imaging mode for subject extraction based on command data from the terminal means via the means.

According to an eighth aspect of the present invention, there is provided a captured image processing apparatus comprising a memory unit having recording / reproducing means for recording / reproducing image data in a removable memory medium in the captured image processing apparatus according to the first aspect. Is characterized in that the header section holds imaging operation control procedure data in the imaging mode for subject extraction.

According to a ninth aspect of the present invention, there is provided a captured image processing apparatus comprising a memory means having a recording and reproducing means for recording and reproducing image data on a removable memory medium in the captured image processing apparatus according to the first aspect, The control means
It is characterized in that imaging conditions are set and an imaging operation is performed based on image data read after the memory medium is loaded into the memory means.

According to a tenth aspect of the present invention, there is provided a captured image processing apparatus comprising a memory unit having recording and reproducing means for recording and reproducing image data on a removable memory medium in the captured image processing apparatus according to the first aspect. Recording camera operation information at the time of subject extraction and imaging, and reproducing the camera operation information by the imaging mode setting means or the terminal means.

[0027] A picked-up image processing method according to an eleventh aspect of the present invention provides an image pickup step including an image pickup parameter control step of controlling an image pickup parameter of the image pickup apparatus and an image pickup mode setting step of setting an image pickup mode; A first image processing step of calculating comparison data between images; a calculation step having a second image processing step of discriminating the calculated comparison data to classify an image area; A data communication step of performing communication, wherein the imaging parameter control step controls the imaging parameter based on a signal from the terminal device or a signal in the imaging mode setting step.

According to a twelfth aspect of the present invention, there is provided an image pickup method comprising: an image pickup parameter control step of controlling an image pickup parameter of an image pickup apparatus; and an image processing step of calculating comparison data between a plurality of images in which the image pickup parameters are controlled. And a calculation step of instructing a subject position in the image by an instruction selection device, and a data communication step of performing data communication between the imaging apparatus and a terminal device, wherein the calculation step includes: Generating an imaging parameter control signal based on a subject position signal from the instruction selection device and image data in a predetermined size area centered on the position,
The imaging parameter control step controls imaging conditions based on the imaging parameter control signal, and the terminal device extracts a specific subject image by processing an image obtained under the imaging conditions. .

[0029]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a captured image processing apparatus according to the present invention will be described. The captured image processing device according to the present embodiment is applied to an imaging system.

[First Embodiment] The imaging system according to the first embodiment controls a focus state to extract a specific subject from images under different imaging conditions in a stable and high-speed manner regardless of lighting conditions. It is characterized by performing it. The specific subject extraction process is a process of extracting a subject image from a background image, but this process may be applied to processes such as image classification, recognition, and tracking.

FIG. 1 is a block diagram showing the configuration of the imaging system according to the first embodiment. The imaging system
At least one or more cameras (imaging devices) 1, a plurality of terminal devices 21, a display device 22, and a printer 25 are connected to a data communication bus 24. Terminal device 21
Is provided with a mouse 23 and a display device 26 for selecting an instruction. The instruction may be selected by pen input instead of the mouse 23. The data communication bus 24 includes a bus control.

In the present imaging system, when a plurality of terminal devices 21 and cameras 1 are connected, control of an imaging mode of any camera 1 from any terminal device 21 and control of image processing inside the camera are performed. Can be performed, and one of the terminal devices 21 functions as a server.

Further, it is also possible to process the image data taken in a predetermined mode and output from the camera 1 by the terminal device 21 to cut out a specific subject. Further, the extracted image is displayed on an arbitrary display device (display device 22,
It is also possible to output to the display device 26 or a finder display (not shown) inside the camera, or to the printer 25.

FIG. 2 is a block diagram showing the internal configuration of the camera 1. The camera 1 has an extraction processing mechanism for extracting a specific image from an image captured in a specific subject extraction imaging mode. However, the processing required for extracting the image may not be performed by the camera 1 but may be performed by the terminal device 21. Here, the subject extraction imaging mode refers to an imaging operation mode until the plurality of image data is output from the image sensor to the image recording unit by controlling imaging parameters (lens arrangement, shutter speed, aperture diameter, and the like).

In the camera 1 shown in FIG. 2, reference numeral 2 denotes an image forming optical system. It is desirable that the imaging optical system 2 has a small depth of focus. Reference numeral 3 denotes a lens motor drive control unit, which includes a focus lens drive unit (focus motor), a zoom lens drive unit, and a lens information readout (measurement) unit that reads the type of the mounted lens.

An image sensor 4 is a typical CC.
A solid-state imaging device such as D is used. Reference numeral 5 denotes an imaging parameter measurement control unit, which includes a zoom control unit 51, a focus state detection unit 52a, a focus control unit 52b, a shutter speed control unit 53, an aperture measurement control unit 54, and image signal characteristic parameters (gamma, knee, white balance). A characteristic amount (for example, a correction coefficient for gamma) of a correction, accumulation time of a CCD or the like is included in the detection unit 55.

The shutter speed control section 53 controls a mechanical shutter (not shown). When an electronic shutter is used, a substantial shutter speed (charge accumulation time) is controlled by a sensor drive circuit 18 described later. The detection of the in-focus state may be either a detection method using a video signal or a distance measurement method using infrared rays. Reference numeral 6 denotes an image recording / reproducing unit which performs digital recording in a predetermined format on a recording medium (a disk medium such as a tape medium, an optical (magnetic) disk, or an IC memory medium such as an IC memory card) at the time of photographing. Incidentally, the recording medium or the image recording / reproducing section 6 may be provided detachably from the camera body. Further, an imaging operation procedure program in the subject extraction mode, necessary data, and the like may be written in the recording medium, and control may be performed such that imaging is performed based on the information.

When reproducing an image, a viewfinder (EV)
F) Output image data to 7 or a data transfer unit 12 described later. Reference numeral 8 denotes an imaging parameter storage unit, which includes lens information from the lens motor driving unit 3, imaging parameters, image signal characteristic parameters, presence / absence of strobe light emission, intentional camera operation (movement) such as scanning, presence / absence of camera shake, and the like. Records information at the time of imaging. Such information is recorded in any of external control, manual operation, and autonomous control by a built-in program, and is used later to reproduce the same imaging conditions.

It should be noted that camera operation (scan, pan, etc.) information may be detected by video signal processing, or an image pickup device may be provided with an acceleration sensor (not shown) or a gyro, etc. Good.

Reference numeral 9 denotes an imaging mode setting switch for subject extraction, tracking, identification, and the like. When this switch is set, the imaging mode is set in response to an imaging start operation signal from a shutter button (not shown) subsequent to turning on the switch. Is performed. Note that the imaging start switch may be configured to also serve as the imaging mode setting switch.

Reference numeral 10 denotes an external command data communication control unit. An output image generation unit 11 generates an analog / digital image signal according to an output destination. For example,
The TV receiver generates an NTSC signal or a PAL signal. Further, an image signal which has been subjected to gradation correction of light and shade, error diffusion processing, and color component correction processing according to the output device may be output to a display, a printer, or the like. Instructions for such signal generation and processing are issued by the command data communication control unit 1.
0 or externally, or by using a switch on the operation panel of a camera (not shown).

Reference numeral 12 denotes a data transfer unit, which includes a communication interface unit and an adapter terminal (not shown), and outputs image data and the like to an external display device or computer. Reference numeral 13 denotes a subject extraction area discrimination processing unit (cutout image processing unit) which discriminates an image obtained under a plurality of imaging conditions into a background area and a subject area by a method described later.
The image is cut out.

Reference numeral 14 denotes an image capture signal generation unit which checks the control conditions of exposure conditions and imaging conditions, charge accumulation / transfer time in an image sensor (CCD), and an image writing control signal in the image recording / reproducing unit 6. And automatically taking into account the timing of the image capture.

Reference numeral 15 denotes a system control unit as a setting unit for a plurality of imaging conditions.
By reading a signal from the imaging mode setting switch 9 or information of a control program written on the recording medium of the image recording / reproducing unit 6, a series of imaging operation control signals in the subject extraction mode is generated.

Reference numeral 16 denotes an aperture. Reference numeral 17 denotes a video signal processing unit, which is a preprocessing circuit (a sample and hold circuit, an auto gain control circuit, an A / D conversion circuit, etc.) 1
7a, a gamma correction processing circuit 17b, and other video signal processing circuits (including a white balance correction circuit, a camera shake correction circuit, etc.) 17c. Note that these circuit configurations are not limited to those schematically shown in FIG.

Reference numeral 18 denotes a sensor drive circuit for driving the image sensor 4, which controls a charge storage time, a transfer timing, and the like. Also, in the figure, the flow of control signals particularly related to the present embodiment is indicated by thick arrows.

In the present embodiment, in the subject extraction imaging mode, the focusing lens motor (focus motor) is driven based on the output from the focusing state detection unit 52a, and the optimal focusing level, that is, After the high-resolution image is captured from the image sensor 4 in the focused state, the image sensor 4 is driven so that the focus shifts in the same direction as the immediately preceding driving direction of the focusing lens motor. The low-resolution capture at the same time is performed continuously.

Here, the appropriate out-of-focus level is a value set in advance and stored in a storage unit such as the image recording / reproducing unit 6 or a value set by a command signal from the external terminal device 21 or the like. Yes, for example, it is set to a ratio from the focus level (a numerical value such as 90% of the focus value).

The image may be picked up at different out-of-focus levels and used for initial data extraction (coarsely cut image data) for image cutout.

When the continuous image pickup operation is completed, the subject extraction mode is automatically canceled or the setting for returning to the standard mode is made by the image pickup mode setting switch 9. Note that operations such as setting and canceling of the above-described imaging mode may be performed by inputting a command from the terminal device 21.

FIG. 3 is a graph schematically showing the relationship between the focus signal and the image pickup position of the focus lens when photographing is performed under a plurality of image pickup conditions by focus control. It is shown that a focus lens is driven from an initial position, a focus level is once detected and an image is taken, and then a focus lens is driven by a predetermined amount to capture an out-of-focus image within an allowable range.

FIG. 4 is an explanatory diagram showing respective functions in a basic imaging system in which a camera and a terminal device are connected. In the figure, the functions indicated by thick frames (step S
51, S52, S54, S58, S60, S61) belong to the terminal device 21, and the functions indicated by broken lines (steps S57, S59, S62) belong to either the camera or the terminal device. Others are functions in the camera (steps S53, S55, S56). These functions are described below in order.

First, the terminal device 21 establishes a communication session with the camera 1 (step S51). A setting command of the subject extraction imaging mode is transmitted to the camera 1 (step S52).

At this stage, the basic control program is activated (step S53), or the imaging parameters to be controlled, the control amount of the imaging conditions, the number of shots, and the processing range inside the camera (for example, Until the pre-processing such as calculation of the difference data, etc., it is specified by inputting from the terminal device 21 such as specifying only imaging under a plurality of imaging conditions or the like (step S54). This may be selected from a menu or the like displayed on the display device 26 of the terminal device 21.

These conditions are standardly set in advance in the basic control program. At the time of imaging by setting a plurality of imaging conditions (Step S56), control of imaging conditions based on the set parameters and imaging parameters (lens data, focal length, magnification, focus signal, focus lens arrangement, gamma control value, Recording of the aperture diameter, charge accumulation time, etc.) is performed.

Thereafter, there are three control processing procedures according to the processing range inside the camera. The mode automatically returns to the standard mode (step S57), or after the imaging operation in the subject extraction mode is completed, a cutout condition input is received (step S57).
58) Alternatively, the clipping process is performed under standard conditions set in advance (step S59).

After the processing is completed, the cut-out image may be recorded in the image recording / reproducing unit 6 in the camera body, transferred to the external memory or the display device 22 (step S60), or displayed on the finder display (step S60). S
61). It is assumed that the output form of the cut-out image is specified in advance when inputting the control data or in the basic program. After the above processing, the automatic or manual return to the standard imaging mode is finally performed (step S62).

Next, the process of processing each image captured from the image sensor 4 will be described in detail. First, gamma correction, white balance correction, and the like are performed by the video signal processing unit 17 on video signals from at least two sensors obtained by controlling the in-focus state (focus).

The area discrimination processing unit 13 inside the image pickup apparatus calculates a difference between a high-resolution image (focused image) and a low-resolution image (unfocused image) or difference data between two different low-resolution images. These are subjected to smoothing, binarization, and thinning processing.

The processing other than the difference may be performed by inputting appropriate processing parameters from the terminal device 21 via the command data communication control unit 10.

When a plurality of low-resolution images having different degrees of out-of-focus are used, components having a high spatial frequency are cut off, and when extracting a contour line of a specific object from their difference data, an extra isolated feature point or an isolated area is extracted. Can be suppressed. Therefore, noise and high spatial frequency components in the background,
Alternatively, it is possible to obtain stable initial data (contour lines) without being influenced by the lighting conditions. The output value of a pixel that becomes negative due to the difference may be set to the value 0, or the absolute value of the difference at each pixel may be output.

Next, the subsequent initial data (contour line) extraction processing will be described. This processing can be performed also in the terminal device 21 connected to the camera 1. However, the arithmetic processing inside the camera 1 is registered as a standard processing mode, or the terminal device 21 is controlled via the command data communication control unit 10. You can also specify from such. Typically, it is set in a basic control program such as a difference calculation and a binarization process or a difference calculation and a smoothing process between images of a plurality of imaging conditions as a standard process inside the camera.

After calculating the comparison (difference) data between the images obtained by controlling the imaging conditions, the smoothing process is performed to remove isolated features (local regions having irregular shapes or colors, line segments, etc.) and to remove Gaussian filters. And the like, or a general low-pass filter process. The setting of the threshold value for the subsequent binarization processing is performed according to the method of Otsu (Transactions of the Institute of Electronics, Information and Communication Engineers, vol.
J63, pp. 349-356, 1980) or after dividing an image into blocks of an appropriate size, based on statistical processing (mean, variance, hypothesis test from histogram, etc.) of local image data (luminance, color, etc.) A setting method may be used.

Further, in the present embodiment, the area discriminating section 13 performs averaging processing of difference data (a plurality of pieces) between three or more images obtained by continuously controlling the in-focus state. The result may be subjected to an initial contour extraction process (smoothing, binarization, thinning process, etc.) of an image to be cut out.

For this purpose, the lens motor is driven at a high speed on the basis of the output from the focusing state detecting section 52a, and the first half (front focus) or the second half (back focus) including the optimum focus value, or the front focus and rear focus. At least three still images containing both,
The image is continuously captured at a predetermined time interval and stored in the image recording / reproducing unit 6. Typically, after capturing an image by focusing detection, a predetermined number of unfocused images are continuously photographed.

In this case, the signal from the image sensor 4 is transferred and recorded directly to a temporary storage unit (not shown) such as a cache memory without passing through the video signal processing unit 17 by a high-speed switching transfer unit (not shown). Is done. After completion of imaging under a plurality of imaging conditions, that is, writing of an image to the temporary storage unit, the image data is sequentially transferred to perform video signal processing and preprocessing required for image clipping.

At this time, the high-speed switching transfer section may directly transfer the data to the area determination processing section 13. As described above, by not performing the non-linear processing that is normally performed on the video signal from the image sensor, it is possible to suppress the influence of a change in the lighting condition at the time of imaging, the movement of the subject, and the like, thereby stabilizing the processing accuracy. .

Further, by performing the video signal processing after a series of image capturing, it is possible to increase the speed of the imaging operation, stabilize the clipping process, and improve the flexibility. still,
When capturing images in time series, only the immediately preceding image data and the difference data updated by the averaging process may be temporarily stored. Also, if the number of images to be used for the initial contour line extraction processing is designated in advance as N, if N or more images are taken in the focusing process, the latest N images are held (deleted in the oldest order). Calculation of difference data and averaging processing may be performed. By averaging difference data between a plurality of slightly different images in the in-focus state as in the present embodiment, the influence of noise can be suppressed, and image extraction with high accuracy and high resolution can be realized.

FIG. 5 is an explanatory diagram showing a process of processing image data. FIG. 7A shows an image in focus, and FIG.
FIG. 3C is a diagram schematically highlighting an image in the case where a focus shift has occurred. FIG. 4C shows a case where the user points to a point in the extracted subject while checking the image of FIG. 4A on the display device 26. Shows the local area set in the.

FIG. 11D shows a result obtained by performing smoothing, binarization, and thinning in the local area from the difference image data of FIGS. 11A and 11B, and further performing contour line tracking processing. 5 shows an image within the initial contour. Although not shown, when obtaining the difference image data, two images having different degrees of focus as described above and both of which are out of focus may be used.
Alternatively, only contour line tracking processing may be performed without performing smoothing and binarization.

FIGS. 6 and 7 are flowcharts showing the image extraction processing procedure. First, the imaging system is initialized (step S1), and the devices connected to the network are set in a standby state. This initialization is usually performed on the terminal device 21 side.

Next, a device for performing control from the imaging operation to the output operation is selected (step S2). It is determined whether or not the control device is the terminal device 21 (step S3), and if the control device is the terminal device 21, first, in the standby state, the presence or absence of received data or a command is checked (step S4). If there is no, the imaging device 1 to be operated is specified (step S5).

When the user selects the subject extraction mode setting from the initial menu panel displayed on the display device 22, a subject extraction imaging mode setting command is transmitted to the imaging device 1 (step S6). Upon receiving this command, the imaging apparatus 1 reads out a basic control program including a standard data set for subject extraction from a memory (such as a ROM) built in the system control unit 15.

In the present embodiment, the standard data set includes a control imaging parameter (focus), the number of images to be captured, an allowable range of the imaging parameter to be controlled (in the present embodiment, given by a ratio to a focusing level, etc.), Items such as an image data output destination (provided in a memory of the terminal device or the camera body) are included. This basic program may be read from a recording medium in the image recording / reproducing unit 6.

At this time, a message indicating the contents of the standard data and prompting the user to change the standard data is displayed, and these changes are performed here if necessary. And
Pre-processing for setting and controlling a plurality of imaging conditions (comparison data between a plurality of images) is performed by the method described above (step S7).

Next, the image from the imaging device 1 is displayed on the screen of the display device 26, and the user is allowed to select a subject to be extracted (step S8). That is, for example, a point near the boundary between the inside of the subject and the background is designated (clicked) with the pointing device 23 such as a mouse. in this case,
It is desirable to appropriately set the angle-of-view exposure conditions during imaging. Therefore, appropriate determination of the imaging conditions at this stage (for example, that the subject is imaged under appropriate exposure conditions, that the entire region to be extracted exists, that the size is sufficiently large, etc.) is performed (step S9). If there is no problem, the process proceeds to area determination and cutout processing (step S11).

If not appropriate, zooming, imaging device 1
The posture change and other imaging parameter changes are automatically performed based on the image data (step S10). For example, by performing photometry and exposure condition setting in a predetermined area centered on the designated point, calculating an area area having a similar image attribute, and performing zooming control such that the ratio of the area in the screen becomes a certain value or more. Is also good.

As an interactive designation method, the user designates a plurality of points to designate a rough area of the subject, or designates the shape and size of the area surrounding the subject, and, for example, designates a rectangular or elliptical area by the user. A predetermined shape area having a size corresponding to the length may be semi-automatically set by instructing a point at the position on the subject image with a mouse or by scanning in one direction.

Thereafter, zooming and focusing operations are performed centering on the area, and after determining the in-focus level, the above-described imaging at the out-of-focus level and calculation of difference data, and extraction of the subject area are performed. To the above-described contour line tracking process on the boundary.

After the cut-out processing, it is selected whether or not to record the extracted data (step S12).
A location is designated and data is written (a storage unit inside the imaging device 1, a storage unit inside the terminal device, step S13). Further, including the case where no image is recorded at this stage, the extracted image is edited (combined with another image, etc.) using the mouse 23 of the terminal device 1 (step S14). Further, image data may be converted (step S15) according to the characteristics of human visual characteristics in accordance with the characteristics of the output device (printer, display, etc.) and then displayed (step S15).
16).

Checking for existence of received data (step S
In the case of 4), a case where data is transmitted from the imaging device 1 or a case where a recording medium incorporating an imaging control program or the like in the subject extraction mode is loaded in the terminal device 1 will be described.

The transmitting device is determined (step S17), and the image pickup mode is read out together with the image data (standard, subject extraction mode, etc.) (step S18). Here, it is determined whether or not to perform imaging and clipping processing in subject extraction under the same imaging mode condition (step S19). 1 is specified, and the processing after step 7 is executed.

If not, the user is asked to select whether or not to perform the cutout processing in the terminal device 1 (step S2).
0), and execute step S11 or step S12 and subsequent steps according to each of them. When command data from another terminal device is received in step S4, it goes without saying that processing corresponding to each request (step S21) is performed.

On the other hand, when the control device is selected (step S2), if the imaging device 1 is selected, the operation on the imaging device 1 is executed with the first priority. When basically performing a switch operation on the camera without receiving a control command from the outside, basic processing (step S2) from capturing a plurality of images having different focus states to performing pre-processing of image clipping (step S2)
The processing procedure of 2) is as follows.

First, after the power is turned on, when the mode is set to the subject extraction mode, the standard parameter values (for example, the range of the out-of-focus level, the cut-out processing are performed) for controlling the imaging conditions incorporated in the plurality of imaging condition setting units Therefore, a basic control program or the like is read.

The specifications and type of the mounted imaging optical system such as lens information are detected by the lens motor drive unit 3. The purpose of this information is to appropriately control the drive amount of the focus motor at the time of focus control, or to speed up the setting according to the type of optical system when setting the same as the previously used imaging condition. Used in

After that, magnification setting, photometry and (automatic) exposure conditions are set in the same manner as in the normal imaging mode, and then the focus motor is driven until the optimum focusing level is reached for the subject, and the hill-climbing method is used. Focusing is determined based on the image, and an image in which the subject is in focus is captured.

The focus motor is driven in the same direction by a predetermined width to evaluate the focus signal level, and if the level is out of focus within a preset allowable range, an image is taken. At this time, the number of captured images is checked, and focus control and the imaging operation are repeated until the number reaches a preset maximum number. Hereinafter, difference image data is extracted between a plurality of images having a small difference in focus signal level, and an image clipping process is performed.

The image cutout processing (contour line extraction processing) will be described. Up to this point, a binarization threshold has been set based on statistical processing of a local area of a fixed size centered on a designated point set with a mouse or the like (or an area set in an arbitrary shape with a mouse or the like). The binarization, thinning, and contour tracking processing may be performed within the area.

After the processing is completed, a local area centered on the end point is automatically set, and the same processing is repeated. Of these, thinning is processing for obtaining a representative point in a thick processing contour line, and is not limited to a method performed by conventional image processing. For example, an end point may be searched in any one of the left, right, upper, and lower directions from an arbitrary point in the coarse initial contour, and an end point adjacent to the point may be searched for as a representative point.

If there are a plurality of edges or contours in the vicinity due to thinning, these are superimposed on the input image on the display and displayed, and the edge to be taken is determined by means of a mouse or the like. A selection instruction may be made possible.

If only a single edge exists in the neighboring area, or if an edge is selected by the user, contour tracing processing is performed in a preset direction, and each point of the thinned image connected to the edge is processed. Are sequentially recorded as sampling points of the initial contour line.

When the thinned image has a branched structure,
As the selection of the branch direction, priority is given to the branch direction in which the image data attributes (color, luminance, or variance thereof, etc.) of the contour line in the direction orthogonal to the tracking direction of the point before the branch and the direction in which the direction change before and after the branch is small And select. In this case, the image attribute of the minute area centered on each point after the branch is detected and performed.

As another method, the user may be allowed to select which branch to take, for example, by suspending contour tracing and blinking an area around the branch point. However, if an imaging optical system with a shallow depth of focus is used, and if the distance between the extraction target and the background is sufficiently larger than the subject distance, a branch structure may appear at the boundary between the background and the subject in the differential image data. Needless to say, this can be suppressed.

When the outline is cut off in the middle by the binarization and thinning processing, edge connection processing is performed. In this case, a predetermined algorithm (see the 23rd Collection of Image Engineering Conference Papers, pp. 67-70, 1992, etc.)
To indicate the end point by automatically connecting it, or by blinking the end point remaining as a result of contour tracking on the display device, or by displaying a color different from other contour lines. May be displayed on the screen, and the user may confirm the confirmation and specify an end point to be connected by using the instruction selection unit to perform the connection. As a contour connecting the connection points, a spline interpolation curve or the like may be generated using a straight line or a representative point on the contour. In particular, when an end point after contour tracking is on an image frame, the end point may be connected to an end point on another frame.

As described above, after the closed contour and the image data inside the closed contour are extracted, the background area is removed by statistical processing, the area growing method, or the dynamic contour processing method is applied. Elaborate image extraction may be performed.

In this embodiment, a plurality of images having different focus states are processed by the focus lens control.
A plurality of images having different imaging parameters (aperture, shutter speed, etc.), imaging conditions (exposure conditions, sensor signal characteristics, etc.), or a combination thereof may be processed to extract, identify, or track a specific subject. .

[Second Embodiment] In a second embodiment, the imaging method and the principle of extracting a specific subject image shown in the first embodiment are applied to a digital copier connected to a computer terminal or the like. Shows when applied.

FIG. 8 is a block diagram showing a configuration of an imaging system according to the second embodiment. In the imaging system, a copier 27 as an image input unit is connected to a communication network.
Shows the case where is connected.

FIG. 9 is an explanatory diagram showing a schematic configuration of a digital copying machine. The image input unit 200 includes an optical system 201 having a zoom and focus adjustment function, and an image sensor 20.
2. Illumination means 203 such as a halogen lamp, focus zoom lens motor 204, visible light spectral filter 20
5, a control unit 206 and an infrared cut / spectral correction filter (not shown).

The printer section 220 comprises an image processor 210, a semiconductor laser 221, a photosensitive drum 222, a transfer drum 223, a rotary developing machine 224, and the like.
The image forming apparatus includes a fixing device 230, a paper supply unit 240, a toner supply unit (not shown), a control processor 250, a document table 260, an instruction selection unit 270, a data communication control unit 280, and an operation panel.

The optical system (not shown) of the printer unit 220 is typically composed of a reflection mirror, a toric lens (f-θ lens), a spherical lens, a polygon mirror, a cylindrical lens, and the like in the order close to the photosensitive drum.

The operation panel 290 has a switch 291 for setting the copying machine to extract and copy a subject. The setting of the same mode can also be performed from the keyboard of the terminal device 21 or an instruction selecting unit such as a pen or a mouse.
In the present embodiment, after the same mode is set, once image capturing for creating area mask data to be copied is performed, the density of the image data read in advance from the semiconductor laser 221 is changed only for the mask area. A light having a corresponding output is emitted, and a latent image is formed on the photosensitive drum 222.

An image obtained by photographing in the normal copy mode is displayed on the display unit of the terminal device 21, and the user confirms the image and designates a point on the contour line with the background of the subject to be extracted or its vicinity.

Next, the control processor 250 controls the imaging parameters, captures images under different imaging conditions (for example, focus), and calculates difference data between the images by the image processor 210. Thereafter, by performing the same extraction region cutout processing (mask data creation processing) as in the first embodiment, only the image to be extracted is copied. Further, the extracted image may be transferred to another terminal device 21 or display device 22 on the network and output.

Further, the present invention can be applied to a part of the above-described configuration to an electrophotographic facsimile apparatus having an image forming optical system. The reading unit of the facsimile apparatus has an illuminating unit, a mirror scanning mechanism, an optical system capable of controlling imaging parameters as in the first embodiment, and an image sensor.

The recording unit may use any of an electrophotographic system, a laser beam printer system, and a thermal transfer recording system. The communication control unit, for example, G4
It has a G3 / G2 communication control function for protocol control and subscribed lines. The control unit has an encoding / decoding unit.

The facsimile machine 27 is connected to an external terminal device 21 and can be controlled from the terminal device 21. That is, after shooting in the normal mode, the image data is displayed on the display unit of the terminal device 21. The user extracts an image by the above-described method by specifying a specific subject to be extracted and transferred from the image displayed on the display unit.

The above-described imaging by the focus control and the extraction and copying of the specific subject can be performed with high accuracy and efficiency by applying to a three-dimensional object. In this case, the copier includes a three-dimensional object installation table, an imaging device, an image processor,
It is composed of components of a normal copying machine such as a printer unit and a fixing device. In particular, the image input unit 200 may be separated from other components of the copying machine and installed above the three-dimensional object installation table. The process of transferring the image area extracted by the image processor 210 to the photosensitive drum and finally copying only the specific subject is the same as the above-described method.

As a suitable imaging control method for extracting a specific target image from a planar area such as a paper surface, the filter control unit 206 controls the characteristics of the visible light spectral filter 205 in the image input unit 200. An image may be input under a plurality of imaging conditions, and a specific subject area may be extracted and copied based on the difference data.

For example, when extracting an object whose color tone characteristic is unevenly distributed in a specific spectrum (for example, a red object as a whole), it is obtained by controlling a spectral filter so as to increase the transmittance with respect to the spectrum. An image and an image obtained in the normal mode are input, and extraction based on their difference data is performed.

As another image pickup control method, the image signal characteristics (gamma or the like) of the image sensor 202 or the exposure conditions (illumination light intensity, the diameter of a diaphragm if there is a diaphragm, the scanning speed when a scan is input, etc.) are controlled. The extraction processing may be performed on the obtained plurality of images.

In this case, after performing normalization processing (for example, scaling conversion of the luminance value so that the maximum luminance level becomes the same) between a plurality of image data, difference data between the two images is calculated, and the above-described method is used. It is desirable to perform the cutout processing in the same manner as described above.

[Third Embodiment] In the third embodiment, the principle of extracting a specific subject described above is applied to an image input device (image scanner, facsimile machine, etc.) having another contact type image sensor (such as a CCD element). Etc.). Here, a case where the present invention is applied to a facsimile machine is shown for simplicity.

FIG. 10 is an explanatory diagram showing a schematic configuration of an image input device. The main body 300 is connected to the terminal device 21, and the original 350 is photoelectrically converted by the contact image sensor 310 to read image information.

In the present embodiment, the image sensor 310
Has a drive control mechanism 320 for finely moving the image in a direction substantially orthogonal to the sensor surface, thereby performing an original image input in a normal mode (high-resolution image input mode) and an image input with an out-of-focus state.

As a drive unit of the fine movement control mechanism 320, a piezoelectric element or a voice coil motor is typically used. Note that the image data transferred via the modem 370 is transferred to a recording sheet 360 by a recording unit (such as a thermal head) 330 as in other facsimile apparatuses. The image processing unit 340 divides the image area into a character area and an image area based on the output from the image sensor 310 and, based on the method described in the first embodiment, specifies a specific graphic element specified in advance in the image area. Alternatively, a specific subject area is extracted.

More specifically, scanning and reading of an image are performed at a normal sensor surface position, the first image data is fetched, and then the sensor surface is slightly moved to scan and read the same image region in a defocused state. Then, the second image data is obtained. Further, the contour extraction and cutout processing of the subject are performed on the difference data between the first and second images as described in the first embodiment.

The control processor 380 controls the readout of an image, the extraction of a subject, the drive control of the contact sensor position, the recording of a thermal head, the paper feed, and the like. The control processor 380 also enables control by a control command from the terminal device 21.

[Fourth Embodiment] In the fourth embodiment, the imaging apparatus includes an inexpensive and small wireless communication control means having an infrared communication function. Other components inside the camera are the same as those in the first embodiment.

Also, by incorporating a communication control unit in the terminal device, a setting signal of the subject extraction imaging mode of the imaging device, imaging parameter control data, cut-out image data, and the like are transmitted and received. The communication system defined by the modulation system, coding system, data transmission speed, data format, communication protocol, etc. is not particularly limited, but typically the system defined by IrDA is used. In this case, it is assumed that one-to-one two-way communication is performed within a distance of several meters (typically 1 m) from each other, but in principle, one-to-many communication (one imaging device and many Communication between terminal devices, communication between one terminal device and many imaging devices)
Is possible.

Normally, at the start of communication with the other party, 960
A session is established at a rate of 0 bits / sec. At this time, both parties check the maximum transmission rate that can be supported, and thereafter communicate at that rate.

Further, the data transmission right is changed from 5 ms to 500
Exchange every ms and perform half-duplex communication. When a communication session with a specific imaging device is established from the terminal device, the type (imaging device or terminal device), the ID number of the user, and the like are mutually transmitted and received, so that the imaging device enters an imaging standby state by remote operation. .

In this case, a display indicating that the camera is in the communication control mode may be displayed on the operation panel display of the camera. Thereafter, the process from the setting of the subject extraction imaging mode to the transfer or recording of the captured image data is the same as that of the first embodiment. Control data or appropriately compressed and encoded image data is transmitted to a public network or an IS through a communication device employing the same communication method.
It can also be transferred to a remote location by connecting to a line such as a DN. Further, an operation panel similar to the operation panel of the imaging device may be displayed on the display panel of the terminal device, and camera operation information may be transmitted to the imaging device by a touch or a hand or a pen.

[0125]

According to the first aspect of the present invention, the imaging means controls the imaging parameters by the imaging parameter control means, sets the imaging mode by the imaging mode setting means, and sets the imaging mode by the arithmetic means. The first image processing means calculates comparison data between the plurality of images in which the imaging parameters are controlled, the second image processing means discriminates the calculated comparison data and classifies the image area, and the terminal means includes a data communication means. Performs data communication with the imaging unit, and the imaging parameter control unit controls the imaging parameter based on a signal from the terminal unit or a signal from the imaging mode setting unit. Therefore, communication from an external terminal device is performed. For selective extraction, recognition, tracking, etc. of the subject either by remote control by control or operation on the imaging means (camera) It may enable imaging operation.

According to the second aspect of the present invention, the imaging means controls the imaging parameters by the imaging parameter control means, and calculates comparison data between the plurality of images in which the imaging parameters are controlled by the image processing means. The arithmetic means instructs the position of the subject in the image by the instruction selecting means, and when performing data communication with the imaging means by the terminal means, the arithmetic means focuses on the object position signal from the instruction selecting means and the position. Generating an imaging parameter control signal based on image data within a predetermined size area, wherein the imaging parameter control means controls imaging conditions based on the imaging parameter control signal, and the terminal means A specific subject image is extracted by processing the obtained image. It is possible to enable the setting of conditions.

According to the third aspect of the present invention, the imaging parameter control means controls the imaging parameters so as to perform imaging centering on a substantially homogeneous area of a predetermined characteristic amount of the image data. Therefore, optimization and automation of an imaging method for subject extraction based on image data can be realized.

According to a fourth aspect of the present invention, the data communication means includes a synchronization means for transferring image data in synchronization with the imaging means, and the arithmetic means comprises:
Since the image data received via the data communication means is processed, it is possible to perform imaging (image capture) for extracting a subject from an external terminal device at an arbitrary time and timing.

According to the fifth aspect of the present invention, there is provided an image pickup device having a finder display device, an image display device for displaying an image picked up by the image pickup device, and an image displayed on the image display device. Instruction selecting means for instructing
Computing means having an area discriminating processing means for discriminating an area of the instructed image, wherein the area discriminating processing means processes the image data picked up by the image pickup means and is output from the instruction selecting means The image display means or the finder display means displays an extracted image signal from the arithmetic means, thereby performing a cutout process centered on a position or an area in an image frame. High-speed display on a display of a camera or a terminal device can be enabled.

According to the photographed image processing apparatus of the present invention, an image pickup means having an image pickup parameter control means for controlling an image pickup parameter, a memory means for storing imaged image data, and an image picked up by the image pickup means Image display means for displaying an image, an instruction selection means for indicating the displayed image, an arithmetic means having an area determination processing means for determining an area of the specified image, and data for performing data communication with the imaging means. Terminal means having communication means, the imaging parameter control means receives control data from the terminal means via the data communication means or inputs from the memory means, the area determination processing means,
Calculating image comparison data between a plurality of images obtained by imaging under two or more imaging conditions of a standard imaging condition and a non-standard imaging condition set by the imaging parameter control means; The image display means displays an image signal output from the arithmetic means, and performs a series of processing from setting of imaging conditions to display of an extracted image. It can be controlled on the device side.

According to a seventh aspect of the present invention, the data communication means includes a transmission / reception means for transmitting / receiving a signal by an electromagnetic wave or a line and a communication procedure control means, and is provided from the terminal means via the data communication means. Since the imaging mode setting means for setting the imaging mode for subject extraction based on the command data is provided, it is possible to cordlessly remotely control the imaging parameters for subject extraction from outside.

According to the picked-up image processing apparatus of the eighth aspect, the detachable memory medium is provided with a memory means having a recording / reproducing means for recording / reproducing image data, and the memory medium has a header portion for picking up an object. Since the imaging operation control procedure data in the mode is held, the imaging operation control program is recorded on a recording medium and supplied from outside,
In addition, the same imaging operation (processing procedure inside the camera) for subject extraction can be automatically recovered.

According to a ninth aspect of the present invention, there is provided a memory device having a recording / reproducing means for recording / reproducing image data on a removable memory medium, and the imaging parameter control means transmits the image data to the memory means. Since the setting of the imaging conditions and the imaging operation are performed based on the image data read after the memory medium is loaded, the imaging control data can be recorded on a recording medium and supplied from the outside, and the same imaging conditions for extracting the subject can be obtained. Can recover automatically.

According to a tenth aspect of the present invention, there is provided a photographed image processing apparatus comprising: a memory unit having a recording / reproducing unit for recording / reproducing image data on a removable memory medium; Since the operation information is recorded and the camera operation information is reproduced by the imaging mode setting means or the terminal means, if the imaging operation for extracting the subject is performed manually, the same imaging operation can be automatically recovered later. it can.

According to the image processing method of the eleventh aspect, the imaging step includes an imaging parameter control step of controlling imaging parameters of the imaging apparatus and an imaging mode setting step of setting an imaging mode, and the imaging parameters are controlled. A first image processing step of calculating comparison data between a plurality of images, and a second image processing step of discriminating the calculated comparison data to classify an image area; and the imaging device and the terminal device. A data communication step of performing data communication, the imaging parameter control step, since the imaging parameter is controlled based on a signal from the terminal device or a signal at the time of the imaging mode setting step, from an external terminal device The extraction, recognition, and tracking of the subject can be selectively performed either by remote control by communication control of the It can allow an imaging operation for.

According to the twelfth aspect of the present invention, there is provided an imaging parameter control step of controlling imaging parameters of the imaging apparatus and an image processing step of calculating comparison data between a plurality of images in which the imaging parameters are controlled. In a captured image processing method comprising: an imaging step, an arithmetic step of instructing a subject position in the image by an instruction selection device, and a data communication step of performing data communication between the imaging apparatus and a terminal device, wherein the arithmetic step is Generating an imaging parameter control signal based on a subject position signal from the instruction selection device and image data within a predetermined size area centered on the position, wherein the imaging parameter control step is based on the imaging parameter control signal. The terminal device controls an imaging condition, and the terminal device extracts a specific subject image by processing an image obtained under the imaging condition. Since it is possible to enable the setting of appropriate imaging conditions around the object based on the image data.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an imaging system according to a first embodiment.

FIG. 2 is a block diagram showing an internal configuration of the camera 1.

FIG. 3 is a graph schematically illustrating a relationship between a focus signal and an imaging position of a focus lens when performing imaging under a plurality of imaging conditions by focus control.

FIG. 4 is an explanatory diagram showing respective functions in a basic imaging system to which a camera and a terminal device are connected.

FIG. 5 is an explanatory diagram showing a process of processing image data.

FIG. 6 is a flowchart illustrating an image extraction processing procedure.

FIG. 7 is a flowchart illustrating an image extraction processing procedure following FIG. 6;

FIG. 8 is a block diagram illustrating a configuration of an imaging system according to a second embodiment.

FIG. 9 is an explanatory diagram showing a schematic configuration of a digital copying machine.

FIG. 10 is an explanatory diagram illustrating a schematic configuration of an image input device.

[Explanation of symbols]

 Reference Signs List 1 camera 9 imaging mode setting switch 15 system control unit 17 video signal processing unit 21 terminal device 26 display device 52b focus control unit

Claims (12)

[Claims] An imaging unit having imaging parameter control means for controlling an imaging parameter and an imaging mode setting means for setting an imaging mode; and first image processing for calculating comparison data between a plurality of images in which the imaging parameters are controlled. Means, and a computing means having second image processing means for classifying an image area by discriminating the calculated comparison data; and a terminal means having data communication means for performing data communication with the imaging means. The captured image processing apparatus, wherein the parameter control means controls the imaging parameters based on a signal from the terminal means or a signal from the imaging mode setting means. 2. An imaging unit having imaging parameter control means for controlling imaging parameters, image processing means for calculating comparison data between a plurality of images in which the imaging parameters are controlled, and an instruction for designating a subject position in the image. In a captured image processing apparatus comprising: a calculation unit having a selection unit; and a terminal unit that performs data communication with the imaging unit, the calculation unit includes a subject position signal from the instruction selection unit and a predetermined value centered on the position. An imaging parameter control signal is generated based on image data in a size area, the imaging parameter control unit controls imaging conditions based on the imaging parameter control signal, and the terminal unit is obtained under the imaging conditions. A captured image processing apparatus, wherein a specific subject image is extracted by processing an image. 3. The imaging apparatus according to claim 1, wherein the imaging parameter control means controls the imaging parameters so as to perform imaging centering on a substantially homogeneous area of a predetermined feature amount of the image data. Image processing device. 4. The data communication means has a synchronization means for transferring image data in synchronization with the imaging means, and the arithmetic means processes the image data received via the data communication means. The captured image processing apparatus according to claim 1, wherein: 5. An image pickup means having a finder display means, an image display means for displaying an image picked up by the image pickup means, an instruction selection means for indicating an image displayed on the image display means, Computing means having an area discriminating processing means for discriminating an area of the image which has been processed. The area discriminating processing means processes the image data picked up by the image pick-up means. Wherein the image display means or the finder display means displays an extracted image signal from the calculation means. 6. An image pickup means having an image pickup parameter control means for controlling an image pickup parameter and a memory means for storing imaged image data; an image display means for displaying an image picked up by the image pickup means; Instruction selecting means for instructing the designated image, computing means having area discriminating processing means for discriminating the area of the designated image, and terminal means having data communication means for performing data communication with the imaging means. The imaging parameter control means receives control data from the terminal means via the data communication means or inputs the control data from the memory means, and the area determination processing means comprises a standard imaging set by the imaging parameter control means. Calculating comparison data between a plurality of images obtained by imaging under two or more imaging conditions of a condition and a non-standard imaging condition; A picked-up image processing apparatus, wherein a cutout process is performed centering on a position or a region in an image frame output from a stage, and the image display means displays an image signal output from the arithmetic means. 7. The image pickup mode for extracting a subject based on command data from the terminal means via the data communication means, the data communication means having a means for transmitting / receiving a signal by electromagnetic waves or lines and a communication procedure control means. 2. The captured image processing apparatus according to claim 1, further comprising an imaging mode setting unit configured to set the image capturing mode. 8. A memory unit having a recording / reproducing unit for recording / reproducing image data on a removable memory medium, wherein the memory medium holds an imaging operation control procedure data in a subject cutout imaging mode in a header portion. The captured image processing apparatus according to claim 1, wherein: 9. A memory unit having recording / reproducing means for recording / reproducing image data on / from a removable memory medium, wherein the imaging parameter control means stores image data read out after loading the memory medium into the memory means. 2. The captured image processing apparatus according to claim 1, wherein an image capturing condition is set and an image capturing operation is performed based on the image capturing condition. 10. A memory unit having a recording / reproducing unit for recording / reproducing image data on a removable memory medium, wherein the memory unit records camera operation information at the time of subject extraction imaging, and the imaging mode setting unit 2. The captured image processing apparatus according to claim 1, wherein the camera operation information is reproduced by the terminal unit. 11. An imaging step having an imaging parameter control step of controlling an imaging parameter of an imaging apparatus and an imaging mode setting step of setting an imaging mode, and a step of calculating comparison data between a plurality of images in which the imaging parameters are controlled. A computing step having one image processing step, a second image processing step of discriminating the calculated comparison data to classify an image area, and a data communication step of performing data communication between the imaging device and the terminal device. The imaging parameter processing method, wherein the imaging parameter control step controls the imaging parameter based on a signal from the terminal device or a signal in the imaging mode setting step. 12. An imaging step having an imaging parameter control step of controlling imaging parameters of an imaging apparatus and an image processing step of calculating comparison data between a plurality of images in which the imaging parameters are controlled; In a captured image processing method comprising: a calculation step instructed by an instruction selection device; and a data communication step of performing data communication between the imaging device and the terminal device, wherein the calculation step includes: a subject position signal from the instruction selection device; The imaging parameter control signal is generated based on image data within a predetermined size area centered on the position, the imaging parameter control step controls imaging conditions based on the imaging parameter control signal, A captured image processing method, wherein a specific subject image is extracted by processing an image obtained under the imaging conditions. .