JPH11261939A - Image processing method, its unit and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing method and its unit with high convenience without placing a limit onto photographing applications. SOLUTION: The image processing unit 100 has recording media 200a, 200b that record and reproduced an image photographed by an image pickup section S and an image display section 110 that reproduces and displays the image photographed at least before the present time, and the image display section 110 has pluralities of display arrangement modes where a current photographing signal and a signal resulting from reproducing the image photographed at least before the present time are displayed while overlapping parts of border areas.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method and apparatus for capturing, recording, and reproducing still and moving images, and a storage medium storing a control program for controlling the image processing apparatus.

[0002]

2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera for recording / reproducing a still image or a moving image using a memory card having a solid-state memory element as a recording medium is already on the market, and an electronic finder such as a color liquid crystal panel is already available. Electronic cameras equipped with are also commercially available.

According to these electronic cameras, it is possible for the user of the electronic camera to continuously determine the composition by continuously displaying images before shooting, and to reproduce and display the shot images for confirmation. .

In particular, a function of creating a panoramic image by combining a plurality of captured images is highly convenient and is a useful function for a user of an electronic camera.

[0005]

However, such a conventional image processing apparatus such as an electronic camera cannot photograph a complicated combination of panoramic images or photograph a complicated combination of panoramic images. Is not possible when using the finder
There has been a problem that the shooting application may be limited.

In addition, when a user of an image processing apparatus such as an electronic camera determines a composition to be shot, a panoramic image cannot be started to be shot in an arbitrary direction, so that a highly convenient image processing apparatus can be provided. There was a problem that it was not possible.

Further, there is a problem that a highly convenient image processing apparatus cannot be provided because a finder display and an operation for easily performing redo photographing cannot be performed immediately after photographing a panoramic image.

[0008] The present invention has been made in view of the above-mentioned problems of the above-described conventional technology. The first object of the present invention is to limit the use of photographing without limiting
An object of the present invention is to provide a highly convenient image processing method and apparatus.

It is a second object of the present invention to provide a storage medium storing a control program capable of smoothly controlling the above-described image processing apparatus of the present invention.

[0010]

According to a first aspect of the present invention, there is provided an image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium. An image capturing step of capturing an image, a recording / reproducing step of recording and reproducing an image captured by the image capturing step, and a display step of reproducing and displaying an image captured at least before the present, and The display step includes a plurality of display arrangement modes for displaying a current image pickup signal and at least a signal obtained by reproducing an image picked up before the present at least partially in a boundary region.

According to a second aspect of the present invention, there is provided an image processing method according to the first aspect, wherein the image is a still image.

In order to achieve the first object, an image processing method according to claim 3 is characterized in that in the image processing method according to claim 1, the image is a moving image. In order to achieve the first object, an image processing method according to claim 4 is characterized in that, in the image processing method according to claim 1, the images are a still image and a moving image.

According to another aspect of the present invention, there is provided an image processing method comprising:
In the image processing method described above, the plurality of display arrangement modes of the display step are a first display arrangement mode arranged in a two-dimensional direction and a second display arrangement mode arranged in a one-dimensional direction. Features.

According to a sixth aspect of the present invention, there is provided an image processing method according to the fifth aspect, wherein the second display arrangement mode is arranged in a horizontal direction. It is characterized by.

According to a seventh aspect of the present invention, there is provided an image processing method according to the fifth aspect, wherein the second display arrangement mode is arranged in a vertical direction. It is characterized by.

In order to achieve the first object, an image processing method according to claim 8 is the image processing method according to claim 5, wherein the second display arrangement mode is arranged in a horizontal direction. It is characterized by comprising a horizontal arrangement mode and a vertical arrangement mode arranged in a vertical direction.

In order to achieve the first object, an image processing apparatus according to a ninth aspect is an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. Imaging means for capturing an image, recording / reproducing means for recording and reproducing an image captured by the image capturing means, and display means for reproducing and displaying an image captured at least before the present, and the display means comprises: A plurality of display arrangement modes are provided in which a current imaging signal and at least a signal obtained by reproducing an image captured before the present are displayed with a partial boundary area overlapped.

In order to achieve the first object, an image processing apparatus according to claim 10 is the image processing apparatus according to claim 9, wherein the image is a still image.

In order to achieve the first object, an image processing apparatus according to claim 11 is the image processing apparatus according to claim 9, wherein the image is a moving image.

According to a twelfth aspect of the present invention, in order to achieve the first object, in the image processing apparatus according to the ninth aspect, the images are a still image and a moving image. .

According to a thirteenth aspect of the present invention, in the image processing apparatus according to the ninth to eleventh or twelfth aspects, a plurality of display arrangement modes of the display means are provided. It is characterized by a first display arrangement mode arranged in a two-dimensional direction and a second display arrangement mode arranged in a one-dimensional direction.

According to a fourteenth aspect of the present invention, in the image processing apparatus of the thirteenth aspect, the second display arrangement mode is arranged in a horizontal direction. It is characterized by.

According to a fifteenth aspect of the present invention, in the image processing apparatus according to the thirteenth aspect, the second display mode is vertically arranged. It is characterized by.

In order to achieve the first object, an image processing apparatus according to claim 16 is the image processing apparatus according to claim 13, wherein the second display arrangement mode is arranged in a horizontal direction. It is characterized by comprising a horizontal arrangement mode and a vertical arrangement mode arranged in a vertical direction.

In order to achieve the first object, an image processing apparatus according to claim 17 is the image processing apparatus according to claims 9 to 15 or 16, wherein the image processing apparatus is an electronic camera. Features.

In order to achieve the first object, an image processing method according to claim 18 is an image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium. An image capturing step of capturing an image, a recording / reproducing step of recording and reproducing an image captured by the image capturing step, and a display step of reproducing and displaying an image captured at least before the present, and the display step includes: A display arrangement mode in which a current imaging signal and at least a signal obtained by reproducing an image captured before the present are arranged and displayed in a one-dimensional direction by partially overlapping a boundary region, and a function of inverting the arrangement direction in the one-dimensional direction And characterized in that:

In order to achieve the first object, an image processing method according to claim 19 is characterized in that, in the image processing method according to claim 18, the image is a still image.

In order to achieve the first object, an image processing method according to claim 20 is characterized in that, in the image processing method according to claim 18, the image is a moving image.

In order to achieve the first object, an image processing method according to claim 21 is the image processing method according to claim 18, wherein the images are a still image and a moving image. .

In order to achieve the first object, the image processing method according to claim 22 has the function of reversing the arrangement direction in the one-dimensional direction in the image processing method according to claims 18 to 20 or 21. It is characterized in that use is prohibited at least after the end of photographing of the first image.

In order to achieve the first object, the image processing method according to claim 23 is the image processing method according to claims 18 to 21 or 22, wherein the display arrangement mode is arranged in a horizontal direction. It is characterized by the following.

In order to achieve the first object, an image processing method according to claim 24 is the image processing method according to claims 18 to 21 or 22, wherein the display arrangement mode is arranged in a vertical direction. It is characterized by the following.

In order to achieve the first object, an image processing method according to claim 25 is the image processing method according to claims 18 to 21 or 22, wherein the display arrangement mode is arranged in a horizontal direction. It is characterized by comprising a horizontal arrangement mode and a vertical arrangement mode arranged in a vertical direction.

In order to achieve the first object, an image processing apparatus according to claim 26 is an image processing apparatus that records a plurality of captured images on a recording medium and reproduces and displays the images. Imaging means for capturing an image, recording / reproducing means for recording and reproducing an image captured by the image capturing means, and display means for reproducing and displaying an image captured at least before the present, and the display means comprises: A display arrangement mode in which a current imaging signal and at least a signal obtained by reproducing an image captured earlier than the present are arranged in a one-dimensional direction with a partial boundary area overlapped and displayed, and a function of inverting the arrangement direction in the one-dimensional direction And characterized in that:

In order to achieve the first object, an image processing apparatus according to claim 27 is characterized in that, in the image processing apparatus according to claim 26, the image is a still image.

In order to achieve the first object, an image processing apparatus according to claim 28 is the image processing apparatus according to claim 26, wherein the image is a moving image.

In order to achieve the first object, an image processing apparatus according to claim 29 is characterized in that in the image processing apparatus according to claim 26, the images are a still image and a moving image. .

In order to achieve the first object, the image processing apparatus according to claim 30 has the function of reversing the arrangement direction in the one-dimensional direction in the image processing apparatus according to claims 26 to 28 or 29. It is characterized in that use is prohibited at least after the end of photographing of the first image.

In order to achieve the first object, the image processing apparatus according to claim 31 is the image processing apparatus according to claims 26 to 29 or 30, wherein the display arrangement mode is arranged in a horizontal direction. It is characterized by the following.

In order to achieve the first object, an image processing apparatus according to claim 32 is the image processing apparatus according to claims 26 to 29 or 30, wherein the display arrangement mode is arranged in a vertical direction. It is characterized by the following.

In order to achieve the first object, an image processing apparatus according to claim 33 is the image processing apparatus according to claims 26 to 29 or 30, wherein the display arrangement mode is arranged in a horizontal direction. And a vertical arrangement mode arranged in a vertical direction.

In order to achieve the first object, an image processing apparatus according to claim 34 is the image processing apparatus according to claims 26 to 32 or 33, wherein the image processing apparatus is an electronic camera. Features.

In order to achieve the first object, an image processing method according to claim 35 is an image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium. An image capturing step of capturing an image, a recording / reproducing step of recording and reproducing an image captured by the image capturing step, a display step of reproducing and displaying an image captured at least before the present, and a current image signal and at least a current A first display arrangement mode for displaying a signal obtained by reproducing a previously captured image in a one-dimensional direction by partially overlapping a boundary area and displaying a signal obtained by reproducing an image captured at least before the current time; A switching step of switching a second display arrangement mode for displaying a signal obtained by reproducing a captured image in a one-dimensional direction by partially overlapping a boundary area and displaying the signal.

In order to achieve the first object, an image processing method according to claim 36 is characterized in that, in the image processing method according to claim 35, the image is a still image.

In order to achieve the first object, an image processing method according to claim 37 is characterized in that, in the image processing method according to claim 35, the image is a moving image.

In order to achieve the first object, an image processing method according to claim 38 is characterized in that, in the image processing method according to claim 35, the images are a still image and a moving image. .

In order to achieve the first object, an image processing method according to claim 39 is the image processing method according to claims 35 to 37 or 38, wherein the display arrangement mode is arranged in a horizontal direction. It is characterized by the following.

In order to achieve the first object, an image processing method according to claim 40 is the image processing method according to claims 35 to 37 or 38, wherein the display arrangement mode is arranged in a vertical direction. It is characterized by the following.

In order to achieve the first object, an image processing method according to claim 41 is the image processing method according to claims 35 to 37 or 38, wherein the display arrangement mode is arranged in a horizontal direction. And a vertical arrangement mode arranged in a vertical direction.

In order to achieve the first object, an image processing apparatus according to claim 42 is an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. Imaging means for capturing an image, recording / reproduction means for recording and reproducing an image captured by the imaging means, display means for reproducing and displaying an image captured at least before the present, and a current imaging signal and at least a current A first display arrangement mode in which a signal obtained by reproducing a previously captured image and a partial boundary area are overlapped and arranged in a one-dimensional direction and displayed on a display unit; Further, a switching means for switching between a signal obtained by reproducing a previously captured image and a second display arrangement mode in which a boundary area is partially overlapped, arranged in a one-dimensional direction, and displayed on a display means is provided. The features.

In order to achieve the first object, an image processing apparatus according to claim 43 is the image processing apparatus according to claim 42, wherein the image is a still image.

In order to achieve the first object, an image processing apparatus according to claim 44 is characterized in that, in the image processing apparatus according to claim 42, the image is a moving image.

In order to achieve the first object, an image processing apparatus according to claim 45 is characterized in that, in the image processing apparatus according to claim 42, the images are a still image and a moving image. .

In order to achieve the first object, an image processing apparatus according to claim 46 is the image processing apparatus according to claims 42 to 44 or 45, wherein the display arrangement mode is arranged in a horizontal direction. It is characterized by the following.

In order to achieve the first object, an image processing apparatus according to claim 47 is the image processing apparatus according to claims 42 to 44 or 45, wherein the display arrangement mode is arranged in a vertical direction. It is characterized by the following.

In order to achieve the first object, an image processing apparatus according to claim 48 is the image processing apparatus according to claims 42 to 44 or 45, wherein the display arrangement mode is arranged in a horizontal direction. And a display arrangement mode arranged vertically.

In order to achieve the first object, the image processing apparatus according to claim 49 is the image processing apparatus according to claims 42 to 47 or 48, wherein the image processing apparatus is an electronic camera. Features.

In order to achieve the first object, an image processing method according to claim 50 is an image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium. An image capturing step of capturing an image, a recording / reproducing step of recording and reproducing an image captured by the image capturing step, and a display step of reproducing and displaying an image captured at least before the present, and the display step includes: A display arrangement mode in which a current imaging signal and at least a signal obtained by reproducing an image captured before the present are arranged and displayed in a two-dimensional direction by partially overlapping a boundary region, and each of the arrangements arranged according to the display arrangement mode is provided. A selection step of selecting an arbitrary area from the display areas is provided.

In order to achieve the first object, an image processing method according to claim 51 is characterized in that, in the image processing method according to claim 50, the image is a still image.

In order to achieve the first object, an image processing method according to claim 52 is characterized in that, in the image processing method according to claim 50, the image is a moving image.

In order to achieve the first object, an image processing method according to claim 53 is characterized in that in the image processing method according to claim 50, the images are a still image and a moving image. .

In order to achieve the first object, the image processing method according to claim 54 is the image processing method according to claims 49 to 51 or 53, wherein the selecting step includes displaying a current imaging signal. It is characterized in that an area is selected.

In order to achieve the first object, the image processing method according to claim 55 is the image processing method according to claims 49 to 51 or 53, wherein the selecting step includes the step of: A display area to be reproduced and displayed is selected.

In order to achieve the first object, an image processing apparatus according to claim 56 is an image processing apparatus which records a plurality of captured images on a recording medium and reproduces and displays the images. Imaging means for capturing an image, recording / reproducing means for recording and reproducing an image captured by the image capturing means, and display means for reproducing and displaying an image captured at least before the present, and the display means comprises: A display arrangement mode in which a current imaging signal and at least a signal obtained by reproducing an image captured before the present are arranged and displayed in a two-dimensional direction by partially overlapping a boundary region, and each of the arrangements arranged according to the display arrangement mode is provided. It is characterized by comprising a selecting means for selecting an arbitrary area from the display area.

In order to achieve the first object, an image processing apparatus according to claim 57 is characterized in that, in the image processing apparatus according to claim 56, the image is a still image.

In order to achieve the first object, an image processing apparatus according to claim 58 is characterized in that, in the image processing apparatus according to claim 56, the image is a moving image.

In order to achieve the first object, an image processing apparatus according to claim 59 is characterized in that, in the image processing apparatus according to claim 56, the images are a still image and a moving image. .

In order to achieve the first object, an image processing apparatus according to claim 60 is the image processing apparatus according to claims 55 to 58 or 59, wherein the selecting means is configured to display a current imaging signal. It is characterized in that an area is selected.

In order to achieve the first object, the image processing apparatus according to claim 61 is the image processing apparatus according to claims 55 to 58 or 59, wherein the selecting means selects the last image taken. A display area to be reproduced and displayed is selected.

In order to achieve the first object, the image processing apparatus according to claim 62 is the image processing apparatus according to claims 56 to 60 or 61, wherein the image processing apparatus is an electronic camera. Features.

In order to achieve the second object, the storage medium according to claim 63 stores a control program for controlling an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. A storage medium that captures an image, records and reproduces the captured image, reproduces and displays at least an image captured before the present, and displays a current image signal and at least an image captured before the present. And a control program having a control module of a step of performing control to execute a plurality of display arrangement modes for displaying a signal obtained by reproducing a part of a boundary area partially overlapped therewith.

In order to achieve the second object, the storage medium according to claim 64 is characterized in that, in the storage medium according to claim 63, the image is a still image.

In order to achieve the second object, the storage medium according to claim 65 is characterized in that, in the storage medium according to claim 63, the image is a moving image.

In order to achieve the second object, a storage medium according to claim 66 is characterized in that, in the storage medium according to claim 63, the images are a still image and a moving image.

In order to achieve the second object, the storage medium according to claim 67 is the storage medium according to claims 63 to 65 or 66, wherein the image processing device is an electronic camera. I do.

In order to achieve the second object, the storage medium according to claim 68 stores a control program for controlling an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. A storage medium that captures an image, records and reproduces the captured image, reproduces and displays at least an image captured before the present, and displays a current image signal and at least an image captured before the present. And a control module for controlling to execute a display arrangement mode for arranging and displaying a signal in which a boundary area is partially overlapped and arranged in a one-dimensional direction and a function of inverting the arrangement direction in a one-dimensional direction. Characterized by storing a control program having the control program.

In order to achieve the second object, a storage medium according to claim 69 is the storage medium according to claim 68, wherein the image is a still image.

In order to achieve the second object, the storage medium according to claim 70 is characterized in that, in the storage medium according to claim 68, the image is a moving image.

In order to achieve the second object, a storage medium according to claim 71 is the storage medium according to claim 68, wherein the image is a still image and a moving image.

In order to achieve the second object, a storage medium according to claim 72 is the storage medium according to claims 68 to 70 or 71, wherein the image processing device is an electronic camera. I do.

In order to achieve the second object, a storage medium according to claim 73 stores a control program for controlling an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. A storage medium that captures an image, records and reproduces the captured image, reproduces and displays at least an image captured before the present, and displays a current image signal and at least an image captured before the present. A first display arrangement mode for displaying a signal obtained by reproducing the image and partially arranging the boundary region in a one-dimensional direction and displaying a signal obtained by reproducing at least an image captured before the present and an image captured further before A control program having a control module for controlling to switch a second display arrangement mode in which a signal and a partial signal are overlapped and partially arranged in a one-dimensional direction and displayed. It is characterized in.

In order to achieve the second object, a storage medium according to claim 74 is the storage medium according to claim 73, wherein the image is a still image.

In order to achieve the second object, a storage medium according to claim 75 is the storage medium according to claim 73, wherein the image is a moving image.

In order to achieve the second object, a storage medium according to claim 76 is characterized in that, in the storage medium according to claim 73, the images are a still image and a moving image.

In order to achieve the second object, the storage medium according to claim 77 is the storage medium according to claims 73 to 75 or 76, wherein the image processing device is an electronic camera. I do.

In order to achieve the second object, the storage medium according to claim 78 stores a control program for controlling an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium. A storage medium that captures an image, records and reproduces the captured image, reproduces and displays at least an image captured before the present, and displays a current image signal and at least an image captured before the present. And a control module for controlling so as to select an arbitrary area from among the display areas arranged in a display arrangement mode in which a signal obtained by reproducing the signal is partially overlapped with a boundary area and arranged and displayed in a two-dimensional direction. Characterized by storing a control program having the control program.

In order to achieve the second object, a storage medium according to claim 79 is the storage medium according to claim 78, wherein the image is a still image.

In order to achieve the second object, a storage medium according to claim 80 is the storage medium according to claim 78, wherein the image is a moving image.

In order to achieve the second object, the storage medium according to claim 81 is characterized in that, in the storage medium according to claim 78, the images are a still image and a moving image.

Further, in order to achieve the second object, the storage medium according to claim 82 is the storage medium according to claims 78 to 80 or 81, wherein the image processing device is an electronic camera. I do.

[0091]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of an image processing apparatus according to an embodiment of the present invention. In FIG. 1, reference numeral 100 denotes an image processing apparatus, and 101 denotes a photographic lens for photographing a subject. is there. A shutter 102 has an aperture function. An image sensor 103 converts an optical image into an electric signal. An A / D converter 104 converts an analog signal output of the image sensor 103 into a digital signal. A timing generation circuit 105 supplies a clock signal and a control signal to the image sensor 103, the A / D converter 104, and a D / A converter 109 described later. Is controlled by

Reference numeral 106 denotes an image processing circuit, which is an A / D converter 1
04 or a memory control circuit 107 to be described later.
, And performs predetermined pixel-to-pixel processing and color conversion processing. Further, in the image processing circuit 106, predetermined calculation processing is performed using the captured image data, and based on the obtained calculation result, a system control circuit 118, which will be described later, performs exposure control means 113 and distance measurement control means 114, which will be described later. TTL (through-the-lens) type AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing, which perform control on the flash memory. Further, the image processing circuit 106 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

Reference numeral 107 denotes a memory control circuit, which includes an A / D converter 104, a timing generation circuit 105, and an image processing circuit 10.
6. It controls an image display unit 110 described later, a D / A converter 109 described later, a memory 111 described later, and a compression / decompression circuit 112 described later. A / D converter 104
From the image processing circuit 106 and the memory control circuit 1
07, or the data from the A / D converter 104 is written directly to the image display memory 108 described later or the memory 111 described later via the memory control circuit 107.

Reference numeral 108 denotes an image display memory in which image data for display is written. A D / A converter 109 converts a digital signal into an analog signal. Reference numeral 110 denotes an image display unit including a TFT-LCD (thin film transistor liquid crystal display) or the like. Display image data written in the image display memory 108 is displayed by the image display unit 110 via the D / A converter 109. . If the image data captured using the image display unit 110 is sequentially displayed, an electronic finder function can be realized. The image display unit 110 can arbitrarily turn on / off the display in accordance with an instruction from a system control circuit 118 described later. can do.

Reference numeral 111 denotes a memory for storing photographed still images and moving images, and having a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. Accordingly, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 111 at high speed. The memory 111 can also be used as a work area for a system control circuit 118 described later.

Reference numeral 112 denotes a compression / decompression circuit for compressing / decompressing image data by adaptive discrete cosine transform (ADCT) or the like. The compression / decompression circuit 112 reads an image stored in the memory 111 and performs compression or decompression processing. The completed data is written to the memory 111. An exposure control unit 113 controls the shutter 102, and has a flash dimming function in cooperation with a flash 117 described later. A distance measuring unit 114 controls focusing of the photographing lens 101.
A zoom control unit 115 controls zooming. Reference numeral 116 denotes a barrier control unit which controls the operation of a protection unit which is a barrier described later. Reference numeral 117 denotes a flash, which also has an AF auxiliary light projecting function and a flash dimming function.

Exposure control means 113 and distance measuring means 114
Is controlled using the TTL method, and a system control circuit 118 described later controls the exposure control unit 113 and the distance measurement unit 114 based on the calculation result obtained by calculating the captured image data by the image processing circuit 106. Do.

A system control circuit 118 controls the entire image processing apparatus 100. A memory 119 stores constants, variables, programs, and the like for the operation of the system control circuit 118. Reference numeral 120 denotes a display unit, which includes a liquid crystal display device that displays an operation state or a message using characters, images, sounds, or the like in response to execution of a program in the system control circuit 118, or a speaker. A single or a plurality of units are installed at easily visible positions near an operation unit of the processing apparatus 100, which will be described later.
The display unit 120 has a part of its functions installed in an optical finder 138 described later.

Of the display contents of the display unit 120, those displayed on the LCD or the like include, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining image capturing possible. Number display, shutter speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, buzzer setting display, battery remaining battery display, battery remaining display, error display, multi-digit number display Information display, recording medium 2 described later
00a, 200b display, communication I / F (interface) operation display, date / time display, display indicating connection status with external computer, and the like.

Among the display contents of the display unit 120, those displayed in an optical viewfinder 138, which will be described later, include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, There are a shutter speed display, an aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

Further, among the display contents of the display unit 120, L
The display on the ED or the like includes, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charge display,
Flash charging completion display, recording medium writing operation display,
There are a macro shooting setting notification display, a secondary battery charge state display, and the like.

Further, among the display contents of the display unit 120, those displayed on a lamp or the like include a self-timer notification lamp, for example. This self-timer notification lamp may be shared with the AF auxiliary light.

Reference numeral 121 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM (electronica).
lly eraseable and programm
Able read only memory (electrically erasable PROM) or the like is used.

122, 123, 124, 125, 12
Reference numerals 6, 127, and 128 denote operating means for inputting various operation instruction information of the system control circuit 118. The operating means comprises a single switch or a combination of a plurality of switches, dials, touch panels, pointing by gaze detection, voice recognition devices, and the like. Is done.

Here, these operating means 122 to 12
8 will be described specifically.

Reference numeral 122 denotes a mode dial switch for turning off the power, automatic photographing mode, photographing mode, panoramic photographing mode, reproducing mode, multi-screen reproducing / erasing mode, PC
(Personal computer) Each function mode such as a connection mode can be switched and set.

Reference numeral 123 denotes a first shutter switch which is turned on during the operation of a shutter button (not shown),
(Auto focus) processing, AE (auto exposure) processing, A
It instructs to start operations such as WB (auto white balance) processing and EF (flash pre-emission) processing.

Reference numeral 124 denotes a second shutter switch, which is turned on when the operation of a shutter button (not shown) is completed, and transmits a signal read from the image sensor 103 to the memory 111 via the A / D converter 104 and the memory control circuit 107. Exposure processing for writing data, development processing using the calculation results of the image processing circuit 106 and the memory control circuit 107, and the memory 11
1 to instruct the start of a series of processes of a recording process of writing image data to a recording medium 200a or a recording medium 200b to be described later.

Reference numeral 125 denotes a selection / selection switch, which can set selection and switching of various functions when photographing and reproducing in a panorama mode or the like. Reference numeral 126 denotes a decision / execution switch, which can set the decision and execution of various functions when performing shooting and playback in a panorama mode or the like.

An operation unit 127 includes various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single / continuous shooting self-timer switching button,
Menu move + (plus) button, menu move-(minus) button, play image move + (plus) button, play image move-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, An image display on / off setting button for setting on / off of the image display unit 110, a quick review on / off setting button for setting a quick review function for automatically reproducing image data shot immediately after shooting on the image display unit 110, and the like are provided. is there.

A compression mode switch 128 is a JPEG
In order to select the compression ratio of the compression or to digitize the signal from the image sensor 103 as it is,
00a or a switch for selecting a CCD RAW mode for recording raw data on the recording medium 200b as it is.

As the JPEG compression mode, for example, a normal mode and a fine mode are prepared. JPEG
In the compression mode, image data read from the image sensor 103 and written into the memory 111 via the A / D converter 104, the image processing circuit 106, and the memory control circuit 107 is read, and the compression / decompression circuit 112 is read. After compression is performed at the compression rate set by
00a or recording on the recording medium 200b.

In the CCD RAW mode, the image sensor 103
In accordance with the pixel array of the color filter, the image data is read out for each line as it is, and the image data written in the memory 111 is read out via the A / D converter 104 and the memory control circuit 107. 200a,
Alternatively, recording is performed on the recording medium 200b.

Reference numeral 129 denotes a power supply control means, a battery detection circuit,
It comprises a DC-DC converter, a switch circuit for switching a block to be energized, and the like, and detects the presence or absence of a battery, the type of the battery, and the remaining battery level, based on the detection result and an instruction from the system control circuit 118. DC-
The DC converter is controlled to supply a required voltage to each unit including the recording media 200a and 200b for a required period.

Reference numerals 130 and 131 denote connectors for connecting the power supply control means 129 to a power supply 132 described later. Reference numeral 132 denotes a power supply, which includes a primary battery such as an alkaline battery and a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, and a Li battery, and an AC adapter. 133,134
Is an interface (I / F) with the recording media 200a and 200b described later, and 135 and 136 are connectors for connecting the interfaces (I / F) 133 and 134 with the recording media 200a and 200b described later.

Reference numeral 137 denotes a recording medium attachment / detachment detecting means for detecting whether or not a recording medium 200a or a recording medium 200b, which will be described later, is attached to the connector 135 or the connector 136. Recording medium attachment / detachment detecting means 13
7 can also detect whether the connector 135 or the connector 136 is mounted with, for example, various communication cards or the like described below other than the recording medium 200a or the recording medium 200b described below. In the present embodiment, the description has been made assuming that there are two interfaces and connectors for attaching the recording media 200a and 200b. Of course, the interface and the connector for attaching the recording media 200a and 200b may have a single or plural number of systems.

Further, the configuration may be such that interfaces and connectors of different standards are provided in combination. The interface and the connector may be configured by using a standard compliant with a PCMCIA card, a CF (Compact Flash) card, or the like.

Further, the interfaces 133 and 134 and the connectors 135 and 136 are connected to a PCMCIA card or CF.
When using a card that conforms to the standards of the card, etc.,
LAN card, modem card, USB card, IEEE
1394 card, P1284 card, SCSI card,
By connecting various communication cards such as a communication card such as a PHS, image data and management information attached to the image data can be transferred to and from another computer or a peripheral device such as a printer.

Reference numeral 137 denotes a protection means.
By covering the imaging unit S including the imaging lens 101 of
This is a barrier for preventing the imaging unit S from being stained or damaged. 13
Reference numeral 8 denotes an optical finder, which can perform photographing using only the optical finder 138 without using the electronic finder function of the image display unit 110.
In the optical viewfinder 138, some functions of the display unit 120, such as a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display,
An exposure compensation display and the like are provided.

Reference numeral 139 denotes communication means such as RS232C or US
It has various communication functions such as B, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication. 14
Reference numeral 0 denotes a connector or an antenna, which serves as a connector when the image processing apparatus 100 is connected to another device by the communication unit 139, and serves as an antenna for wireless communication.

Reference numerals 200a and 200b are recording media such as a memory card and a hard disk. Recording media 200a, 2
Reference numeral 00b denotes recording units 201a and 201b including a semiconductor memory and a magnetic disk, interfaces (I / F) 202a and 202b with the image processing apparatus 100, and connectors 203a and 203 for connecting to the image processing apparatus 100.
b.

Next, the operation of the image processing apparatus 100 according to the present embodiment having the above configuration will be described with reference to FIGS.

FIGS. 2 to 4 are flowcharts of the main routine of the image processing apparatus 100 according to the present embodiment.

First, a description will be given with reference to FIGS.

In step S201 of FIG. 2, when the power is turned on such as battery replacement, the system control circuit 118 initializes flags, control variables, and the like, and performs initialization processing (initial setting) of each unit of the image processing apparatus 100. Next, step S20
In step 2, the system control circuit 118 determines the setting position of the mode dial switch 122, and if the mode dial switch 122 is set to power off, the process proceeds to step S2.
At 13, the display of each display section is changed to the end state,
The barrier 32 is closed to protect the imaging unit S, necessary parameters including flags and control variables, setting values, and setting modes are recorded in the non-volatile memory 121, and an image including the image display unit 110 is provided by the power control unit 129. After performing a predetermined process such as shutting off unnecessary power of each unit of the processing apparatus 100, the process returns to the step S202.

If the mode dial switch 122 is set to another mode in step S202, the system control circuit 118 is set in step S203.
The power supply control unit 129 determines whether or not the remaining capacity and the operation state of the power supply 132 constituted by a battery or the like are hindering the operation of the image processing apparatus 100. And
If there is a problem, a predetermined warning is given by image or sound using the display unit 120 in step S214, and the process returns to step S202.

If there is no problem in step S203, the recording medium 200 is checked in step S204.
a, or whether the operation state of the recording medium 200b has hindered the operation of the image processing apparatus 100, particularly, the operation of recording / reproducing image data on / from the recording media 200a, 200b. And if you ’re having trouble,
After a predetermined warning is given by an image or a sound using the display unit 120 in step S214, the process returns to step S202.

If there is no problem in step S204, various setting states of the image processing apparatus 100 are displayed on the display unit 120 using images and sounds in step S205. If the image display of the image display unit 110 is on, the various setting states of the image processing apparatus 100 are displayed by the image and the sound using the image display unit 110.

Next, in step S206, the setting position of the mode dial switch 122 is determined. If the mode dial switch 122 is set to the photographing mode, a predetermined photographing process is executed in step S215, and the process proceeds to step S202. Return. The mode dial switch 12
If 2 is set to another mode, step S2
In step S16, the system control circuit 118 executes a process corresponding to the selected (set) mode, and then executes step S20.
Return to 2. Further, if the mode dial switch 122 is set to the panorama mode, the system control circuit 118 displays a panorama mode selection screen on the image display unit 110 in step S207.

The user of the image processing apparatus 100 looks at the panorama mode selection screen displayed on the image display unit 110,
An arbitrary mode can be selected from a plurality of panorama shooting modes.

The panorama photographing mode includes a 2 × 2 panorama mode, a horizontal panorama mode, a vertical panorama mode, and the like. A plurality of photographings are superimposed to form a two-dimensionally enlarged panorama image or a horizontally enlarged panorama image. Images and panoramic images enlarged in the vertical direction can be created.

[0133] Information indicating the positional relationship is added to each of a series of shot images, and the images are combined by the image processing apparatus 100 or after being transferred to a computer or the like, and then combined into one panorama. It is possible to create an image.

An example of the panorama mode selection screen is shown in FIG. In the figure, reference numeral 901 denotes an icon for selecting a 2 × 2 panoramic mode for capturing a two-dimensional panoramic image, 902 denotes an icon for selecting a horizontal panoramic mode for capturing a horizontal panoramic image, and 903 denotes a vertical panoramic image Is an icon for selecting a vertical panorama mode for shooting.

The user of the image processing apparatus 100 selects the panorama mode to be photographed with the selection / changeover switch 125 (for example, the [+] key), and determines / executes the switch 126.
The panorama mode can be determined by (for example, the [SET] key).

Returning to FIG. 2 again, the aforementioned step S207
Is completed, the type of panorama mode selected by the selection / changeover switch 125 and the decision / execution switch 126 in step S208 is determined. And 2 × 2
If the panorama mode is selected, the system control circuit 118 sets the 2 × 2 panorama mode initial setting in step S209. If the vertical panorama mode is selected, the system control circuit 118 sets the vertical panorama in step S210. If the mode initial setting is further selected and the horizontal panoramic mode is further selected, the system control circuit 118 performs horizontal panoramic mode initial setting in step S211 and sets flags, parameters, initial values of variables, memory areas, and the like. After the reading of the display screen as the user interface and the like are performed, step S212 is performed.
The panorama shooting screen corresponding to each mode is displayed on the image display unit 11.
After displaying 0, the processing shifts to the processing of FIG.

An example of the horizontal panorama mode shooting screen is shown in FIG. 10, and an example of the vertical panorama mode shooting screen is shown in FIG.
FIG. 12 shows an example of a 2 × 2 panorama mode shooting screen.

In FIG. 10, (a) is a photographing screen for creating a panoramic screen by repeating photographing continuously in the right direction;
(B) is a photographing screen in which photographing is continuously repeated in the left direction to create a panoramic screen.

In FIG. 10, one of a series of panoramic images is shown.
A through image by the electronic viewfinder is displayed in the area of “1” for the photographing of the first image, and if the photographing of the first image is not completed, the selection / changeover switch 125 (for example, the [+] key) is used to move the right image. The direction photographing (a) and the left direction photographing (b) can be switched at any time. The determination of the shooting direction is performed by pressing the shutter button in the desired display screen state of (a) or (b) to execute the first shooting.

By pressing the decision / execution switch 126 (for example, the [SET] key), the photographing in the horizontal panorama mode can be ended.

In FIG. 11, (a) is a photographing screen for continuously creating a panoramic screen by repeatedly photographing in the upward direction, and (b) is a photographing screen for continuously producing photographing in the downward direction to create a panoramic screen. This is a shooting screen.

In FIG. 11, one of a series of panoramic images is shown.
A through image by the electronic viewfinder is displayed in an area "1" for photographing the first image, and if the photographing of the first image is not completed, the selection / changeover switch 125 (for example, a [+] key) is used to move the image upward. The direction photographing screen (a) and the downward photographing screen (b) can be switched at any time. The determination of the shooting direction is performed by pressing the shutter button and executing the first shooting in the desired display screen state of the shooting screen (a) or (b).

By pressing the enter / execute switch 126 (for example, the [SET] key), shooting in the vertical panorama mode can be ended.

In FIG. 12, (a) is a first photographing screen of a photographing screen for forming a 2 × 2 panoramic screen by repeating photographing a total of four images in a two-dimensional manner, and (b) is a photographing screen. This is also the second image capturing screen.

In FIG. 12, a through image by the electronic finder is displayed, for example, in an upper right area for photographing the first panorama image.

When the photographing of the first image is completed, a reproduced image of the photographed image is displayed, for example, in the upper right area, and a through image by the electronic finder is displayed in the lower right area, for example, for the second image. Will be displayed. The shooting area by the electronic viewfinder is sequentially sent to the next area every time shooting is performed,
It is possible to start shooting from an arbitrary area, and it is also possible to return to an area where shooting has been completed and start shooting again. Therefore, the photographing area can be moved at any time by the selection / changeover switch 125 (for example, the [+] switch). The determination of the redo shooting area and the execution of shooting
In the display screen state where the desired area is selected, the photographing is performed by pressing the shutter button. By pressing the enter / execute switch 126 (for example, the [SET] key), shooting in the 2 × 2 panoramic mode can be ended.

In FIG. 3, first, in step S301, the system control circuit 118 initializes flags and variables set in its internal memory or the memory 119. For example, the panorama shooting start flag is cleared (reset), a variable n is set and initialized to n = 1 in the next step S302, and a variable m is set and initialized to m = 1 in the next step S303.

Here, the cancellation of the panorama shooting start flag indicates that no series of panorama shooting has been performed yet. The variable n indicates the number of a photographing area in each panoramic mode photographing. The variable m is used to return the photographing area to the previous frame or to cancel the return when re-imaging in the horizontal panorama mode and the vertical panorama mode. Details of how to use these flags and variables will be described later.

Next, in step S304, the set position of the mode dial switch 122 is determined, and if the set position of the mode dial switch 122 is set to another mode other than the panorama mode, the system control circuit 118 performs shooting in the panorama mode. And returns to step S202 in FIG. Thereby, the image processing apparatus 100
Can end the panorama mode at any time and switch to another mode.

If the setting position of the mode dial switch 122 has been set to the panorama mode, it is determined in step S305 whether the end of the panorama mode has been selected. Then, with the setting position of the mode dial switch 122 in the panorama mode, that is, with the display screen of the image display unit 110 being the panorama shooting screen described above, the decision / execution switch 126 (for example, [SE
If the end of the panorama mode is selected by pressing the [T] key), a confirmation of the end of the panorama mode is displayed, and it is determined in step S314 whether the end confirmation is selected. When the end confirmation is selected, the process returns to step S207 in FIG. If the end confirmation is not selected, the process returns to step S304.

If the end of the panorama mode is not selected in step S305, step S3
At 06, it is determined whether or not the selection / changeover switch 125 (for example, the [+] key) is pressed while the display screen of the image display unit 110 is in the state of each panorama shooting screen described above. And
If the selection / selection switch 125 (for example, the [+] key) has been pressed, the system control circuit 11 proceeds to step S307.
8 determines the contents of the panorama mode.

If the content of the panorama mode is the 2 × 2 panorama mode, the system control circuit 118 sets the variable n to n = n + 1 in step S308, and determines whether or not n = 5 in the next step S309. I do. And
If n = 5, in the next step S310, n = n−4 and the process returns to the first shooting area, and then the next step S311
Proceed to.

That is, each time the selection / selection switch 125 (for example, the [+] key) is pressed, the four photographing areas in the 2 × 2 panoramic mode are repeatedly moved. For example, the shooting area sequentially moves in the order of upper right, lower right, lower left, upper left, upper right, lower right,...

On the other hand, if the selection / changeover switch 125 (for example, the [+] key) is not pressed in the step S306, the steps S307 to S310 are performed.
Skip to step S311.

If the content of the panorama mode is the horizontal panorama mode or the vertical panorama mode in step S307, the state of the shooting start flag is determined in step S315. If the shooting start flag has been released, that is, if the shooting of the first image has not yet been performed in a series of panoramic shootings, the system control circuit 118 reverses the shooting direction of each panorama mode in step S316. Proceed to step S311.

If the photographing start flag has been set in step S315, that is, if the photographing of the first image has been performed in a series of panoramic photographing, the system control circuit 118 determines in step S317 that m = m × ( -1)
, +1, -1, +1,..., The sign is inverted each time, and in the next step S318, n = n + m for the variable n, and n = n-1, n = N +
After performing the operation of inverting the sign each time, that is, 1, n = n-1, n = n + 1,...

In step S309, n =
If it is not 5, skip step S310 and proceed to step S311.

In this way, in order to redo photography, it is possible to repeatedly select to move to the photographed area and to stop moving to the photographed area, although only for the last photographing. .

Thus, after the panorama shooting of the n-th image area, the selection / selection switch 125 (for example, [+]
Key) to check the connection of the boundary area between the quick review image of the (n-1) th image area and the quick review image of the nth image area, and then temporarily select / select switch 125 (for example, the [+] key) Is released (released) to make the n-th image area a through image, and then press the select / change switch 125 (for example, the [+] key) again to return the quick review image of the original n-th image area and the (n + 1) -th image area. The next panorama shooting can be performed by displaying a through image in the image area.

After the panoramic shooting of the n-th image area, the selection / selection switch 125 (for example, the [+] key)
Is pressed to check the connection of the boundary area between the quick review image in the (n-1) th image area and the quick review image in the nth image area. By releasing the 125 (for example, the [+] key) and setting the n-th image area as a through image, pressing the shutter switch 123 in this screen state replaces the image with a new one, and then performs the next panorama shooting. be able to.

In step S311, the system control circuit 1
18 selects the n-th image area, and proceeds to the next step S3
It is determined whether it is necessary to change (switch) the screen layout according to the image area selected in step 12. If it is necessary to change (switch) the screen layout according to the selected image area, the next step S3
After switching and displaying the screen layout at 13, the process proceeds to the process of FIG.

When it is not necessary to change (switch) the screen layout according to the selected image area, the process skips step S313 and shifts to the processing of FIG. As a result, a screen corresponding to the above-described reversal of the photographing direction, a screen corresponding to the change of the photographing area, a screen in which characters and images for description are updated, and the like can be displayed as necessary.

In the photographing of the second and subsequent images, the photographing region that has already been photographed is set in the quick review display state, and the next photographing region moved for the next photographing is set in the through display state. This makes it possible to partially display a reproduced image of an image that has already been captured and an image that is to be captured next. Thus, the user of the image processing apparatus 100 can easily determine the next shooting composition.

In FIG. 4, first, in step S401, the system control circuit 118 sets a through display state in which captured image data is sequentially displayed.

In the through display state, the image sensor 10
3. The data sequentially written to the image display memory 108 via the A / D converter 104, the image processing circuit 106, and the memory control circuit 107 are transferred to the memory control circuit 107 and the D
An electronic finder function is realized by sequentially displaying images in the above-described shooting area of the image display unit 110 via the / A converter 109.

In the next step S402, it is determined whether or not the first shutter switch 123 has been pressed. And
If the first shutter switch 123 has not been pressed, the process returns to step S304 in FIG. If the first shutter switch 123 has been pressed, the system control circuit 118 proceeds to step S403.
Is set to the freeze display state.

In the freeze display state, the image sensor 1
03, the rewriting of image data in the image display memory 108 via the A / D converter 104, the image processing circuit 106, and the memory control circuit 107 is prohibited, and the last written image data is stored in the memory control circuit 107, A / D conversion The frozen image is displayed on the electronic viewfinder by displaying the image in the above-described shooting area of the image display unit 110 via the image display unit 104.

Next, in step S404, the system control circuit 118 performs a distance measuring process to focus the photographing lens 101 on the subject, and performs a photometric process to determine an aperture value and a shutter time. In the photometric processing, on / off setting of the flash 117 is also performed if necessary. FIG. 5 shows the details of the distance measurement and photometry processing in step S404.
Will be described later.

After the distance measurement / photometry processing in step S404 is completed, in next step S405, the system control circuit 118 sets the display state of the image display unit 110 to the through display state. This through display state is the same operation state as the through display state in step S401.

Next, in step S406, it is determined whether or not the second shutter switch 124 has been pressed. And
If the second shutter switch 124 has not been pressed, the first shutter switch 12
It is determined whether or not 3 has been released. When the first shutter switch 123 is released, the process returns to step S406. Also, the first shutter switch 1
If 23 is not released, step S30 in FIG.
Return to 4.

In step S406, the second
If the shutter switch 124 of the image display unit 1 is pressed, the system control circuit 118 proceeds to step S407.
The display state of No. 10 is set to the fixed color display state. In this fixed color display state, instead of the captured image data written to the image display memory 108 via the image sensor 103, the A / D converter 104, the image processing circuit 106, and the memory control circuit 107, the replaced fixed color is displayed. Is displayed in the above-described photographing area of the image display unit 110 via the memory control circuit 107 and the D / A converter 109, so that a fixed color image is displayed on the electronic viewfinder.

Next, in step S 408, the system control circuit 118 sends the memory control circuit via the image sensor 103, the A / D converter 104, the image processing circuit 106 and the memory control circuit 107 or directly from the A / D converter 104. An exposure process and memory control circuit 107 for writing image data captured in the memory 111 via the memory 107, and an image processing circuit 106 as needed to read out the image data written in the memory 111 and perform various processes. Execute the shooting process to be performed. Details of this photographing process will be described later with reference to FIG.

Next, in step S 409, the system control circuit 118 reads out the image data written in the memory 111 by the photographing process in step S 408 and sends the read image data to the image display memory 10 via the memory control circuit 107.
8 to execute the display image processing. Details of the display image processing will be described later with reference to FIG.

Next, in step S410, the system control circuit 118 sets the display state of the image display section 110 to the quick review display state. In this quick review display state, the image data transferred to the image display memory 108 by the display image processing in step S409 is captured by the image display unit 110 via the memory control circuit 107 and the D / A converter 109 as described above. By displaying the image in the area, an electronic viewfinder function for automatically reproducing a captured image is realized.

Next, in step S 411, the system control circuit 118 reads out the captured image data written in the memory 111, and performs various image processing using the memory control circuit 107 and, if necessary, the image processing circuit 106. Further, a compression process for compressing an image according to the mode set using the compression / expansion circuit 112 is performed. Details of this compression processing will be described later with reference to FIG.

Next, in step S412, the interface 133 or the interface 134, the connector 13
5, or via the connector 136, a recording medium 200a, 20 such as a memory card or a compact flash card.
The recording process for writing the image data to 0b is executed.

When the image display unit 110 is on,
While writing the image data to the recording media 200a and 200b, clearly indicate that the writing operation is being performed.
For example, display such as “BUSY” is performed on the image display unit 110. Further, in the display unit 120, for example, LE
A recording medium writing operation display such as blinking of D is also performed.

Then, the system control circuit 118
Until the shutter switch 124 is released, the quick review display on the image display unit 110 is continued.
This allows the user to use the second shutter switch 124
While pressing, the photographed image can be checked carefully.

Next, in step S413, the system control circuit 118 determines whether or not the second shutter switch 124 has been released until it is released. If the second shutter switch 124 has been released, the system control circuit 118 sets (sets) a panorama shooting start flag in step S414, and the first shot has been executed in a series of panorama shootings. Make it clear. As a result, as described in step S315 in FIG. 3, it is possible to prohibit the reversal of the photographing direction after the photographing of the first horizontal panorama mode or the vertical panorama mode.

Next, in step S415, the system control circuit 118 sets the variable n to n in order to move to the next photographing area.
= N + 1, and in the next step S416, the system control circuit 118 initializes the variable m as m = 1, and then returns to step S304 in FIG. 3 to repeat a series of panorama shooting processing.

As described above, the second shutter switch 1
By releasing (release) 24, the process returns to step S304 in FIG. 3, and then moves to the next photographing region in step S311. In step S313, the photographed region including the previous photographed region is displayed in the quick review display state. In addition, by setting the next shooting area in the through display state, and displaying the captured image and the image to be captured in an overlapping manner, the user can easily perform the panoramic shooting by taking a picture. can do.

Here, FIG. 14 shows an example of the photographing screen before and after the photographing of the n-th frame in the horizontal panoramic mode. In the figure, (a) is a photographing screen in a state before photographing the first image,
(B) shows the second shutter switch 1 after the first image is taken.
24 is a photographing screen in a state where 24 is released. Although not shown, until the second shutter switch 124 is released after the photographing of the first image, the photographing area of the first image in FIG.

FIG. 15 shows an example of a photographing screen before and after the photographing of the n-th frame in the vertical panorama mode. In the figure, (a) is a photographing screen in a state before photographing the first image,
(B) shows the second shutter switch 1 after the first image is taken.
24 is a photographing screen in a state where 24 is released. Although not shown, until the second shutter switch 124 is released after the photographing of the first image, the photographing area of the first image in FIG.

Further, FIGS. 12 and 13 show examples of photographing screens before and after the photographing of the n-th frame in the 2 × 2 panoramic mode.

In FIG. 12, (a) shows a photographing screen before photographing the first image, and (b) shows a state in which the second shutter switch 124 is released after photographing the first image.
It is a photographing screen in a state before photographing the second sheet.

Although not shown, after the first image is taken, the second shutter switch 124 is released until the second shutter switch 124 is released.
The shooting area of the first image in (a) is a shooting screen in which quick review is displayed.

In FIG. 13, (a) shows a state in which the second shutter switch 124 is released after the photographing of the second image, that is, a photographing screen before the photographing of the third image.
(B) shows the second shutter switch 1 after the third image is taken.
24 is a photographing screen in a state where 24 is released, that is, a state before photographing the fourth image.

[0188] Although not shown, after the n-th photograph is taken, the second shutter switch 124 is released until the second shutter switch 124 is released.
(A) and (b) of FIG. 12 and (a) of FIG.
The (n) photographing area of the n-th photograph is a photographing screen in which the quick review is displayed. Second shutter switch 124
Is released, a through display of the next (n + 1) th image capturing area is added.

FIG. 5 is a flowchart showing a detailed operation flow of the distance measurement and photometry processing in step S404 in FIG.

First, in step S501, the system control circuit 118 reads a charge signal from the image sensor 103,
The captured image data is sequentially read into the image processing circuit 106 via the A / D converter 104. The image processing circuit 106 uses the read image data to execute TTL (through the
A predetermined calculation used for an AE (auto exposure) process, an EF (flash pre-emission) process, and an AF (auto focus) process of a lens) system is performed.

In this process, a necessary portion of the total number of photographed pixels is cut out and extracted as necessary, and used for calculation. Thus, in each of the TTL AE, EF, and AF processes, the center-weighted mode,
Optimal calculations can be performed for different modes such as the average mode and the evaluation mode.

Next, in step S502, the system control circuit 118 uses the calculation result of the image processing circuit 106 to
It is determined whether the exposure (AE) is appropriate (OK). If the AE is not appropriate, the system control circuit 118 performs AE control in step S503. Next, step S5
At 04, the system control circuit 118 uses the measurement data obtained by the AE control to determine whether or not a flash is necessary. If the flash is not required, the process returns to step S501. If the flash is required, the flash flag is set in the next step S505, the flash 117 is charged, and the process returns to step S501.

On the other hand, in step S502, the AE
If is suitable, the measurement data and / or setting parameters are stored in the internal memory of the system control circuit 118 or the memory 119. Then, in step S506, the system control circuit 118 determines whether the white balance (AWB) is appropriate (OK) using the calculation result of the image processing circuit 106 and the measurement data obtained by the AE control. . If the white balance is not appropriate, the AWB control is performed by adjusting the color processing parameters using the image processing circuit 106 in step S507, and the process returns to step S501.

On the other hand, if the white balance is appropriate in step S506, the measurement data and / or setting parameters are stored in the internal memory of the system control circuit 118 or the memory 119. Then, in step S508, the system control circuit 118 uses the measurement data obtained by the AE control and the AWB control to determine whether or not the distance measurement is in focus (OK). If the distance measurement is not in focus, AF control is performed in step S509, and the process returns to step S501. If the distance measurement is in focus at the step S508, the measurement data or the setting parameters are stored in the internal memory of the system control circuit 118 or the memory 119, and this processing operation (the processing operation of the step S404 in FIG. 4) is performed. ) To end.

FIG. 6 is a flowchart showing a detailed flow of the photographing process in step S408 of FIG.

First, in step S601, the system control circuit 118 controls the shutter 1 having the aperture function by the exposure control means 113 in accordance with the photometric data stored in the internal memory of the system control circuit 118 or the memory 119.
02 is opened in accordance with the aperture value, and the system control circuit 118 starts exposure of the image sensor 103 in the next step S602. Next, in step S603, it is determined from the flash flag whether the flash 117 is necessary. And
If the flash 117 is required, the next step S60
After the flash 117 is fired in step 4, the next step S
Proceed to 605. If the flash 117 is not required in step S603, the process proceeds to step S60.
Skip to step S605 and proceed to step S605.

In step S605, the system control circuit 118 determines whether or not the exposure of the image sensor 103 has been completed according to the photometric data until it is completed. When the exposure of the image sensor 103 is completed, the next step S
At 606, the system control circuit 118
Is closed, and in the next step S607, the system control circuit 1
18 reads out a charge signal from the image sensor 103 and
The data of the captured image is written to the memory 111 via the D converter 104, the image processing circuit 106, the memory control circuit 107, or directly from the A / D converter 104 via the memory control circuit 107. Then, when a series of processing ends, the present processing operation (the processing operation of step S408 in FIG. 4) ends.

FIG. 7 is a flowchart showing a detailed flow of the display image processing in step S409 in FIG.

First, in step S701, the system control circuit 118 determines whether or not it is necessary to perform frame processing according to the set photographing mode. If frame processing needs to be performed, the process proceeds to the next step S702.
Then, using the memory control circuit 107 and, if necessary, the image processing circuit 106, the image data written in the memory 111 is read, and the vertical addition process is performed.
After the same color processing is performed in step 703, the processed image data is written in the memory 111, and then the next step S
Proceed to 704.

On the other hand, if it is not necessary to perform frame processing in step S701, the process proceeds to step S7.
02 and step S703 are skipped, and the process proceeds to step S704.

In this step S704, the system control circuit 118 reads out image data from the memory 111,
The display image data is transferred to the image display memory 108 via the memory control circuit 107.

When a series of processing is completed, the present processing operation (the processing operation of step S409 in FIG. 4) is completed.

FIG. 8 is a flowchart showing a detailed flow of the compression processing in step S411 of FIG.

First, in step S 801, the system control circuit 118 reads out the image data written in the memory 111 by using the memory control circuit 107 and, if necessary, the image processing circuit 106. After the pixel square processing for interpolating the pixel ratio to 1: 1 is performed, the processed image data is written to the memory 111. Next, the image data written in the memory 111 in step S802 is read, and image compression processing corresponding to the setting mode is performed by the compression / decompression circuit 112. Then, the present processing operation (the processing operation in step S411 in FIG. 4) is performed. finish.

In the above embodiment, the panorama mode selectable on the panorama mode selection screen has been described as three types: 2 × 2 panorama mode, horizontal panorama mode, and vertical panorama mode, but the present invention is not limited to this. Alternatively, one or a plurality of arbitrary number of different panorama modes may be selectable.

Also, the display of the panorama mode selection screen in FIG. 9 is not limited to the one exemplified in the present embodiment, and may be performed by an arbitrary arrangement or method using images and sounds. .

Although the display on the 2 × 2 panorama mode photographing screen has been described two-dimensionally as a total of four frames, the present invention is not limited to this.
Any number of two-dimensional arrangements, such as six, or even three-dimensional arrangements are possible.

Also, in the above-described embodiment, the display on the horizontal panorama mode shooting screen and the vertical panorama mode shooting screen has been described as two continuous images. However, the present invention is not limited to this, and the present invention is not limited to this. Any number of one-dimensional arrangements such as sheets may be used.

The display of the panorama mode shooting screen in FIGS. 10 to 15 is not limited to this example.
The display may be performed by an arbitrary arrangement or method using images, sounds, characters, symbols, and the like.

In the above-described embodiment, it has been described that the reversal of the photographing direction in the horizontal panorama mode and the vertical panorama mode cannot be performed after the photographing of the first image is completed. However, the present invention is limited to this. Instead, the photographing direction may be reversed at any time. Further, the photographing direction may be changed to any direction including right and left directions, upward and downward directions, or oblique directions as needed. In the present invention, if the display area of the image display unit 110 is increased so that a large number of image display areas can be displayed simultaneously, any direction including right and left, upward and downward, or oblique direction It is also possible to change the shooting direction at any time.

[0211] In the above-described embodiment, the re-shooting in the horizontal panorama mode and the vertical panorama mode has been described up to the previous shot image. However, the present invention is not limited to this. The photographing may be performed again retroactively to the photographed image before the number of times.

In the above-described embodiment, the image display area to be photographed next is displayed as a through display, and the image display area that has been photographed is displayed as a quick review display. Although the description has been made assuming that the boundary region is partially overlapped and displayed, the present invention is not limited to this, and the boundary region may be displayed without overlapping.

In the illustrations of the respective panorama modes shown in FIGS. 10 to 15, description characters "LIVE" and "FREEZE" are added to the image display area as an example. May be displayed with or without these characters.

The recording media 200a and 200b store P
Not only memory cards such as CMCIA cards and compact flash, hard disks, etc., but also micro DATs
(Digital audio tape), magneto-optical disk, CD
-R or an optical disk such as a CD-RW, or a phase change optical disk such as a DVD.

The recording media 200a and 200b may be a composite recording medium in which a memory card and a hard disk are integrated. Further, a configuration may be adopted in which a part of the composite recording medium is detachable.

Further, in the above-described embodiment, the recording media 200a and 200b are described as being separated from the image processing apparatus 100 and can be arbitrarily connected. However, either one of the recording media or all the recording media can be used. The medium may remain fixed to the image processing apparatus 100.

Further, the recording medium 20 is stored in the image processing apparatus 100.
0a and 200b may be configured to be connectable to a single or a plurality of arbitrary numbers.

Further, in the above-described embodiment, the configuration in which the recording media 200a and 200b are mounted on the image processing apparatus 100 has been described. However, the recording media may have a single configuration or a combination of a plurality of recording media.

[0219]

As described in detail above, according to the image processing method and apparatus of the present invention, photographing applications are not limited.
An effect that convenience is high is exhibited.

Further, according to the storage medium of the present invention, there is an effect that the above-described image processing apparatus of the present invention can be smoothly controlled.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a flowchart of a main routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 3 is a flowchart of a main routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 4 is a flowchart of a main routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 5 is a flowchart of a ranging / photometry processing routine of the image processing apparatus according to the embodiment of the present invention;

FIG. 6 is a flowchart of a shooting processing routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 7 is a flowchart of a display image processing routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 8 is a flowchart of a compression processing routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 9 is an explanatory diagram of a panorama shooting mode setting screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 10 is an explanatory diagram of a horizontal panorama mode initial screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 11 is an explanatory diagram of a vertical panorama mode initial screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 12 is an explanatory diagram of a 2 × 2 panorama mode shooting screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 13 is an explanatory diagram of a 2 × 2 panorama mode shooting screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 14 is an explanatory diagram of a horizontal panorama mode shooting screen of the image processing apparatus according to one embodiment of the present invention.

FIG. 15 is an explanatory diagram of a vertical panorama mode shooting screen of the image processing apparatus according to one embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 image processing apparatus 101 photographing lens 102 shutter 103 image sensor 104 A / D converter 105 timing generation circuit 106 image processing circuit 107 memory control circuit 108 image display memory 109 D / A converter 110 image display unit 111 memory 112 compression / expansion Circuit 113 Exposure control means 114 Distance measuring means 115 Zoom control means 116 Barrier control means 117 Flash 118 System control circuit 119 Memory 120 Display unit 121 Non-volatile memory 122 Mode dial switch 123 First shutter switch 124 Second shutter switch 125 Select / switch 126 decision / execution switch 127 operation unit 128 compression mode switch 129 power supply control means 130 connector 131 connector 132 power supply 133 interface Interface (I / F) 134 interface (I / F) 135 connector 136 connector 137 protection means (barrier) 138 optical finder 139 communication means 140 connector or antenna 200a recording medium 200b recording medium 201a recording section 201b recording section 202a interface (I / F) 202b Interface (I / F) 203a Connector 203b Connector 901 Icon 902 Icon 903 Icon

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 5/225 H04N 5/781 520B

Claims (82)

[Claims] 1. An image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing step for capturing an image; and a recording / reproducing method for recording and reproducing the image captured by the image capturing step. A reproducing step; and a display step of reproducing and displaying at least an image captured before the present, wherein the displaying step includes combining a current image signal and at least a signal obtained by reproducing the image captured before the present. An image processing method comprising a plurality of display arrangement modes for superimposing and displaying section boundary areas. 2. The image processing method according to claim 1, wherein the image is a still image. 3. The image processing method according to claim 1, wherein the image is a moving image. 4. The image processing method according to claim 1, wherein the images are a still image and a moving image. 5. A plurality of display arrangement modes of the display step, the first display arrangement mode arranged in a two-dimensional direction,
5. The image processing method according to claim 1, wherein the display mode is a second display arrangement mode arranged in a one-dimensional direction. 6. The image processing method according to claim 5, wherein the second display arrangement mode is arranged in a horizontal direction. 7. The image processing method according to claim 5, wherein the second display arrangement mode is arranged in a vertical direction. 8. The image processing method according to claim 5, wherein the second display arrangement mode includes a horizontal arrangement mode arranged in a horizontal direction and a vertical arrangement mode arranged in a vertical direction. . 9. An image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing means for capturing images; and a recording / reproducing apparatus for recording and reproducing images captured by the image capturing means. Playback means; and display means for playing back and displaying at least an image taken earlier than the present time, wherein the display means displays a current image signal and at least a signal obtained by playing back an image taken earlier than the present time. An image processing apparatus comprising a plurality of display arrangement modes for superimposing and displaying section boundary areas. 10. The image processing apparatus according to claim 9, wherein the image is a still image. 11. The image processing apparatus according to claim 9, wherein the image is a moving image. 12. The image processing apparatus according to claim 9, wherein the images are a still image and a moving image. 13. A plurality of display arrangement modes of the display means, a first display arrangement mode arranged in a two-dimensional direction,
13. The image processing apparatus according to claim 9, wherein the display mode is a second display arrangement mode arranged in a one-dimensional direction. 14. The image processing apparatus according to claim 13, wherein the second display arrangement mode is arranged in a horizontal direction. 15. The image processing apparatus according to claim 13, wherein the second display arrangement mode is arranged in a vertical direction. 16. The display device according to claim 1, wherein the second display arrangement mode includes a horizontal arrangement mode arranged in a horizontal direction and a vertical arrangement mode arranged in a vertical direction.
3. The image processing device according to 3. 17. The image processing apparatus according to claim 9, wherein the image processing apparatus is an electronic camera. 18. An image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing step for capturing an image; and a recording / reproducing method for recording and reproducing the image captured by the image capturing step. Reproduction step, having a display step of reproducing and displaying at least an image taken before the present,
A display arrangement mode in which the display step displays a current imaging signal and a signal obtained by reproducing at least an image captured earlier than the current one by partially overlapping a boundary area and arranging the boundary area in a one-dimensional direction;
An image processing method having a function of reversing the arrangement direction in a one-dimensional direction. 19. The image processing method according to claim 18, wherein the image is a still image. 20. The image processing method according to claim 18, wherein the image is a moving image. 21. The image processing method according to claim 18, wherein the images are a still image and a moving image. 22. The image processing method according to claim 18, wherein the function of reversing the arrangement direction in a one-dimensional direction is prohibited after at least the first image has been photographed. 23. The display arrangement mode according to claim 18, wherein the display arrangement mode is arranged in a horizontal direction.
The image processing method described in the above. 24. The display arrangement mode according to claim 18, wherein the display arrangement mode is arranged in a vertical direction.
The image processing method described in the above. 25. The display arrangement mode according to claim 18, wherein the display arrangement mode includes a horizontal arrangement mode arranged in a horizontal direction and a vertical arrangement mode arranged in a vertical direction.
23. The image processing method according to 1 or 22. 26. An image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing means for capturing images; and a recording / reproducing apparatus for recording and reproducing images captured by the image capturing means. Reproducing means, having display means for reproducing and displaying at least an image taken before the present,
A display arrangement mode in which the display means displays a current imaging signal and at least a signal obtained by reproducing an image captured earlier than the current one by partially overlapping a boundary region and arranging in a one-dimensional direction;
An image processing apparatus having a function of reversing the arrangement direction in a one-dimensional direction. 27. The image processing apparatus according to claim 26, wherein the image is a still image. 28. The image processing apparatus according to claim 26, wherein the image is a moving image. 29. The image processing apparatus according to claim 26, wherein the images are a still image and a moving image. 30. The image processing apparatus according to claim 26, wherein the function of inverting the arrangement direction in a one-dimensional direction is prohibited after at least the first image is captured. 31. The display arrangement mode according to claim 26, wherein the display arrangement mode is arranged in a horizontal direction.
The image processing apparatus according to any one of the preceding claims. 32. The display arrangement mode according to claim 26, wherein the display arrangement mode is arranged in a vertical direction.
The image processing apparatus according to any one of the preceding claims. 33. The image processing according to claim 26, wherein the display arrangement mode includes a horizontal arrangement mode arranged in a horizontal direction and a vertical arrangement mode arranged in a vertical direction. apparatus. 34. The image processing apparatus according to claim 26, wherein the image processing apparatus is an electronic camera. 35. An image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing step for capturing an image; and a recording / reproducing method for recording and reproducing the image captured in the image capturing step. A reproduction step, a display step of reproducing and displaying at least an image taken before the present, and a one-dimensional display in which a current image signal and at least a signal obtained by reproducing the image taken before the current are partially overlapped with a boundary region. A first display arrangement mode for arranging and displaying images in a direction, and at least a signal obtained by reproducing an image taken earlier than the present and a signal obtained by reproducing an image taken earlier are partially overlapped with a boundary region in a one-dimensional direction. A switching step of switching a second display arrangement mode for arrangement and display. 36. The image processing method according to claim 35, wherein the image is a still image. 37. The image processing method according to claim 35, wherein the image is a moving image. 38. The image processing method according to claim 35, wherein the images are a still image and a moving image. 39. The display arrangement mode according to claim 35, wherein the display arrangement mode is arranged in a horizontal direction.
The image processing method described in the above. 40. The display arrangement mode according to claim 35, wherein the display arrangement mode is arranged in a vertical direction.
The image processing method described in the above. 41. The image processing according to claim 35, wherein the display arrangement mode includes a horizontal arrangement mode arranged in a horizontal direction and a vertical arrangement mode arranged in a vertical direction. Method. 42. An image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing means for capturing images; and a recording / reproducing apparatus for recording and reproducing images captured by the image capturing means. A reproducing unit, at least a display unit that reproduces and displays an image captured before the present time, and a one-dimensional image in which a current image signal and at least a signal that reproduces an image captured before the present time are partially overlapped with a boundary region. A first display arrangement mode for arranging in the direction and displaying on the display means, and at least a signal obtained by reproducing an image taken earlier than the present and a signal obtained by reproducing an image taken earlier are partially overlapped with a primary region by partially overlapping the boundary region. An image processing apparatus comprising: a switching unit that switches between a second display arrangement mode in which the image is arranged in the original direction and displayed on the display unit. 43. The image processing apparatus according to claim 42, wherein the image is a still image. 44. The image processing apparatus according to claim 42, wherein the image is a moving image. 45. The image processing apparatus according to claim 42, wherein the images are a still image and a moving image. 46. The display device according to claim 42, wherein the display arrangement mode is arranged in a horizontal direction.
The image processing apparatus according to any one of the preceding claims. 47. The display arrangement mode according to claim 42, wherein the display arrangement mode is arranged in a vertical direction.
The image processing apparatus according to any one of the preceding claims. 48. The image processing according to claim 42, wherein the display arrangement mode includes a display arrangement mode arranged in a horizontal direction and a display arrangement mode arranged in a vertical direction. apparatus. 49. The image processing apparatus according to claim 42, wherein said image processing apparatus is an electronic camera. 50. An image processing method for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing step for capturing an image; and a recording / reproducing method for recording and reproducing the image captured by the image capturing step. Reproduction step, having a display step of reproducing and displaying at least an image taken before the present,
The display step includes a display arrangement mode in which a current imaging signal and a signal obtained by reproducing at least an image captured earlier than the present are arranged and displayed in a two-dimensional direction with a partial boundary area overlapped. An image processing method comprising the step of selecting an arbitrary area from among the display areas arranged according to (1). 51. The image processing method according to claim 50, wherein the image is a still image. 52. The image processing method according to claim 50, wherein the image is a moving image. 53. The image processing method according to claim 50, wherein the images are a still image and a moving image. 54. The apparatus according to claim 49, wherein the selecting step selects a display area of a current image pickup signal.
Or the image processing method according to 52. 55. The image processing method according to claim 49, wherein the selecting step selects a display area in which a last captured image is reproduced and displayed. 56. An image processing apparatus for recording and reproducing and displaying a plurality of captured images on a recording medium, comprising: an image capturing means for capturing an image; and a recording / reproducing apparatus for recording and reproducing the image captured by the image capturing means. Reproducing means, having display means for reproducing and displaying at least an image taken before the present,
The display means includes a display arrangement mode in which a current image pickup signal and at least a signal obtained by reproducing an image taken earlier than the present time are displayed in a two-dimensional direction with a partial boundary area overlapped and displayed. An image processing apparatus comprising a selection unit for selecting an arbitrary area from among the display areas arranged according to (1). 57. The image processing apparatus according to claim 56, wherein said image is a still image. 58. An image processing apparatus according to claim 56, wherein said image is a moving image. 59. The image processing apparatus according to claim 56, wherein said images are a still image and a moving image. 60. The apparatus according to claim 55, wherein said selection means selects a display area of a current imaging signal.
Or the image processing apparatus according to 59. 61. An image processing apparatus according to claim 55, wherein said selection means selects a display area in which a last captured image is reproduced and displayed. 62. An image processing apparatus according to claim 56, wherein said image processing apparatus is an electronic camera. 63. A storage medium for storing a control program for controlling an image processing apparatus that records and reproduces and displays a plurality of captured images on a recording medium, wherein the control unit captures images, records the captured images, and A plurality of display arrangements for reproducing and displaying at least an image captured before the present and displaying the current image signal and at least a signal for reproducing the image captured before the present with a partial boundary area superimposed. A storage medium storing a control program having a control module of a step of controlling to execute a mode. 64. The storage medium according to claim 63, wherein said image is a still image. 65. The storage medium according to claim 63, wherein said image is a moving image. 66. The storage medium according to claim 63, wherein said images are still images and moving images. 67. The storage medium according to claim 63, wherein said image processing device is an electronic camera. 68. A storage medium for storing a control program for controlling an image processing apparatus that records and reproduces and displays a plurality of captured images on a recording medium, wherein the storage medium captures an image, and stores and records the captured image. Playback, at least an image taken before the present time is played back and displayed, and a current image signal and at least a signal obtained by playing back the image taken before the current time are arranged in a one-dimensional direction with a partial boundary area overlapped. A storage medium storing a control program having a control module of a step of controlling so as to execute a display arrangement mode for performing display and a function of inverting an arrangement direction in a one-dimensional direction. 69. The storage medium according to claim 68, wherein said image is a still image. 70. The storage medium according to claim 68, wherein said image is a moving image. 71. The storage medium according to claim 68, wherein said images are still images and moving images. 72. The storage medium according to claim 68, wherein said image processing device is an electronic camera. 73. A storage medium for storing a control program for controlling an image processing apparatus for recording and reproducing and displaying a plurality of captured images on a storage medium, wherein the storage medium captures an image, and stores and records the captured image. Playback, at least an image taken before the present time is played back and displayed, and a current image signal and at least a signal obtained by playing back the image taken before the current time are arranged in a one-dimensional direction with a partial boundary area overlapped. The first to display
Display arrangement mode and a second display in which at least a signal obtained by reproducing an image taken before the present and a signal obtained by reproducing an image taken earlier are partially arranged in a one-dimensional direction with a partial boundary area overlapped and displayed. A storage medium storing a control program having a control module of a step of controlling to switch an arrangement mode. 74. The storage medium according to claim 73, wherein said image is a still image. 75. The storage medium according to claim 73, wherein said image is a moving image. 76. The storage medium according to claim 73, wherein said images are still images and moving images. 77. The storage medium according to claim 73, wherein said image processing device is an electronic camera. 78. A storage medium for storing a control program for controlling an image processing apparatus that records and reproduces and displays a plurality of captured images on a recording medium, wherein the control unit captures images, records the captured images, and Reproducing, reproducing and displaying at least the image captured before the present, and arranging the current imaging signal and at least the signal reproducing the image captured before the present at least partially in the boundary region in the two-dimensional direction. A storage medium storing a control program having a control module for controlling to select an arbitrary area from among the display areas arranged in a display arrangement mode for displaying images. 79. The storage medium according to claim 78, wherein said image is a still image. 80. The storage medium according to claim 78, wherein said image is a moving image. 81. The storage medium according to claim 78, wherein said images are still images and moving images. 82. The storage medium according to claim 78, wherein said image processing device is an electronic camera.