JP2000115669A - Image processor, control method for image processor and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor, capable of making a person conducting image pickup recognize to the effect that photographing is performed in a state in which a recording medium is not mounted. SOLUTION: When an image display means for displaying picked-up images is turned into a non-display state, based on the state of a detachable recording medium for recording the picked-up images (S160, S162, S164 and S166), a display part issues an alarm. Thus, a person conducting image pickup can recognizes that the recording medium is not mounted and image pickup is prevented from being conducted in a state in which the recording medium is not mounted.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus for capturing, recording, and reproducing still images and moving images, a control method for the image processing apparatus, and a storage medium.

[0002]

2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera for recording and reproducing a still image and a moving image has already been marketed as a removable recording medium having a memory card having a solid-state memory element. Electronic cameras equipped with an electronic finder are also on sale.

According to these electronic cameras, it is possible for the user of the electronic camera to continuously determine the composition by continuously displaying images before shooting, and to reproduce and display the shot images for confirmation. .

[0004] In particular, the function of reproducing a photographed image immediately after photographing is highly convenient and is a useful function for a user of an electronic camera.

Further, by effectively using an electronic finder,
An electronic camera having a function of assisting a panoramic shooting composed of a plurality of images by partially overlapping a plurality of shot images on an electronic viewfinder has also appeared.

[0006]

In such a conventional image processing apparatus such as an electronic camera, a photographing operation without a recording medium mounted is often prohibited. Since the button does not operate even if the button is pressed, it is necessary to prepare a recording medium even if the operation of the automatic focusing mechanism is simply checked, which is inconvenient.

On the other hand, there is an image processing apparatus which permits a photographing operation in a state where a recording medium is not mounted. In this case, photographing may be performed without noticing that a recording medium is not mounted. It was a fatal problem. In particular, if a photographing operation is permitted without displaying an image on a display device such as a color liquid crystal panel, there is no difference in the warning method as compared with photographing when a recording medium is mounted, which is problematic. Was.

Further, even when an image is displayed on an electronic finder such as a color liquid crystal panel, image data is developed in order to display a plurality of images on the electronic finder in a panoramic shooting composed of a plurality of images. However, it is not economical to use an extra memory device, and it is difficult to clearly notify that recording is not possible in order to secure a space for displaying an image on the display unit.

On the other hand, when the recording medium is mounted, there is no free space on the recording medium, the name of the next image to be shot cannot be given, or the recording medium is logically destroyed and cannot be recorded. In this case, it is necessary to notify the user of the details of the reason why the recording cannot be performed.

[0010] Accordingly, an object of the present invention is to enable a photographer to recognize that shooting has been performed in a state in which a recording medium is not mounted, and to perform simulated imaging even when a recording medium is not mounted. It is an object of the present invention to provide an image processing apparatus, a control method for the image processing apparatus, and a storage medium that enable the above.

[0011]

An image processing apparatus according to the present invention is provided with a detachable recording medium for recording an image when an image display means for displaying an image is in a non-display state. A first warning is issued when the status is determined to be inappropriate for recording.

In one embodiment of the image processing apparatus according to the present invention, a second warning is issued based on the state of the recording medium when the image display means is activated and brought into a display state. .

[0013] In one embodiment of the image processing apparatus of the present invention, the state of the recording medium may be a state in which the recording medium is not mounted, a state in which the recording medium has insufficient recording capacity, or a state in which the recording medium is insufficient. A state where the name of the image to be captured cannot be generated, a state where the recording medium is logically destroyed, a state where the recording medium is physically destroyed,
The format of the recording medium is different from a predetermined format.

In one embodiment of the image processing apparatus according to the present invention, recording is prohibited when the recording medium is not mounted.

In one embodiment of the image processing apparatus according to the present invention, there is provided an operating means which is operated at the time of image capturing and is operated in two stages before an image capturing operation instruction, and it is determined that the state of the recording medium is not suitable for recording. In this case, a third warning is issued when the operation means is operated up to one stage.

In one embodiment of the image processing apparatus according to the present invention, when the operation means is operated up to two steps in a state where the recording medium is not mounted, the image is displayed on the image display means. While displaying the image
A fourth warning is issued.

In one embodiment of the image processing apparatus according to the present invention, the first warning is issued in conjunction with turning on the power.

In one embodiment of the image processing apparatus according to the present invention, the first warning is displayed or sounded on a display unit other than the image display means.

In one embodiment of the image processing apparatus according to the present invention, one of the second, third and fourth warnings is displayed on the image display means.

In one embodiment of the image processing apparatus according to the present invention, a special photographing mode is set in which an image to be photographed is displayed adjacently while updating the image to be photographed. If the recording medium is not mounted, a special photographing mode is set. 5 warning is issued.

In one embodiment of the image processing apparatus according to the present invention, the image processing apparatus includes communication means for communicating with an external device, and is restricted by the state of the recording medium while communication with the external device is established. The transfer of the image displayed on the image display means or the transfer of the picked-up image is performed without recording the image on the external device.

The control method of the image processing apparatus according to the present invention includes an imaging step, and when the image display means for displaying the image is in a non-display state, the state of the removable recording medium for recording the captured image is changed. The first warning is issued when it is determined that the recording is inappropriate.

According to the control method of the image processing apparatus of the present invention, when the image display means is activated and brought into a display state, a second warning is issued based on the state of the recording medium.

In one embodiment of the control method of the image processing apparatus according to the present invention, the state of the recording medium includes a state in which the recording medium is not mounted, a state in which the recording medium has insufficient recording capacity, and a state in which the recording A state in which a name of an image to be captured on a medium cannot be generated, a state in which the recording medium is logically destroyed, a state in which the recording medium is physically destroyed, and a format of the recording medium is a predetermined format And one of different states.

In one embodiment of the control method of the image processing apparatus according to the present invention, recording is prohibited when the recording medium is not mounted.

In one embodiment of the control method of the image processing apparatus according to the present invention, there is provided an operation means which is operated at the time of imaging and is operated in two stages before an imaging operation instruction is issued, and the state of the recording medium is inappropriate for recording. In this state, a third warning is issued when the operation means is operated up to one stage.

In one embodiment of the control method of the image processing apparatus according to the present invention, when the operation means is operated up to two stages in a state where the recording medium is not mounted, the image is displayed on the image display means. Is displayed, and a fourth warning is issued.

In one embodiment of the control method of the image processing apparatus according to the present invention, the first warning is issued in conjunction with turning on the power.

In one embodiment of the control method of the image processing apparatus according to the present invention, the first warning is displayed or sounded on a display unit other than the image display means.

In one embodiment of the control method of the image processing apparatus according to the present invention, one of the second, third and fourth warnings is displayed on the image display means.

In one embodiment of the control method of the image processing apparatus according to the present invention, a special photographing mode in which an image to be photographed is displayed adjacently while updating the image to be photographed is set, and when the recording medium is not mounted, Issues a fifth warning.

In one embodiment of the control method of the image processing apparatus according to the present invention, there is provided communication means for communicating with an external device, and while the communication with the external device is established, the state of the recording medium is maintained. The image displayed on the image display means is transferred or the captured image is transferred without being restricted, and the image is recorded in the external device.

A storage medium according to the present invention is a computer-readable storage medium storing a program for executing the procedure of the control method of the image processing apparatus.

[0034]

According to the above-mentioned means, in the state where the recording medium is not mounted and the display means is not activated, the uniform photographing operation is prohibited, so that the photographing can be performed without noticing that the recording medium is not mounted. The problem of going away can be solved.

Further, even when the recording medium is not loaded,
Provided is an image processing apparatus and a control method for the image processing apparatus that, when the display unit is activated, allow the user to experience the operation from the photographing preparation operation to the photographing operation immediately before the recording operation and clearly notify the user that the recording was not performed. It is possible to do.

Further, in the special photographing mode, it is not necessary to mount the image storage means required more than the general photographing, so that it is possible to provide a compact and inexpensive image processing apparatus and a control method of the image processing apparatus. Become.

Further, when a recording medium is mounted, a warning is issued in accordance with the state of the recording medium to clearly indicate the difference from the case where the recording medium is not mounted.
The user's feeling of use can be improved and confusion can be avoided.

In an image processing apparatus capable of communicating with an external device, photographing can be performed during a period in which communication with the external device is established irrespective of the presence and / or state of a recording medium. Can be done.

[0039]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of one embodiment of the present invention.

In FIG. 1, reference numeral 100 denotes an image processing device. Reference numeral 14 denotes an image sensor that converts an optical image into an electric signal.
Is an A / D converter for converting an analog signal output of the image sensor 14 into a digital signal.

Reference numeral 18 denotes an image pickup device 14, an A / D converter 1.
6, a timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

Reference numeral 20 denotes an image processing circuit which performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22. In the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and the system control circuit 50 controls the exposure control means 40 and the distance measurement control means 42 based on the obtained arithmetic results. TTL (through-the-lens) AF (autofocus) processing, AE
(Automatic exposure) processing and EF (flash pre-emission) processing are performed. Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

Reference numeral 22 denotes a memory control circuit, which includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The data of the A / D converter 16 for controlling the compression / decompression circuit 32 is transmitted through the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is transmitted directly through the memory control circuit 22. Image display memory 24 or memory 3
Written to 0.

Reference numeral 24 denotes an image display memory; 26, a D / A converter; and 28, an image display section comprising a TFT LCD or the like. The display image data written in the image display memory 24 is a D / A converter 26. Is displayed by the image display unit 28 via the. The electronic viewfinder function can be realized by sequentially displaying the captured image data using the image display unit 28. The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the image processing apparatus 100 is significantly reduced. You can do it.

Reference numeral 30 denotes a memory for storing photographed still images and moving images, which has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. Thus, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

32 is an adaptive discrete cosine transform (ADCT)
A compression / decompression circuit for compressing / decompressing image data by, for example, reading an image stored in the memory 30 and performing compression or decompression processing, and storing the processed data in the memory 3
Write to 0.

Reference numeral 48 denotes a flash, which also has a function of projecting AF auxiliary light and a function of controlling flash light. Exposure control means 4
0, the distance measurement control means 42 is controlled by using the TTL method, and the system control circuit 50 controls the exposure control means 40 and the distance measurement control means 42 based on the calculation result obtained by calculating the captured image data by the image processing circuit 20. Is controlled.

Reference numeral 50 denotes a system control circuit for controlling the entire image processing apparatus 100, and reference numeral 52 denotes a memory for storing constants, variables, programs, and the like for operating the system control circuit 50.

Reference numeral 54 denotes a display unit such as a liquid crystal display, a speaker, or the like which displays an operating state or a message using characters, images, sounds, or the like in accordance with the execution of a program by the system control circuit 50. A single or a plurality of such devices are installed at easily visible positions near the operation unit of the device 100, and are configured by, for example, a combination of LCDs, LEDs, sound-generating elements, and the like. The display unit 54 has a part of its functions installed in the optical viewfinder 104.

Among the display contents of the display unit 54, those displayed on the LCD or the like include, for example, a single shot / snapshot display, a self-timer display, a compression ratio display, a display of the number of recording pixels, a display of the number of recordings, and a remaining photographing operation Number display, shutter speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, buzzer setting display, battery remaining battery display, battery remaining display, error display, multi-digit number display There are an information display, a detachable state display of the recording media 200 and 210, a detachable state display of the lens unit 300, a communication 1 / F operation display, a date / time display, a display indicating a connection state with an external computer, and the like. Also, among the display contents of the display unit 54, the optical finder 1
Examples of the information displayed in the display area 04 include an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, a shutter speed display, an aperture value display, an exposure correction display, and a recording medium writing operation display. , Etc.

Further, among the display contents of the display unit 54, LE
Examples of the display on D and the like include an in-focus display, a shooting ready display, a camera shake warning display, a flash charge display,
Flash charging completion display, recording medium writing operation display,
There are a macro shooting setting notification display, a secondary battery charging state display, and the like.

Among the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp
It may be used in common with the F auxiliary light.

Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.

Reference numerals 60, 62, 64, 66, 68, 70, and 72 denote operation means for inputting various operation instructions of the system control circuit 50, such as switches and dials, a touch panel, pointing by gaze detection, and voice recognition. It is composed of a single device or a combination of a plurality of devices.

Here, these operation means will be specifically described. Reference numeral 60 denotes a mode dial switch for turning off the power,
Each function mode such as an automatic shooting mode, a shooting mode, a panoramic shooting mode, a playback mode, a multi-screen playback / erase mode, and a PC connection mode can be switched and set.

Reference numeral 62 denotes a shutter switch SW1, which is turned on during the operation of a shutter button (not shown),
(Auto focus) processing, AE (auto exposure) processing, A
It instructs to start operations such as WB (auto white balance) processing and EF (flash pre-emission) processing.

Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed, and transfers a signal read from the image sensor 12 to the memory 30 via the A / D converter 16 and the memory control circuit 22. Exposure processing for writing, development processing using arithmetic operations in the image processing circuit 20 and the memory control circuit 22, reading image data from the memory 30, performing compression in the compression / decompression circuit 32, and writing the image data in the recording medium 200 or 210 It instructs to start the operation of a series of processing called recording processing.

Reference numeral 66 denotes an image display ON / OFF switch.
ON / OFF of the image display unit 28 can be set. With this function, it is possible to save power by cutting off the current supply to an image display unit such as a TFT LCD when taking a picture using the optical viewfinder 104.

Reference numeral 68 denotes a quick review ON / OFF switch for setting a quick review function for automatically reproducing image data immediately after photographing. In this embodiment, particularly, a quick review function when the image display unit 28 is turned off is set. A function to set the review function shall be provided.

An operation unit 70 includes various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback change button, a flash setting button, a single-shot / quick-shot / self-timer switching button,
Menu move + (plus) button, menu move-(minus) button, playback image move + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, panorama mode Selection / switch button for setting selection and switching of various functions when executing shooting and playback of a photo, etc., and determination / execution button for setting and execution of various functions when executing shooting and playback of a panorama mode and the like There is.

Reference numeral 72 denotes a compression mode switch, which is used to select a compression rate of JPEG compression, or a CCDRA for digitizing a signal of an image pickup device as it is and recording it on a recording medium.
This is a switch for selecting the W mode. As the JPEG compression mode, for example, a normal mode and a fine mode are prepared.

In the JPEG compression mode, the image data read from the image sensor 14 and written in the memory 30 via the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 is read and compressed. .Expansion circuit 32
After performing compression to the compression ratio set by
Recording is performed at 0 or 210.

In the CCD RAW mode, image data is read out line by line in accordance with the pixel arrangement of the color filter of the image sensor 14 and written to the memory 30 via the A / D converter 16 and the memory control circuit 22. The read image data is read and recorded on the recording medium 200 or 210.

Reference numeral 80 denotes a power supply control means, a battery detection circuit, D
It comprises a C-DC converter, a switch circuit for switching a block to be energized, and the like, and detects the presence or absence of a battery, the type of battery, the remaining battery level, and performs DC based on the detection result and an instruction from the system control circuit 50. Control the DC converter to supply a required voltage to each unit including the recording medium for a required period.

Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply means including a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.

Reference numerals 90 and 94 denote an interface with a recording medium such as a memory card or a hard disk, reference numerals 92 and 96 denote connectors for connecting to a recording medium such as a memory card or a hard disk, and reference numeral 98 denotes a recording medium 200 or 210 on the connector 92 and / or 96 Is a recording medium attachment / detachment detection unit for detecting whether or not the recording medium is attached.

In this embodiment, the description has been made assuming that there are two interfaces and connectors for attaching a recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or plural number of systems. In addition, a configuration may be adopted in which interfaces and connectors of different standards are provided in combination. Further, as the interface and the connector, those conforming to standards such as a PCMCLA card and a CF (compact flash) card may be used.

Further, the interfaces 90 and 94 and the connectors 92 and 96 are connected to a PCMCIA card or CF.
(Compact flash) When using a card conforming to the standard such as a card, a LAN card, a modem card, a USB card, an IEEE1394 card, a P128
By connecting various communication cards such as a 4-card, a SCSI card, a communication card such as a PHS, and the like, image data and management information attached to the image data are transferred to and from other peripheral devices such as a computer and a printer. I can do it.

Reference numeral 104 denotes an optical finder, which enables photographing using only the optical finder without using the electronic finder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, such as a point display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, and an exposure correction display, are provided.

Reference numeral 110 denotes communication means, such as RS232C or US
B, IEEE1394, P1284, have various communication functions such as SCSI, modem, LAN, wireless communication, etc.

Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna for wireless communication.

Reference numeral 120 denotes an interface for connecting the image processing apparatus 100 to the lens unit 300 in the lens mount 106, and 122 denotes the image processing apparatus 10
Reference numeral 124 denotes a connector for electrically connecting the lens unit 300 to the lens unit 300, and reference numeral 124 denotes a lens attachment / detachment detecting unit for detecting whether or not the lens unit 300 is attached to the lens mount 106 and / or the connector 122. Connector 122
Has a function of transmitting a control signal, a status signal, a data signal, and the like in response to a question between the image processing apparatus 100 and the lens unit 300, and a function of supplying currents of various voltages. Further, the connector 122 may be configured to transmit not only electric communication but also optical communication, voice communication, and the like.

Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory or a magnetic disk, an interface 204 with the image processing apparatus 100, and the image processing apparatus 1
00 is provided with a connector 206 for making a connection.

Reference numeral 210 denotes a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including a semiconductor memory and a magnetic disk, an interface 214 with the image processing apparatus 100, and the image processing apparatus 1
00 and a connector 216 for making connection with the 00.

Reference numeral 300 denotes an interchangeable lens type lens unit. Reference numeral 306 denotes a lens mount that mechanically couples the lens unit 300 with the image processing apparatus 100.
The lens mount 306 includes various functions for electrically connecting the lens unit 300 to the image processing apparatus 100.

Reference numeral 310 denotes a photographing lens, and reference numeral 312 denotes a shutter having an aperture function. 320 is the lens mount 3
In the interface 06, an interface 322 for connecting the lens unit 300 to the image processing apparatus 100 is a connector for electrically connecting the lens unit 300 to the image processing apparatus 100. The connector 322 transmits a control signal, a status signal, a data signal, and the like between the image processing apparatus 100 and the lens unit 300, and has a function of supplying or supplying current of various voltages. Also,
The connector 322 may be configured to transmit not only electrical communication but also optical communication, voice communication, and the like.

Reference numeral 340 denotes a shutter 31 having an aperture function.
Exposure control means for controlling the flash unit 2 and having a flash dimming function in cooperation with the flash 48.

Reference numeral 342 denotes distance measuring control means for controlling focusing of the photographing lens 310, and 344 denotes a distance measuring means.
Is a zoom control means for controlling zooming.

Reference numeral 350 denotes a lens system control circuit for controlling the entire lens unit 300. The lens system control circuit 350 includes a memory that stores operation constants, variables, programs, and the like, identification information such as a number unique to the lens unit 300, management information, function information such as an open aperture value and a minimum aperture value, and a focal length. It also has a function of a non-volatile memory for holding current and past set values.

FIGS. 2 and 3 show a flowchart of a main routine of the image processing apparatus 100 according to the present embodiment. The operation of the image processing apparatus 100 will be described with reference to FIGS.

When the power is turned on such as when the battery is replaced, the system control circuit 50 initializes flags and control variables (S10).
1) Initially, the image display on the image display unit 28 is set to the OFF state (S102).

The system control circuit 50 determines the set position of the mode dial 60, and the mode dial 60
If it is set to FF (S103), the display of each display unit is changed to the end state, the barrier of the protection unit 102 is closed to protect the imaging unit, and necessary parameters and settings including flags and control variables are set. Non-volatile memory 56
After performing predetermined termination processing such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power supply control unit 80 (S105), the process returns to S103.

If the mode dial 60 has been set to the photographing mode (S103), the process proceeds to S106.

If the mode dial 60 has been set to another mode (S103), the system control circuit 5
0 executes a process according to the selected mode (S10
4) When the processing is completed, the process returns to S103.

The power supply control means 8
0, it is determined whether or not the remaining capacity of the power supply 86 composed of a battery or the like or the operating condition has a problem in the operation of the image processing apparatus 100 (S106). After a predetermined constant voltage warning is issued by voice (S107), the process returns to S103.

If there is no problem in the power supply 86 (S10
6), the system control circuit 50 controls the recording medium 200 or 2
It is determined whether the operation state 10 has a problem in the operation of the image processing apparatus 100, particularly, the operation of recording and reproducing image data on a recording medium (S108).
9) After a predetermined warning is given by image or sound using the display unit 54, the state at this time is stored in the internal memory of the system control circuit 50 or the memory 52 (S110),
Go to 111.

Here, the recording medium inspection will be described with reference to FIG. The state of the recording medium includes: 1. Recording medium does not exist or is physically destroyed 2. There is no storage capacity of the recording medium. 3. The name of the next image to be recorded on the recording medium cannot be generated. The recording medium is logically destroyed or has a different format.

When the stored state of the recording medium does not exist or is physically destroyed (S160), the card status is set to "1" (S161). If a recording medium exists and there is no storage capacity (S162), the card status is set to "2" (S163).
If the name of the next image to be recorded on the recording medium cannot be generated (S164), the card status is set to "3" (S165). Further, when the recording medium is logically destroyed or has a different format (S16
In 6), the card status is set to "4" (S1).
67) If not, the card status is set to "0" as a normal recording medium (S168) and the process returns.

In the present embodiment, as a warning display to be displayed on the LCD of the display contents of the display unit 54, the character "Card" blinks in cases other than the above 2, and the numeral "0" is lit in the case of the above 2. ing. Of course, each state may be represented by a separate character, mark, number, or combination according to the number of LCD segments.

After the operation of the recording medium 200 or 210 has been confirmed (S109), various setting states of the image processing apparatus 100 are displayed on the display unit 54 using images and sounds (S11).
1). If the image display of the image display unit 28 is ON, various setting states of the image processing apparatus 100 are displayed by the image display unit 28 using the image and the sound.

The system control circuit 50 checks the setting state of the quick review ON / OFF switch 68 (S11).
2) If the quick review is set to ON, the quick review flag is set (S113), and if the quick review is set to OFF, the quick review flag is released (S114). The status of the quick review flag is stored in the internal memory of the system control circuit 50 or the memory 52.

Subsequently, the system control circuit 50 checks the setting state of the image display ON / OFF switch 66 (S11).
5) If the image display is set to ON, the image display flag is set (S116), and the image display unit 28 is set.
Is set to the ON state (S117), and the through display state for sequentially displaying the captured image data is set (S118). Here, if the state of the recording medium stored in S110 is not normal, a warning is displayed when an image can be output (S119). The detailed operation of this warning display will be described later. When the image is displayed, the process proceeds to S129.

In the through display state, the image sensor 1
2, the data sequentially written to the image display memory 24 via the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 are transferred to the memory control circuit 22, the D / A converter 26
The electronic finder function is realized by sequentially displaying the image on the image display unit 28 via the.

If the image display ON / OFF switch 66 is set to image display OFF (S115), the image display flag is cleared (S120), and the image display of the image display unit 28 is set to OFF. (S121),
Proceed to S129.

In the case of image display 0FF, the image display unit 28
The photographing is performed using the optical viewfinder 104 without using the electronic viewfinder function. In this case, it is possible to reduce the power consumption of the image display unit 28 and the D / A converter 26 that consume a large amount of power. The state of the image display flag is stored in the internal memory of the system control circuit 50 or the memory 52.

Here, the details of the warning display operation in S119 will be described with reference to FIG. When the stored state of the recording medium does not exist or is physically destroyed (S
In step 170), the display character is set to “NoCard” (S171). If there is a recording medium and no storage capacity (S172), the display character is changed to "Not
"Available" (S173). Also,
If the name of the next image to be recorded on the recording medium cannot be generated (S174), the display character is changed to “Naming”.
Error ”(S175). Further, if the recording medium is logically destroyed or has a different format (S176), the display character is changed to "Card".
NG "(S177). If none of them is satisfied, the process returns to a normal recording medium. If any abnormality is detected, the image block for which a warning is displayed is cleared and the fixed color is set. Is embedded (S178), and a warning is displayed thereon according to the display character (S17).
9), go back. Note that the warning display may be displayed over the image. Further, the warning display may be any of letters, numbers, or marks, or a combination thereof.

In FIG. 3, the shutter switch SW1
If is not pressed (S129), the process returns to S103. If the shutter switch SW1 is pressed, ぱ (S1
29) The system control circuit 50 first determines whether or not the camera is in the special shooting mode (S130). If the shooting mode is not the special shooting mode, the image display flag stored in the internal memory or the memory 52 of the system control circuit 50 is determined. Is determined (S131). If the image display flag is set, the card status is checked (S134), and the card status is "0" (card is normal) or "1" (card does not exist). In the case of ()), the display state of the image display unit 28 is set to the freeze display state (S132), and S1
Proceed to 36. If the card status is neither "0" nor "1" (S134), the sound element in the display unit 54 is sounded (S133), and the process returns to S103. If the image display flag is not set (S131). ), The card status is checked. If the card status is not "0" (S132), the sounding element in the display unit 54 is sounded (S133), and the process returns to S103. Further, even in the special shooting mode, it is checked whether or not the card status is "0", and if the card status is not "0", the sounding element in the display unit 54 is sounded (S133).
It returns to S103. In the freeze display state, rewriting of image data in the image display memory 24 via the imaging device 12, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 is prohibited, and the last written image data Is displayed on the image display unit 28 via the memory control circuit 22 and the D / A converter 26, so that the frozen image is displayed on the electronic finder.

The system control circuit 50 performs a distance measuring process to focus the photographing lens 10 on the subject, and performs a photometric process to determine an aperture value and a shutter time (S13).
6). In the photometric processing, flash setting is also performed if necessary. The details of the distance measurement / photometry processing S136 will be described later with reference to FIG.

When the distance measurement / photometry processing S136 is completed,
The system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S137). If the image display flag has been set, the display state of the image display unit 28 is skipped. The display state is set (S138), and the process proceeds to S139. S13
The through display state at 8 is the same operation state as the through state at S118. Of course, the displayed image includes S11
The display character determined in 9 is displayed simultaneously with the image. Subsequently, when displaying the through image, the card status is checked again. If the card status is "1" (S139), the image display unit 28
Then, a display character different from the display character determined in S119 is added and displayed (S140).

If the shutter switch SW2 is not pressed (S141) and the shutter switch SW1 is also released (S142), the process returns to S103.

If the shutter switch SW2 is pressed (S141), the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S143). Is set, the display state of the image display unit 28 is set to the fixed color display state (S144), and the process proceeds to S145.

In the fixed color display state, the image sensor 1
2. Instead of the captured image data written to the image display memory 24 via the A / D converter 16, the image processing circuit 20, and the memory control circuit 22, the replaced fixed color image data is replaced with the memory control circuit 22, By displaying the image on the image display unit 28 via the D / A converter 26, a fixed color image is displayed on the electronic viewfinder.

If the image display flag has been released (S143), the process proceeds to S145. System control circuit 50
Denotes an image sensor 12, an A / D converter 16, an image processing circuit 2
0, an exposure process for writing photographed image data in the memory 30 via the memory control circuit 22 or directly from the A / D converter via the memory control circuit 22, and the memory control circuit 22 and, if necessary, the image processing. By using the processing circuit 20, the image data written in the memory 30 is read out, and a photographing process including a developing process for performing various processes is executed (S145). Details of the photographing process S145 will be described later with reference to FIG.

The system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S146), and if the image display flag has been set, performs a quick review display. (S149). In this case, the image display unit 28 is always displayed as an electronic finder even during shooting, and a quick review display immediately after shooting is also performed.

If the image display flag has been released (S146), the state of the quick review flag stored in the internal memory of the system control circuit 50 or the memory 52 is determined (S147), and the quick review flag is set. Then, turn on the image display of the image display unit 28
The state is set (S148), and a quick review display is performed (S149). Note that the warning content set in S140 is similarly displayed in the quick review display in S149.

It is determined whether the mode is the continuous shooting mode (S150),
In the case of the continuous shooting mode, it is determined whether or not the switch SW2 is kept pressed (S151).
Return to step 5 and shoot. Whether SW2 has been released due to continuous shooting (S151), and if not continuous shooting (S150)
It moves to S152.

The system control circuit 50 reads out the photographed image data written in the memory 30 and performs various image processing using the memory control circuit 22 and the image processing circuit 20 as necessary. After performing the image compression process according to the mode set by using, the recording process of writing the image data to the recording medium 200 or 210 is executed (S152).

The details of the recording process S152 will be described with reference to FIG. First, the card status is checked. If the card is normal (S400), the system control circuit 5
0 denotes a pixel square processing for reading out the captured image data written in the memory 30 and interpolating the vertical and horizontal pixel ratio of the image sensor to 1: 1 using the memory control circuit 22 and the image processing circuit 20 as necessary. After performing (S401), the processed image data is written in the memory 30. And
The image data written in the memory 30 is read out, and the image compression processing according to the set mode is performed by the compression / decompression circuit 3.
2 (S402), and then writes the compressed image data to the recording medium 200 or 210 via the interface 90 or 94 and the connector 92 or 96 (S403).

If no card is present (S4
00), the sounding element in the display unit 54 is sounded to give a warning. (S404) When the writing to the recording medium is completed, the recording processing routine S152 ends.

As described above, the recording medium 200 or 21
According to the state of 0 and the state of the image display unit 28, permission / prohibition of photographing is determined, and the detailed state of the recording medium 200 or 210 is displayed on the image display unit 28. L in the display unit 54
Since the number of segments in a CD is limited, the state of the recording medium cannot be clearly shown to the user, but can be known by displaying it on the image display unit 28. In addition, even if there is no recording medium, it is possible to determine whether to permit or prohibit photographing in a state where the state of the recording medium is displayed on the image display unit 28. If the photographing is permitted, a warning is emphasized with SW1, and When a review image is displayed, an emphasized warning for re-recognition is issued, and a warning buzzer is sounded. Therefore, even if images are shot with the same shooting operation feeling, the possibility of misunderstanding that the images have been recorded is drastically reduced.

If the shutter switch SW2 is depressed when the recording process S152 is completed (S153), the state is maintained, and if the shutter switch SW2 is released. (S
154) After a predetermined minimum review time has elapsed, the process proceeds to S155.

The minimum review time may be a fixed value, may be arbitrarily set by the user, or may be arbitrarily set or selected by the user within a predetermined range. , May be set by any method.

If the image display flag has been set (S155), the system control circuit 50 displays the image
Is set to the through display state (S156),
Proceed to S158.

In this case, after the photographed image is confirmed by the quick review display on the image display unit 28, a through display state in which image data photographed for the next photographing is sequentially displayed can be provided.

If the image display flag has been cleared (S155), the image display of the image display unit 28 is set to the OFF state (S157), and the flow proceeds to S158.

In this case, after the captured image is confirmed by the quick review display on the image display unit 28, the function of the image display unit 28 is stopped to save power, and the image display unit 28 and the D The power consumption of the / A converter 26 and the like can be reduced.

If the shutter switch SW1 has been pressed (S158), the system control circuit 50
Returns to step S139 to prepare for the next shooting.

If the shutter switch SW1 has been released (S158), the system control circuit 50
Ends the series of shooting operations, and returns to S103.

FIG. 6 is a detailed flowchart of the distance measurement / photometry processing in S136 of FIG. The system control circuit 50 reads the charge signal from the image sensor 14 and
The captured image data is sequentially read into the image processing circuit 20 via the D converter 16 (S201). Using the sequentially read image data, the image processing circuit 20 performs TTL (through-the-lens) AE (auto exposure) processing, EF
Predetermined calculations used for (flash pre-emission) processing and AF (auto focus) processing are performed.

In each process, a specific portion of the total number of photographed pixels, which is necessary, is cut out and extracted for a necessary portion, and used in the calculation. Thus, in each of the TTL-type AE, EF, AWB, and AF processes, it is possible to perform an optimal calculation for each of the different modes such as the center-weighted mode, the average mode, and the evaluation mode.

Using the calculation result in the image processing circuit 20,
The system control circuit 50 performs AE control using the exposure control means 40 (S203) until the exposure (AE) is determined to be appropriate (S202).

Using the measurement data obtained by the AE control,
The system control circuit 50 determines whether or not a flash is necessary (S204), and if necessary, sets a flash flag and charges the flash 48 (S20).
5).

If it is determined that the exposure (AE) is appropriate (S
202), the measurement data and / or the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52.

The system control circuit 5 uses the calculation results of the image processing circuit 20 and the measurement data obtained by the AE control.
0 indicates that the AWB control is performed by adjusting the color processing parameters using the image processing circuit 20 until the white balance (AWB) is determined to be appropriate (S206) (S207).

If it is determined that the white balance (AWB) is appropriate (S206), the measurement data and / or the set parameters are stored in the internal memory of the system control circuit 50 or the memory 52.

Using the measurement data obtained by the AE control and the AWB control, the system control circuit 50 executes the distance measurement control unit 42 until the distance measurement (AF) is determined to be in focus (S208).
Is used to perform AF control (S209).

If it is determined that the distance measurement (AF) is in focus (S
208), the measurement data and / or the setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50, and the distance measurement / photometry processing routine S122 ends.

FIG. 7 is a detailed flowchart of the photographing process in S145 of FIG. System control circuit 50
Is the internal memory of the system control circuit 50 or the memory 5
In accordance with the photometric data stored in Step 2, the exposure control means 40 opens the shutter 12 having the aperture function according to the aperture value to expose the image sensor 10 (S301, S3).
02).

Flash 48 is performed by the flash flag.
Is determined (S303), and if necessary, a flash is emitted (S304).

The system control circuit 50 waits for the end of exposure of the image sensor 12 in accordance with the photometric data (S305), closes the shutter 12 (S306), reads out a charge signal from the image sensor 14, reads the charge signal from the A / D converter 16, Processing circuit 2
0, the memory 30 via the memory control circuit 22 or directly from the A / D converter 16 via the memory control circuit 22.
Then, the data of the photographed image is written in (S307).

If frame processing needs to be performed in accordance with the set photographing mode (S308), the system control circuit 50 uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to store the data in the memory 30. The image data written in is read and the vertical addition processing (S309) is performed.
After the color processing (S310) is sequentially performed, the processed image data is written in the memory 30.

The system control circuit 50 reads out the image data from the memory 30, and transfers the display image data to the image display memory 24 via the memory control circuit 22 (S3).
11).

When a series of processing is completed, the photographing processing routine S129 ends.

As described above, according to the present embodiment, the recording operation is uniformly prohibited in a state where the recording media 200 and 210 are not mounted and the display means is not activated. It is possible to solve the problem that photographing is performed without noticing that the media 200 and 210 are not mounted. Also, the recording media 200, 210
An image processing apparatus and an image processing apparatus which, when the display means is activated even when the camera is not mounted, allow the user to experience from the shooting preparation operation to the shooting operation immediately before the recording operation and clearly notify the user that the recording was not performed. It is possible to provide a device control method. Therefore, it is possible to know the shooting sensation that the shutter is released without installing the recording medium at the store, and it is also possible to prevent the recording medium from being stolen.

Further, in the special photographing mode, it is not necessary to mount the image storing means required more than the general photographing, so that it is possible to provide a compact and inexpensive image processing apparatus and an image processing apparatus control method. .

Further, when the recording media 200, 210 are mounted, a warning is issued according to the state of the recording media 200, 210, so that the recording media 200, 210
It is possible to clearly indicate the difference from the case where 0 is not attached, improve the user's feeling of use, and avoid confusion.

In an image processing apparatus capable of communicating with an external device, the presence / absence of recording media 200 and 210,
Alternatively, regardless of the state, it is possible to enable imaging during a period when communication with the external device is established.

In the description of the embodiment, the warning is performed by displaying the display contents of the image display unit 28 and the display unit 54 on the LCD and sounding the sound element in the display unit 54. Communication means 1 instead of section 28
10 can also be realized by wired or wireless transfer to an image processing device or an image display device provided with an external communication means. The transfer form is not particularly limited, such as image data or image signals, audio signals or audio data.

For example, the output of the D / A converter 26 is connected to a video amplifier, converted into a terminated video signal, and displayed on an external monitor via a connector or a jack. Alternatively, interfaces 90 and 94 and connector 92
And 96 are configured using a standard such as a PCMCIA card or a CF (Compact Flash) card, and a LAN card, a modem card, a USB card, an IE,
By connecting various communication cards such as EE1394 card, P1284 card, SCSl card, PHS and other communication cards, it communicates with peripheral devices such as other computers and printers, and manages image data and management information attached to the image data. Alternatively, it can be realized by transferring voice data.

When the image processing apparatus is remotely controlled by an external device, if the external device has a recording medium, it does not depend on the state of the recording medium of the image processing device.
Further, it is also possible to transfer an image in accordance with a live image transfer command and / or a photographing command or a photographed image transfer command of the external device regardless of the format of the recording medium of the external device. For example, by setting a flag indicating whether external communication is established or not, and adding a condition that this flag is not set to the warning condition described with reference to FIGS. Transfer, photographing, and photographed image transfer.

The recording media 200 and 210 are PCM
Not only memory cards such as C1A cards and compact flashes, hard disks and the like, but also micro DATs, magneto-optical disks, optical disks such as CD-Rs and CD-WRs,
Of course, there is no problem even if it is constituted by a phase change optical disk such as a DVD.

There is no problem if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Further, there is no problem if a part of the composite medium is detachable.

In the description of the embodiment, the recording media 200 and 210 are described as being separated from the image processing apparatus 100 and can be arbitrarily connected. However, any one of the recording media is fixed to the image processing apparatus 100. Of course, there is no problem even if it remains.

Further, the recording medium 20 is stored in the image processing apparatus 100.
0 or 210 may be configured to be connectable to a single or a plurality of arbitrary numbers.

The recording medium 2 is stored in the image processing apparatus 100.
The configuration in which the recording mediums 00 and 210 are mounted has been described. However, the recording medium may have any combination of a single recording medium or a plurality of recording media.

The present invention may be applied to a system constituted by a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.) or to an apparatus constituted by one device.

[0147] Further, in order to realize the functions of the above-described embodiments, a device connected to the above-mentioned various devices or a computer in a system is operated so as to operate various devices so as to realize the functions of the above-described embodiments. The present invention also includes programs implemented by supplying the program code of the software described above and operating the various devices according to programs stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the program code of the software implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer are provided.
For example, a storage medium storing such a program code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM,
A magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the OS (operating system) or other operating system running on the computer. Needless to say, even when the functions of the above-described embodiments are realized in cooperation with application software or the like, such program codes are included in the embodiments of the present invention.

Further, after the supplied program code is stored in the memory provided on the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. It is needless to say that the present invention also includes a case where the CPU or the like provided in the first embodiment performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0151]

According to the present invention, in a state where the recording medium is not mounted and the display means is not activated, a warning is issued, so that photographing is performed without noticing that the recording medium is not mounted. Problem can be solved.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a part of a main routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 3 is a flowchart illustrating a part of a main routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 4 is a flowchart illustrating a recording medium inspection of the image processing apparatus according to the embodiment of the present invention.

FIG. 5 is a flowchart illustrating a warning selection of the image processing apparatus according to the embodiment of the present invention.

FIG. 6 is a flowchart illustrating a distance measurement and photometry routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 7 is a flowchart illustrating a shooting routine of the image processing apparatus according to the embodiment of the present invention.

FIG. 8 is a flowchart illustrating a recording routine of the image processing apparatus according to the embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 14 Image sensor 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display unit 30 Memory 32 Image compression / decompression circuit 48 Flash 50 System control circuit 52 Memory 54 Display unit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1 64 Shutter switch SW2 66 Image display ON / OFF switch 68 Quick review ON / OFF switch 70 Operation unit 80 Power control unit 82 Connector 84 Connector 86 Power supply unit 90 Interface 92 connector 94 interface 96 connector 98 recording medium attachment / detachment detection means 100 image processing device 104 optical finder 106 lens mount 110 communication means 112 connector (Or antenna) 120 interface 122 connector 124 lens attachment / detachment detecting means 200 recording medium 202 recording unit 204 interface 206 connector 210 recording medium 212 recording unit 214 interface 216 connector 300 lens unit 306 lens mount 310 photographing lens 312 shutter 320 interface 322 connector 340 exposure Control means 342 Distance measurement control means 344 Zoom control means 350 Lens system control circuit

Claims (23)

[Claims] An image display means for displaying an image in a non-display state; and a state in which a removable recording medium for recording the image is determined to be inappropriate for recording. An image processing apparatus, wherein a first warning is issued. 2. The image according to claim 1, wherein a second warning is issued based on a state of the recording medium when the image display unit is activated and brought into a display state. Processing equipment. 3. The state of the recording medium is a state where the recording medium is not mounted, a state where the recording medium of the recording medium is insufficient, and a name of an image captured on the recording medium cannot be generated. A state in which the recording medium is logically destroyed, a state in which the recording medium is physically destroyed, or a state in which the format of the recording medium is different from a predetermined format. The image processing device according to claim 1. 4. The image processing apparatus according to claim 3, wherein recording is prohibited when the recording medium is not mounted. 5. An operation unit which is operated at the time of imaging and is operated in two stages before an imaging operation instruction, and when the state of the recording medium is determined to be inappropriate for recording, the operation unit is operated up to one stage. The image processing apparatus according to claim 1, wherein a third warning is issued when operated. 6. In a state where the recording medium is not mounted, an image is taken when the operation means is operated up to two stages, and the taken image is displayed on the image display means, and a fourth warning is displayed. 6. The image processing apparatus according to claim 5, wherein the image processing apparatus generates 7. The image processing apparatus according to claim 1, wherein the first warning is issued in synchronization with power-on. 8. The image processing apparatus according to claim 1, wherein the first warning is displayed or sounded on a display unit other than the image display unit. 9. The image processing apparatus according to claim 1, wherein one of the second, third, and fourth warnings is displayed on the image display unit. . 10. A special shooting mode in which an image to be picked up is displayed adjacently while being updated, and a fifth warning is issued when the recording medium is not mounted. Claims 1 to 9 characterized by the above-mentioned.
The image processing device according to any one of claims 1 to 4. 11. An image displayed on the image display means without being restricted by the state of the recording medium, while having communication means for communicating with an external device, while communication with the external device is established. The image processing apparatus according to any one of claims 1 to 10, wherein the image processing apparatus transfers an image or a captured image, and records the image in the external device. 12. When a state of a removable recording medium for recording a captured image is determined to be unsuitable for recording when the image display means for displaying an image is in a non-display state and includes an imaging step. A first warning is issued to the image processing apparatus. 13. The image according to claim 12, wherein a second warning is issued based on a state of the recording medium when the image display unit is activated and brought into a display state. A method for controlling a processing device. 14. The state of the recording medium may be a state where the recording medium is not mounted, a state where the recording capacity of the recording medium is insufficient, or a name of an image captured on the recording medium cannot be generated. A state in which the recording medium is logically destroyed, a state in which the recording medium is physically destroyed, or a state in which the format of the recording medium is different from a predetermined format. A method for controlling an image processing apparatus according to claim 12. 15. The method according to claim 14, wherein recording is prohibited when the recording medium is not loaded. 16. An operation unit which is operated at the time of imaging and which is operated in two stages before an imaging operation instruction, and in a state where the state of the recording medium is determined to be inappropriate for recording, the operation unit is operated up to one stage. The method according to any one of claims 12 to 15, wherein a third warning is issued when operated. 17. In a state where the recording medium is not mounted, an image is taken when the operation means is operated up to two stages, and the image display means displays the taken image and a fourth warning. 17. The method according to claim 16, wherein the method is performed. 18. The system according to claim 12, wherein said first warning is issued in conjunction with power-on.
The control method of the image processing device according to any one of the above. 19. The control method according to claim 12, wherein the first warning is displayed or sounded on a display unit other than the image display unit. 20. The image processing apparatus according to claim 12, wherein one of the second, third, and fourth warnings is displayed on the image display unit. Control method. 21. A special shooting mode in which an image to be picked up is displayed adjacently while being updated, and a fifth warning is issued when the recording medium is not mounted. Claims 12 to 20
The control method of the image processing device according to any one of the above. 22. A communication device for communicating with an external device, wherein an image displayed on the image display device is not restricted by a state of the recording medium while communication with the external device is established. 22. The control method of an image processing apparatus according to claim 12, wherein transfer of the image data or transfer of a captured image is performed, and the image is recorded in the external device. 23. A computer-readable storage medium on which a program for executing the procedure of the control method according to claim 12 is recorded.