JP2003274366A - Image processor, image processing method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an excellent feeling of use to a user by performing reproduction and display without rotational display when a moving picture is reproduced and automatically performing rotational display when a still picture is reproduced. <P>SOLUTION: When an image is photographed, the attitude in the image photography is detected by a camera attitude detection part 106. It is decided whether the image is photographed as a still picture and when it is determined that the image is photographed as the still picture, the image is rotated according to the detection result of the camera attitude detection part 106 to reproduce the rotated image on an image display part 28. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, an image processing method, a program and a recording medium for capturing, recording and reproducing a still image or a moving image, and particularly, hinders a user's favorable usability. An image processing apparatus, an image processing method, and an image processing method capable of executing image processing according to the posture at the time of image capturing so as not to
The present invention relates to a program and a recording medium.

[0002]

2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera for recording and reproducing a still image or a moving image using a memory card having a solid-state memory element as a recording medium is already on the market.
Electronic cameras equipped with an electronic viewfinder such as a color liquid crystal panel are also on sale. According to these electronic cameras,
It is possible for the user of the electronic camera to determine the composition by continuously displaying the images before shooting, and to reproduce and display the taken images for confirmation.

In particular, the function of reproducing a photographed image immediately after photographing is highly convenient and is a useful function for the user of the electronic camera. In addition, an electronic camera, etc., which is equipped with a posture detection sensor, determines the posture of the camera, and changes the range of distance measurement and photometry according to the posture of the camera, is commercially available. According to Japanese Patent Laid-Open No. 2000-312329,
It is disclosed that the posture of a camera is recorded together with a photographed image, and the image is rotated and reproduced according to the posture of the camera at the time of photographing.

[0004]

In such a conventional image processing apparatus such as an electronic camera, when the camera is rotated to take an image, all the images taken at the time of reproduction are automatically rotated and displayed. . However, the rotation display requires more processing time than the normal display. Therefore, when the camera has low capability, for example, when a rotating display of a moving image is performed, it is not possible to smoothly reproduce and display. Therefore, when reproducing a moving image, there has been a demand to smoothly reproduce and display the image without rotating the image.

The present invention has been made in view of the above-mentioned problems, and when reproducing a moving image, the reproducing display is performed without performing the rotating display, and when the still image is reproduced, the rotating display is automatically performed. An object of the present invention is to provide an image processing device, an image processing method, a program, and a recording medium that can secure a good usability for the user.

[0006]

In order to achieve such an object, an image processing apparatus according to a first aspect of the present invention includes a photographing means for photographing an image and a posture for detecting a posture related to the photographing of the image. A detecting means; a judging means for judging whether the image is photographed as a still image by the photographing means; and a posture detecting means of the posture detecting means when the judging means judges that the image is photographed as a still image. Rotation processing means for performing rotation processing of the image based on the detection result, and reproduction means for reproducing the image rotation-processed by the rotation processing means on the display means.

The image processing method according to the second aspect of the present invention includes a photographing step of photographing an image with photographing means,
A posture detecting step of detecting a posture related to the image capturing by the posture detecting means, a determining step of determining by the determining means whether the image is captured as a still image by the capturing means, and the determining means. When it is determined that the image was captured as a still image, a rotation processing step of executing rotation processing of the image on the rotation processing means based on the detection result of the posture detection means, and rotation processing by the rotation processing means. A reproducing step of reproducing the reproduced image on the display means.

The program according to the third aspect of the present invention includes a photographing step of photographing an image with a photographing means, a posture detecting step of detecting a posture related to the photographing of the image by a posture detecting means, and A determination step of determining in the determination means whether or not the image has been captured as a still image by the image capturing means; and a detection of the posture detection means when the determination means determines that the image has been captured as a still image. A computer is made to perform a rotation processing step of performing rotation processing of the image on the rotation processing means based on the result, and a reproduction step of reproducing the image rotated by the rotation processing means on the display means. Characterize.

Further, the recording medium according to the fourth aspect of the present invention includes a photographing step of photographing an image by means of a photographing means, and a posture detecting step of detecting a posture related to the photographing of the image by the posture detecting means. A determination step of determining whether the image is captured as a still image by the image capturing means, and a determination step of determining whether the image is captured as a still image when the determination means determines that the image is captured as a still image. In order to cause the computer to execute a rotation processing step in which rotation processing means performs rotation processing of the image based on the detection result and a reproduction step in which the image rotation processed by the rotation processing means is reproduced on the display means. The program is recorded.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<First Embodiment> FIG. 1 shows first and second embodiments.
It is a diagram showing a configuration of an image processing apparatus according to the embodiment. In FIG. 1, 100 is an image processing apparatus. 10
Is a photographing lens, 12 is a shutter having an aperture function, 1
Reference numeral 4 is an image pickup device for converting an optical image into an electric signal, and 16 is an A / D converter for converting an analog signal output of the image pickup device 14 into a digital signal.

Reference numeral 18 denotes an image pickup device 14, an A / D converter 16,
A timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50. An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22.

Further, in the image processing circuit 20, a predetermined arithmetic processing is performed using the imaged image data, and the system control circuit 50 controls the exposure control means 40 and the distance measurement control means 42 based on the obtained arithmetic result. TTL to control
(Through the lens) AF (auto focus)
Processing, AE (automatic exposure) processing, and EF (flash pre-flash) processing are performed. Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

A memory control circuit 22 includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The compression / expansion circuit 32 is controlled. The data of the A / D converter 16 is passed through the image processing circuit 20 and the memory control circuit 22, or the data of the A / D converter 16 is passed directly through the memory control circuit 22, and the image display memory 24 or the memory 3 is displayed.
Written to zero.

Reference numeral 24 is an image display memory, 26 is a D / A converter, and 28 is an image display section composed of a TFT LCD or the like. The image data for display written in the image display memory 24 is D
The image is displayed on the image display unit 28 via the / A converter 26. The electronic viewfinder function can be realized by sequentially displaying the captured image data using the image display unit 28.

Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50, and when the display is turned off, the image processing apparatus 100 is turned on.
It is possible to significantly reduce power consumption. Reference numeral 30 is a memory for storing still images and moving images taken,
It has a storage capacity sufficient to store a predetermined number of still images and a moving image for a predetermined time. This makes it possible to write a large amount of images in the memory 30 at high speed even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot.

The memory 30 is a system control circuit 50.
It can also be used as a work area. Reference numeral 32 denotes a compression / expansion circuit that compresses / expands image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 30 and performs compression processing or expansion processing, and stores the processed data in the memory 30. Write in.

Reference numeral 40 denotes an exposure control means for controlling the shutter 12 having a diaphragm function, which also has a flash light control function in cooperation with the flash 48.
Reference numeral 42 is a distance measurement control means for controlling the focusing of the taking lens 10, 44 is a zoom control means for controlling the zooming of the taking lens 10, and 46 is a protection means 102 which is a barrier.
It is a barrier control means for controlling the operation of. Reference numeral 48 denotes a flash, which also has an AF auxiliary light projection function and a flash light control function.

The exposure control means 40 and the distance measurement control means 42 are TT
It is controlled using the L method, and based on the calculation result of the captured image data calculated by the image processing circuit 20,
The system control circuit 50 controls the exposure control means 40 and the distance measurement control means 42. 50 is an image processing apparatus 100
A system control circuit that controls the entire system, and 52 is a memory that stores constants, variables, programs and the like for operating the system control circuit 50.

Reference numeral 54 is a display unit such as a liquid crystal display device and a speaker for displaying operating states and messages using characters, images, voices, etc. according to the execution of the program in the system control circuit 50. A single or a plurality of places are installed near the operation unit of 100 in an easily visible position.
It is composed of a combination of LCDs, LEDs, and sound elements. Further, the display unit 54 has some of its functions installed in the optical finder 104.

Of the display contents of the display section 54, what is displayed on the LCD or the like includes a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining number of recordable images. Display, shutter speed display, aperture value display, exposure compensation display, flash display, red-eye reduction display, macro shooting display, buzzer setting display,
Battery remaining amount display for clocks, battery remaining amount display, error display, information display with multiple digit numbers, attachment / detachment state display of recording media 200 and 210, communication I / F operation display, date / time display,
Etc.

Of the display contents of the display unit 54, what is displayed in the optical viewfinder 104 include focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, etc. There is.

Reference numeral 56 is an electrically erasable / recordable non-volatile memory, for example, an EEPROM or the like is used. 60, 6
2, 64, 66, 68 and 70 are system control circuits 5
0 is an operation means for inputting various operation instructions,
It is composed of a switch, a dial, a touch panel, a pointing by visual line detection, a voice recognition device, or the like, or a combination thereof. Here, a specific description of these operating means will be given.

Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, playback mode, multi-screen playback / erasure mode, and PC connection mode. Reference numeral 62 denotes a shutter switch SW1, which is turned on during the operation of a shutter button (not shown) to perform AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash) processing, etc. Instruct to start operation.

Reference numeral 64 is a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed, and the image sensor 1
2 is an exposure process for writing image data to the memory 30 via the A / D converter 16 and the memory control circuit 22, a development process using calculation in the image processing circuit 20 and the memory control circuit 22, and a memory 30. The image data is read from the storage medium 200, compressed by the compression / expansion circuit 32, and stored in the recording medium 200.
Alternatively, an instruction to start the operation of a series of processes, which is a recording process for writing the image data, is issued to 210. 66 is image display ON / OFF
The switch can be used to set ON / OFF of the image display unit 28.

With this function, the optical viewfinder 104
It is possible to save power by shutting off the current supply to the image display unit composed of a TFT LCD or the like when shooting is performed using the.

Reference numeral 68 denotes a quick review ON / OFF switch for setting a quick review function for automatically reproducing image data taken immediately after shooting. It should be noted that the present embodiment is particularly provided with a function of setting the quick review function when the image display unit 28 is turned off.

Reference numeral 70 denotes an operation unit including various buttons and a touch panel, which includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, and menu movement + There are (plus) button, menu move- (minus) button, playback image move + (plus) button, playback image- (minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, and the like.

Reference numeral 80 denotes a power supply control means, which is a battery detection circuit, DC
-It is composed of a DC converter, a switch circuit that switches the blocks to be energized, and the like, detects whether or not a battery is installed, the type of battery, and the remaining battery level, and based on the detection result and the instruction from the system control circuit 50, the DC- It controls the DC converter and supplies the required voltage to each unit including the recording medium for the required period.

Reference numeral 82 is a connector, 84 is a connector, 86 is a primary battery such as an alkaline battery or a lithium battery, a NiCd battery,
It is a power source that consists of a secondary battery such as NiMH battery and Li battery, and an AC adapter. Reference numerals 90 and 94 are interfaces with recording media such as memory cards and hard disks, 92 and 96 are connectors for connecting with recording media such as memory cards and hard disks, and 98 is connectors 92 and or 96.
It is a recording medium attachment / detachment detecting means for detecting whether or not the recording medium 200 or 210 is attached.

The present embodiment has been described as having two systems of the interface and the connector for attaching the recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or plural number of systems. Further, the interface and the connector of different standards may be combined and provided. As the interface and the connector, those conforming to the standard such as PCMCIA card and CF (Compact Flash (R)) card may be used.

Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured by using those conforming to the standards such as PCMCIA card and CF (Compact Flash (R)) card, LAN card, modem card, USB
Card, IEEE1394 card, P1284 card, SCSI card, P
By connecting communication cards such as HS and other communication cards, image data and management information attached to the image data can be transferred to and from other computers and peripheral devices such as printers.

Reference numeral 102 denotes the lens 1 of the image processing apparatus 100.
By covering the image pickup unit including 0, the protective unit is a barrier that prevents the image pickup unit from being soiled or damaged. Reference numeral 104 denotes an optical viewfinder, which allows shooting using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, such as focus display, camera shake warning display, flash charge display,
A shutter speed display, aperture value display, exposure compensation display, etc. are installed.

Reference numeral 106 denotes a camera posture detection unit which detects the posture state of the image processing apparatus 100, that is, the state of the orientation of the image pickup surface of the image pickup device 14 provided in this apparatus. A gravity sensor, for example, is used as the sensor for detecting the posture state. 110 is a communication means, such as RS232C, USB, IEE
It has various communication functions such as E1394, P1284, SCSI, modem, LAN, and wireless communication. Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna in the case of wireless communication. Reference numeral 200 is a recording medium such as a memory card or a hard disk.

The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, etc., and the image processing apparatus 1.
An interface 204 with the image processing apparatus 100 and a connector 206 for connecting with the image processing apparatus 100. 210 is a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including a semiconductor memory or a magnetic disk, an interface 214 with the image processing apparatus 100, and a connector 216 for connecting to the image processing apparatus 100.

FIG. 2 is a rear view of the image processing apparatus according to this embodiment. Reference numeral 63 is a shutter switch, which is a member for instructing a shooting operation. When the shutter switch 63 is pressed halfway down, the 62 shutter switch SW1 turns on, and when it is pressed all the way down, the 64 shutter switch SW2 turns on. Reference numeral 100 is an image processing device, and 28 is an image display unit including a TFT LCD or the like, which displays a captured image and also displays an icon or the like representing camera information. The information displayed includes the posture of the camera, the compression rate, the size, the exposure correction value, the white balance, the distance measuring method, the photometric method, and the like. Reference numeral 70-a is a reproduction image move + (plus) button, and 70-b is a reproduction image move- (minus) button, which is a member for selecting an image to be reproduced and displayed.

Next, the operation of the image processing apparatus according to the first embodiment will be described with reference to FIGS. 3 and 4 show flowcharts of the main routine of the image processing apparatus 100 of this embodiment. The operation of the image processing apparatus 100 will be described with reference to FIGS. 3 and 4.

Upon power-on such as battery replacement, the system control circuit 50 initializes flags and control variables (S10).
1), the image display of the image display unit 28 is initially set to the OFF state (S102). The system control circuit 50 determines the setting position of the mode dial 60, and if the mode dial 60 is set to power off (S103), changes the display of each display unit to the end state and the barrier of the protection means 102. Is closed to protect the image pickup unit, necessary parameters including a flag and control variable, setting values, and setting modes are recorded in the non-volatile memory 56, and the power supply control unit 80 controls the image display unit 28.
After performing a predetermined termination process such as cutting off unnecessary power of each part of the image processing apparatus 100 including S (S104), the process returns to S103. If the mode dial 60 is set to the shooting mode (S103), the process proceeds to S105.

The system control circuit 50 turns the image display ON / OFF.
The setting state of the switch 66 is checked (S105), and if the image display is set to ON, the image display flag is set (S06), and the image display of the image display unit 28 is set to ON state (S107). Furthermore, the through display state in which the captured image data is sequentially displayed is set (S109), the camera posture is detected (S109), the state of the detected posture is displayed as an icon (S110), and the process proceeds to S113. Camera posture detection processing (S109)
10 will be described later with reference to FIG. 10, and the processing for displaying the camera posture icon (S110) will be described later with reference to FIG.

In the through display state, the image pickup device 1
2. The data sequentially written in the image display memory 24 via the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 is converted into the memory control circuit 22 and the D / A converter 26.
The electronic viewfinder function is realized by sequentially displaying the image on the image display unit 28 via the.

The image display ON / OFF switch 66 displays the image display OF.
If it is set to F (S105), the image display flag is canceled (S111), and the image display of the image display unit 28 is performed.
Set to the OFF state (S112), and proceed to S113. Image display OF
In the case of F, the electronic viewfinder function of the image display unit 28 is not used, and the optical viewfinder 104 is used for shooting. In this case, it is possible to reduce the power consumption of the image display unit 28, the D / A converter 26, and the like that consume a large amount of power. The state of the image display flag is stored in the internal memory of the system control circuit 50 or the memory 52.

If the shutter switch 63 is not pressed (S
113), and returns to S105. If the shutter switch 63 is pressed (S113), the current camera posture is detected (S114). The camera attitude detection process (S109) will be described later with reference to FIG.

After detecting the camera posture (S114), the system control circuit 50 performs a photographing process (S115) and a compression process (S116). Since the photographing process and the compression process are widely known, they will not be described here. After compression (S116), the camera orientation detected in S114 is associated with the captured image captured / compressed in S115, 6 (S117), and the camera orientation and captured image are recorded in a recording medium (S118). After the camera posture and the photographed image are associated with each other and the camera posture and the photographed image are recorded on the recording medium (S118), the process returns to S103.

FIG. 7 shows an example of a format recorded on the recording medium. Add a tag to the captured image, and in the tag,
An area for recording attitude information is provided. For example, in the Exif format, the Orientation tag is prepared as an area for recording orientation information.

If the mode dial is the reproduction mode in S103, the process proceeds to S201. Image display of the image display unit 28
Set it to the ON state (S201). Then the system control circuit 50
Acquires the final shooting number Nmax of the image data recorded on the recording medium 200 or 210 (S202). The final shooting number Nmax is read from the recording medium 200 or 210 via the connector 92 or 96 and the interface 90 or 94, and is stored in the internal memory of the system control circuit 50 or the memory.
Stored in 52.

Subsequently, the system control circuit 50 sets the reproduced image number N to N = Nmax (S203), and proceeds to S204. In addition,
The reproduced image number N is stored in the internal memory of the system control circuit 50 or the memory 52. In S204, the image data corresponding to the reproduced image number N is recorded on the recording medium 200 or 210.
Read from the memory 30 and stored in the memory 30. At this time, the flag indicating the camera posture is also read and stored in the internal memory of the system control circuit 50 or the memory 52.

Subsequently, the system control circuit 50 determines whether the image to be reproduced is a moving image or a still image (S205), and if it is a moving image, S2.
Go to step 11, and if it is a still image, go to step S206. The determination as to whether the image to be reproduced is a still image or a moving image is made, for example, by the extension of the file name. If the extension is “.jpg”, it is determined to be a still image, and if the extension is “.avi”, it is determined to be a moving image.

If it is determined in S205 that the image is a still image, the image compression / expansion circuit 32 performs image expansion processing for expanding the image data read in S204 (S206). The expanded image data is written in the memory 30. Next, S204
The posture state is determined from the posture information read in (S207), and image rotation processing (S208) is performed based on the determined posture. The rotated image data is written in the memory 30.

Subsequently, the system control circuit 50 converts the image data subjected to the rotation processing in S208 into display format data,
The converted image data is transferred to the image display memory 24 via the memory control circuit 22 (S209). Next, the image display memory 24
Display data transferred to the memory control circuit 2
2. Display on the image display unit 28 via the D / A converter 26 (S21
0).

FIG. 6 shows an example of an image displayed after the rotation process. FIG. 6A is a display example in which an image captured by rotating the camera by 0 ° or 180 ° with respect to the vertical direction of the camera is reproduced and displayed. FIG. 6B is a display example in which an image captured by rotating the camera by 90 ° or 270 ° with respect to the vertical direction of the camera is reproduced and displayed. Of FIG.
In (b), the margins are painted black. Even when the camera is rotated to take an image, the user can be given a good feeling of use by automatically switching the display of the captured image in the vertical direction and switching the display magnification associated with the image rotation processing. After displaying the image (S210), the system control circuit 50 proceeds to S215.

On the other hand, if it is determined in S205 that the image is a moving image, the process proceeds to S211. The system control circuit 50 expands one frame of the moving image (S211), converts the expanded image into a display format image (S212), and displays the image converted into the display format on the image display unit 28. S211, S212, and S213 are the same processes as S206, S209, and S210 described in the still image process, respectively.

When the expansion for one frame is completed, it is judged whether or not the next frame exists (S214). If the next frame exists, the process returns to S211 to expand / display the next frame. . On the other hand, if there is no next frame, that is, if the expansion display of the final frame is completed, the process proceeds to S215. As described above, when the moving image is reproduced and displayed, the rotation process is not performed.

Subsequently, the system control circuit 50 determines whether or not the reproduced image move + button 70-a is pressed (S215),
If it is pressed, read the next shooting number and press (S
218), and returns to S204. On the other hand, in S215 move playback image +
If 70-a is not pressed, move playback image-button 70
It is determined whether -b has been pressed (S216), and if it has been pressed, the previous shooting number is read (S219) and the process returns to S204. On the other hand, if the playback image move-button 70-b is not pressed in S216, the state of the mode dial is determined (S217),
If it is in the reproduction mode, the process returns to S215, and if it is not the reproduction mode, the process returns to S103. Processing to read the next shooting number (S21
The process 8) and the process (S219) of reading the previous shooting number will be described later with reference to FIG.

FIG. 5- (a) shows a detailed flow chart of the photographing number reading process after one in S218 of FIG. The system control circuit 50 determines whether the reproduced image number N is Nmax (S301), and if it is Nmax,
The playback image number N is set to "N = 1" (S302), the shooting number of the first shot image is selected, and the process ends. On the other hand, S301
If the reproduced image number N is not Nmax, the reproduced image number N is set to "N = N + 1" (S303), the next reproduced image number is selected, and the process ends.

FIG. 5- (b) is a detailed flowchart of the immediately preceding shooting number reading process in S219 of FIG. The system control circuit 50 determines whether or not the reproduction image number N is 1 (S304). If it is 1, the reproduction image number N is set to “N = Nmax” (S305), and The last photographing number is selected and the process ends. On the other hand, in S301,
If the playback image number N is not 1, the playback image number N
Is set to "N = N-1" (S306), the previous reproduction image number is selected, and the process is terminated.

FIG. 10 shows a detailed flowchart of the posture detection processing in S109 and S114 of FIG. The system control circuit 50 determines whether the posture detected by the posture detection unit 106 is −45 ° or more and less than 45 ° with respect to the vertical direction (S50
1) If the camera posture is −45 ° or more and less than 45 ° with respect to the vertical direction, the posture flag is set to 0 (S502). On the other hand, S
If the camera attitude at 501 is not less than -45 ° and less than 45 ° with respect to the vertical direction, proceed to S503. Next, when the camera posture is 45 ° or more and less than 135 ° with respect to the vertical direction, the posture flag is set to 90 (S504). On the other hand, in S503, when the camera attitude is not 45 ° or more and less than 135 ° with respect to the vertical direction, the process proceeds to S505. When the camera attitude is 135 ° or more and less than 225 ° with respect to the vertical direction, the attitude flag is set to 180.
Is set (S180). On the other hand, when the camera posture is not 135 ° or more and less than 225 ° with respect to the vertical direction, 270 is set in the posture flag.

FIG. 8 is a view showing the concept of angles in the attitude detection processing of FIG. In FIG. 8, the image processing device 100
Shows a figure located at 0 ° in the vertical direction. Figure 1
The value of the posture flag of 0 is that the vertical direction of the image processing apparatus is
0 when in range (a), 9 when in range (b)
0, 180 in the range (c), 180 in the range (d)
It is 270.

FIG. 11 shows a detailed flowchart of the posture icon display processing in S110 of FIG. The system control circuit 50 determines the shooting mode (S6001), and ends the process without doing anything in the case of shooting a moving image. On the other hand, in the case of still image shooting, the process proceeds to S601. The system control circuit 50 determines whether or not the value of the posture flag is 0 (S601).
Draw an icon (S602) and proceed to S608. On the other hand, when the posture flag is not 90, the process proceeds to S603. Attitude flag is 90
(S603), if 90, draw a ← icon (S604) and proceed to S608. On the other hand, the posture flag is 90
If not, proceed to S605. It is determined whether or not the posture flag is 180 (S605), and if 180, the ↓ icon is drawn (S606), and the process proceeds to S608. On the other hand, if it is not 180, the icon is drawn (S607) and the process proceeds to S608. The system control circuit 50 displays the drawn icon on the image display unit 28 (S608), and ends the process.

FIG. 9 shows an example of a screen displayed by the attitude icon display processing of FIG. 1001 is an icon representing a posture, and 1002 is a captured image. When the posture flag value is 0 (a), when it is 90 (b), when it is 180 (c), 270
In case of, the screen of (d) is displayed. In this way, by showing the direction of the heavens in the upside down direction with the arrow, it is possible to notify the user of the attitude of the image processing apparatus.

<Second Embodiment> In the first embodiment,
For the sake of simplicity, the icon representing the posture is described as an arrow. However, for example, the posture icon 1003 as shown in FIG.
Of course, it does not matter even if is displayed. FIG. 13 is a diagram showing a detailed description of the posture icon 1003 shown in FIG. Ten
04 is an icon representing the top side in the vertical direction, 1005 is an icon representing the attitude of the image processing apparatus itself, and 1006 is an icon representing the ground side in the vertical direction.

FIG. 12 (b) shows the vertical direction and also indicates that the attitude of the image processing apparatus is rotated 90 ° clockwise with respect to the vertical direction. Similarly (a)
Also in (c) and (d), in addition to the vertical direction, the posture of the image processing device is 0 ° and 1 ° clockwise with respect to the vertical direction, respectively.
It indicates that it is rotating 80 ° and 270 °. As described above, according to the second embodiment, it is possible to notify the user of the attitude of the image processing apparatus itself in addition to the vertical direction.

Further, in the first and second embodiments, the description has been made on the assumption that the icon to be displayed is updated with a 90 ° posture change, but the icon update process may be performed with any angle change. .

The recording media 200 and 210 are PCMC.
Not only memory cards such as IA cards and compact flash (R), hard disks, etc., but also micro DAT, magneto-optical disks, optical disks such as CD-R and CD-WR, and phase change optical disks such as DVD. Of course there is no problem. Further, of course, there is no problem even if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Furthermore, there is of course no problem even if a part of the composite medium is detachable.

In the description of the first embodiment, the recording media 200 and 210 are described as being separate from the image processing apparatus 100 and can be arbitrarily connected.
Of course, there is no problem if any or all of the recording media remain fixed to the image processing apparatus 100. Further, the recording medium 200 or 210 may be connected to the image processing apparatus 100 in an arbitrary number of single or plural. Although the recording mediums 200 and 210 are attached to the image processing apparatus 100, the recording medium may be a single recording medium or a combination of plural recording media.
Of course there is no problem.

According to the above-described embodiment, when a still image is reproduced, the photographed image data is always displayed by automatically rotating the reproduced image on the display means according to the camera posture determined at the time of photographing. It is possible to provide an image processing device capable of displaying in the correct direction.

Further, when reproducing a moving image, regardless of the camera orientation determined at the time of photographing, the photographed image data is smoothly reproduced and displayed by performing the reproduction display on the display means without performing the rotation processing. It is possible to provide an image processing device capable of performing the above.

Further, it is possible to provide an image processing apparatus capable of identifying the attitude determined by the camera by displaying the attitude of the camera determined by the camera.

Further, the camera attitude is displayed together with the through image so that the attitude of the camera can be identified, and when the attitude of the camera changes, the attitude of the camera is updated before shooting by updating the display of the camera attitude accordingly. An identifiable image processing device can be provided.

Furthermore, by not displaying the camera attitude determined by the camera when shooting a moving image, it is possible to identify that the moving image currently being shot is not automatically rotated and displayed during playback when shooting a moving image. It is possible to provide various image processing devices.

[0070]

As is apparent from the above description, according to the present invention, only an image taken as a still image is configured to be rotated and reproduced in accordance with the posture at the time of image shooting. Therefore, it is possible to avoid the problem that smooth reproduction and display cannot be performed at the time of rotating display of a moving image, and to provide the user with a good feeling of use.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a rear surface configuration of the image processing apparatus according to the embodiment of the present invention.

FIG. 3 is a flowchart showing a part of a main routine of the image processing apparatus according to the first embodiment of the present invention.

FIG. 4 is a flowchart showing a part of a main routine of the image processing apparatus according to the first embodiment of the present invention.

FIG. 5 is a flow chart showing an operation of reading an imaging number after one and an operation of reading an imaging number before by the image processing apparatus according to the first embodiment of the present invention.

FIG. 6 is a diagram showing an example of a screen reproduced and displayed by the image processing apparatus according to the first embodiment of the present invention.

FIG. 7 is a diagram showing an example of a recording format of the image processing apparatus according to the first embodiment of the present invention.

FIG. 8 is a diagram showing an angle concept in a posture detection process of the image processing apparatus according to the first embodiment of the present invention.

FIG. 9 is a diagram showing an example of a screen displayed by the image processing apparatus according to the first embodiment of the present invention.

FIG. 10 is a flowchart showing a posture detection routine of the image processing apparatus according to the first embodiment of the present invention.

FIG. 11 is a flowchart showing a posture icon display routine of the image processing apparatus according to the first embodiment of the present invention.

FIG. 12 is a diagram showing an example of a screen displayed by the image processing apparatus according to the second embodiment of the present invention.

FIG. 13 is a diagram showing an example of a posture icon displayed by the image processing apparatus according to the second embodiment of the present invention.

[Explanation of symbols]

10: Shooting lens 12: Shutter 14: Image sensor 16: A / D converter 18: Timing generation circuit 20: Image processing circuit 22: Memory control circuit 24: Image display memory 26: D / A converter 28: Image display section 30: Memory 32: Image compression / decompression circuit 40: Exposure control means 42: Distance measurement control means 44: Zoom control means 46: Barrier control means 48: Flash 50: System control circuit 52: Memory 54: Display 56: Non-volatile memory 60: Mode dial switch 62: Shutter switch SW1 64: Shutter switch SW2 66: Image display ON / OFF switch 68: Quick review ON / OFF switch 70: Operation unit 70-a: Image selection + switch 70-b: Image selection-switch 80: Power control means 82: Connector 84: Connector 86: Power supply means 90: Interface 92: Connector 94: Interface 96: Connector 98: Recording medium attachment / detachment detection means 100: Image processing device 102: protective means 104: Optical viewfinder 106: Camera posture detection unit 110: Communication means 112: Connector (or antenna) 200: recording medium 202: recording unit 204: Interface 206: Connector 210: recording medium 212: Recording unit 214: Interface 216: Connector 1001: Posture icon 1002: Through image 1003: Posture icon 1004: Icon indicating the top side 1005: Icon representing the attitude of the image processing apparatus itself 1006: Icon representing the ground side

Claims (10)

[Claims] 1. A photographing means for photographing an image, a posture detecting means for detecting a posture at the time of photographing the image, and a judging means for judging whether or not the image is photographed as a still image by the photographing means, When the determination unit determines that the image is captured as a still image, a rotation processing unit that performs rotation processing of the image based on the detection result of the posture detection unit, and rotation processing performed by the rotation processing unit. An image processing apparatus comprising: a reproduction unit that reproduces the image on a display unit. 2. The image processing apparatus according to claim 1, further comprising a scaling processing unit that performs scaling processing of the image in accordance with the rotation processing of the image by the rotation processing unit. 3. The display unit displays the image captured by the image capturing unit and information capable of identifying the orientation detected by the orientation detection unit. Image processing device. 4. The rotation processing means, when the judging means judges that the image is not a still image but the image is a moving image, the rotation processing means rotates the image regardless of the detection result of the posture detecting means. 2. The image processing apparatus according to claim 1, wherein the reproducing means reproduces the image, which has not been subjected to the rotation processing by the rotation processing means, on the display means without executing the processing. 5. The display means does not display information for identifying the posture detected by the posture detecting means when the judging means judges that the image is a moving image. The image processing device according to claim 4. 6. The display unit displays, as the information for identifying the posture, information for identifying a vertical direction with respect to the posture.
The image processing device according to item. 7. The display unit displays, as the information for identifying the orientation, information for identifying the orientation of the image processing apparatus, according to any one of claims 1 to 5. Image processing device. 8. A photographing step of photographing an image by a photographing means, a posture detecting step of detecting a posture related to photographing of the image by a posture detecting means, and whether the image is photographed as a still image by the photographing means. A determination step of determining whether or not the determination unit determines whether the image is captured as a still image by the determination unit, and a rotation process of the image rotation process based on the detection result of the posture detection unit. An image processing method comprising: a rotation processing step executed by a means; and a reproduction step of reproducing the image rotated by the rotation processing means on a display means. 9. A photographing step of photographing an image by a photographing means, a posture detecting step of detecting a posture at the time of photographing the image by a posture detecting means, and whether the image is photographed as a still image by the photographing means. A determination step of determining whether or not the determination unit determines whether the image is captured as a still image by the determination unit, and a rotation process of the image rotation process based on the detection result of the posture detection unit. A program for causing a computer to execute a rotation processing step executed by the means, and a reproduction step of reproducing the image rotated by the rotation processing means on a display means. 10. A photographing step of photographing an image with a photographing means, a posture detecting step of detecting a posture related to photographing of the image by a posture detecting means, and whether the image is photographed as a still image by the photographing means. A determination step of determining whether or not the determination unit determines whether the image is captured as a still image by the determination unit, and a rotation process of the image rotation process based on the detection result of the posture detection unit. A recording medium having recorded thereon a program for causing a computer to execute a rotation processing step executed by the means and a reproduction step of reproducing the image rotated by the rotation processing means on a display means.