JP2007006162A - Image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor capable of improving operability for reproduction. <P>SOLUTION: A tilt sensor 36 detects a tilt α in a direction around an optical axis. When a camera mode is selected, an image photographed in response to a photographing instruction and detection result information showing a detection result of the tilt sensor 36 at the time of accepting the photographing instruction are recorded in a memory card 44. When a reproduction mode is selected, an image reproduced from the memory card 44 is displayed on a monitor 28 through a video encoder 26. A CPU 38 reads out detection result information corresponding to the display image from the memory card 44 and takes in the detection result of the tilt sensor 36 and then controls an attitude of the display image on the basis of the read-out detection result information and the taken-in detection result. When a present tilt in the direction around the optical axis is changed from the tilt in the direction around the optical axis at the time of photographing, the attitude of the reproduced image is changed. As a result, the reproduced image can be displayed in an erect attitude to improve operability in the reproducing mode. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, and more particularly to an image processing apparatus applied to an electronic camera including a tilt sensor, for example.

Conventionally, this type of apparatus is disclosed in Patent Document 1. An electronic camera to which this conventional technique is applied includes an inclination sensor that detects an inclination in the direction around the optical axis (specifically, an inclination of 90 degrees to the left or 90 degrees to the right). When a camera mode is selected, a conventional image processing apparatus records an image photographed in response to a photographing instruction and detection result information indicating a detection result of a tilt sensor at the time when the photographing instruction is received on a recording medium. . When the reproduction mode is selected, an image reproduced from the recording medium is displayed in a mode corresponding to detection result information related to the image. Thereby, it is possible to display an image taken with the electronic camera tilted in the direction around the optical axis in an upright posture.
JP 2003-110914 A [H04N 5/225, 5/907]

  However, the reproduction operation is not always performed in an upright state, that is, in a state where the electronic camera is not inclined in the direction around the optical axis. In the prior art, an image captured in an inclined state is displayed in an upright posture if a playback operation is performed in an upright state. However, if a playback operation is performed in an inclined state, the image is displayed in an inclined posture and operability is improved. Getting worse.

  Therefore, a main object of the present invention is to provide an image processing apparatus capable of improving the operability during reproduction.

  The image processing apparatus according to the first aspect of the present invention includes an image photographed in response to a photographing instruction and inclination information indicating the inclination of the imaging surface (14a) in the direction around the optical axis (Z) when the photographing instruction is received. First receiving means (S5, S85) for receiving an image reproducing operation directed to the recorded recording medium (44), first reading means (S73) for reading an image designated by the image reproducing operation from the recording medium, first Display means (26) for displaying an image read from the recording medium by the reading means on the monitor screen (28), and a first detection for detecting the inclination in the direction around the normal line of the monitor screen in relation to the display operation of the display means. Means (S75), second reading means (S73) for reading tilt information corresponding to the image displayed by the display means from the recording medium, and the attitude of the image displayed by the display means and the detection result of the first detecting means and the first 2 Read by reading means And attitude control means (S77, S91) for controlling based on the tilt information.

  In the recording medium, an image photographed in response to the photographing instruction and inclination information indicating the inclination in the direction around the optical axis at the time when the photographing instruction is received are recorded. The image reproducing operation directed to the recording medium is received by the first receiving unit.

  The first reading means reads the image designated by the image reproduction operation from the recording medium. The display means displays the read image on the monitor screen. The tilt detection means detects a tilt in the direction around the normal line of the monitor screen in relation to the display operation. The second reading means reads tilt information corresponding to the image displayed on the monitor screen from the recording medium.

  The posture of the image displayed on the monitor screen is controlled by the posture control unit based on the detection result detected by the tilt detection unit and the tilt information read by the second reading unit.

  That is, the posture of the reproduced image is controlled according to the change in the inclination around the normal line of the monitor screen with respect to the inclination around the optical axis of the imaging surface at the time of shooting. As a result, the reproduced image can be displayed in an upright posture, and the operability during reproduction is improved.

  An image processing apparatus according to a second aspect of the invention is dependent on the first aspect, wherein the attitude control means calculates a difference between the detection result of the first detection means and the inclination information read by the second reading means. Means (S111), and correction amount calculation means (S113) for calculating the posture correction amount based on the calculation result of the difference calculation means.

  The difference calculating means calculates a difference between the detection result of the first detecting means and the inclination information read by the second reading means, and the correction amount calculating means calculates the posture correction amount based on the calculation result of the difference calculating means. . The posture control means performs control according to the posture correction amount thus calculated.

  An image processing apparatus according to a third aspect of the invention is dependent on the first or second aspect, and the first detection unit repeatedly performs detection in parallel with the display operation of the display unit.

  Thereby, it is possible to cope with a tilt change that occurs at any time during display.

  An image processing apparatus according to a fourth aspect of the invention is dependent on any one of the first to third aspects, and a magnification control means (S79, S93) for controlling the magnification of an image displayed by the display means in accordance with the control of the attitude control means. ).

  The magnification of the image displayed by the display means is controlled by the magnification control means in accordance with the control of the attitude control means. Thereby, the operation amount for changing the magnification is reduced, and the operability during reproduction is further improved.

  An image processing apparatus according to the invention of claim 5 is dependent on claim 4, and includes a second receiving means (S53, S55) for receiving a selection operation for selecting one of the control in the reduction direction and the control in the enlargement direction. In addition, the magnification control means controls in the direction selected by the selection operation.

  The selection operation for selecting one of the control in the reduction direction and the control in the enlargement direction is received by the second reception unit. The magnification of the reproduced image is controlled in the direction selected by the selection operation.

  By selecting control in the reduction direction, the entire image can be displayed as much as possible even if the attitude of the image is controlled. By selecting control in the enlargement direction, an image can be displayed on the entire screen as much as possible even if the orientation of the image is controlled.

  An image processing apparatus according to the invention of claim 6 is dependent on claim 5 and further comprises holding means (S59) for holding direction information indicating the direction selected by the selection operation.

  Direction information indicating the direction selected by the selection operation is held by the holding unit. The magnification control means performs control with reference to the holding information of the holding means. Thereby, the operation amount for the selection operation is suppressed.

  An image processing apparatus according to a seventh aspect of the present invention is dependent on any one of the first to sixth aspects, wherein the second detection means for detecting the inclination of the imaging surface in the direction around the optical axis when the imaging instruction is received, and the imaging instruction Recording means for recording on the recording medium the image photographed in response to the information and the tilt information indicating the detection result of the second detection means.

  The inclination of the imaging surface in the direction around the optical axis is detected by the second detection means when a shooting instruction is received. The inclination information indicating the detection result of the second detection unit is recorded on the recording medium by the recording unit together with the image shot in accordance with the shooting instruction.

  An image processing apparatus according to an eighth aspect of the present invention is dependent on the seventh aspect, and the monitor screen is parallel to the imaging surface.

  In other words, the normal line of the monitor screen is parallel to the optical axis, and therefore the posture can be controlled with only one tilt sensor.

  The image processing apparatus according to the invention of claim 9 is dependent on claim 8 and further comprises one biaxial acceleration sensor (36a) for detecting two accelerations respectively applied in two axial directions orthogonal to each other, and the first detection Each of the means and the second detection means performs detection based on the output of the biaxial acceleration sensor.

  Two accelerations respectively applied in two axial directions orthogonal to each other are detected by a biaxial acceleration sensor, and each of the first detection means and the second detection means detects an inclination based on the output of the biaxial acceleration sensor.

  The image processing apparatus according to the invention of claim 10 is dependent on claim 9, and each of the two axes is orthogonal to the optical axis.

  Thereby, the thickness of the image processing apparatus in the optical axis direction is suppressed.

  According to the present invention, a reproduced image can be displayed in an upright posture, and as a result, operability during reproduction can be improved.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

  Referring to FIG. 1, a digital camera 10 of this embodiment includes a focus lens 12. The optical image of the subject enters the imaging surface 14 a of the image sensor 14 through the focus lens 12. On the imaging surface 14a, a camera signal (raw image signal) corresponding to the incident optical image is generated by photoelectric conversion. The imaging surface 14a is covered with a primary color Bayer array color filter (not shown), and each pixel signal forming a camera signal has only one of R, G, and B color components.

  When the camera mode is selected by the operation key 32, a through shooting command is issued by the CPU 38. In response to the issued through shooting command, the image sensor 14 first outputs a camera signal generated by photoelectric conversion at a predetermined frame rate. The camera signal of each frame output from the image sensor 14 is converted into a digital signal by the A / D converter 18 through known noise removal and level adjustment in the CDS / AGC circuit 16.

  The signal processing circuit 20 performs signal processing, such as color separation, white balance adjustment, and YUV conversion, on the camera data of each frame output from the A / D converter 18 to obtain a luminance component (Y data) and a color difference component (U data). , V data) is generated. The generated image data is given to the memory control circuit 24 and written into the SDRAM 22 by the memory control circuit 24.

  The video encoder 26 causes the memory control circuit 24 to read the image data of the SDRAM 22. Then, the read image data of each frame is encoded into a composite image signal in the NTSC format, and the encoded composite image signal is supplied to the monitor 28. The monitor 28 displays a real-time moving image (through image) of the subject.

  When the shutter button 30 is half-pressed by the operator, the CPU 38 adjusts photographing conditions such as exposure amount and white balance. Thereafter, when the shutter button 30 is fully pressed, the CPU 38 issues a shooting command. In response to the issued shooting command, the image sensor 14 performs exposure using an electronic shutter method, and outputs a camera signal generated thereby. The output camera signal is converted into image data composed of a luminance component and a color difference component through the same processing as described above, and the converted image data is stored in the SDRAM 22.

  When image data based on the full press of the shutter button 30 is secured in the SDRAM 22, the CPU 38 disables the image sensor 14 and gives a compression command to the JPEG codec 40. The JPEG codec 40 causes the memory control circuit 24 to read out the image data stored in the SDRAM 22 and applies a compression process according to the JPEG format to the read image data. When compressed image data (JPEG data) is obtained, the JPEG codec 40 provides the JPEG data to the memory control circuit 24. The JPEG data is stored in the SDRAM 22 by the memory control circuit 24.

  Thereafter, the CPU 38 reads JPEG data from the SDRAM 22 through the memory control circuit 24 and records the read JPEG data in the memory card 44 through the I / F circuit 42. Further, the CPU 38 records detection result information indicating a detection result (described later) of the tilt sensor 36 immediately before the shutter button 30 is fully pressed on the memory card 44 through the I / F circuit 42.

  When recording to the memory card 44, the corresponding JPEG data and detection result information are stored in the same image file. That is, JPEG data is recorded in the memory card 44 in a file format, and detection result information is embedded in the image file.

  Note that the memory card 44 is a detachable nonvolatile recording medium and can be accessed by the CPU 38 when it is mounted in a slot (not shown).

  Here, the tilt sensor 36 will be described in detail. The tilt sensor 36 includes a biaxial acceleration sensor 36a and an arithmetic circuit 36b. The biaxial acceleration sensor 36a detects two accelerations applied in two axial directions orthogonal to each other. Hereinafter, these two axes are referred to as “first axis X” and “second axis Y”.

  As shown in FIG. 2, the biaxial acceleration sensor 36a is fixed at a predetermined position in the digital camera 10 placed in an upright state so that the first axis X is vertical and the second axis Y is horizontal. . That is, each of the first axis X and the second axis Y is perpendicular to the normal line of the display surface of the monitor 28, that is, the optical axis Z of the focus lens 12. These three axes (X, Y, Z) rotate as the posture of the digital camera 10 changes.

  The biaxial acceleration sensor 36a outputs a signal (x, y) corresponding to the inclination of each of the first axis X and the second axis Y with respect to the horizontal plane, and the arithmetic circuit 36b calculates the optical axis based on the output signal. An inclination α in the clockwise direction of Z (−90 ° ≦ α ≦ 90 °; see FIG. 3) is calculated. α = 0 corresponds to the upright state, α = −90 ° corresponds to the left 90 ° inclined state, and α = 90 ° corresponds to the right 90 ° inclined state. In this embodiment, the calculation is performed in units of 5 °. The inclination sensor 36 outputs a detection result indicating the inclination α thus calculated, that is, any of −90, −85,..., 0, 5,. Note that the arithmetic circuit 36b may be omitted, and the CPU 38 may perform the same calculation.

  When the reproduction mode is selected by the operation key 32, the CPU 38 reads JPEG data from the image file recorded on the memory card 44 and writes the read JPEG data to the SDRAM 22 through the memory control circuit 24.

  Subsequently, the CPU 38 reads detection result information from the image file from which the JPEG data has been read, and captures the current detection result from the tilt sensor 36. Next, a difference between the inclination indicated by the read detection result information and the inclination indicated by the acquired detection result, that is, a change amount (Δα) of the inclination is calculated. Next, a magnification corresponding to the calculated inclination change amount Δα is calculated.

  Here, the magnification calculation is performed with reference to one of the two tables T1 and T2 stored in the flash memory 34 (the table T1 by default). The table to be referred to, that is, the valid table can be arbitrarily changed through the display mode selection screen shown in FIG.

  Referring to FIG. 4, the display mode selection screen includes two options “full image display” and “full screen display”. When one of “full image display” and “full screen display” is selected by operating the operation key 32, the table corresponding to the selection result is validated. Specifically, the table T1 is validated when “display all images” is selected, and the table T2 is validated when “display full screen” is selected.

  Referring to FIG. 5A, table T1 has magnifications 1, 0.9,..., 0.7, 0.75 corresponding to absolute values 0, 5,. It is registered. Referring to FIG. 5B, the table T2 has magnifications 1, 1.1,..., 1.4, 1.35 corresponding to the absolute values 0, 5,. It is registered. The registered value is calculated based on the aspect ratio of the monitor 28 and the like.

  Returning to FIG. 1, the CPU 38 subsequently sets the inclination correction value (−Δα) corresponding to the calculated inclination change amount Δα and the calculated magnification in the memory control circuit 24 and issues a reproduction start command. The playback start command includes a decompression command. In response to this decompression command, the JPEG codec 40 reads JPEG data from the SDRAM 22 through the memory control circuit 24, and decompresses the read JPEG data according to the JPEG format. Apply. The expanded image data is given to the memory control circuit 24. The memory control circuit 24 writes the given decompressed image data to the SDRAM 22 in a manner corresponding to the set inclination change amount (−Δα) and the set magnification.

  That is, if the detection result information indicates “0”, it is considered that no tilt change has occurred, and the decompressed image data is written in an upright state. If the detection result information indicates “90”, it is considered that a 90 ° tilt change has occurred on the right, and the expanded image data is written in a state rotated 90 ° to the left. If the detection result information indicates “−90”, it is considered that a 90-degree tilt change has occurred on the left, and the expanded image data is written in a state rotated 90 ° to the right.

  Similarly, if the detection result information indicates “5”, the decompressed image data is written in a state rotated by 5 ° to the left. If the detection result information indicates “85”, the decompressed image data is written in a state rotated by 85 ° to the left.

  The decompressed image data developed in the SDRAM 22 in this manner is read by the video encoder 26 through the memory control circuit 24 and converted into an NTSC composite image signal. The converted composite image signal is supplied to the monitor 28, and as a result, a reproduced image is displayed.

  In the digital camera 10 configured as described above, when the object scene shown in FIG. 6A is photographed in the upright state, if the reproduction is performed in the upright state, the reproduced image is displayed regardless of the display mode. As shown in FIG. 6 (B), the image is displayed in the upright posture and the same magnification. If playback is performed in the right 90 degree tilt state (or left 90 degree tilt state), the image is displayed in the upright posture and the reduction magnification (0.75 times) as shown in FIG. In the screen display mode, the screen is displayed in an upright posture and an enlargement magnification (1.35 times) as shown in FIG.

  Further, when the object scene shown in FIG. 7A is photographed in the right 90 degree inclined state (or left 90 degree inclined state), if the reproduction is performed in the right 90 degree inclined state or the left 90 degree inclined state, a reproduced image is obtained. Is displayed in an upright posture and at an equal magnification as shown in FIG. 7B regardless of the display mode. If playback is performed in the upright state, the image is displayed in the upright posture and the reduction magnification (0.75 times) as shown in FIG. 7C in the full image display mode, and in the full screen display mode, FIG. As shown, the image is displayed in an upright posture and an enlargement magnification (1.35 times).

  Further, when the object scene shown in FIG. 8A is photographed in the right 90 degree tilt state (or left 90 degree tilt state), if the playback is performed in the left 85 degree tilt state, the reproduced image is displayed as a full image. In the mode, the image is displayed in the upright posture and the reduction magnification (0.9 times) as shown in FIG. 8B, and in the full screen display mode, the image is displayed in the upright posture and the enlargement magnification (1. 1x). If playback is performed in a state of tilting 5 degrees to the left, the image is displayed in the upright posture and the reduction magnification (0.7 times) as shown in FIG. 8D in the full image display mode, and in the full screen display mode, as shown in FIG. As in (C), the image is displayed in an upright posture and an enlargement magnification (1.4 times).

  The CPU 38 processes the main task shown in FIGS. 9 and 11 to the imaging task shown in FIG. 10 in parallel under the control of a multitask OS such as μITRON. Note that programs corresponding to these flowcharts are stored in the flash memory 34.

  Referring to FIG. 9, first, a shooting task is started in step S1, and then a loop of steps S3 to S7 is entered. In step S3, the presence / absence of a setting start operation is determined. In step S5, the presence / absence of a reproduction start operation is determined. In step S7, the presence / absence of a power-off operation is determined.

  When the setting start operation is performed, “YES” is determined in the step S3, the process proceeds to a step S9, and the photographing task is ended. In step S11, a setting process (described later) is executed, and then the process returns to step S1. When the reproduction start operation is performed, “YES” is determined in the step S5, the process proceeds to a step S13, and the photographing task is ended. In step S15, a reproduction process (described later) is executed, and then the process returns to step S1. When the power-off operation is performed, “YES” is determined in the step S7, and the photographing task is ended by moving to a step S17. Thereafter, the main task is terminated.

  Referring to FIG. 10, first, a through shooting command is issued in step S31, and then the process proceeds to step S33 to determine whether or not there is a shooting operation. When a shooting operation is performed, YES is determined in step S33, and the process proceeds to step S35 to issue a shooting command. In response to the photographing command, exposure by the image sensor 14, noise removal and level adjustment by the CDS / AGC circuit 16, and conversion by the A / D converter 18 are performed.

  In step S37, the output of the inclination sensor 36, that is, the detection result α is captured. In step S39, a compression instruction is issued. In response to this compression command, JPEG compression processing by the JPEG codec 40 is executed. In step S41, a recording process is executed. Specifically, JPEG data is read from the SDRAM 22 through the memory control circuit 24, and the read JPEG data and the detection result information including the acquired detection result α are recorded in the memory card 44 in a file format through the I / F circuit 42. To do. When the recording process is completed, the process returns to step S31.

  Referring to FIG. 11, in step S51, it is determined whether or not “display mode setting” has been selected as a setting item. If “YES” here, a display mode setting screen (see FIG. 4) is displayed on the monitor 28 in a step S53. Thereafter, the loop of steps S55 and S57 is entered. In step S55, it is determined whether or not acceptance of the setting operation has been completed, and in step S57, it is determined whether or not a cancel operation has been performed.

  When the operation key 32 for the display mode setting screen is operated, either “full image display” or “full screen display” is selected, and when the selection result is confirmed, YES is determined in a step S55, In step S59, the selection result is stored in the flash memory 34. Thereafter, the process returns to the upper layer routine. If a cancel operation is performed, “YES” is determined in the step S57, and the process returns to the upper layer routine.

  Referring to FIG. 12, an identification number (1, 2,...) Is assigned to the image file in memory card 44. First, “1” is set to variable N in step S71. In step S73, the detection result information is read from the image file N. In step S75, the output of the tilt sensor 36, that is, the detection result α is captured. In step S77, the posture is changed (described later). In step S79, the magnification is changed (described later). In step S81, a reproduction start command is issued.

  In response to the decompression command included in the reproduction start command, JPEG decompression processing by the JPEG codec 40 is executed. The decompressed image data is written into the SDRAM 22 by the memory control circuit 24 in a manner corresponding to the attitude change result in step S77 and the magnification change result in step S79. The decompressed image data developed in the SDRAM 22 is read by the video encoder 26 and converted into a composite image signal. The converted composite image signal is applied to the monitor 28, and a reproduced image is displayed on the display surface of the monitor 28.

  Referring to FIG. 13, after the instruction is issued, the process of CPU 38 enters a loop of steps S83 to S87. In step S83, it is determined whether or not a predetermined time has elapsed. In step S85, it is determined whether there is an update operation. In step S87, it is determined whether there is a stop operation.

  When a predetermined time has elapsed since the previous sensor output capture, YES is determined in step S83, and the process proceeds to step S89 to capture the output of the tilt sensor 36. In step S91, the posture is changed (described later), and in step S93, the magnification is changed (described later). Then, the process returns to the loop of steps S83 to S87.

  When an update operation is performed via the operation key 32, YES is determined in the step S85, and the process proceeds to a step S95 to increment the variable N. After the increment, the process returns to step S73.

  If a stop operation is performed via the operation key 32, “YES” is determined in the step S87, and the process shifts to a step S97 to issue a reproduction stop command. As a result, the reproduction process being executed is stopped. After issuing the command, return to the upper layer routine.

  Referring to FIG. 14, in step S111, the amount of change in inclination Δα, that is, how much the current inclination changes with respect to the inclination at the time when the photographing operation is accepted is calculated. The inclination change amount Δα is obtained by subtracting the detection result α included in the detection result information read out in step S73 from the detection result α acquired in step S75.

  In step S113, an inclination correction value (−Δα) is calculated based on the calculation result of step S111. The inclination correction value is obtained by inverting the sign of the calculation result in step S77. In step S115, the calculation result of step S113 is set in the memory control circuit 24. Thereafter, the process returns to the upper layer routine.

  Referring to FIG. 15, in step S121, it is determined whether or not the selection result stored in flash memory 34 is the all-image display mode. If “YES” here, the process proceeds to a step S123, and the magnification corresponding to the inclination change amount Δα calculated in the step S111 is read from the table T1. If NO, the process proceeds to step S125, and the magnification corresponding to the inclination change amount Δα calculated in step S111 is read from the table T2. In the subsequent step S127, the magnification read from the table T1 or T2 is set in the memory control circuit 24. After setting, return to the upper layer routine.

  As is apparent from the above, in the digital camera 10 of this embodiment, the tilt sensor 36 detects the tilt α in the direction around the optical axis Z (that is, the direction around the normal line of the display surface of the monitor 28). When the camera mode is selected, an image shot in response to the shooting instruction and detection result information indicating the detection result of the tilt sensor 36 when the shooting instruction is received are recorded in the memory card 44. When the reproduction mode is selected, an image reproduced from the memory card 44 is displayed on the monitor 28 through the video encoder 26.

  The CPU 38 reads the detection result information corresponding to the display image from the memory card 44 (S73), and takes in the detection result of the tilt sensor 36 (S75, S89). Then, the orientation of the display image is changed based on the read detection result information and the captured detection result (S77, S91).

  That is, if the current inclination in the direction around the optical axis Z changes with respect to the inclination in the direction around the optical axis Z at the time of shooting, the posture of the reproduced image is changed. Specifically, the inclination value indicated by the detected detection result information is subtracted from the inclination value indicated by the detected detection result (S111), the sign of the subtraction result “Δα” is inverted (S113), and the inversion result is obtained. The posture is changed using “−Δα” as a correction value. As a result, the reproduced image can be displayed in an upright posture, and the operability in the reproduction mode is improved.

  Further, the CPU 38 also changes the magnification of the display image in accordance with the posture change (S79, S93). As a result, the operation amount for changing the magnification is suppressed, and the operability in the reproduction mode is further improved.

  In this embodiment, the magnification is calculated using one of the two tables T1 and T2. However, two algorithms for the full image display mode and the full screen display mode are prepared, and one of the two algorithms is prepared. The magnification may be calculated by calculation according to the following.

  In this embodiment, the imaging surface 14a of the image sensor 14 and the display surface of the monitor 28 are parallel to each other (that is, the normal line of the display surface of the monitor 28 and the optical axis Z are parallel to each other). If 28 is pivotally connected to the camera body, they are generally not parallel. In this case, another inclination sensor (not shown) may be provided on the monitor 28. That is, in the camera mode, the tilt sensor 36 detects the tilt in the direction around the optical axis Z, and in the playback mode, another tilt sensor detects the tilt in the direction around the normal line of the display surface of the monitor 28. Then, when the inclination in the direction around the normal line of the current display surface is changed with respect to the inclination in the direction around the optical axis Z at the time of shooting, the posture of the reproduced image is changed.

  Hereinafter, another embodiment of the present invention will be briefly described. In this embodiment, a memory card in which an image photographed in response to a photographing instruction and inclination information (inclination sensor detection result) indicating inclination in the direction around the optical axis at the time when the photographing instruction is received is mounted. The image display device (viewer) displays an image on a monitor screen in response to a reproduction operation directed to the memory card.

  This viewer includes components related to the camera mode, that is, a focus lens 12, an image sensor 14, a CDS / AGC circuit 16, an A / D converter 18, a signal processing circuit 20, and a shutter button 30 in the digital camera 10 of FIG. Has an excluded configuration. The remaining components perform the same operations as in FIG. However, the JPEG codec 40 only needs to perform decompression. The memory card 44 may be the memory card 44 removed from the digital camera 10 of FIG. 1 embodiment, or may be a memory card removed from another electronic camera.

  The inclination information recorded on the memory card removed from the other electronic camera may have a format different from the detection result of the inclination sensor 36 in FIG. In this case, when performing the posture change (see FIG. 14), the CPU 38 performs format conversion of the tilt information prior to the calculation of the tilt change amount (S111). The inclination information may be in the same unit of 5 degrees as the detection result of the inclination sensor 36, or may be in units other than this, for example, in units of 90 degrees (any one of -90 °, 0, and 90 °).

  Although the above description has been made using the digital camera 10 and the viewer, the present invention can be applied to a portable image processing device (for example, a mobile phone terminal, a PDA, a portable game machine, etc.) having a monitor screen. The present invention can also be applied to a stationary image processing apparatus (for example, a personal computer or a car navigation system) having a mechanism for rotating the monitor screen in the direction around the normal line.

It is a block diagram which shows the structure of one Example of this invention. FIG. 2 is a perspective view showing the embodiment of FIG. 1 placed in an upright state. It is an illustration figure which shows the definition of the inclination of the surroundings direction of an optical axis applied to the FIG. 1 Example. It is an illustration figure which shows the display mode selection screen applied to the FIG. 1 Example. (A) is an illustration figure which shows an example of the table applied to FIG. 1 Example, (B) is an illustration figure which shows another example of the table applied to FIG. 1 Example. (A) is an illustrative view showing an example of a photographed image, (B) is an illustrative view showing an example of a reproduction screen based on (A) image, and (C) is another reproduction screen based on (A) image. (D) is an illustrative view showing another example of a reproduction screen based on an image. (A) is an illustrative view showing another example of a captured image, (B) is an illustrative view showing an example of a playback screen based on (A) image, and (C) is a playback screen based on (A) image. It is an illustration figure which shows another example of (A), (D) is an illustration figure which shows another example of the reproduction | regeneration screen based on (A) image. (A) is an illustrative view showing another example of a captured image, (B) is an illustrative view showing an example of a playback screen based on (A) image, and (C) is a playback screen based on (A) image. (D) is an illustrative view showing another example of a playback screen based on (A) image, and (E) is yet another example of a playback screen based on (A) image. It is an illustration figure which shows an example. It is an illustration figure which shows a part of CPU operation | movement applied to FIG. 1 Example. FIG. 10 is an illustrative view showing another portion of the CPU operation applied to the embodiment in FIG. 1; It is an illustration figure which shows the other part of CPU operation | movement applied to FIG. 1 Example. FIG. 10 is an illustrative view showing yet another portion of the CPU operation applied to the embodiment in FIG. 1; FIG. 10 is an illustrative view showing another portion of the CPU operation applied to the embodiment in FIG. 1; FIG. 10 is an illustrative view showing another portion of the CPU operation applied to the embodiment in FIG. 1; It is an illustration figure which shows the other part of CPU operation | movement applied to FIG. 1 Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Digital camera 12 ... Focus lens 14 ... Image sensor 14a ... Imaging surface 18 ... CPU
22 ... SDRAM
24 ... Memory control circuit 26 ... Video encoder 28 ... Monitor 36 ... Tilt sensor 36a ... Biaxial acceleration sensor 36b ... Arithmetic circuit 44 ... Memory card

Claims (10)

First to accept an image reproduction operation directed to a recording medium in which an image photographed in response to a photographing instruction and inclination information indicating the inclination of the imaging surface in the direction around the optical axis when the photographing instruction is accepted are recorded Receiving means,
First reading means for reading an image designated by the image reproduction operation from the recording medium;
Display means for displaying an image read from the recording medium by the first reading means on a monitor screen;
First detection means for detecting an inclination in a direction around a normal line of the monitor screen in relation to a display operation of the display means;
Second readout means for reading out tilt information corresponding to the image displayed by the display means from the recording medium, and the detection result of the first detection means and the second readout means for the orientation of the image displayed by the display means An image processing apparatus comprising posture control means for controlling based on the inclination information read out by.   The posture control means includes a difference calculation means for calculating a difference between the detection result of the first detection means and the inclination information read by the second reading means, and posture correction based on the calculation result of the difference calculation means The image processing display apparatus according to claim 1, further comprising a correction amount calculation unit that calculates the amount.   The image processing apparatus according to claim 1, wherein the first detection unit repeatedly performs detection in parallel with the display operation of the display unit.   The image processing apparatus according to claim 1, further comprising a magnification control unit that controls a magnification of an image displayed by the display unit in accordance with control of the posture control unit. A second receiving means for receiving a selection operation for selecting one of the control in the reduction direction and the control in the enlargement direction;
The image processing apparatus according to claim 4, wherein the magnification control unit performs control in a direction selected by the selection operation.   The image processing apparatus according to claim 5, further comprising holding means for holding direction information indicating a direction selected by the selection operation. Second detection means for detecting the inclination of the imaging surface in the direction around the optical axis at the time when the imaging instruction is received, and an image captured in accordance with the imaging instruction and inclination information indicating a detection result of the second detection means. The image processing apparatus according to claim 1, further comprising recording means for recording on a recording medium.   The image processing apparatus according to claim 7, wherein the monitor screen is parallel to the imaging surface. A two-axis acceleration sensor for detecting two accelerations respectively applied in two axial directions orthogonal to each other;
The image processing apparatus according to claim 8, wherein each of the first detection unit and the second detection unit performs detection based on an output of the biaxial acceleration sensor.   The image processing apparatus according to claim 9, wherein each of the two axes is orthogonal to the optical axis.

Images