JP5744606B2 - Display control device, display control method, program, and storage medium - Google Patents

Description

  The present invention relates to a display control technique for detecting posture information of an image and displaying the posture information.

  An imaging device such as an electronic camera that records and reproduces still images and moving images using a memory card as a recording medium includes a display device such as a liquid crystal panel, and reproduces the captured image and images read from the recording medium as an electronic viewfinder. Can do.

  The angle of view of these electronic cameras, that is, the aspect ratio of the photographed image is not 1: 1, and it is normal for the photographer to photograph while changing the orientation of the camera vertically or horizontally according to the subject.

  Therefore, if the orientation of the camera at the time of shooting is not the normal (horizontal) position, an image that is not in the normal position is displayed on the display device when the image is reproduced.

  Therefore, in Patent Document 1 and Patent Document 2, camera posture information at the time of shooting is recorded together with an image, and the recorded posture information is referred to during image reproduction. Is rotated and displayed. A gravity sensor or the like is used as means for detecting the posture of the camera.

  In such an image pickup apparatus such as an electronic camera, camera posture information at the time of shooting is always recorded together with the image, so that it is always automatically in the normal position regardless of the photographer's intention at the time of image reproduction. Displayed after image processing. Depending on the subject, there is no particular distinction between the top and bottom, and the top and bottom of the subject may differ from the posture information of the camera, and even if rotation processing is performed with reference to the posture information, it is not always displayed at the correct position.

  Therefore, in Patent Document 3, posture information is always automatically added in an automatic shooting mode in which all control related to shooting is automatically performed during shooting, and posture information is added in a manual shooting mode in which control related to shooting is performed manually. You can choose whether or not to do.

JP-A-11-341324 JP 2000-31329 A JP 2003-259295 A

  However, a gravity sensor used for camera posture detection may not be able to correctly detect the vertical and horizontal postures of the camera. In particular, when the camera is facing directly down or directly above, the camera is in the normal position (horizontal position; the short side of the imaging surface is the gravitational direction) or the vertical position (the long side of the imaging surface). Detecting gravity does not make sense when it is determined whether or not is in the direction of gravity. Therefore, it is not accurate to determine whether the photographer is holding the camera sideways or vertically. Therefore, the vertical and horizontal postures of the camera cannot be detected correctly in shooting modes such as shooting underwater or food that is often shot with the camera pointing up or down. Therefore, even if an image shot in a mode for shooting underwater or cooking, which is often taken with the camera pointing up or down, is displayed in a direction according to the posture information detected by the camera, the user can have the desired orientation. There is a problem that the frequency of not becoming high is high.

  The present invention has been made in view of the above problems, and an object thereof is to realize a display control technique that reduces the possibility that an image shot in a specific shooting mode is displayed in a direction contrary to the user's intention. is there.

In order to solve the above problems and achieve the object, the display control apparatus of the present invention includes a reading unit that reads image data and attribute information thereof from a recording medium, and image data read from the attribute information read by the reading unit. Determining means for determining whether or not the image has been shot in a specific shooting mode; and if the read out image data is determined to have been shot in a shooting mode other than the specific shooting mode, the read image Controls to display the image without reflecting the posture information when it is determined that the image was captured in the specific shooting mode by reflecting the posture information at the time of shooting included in the attribute information of the data display control means for, and display means for displaying a setting screen for setting whether to display without reflecting the posture information, the items included in the setting screen An operation means for accepting an operation to be selected or determined by the user, and the display control means is configured to display information other than the specific shooting mode when the operation means is set to display without reflecting posture information. When it is determined that the image is taken in the shooting mode, an image is displayed reflecting the posture information at the time of shooting included in the read attribute information, and when it is determined that the image is shot in the specific shooting mode, the posture information is displayed. Control to display the image without reflecting .

  According to the present invention, it is determined whether or not the result of posture detection is shot in a shooting mode that is often shot in a situation that does not become the direction intended by the user, and when shot in such a specific shooting mode, An image is displayed without reflecting the detected posture information. Thereby, possibility that an image will be displayed in the direction contrary to a user's intention can be reduced.

1 is a block diagram of an imaging apparatus according to an embodiment of the present invention. 5 is a flowchart of display control processing according to the first embodiment. 10 is a flowchart of display control processing according to the second embodiment. An example of a setting screen for executing the underwater image batch rotation function. 10 is a flowchart of display control processing according to the third embodiment.

  Hereinafter, embodiments for carrying out the present invention will be described in detail. The embodiment described below is an example for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment. Moreover, you may comprise combining suitably one part of each embodiment mentioned later.

  [Embodiment 1] In this embodiment, an embodiment in which the display control apparatus of the present invention is applied to an imaging apparatus represented by a digital video camera (hereinafter referred to as a camera) will be described.

  <Configuration of Imaging Device> The configuration of the imaging device of this embodiment will be described with reference to FIG.

  In FIG. 1, a recording medium 100 is a recording medium such as a memory card or a hard disk for recording image data such as still images and moving images. This recording medium 100 may be a removable recording medium such as a memory card, or may be a non-removable recording medium such as a built-in memory.

  The reading unit 101 reads out image data recorded on the recording medium 100 and writes it in the memory 102. The decompression unit 103 is a decompression circuit that decompresses image data, reads image data stored in the memory 102, performs decompression processing, and writes the processed data to the memory 102. The shooting mode determination unit 104 extracts attribute information from the decompressed image data stored in the memory 102, reads the shooting mode information recorded therein, and determines the shooting mode of the stored image data.

  The display control unit 105 extracts posture information from the attribute information of the decompressed image data stored in the memory 102, and according to the posture information and the result determined by the shooting mode determination unit, the rotation angle of the image to be displayed, Control the direction of rotation. The display unit 106 includes an LCD panel or the like. The control unit 107 controls the entire apparatus. The memory 108 is used as a work area in which constants, variables, programs, and the like for operation of the control unit 107 are temporarily recorded. The operation unit 109 includes buttons, a touch panel, and the like that allow the user to open menus and perform operations such as selection and setting.

  The attribute information editing unit 110 performs a process of editing the posture information among the attribute information added to the image data. The attribute information editing unit 110 edits the attribute information of the image data written in the memory 102 and writes the edited data in the memory 102. The compression unit 111 performs a compression process for compressing the image data, reads the image data stored in the memory 102, performs the compression process, and writes the compressed data in the memory 102. The writing unit 112 writes the compressed image data stored in the memory 102 to the recording medium 100. The control unit 107 may be configured to realize the functions of the shooting mode determination unit 104, the display control unit 105, and the attribute information editing unit 110.

  Here, modes that can be set by the imaging apparatus of the present embodiment will be described.

  The imaging device can switch between at least a playback mode for playing back an image and a shooting mode for shooting. The shooting mode includes an auto mode, a manual mode, and a plurality of scene-specific shooting modes. The scene-specific shooting mode is a shooting mode realized by combining a shutter speed and an aperture value, a strobe emission state, sensitivity setting, white balance (WB) setting, and the like suitable for each shooting scene.

The imaging device has, for example, the following scene-specific shooting modes (1) to (10). However, the present invention is not limited to these scene-specific shooting modes.
(1) Water shooting mode (beach mode): A mode in which a person or the like can take a picture even on the sea surface or sandy beach where sunlight is strongly reflected.
(2) Night scene shooting mode: A mode specialized for night scenes in which a person is flashed and the background is recorded at a slow shutter speed.
(3) Astronomical mode: An imaging mode suitable for astronomical imaging, in which the shutter speed is slowed, the aperture is set to the minimum value, and the focal length is set to infinity.
(4) Underwater mode: A mode in which the white balance is set to be optimal for underwater shooting, and the image is shot with a hue that reduces bluishness.
(5) Text shooting mode: This mode captures text on a document so that it is easy to read. It is fixed to macro, sharpness is set to hard, and contrast is set to high.
(6) Portrait shooting mode: A mode specialized in shooting a person by blurring the background and making the person stand out.
(7) Sports shooting mode: A shooting mode that is specialized for taking fast-moving subjects.
(8) Snow shooting mode: A mode in which a person does not darken even when the snow scene is in the background and the image is taken without leaving a bluish tint.
(9) Night & Snap Shooting Mode: A mode suitable for shooting night views and people without a tripod.
(10) Cooking mode: This is a shooting mode suitable for shooting food, fixed to macro, and set to a higher saturation.

  The imaging apparatus of the present embodiment can perform shooting by setting an arbitrary shooting mode from the shooting modes described above, and attribute information that can specify in which shooting mode the shooting mode is added is added to the shot image. The The display control apparatus of the present invention can reproduce an image shot by such an imaging apparatus, and can also read shooting mode attribute information added to the image. Note that the display control apparatus of the present invention may be the above-described imaging apparatus itself having a reproduction mode.

  <Display Control Processing> Next, with reference to FIG. 2, the display control processing by the imaging apparatus of this embodiment will be described. A program for performing the processing of FIG. 2 is stored in the memory 108 in advance, and is read and executed as appropriate by the control unit 107.

  In FIG. 2, in step S200, the control unit 107 determines the display setting. If the list display setting is set, the process proceeds to step S201. If the single reproduction setting is set, the process proceeds to step S209.

  In step S201, the control unit 107 assigns 1 to a variable n that stores an index of images to be displayed as a list. That is, a setting is made to read the first image in the list display.

  In step S <b> 202, in the control unit 107, the reading unit 101 reads n-th image data from the recording medium 100, and the image data expanded by the expansion unit 103 is written in the memory 102.

  In step S <b> 203, the control unit 107 acquires attribute information of the nth image data written in the memory 102.

  In step S204, the control unit 107 determines whether the image data is captured in the underwater mode from the attribute information acquired by the capturing mode determination unit 104. If the image was taken in the underwater mode, the process proceeds to step S205. If the image was taken in a mode other than the underwater mode, the process proceeds to step S206. Although the underwater mode is determined here, the present invention is not limited to this, and the present invention is applicable to any shooting mode in which the imaging device is frequently photographed with the imaging device facing up or down. For example, the cooking mode (the frequency with which the imaging device is photographed directly from above the dish on the plate is high) and the celestial mode (the imaging device is frequently photographed with the imaging device facing directly above the celestial body) , Text shooting mode (high frequency of shooting from above the document with the imaging device pointing directly down), and the like can be considered.

  In step S205, the display control unit 105 displays an image on the display unit 106 without reflecting the posture information in the acquired attribute information. Note that “without reflecting the posture information” means that image rotation processing according to the posture information indicating the detection result of the posture of the imaging apparatus at the time of shooting is not performed (hereinafter referred to as “reflecting the posture information”). Do not (do not) "is used interchangeably).

  On the other hand, in step S206, the display control unit 105 displays an image on the display unit 106 by reflecting the posture information in the acquired attribute information. Note that “reflect posture information” means that image rotation processing is performed according to posture information indicating the detection result of the posture of the imaging apparatus at the time of shooting (hereinafter, “reflect posture information ( And ")" are used in the same meaning). The image is normally recorded on the recording medium 100 in a horizontally long state (landscape) without being rotated at the time of shooting. Therefore, if an image taken with the imaging device in the vertical position is displayed as it is, it will be displayed in landscape orientation and displayed in a different orientation from the portrait orientation that the photographer was observing at the time of photography. become. However, when displaying the posture information, if the posture information indicates that the image is taken in the vertical position, the image recorded on the recording medium 100 is displayed by being rotated 90 degrees to display the image at the time of shooting. The image can be displayed in the same vertical direction as the direction that the person was observing.

  In step S207, the control unit 107 determines whether the variable n has reached the index display number of the list display. If the variable n has not reached the list display number, the process proceeds to step S209, and if the variable n has reached the list display number, This process ends.

  In step S208, the control unit 107 increments the variable n and returns to step S202. That is, the second and third images are read until the index display number of the list display is reached, and the shooting mode is similarly determined to determine whether to reflect the posture information added to the image data. And display.

  On the other hand, if single reproduction is set in step S200, the image data selected by the reading unit 101 for single reproduction is read from the recording medium 100 in step S209 and the image expanded by the expansion unit 103 is read. Data is written to the memory 102.

  In step S <b> 210, the control unit 107 acquires attribute information of image data written in the memory 102.

  In step S211, the control unit 107 determines whether the image data is captured in the underwater mode from the attribute information acquired by the capturing mode determination unit 104. Then, the process proceeds to step S212 when the image is captured in the underwater mode, and the process proceeds to step S213 when the image is captured in a mode other than the underwater mode. Here, the underwater mode is determined, but the present invention is not limited to this, and it may be a specific shooting mode such as a cooking mode or an astronomical mode in which the imaging device is frequently shot up and down.

  In step S212, since the image was shot in a specific shooting mode, the display control unit 105 displays an image on the display unit 106 without reflecting the posture information in the acquired attribute information, and the process ends.

  On the other hand, in step S213, since the image was shot in a shooting mode other than the specific shooting mode, the display control unit 105 displays the image on the display unit 106 reflecting the posture information in the attribute information, and the process ends.

  According to the first embodiment described above, the image is displayed without reflecting the posture information on the image shot in the shooting mode in which the imaging device is shot up and down frequently. The image can be prevented from being displayed in the orientation.

  [Embodiment 2] Next, Embodiment 2 will be described.

  The apparatus configuration of the second embodiment is the same as that of FIG. 1 described in the first embodiment.

  Hereinafter, the display control process of the second embodiment will be described with reference to FIG. 3, but the description of the same process as that of FIG. 2 of the first embodiment will be omitted or simplified. A program for performing the processing of FIG. 3 is stored in the memory 108 in advance, and is read and executed as appropriate by the control unit 107.

  In FIG. 3, steps S300 to S303 are the same as steps S200 to S203 of FIG.

  In step S304, the control unit 107 determines whether the underwater image non-rotation flag is set to ON. If the flag is set to ON, the process proceeds to step S305. If the flag is set to OFF, step S307 is performed. Migrate to The underwater image non-rotation flag is a flag indicating that the display is performed without reflecting the rotation information of the image data taken underwater. The setting of the underwater image non-rotation flag will be described later.

  Next, steps S306 to S309 are the same as steps S204 to S208 in FIG.

  If the variable n has reached the index display number of the list display in step S308, the process proceeds to step S316.

  On the other hand, if single-image playback has been set in step S300, the process proceeds to step S310. Steps S310, S311, and S313 to S315 are the same as steps S209, S210, S211, S212, and S213 of FIG. The difference from FIG. 2 is that it is determined whether or not the underwater image non-rotation flag is set to ON in step S312 preceding step S313. That is, in step S312, the control unit 107 proceeds to step S313 if the underwater image non-rotation flag is set to ON, and proceeds to step S315 if it is set to OFF. And after step S314 and S315, it transfers to step S316.

  In step S316, the control unit 107 displays the “underwater image batch rotation” icon 402 at the lower right of the list screen 401 shown in FIG. 4A or the lower right of the single image playback screen 403 shown in FIG. 4B. It is determined whether the “underwater image batch rotation” icon 404 as shown in FIG. If the icon is pressed from these setting screen items, the process proceeds to step S317, and the underwater image non-rotation flag is set to ON. The underwater image non-rotation flag is a flag for setting an image captured in the underwater mode to be displayed without reflecting the posture information. Therefore, by setting the underwater image non-rotation flag to ON, an image shot in the underwater mode that is displayed reflecting the posture information is uniformly landscape. After that, the process returns to step S300 to draw an image.

  On the other hand, if the icon is not pressed in step S316, the process proceeds to step S318. In step S318, the control unit 107 determines whether the user has turned off the power. If the power is off, the control unit 107 terminates the process. If the user is on, the control unit 107 returns to step S316 and performs polling to determine whether the icon has been pressed.

  Here, the case where an icon is displayed as an operation for setting the underwater image non-rotation flag and the icon is selected has been described as an example, but the present invention is not limited to this. For example, “Underwater image batch rotation” may be prepared in the menu 405 of the selection screen shown in FIG. 4C and set when the user selects it. Further, when the user rotates and corrects any one of the image data photographed underwater, a confirmation message 406 as shown in FIG. 4D is displayed, and the user selects “Yes” You may set to.

  According to the second embodiment described above, when it is determined that the image is not intended to be rotated with respect to an image shot in a shooting mode in which the user frequently shoots the image pickup apparatus up and down, a simple operation can be performed. It is possible to perform rotation correction of an image shot in a specific shooting mode. In addition, it is possible to omit the operation of the user to perform rotation correction on all images by performing rotation correction on images shot in other modes triggered by any one of the rotation corrections. .

  [Third Embodiment] Processing for editing attribute information will be described as a third embodiment.

  The apparatus configuration of the third embodiment is the same as that of FIG. 1 described in the first embodiment. The display control process is the same as that in FIG. 2 described in the first embodiment.

  Hereinafter, the process of editing the attribute information will be described with reference to FIG. Note that the program for performing the processing of FIG. 5 is stored in the memory 108 in advance, and is read and executed as appropriate by the control unit 107.

  In FIG. 5, in step S500, the control unit 107 waits for the edit button to be pressed. If the edit button is pressed, the control unit 107 proceeds to step S501.

  Steps S501 to S504 are the same as steps S201 to S204 in FIG. Here, the operation of the edit button is given as an example, but the present invention is not limited to this, and for example, selection by a menu may be used.

  In step S504, the control unit 107 proceeds to step S505 when it is determined that the image data was captured in the underwater mode, and proceeds to step S507 when captured in a mode other than the underwater mode. Here, the underwater mode is determined, but the present invention is not limited to this, and it may be a specific shooting mode such as a cooking mode or an astronomical mode in which the imaging device is frequently shot up and down.

  In step S <b> 505, the attribute information editing unit 110 corrects the posture information out of the attribute information added to the nth image data written in the memory 102 without rotation, and writes it in the memory 102.

  In step S506, the compression unit 111 compresses the nth image data written in the memory 102, and the writing unit 112 writes the compressed image data to the recording medium 100.

  In step S507, the control unit 107 determines whether the variable n has reached the number of image data recorded on the recording medium 100. If not, the control unit 107 proceeds to step S508, and if it has reached, the process ends. .

  In step S508, the control unit 107 increments the variable n and returns to step S502. That is, the second and third images are read until the number of image data recorded on the recording medium 100 is reached, and the shooting mode is determined in the same manner, and the posture information added to the image data is not rotated. Decide whether or not to modify and edit.

  Here, the processing for editing the posture information of the attribute information for all the image data recorded on the recording medium 100 has been described, but editing may be performed for one image.

  According to the third embodiment described above, the posture information of an image shot in a shooting mode with a high frequency of shooting with the imaging device facing up and down is edited. Can be displayed.

  Note that the control of the control unit 107 may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.

  In the embodiment described above, any display control apparatus that displays an image can be applied. That is, the present invention can be applied to a personal computer, a PDA, a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a music player, a game machine, an electronic book reader, and the like.

  [Other Embodiments] The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program code. It is processing to do. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (9)

Reading means for reading image data and its attribute information from the recording medium;
Determination means for determining whether or not the read image data is shot in a specific shooting mode from the attribute information read by the reading means;
When it is determined by the determination means that the read image data has been shot in a shooting mode other than the specific shooting mode, an image is reflected reflecting the posture information at the time of shooting included in the attribute information of the read image data. Display control means for displaying and controlling to display an image without reflecting the posture information when it is determined that the image has been shot in the specific shooting mode;
Display means for displaying a setting screen for setting whether to display without reflecting the posture information;
An operation means for accepting an operation for a user to select or determine an item included in the setting screen;
The display control unit includes the read attribute information when it is determined that the shooting is performed in a shooting mode other than the specific shooting mode when the operation unit is set to display without reflecting the posture information. An image is displayed reflecting posture information at the time of shooting, and when it is determined that the image was shot in the specific shooting mode, control is performed so that the image is displayed without reflecting the posture information. Display control device. Reading means for reading image data and its attribute information from the recording medium;
  Determination means for determining whether or not the read image data is shot in a specific shooting mode from the attribute information read by the reading means;
  When it is determined by the determination means that the read image data has been shot in a shooting mode other than the specific shooting mode, an image is reflected reflecting the posture information at the time of shooting included in the attribute information of the read image data. Display control means for displaying and controlling to display an image without reflecting the posture information when it is determined that the image has been shot in the specific shooting mode;
  The display control apparatus characterized in that the specific photographing mode is an underwater mode, a cooking mode, or an astronomical mode. Writing means for writing image data and its attribute information to a recording medium;
Determination means for determining whether or not the read image data is shot in a specific shooting mode from the attribute information read from the recording medium;
When it is determined that the image was taken in a shooting mode other than the specific shooting mode, image data is recorded while maintaining the posture information at the time of shooting included in the read attribute information, and the image is shot in the specific shooting mode. If determined, editing means for correcting the posture information without rotation and recording image data; and
Display means for displaying a selection screen for selecting whether or not to edit the posture information;
An operation means for accepting an operation for a user to select or determine an item included in the selection screen;
If it is determined that the shooting is performed in a shooting mode other than the specific shooting mode when the selection of editing the posture information is performed by the operation unit, the editing unit determines whether the shooting is included in the read attribute information. Image data is recorded with the posture information as it is, and when it is determined that the image has been shot in the specific shooting mode, the posture information is corrected without rotation and the image data is recorded . that table示制control device. Wherein a specific photographing mode, the display control device according to claim 1 or 3, characterized in that water mode, a cooking mode or astronomical mode. A reading step in which reading means reads image data and its attribute information from the recording medium;
A determination step of determining whether or not the read image data was shot in a specific shooting mode from the read attribute information;
When the display control unit determines that the read image data has been shot in a shooting mode other than the specific shooting mode, the image reflects the posture information at the time of shooting included in the attribute information of the read image data. A control step for controlling to display an image without reflecting the posture information when it is determined that the image has been shot in the specific shooting mode;
A display step of displaying a setting screen for setting whether or not the display means displays without reflecting the posture information;
An operation step of accepting an operation for a user to select or determine an item included in the setting screen;
In the control step, if it is determined in the operation step that display is performed without reflecting the posture information, and it is determined that the image is shot in a shooting mode other than the specific shooting mode, the read attribute information includes An image is displayed reflecting posture information at the time of shooting, and when it is determined that the image was shot in the specific shooting mode, control is performed so that the image is displayed without reflecting the posture information. Display control method.   A reading step in which reading means reads image data and its attribute information from the recording medium;
  A determination step of determining whether or not the read image data was shot in a specific shooting mode from the read attribute information;
  When the display control unit determines that the read image data has been shot in a shooting mode other than the specific shooting mode, the image reflects the posture information at the time of shooting included in the attribute information of the read image data. And a control step of controlling to display an image without reflecting the posture information when it is determined that the image has been shot in the specific shooting mode, and
  The display control method, wherein the specific photographing mode is an underwater mode, a cooking mode, or an astronomical mode. A writing step in which writing means writes image data and its attribute information to a recording medium;
A determination step of determining whether or not the read image data is shot in a specific shooting mode from the attribute information read from the recording medium;
When it is determined that the editing unit has shot in a shooting mode other than the specific shooting mode, the image data is recorded without changing the posture information at the time of shooting included in the read attribute information, and the specific shooting mode is recorded. If it is determined that the image was taken in the editing step, the posture information is corrected without rotation and the image data is recorded and controlled.
A display step in which a display means displays a selection screen for selecting whether or not to edit the posture information;
An operation step of receiving an operation for a user to select or determine an item included in the selection screen;
In the editing step, when it is determined that the shooting is performed in a shooting mode other than the specific shooting mode when the selection of editing the posture information is performed in the operation step, the shooting time included in the read attribute information Image data is recorded with the posture information as it is, and when it is determined that the image has been shot in the specific shooting mode, control is performed so that the posture information is corrected without rotation and the image data is recorded. Display control method to be performed. The program for functioning a computer as each means of the display control apparatus of any one of Claims 1 thru | or 4 . A computer-readable storage medium storing a program for causing a computer to function as each unit of the display control device according to any one of claims 1 to 4 .

Images