JP2008005427A - Imaging apparatus and imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To accurately detect and record the top-bottom direction of a picked-up image. <P>SOLUTION: Face detection information contains the position of the face on an image, the size of the face, reliability indicating certainty that a detection result is the face, and a rotating angle of the image at a time when the face is detected. The face detection information is included in meta-information and recorded in a management information recording area of a recording medium in accordance with a still image file or a moving image file. When reproducing the still image file or the moving image file, the rotating angle of the image is acquired from the meta-information, and the image is rotated and displayed in accordance with the rotating angle. The imaging apparatus may be applicable to digital still cameras, digital video cameras and the like. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program, and more particularly, to an imaging apparatus, an imaging method, and a program that record the top-and-bottom direction of a captured image in association with an image signal.

  When displaying an image taken with a digital still camera or digital video camera on the display, information indicating the top-to-bottom direction of the image is taken so that the image is not tilted 90 ° horizontally or upside down. It is desirable to obtain.

  Conventionally, as a method of acquiring the image top-and-bottom direction at the time of imaging, there is a method in which a gravitational sensor that detects the direction of gravity is provided in the camera and the detected gravity direction is set to the image top-and-bottom direction (see, for example, Patent Document 1).

JP-A-10-173984

  However, the method of setting the gravity direction as the top-to-bottom direction of the image increases the cost by providing a gravity sensor. In addition, for example, when shooting in an accelerating vehicle, the direction of gravity may not match the vertical direction of the image. Further, for example, when a subject is imaged looking down from a high place, the gravity direction coincides with the optical axis of the camera, and the vertical direction of the image may not be determined.

  The present invention has been made in view of such a situation, and makes it possible to accurately detect and record the vertical direction of an image without newly providing a gravity sensor or the like.

  An imaging apparatus according to an aspect of the present invention is an imaging apparatus that records an image signal corresponding to a captured subject on a recording medium, and a generation unit that captures the subject and generates an image signal corresponding to the subject. Detecting means for detecting a human face from an image of the image signal, and generating face detection information including first direction information indicating a relative direction in the image in the vertical direction of the detected face; Meta information generating means for generating meta information corresponding to the image signal including face detection information, and recording means for associating the image signal and the meta information with each other and recording them on the recording medium.

  The detection means sets a rotation angle for the generated image signal, detects a human face from the rotated image, and detects the relative direction of the detected image in the vertical direction of the face. It is possible to generate face detection information including the rotation angle as the first direction information indicating.

  The imaging apparatus according to an aspect of the present invention may further include a detection unit that detects camera shake during imaging, and the meta information generation unit detects the detected face detection information when the face detection information is not generated. Based on camera shake, second direction information indicating the vertical direction of the image of the generated image signal is generated, and meta information corresponding to the image signal is generated including the generated second direction information. Can be.

  The imaging apparatus according to an aspect of the present invention may further include an encoding unit that encodes the generated image signal, and the meta information generation unit is configured such that when the face detection information is not generated, Generate second direction information indicating the vertical direction of the image of the generated image signal based on the motion vector on the image of the image signal calculated in the process of encoding and the detected camera shake. Then, it is possible to generate meta information corresponding to the image signal including the generated second direction information.

  The recording means can record the image signal and the meta information in association with each other in different recording areas of the recording medium.

  The image pickup apparatus according to one aspect of the present invention, when displaying an image signal reproduced from the recording medium, based on the first or second direction information included in the meta information corresponding to the image signal, Rotating means for rotating the image of the signal may be further included.

  An imaging method according to an aspect of the present invention is an imaging method of an imaging apparatus that records an image signal corresponding to a captured subject on a recording medium. A face is detected, face detection information including first direction information indicating a relative direction in the image in the vertical direction of the detected face is generated, and a meta corresponding to the image signal including the face detection information is generated. Generating information, and associating and recording the image signal and the meta information on the recording medium.

  A program according to one aspect of the present invention is a program for controlling an imaging apparatus that records an image signal corresponding to a captured subject on a recording medium, and the program is performed on the image of the image signal corresponding to the subject. A face of the person is detected, face detection information including first direction information indicating a relative direction of the detected image in the vertical direction of the face is generated, and the face detection information is included in the image signal. Corresponding meta information is generated, and the computer is caused to execute a process including a step of associating the image signal with the meta information and recording it on the recording medium.

  In one aspect of the present invention, a human face is detected from an image of an image signal corresponding to a subject, and face detection includes first direction information indicating a relative direction in an image in the vertical direction of the detected face. Information is generated, meta information corresponding to the image signal including the face detection information is generated, and the image signal and the meta information are associated with each other and recorded on the recording medium.

  According to one aspect of the present invention, the top-to-bottom direction of an image can be accurately detected and recorded.

  Embodiments of the present invention will be described below. Correspondences between constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  The image pickup apparatus according to claim 1, in an image pickup apparatus (for example, the image pickup apparatus 10 in FIG. 1) that records an image signal corresponding to the imaged subject on a recording medium, the image signal corresponding to the subject by photographing the subject. Generating means (for example, the imaging unit 11 in FIG. 1), and detecting a human face from the image of the generated image signal, and determining the relative direction of the detected image in the vertical direction of the face. Detection means for generating face detection information including first direction information shown (for example, face detection unit 52 in FIG. 3), and meta information generation for generating meta information corresponding to the image signal including the face detection information Means (for example, the control unit 21 in FIG. 1) and recording means (for example, the media drive 16 in FIG. 1) that records the image signal and the meta information in association with each other on the recording medium.

  The image pickup apparatus according to a third aspect further includes a detection unit (for example, a camera shake detection unit 12 in FIG. 1) that detects a camera shake at the time of imaging.

  The imaging apparatus according to a fourth aspect further includes an encoding unit (for example, the encoding / decoding unit 15 in FIG. 1) that encodes the generated image signal.

  The image pickup apparatus according to claim 6, when displaying an image signal reproduced from the recording medium, based on the first or second direction information included in the meta information corresponding to the image signal. Rotating means (for example, the image signal rotating unit 39 in FIG. 2) for rotating the image of the image.

  The imaging method according to claim 7 and the program according to claim 8 shoot a subject, detect a human face from an image of an image signal corresponding to the subject, and detect the face in the vertical direction of the detected face. Face detection information including first direction information indicating a relative direction in the image is generated (for example, step S1 in FIG. 7), and meta information corresponding to the image signal including the face detection information is generated ( For example, step S3 in FIG. 7 includes the step of recording the image signal and the meta information in association with each other on the recording medium (for example, step S4 in FIG. 7).

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  FIG. 1 shows a configuration example of an imaging apparatus according to an embodiment of the present invention. The imaging apparatus 10 captures a moving image or a still image, records it on a recording medium, and displays a moving image or a still image reproduced from the recording medium.

  The imaging apparatus 10 includes an imaging unit 11 that generates an image signal corresponding to an optical image of a subject, an image signal processing unit 14 that performs predetermined image processing on the image signal, and an encoding decoding that encodes and decodes the image signal. 15, a media drive 16 that records and reads out image signals and the like on the recording medium 17, a display unit 18 that displays captured images and various setting screens, an operation unit 19 that receives user operations, and a memory The control unit 21 is configured to control the entire imaging apparatus 10 by executing a control program recorded in the control unit 20.

  The imaging unit 11 includes an imaging element such as a lens group, a diaphragm, and a CCD (Charge Coupled Device), converts an optical image of a subject focused by the lens group into an image signal by the imaging element, and supplies the image signal to the image signal processing unit 14. Output. The imaging unit 11 includes a gyro sensor that does not include the camera shake detection unit 12 and the camera shake correction unit 13. The camera shake detection unit 12 detects a user's camera shake, and corrects image signal degradation caused by the camera shake. A camera shake correction unit 13 is built in. The information indicating the detected camera shake is also notified to the control unit 21 and used for determining the rotation angle of the image.

  The image signal processing unit 14 performs predetermined image processing on the image signal input from the imaging unit 11 and the decoded image signal input from the encoding / decoding unit 15 and outputs the processed image signal to the encoding / decoding unit 15 or the display unit 18. To do. The image signal processing unit 14 detects a human face from the image of the image signal input from the imaging unit 11 and notifies the control unit 21 of face detection information as a detection result. The notified face detection information is recorded in the meta information, and is used to determine the rotation angle of the image when the image is reproduced and displayed.

  FIG. 2 shows a configuration example of the image signal processing unit 14. The image signal processing unit 14 includes a noise removing unit 31 that removes noise components of the image signal, a size changing unit 33 that changes the image frame size of the image signal, a signal conversion unit 34 that performs predetermined image processing on the image signal, and an image signal. An image information detection unit 35 that detects a human face from the image of the image, an image synthesis unit 36 that synthesizes another image with the image of the image signal, a selector 38 that switches the output destination of the image signal, and an image that becomes easy to see when displayed. Thus, the image signal rotation unit 39 is configured to rotate the image based on the image rotation angle.

  The noise removing unit 31 compares the image signal input from the imaging unit 11 with the image signal from which noise has been removed one frame before recorded in the frame memory 32, thereby inputting the image signal input from the imaging unit 11. Are detected, and the detected noise component is removed from the image signal. The image signal from which the noise component has been removed is supplied to the subsequent size changing unit 33 and is overwritten and saved in the frame memory 32.

  The size changing unit 33 appropriately enlarges or reduces the image frame size of the image signal input from the previous stage and outputs the image frame size to the signal conversion unit 34. Based on the setting from the user, the signal conversion unit 34 performs sepia color processing, mosaic processing, monochrome processing, and the like on the image signal input from the previous stage to the image information detection unit 35 and the image synthesis unit 36 in the subsequent stage. Output.

  As shown in FIG. 3, the image information detection unit 35 includes a still image generation unit 51 that generates a still image based on an image signal input from the previous stage, and a face detection unit that detects a human face existing on the still image. 52 and a thumbnail generation unit 53 that generates a thumbnail image of the input still image.

  The still image generation unit 51 generates a still image only at the time of moving image capture, and outputs the still image signal from the previous stage as it is to the subsequent stage at the time of still image capture. The face detection unit 52 rotates the still image in units of 90 °, detects the human face existing on the image based on the luminance distribution of the rotated still image, and generates face detection information only when it can be detected. The control unit 19 is notified.

  The face detection unit 52 can detect the face of an upright person in a state where the still image is rotated at each rotation angle. For example, in the case of the still image shown in FIG. 4A, a human face is detected when the rotation angle is 0 °. In the case of the still image shown in FIG. 4B, a human face is detected when the rotation angle is 270 °. In the case of the still image shown in FIG. 4C, a human face is detected when the rotation angle is 180 °. In the case of the still image shown in FIG. 4D, a human face is detected when the rotation angle is 90 °.

  In the face detection information, as shown in FIG. 5, the position (coordinates) of the face on the image, the size of the face, the reliability indicating the certainty that the detection result is a face, and when the face is detected The rotation angle of the image is included.

  For example, as shown in FIG. 4D, when a plurality of faces are detected from a still image of one frame, face detection information is generated for the number of detected faces and notified to the control unit 19.

  The thumbnail image generation unit 53 outputs the generated thumbnail image to the control unit 19.

  Returning to FIG. Based on the setting from the user, the image composition unit 36 performs a fade-in process, a fade-out process on the input image signal, or a graphic composition process for compositing an image recorded in the memory 37 in advance to the selector 38. Output. The selector 38 outputs the image signal input from the image synthesis unit 36 to both or one of the encoding / decoding unit 15 and the display unit 18.

  The image signal rotation unit 39 rotates the decoded image signal input from the encoding / decoding unit 15 based on the image rotation angle of the face detection information included in the corresponding meta information so that the user can easily view the displayed image signal. Then, the data is output to the subsequent size changing unit 13.

  Note that the configuration example of the image signal processing unit 14 shown in FIG. 2 may be realized by either hardware or software.

  Returning to FIG. The encoding / decoding unit 15 converts the image signal input from the image signal processing unit 14 into a predetermined encoding method (for example, MPEG (Moving Picture Experts Group) 2 method for moving images, JPEG for still images). (Joint Photographic Experts Group) method and the like, and the resulting encoded image signal is output to the media drive 16. The encoding / decoding unit 15 notifies the control unit 21 of the motion vector of the image detected at the time of encoding. The notified motion vector is used to determine the rotation angle of the image.

  Further, the encoding / decoding unit 15 decodes the encoded image signal read from the recording medium 17 by the media drive 16 and outputs the resulting image signal to the image signal processing unit 14.

  The media drive 16 records the encoded image signal input from the encoding / decoding unit 15 on the recording medium 17. The media drive 16 records the file management information input from the control unit 21 on the recording medium 17.

  FIG. 6 shows a file recording area 71 and a file management information recording area 72 provided on the recording medium 17.

  An encoded image signal is recorded in the file recording area 71. Hereinafter, an encoded image signal corresponding to a still image is also referred to as a still image file, and an encoded image signal corresponding to a moving image is also referred to as a moving image file. Note that an audio file corresponding to the moving image file is also recorded in the file recording area 71.

  The file management information recording area 72 is generated based on the recording position information indicating the position on the recording medium 17 where each content file such as a still image file, a moving image file, and an audio image file is recorded, and each content file. The thumbnail image and meta information (including face detection information) of each content file are recorded in association with each content file.

  Returning to FIG. The display unit 18 is composed of an LCD (Liquid Crystal Display) or the like, and based on the image signal input from the image signal processing unit 14, a through image for determining a composition at the time of imaging, and a still image recorded on the recording medium 17. Displays a playback image obtained by playing back a file or moving image file, various setting screens, and the like.

  The operation unit 19 includes buttons, switches, or a touch panel installed on the display unit 18 so as to be turned on / off, shutter operation, recording start / end instruction, input of various settings, and the like. The operation is accepted and an operation signal corresponding to the operation is output to the control unit 21.

  When face detection information is input from the image signal processing unit 14, the control unit 21 includes the face detection information in the meta information and outputs it to the media drive 16 together with the thumbnail image, and outputs it to the file management information recording area 72 of the recording medium 17. Let me record. When face detection information is not input from the image signal processing unit 14, the rotation angle of the image that is easy to see when the image is displayed is determined based on the camera shake information from the camera shake detection unit 12. Information is generated and output together with the thumbnail image to the media drive 16 and recorded in the file management information recording area 72 of the recording medium 17.

  Next, the operation of the imaging device 10 will be described. When the power supply of the imaging device 10 is turned on, the image signal obtained by the photoelectric conversion is continuously output from the imaging unit 11 to the image signal processing unit 14. In the image signal processing unit 14, the input image signal is reduced by thinning out pixels or the like and output to the display unit 18. The display unit 18 displays a through image for composition determination based on the input image signal.

  For example, when the user gives an instruction to capture a still image (when a shutter operation is performed), the image signal processing unit 14 encodes and decodes the image signal of the still image corresponding to the timing of the shutter operation. And the face detection information and thumbnail image for the still image are generated and output to the control unit 21. However, there are cases where a face is not detected from a still image and face detection information is not output.

  The encoding / decoding unit 15 encodes the input still image signal and outputs the encoded image signal obtained as a result to the media drive 16. The media drive 16 records the input encoded image signal in the file recording area 71 of the recording medium 17 as a still image file.

  On the other hand, the control unit 21 generates meta information including the face detection information input from the image signal processing unit 14 and outputs it to the media drive 16 together with the thumbnail image. When face detection information is not input from the image signal processing unit 14, the rotation angle of the image is determined based on the camera shake information, and the determined image rotation angle is included in the meta information.

  The media drive 16 records the thumbnail image and meta information input from the control unit 19 in the file management information recording area 72 of the recording medium 17. Further, the media drive 16 updates the recording position information in the file management information recording area 72 in accordance with the recorded still image file in accordance with the control from the control unit 21.

  Also, for example, when the user instructs to start recording a moving image, the image signal processing unit 14 continues to output the image signal to the encoding / decoding unit 15 and stops based on the top image signal of the moving image. An image is generated, face detection information for the still image and a thumbnail image are generated and output to the control unit 21. In addition, while capturing a moving image, a still image is generated for each predetermined period to detect a face, a thumbnail image is generated, and face detection information and a thumbnail image are periodically output to the control unit 21. It may be.

  The encoding / decoding unit 15 encodes sequentially input image signals and outputs the resulting encoded image signal to the media drive 16. The media drive 16 records the input encoded image signal in the file recording area 71 of the recording medium 17 as a moving image file.

  On the other hand, the control unit 21 generates meta information including the face detection information input from the image signal processing unit 14 and outputs it to the media drive 16 together with the thumbnail image. When face detection information is not input from the image signal processing unit 14, an image rotation angle is determined based on camera shake information or a motion vector in the image, and the determined image rotation angle is included in the meta information.

  The media drive 16 records the thumbnail image and meta information input from the control unit 19 in the file management information recording area 72 of the recording medium 17. When face detection information and thumbnail images are periodically output from the image signal processing unit 14, meta information and thumbnail images including face detection information are also periodically recorded in the file management information recording area 72.

  Then, when the end of video recording is instructed, the image signal processing unit 14 ends the encoding of the image signal. The media drive 16 closes the moving image file being recorded, and updates the recording position information in the file management information recording area 72 in accordance with the recorded moving image file in accordance with the control from the control unit 21.

  Of the operations of the imaging apparatus 10 described above, the details of the processing for recording the rotation angle of the image signal (hereinafter referred to as image rotation angle recording processing) will be described with reference to the flowchart of FIG.

  In step S1, the image information detection unit 35 of the image signal processing unit 14 detects a human face from the image of the image signal input from the previous stage. The process of step S1 will be described with reference to the flowchart of FIG.

  In step S11, when the image signal input from the previous stage corresponds to a moving image, the still image generation unit 51 generates a still image based on the image signal, and the face detection unit 52 and the thumbnail generation unit 53. Output to. When the image signal input from the previous stage corresponds to a still image, the image signal is output as it is to the face detection unit 52 and the thumbnail generation unit 53.

  In step S12, the face detection unit 52 sets the rotation angle of the input still image to 0 °. That is, the input state is maintained without rotating the image. The thumbnail generation unit 53 generates a thumbnail image corresponding to the input still image and outputs the thumbnail image to the control unit 21.

  In step S13, the face detection unit 52 detects a human face from the still image based on the luminance distribution of the still image in which the rotation angle is set. In step S14, the face detection unit 52 determines whether or not a human face has been detected from the still image. If it is determined that a human face has been detected, the process proceeds to step S15.

  In step S15, the face detection unit 15 generates face detection information including information on each item shown in FIG. 5 corresponding to the detected human face. The rotation angle at which the current still image is set is recorded as the image rotation angle of the face detection information. The generated face detection information is output to the control unit 21. If it is determined in step S14 that no human face is detected, the process in step S15 is skipped.

  In step S16, the face detection unit 52 determines whether or not the current rotation angle of the still image is 270 °, and if not, the process proceeds to step S17. In step S17, the face detection unit 52 sets the current rotation angle of the still image to be increased by 90 °, and returns the process to step S13. Thereafter, the processes in steps S13 to S17 are repeated. As a result, the rotation angle of the still image is sequentially set to 0 °, 90 °, 180 °, and 270 °, and a human face is detected. If it is determined in step S16 that the current rotation angle of the still image is 270 °, the process returns to step S2 in FIG.

  In step S <b> 2, the control unit 21 determines whether face detection information is input from the image signal processing unit 14. If it is determined that face detection information has been input, the process proceeds to step S3. In step S3, the control unit 21 generates meta information of the image signal including the input face detection information. In step S <b> 4, the control unit 21 outputs the generated meta information and the thumbnail image input from the image signal processing unit 14 to the media drive 16 and records them in the file management information recording area 72 of the recording medium 17.

  Conversely, if it is determined in step S2 that face detection information is not input from the image signal processing unit 14, the process proceeds to step S5. In step S <b> 5, the control unit 21 determines the rotation angle of the image based on the camera shake information input from the camera shake detection unit 12 and the motion vector on the image input from the encoding / decoding unit 15. However, since the motion vector on the image is input from the encoding / decoding unit 15 only when a moving image is captured, the image based on only the camera shake information input from the camera shake detection unit 12 is captured when a still image is captured. Determine the rotation angle.

  Details of the process of step S6 will be described with reference to the flowchart of FIG.

  In step S <b> 21, the control unit 21 acquires camera shake information from the camera shake detection unit 12. In step S <b> 22, the control unit 22 acquires a motion vector on the image corresponding to the image signal to be encoded from the encoding / decoding unit 15.

  In step S23, the control unit 21 calculates a locus of blurring of the optical axis of the imaging unit 11 based on the acquired camera shake information and the motion vector. In step 24, the control unit 21 performs image processing based on the locus. Determine the top and bottom direction (rotation angle when displaying).

  Specifically, it is known that the locus of blurring of the optical axis of the imaging unit 11 due to camera shake usually draws an elliptical orbit as indicated by 10. Among the elliptical trajectories, the long axis amplitude is known to be caused by the vertical camera shake that occurs in synchronization with the user's breathing. Therefore, the long axis direction of the elliptical movement is defined as the vertical direction of the image. Therefore, 0 °, 90 °, 180 ° or 270 ° closest to this angle is determined as the rotation angle. After determining the rotation angle, the process returns to step S7 in FIG.

  In step S7, the control unit 21 generates meta information of the image signal including the rotation angle determined based on the camera shake. Thereafter, the process proceeds to step S4, and the generated meta information and thumbnail image are recorded in the file management information recording area 72 of the recording medium 17.

  As described above, according to the imaging apparatus 10, when a moving image or a reproduced image is captured, the rotation angle when displaying the image is associated with the moving image file or the still image file as a part of the meta information. It is recorded on the recording medium 17.

  Next, when a still image file or a moving image recorded on the recording medium 17 is played back and displayed, the image rotation angle included in the correspondingly recorded meta information is used to display the image in an easily viewable manner ( Hereinafter, it will be described with reference to the flowchart of FIG.

  For example, when an operation for instructing reproduction of a still image file recorded on the recording medium 17 is input by the user, the still image file instructed to be reproduced from the recording medium 17 by the media drive 16 and the corresponding metadata are read. And output to the encoding / decoding unit 15. The encoding / decoding unit 15 decodes the encoded still image file, and outputs the image signal and meta information obtained as a result to the image signal processing unit 14.

  In step S31, the image signal rotation unit 39 of the image signal processing unit 14 acquires the rotation angle of the image from the input meta information. When a plurality of human faces are present on this one frame image, the meta information includes a plurality of face detection information, and the rotation angle can be acquired from each face detection information. Thus, when there are a plurality of face detection information, the face detection information that has the highest reliability is selected from the face detection information, and the image rotation angle is obtained from the selected face detection information.

  In step S32, the image signal rotation unit 39 rotates the image signal based on the acquired image rotation angle and outputs it to the subsequent stage. As a result, the image displayed on the display unit 18 through the subsequent processing should be easy to see with the vertical direction of the subject coincident with the vertical direction of the display. However, since the display direction of the image may not match the user's intention, the display direction of the image is matched with the user's intention by the processing after step S33.

  In step S33, the control unit 21 determines whether or not an operation for instructing to change the display direction of the displayed image is input from the user for a predetermined time. If it is determined that an operation for instructing to change the display direction of the image has been input, the process proceeds to step S34. In step S34, the image signal rotation unit 39 changes the rotation angle of the image signal being displayed in accordance with the direction instructed to be changed. In step S <b> 35, the control unit 21 updates the image rotation angle included in the meta information recorded on the recording medium 17 corresponding to the changed rotation angle. However, since the case where the user merely rotates the image temporarily may also occur, it may be confirmed whether or not the meta information may be updated.

  If it is determined in step S33 that an operation for instructing to change the image display direction has not been input even after waiting for a predetermined time, the processes in steps S34 and S35 are skipped.

  According to the above-described processing at the time of image processing, when displaying a still image, the image is displayed after being rotated based on the image rotation angle included in the corresponding meta information. Are easy to see.

  Furthermore, when the display result is not easy to see for the user, the direction of the display can be changed, and the change result can be reflected in the meta information. Therefore, when displaying an image generated by Ana, the image can be quickly displayed in an easy-to-view direction.

  In addition, when displaying a moving image, it can be similarly rotated. However, since it may be difficult to see if the moving image is rotated and displayed frequently, the image rotation angle included in the corresponding meta information is referred to when displaying the corresponding thumbnail image, and the thumbnail image is rotated. You may make it display. In principle, even when displaying a thumbnail image of a still image, it is possible to acquire and rotate the image rotation angle included in the meta information.

  Further, the image rotation angle included in the meta information is not only for displaying a still image file or a moving image file, but also for displaying a list of still image files or moving image files recorded on the recording medium 17, for example. It can also be used when only thumbnail images are displayed on the screen.

  In this case, the meta information and thumbnail information of the file management information recording area 72 may be read without reading the file recording area 71 of the recording medium 17, so that a list of thumbnail images can be quickly displayed so that each thumbnail image can be easily viewed. Can be displayed.

  As described above, according to the imaging apparatus 10 to which the present invention is applied, the display orientation that makes the image easy to see without providing a dedicated sensor (such as a gravity sensor) to determine the top-to-bottom direction of the image, that is, The rotation angle can be determined.

  In particular, since no gravity sensor is used, it is possible to determine an easy-to-view rotation angle without being influenced by the posture, vibration, acceleration, and direction of gravity at the time of shooting.

Furthermore, even when a human face cannot be detected from the image, the rotation angle at which the image can be easily viewed can be determined by using the detection result of the camera shake detection unit 12 used for camera shake correction.

  The present invention is not limited to a digital still camera and a digital video camera, and can be applied to any electronic device that processes an image signal.

  By the way, the series of processes described above can be executed by hardware, but can also be executed by software.

  In this specification, the steps executed based on the program are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes executed in time series according to the described order. It also includes processing.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the structural example of the imaging device to which this invention is applied. It is a block diagram which shows the structural example of the image signal process part of FIG. It is a block diagram which shows the structural example of the image information detection part of FIG. It is a figure for demonstrating the process of a face detection part. It is a figure which shows each item of face detection information. It is a figure which shows the file recording area and file management information recording area of a recording medium. It is a flowchart explaining an image rotation angle recording process. It is a flowchart explaining the detail of step S1 of FIG. It is a flowchart explaining the detail of step S6 of FIG. It is a figure which shows the locus | trajectory of the optical axis resulting from camera shake. It is a flowchart explaining an image display process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 imaging device, 11 imaging part, 12 camera shake detection part, 13 camera shake correction part, 14 image signal processing part, 15 encoding / decoding part, 16 media drive, 17 recording medium, 18 display part, 19 operation part, 20 memory , 21 control unit, 35 image signal detection unit, 39 image signal rotation unit, 51 still image generation unit, 52 face detection unit, 53 thumbnail generation unit,

Claims (8)

In an imaging device that records an image signal corresponding to a captured subject on a recording medium,
Generating means for photographing an object and generating an image signal corresponding to the object;
Detecting means for detecting a human face from an image of the generated image signal and generating face detection information including first direction information indicating a relative direction in the image in the vertical direction of the detected face; ,
Meta information generating means for generating meta information corresponding to the image signal including the face detection information;
An imaging apparatus comprising: a recording unit that records the image signal and the meta information in association with each other on the recording medium. The detection means sets a rotation angle for the generated image signal, detects a human face from the rotated image, and detects the relative direction of the detected image in the vertical direction of the face. The imaging device according to claim 1, wherein face detection information including the rotation angle as first direction information indicating the position is generated. It further includes detection means for detecting camera shake during imaging,
When the face detection information is not generated, the meta information generation unit generates second direction information indicating a vertical direction of an image of the generated image signal based on the detected camera shake, The imaging apparatus according to claim 1, wherein meta information corresponding to the image signal is generated including the generated second direction information. Encoding means for encoding the generated image signal;
When the face detection information is not generated, the meta information generation unit generates the meta information based on the motion vector on the image of the image signal calculated in the encoding process and the detected camera shake. The imaging according to claim 3, wherein second direction information indicating a vertical direction of an image of the image signal that has been generated is generated, and meta information corresponding to the image signal is generated including the generated second direction information. apparatus. The imaging apparatus according to claim 1, wherein the recording unit records the image signal and the meta information in association with each other in different recording areas of the recording medium. The image processing apparatus further includes a rotating unit that rotates the image of the image signal based on the first or second direction information included in the meta information corresponding to the image signal when displaying the image signal reproduced from the recording medium. The imaging device according to claim 1. In an imaging method of an imaging apparatus that records an image signal corresponding to an imaged subject on a recording medium,
Face detection information including first direction information indicating a relative direction in the image in the vertical direction of the detected face by photographing a subject and detecting a human face from an image of an image signal corresponding to the subject. Produces
Generating meta information corresponding to the image signal including the face detection information;
An imaging method including a step of recording the image signal and the meta information in association with each other on the recording medium. A program for controlling an imaging apparatus that records an image signal corresponding to a captured subject on a recording medium,
Face detection information including first direction information indicating a relative direction in the image in the vertical direction of the detected face by photographing a subject and detecting a human face from an image of an image signal corresponding to the subject. Produces
Generating meta information corresponding to the image signal including the face detection information;
A program for causing a computer to execute a process including a step of recording the image signal and the meta information in association with each other on the recording medium.

Images