JP4757227B2 - Imaging apparatus, imaging display system, and imaging method - Google Patents

Description

  The present invention relates to an imaging device, an imaging display system, and an imaging method capable of obtaining a good-looking horizontal shooting and vertical shooting image.

  In recent years, an image pickup apparatus (digital still camera) that stores an image picked up by an image pickup device as image data has been widely used. In such an imaging apparatus, light from a subject is received through an optical system by an imaging device constituted by a CCD (Charged Coupled Device) or a CMOS image sensor, converted into image data, and stored in an internal memory or the like. Image data stored in the imaging device is given to and displayed on a display unit provided in the imaging device, a display device provided outside, and the like.

  Imaging devices having a rectangular imaging surface having a long side to short side ratio of 16: 9, 4: 3, or 3: 2 are widely used in imaging devices. Hereinafter, the ratio of the long side to the short side is referred to as the aspect ratio. When the imaging device housing is held in the upright direction of the subject, the imaging device is mounted in the housing so that the imaging surface stands upright and faces the subject with the long side of the imaging surface facing the substantially horizontal direction. ing. Depending on the shape and composition of the subject, the photographer may shoot in a posture in which the imaging device is tilted by approximately 90 degrees with respect to the upright direction, that is, in a state where the long side of the imaging surface is oriented in a substantially vertical direction. . Holding the imaging device with the long side of the imaging surface facing the substantially horizontal direction and the substantially vertical direction and shooting is called horizontal shooting and vertical shooting, respectively.

  In addition, images captured in horizontal shooting and vertical shooting are referred to as horizontal shooting images and vertical shooting images, respectively. The vertically shot image is a rollover image that is rotated approximately 90 degrees clockwise or counterclockwise with respect to the upright direction, and the top and bottom are turned over. For example, when an upright person is taken vertically, the recorded vertically taken image is a rollover image with the head left or right. Exif (Exchangeable image file format), which is widely adopted as a recording format for image data of an imaging device, includes rotation information indicating the rotation angle of an image by vertical shooting and horizontal shooting, and records angle information at the time of shooting. You can also do it.

  Some imaging devices and display devices have a display function of acquiring rotation information included in image data and displaying the image upright by performing rotation correction when the rotation information indicates vertical shooting. Some image sensors provided in the imaging apparatus have imaging surfaces with aspect ratios of 4: 3 and 16: 9. The display screen of a display device installed outside an imaging device such as a television includes a standard screen with an aspect ratio of 4: 3 and a wide screen with an aspect ratio of 16: 9 which is wider than the standard screen. Here, a conventional method for displaying image data captured by an imaging device including an imaging device having an imaging surface with an aspect ratio of 16: 9 on a display device having a wide screen will be described.

  FIG. 12 is an explanatory diagram for explaining the display of the horizontally shot image data on the wide screen in the prior art. In the figure, (a), (b) and (c) are directions having a wide screen on which the direction of holding the housing of the imaging device, the side-by-side image data stored in the imaging device and the side-by-side image data are displayed. Indicates the device. Reference numerals 101 and 201 in the figure denote an image pickup device having an image pickup surface having an image pickup surface with an aspect ratio of 16: 9 and a display unit, and a display device having a wide screen with an aspect ratio of 16: 9.

  The horizontally shot image data shown in FIG. 5B is an upright image with an aspect ratio of 16: 9, and includes rotation information with a rotation angle of 0 degree. The display device 201 that has acquired the horizontally shot image data displays it on the wide screen without performing rotation correction. Since the horizontally shot image data has the same aspect ratio 16: 9 as that of the wide screen of the display device 201 shown in (c) of the figure, there is a blank portion where no image is displayed on the wide screen of the display device 201. It is displayed upright and nice without any occurrence.

  FIG. 13 is an explanatory diagram for explaining the display of vertically shot image data on a wide screen in the prior art. In the figure, (a), (b), and (c) are directions in which the housing of the imaging apparatus 101 is held, and the wide-screen image data and vertical image data stored in the imaging apparatus 101 are displayed. 1 shows a display device 201 having the same. The vertically shot image data shown in (b) in the figure is a rollover image with an aspect ratio of 16: 9, and includes rotation information with a rotation angle of +90 degrees. The display device 201 that has acquired the vertically shot image data performs an -90 degree rotation correction based on the rotation information and displays the image upright on a wide screen.

The vertically shot image subjected to the rotation correction becomes a vertically long image, and there are wide blank portions indicated by oblique lines (c) in the figure on both sides of the vertically shot image displayed on the wide screen of the display device 201, and the appearance is poor. . Japanese Patent Application Laid-Open No. 2004-228561 describes a method of setting up a display range having different aspect ratios on a square display screen provided in an imaging apparatus according to horizontal shooting and vertical shooting, and displaying the image upright with good appearance.
JP 2006-203732 A

  However, in the method described in Patent Document 1, the aspect ratio of the vertically captured image data stored is the same as the aspect ratio of the imaging surface, and when the image is displayed upright on a wide screen of a display device installed outside, FIG. As in the example shown in 13 (c), there is a problem that it looks bad. Further, even in an imaging device having an imaging surface having an aspect ratio of 4: 3, when horizontal image data is displayed upright on a wide screen of a display device installed outside, a wide blank is formed on the left and right of the displayed image. There was a problem that there was a part and it looked bad.

  The present invention has been made in view of such circumstances, and has a rectangular shape based on a determination unit that determines whether the state is horizontal shooting or vertical shooting, and image data that is output from the image sensor according to the determination result. An image displayed with a narrow margin on a display device having a wide screen by providing an extraction means for extracting image data and a storage unit for adding a determination result to the extracted image data and storing it. It is an object of the present invention to provide an imaging apparatus in which data is obtained without requiring an instruction for horizontal shooting and vertical shooting by a photographer.

  Another object of the present invention is to output an image sensor when taking an image with an imaging device having an imaging surface having a ratio substantially the same as the aspect ratio of a wide screen provided in an external display device. By configuring the extraction means to extract rectangular image data having a ratio smaller than that of the wide screen from the image data, image data that is displayed nicely with a narrow margin on the wide screen is obtained. In addition, an object of the present invention is to provide an imaging apparatus that can obtain image data that is displayed in a good-looking manner by effectively using the entire range of image data output by the imaging device when performing horizontal shooting.

  Another object of the present invention is to obtain a ratio of the wide screen from the image data output from the image sensor when performing horizontal shooting with an imaging device having an imaging surface having a smaller aspect ratio than the wide screen of the display device. By configuring the extraction means to extract rectangular image data having substantially the same ratio, it is possible to obtain image data that is displayed nicely with a narrow margin on a wide screen and to shoot in vertical shooting. In this case, it is an object of the present invention to provide an image pickup apparatus that can obtain image data displayed in a good-looking manner by effectively using the entire range of image data output from the image pickup element.

  Another object of the present invention is to provide direction receiving means for receiving an instruction to select either vertical shooting or horizontal shooting, so that the photographer can select either horizontal shooting or vertical shooting as appropriate. An object of the present invention is to provide an image pickup apparatus that enables high-quality shooting.

  Another object of the present invention is to provide invalidity accepting means for accepting an instruction to invalidate extraction by the extracting means, so that the photographer can appropriately invalidate extraction of image data by the extracting means and perform photographing with a high degree of freedom. It is an object of the present invention to provide an imaging device that enables this.

  Another object of the present invention is to determine whether the state is horizontal shooting or vertical shooting, add an image to the image data and store the image, and image data acquired in accordance with the result of the determination. An imaging display system that displays rectangular and vertical image data with a narrow blank portion on a wide screen, by including a display device that extracts rectangular image data and displays it on a wide screen. It is to provide.

  Another object of the present invention is to determine whether the state is horizontal shooting or vertical shooting, extract rectangular image data from image data output by the image sensor according to the determination result, and determine the determination result. By adding and storing the information, it is an object of the present invention to provide an imaging method for storing a good-looking image with an imaging device when displayed on a display device having a wide screen.

An image pickup apparatus according to the present invention includes an image pickup device that picks up an image of a subject on a rectangular image pickup surface and outputs image data. The image data output from the image pickup device is used to form a rectangular shape provided in an external display device. In the imaging apparatus that stores the image data to be displayed on the display screen, a determination unit that determines whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction, and a determination result by the determination unit In accordance with the extraction means for extracting rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface from the image data output by the imaging device, and the image data extracted by the extraction means wherein comprising a storage unit for adding and storing a determination result, and invalid accepting means for accepting an instruction to disable the extraction by the extraction means, the extraction means, the invalid reception means has received an instruction Characterized in that that is configured to disable more extraction.

In the present invention, it is determined by the determination means whether the state is horizontal shooting or vertical shooting. The extraction unit extracts rectangular image data having a ratio different from the aspect ratio of the imaging surface from the image data output from the image sensor according to the determination result, and adds and stores the determination result. Further, when the invalidation instruction from the photographer is received, the extraction unit invalidates the extraction.

  In the imaging apparatus according to the present invention, the imaging surface has a ratio that is substantially the same as a ratio of the display screen, and the extraction unit has the long side of the imaging surface facing a substantially vertical direction by the determination unit. If it is determined, rectangular image data having a smaller ratio than the ratio of the imaging surface is extracted from the image data output by the imaging device.

  In the present invention, the image pickup surface having the same ratio as that of the display screen of the display device is provided, and the extraction unit extracts image data having a ratio smaller than the ratio of the image pickup surface when the determination unit determines vertical shooting. Extraction is performed, and a determination result is added and stored by the storage unit. On the other hand, when the determination unit determines that the horizontal shooting is performed, extraction by the extraction unit is not performed, and the determination result is added to and stored in the entire range of image data output by the image sensor.

  In the imaging device according to the present invention, the imaging surface has a ratio smaller than a ratio of the display screen, and the extraction unit has the long side of the imaging surface facing a substantially horizontal direction by the determination unit. When the determination is made, the image data output from the image sensor is extracted from rectangular image data having a ratio substantially the same as the ratio of the display screen.

In the present invention, an imaging surface having a ratio smaller than the ratio of the display screen of the display device is provided, and the extraction means has a ratio substantially the same as the ratio of the display screen when the determination means determines that the horizontal shooting is performed. Image data is extracted, and a determination result is added and stored by the storage unit. On the other hand, when the determination unit determines that the vertical shooting is performed, the extraction unit does not perform extraction, and the determination result is added and stored in the entire range of image data output by the image sensor.
An image pickup apparatus according to the present invention includes an image pickup device that picks up an image of a subject on a rectangular image pickup surface and outputs image data. The image data output from the image pickup device is used to form a rectangular shape provided in an external display device. In the imaging apparatus that stores the image data to be displayed on the display screen, a determination unit that determines whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction, and a determination result by the determination unit In accordance with the extraction means for extracting rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface from the image data output by the imaging device, and the image data extracted by the extraction means A storage unit that adds and stores the determination result, wherein the imaging surface has a ratio smaller than a ratio of the display screen, and the extraction unit has a long side of the imaging surface substantially reduced by the determination unit. When it is determined that the image is oriented in the horizontal direction, rectangular image data having a ratio substantially the same as the ratio of the display screen is extracted from the image data output by the imaging device. To do.
In the present invention, it is determined by the determination means whether the state is horizontal shooting or vertical shooting. The extraction unit extracts rectangular image data having a ratio different from the aspect ratio of the imaging surface from the image data output from the image sensor according to the determination result, and adds and stores the determination result. In addition, an image pickup surface having a ratio smaller than the display screen ratio of the display device is provided, and the extraction unit extracts image data having a ratio substantially the same as the display screen ratio when the determination unit determines horizontal shooting. The determination result is added and stored by the storage unit. On the other hand, when the determination unit determines that the vertical shooting is performed, the extraction unit does not perform extraction, and the determination result is added and stored in the entire range of image data output by the image sensor.
An imaging apparatus according to the present invention includes invalidation accepting means for accepting an instruction to invalidate extraction by the extraction means, and the extraction means is configured to invalidate extraction according to an instruction received by the invalidation accepting means. It is characterized by being.
In the present invention, when the invalidation instruction from the photographer is received, the extraction unit invalidates the extraction.

  The imaging apparatus according to the present invention includes a direction receiving unit that receives an instruction to select whether the long side of the imaging surface is in a substantially vertical direction or a substantially horizontal direction, and the determination unit receives the direction reception The instruction received by the means is used as the determination result.

  In the present invention, either the vertical shooting or the horizontal shooting is selected by the photographer.

  An imaging display system according to the present invention includes an imaging device including an imaging device that images a subject with a rectangular imaging surface and outputs image data, an image acquisition unit that acquires the image data from the imaging device, and the acquisition In the imaging display system configured with a display device having a rectangular display screen for displaying the image data, the imaging device has a long side of the imaging surface in a substantially horizontal direction or a substantially vertical direction. A determination unit that determines whether the image is suitable; a determination result adding unit that adds a determination result by the determination unit to the image data; and the display device acquires a determination result acquisition unit that acquires the determination result According to the determination result, rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface is extracted from the image data acquired by the image acquisition unit. And it means output, the display screen is characterized in that is arranged to display the image data extracted by the extracting unit.

  In the present invention, an imaging display system is configured by an imaging device that captures an image of a subject and stores the image data, and a display device that displays the image data. A determination unit provided in the imaging apparatus determines whether the state is in the vertical shooting or the horizontal shooting. The imaging apparatus adds the determination result of the determination unit to the image data and stores it in the storage unit. The image acquisition means and the determination result acquisition means provided in the display device respectively acquire the image data and the determination result included in the image data from the storage unit of the imaging device. The extraction means provided in the display device extracts rectangular image data having a ratio different from the aspect ratio of the image data from the acquired image data based on the acquired determination result, and is extracted on the display screen. Image data is displayed.

An imaging method according to the present invention is an imaging method in which image data to be displayed on a display device having a rectangular display screen is captured by an imaging device having an imaging element that captures image data on a rectangular imaging surface and outputs the image data. It is determined whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction, and the long side relative to the short side of the imaging surface is determined from the image data output by the imaging device according to the determination result. Extracting rectangular image data having a ratio different from the above ratio, adding and storing the determination result, receiving an instruction to invalidate the extraction of the image data, and invalidating the extraction according to the accepted instruction And

In the present invention, when image data to be displayed on a display device having a rectangular display screen is stored in an imaging device having an imaging element having a rectangular imaging surface, either vertical shooting or horizontal shooting is used. In accordance with the determination result, rectangular image data having a ratio different from the aspect ratio of the imaging surface is extracted from the image data output from the image sensor, and the determination result is added and stored. Further, when the invalidation instruction from the photographer is received, the extraction unit invalidates the extraction.
The imaging method according to the present invention is an imaging device that captures image data to be displayed on a display device having a rectangular display screen on a rectangular imaging surface having a ratio smaller than the ratio of the display screen and outputs the image data. In the imaging method stored in the imaging apparatus having the above, it is determined whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction, and the long side of the imaging surface is oriented in a substantially horizontal direction. If it is determined that the image is output, rectangular image data having a ratio substantially the same as the ratio of the display screen is extracted from the image data output by the imaging device, and the determination result is added and stored. And
In the present invention, an imaging surface having a ratio smaller than the ratio of the display screen of the display device is provided, and the extraction means has a ratio substantially the same as the ratio of the display screen when the determination means determines that the horizontal shooting is performed. Image data is extracted, and a determination result is added and stored by the storage unit. On the other hand, when the determination unit determines that the vertical shooting is performed, the extraction unit does not perform extraction, and the determination result is added and stored in the entire range of image data output by the image sensor.

  In the present invention, a determination unit that determines whether the state is horizontal shooting or vertical shooting, and an extraction unit that extracts rectangular image data from the image data output by the imaging device according to the determination result And a storage unit for adding the determination result to the extracted image data and storing it, so that the image data displayed with a narrow margin on a display device having a wide screen is displayed in a horizontal direction by the photographer. And it becomes possible to obtain without requiring the instruction of the vertical shooting.

  Further, in the present invention, an image output by the image sensor when performing vertical shooting with an imaging device having an imaging surface having a ratio substantially the same as the aspect ratio of the wide screen provided in the external display device. By configuring the extraction means to extract rectangular image data having a smaller ratio than the wide screen ratio from the data, it is possible to obtain image data that is displayed nicely with a narrow margin on the wide screen In the case of horizontal shooting, it is possible to obtain image data that is displayed nicely by effectively using the entire range of image data output by the image sensor.

  Further, in the present invention, when performing horizontal shooting with an imaging device having an imaging surface having a smaller aspect ratio than the wide screen of the display device, the ratio of the wide screen is abbreviated from the image data output by the imaging device. When extracting the rectangular image data having the same ratio to obtain image data that is displayed nicely with a narrow margin on the wide screen, and shooting in vertical shooting Thus, it is possible to obtain image data that is displayed with good appearance by effectively using the entire range of image data output from the image sensor.

  Further, in the present invention, by including an accepting unit that receives an instruction to select either horizontal shooting or vertical shooting, the photographer can select either horizontal shooting or vertical shooting as appropriate, and has a high degree of freedom. Shooting is possible.

  Further, according to the present invention, by including an invalidity accepting unit that accepts an instruction to invalidate the extraction by the extracting unit, the photographer can appropriately invalidate the extraction of the image data by the extracting unit and can perform shooting with a high degree of freedom. It becomes.

  Further, in the present invention, from the imaging device that determines whether the state is horizontal shooting or vertical shooting and adds and stores the determination result to the image data, and the image data acquired according to the determination result, By configuring it with a display device that extracts rectangular image data with a ratio different from the aspect ratio of the imaging surface and displays it on a wide screen, the horizontal and vertical image data has a narrow blank area on the wide screen. Thus, it is possible to display it with a good appearance.

  Another object of the present invention is to determine whether the state is horizontal shooting or vertical shooting, extract rectangular image data from image data output by the image sensor according to the determination result, and determine the determination result. By adding and storing, when the image is displayed on a display device having a wide screen, a good-looking image can be stored in the imaging device.

Embodiment 1
Hereinafter, the present invention will be described in detail with reference to the drawings showing embodiments thereof. FIG. 1 is a block diagram illustrating configurations of an imaging apparatus and a storage medium according to Embodiment 1. In FIG. 1, reference numeral 1 denotes an imaging device, an imaging device 13 having an imaging surface 131 that receives light from a subject, an orientation sensor 11 that detects the orientation of a housing of the imaging device 1, an accepting unit 12 that receives an operation, and an imaging instruction. A display unit 17 that displays captured image data, a storage medium writing unit 15 that writes image data to an external storage medium, and a data output unit 16 that outputs image data.

  In the figure, reference numeral 2 denotes a storage medium into which image data inserted from the outside into the storage medium writing unit 15 and imaged by the imaging device 1 is written, and is a memory or a memory card. In addition, the imaging apparatus 1 processes the image data output from the imaging device 13, the attitude signal detected by the attitude sensor 11, and the signal related to the operation received by the receiving unit 12, and the processing unit 14 that controls each hardware; A ROM 19 that stores a program for executing arithmetic processing performed by the processing unit 14 and a RAM 18 that stores data generated during the arithmetic processing of the processing unit 14 are provided.

  The attitude sensor 11 is configured by an acceleration detection element or the like, and is fixed to the casing of the imaging apparatus 1, and gives an attitude signal indicating the inclination of the casing to the processing unit 14. The imaging surface 131 is rectangular and has an aspect ratio of 16: 9. When the photographer holds the imaging apparatus 1 facing the subject in the upright direction, the imaging element 13 has the long side of the imaging surface 131 directed in a substantially horizontal direction, and the imaging surface 131 stands upright and faces the subject. In this way, it is attached to the housing of the imaging device 1.

  The processing unit 14 holds the housing in a state where the long side of the imaging surface 131 is directed in a substantially horizontal direction according to a posture signal given from the posture sensor 11, and performs horizontal shooting in which shooting is performed or a housing in a state in which the long side of the imaging surface 131 faces in a substantially vertical direction. It is determined whether the camera is in a vertical shooting state where the body is held for shooting. In addition, the processing unit 14 is configured to be able to determine whether it is in the horizontal shooting mode or the vertical shooting mode by the selection operation received by the receiving unit 12. Light from the subject received by the imaging surface 131 is converted into image data and output from the imaging device 13 to the processing unit 14.

  The processing unit 14 extracts rectangular image data from the image data output from the imaging device 13 in accordance with the determination result of horizontal shooting or vertical shooting. The processing unit 14 immediately gives the extracted image data to the display unit 17 for display, and an image extracted from the image of the subject received by the image sensor 13 is displayed on the display unit 17 immediately. Further, the processing unit 14 adds rotation information related to the horizontal shooting or the vertical shooting to the extracted image data, and supplies the extracted image data to the storage medium writing unit 15. The storage medium writing unit 15 writes image data to the storage medium 2.

  The processing unit 14 is configured to be able to read image data stored in the storage medium 2 inserted in the storage medium writing unit 15 and output it to the data output unit 16. The data output unit 16 is connected to a data transfer line such as an external display device (not shown), and outputs image data via the data transfer line. The imaging device 1 has a wide shooting mode for shooting image data to be displayed on a display device having a wide screen with an aspect ratio of 16: 9. The wide shooting mode is set in the processing unit 14 when the receiving unit 12 receives a setting instruction from the photographer.

  When the wide shooting mode is set, the processing unit 14 has a rectangular shape having a ratio different from the ratio of the aspect ratio of the imaging surface 131 from the image data output by the imaging device 13 according to the determination result of horizontal shooting or vertical shooting. Are extracted and given to the storage medium writing unit 15 to be written into the storage medium 2. If the wide shooting mode is not set, the processing unit 14 does not extract the image data, but gives the entire range of the image data output from the image sensor 13 to the storage medium writing unit 15 for storage. The extraction of image data by the processing unit 14 is invalidated when the accepting unit 12 accepts an invalid instruction from the photographer.

  FIG. 2 is an explanatory diagram for explaining a method of extracting image data in vertical shooting according to the first embodiment. In FIG. 2, (a), (b), and (c) are respectively a rectangular extraction range set in the image data output from the image sensor 13 and a wide area in which image data extracted from the vertically shot image is displayed. 2 shows a screen and a wide screen on which a vertically shot image is displayed without image data extraction. The processing unit 14 extracts an inscribed rectangle having a smaller ratio than the aspect ratio of the imaging surface 131 when it is determined that the vertical shooting is performed based on the posture signal supplied from the posture sensor 11 or the selection instruction received by the receiving unit 12. The range is set on the image data output from the image sensor 13.

  In the example shown in FIG. 2 (a), the inscribed rectangular extraction range with an aspect ratio of 4: 3 is in the range indicated by diagonal lines at the center of the image data output by the image sensor 13 having an aspect ratio of 16: 9. A transversal image of a person whose head is directed to the right is captured within the extraction range. The vertically shot image data written by the processing unit 14 on the storage medium 2 inserted in the storage medium writing unit 15 becomes a rollover image having an aspect ratio of 4: 3. The display device having a wide screen acquires the vertically captured image data output from the data output unit 16 or the vertically captured image data written in the storage medium 2 and based on the rotation information included in the acquired vertically captured image data. An upright image is displayed by performing rotation correction on the rollover image.

  In the example shown in FIG. 2B, a vertically shot image with an aspect ratio of 4: 3 that has been rotated by −90 degrees by rotation correction is displayed upright. The processing unit 14 performs extraction when it is determined that the vertical shooting is performed based on the posture signal provided from the posture sensor 11, or when either the wide shooting mode is not set or the invalidation instruction for extraction is received. First, the image data written in the storage medium 2 inserted into the storage medium writing unit 15 by the processing unit 14 becomes a rollover image having an aspect ratio of 16: 9.

  In the example shown in FIG. 2C, a vertically shot image with an aspect ratio of 16: 9 that has been rotated by -90 degrees by rotation correction is displayed upright. The blank portions located on both sides of the vertically shot image shown in FIG. 2B are narrower than the blank portions shown in FIG. 2C, and the vertically shot image data obtained by extracting the image data is It is displayed nicely. In the example shown in FIG. 2A, the example in which the extraction range having the aspect ratio of 4: 3 is set on the image data output from the image sensor 13 is shown, but the present invention is not limited to this, and the ratio of the aspect ratio of 16: 9 is shown. Any rectangular extraction range having a smaller ratio may be used.

  3 and 4 are flowcharts showing the procedure of the image data extraction process according to the first embodiment. The image data extraction process is executed according to a program read by the processing unit 14 from the ROM 19. The processing unit 14 causes the reception unit 12 to accept an operation by the photographer (step S1). The processing unit 14 selects whether the operation received by the receiving unit 12 is in an operation instructing invalidation of image data extraction, an operation instructing setting of a wide shooting mode, or a vertical shooting or a horizontal shooting state. It is determined which of the operations to be instructed (step S2).

  If the processing unit 14 determines that the operation is an instruction to invalidate the extraction of the image data (“invalid” in step S2), the processing unit 14 sets an invalid flag (step S3). If the processing unit 14 determines that the operation is an operation for instructing setting of the wide shooting mode (“wide” in step S2), the processing unit 14 sets a wide flag (step S4). If the processing unit 14 determines that the operation is an instruction to select whether the state is vertical shooting or horizontal shooting (“select” in step S2), the processing unit 14 sets a selection flag (step S5).

  The processing unit 14 determines whether or not the invalid flag is set (step S6). When determining that the invalid flag is not set (NO in step S6), the processing unit 14 determines whether the wide flag is set (step S7). When determining that the wide flag is set (YES in step S7), the processing unit 14 determines whether or not the selection flag is set (step S8). When it is determined that the selection flag is not set (NO in step S8), the processing unit 14 acquires an attitude signal from the attitude sensor 11 (step S9).

  The processing unit 14 determines whether or not it is in the state of vertical shooting from the acquired posture signal (step S10). When determining that the selection flag is set in step S8 (YES in step S8), the processing unit 14 receives the posture signal from the posture sensor 11 without acquiring the posture signal. Based on the selection instruction received by the unit 12, it is determined whether or not it is in the state of vertical shooting (step S10). If the processing unit 14 determines that the vertical shooting state is set (YES in step S10), the processing unit 14 sets the above-described extraction range on the image data provided from the image sensor 13 (step S11).

  The processing unit 14 extracts the image data set in the extraction range from the image data output from the image sensor 13 (step S12). The processing unit 14 displays the extracted image data on the display unit 17 (step S13). When determining that the invalid flag is set in step S6 (YES in step S6), the processing unit 14 determines whether the wide flag is set in step S7. If it is determined that it is not set (NO in step S7), or if it is determined in step S10 that it is determined whether or not it is in the vertical shooting state (NO in step S10), the image data The entire range of image data output by the image sensor 13 is displayed on the display unit 17 without extracting (step S13).

  The processing unit 14 determines whether or not the shutter button 20 has detected pressing of the shutter button (step S14). If the processing unit 14 determines that pressing has not been detected (NO in step S14), the processing unit 14 returns the processing to step S1 in which the operation by the photographer is received by the reception unit 12. When it is determined that the pressing is detected (YES in step S14), the processing unit 14 determines whether or not the invalid flag is set (step S15). If it is determined that the invalid flag is not set (NO in step S15), the processing unit 14 extracts the image data set in the extraction range from the image data output by the image sensor 13 (step S16).

  When it is determined that the invalid flag is set (YES in step S15), the processing unit 14 acquires the entire range of image data output by the image sensor 13 (step S17). The processing unit 14 adds the rotation information indicating the rotation angle related to the vertical shooting or the horizontal shooting to the image data (step S18). The processing unit 14 gives the image data to which the rotation information is added to the storage medium writing unit 15, stores the image data in the storage medium 2 inserted in the storage medium writing unit 15 (step S19), and ends the image data extraction processing. To do.

Embodiment 2
The imaging surface 131 is rectangular and has an aspect ratio of 4: 3. When the photographer holds the imaging apparatus 1 facing the subject in an erect direction, the imaging element 13 is such that the long side of the imaging surface 131 is directed in a substantially horizontal direction, and the imaging surface 131 stands upright and faces the subject. In this way, it is attached to the housing of the imaging device 1. When the processing unit 14 determines that the horizontal shooting is performed based on the orientation signal given from the orientation sensor 11 or the selection instruction received by the receiving unit 12 in the state where the wide shooting mode is set, the processing unit 14 displays the wide screen provided in the external display device. An inscribed rectangular extraction range having a ratio substantially the same as the aspect ratio of 16: 9 is set on the image data output by the image sensor 13.

  FIG. 5 is an explanatory diagram for explaining a method of extracting image data in landscape shooting according to the second embodiment. In the example shown in FIG. 5, the inscribed rectangular extraction range with an aspect ratio of 16: 9 is indicated by hatching in the center of the image data output by the imaging device 13 having the imaging surface 131 with an aspect ratio of 4: 3. Is set to The image data stored in the storage medium 2 inserted into the storage medium writing unit 15 by the processing unit 14 is an upright image having an aspect ratio of 16: 9. The display device having a wide screen acquires the image data output from the data output unit 16 or the image data written in the storage medium 2, and does not perform the rotation correction based on the rotation information included in the acquired image data. indicate.

  When displaying horizontally shot image data stored in the recording medium 2 on a display device having a wide screen, a 16: 9 horizontally shot image having the same aspect ratio as that of the wide screen is displayed upright, and a blank portion where no image is displayed is displayed. A good-looking display image that does not exist is obtained. When the processing unit 14 determines vertical shooting based on the posture signal provided from the posture sensor 11, the processing unit 14 corresponds to any of the case where the wide shooting mode is not set and the case where invalidation of image data extraction is selected. Without extracting the image data, the entire range of image data output by the image sensor 13 is supplied to the storage medium writing unit 15 and written to the storage medium 2.

  6 and 7 are flowcharts showing a procedure of image data extraction processing according to the second embodiment. The image data extraction process is executed according to a program read by the processing unit 14 from the ROM 19. The processing unit 14 causes the reception unit 12 to accept an operation by the photographer (step S21). The processing unit 14 selects whether the operation received by the receiving unit 12 is in an operation instructing invalidation of image data extraction, an operation instructing setting of a wide shooting mode, or a vertical shooting or a horizontal shooting state. It is determined which of the operations to be instructed (step S22).

  If the processing unit 14 determines that the operation is an instruction to invalidate the extraction of the image data (“invalid” in step S22), the processing unit 14 sets an invalid flag (step S23). If the processing unit 14 determines that the operation is an instruction to set the wide shooting mode (“wide” in step S22), the processing unit 14 sets a wide flag (step S24). If the processing unit 14 determines that the operation is an instruction to select whether the state is the vertical shooting or the horizontal shooting (“select” in step S22), the processing unit 14 sets a selection flag (step S25).

  The processing unit 14 determines whether or not an invalid flag is set (step S26). When determining that the invalid flag is not set (NO in step S26), the processing unit 14 determines whether or not the wide flag is set (step S27). If it is determined that the wide flag is set (YES in step S27), the processing unit 14 determines whether or not the selection flag is set (step S28). When it is determined that the selection flag is not set (NO in step S28), the processing unit 14 acquires an attitude signal from the attitude sensor 11 (step S29).

  The processing unit 14 determines whether or not it is in the state of horizontal shooting from the acquired posture signal (step S30). When it is determined in step S28 that determines whether or not the selection flag is set (YES in step S28), the processing unit 14 receives the posture signal from the posture sensor 11 without acquiring the posture signal. Based on the selection instruction received by the unit 12, it is determined whether or not the camera is in the horizontal shooting state (step S30). When the processing unit 14 determines that the camera is in the horizontal shooting state (YES in step S30), the processing unit 14 sets the above-described extraction range on the image data output from the image sensor 13 (step S31).

  The processing unit 14 extracts the image data set in the extraction range from the image data output from the image sensor 13 (step S32). The processing unit 14 displays the extracted image data on the display unit 17 (step S33). When determining that the invalid flag is set in step S26 (YES in step S26), the processing unit 14 determines in step S27 whether the wide flag is set. If it is determined that it is not set (NO in step S27), or if it is determined in step S30 that it is determined whether or not the camera is in landscape shooting (NO in step S30), the image data The entire range of image data output by the image sensor 13 is displayed on the display unit 17 without extracting (step S33).

  The processing unit 14 determines whether or not the shutter button 20 has detected pressing of the shutter button (step S34). If the processing unit 14 determines that pressing is not detected (NO in step S34), the processing unit 14 returns the processing to step S21 in which the operation by the photographer is received by the reception unit 12. When it is determined that the pressing is detected (YES in step S34), the processing unit 14 determines whether the invalid flag is set (step S35). If it is determined that the invalid flag is not set (NO in step S35), the processing unit 14 extracts image data within the extraction range set on the image data output by the image sensor 13 (step S36).

  If it is determined that the invalid flag is set (YES in step S35), the processing unit 14 acquires the entire range of image data output by the image sensor 13 (step S37). The processing unit 14 adds the rotation information indicating the rotation angle related to the vertical shooting or the horizontal shooting to the image data (step S38). The processing unit 14 provides the image data to the storage medium writing unit 15 and stores it in the storage medium 2 inserted in the storage medium writing unit 15 (step S39), and ends the image data extraction processing. Although the imaging surface 131 of the second embodiment has an example having an aspect ratio of 4: 3, the present invention is not limited to this and may have an aspect ratio of 3: 2.

  The second embodiment is configured as described above, and besides the difference in the aspect ratio of the imaging surface 131, the configuration and operation are the same as in the first embodiment, so corresponding parts are denoted by the same reference numerals. Detailed description thereof will be omitted.

Embodiment 3
FIG. 8 is a block diagram illustrating a configuration of the imaging display system according to the third embodiment. In the figure, reference numerals 1 and 4 denote an imaging device and a display device, respectively. The imaging display system includes an imaging device 1 and a display device 4 each having a different housing. The data transfer line 3 connects the data output unit 16 provided in the imaging device 1 and the data input unit 41 provided in the display device 4, and the image data output from the data output unit 16 is the data transfer line. 3 to the data input unit 41. The data transfer line 3 is configured to be easily removable from the data output unit 16 of the imaging device 1 and the data input unit 41 of the display device 4.

  The light from the subject received by the imaging surface 131 of the imaging device 13 is converted into image data and output from the imaging device 13 to the processing unit 14. The attitude sensor 11 is fixed to the casing of the imaging apparatus 1 and gives an attitude signal related to the inclination of the casing to the processing unit 14. The processing unit 14 performs either horizontal shooting in which the long side of the imaging surface 131 faces in a substantially horizontal direction or vertical shooting in which the shooting is performed in a substantially vertical direction according to a posture signal given from the posture sensor 11. It is determined whether it is in the state.

  The processing unit 14 adds the determination result to the image data and gives it to the storage medium writing unit 15. The storage medium writing unit 15 writes image data to a storage medium such as a USB memory or a memory card inserted from the outside. The processing unit 14 is configured to be able to read image data stored in a storage medium inserted in the storage medium writing unit 15 and output the image data to the data output unit 16. The data output unit 16 outputs the given image data to the connected data transfer line 3. The display device 4 includes a data input unit 41 to which image data is input, a reception unit 44 that receives an operation, and a display unit 43 that has a display screen 431 that displays image data.

  The display screen 431 is a wide screen with an aspect ratio of 16: 9. Further, the display device 4 includes a processing unit 42 that performs processing according to the processing of the image data input to the data input unit 41 and the operation received by the receiving unit 44 and controls each hardware. A ROM 46 that stores a program for executing the arithmetic processing to be performed, and a RAM 45 that stores data generated during the arithmetic processing of the processing unit 42 are provided. The image data input to the data input unit 41 is given to the processing unit 42. The processing unit 42 sets an extraction range, which will be described later, on the given image data, extracts the image data, performs rotation correction, and displays the extracted data on the display screen 431 of the display unit 43.

  FIG. 9 is an explanatory diagram illustrating an image data extraction method and a rotation correction method according to the third embodiment. In the figure, (a) and (b) respectively show the vertically shot image data stored in the imaging device 1 and the vertically shot image data in which the extraction range is set and the rotation correction is performed by the processing unit 42 of the display device 4. . The hatched portion in the figure indicates the extraction range set for the image data. The vertically shot image data shown in FIG. 5A is a rollover image having an aspect ratio of 16: 9 that is the same as the aspect ratio of the imaging surface 131, and includes rotation information with a rotation angle of +90 degrees.

  In the example shown in (b) in the figure, a vertically long image having an aspect ratio of 4: 3 is extracted from a vertically long image obtained by performing rotation correction of −90 degrees on vertically captured image data based on rotation information. A range is set. The processing unit 42 extracts image data within the extraction range and displays it on the display screen 431 of the display unit 43. Thereby, compared with the case where the entire range of the vertically captured image data is displayed, the blank portions located on both sides of the vertically captured image displayed on the display screen 431 of the display device 4 are narrowed and displayed with good appearance. Although an example of setting the extraction range in which the aspect ratio is 4: 3 is shown, the present invention is not limited to this, and any rectangular extraction range having a ratio smaller than the aspect ratio of 16: 9 may be used.

  FIG. 10 is a flowchart illustrating a procedure of imaging processing according to the third embodiment. The imaging process is executed according to a program read from the ROM 19 by the processing unit 14 of the imaging apparatus 1. The processing unit 14 causes the reception unit 12 to accept an operation by the photographer (step S41). The processing unit 14 determines whether or not the operation received by the receiving unit 12 is an operation for selecting and instructing whether the operation is in the vertical shooting mode or the horizontal shooting mode (step S42). When it is determined that the processing unit 14 is not a selection instruction (NO in step S42), the processing unit 14 acquires a posture signal from the posture sensor 11 (step S43).

  The processing unit 14 determines whether or not the pressing of the shutter button 20 is detected (step S44). When the processing unit 14 determines in step S42 that it is an operation for instructing to select whether the state is in the vertical shooting mode or the horizontal shooting state in step S42 (YES in step S42), the posture is determined. It is determined whether or not the pressing of the shutter button 20 is detected without acquiring the attitude signal from the sensor 11 (step S44).

  If the processing unit 14 determines that pressing is not detected (NO in step S44), the processing unit 14 returns the processing to step S41 in which the operation by the photographer is received by the reception unit 12. When it is determined that the pressing is detected (YES in step S44), the processing unit 14 adds rotation information indicating the rotation angle related to the vertical shooting or the horizontal shooting to the acquired image data (step S45). The processing unit 14 provides the image data to the storage medium writing unit 15 and stores the image data in the storage medium inserted in the storage medium writing unit 15 (step S46), and ends the photographing process.

  FIG. 11 is a flowchart illustrating a procedure of display processing according to the third embodiment. The display process is executed according to a program read from the ROM 46 by the processing unit 42. The processing unit 42 causes the reception unit 44 to accept an operation by the photographer (step S51). The processing unit 42 determines whether the operation received by the receiving unit 44 is an operation for instructing invalidation of the extraction range setting or an operation for instructing setting of the wide shooting mode (step S52). If the processing unit 42 determines that the operation is an instruction to invalidate the extraction range setting (“invalid” in step S52), the processing unit 42 sets an invalid flag (step S53).

  If the processing unit 42 determines that the operation is an instruction to set the wide shooting mode (“wide” in step S52), the processing unit 42 sets a wide flag (step S54). The processing unit 42 determines whether image data is input to the data input unit 41 (step S55). If the processing unit 42 determines that no input has been made (NO in step S55), the processing unit 42 returns the process to step S51 in which the operation by the photographer is received by the reception unit 44. When determining that the input has been made (YES in step S55), the processing unit 42 determines whether or not the invalid flag is set (step S56).

  If the processing unit 42 determines that the invalid flag is set (YES in step S56), the processing unit 42 shifts the processing to step S63 that displays image data of the entire range described later. When it is determined that the invalid flag is not set (NO in step S56), the processing unit 42 determines whether the wide flag is set (step S57). When it is determined that the wide flag is set (YES in step S57), the processing unit 42 acquires rotation information included in the image data input to the data input unit 41 (step S58).

  Based on the acquired rotation information, the processing unit 42 determines whether or not the vertical shooting state is set (step S59). If the processing unit 42 determines that the vertical shooting state is set (YES in step S59), the processing unit 42 sets the above-described extraction range in the input image data (step S60). The processing unit 42 determines whether or not the invalid flag is set (step S61). Further, the processing unit 42 determines whether or not the wide flag is set when it is determined that it is not set at step S57 (NO at step S57), or whether or not it is in a vertical shooting state. If it is determined in step S59 that there is no vertical shooting state (NO in step S59), the process proceeds to step S61 in which it is determined whether or not the invalid flag is set.

  If the processing unit 42 determines that the invalid flag is not set (NO in step S61), the processing unit 42 extracts image data included in the set extraction range from the input image data, and displays the display screen 431 of the display unit 43. (Step S62), and the process returns to Step S51 where the accepting unit 44 accepts an operation by the photographer. When determining that the invalid flag is set (YES in step S61), the processing unit 42 displays the entire range of the input image data on the display screen 431 of the display unit 43 (step S63), and the receiving unit 44. Then, the process returns to step S51 where the operation by the photographer is accepted.

  The third embodiment is configured as described above, and other configurations and operations are the same as those of the first embodiment. Therefore, corresponding parts are denoted by the same reference numerals, and detailed description thereof is omitted.

1 is a block diagram illustrating configurations of an imaging apparatus and a storage medium according to Embodiment 1. FIG. 5 is an explanatory diagram for explaining a method for extracting image data in vertical shooting according to Embodiment 1. FIG. 4 is a flowchart illustrating a procedure of image data extraction processing according to the first embodiment. 4 is a flowchart illustrating a procedure of image data extraction processing according to the first embodiment. 10 is an explanatory diagram for explaining a method of extracting image data in landscape shooting according to Embodiment 2. FIG. 10 is a flowchart illustrating a procedure of image data extraction processing according to the second embodiment. 10 is a flowchart illustrating a procedure of image data extraction processing according to the second embodiment. 10 is a block diagram illustrating a configuration of an imaging display system according to Embodiment 3. FIG. FIG. 10 is an explanatory diagram for explaining an image data extraction method and a rotation correction method according to Embodiment 3; 14 is a flowchart illustrating a procedure of imaging processing according to the third embodiment. 14 is a flowchart illustrating a procedure of display processing according to the third embodiment. It is explanatory drawing explaining the display to the wide screen of the horizontal shooting image data in a prior art. It is explanatory drawing explaining the display to the wide screen of the vertical image data in a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Storage medium 11 Attitude sensor 12 Reception part 13 Image pick-up element 14 Processing part 15 Storage medium writing part 16 Data output part 17 Display part 18 RAM
19 ROM
20 Shutter button 131 Imaging surface

Claims (9)

Image data to be displayed on a rectangular display screen provided in an external display device using an image sensor that captures an image of a subject on a rectangular imaging surface and outputs the image data. In an imaging device for storing
Determining means for determining whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction;
Extraction means for extracting rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface from the image data output by the imaging device according to the determination result by the determination unit;
A storage unit for adding the determination result to the image data extracted by the extraction unit and storing the image data ;
Invalidity acceptance means for accepting an instruction to invalidate extraction by the extraction means;
With
The image pickup apparatus , wherein the extraction unit is configured to invalidate the extraction in accordance with an instruction received by the invalidity accepting unit . The imaging surface has a ratio substantially the same as the ratio of the display screen,
The extraction means is a rectangle having a ratio smaller than the ratio of the imaging surface from the image data output by the imaging element when the determination means determines that the long side of the imaging surface is oriented in a substantially vertical direction. The imaging apparatus according to claim 1, configured to extract shape image data. The imaging surface has a ratio smaller than the ratio of the display screen;
The extraction unit has a ratio that is substantially the same as a ratio of the display screen from the image data output by the imaging element when the determination unit determines that the long side of the imaging surface is in a substantially horizontal direction. The imaging apparatus according to claim 1, wherein the imaging apparatus is configured to extract rectangular image data. Image data to be displayed on a rectangular display screen provided in an external display device using an image sensor that captures an image of a subject on a rectangular imaging surface and outputs the image data. In an imaging device for storing
Determining means for determining whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction;
Extraction means for extracting rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface from the image data output by the imaging device according to the determination result by the determination unit;
A storage unit for adding the determination result to the image data extracted by the extraction unit and storing the image data ;
The imaging surface has a ratio smaller than the ratio of the display screen;
The extraction unit has a ratio that is substantially the same as a ratio of the display screen from the image data output by the imaging element when the determination unit determines that the long side of the imaging surface is in a substantially horizontal direction. An image pickup apparatus configured to extract rectangular image data . An invalidity acceptance means for accepting an instruction to invalidate extraction by the extraction means;
The imaging apparatus according to claim 4 , wherein the extraction unit is configured to invalidate the extraction according to an instruction received by the invalidation reception unit. Direction receiving means for receiving an instruction to select whether the long side of the imaging surface is oriented in a substantially vertical direction or a substantially horizontal direction;
The determination unit is imaging apparatus according to any one of claims 1 to 5, characterized in that an indication that the directional reception means has received are configured to the determination result. An imaging device including an imaging device that images a subject on a rectangular imaging surface and outputs image data, an image acquisition unit that acquires the image data from the imaging device, and a rectangular shape that displays the acquired image data In an imaging display system including a display device having a display screen,
The imaging device
Determining means for determining whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction;
A determination result adding means for adding the determination result by the determination means to the image data,
The display device
A determination result acquisition means for acquiring the determination result;
Extraction means for extracting rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface from the image data acquired by the image acquisition unit according to the acquired determination result;
The imaging display system, wherein the display screen is configured to display the image data extracted by the extraction unit. In an imaging method in which image data to be displayed on a display device having a rectangular display screen is captured by a rectangular imaging surface and stored in an imaging device including an imaging element that outputs the image data.
Determining whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction;
According to the determination result, rectangular image data having a ratio different from the ratio of the long side to the short side of the imaging surface is extracted from the image data output by the imaging element, and the determination result is added and stored .
Accept instructions to disable image data extraction,
An imaging method characterized by invalidating extraction according to an accepted instruction . Image data to be displayed on a display device having a rectangular display screen is stored in an image pickup device including an image pickup device that picks up an image on a rectangular image pickup surface having a smaller ratio than the display screen and outputs the image data. In the imaging method,
Determining whether the long side of the imaging surface is oriented in a substantially horizontal direction or a substantially vertical direction;
When it is determined that the long side of the imaging surface is oriented substantially in the horizontal direction, rectangular image data having a ratio substantially the same as the ratio of the display screen is extracted from the image data output by the imaging element, An imaging method characterized by adding and storing the determination result.

Images