JP6362735B2 - IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD AND CONTROL PROGRAM - Google Patents

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a control program.

  In a general electronic camera, image data acquired by photographing is recorded on a memory card (recording unit) in the electronic camera. The user can arbitrarily reproduce the image data. Here, for example, even if the user wants to know more about the displayed subject, it is difficult for the user to read information on the subject from the image data.

  The electronic camera disclosed in Patent Document 1 records one piece of image data obtained by photographing a subject and related information of the subject that can be read from the image data in association with each other. By reading each recorded information, the electronic camera can reproduce the related information of the subject while reproducing the image data.

JP 2008-252930 A

  We propose an imaging device that allows you to see the details and features of what you see when you take a picture.

According to an imaging device of one embodiment of the present invention, an imaging unit that captures a subject, first image data captured by the imaging unit, and a contrast amount and a region for each region of the first image data are recorded. Photographed by the imaging unit while changing the focus condition for the area determined that a sufficient depiction of the subject is not obtained based on the difference in distance information for each area or information on the depth of field for each area A plurality of second image data recorded in association with the area, a display unit for displaying an image based on the first image data, a touch panel for detecting a touch on the display unit, When a touch on the image based on the first image data displayed on the display unit is detected, the second image data corresponding to the touched area is re-displayed on the display unit. And a control unit for.
According to an imaging device of one embodiment of the present invention, an imaging unit that captures a subject, first image data captured by the imaging unit, and an exposure amount for each region of the first image data are recorded. A plurality of second image data photographed by the imaging unit is recorded in association with the region while changing the exposure condition for the region where it is determined that sufficient depiction of the subject is not obtained. A recording unit; and a display unit that displays an image based on the first image data.

According to an imaging device control method of one embodiment of the present invention, an image based on first image data obtained by photographing a subject with an imaging unit is displayed on a display unit, and a touch on the display unit is detected by a touch panel. And when a touch on the image based on the first image data displayed on the display unit is detected, the contrast amount for each region of the first image data and the distance information for each region The plurality of second image data captured by changing the focus condition for the region determined that the sufficient depiction of the subject is not obtained based on the difference or the depth of field information for each region. Playing the second image data corresponding to the touched area on the display unit.
According to an imaging device control method of one embodiment of the present invention, an image based on first image data obtained by photographing a subject with an imaging unit is displayed on a display unit, and a touch on the display unit is detected by a touch panel. And when a touch to the image based on the first image data displayed on the display unit is detected, a sufficient amount of the subject is determined based on an exposure amount for each area of the first image data. The second image data corresponding to the touched region is selected from among the plurality of second image data captured by changing the exposure condition for the region where it is determined that the depiction is not obtained. Reproducing on the display unit.

The control program for an imaging apparatus according to one embodiment of the present invention displays an image based on first image data obtained by capturing a subject with an imaging unit on a display unit, and detects a touch on the display unit with a touch panel. And when a touch on the image based on the first image data displayed on the display unit is detected, the contrast amount for each region of the first image data and the distance information for each region The plurality of second image data captured by changing the focus condition for the region determined that the sufficient depiction of the subject is not obtained based on the difference or the depth of field information for each region. From the inside, the computer is caused to reproduce the second image data corresponding to the touched area on the display unit.
The control program for an imaging apparatus according to one embodiment of the present invention displays an image based on first image data obtained by capturing a subject with an imaging unit on a display unit, and detects a touch on the display unit with a touch panel. And when a touch to the image based on the first image data displayed on the display unit is detected, a sufficient amount of the subject is determined based on an exposure amount for each area of the first image data. The second image data corresponding to the touched region is selected from among the plurality of second image data captured by changing the exposure condition for the region where it is determined that the depiction is not obtained. Reproduction on the display unit is executed by a computer.

  According to the present invention, when appreciating a photographed image, it is possible to better see details and features of what is shown there.

FIG. 1 is a diagram conceptually illustrating an imaging function of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration example of the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of photographing. FIG. 4 is a diagram illustrating an example of related information of the main image. FIG. 5 is a flowchart showing an example of a photographing operation according to an embodiment of the present invention. FIG. 6 is a flowchart for determining acquisition of related information. FIG. 7 is a diagram illustrating an example of reproduction of sub-image data that is moving image data. FIG. 8 is a diagram illustrating an example of reproduction timing of moving image data. FIG. 9 is a diagram illustrating an example of reproduction of sub-image data for exposure correction. FIG. 10 is a diagram illustrating an example of reproduction timing of sub-image data for exposure correction. FIG. 11 is a diagram illustrating an example of reproduction of sub-image data for focus correction. FIG. 12 is a diagram illustrating an example of reproduction timing of sub-image data for focus correction. FIG. 13 is a diagram illustrating a configuration example of a main image file and a sub image file according to an embodiment of the present invention. FIG. 14 is a diagram conceptually showing the reproduction function of the imaging apparatus according to the embodiment of the present invention. FIG. 15 is a diagram illustrating an operation example related to the reproduction mode of the imaging apparatus according to the embodiment of the present invention. FIG. 16 is a diagram illustrating an example of a photographing operation according to a modification of the embodiment of the present invention. FIG. 17 is a diagram illustrating an example of a reproduction operation according to a modification of the embodiment of the present invention. FIG. 18 is a diagram illustrating a configuration example of a main image file and a sub image file according to a modification of the embodiment of the present invention.

  Hereinafter, an imaging apparatus according to an embodiment of the present invention will be described separately for a shooting mode for shooting and acquiring image data and a playback mode for playing back image data. FIG. 1 is a diagram conceptually illustrating an imaging function of an imaging apparatus according to an embodiment of the present invention. The imaging apparatus 100 includes an imaging unit 111 and a continuous shooting unit 110. The imaging unit 111 captures a subject and acquires image data related to the subject. The continuous photographing unit 110 includes an image region classification unit 112, a region-specific photographing condition changing unit 113, a region-specific reacquisition unit 114, and an imaging result association recording unit 115. The image area classification unit 112 divides the image data acquired by the imaging unit 111 into a plurality of blocks, and determines whether or not re-photographing should be performed for each of the divided blocks. The area-specific imaging condition changing unit 113 sets conditions for re-imaging each block divided by the image area classifying unit 112. The area-specific reacquisition unit 114 performs re-imaging based on the setting of the area-specific imaging condition change unit 113 to reacquire image data. The imaging result association recording unit 115 records the reacquired image data and the first acquired image data in association with each other.

  A specific configuration example of an imaging apparatus according to an embodiment of the present invention is shown in the block diagram of FIG. The imaging device 100 in FIG. 2 is connected to a server 23 via a network 21 so as to be communicable. In addition, a smartphone (smartphone) 22 is also connected to the network 21 in a communicable manner. The smartphone 22 is an example of a portable terminal that can reproduce image data, sound data, and the like received via the network 21.

  In one embodiment of the present invention, the reacquired image data is acquired at the time of shooting. However, in addition to the image data re-acquired at the time of shooting, related information such as image data or text data may be further acquired from the outside using the server 23 or the smartphone 22. Further, position information acquired from an orientation sensor 7b or a location detection unit 10 described later may be further associated.

  The imaging apparatus 100 includes an imaging unit 111, a control unit 1, a display unit 8, a touch panel 8b, a recording unit 4, an operation determination unit 5, a communication unit 6, an eye sensor 3b, and an eyepiece display unit 3. It has an attitude sensor 7 a, an orientation sensor 7 b, a location detection unit 10, and a clock 9. The control unit 1 has a function corresponding to the continuous photographing unit 110 and controls photographing and reproduction. The display unit 8 displays an image based on the image data. The touch panel 8b detects a touch and outputs a signal. The recording unit 4 records various data such as image data. The operation determination unit 5 determines an operation for operating the imaging device 100. This operation corresponds to, for example, operations such as switching an image displayed on the display unit 8, changing a mode, or transmitting / receiving image data. The communication unit 6 transmits and receives data between the imaging device 100 and the server 23. The eye sensor 3 b detects the eyepiece state of the user on the eyepiece display unit 3. The eyepiece display unit 3 is a display unit for an eyepiece type finder. The attitude sensor 7a detects the attitude of the imaging apparatus 100 by detecting the acceleration of the imaging apparatus 100, for example. The direction sensor 7b detects the direction of the imaging apparatus 100 from the inclination with respect to the direction of geomagnetism. The location detection unit 10 is a GPS, for example, and detects a position at the time of shooting. The clock 9 calculates time information.

  The imaging unit 111 includes a lens 26 that enters light emitted from a subject and forms an image, and an imaging device 2 that receives the light incident from the lens 26 on a light receiving surface and converts the light into an electrical signal (analog signal). Have.

  The lens 26 is an optical system for guiding a photographic light beam from a subject (not shown) onto the light receiving surface of the image sensor 2. The lens 26 has a plurality of lenses such as a focus lens. The imaging device 2 has a light receiving surface configured by arranging a large number of pixels, and converts an image from a subject received through the lens 26 into an electrical signal.

  The display unit 8 is, for example, a liquid crystal display (LCD) or an organic EL display. The display unit 8 is installed on the back surface of the imaging device 100 and displays an image for live view, an image recorded in the recording unit 4 and various information based on the image data. The image data displayed on the display unit 8 is divided into a plurality of blocks. In the present embodiment, the user selects a block of interest from a plurality of blocks. At this time, if the block is visualized, the user can easily select display of the recaptured image data. Therefore, for example, a line corresponding to a divided block of a block may be displayed so as to overlap the image.

  The touch panel 8 b is formed so as to overlap the display screen of the display unit 8, detects a touch with a user's finger or the like on the display screen, and inputs the detection result to the control unit 1. Each touch position on the touch panel corresponds to each display position on the display unit. In the present embodiment, for example, when the touch panel 8b is touched, image data re-captured is displayed at the display position on the display unit 8 corresponding to the block including the touch position. The touch panel 8b is one of methods for specifying a block obtained by dividing an image, and the block may be specified by a member other than the touch panel 8b specified by touch. A member such as the touch panel 8b for designating a block is referred to as a designation unit.

  The control unit 1 includes a focus determination unit 1c that determines whether or not to adjust the focus position, a subject determination unit 1h that determines whether or not the subject is a specific subject, and a shadow determination that determines the shadow of the image. Corresponding to the unit 1b, the display control unit 1e that controls the image processing for displaying the image data on the display unit 8, the image area classification unit 112, and the imaging condition changing unit 113 for each area, the image is divided into a plurality of blocks. A part information section 1d that controls the assignment of related information to each block, a movement determination section 1f that determines whether or not the subject has moved, and a communication control that controls transmission and reception of data between the communication section 6 and the outside Part 1g.

  The recording unit 4 records an image file in which image data acquired by photographing is stored. The recording unit 4 records a connection destination DB 4b in which image data acquired from the outside including the server 23 is recorded, and image data that is referred to in order to specify the type of subject displayed in the image. And the target object DB 4c.

  When the server 23 transmits the image data held by the server 23 to the terminal, the server 23 accesses the display control unit 23b that controls display at the transmission destination of the image data, and the access that determines that the imaging device 100 and the smartphone 22 are accessed. The determination unit 23c includes an association unit 23d that selects an image related to image data obtained from the imaging apparatus 100, and a server recording unit 23e that records an image in the server 23.

  An example of photographing is shown in FIG. When the user shoots a person in the scene shown in FIG. 3, other subjects may appear in the image at the same time. Other subjects in the example of FIG. 3 are, for example, a flying bird A and a standing bird B. Further, there may be a case where the state of the subject is not known on the image as in the dark space shown in FIG. As a result of photographing, an image as shown in FIG. 4 in which these subjects are reflected is acquired. Usually, when shooting is performed with focus and exposure suitable for a person, the focus and exposure of other subjects are not appropriate in an image obtained after shooting. For example, bird B is not in focus. In FIG. 4, the fact that the bird B is not in focus is indicated by a dotted line. Further, the exposure in the dark space is such that the vase inside the space is not easily visible. Even if a user is concerned about a subject that is out of focus or a subject whose exposure is not suitable after photographing, it is difficult for the user to photograph the subject concerned later in focus and exposure.

  In one embodiment of the present invention, a main image that captures a subject that the user is first interested in and a sub-image that captures an image of the subject that the user is likely to be interested in as the relevant information in the main image are acquired. Is done. The imaging apparatus 100 according to an embodiment of the present invention can acquire a sub-image of a moving image of a subject, a sub-image of a subject whose focus has been corrected, and a sub-image showing a subject with appropriate exposure.

  An example of the operation of the imaging apparatus 100 will be described with reference to the flowchart of FIG. The control unit 1 determines whether or not a shooting mode has been selected (step S201). When determining that the shooting mode has not been selected (NO in step S201), the control unit 1 selects the playback mode. On the other hand, when it is determined that the shooting mode has been selected (YES in step S201), the control unit 1 causes the imaging unit 111 to start shooting and starts to determine the subject (step S202). This determination of the subject is used for determining a part of interest later described. After that, the control unit 1 performs a part determination which will be anxious later as shown in FIG. 6 (step S204).

  The part determination to be worried later is a process of determining the position information of the block from which the sub image data is to be acquired and the type of sub image data to be acquired in each block. The part determination to be worried later will be described with reference to FIG. FIG. 6A is a flowchart showing an operation example, and FIG. 6B shows a block from which sub-image data is to be acquired. First, the part information unit 1d divides the acquired image data into a plurality of blocks (step S101). In one embodiment of the present invention, the image data is divided into 15 rectangular blocks as shown in FIG. Thereafter, the part information unit 1d acquires information for determining whether to acquire sub-image data for the image data from each block (step S102). The information is, for example, information on whether or not the image of the block is predetermined image data. Next, the part information unit 1d determines whether or not there is a block that is underexposed more than the predetermined exposure or a block that is overexposed than the predetermined exposure (step S103). When it is determined that at least one block is overexposed or underexposed (YES in step S103), the part information portion 1d is determined to be overexposed or underexposed. And the information indicating that a sub-image acquired later for this block is used for exposure is recorded in the recording unit 4 (step S106). This information is information for associating main image data and sub-image data described later. In the block position information, for example, as shown in FIG. 6B, the block in the Bth column of the second row is called B2. On the other hand, when it is determined that all the blocks A1 to E3 are not overexposed or underexposed (NO in step S103) or after the process of step S106, the part information unit 1d includes at least one block. Then, it is determined whether or not the subject is out of focus (step S104). When it is determined that there is a block in which the subject is out of focus (YES in step S104), the part information unit 1d is acquired later regarding the position information of the block in which the subject is out of focus and this block. Information indicating that the sub-image data is used for focusing is recorded in the recording unit 4 (step S107). After step S107 or when all the blocks from A1 to E3 determine that the subject is not out of focus (NO in step S104), the part information unit 1d includes a block in which the subject is moving. Whether or not (step S105). Whether or not the subject is moving is determined, for example, by comparing the shape of the subject of the main image and the shape of the subject of images taken before and after the subject. When it is determined that there is a block in which the subject is moving (YES in step S105), the part information unit 1d receives the position information of the block in which the subject is moving and the sub-image data acquired later for this block. Application information indicating that it is used for moving images is recorded in the recording unit 4 (step S108). After step 108 or when determining that there is no block in which the subject is moving (NO in step S105), the part information unit 1d ends the part determination process of interest later.

  By the way, in FIG. 5, the control unit 1 determines whether or not the moving image block has a result of referring to each piece of information acquired in the part determination to be worried later (step S205). When it is determined that there is no moving image block (NO in step S205), the control unit 1 determines whether to shoot main image data (step S211). The main image data is image data associated with the sub image data, and is image data that the user intends to acquire. When determining that the main image data is not to be captured (NO in step S211), for example, when the release operation is not performed for a predetermined time, the control unit 1 returns the process to step S201. On the other hand, when determining that the main image data is to be captured (YES in step S211), the control unit 1 captures the main image data (step S212). Thereafter, the control unit 1 refers to each piece of information acquired in the part determination to be worried about, and determines whether there is a block from which the sub image data is acquired (step S213). That is, the blocks for acquiring the sub image data are for moving images, for exposure, and for focus. When determining that there is no block from which the sub image data is acquired (NO in step S213), the control unit 1 records the main image data in the recording unit 4 as a main image file. Then, the control part 1 returns a process to step S201 (step S214).

  When it is determined that there is a moving image block (YES in step S205), the control unit 1 records the image data acquired before acquiring the main image data as moving image sub image data in the block. (Step S206). Thereafter, the control unit 1 shifts the process to step S211.

  By the way, when it is determined that there is a block from which sub-image data is acquired (YES in step S213), the control unit 1 first determines whether there is a moving image block (step S221). In step 221, when it is determined as a moving image block, the image data after the acquisition of the main image data is acquired as moving image sub-image data. When it is determined that there is a moving image block (YES in step S221), the control unit 1 acquires the image data of the block as moving image sub image data for a predetermined time (step S222).

  The acquisition of moving image sub-image data will be further described with reference to FIGS. FIG. 7A shows a moving image block in the main image data. That is, the blocks A1 and B1 including the flying bird A are blocks for acquiring moving image sub-image data. FIG. 8 shows an example of a timing chart for obtaining moving image sub-image data in each block. In the horizontal axis direction, time elapses, and image 1, image 2, image 3... Of sub-image data are acquired at timings T1, T2, T3. First, since the bird A is included in the block B1 of FIG. 7B, sub-image data for replacing the block B1 of the main image data with the sub-image data for moving images is acquired. As time advances, a bird A is included in the blocks B1 and A1 as shown in FIG. Therefore, as shown in FIG. 8A, the sub image data for moving images of the block B1 and the block A1 are acquired at the same timing. That is, the control unit 1 determines whether or not sub image data for moving images is acquired by comparing a plurality of pieces of image data acquired in time series with each other. Further, the control unit 1 may compare a plurality of image data obtained by acquiring adjacent blocks in chronological order with adjacent blocks. Thereafter, since the bird A is included only in the block A1, only the moving image sub-image data of the block A1 is acquired. Here, FIG. 8A shows an example in which only the moving image sub-image data including the bird A is acquired. On the other hand, as shown in FIG. 8B, blocks around the block including the bird A may be acquired as moving image data for moving images. Thus, in one embodiment of the present invention, the quadrilateral main image data is described as a combination of simple quadrilateral blocks divided into 15 parts. However, the main image data may be obtained by dividing the block into finer blocks and combining these blocks. Alternatively, the main image data may not be divided. The main image data may be a circle or an ellipse obtained by combining quadrilateral blocks. Further, the shape of the block is not limited to a quadrangle, and may be a specific area in the main image data such as another polygon or the shape of a subject. That is, sub-image data for exposure of a block in the outline of a person or bird or for focus change may be acquired. However, it is difficult to detect the contour. Therefore, for example, the shape of the block may be an ellipse that approximates the contour.

  Incidentally, when it is determined that there is no moving image block (NO in step S221), the control unit 1 does not acquire moving image sub-image data. Then, after acquiring the moving image sub-image data, or when determining that there is no block from which the moving image sub-image data is acquired (NO in step S221), the control unit 1 later becomes a part of interest. With reference to each piece of information acquired in the determination, it is determined whether there is a block for exposure (step S223). When it is determined that there is an exposure block (YES in step S223), the control unit 1 acquires exposure sub-image data (step S224).

  Here, an example of acquiring sub-image data for exposure, first, sub-image data for under-exposure will be described with reference to FIGS. FIG. 9A shows a block for underexposure in main image data. That is, the blocks D1, D2, and D3 in which the dark space is displayed are blocks that acquire the underexposure image data. A block in which underexposure is corrected is acquired by, for example, overlapping a plurality of sub-image data photographed for the same block to increase the luminance. FIG. 10 shows an example of a timing chart for acquiring under-exposure sub-image data in each block. In the upper part of FIG. 10, the horizontal axis indicates the timing of acquiring the sub image data for exposure, and the vertical axis indicates the luminance of the sub image data before superimposition. On the other hand, the lower part of FIG. 10 represents the luminance of the sub-image data after superposition. That is, the luminance of the sub image data increases as the number of sub image data to be superimposed increases. For example, the sub-image data in which the exposure is corrected such as the image 1 + image 2 in FIG. 9D by superimposing the image 1 in FIG. 9B and the image 2 in FIG. 9C of the sub-image data. Is acquired. In the case of superimposing sub-image data, the exposure is corrected to over. On the other hand, when lowering the luminance of an overexposed block, for example, an amplifier may be further added to the block diagram shown in FIG. 1, and the luminance may be lowered by the amplifier.

  By the way, after acquiring the sub-image data for exposure or when it is determined that there is no exposure block, the control unit 1 refers to each piece of information recorded by the part determination to be worried later and changes the focus. It is determined whether there is a block for use (step S225). When it is determined that there is a block for changing the focus (YES in step S226), the control unit 1 performs shooting while changing the focus position in the block, and uses the sub-image data for changing the focus acquired by the shooting. Recording is performed (step S226). As described above, it is determined that the subject in the block is not sufficiently depicted according to the feature of the exposure amount or contrast amount in the block in the main image data, that is, the specific area, and the sub image data is acquired. Is done. This determination may be made on a plurality of images acquired in time series. This determination may be made by comparing features such as distance distribution information between blocks or information on depth of field. That is, the re-acquisition determination may be determined according to the above-described feature or may be determined according to a comparison of a plurality of images acquired in time series. By determining each feature of each block, the type of sub-image data to be acquired for each block is determined.

  Here, an example of acquiring sub-image data for focus change will be further described with reference to FIGS. FIG. 11A shows a focus change block in the main image data. That is, the blocks B2 and B3 in which the bird B is displayed are blocks for acquiring the focus change sub-image data. FIGS. 11B, 11C, and 11D show image data of each block acquired by changing the focus. An example of a timing chart for acquiring sub-image data for focus change in each block is shown in FIG. The imaging apparatus 100 sequentially changes the focus position from near to far, for example, in a hill-climbing AF (autofocus) system.

  By the way, after the focus change sub-image data is acquired (step S226) or when it is determined that there is no focus change block (NO in step S225), the control unit 1 converts the main image data into the main image data. Create an image file. A configuration example of the main image file is shown in FIG. The main image file stores main image data, site-specific tag information, and site information. The part-specific tag information is information that associates each block with the type of sub-image data to be reproduced for each block. For example, the block A1 of the main image data is associated with moving image sub-image data. There may be a plurality of types of sub-image data to be associated. The part information is information indicating the size of each block of the main image data divided in the part determination to be worried later. For example, the block A1 is one block when the main image data is divided into five in the horizontal direction and three in the vertical direction. The size of each block may be non-uniform depending on the size of the subject.

  After main image data is converted into a main image file (step S227), the control unit 1 records the sub image data as a sub image file in the recording unit 4 (step S228). Sub-image data and tag information are stored in the sub-image file. The tag information is information for associating the main image data block with the sub image data. FIG. 13B is a configuration example of the sub image file. The sub image file k and the sub image file l shown in FIG. 13B store sub image data and tag information. The tag information of the sub-image file k includes information on the name of the main image data corresponding to the sub-image data k and the block of the main image data, the timing for reproducing the sub-image data, and the use of the sub-image data. For example, the sub image data k corresponds to the block B1 of the main image data img1 in FIG. 13A as indicated by the tag information. When reproducing the sub image data k of the block B1 of the main image data img1, the sub image data k is reproduced at the timing T1 shown in FIG. On the other hand, in the sub-image data l of the sub-image file l, the usage information indicates that the sub-image data is for exposure. The timing information indicates that the main image data img1 is reproduced in the block D2 at the timing T1. Note that a plurality of pairs of sub-image data and tag information may be stored in the sub-image file. For example, a plurality of moving image sub-images and tag information are collectively handled as sub-image files, so that the user can easily manage the moving image sub-image files. The imaging apparatus 100 sequentially reproduces the sub-image data obtained in time series. With the sub-image data for exposure, the user gradually sees a subject that is difficult to see. In the moving image data, the user can see the reproduction of the movement of the subject. By gradually reproducing the sub-image data, the imaging apparatus 100 can increase the user's expectation or cause the user to be excited. That is, unlike the case where the accompanying information is simply displayed, the reproduction along the time series as described above can give the user a sensory flavor. Playback along the time series may be played back in slow motion or fast forward. Alternatively, the sub-image data reproduced in time series may be reproduced by shifting to a block different from the corresponding block.

  As described above, in the shooting mode of the imaging apparatus 100 according to an embodiment of the present invention, the main image data required by the user and the sub-image data indicating the related information at the time of shooting the main image data are acquired, and the respective image data are associated with each other. Record. The sub-image data is acquired before and after the main image data is photographed for moving image use, exposure use, or focus change use. The user can easily acquire the related information at the time of acquiring the main image data only by the main image data shooting operation. As described above, the imaging apparatus 100 determines that sufficient depiction is not obtained for exposure and focus in each block that is a quadrilateral of the main image data, and supplements the image representation of each block. Obtain sub-image data. Elements of this determination are the exposure amount and the contrast amount. In addition, this determination may be made by comparing a plurality of images acquired in time series. The shape of each block may be a specific area having a shape other than a quadrilateral. The element of this determination may be a difference in distance information of each part, depth of field information, distance distribution information, or an image feature amount, and re-photographed from image data obtained by shifting the focus position in the hill-climbing AF method. It is also possible to make a determination (re-acquisition determination) that recommends.

  Next, the playback function of the imaging apparatus 100 according to an embodiment of the present invention will be described with reference to FIGS. In the reproduction mode, the user can view the sub-image data reproduced in the block by touching the position of the block of the main image.

  FIG. 14 is a diagram conceptually showing the reproduction function of the imaging apparatus according to the embodiment of the present invention. The imaging apparatus 100 including the reproduction apparatus according to the first embodiment of the present invention includes an imaging unit 111, a continuous shooting result recording unit 116, a designation unit 120, a reproduction control unit 130, and a reproduction unit 121. The imaging unit 111 captures a subject and acquires image data. The continuous shooting result recording unit 116 records a plurality of image data and information for associating the plurality of image data. The designation unit 120 designates a predetermined block from a plurality of blocks formed by dividing the main image data. The reproduction control unit 130 corresponds to the control unit 1, and includes an image region classification unit 112, a region cutout unit 117, a reproduction method change unit 118, and a sorting selection unit 119. The image area classification unit 112 corresponds to the part information unit 1d, reads main image data from the continuous shooting result recording unit 116, divides it into a plurality of blocks, and determines whether there is sub-image data associated with each block. Determine. The area cutout unit 117 corresponds to the display control unit 1e, and cuts out the position of the block designated by the designation unit 120. The reproduction method changing unit 118 corresponds to the part information unit 1d, and selects sub-image data of imaging conditions (uses) to be reproduced at the position of the cut out block. The selection selection unit 119 corresponds to the display control unit 1e, reads out the sub-image data of the shooting condition selected by the reproduction method change unit 118 from the continuous shooting result recording unit 116, and reproduces the second image data as a reproduction unit. It outputs to 121. The reproduction unit 121 corresponds to the display unit 8, reproduces image data, and displays an image. The imaging apparatus 100 records sub-image data of shooting conditions (uses) to be reproduced at the position of the extracted quadrilateral block. The sub-image data is acquired to supplement the image expression by determining that the exposure and focus are not sufficient for the main image data. The determination element of the sub image data is determined from the exposure amount and the contrast amount of each block. The shape of the quadrilateral block to be determined may be a specific area having a different shape. This determination may be performed by comparing a plurality of images acquired in time series. The sub-image data determination element may be a difference in distance information of each part or information on the depth of field, and a determination that recommends re-shooting from image data in which the focus position is shifted in the hill-climbing AF method (re-entry) Acquisition determination).

  Next, an operation example of the playback mode of the imaging apparatus according to the embodiment of the present invention will be described with reference to FIG. First, the control unit 1 reads a plurality of main image files shown in FIG. 13A recorded in the recording unit 4 and reproduces the plurality of main image data to be listed on the display unit 8 (step S301). ). Thereafter, the control unit 1 determines main image data to be reproduced by detecting touch on the touch panel 8b, and reproduces main image data corresponding to the touch position (step S302). Thereafter, the control unit 1 determines whether or not a touch on the main image data being reproduced is detected (step S303). When it is determined that a touch on the reproduced main image data has not been detected (NO in step S303), the control unit 1 displays on the display unit 8 when an operation on the operation determination unit 5 is detected. An image switching operation, a mode changing operation, an image data transmission / reception operation, and the like are performed (step S315). On the other hand, when determining that a touch on the main image data being reproduced has been detected (YES in step S303), the control unit 1 sets a plurality of pieces of main image data based on the site-specific tag information of the main image file. Divide into blocks. The control unit 1 determines whether or not the position of the main image data where the touch is detected in step S303 is associated with the sub image data for moving image from the part-specific tag information (step S304). When it is determined that the position of the main image data where the touch is detected in step S303, for example, the block B1 is associated with the sub-image data for moving images (YES in step S304), the control unit 1 performs processing shown in FIG. After reading the sub image file k in b), the block B1 at the position where the touch is detected is cut out, and the sub image data k is reproduced in the cut out block B1 (step S311). The reproduction timing of the sub image data k is timing information T1 of the sub image file k. Note that the control unit 1 may reproduce the layer of the sub image data superimposed on the layer of the main image data without cutting the main image data.

  On the other hand, when it is determined that the position of the main image data where the touch is detected in step S303 is not associated with the sub image data for moving images (NO in step S304), the control unit 1 detects the touch. It is determined whether the position of the main image data is associated with the sub image data for exposure (step S305). When it is determined that the position of the main image data where the touch is detected, for example, the block D2 is associated with the sub image data for exposure (YES in step S305), the control unit 1 in FIG. After reading the sub-image file l, the block D2 is cut out, and the sub-image data l is reproduced in the cut-out block D2 (step S312). The reproduction timing of the sub image data l is the timing information T1 of the sub image data l. On the other hand, after the sub-image data l is reproduced or when it is determined that the position of the main image data where the touch is detected is not associated with the sub-image data for exposure (NO in step S305), the control The unit 1 determines whether or not the position of the main image data where the touch is detected is associated with the sub image data for focus change (step S306). When it is determined that the position of the main image data where the touch is detected is associated with the sub-image data for focus change (YES in step S306), the control unit 1 displays the sub-image for focus change (not shown). After the data is read, the block of the main image data in which the touch is detected is cut out, and the sub image data for changing the focus is reproduced in the cut out block (step S313). On the other hand, after the sub image data for focus change is reproduced or when it is determined that the position of the main image data where the touch is detected is not associated with the sub image data for focus change (NO in step S306). ), The reproduction control unit 130 reproduces the main image data at the position (step S314).

  As described above, in the reproduction mode of the imaging apparatus 100 according to the embodiment of the present invention, the main image data and the sub image data associated with the main image data are reproduced. When the user designates the position of the main image data by touching the main image data to be reproduced, the related information at the time of acquiring the main image data can be easily viewed. The imaging apparatus 100 sequentially reproduces the sub-image data obtained in time series. With the sub-image data for exposure, the user gradually sees a subject that is difficult to see. In the moving image data, the user can see the reproduction of the movement of the subject. By gradually reproducing the sub-image data, the imaging apparatus 100 can increase the user's expectation or cause the user to be excited. That is, unlike the case where the accompanying information is simply displayed, the reproduction along the time series as described above can give the user a sensory flavor. Playback along the time series may be played back in slow motion or fast forward. Alternatively, the sub-image data reproduced in time series may be reproduced by shifting to a block different from the corresponding block.

  Next, modified examples of the shooting mode and the playback mode of the imaging apparatus 100 according to the position embodiment of the present invention will be described with reference to FIGS. 16, 17, and 18. The size of the sub image data in the modification is the same as that of the main image data. Note that the configurations of the shooting mode and the playback mode are the same as the configuration examples shown in FIGS. 1, 2, and 14.

  An operation example of the photographing mode of the modification will be described with reference to FIG. After the shooting mode is selected (step S201) and shooting by the imaging unit 111 is started (step S202), the control unit 1 temporarily records moving image sub-image data (step S406). Here, unlike the embodiment, the sub-image data in the modification is photographed without limiting the position and size within the angle of view. Thereafter, the control unit 1 determines whether or not to shoot (step S211). When it is determined that shooting is to be performed (YES in step S211), the control unit 1 performs shooting to acquire main image data (step S212). Thereafter, the control unit 1 obtains moving image sub-image data (step S422). Thereafter, the control unit 1 acquires sub-image data for exposure (step S424). Thereafter, the control unit 1 acquires a plurality of sub-image data for changing the focus (step S426). Thereafter, the main image data is recorded as a main image file (step S227). Thereafter, the control unit 1 records the sub image data as a sub image file (step S228).

  As described above, in the example of the photographing operation in the modification shown in FIG. 16, the sub-image data with the full angle of view is recorded, and therefore, the part determination which will be anxious later is not performed when acquiring the image data. The position and size of the sub-image data corresponding to is not determined in the shooting mode.

  The position and size of the sub image data corresponding to the main image data are determined in the reproduction mode. An example of the operation in the reproduction mode of the modification will be described with reference to FIG.

  The main image file recorded in the recording unit 4 is read, the main image data is reproduced on the display unit 8 (step S301), and the control unit 1 reproduces the selected main image data (step S302). Thereafter, the control unit 1 performs a site determination to be worried later (step S204). In the modified example, in the reproduction mode, the position of the main image data and the sub image data are associated with each other by determining a part of interest later. In the modification, the position, size, shape, and the like where the sub-image data is reproduced will be described as a case where it is divided into 15 blocks. Of course, the shape of the sub-image data may be a shape of a subject. Therefore, in the modified example, the information stored in the main image file and the sub-image file is based on the part-by-part tag information of the main image file, the part information of the sub-image file, and the candidates based on the determination of the part determination to be worried later. Usage information is updated.

  The configuration example shown in FIG. 18 of the main image file and sub-image file in the modification is the same as the configuration example shown in FIG. For example, in FIG. 13, the tag information of the sub-image file m includes main image data information corresponding to the sub-image data m, timing information indicating reproduction of the sub-image data m at the timing T1, and sub-image data m. Has information indicating that it is a candidate use for moving images and exposure.

  The tag information of the sub-image file n includes information on the main image data corresponding to the sub-image data n, timing information for reproducing the sub-image data n at the timing T8, and candidates for sub-image data n for changing the focus. Application information.

  By the way, after the part determination to be worried later is performed (step S204), the reproduction control unit 130 determines whether or not a touch is detected on the main image (step S303). When it is determined that a touch on the main image has been detected (YES in step S303), the reproduction control unit 130 determines that the position of the main image data where the touch is detected by the image area classification unit 112 is the sub-picture for the moving image. It is determined whether the image data is associated with the image data (step S304). When it is determined that the position of the touched main image data is associated with the sub image data for moving images (YES in step S304), the reproduction control unit 130 touches the sub image data for moving images. The sub image data is cut out so as to correspond to the size of the block at the position, and the cut sub image data is superimposed on the main image data block and reproduced in the order of timing (step S511).

  On the other hand, after the sub image data for moving images is reproduced or when it is determined that the position of the main image data where the touch is detected is not associated with the sub image data for moving images (NO in step S304). The reproduction control unit 130 determines whether or not the position of the block where the touch is detected is associated with the exposure sub-image data (step S305). When it is determined that the position of the main image data where the touch is detected is associated with the exposure-corrected sub-image data (YES in step S305), the reproduction control unit 130 displays the sub-image data for exposure. Then, the image is cut out so as to correspond to the size of the touched main image, and the cut out sub-image data is superimposed on the main image data block and reproduced in the order of timing (step S512). On the other hand, after the sub-image data for exposure is reproduced or when it is determined that the position of the touched main image data block is not associated with the sub-image data for exposure (NO in step S305), The playback control unit 130 determines whether or not the position of the touched main image data is associated with the focus sub image data (step S306). When it is determined that the position of the touched main image data is associated with the sub image data for focusing (YES in step S306), the reproduction control unit 130 touches the sub image data for focusing. The sub image data is cut out so as to correspond to the size of the main image block, and the cut sub image data is superimposed on the main image data block and reproduced (step S513).

  As described above, in the reproduction operation example in the modification shown in FIG. 17, the position of the main image data and the sub image data corresponding to the position are determined. When the position of the main image data corresponding to the sub image data is selected by touching the playback unit 121, the sub image data is based on the information stored in the main image file and the sub image file. Then, the selected position is cut to a predetermined size and reproduced.

  As described above, in the modification of the embodiment of the present invention, the main image data and the sub image data having the same size as the main image data are acquired in the shooting mode. In the reproduction mode, information that associates the position of the main image data with the sub image data is acquired. The information is stored in the main image file and the sub image file.

  The display of the sub image may be displayed so as to overlap the main image, or a block of the main image may be cut out and replaced with the sub image. In one embodiment of the present invention, image data obtained by correcting moving image, exposure, or focus is taken as an example of sub-image data. However, the sub-image data that the user wants to see later is not limited thereto, and may be sub-image data obtained by optically zooming the block. Sub-image data obtained by enlarging the inside of the block with optical zoom is acquired. When a block is touched, the sub-image data is reproduced in the block, so that an enlarged image with higher resolution can be shown to the user.

  In addition, each processing method performed by the imaging apparatus according to the above-described embodiment, that is, the processing illustrated in each flowchart is stored as a program that can be executed by the control unit 1. This program is stored in a storage medium of an external storage device such as a memory card (ROM card, RAM card, etc.), magnetic disk (floppy (registered trademark) disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. The above-described processing can be executed by reading the stored program and controlling the operation by the read program.

  DESCRIPTION OF SYMBOLS 1 ... Control part, 1b ... Shadow determination part, 1c ... Focus determination part, 1d ... Part information part, 1e ... Display control part, 1f ... Motion determination part, 1g ... Communication control part, 1h ... Subject determination part, 2 ... Imaging Elements: 3 ... eyepiece display unit, 3b ... eye sensor, 4 ... recording unit, 4b ... connection destination DB, 4c ... target DB, 5 ... operation determination unit, 6 ... communication unit, 7a ... posture sensor, 7b ... direction sensor, DESCRIPTION OF SYMBOLS 8 ... Display part, 8b ... Touch panel, 9 ... Clock, 10 ... Location detection part, 21 ... Network, 22 ... Smartphone, 23 ... Server, 23b ... Display control part, 23c ... Access determination part, 23d ... Association part, 23e ... 1. Server recording unit, 26 ... lens, 100 ... imaging device, 110 ... continuous imaging unit, 111 ... imaging unit, 112 ... image area classification unit, 113 ... imaging condition changing unit for each area, 1 DESCRIPTION OF SYMBOLS 14 ... Re-acquisition part according to area | region, 115 ... Imaging result correlation recording part, 116 ... Continuous fire result recording part, 117 ... Area extraction part, 118 ... Playback method change part, 119 ... Playback method change part, 120 ... Designation part, 121 ... Reproduction unit, 130 ... reproduction control unit

Claims (8)

An imaging unit for photographing a subject;
The first image data captured by the imaging unit is recorded, and the first image data is based on the contrast amount for each area, the difference in distance information for each area, or the depth of field information for each area. A plurality of second image data captured by the imaging unit is recorded in association with the area while changing a focus condition for the area determined that a sufficient depiction of the subject is not obtained. A recording section;
A display unit for displaying an image based on the first image data;
A touch panel for detecting a touch on the display unit;
A control unit that reproduces, on the display unit, the second image data corresponding to the touched area when a touch on the image based on the first image data displayed on the display unit is detected. When,
An imaging apparatus comprising:   The imaging device according to claim 1, wherein the second image data includes image data in focus in the corresponding region.   The imaging apparatus according to claim 1, wherein the second image data is image data obtained by photographing while shifting a focus from near to far. An imaging unit for photographing a subject;
The area where the first image data photographed by the imaging unit is recorded and it is determined that a sufficient depiction of the subject is not obtained based on the exposure amount for each area of the first image data A recording unit that records a plurality of second image data captured by the imaging unit while changing the exposure condition with respect to the region;
A display unit for displaying an image based on the first image data;
An imaging apparatus comprising: Displaying an image based on the first image data obtained by photographing the subject with the imaging unit on the display unit;
Detecting a touch on the display unit with a touch panel;
When a touch on an image based on the first image data displayed on the display unit is detected, a contrast amount for each region of the first image data, a difference in distance information for each region, or for each region Touching from among a plurality of second image data shot by changing the focus condition for the area determined that sufficient depiction of the subject has not been obtained based on the depth of field information Reproducing the second image data corresponding to the region that has been reproduced on the display unit;
A method for controlling an imaging apparatus comprising: Displaying an image based on the first image data obtained by photographing the subject with the imaging unit on the display unit;
Detecting a touch on the display unit with a touch panel;
When a touch on the image based on the first image data displayed on the display unit is detected, a sufficient depiction of the subject is obtained based on the exposure amount for each area of the first image data. The second image data corresponding to the touched region is displayed on the display unit from among a plurality of second image data photographed by changing the exposure condition for the region determined not to be Playing,
A method for controlling an imaging apparatus comprising: Displaying an image based on the first image data obtained by photographing the subject with the imaging unit on the display unit;
Detecting a touch on the display unit with a touch panel;
When a touch on an image based on the first image data displayed on the display unit is detected, a contrast amount for each region of the first image data, a difference in distance information for each region, or for each region Touching from among a plurality of second image data shot by changing the focus condition for the area determined that sufficient depiction of the subject has not been obtained based on the depth of field information Reproducing the second image data corresponding to the region that has been reproduced on the display unit;
A control program for an image pickup apparatus for causing a computer to execute. Displaying an image based on the first image data obtained by photographing the subject with the imaging unit on the display unit;
Detecting a touch on the display unit with a touch panel;
When a touch on the image based on the first image data displayed on the display unit is detected, a sufficient depiction of the subject is obtained based on the exposure amount for each area of the first image data. The second image data corresponding to the touched region is displayed on the display unit from among a plurality of second image data photographed by changing the exposure condition for the region determined not to be Playing,
A control program for an image pickup apparatus for causing a computer to execute.