JP5635546B2 - Imaging device and method for controlling imaging device - Google Patents

Description

  The present invention relates to a photographing device, and more particularly to a photographing device capable of photographing when a display screen for live view display of a subject image is touched and a method for controlling the photographing device.

  Conventionally, in a photographing apparatus such as a camera, shutter release is performed by operating an operation member such as a release button. However, it has been proposed to perform shutter release by touching a liquid crystal display screen (Patent Document 1). reference). In the camera disclosed in Patent Document 1, shutter release is performed after a certain delay from when the touch panel is touched in order to prevent camera shake when the screen is touched.

JP 11-252427 A

  When the shutter release is performed when the display screen is touched, if the focused area is focused, the subject intended by the user can be focused, which improves usability. However, since a delay time of about 0.5 seconds occurs between when the user wants to touch the display screen and when the user actually touches, when the subject is moving, the subject intended by the user is touched in the touched area. May not exist. In such a case, there is a problem that even if the focused area is focused, the subject intended by the user cannot be focused.

  The present invention has been made in view of such circumstances, and there is provided a photographing device and a photographing device control method that are focused on the subject intended by the user even when the subject is moving when touched. The purpose is to provide.

An imaging apparatus according to a first aspect of the present invention includes an imaging unit that photoelectrically converts a subject image and outputs image data, a display unit that displays the subject image based on image data output from the imaging unit, and the display unit The touch screen for detecting whether the touch on the display screen is a plurality of divided areas and the imaging surface of the imaging unit are divided into a plurality of areas corresponding to the areas, and the image data is A motion detection unit for detecting the movement of the subject for each area based on the memory, a memory for storing the history of the motion of the subject detected by the motion detection unit for each area, and a predetermined time before the touch operation on the touch panel. The movement of the subject is determined based on the history of the movement of the subject stored in the memory, and based on the determination result, the AF area to be focused on by the photographing lens is determined. Possess a determination unit for constant for the automatic focusing unit to perform focusing for areas determined by the determining unit, and the determination unit, based on a history of movement of the object, a first constant If the subject is stationary between the time and the second fixed time, the AF area is determined by comparing adjacent areas, and the subject moves between the first fixed time and the second fixed time. If so, the AF area is determined using a vector .

An imaging device according to a second aspect of the invention includes an imaging unit that photoelectrically converts a subject image and outputs image data, a display unit that displays the subject image based on image data output from the imaging unit, and the display unit The touch screen for detecting whether the touch on the display screen is a plurality of divided areas and the imaging surface of the imaging unit are divided into a plurality of areas corresponding to the areas, and the image data is A motion detector for detecting the motion of the subject for each area based on the memory, a memory for storing the motion history of the subject detected by the motion detector for each area, and a predetermined touch operation on the touch panel . the movement of the subject from the predetermined time before determination based on a history of movement of the object stored in the memory, it is subject to focusing of the photographing lens based on the determination result Includes a determination unit that determines an AF area, and the automatic focus adjustment unit that performs focus for areas determined by the determining unit, and the determination unit, based on the history of the movement of the subject, the If the subject has been stationary before a predetermined time, the AF area is determined by comparing adjacent areas, and if the subject has moved from before the predetermined time, a vector is used. To determine the AF area .

According to a third aspect of the present invention, there is provided a control method for a photographing apparatus including an imaging unit that converts a subject image into image data, and a display unit that can detect a touch operation, and the image data from the imaging unit. A storage step for detecting the movement of the subject based on the information, storing a history of the movement of the subject, a detection step for detecting whether or not the touch operation has been performed, and the detection step in which the touch operation has been performed. If detected , based on the movement history of the subject stored in the storage step, if the subject is stationary between the first fixed time and the second fixed time, it is determined by comparing adjacent areas. The AF area is determined, and when the subject has moved between the first fixed time and the second fixed time, a vector is used to determine the AF area. It has a determining step of determining, and a photographing step for focusing and release against the AF area determined in the determining step.
According to a fourth aspect of the present invention, there is provided a control method for a photographing apparatus including an imaging unit that converts a subject image into image data, and a display unit that can detect a touch operation, and the image data from the imaging unit. A storage step for detecting the movement of the subject based on the information, storing a history of the movement of the subject, a detection step for detecting whether or not the touch operation has been performed, and the detection step in which the touch operation has been performed. If detected , based on the movement history of the subject stored in the storage step, the AF area is determined by comparing adjacent areas if the subject has been stationary before a predetermined time. A determination step for determining the AF area using a vector when the subject has moved from before the predetermined time. If, having, a photographing step for focusing and release against the AF area determined in the determining step.

  ADVANTAGE OF THE INVENTION According to this invention, even if it is a case where a to-be-photographed object is moving when it touches, the imaging device and the control method of an imaging device which focus on the to-be-photographed object's intent can be provided.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the structure of the digital camera concerning 1st Embodiment of this invention, (a) is a block diagram which mainly shows an electrical structure, (b) is arrangement | positioning of the area which divided | segmented the imaging surface of the image pick-up element. FIG. It is a flowchart which shows the imaging operation of the digital camera concerning 1st Embodiment of this invention. FIG. 4 is a block diagram illustrating changes in subject movement for each area in the digital camera according to the first embodiment of the present invention. FIG. 4 is a block diagram illustrating changes in subject movement for each area in the digital camera according to the first embodiment of the present invention. It is a flowchart which shows the imaging operation of the digital camera concerning 2nd Embodiment of this invention. It is a block diagram which shows the change of the motion of the to-be-photographed object for every area in the digital camera concerning 2nd Embodiment of this invention. It is a flowchart which shows the imaging operation of the digital camera concerning 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement of the search of the digital camera concerning 3rd Embodiment of this invention. It is a timing chart from vector calculation to focusing in the digital camera concerning a 3rd embodiment of the present invention. It is a block diagram which shows the change of the motion of the to-be-photographed object for every area in the digital camera concerning 3rd Embodiment of this invention. It is a flowchart which shows the imaging operation of the digital camera concerning 4th Embodiment of this invention.

  Hereinafter, a preferred embodiment will be described using a digital camera to which the present invention is applied. A digital camera according to a preferred embodiment of the present invention has an imaging unit, and converts the subject image into image data by the imaging unit, and arranges the subject image on the back surface of the main body based on the converted image data. Live view is displayed on the display. The photographer determines the composition and the photo opportunity by observing the live view display.

  Further, the display unit is provided with a touch panel unit, and the user touches the touch panel unit when determining the composition and the photo opportunity. When touched, the subject in the touch area is focused and exposed. At this time, in consideration of the delay time until the user touches and the movement of the subject, control is performed using image data of the AF area where the subject intended by the user exists. Thereafter, a shutter release operation is performed, image data output from the imaging unit is subjected to image processing, and the image processed image data is recorded on a recording medium. The image data recorded on the recording medium can be reproduced and displayed on the display unit when the reproduction mode is selected.

(First embodiment)
FIG. 1A is a block diagram mainly showing an electrical configuration of the digital camera according to the first embodiment of the present invention. In FIG. 1A, a lens 1 is an optical lens for forming a subject image, and includes a focus lens, a zoom lens, and the like.

  An imaging unit 3 including an imaging element 3A is disposed on the optical axis of the lens 1 and in the vicinity where a subject image is formed. The imaging unit 3 photoelectrically converts the subject image with the imaging device, outputs image data in a digital signal format to the bus 11, and receives a control signal and the like from the CPU 21. In this embodiment, image data is output at 60 frames per second. Of course, it may be more or less than 60 frames / second.

  FIG. 1B shows a plurality of areas configured by dividing the imaging surface of the imaging device 3A. In the present embodiment, the imaging surface of the imaging device 3A is divided into 30 areas (A, A) to (F, E). Each area 3Aa has a small rectangular shape, and a large number of pixels are two-dimensionally arranged in each area 3Aa, and a photoelectric conversion signal is output from each pixel. Each area 3Aa is a local vector calculation area and has a rectangular size suitable for AF (Auto Focus). A tracking unit 15 to be described later calculates a moving amount and a moving direction of a subject (for example, a human face) moving within the area 3Aa as a local vector. This calculation is performed by a known method for obtaining a shift direction, a shift amount, and the like necessary for matching images for each frame output from each area of the image sensor 3A. The shift direction and shift amount are calculated by cutting out each area from two temporally adjacent frames, shifting the cut out area by one pixel, summing up the differences for each pixel, and shifting by two pixels. The difference is integrated for each pixel, and the difference is integrated for each pixel while sequentially shifting the pixels. By determining the shift direction and the shift amount when the integral value obtained while shifting the pixel is the smallest, the movement amount and the movement direction of the subject can be obtained. Furthermore, the subject can be tracked by repeating this calculation while sequentially shifting two temporally adjacent frames.

  The aggregate 3Ab of each area 3Aa has a large rectangle and is a global vector calculation area. This global vector calculation area calculates the movement amount and movement direction of the entire screen. The movement of the entire screen when the entire digital camera moves due to the hand shake of the user or the like is calculated.

  In calculating the above-described local vector and global vector, the tracking unit 15 or the CPU 21 described below uses the luminance information and the color difference information in the image data output from the imaging unit 3. Further, the rectangular size and the number of rectangles of each area 3Aa for calculating the local vector are set so as to be processable according to the requirements of the software processing capability by the CPU 21, the hardware circuit scale of the image processing unit 5, the DRAM bandwidth, and the like. . In addition to the above requirements, the rectangular size may be determined as an optimum size depending on the subject intended by the photographer. For example, the optimal size may be set according to the subject, such as a face, a bird, an insect, a mountain, or the like.

  Returning to FIG. 1A, the image processing unit 5 inputs the image data output from the imaging unit 3, the image data temporarily stored in the memory 25, etc., performs various image processing, and outputs to the bus 11. To do. For example, basic image processing such as white balance, extraction of contrast information, image data compression and expansion processing, live view display image processing, and the like are performed.

  The display unit 7 includes a liquid crystal display (LCD), an organic EL display, and the like disposed on the back surface of the camera body. The display unit 7 inputs image data from the imaging unit 3 via the bus 11 and performs live view display or playback display. And menu display. The recording unit 9 includes a built-in or loadable storage medium, records image data, and reads recorded image data.

  The lens control unit 13 is connected to the CPU 21, the image processing unit 5, and the like via the bus 11 and performs drive control of the focus lens in the lens 1. The lens control unit 13 drives the focus lens under the control of the CPU 21 so that the contrast of the image data extracted by the image processing unit 5 has a peak value. Thus, the lens 1 is focused.

  The tracking unit 15 is connected to the image processing unit 5 and the CPU 21 through the bus 11 and tracks the subject. Here, the tracking operation is a known operation in which even if the tracking target and the subject move, the subject is tracked, the focus is adjusted at the moving destination, and the exposure is also set to the appropriate exposure. As a tracking method, for example, images from each area 3Aa are compared for each frame, and the movement destination is tracked. For this tracking, the above-described operations such as local vectors and global vectors are performed (however, part or all of them may be performed by the CPU 21). In addition, based on the comparison between the local vector of each area 3Aa or the current image data in each area 3Aa and the image data of a predetermined time, as will be described later (described with reference to FIG. 3), It is determined whether the subject is moving or stationary, and the determination result is stored in the memory 25.

  The touch panel unit 17 is arranged on the front surface of a display display such as a liquid crystal display (LCD) or an organic EL display of the display unit 7 or is configured integrally with the display display, and the user touches the display screen of the display unit 7 with a finger or the like. The touch detection signal is output to the bus 11. Since the touch detection signal indicates a touch position, it is possible to detect which area the user has touched, and a start point or an end point when a slide operation is performed. Further, the touch surface of the touch panel unit 17 is divided into a plurality of areas, and it is possible to detect which area the user has touched.

  The CPU 21 is a central processing unit and performs overall control of the digital camera according to a program stored in the memory 25. For example, when the touch panel unit 17 is touched by the user, the touch panel unit 17 functions as a determination unit that determines a subject to be focused or exposed according to the movement of the subject image detected based on the image data from the imaging unit 3. Further, it also functions as a determination unit that determines an AF area to be focused on by the lens 1 based on the movement of the subject from a predetermined time before the touch operation on the touch panel unit 17. Also, it functions as an automatic focus adjustment unit that drives the focus lens of the lens 1 based on the contrast information extracted by the image processing unit 5 to focus on the determined subject.

  The timer 23 performs a time measuring operation. For example, when a predetermined time has elapsed after receiving a time measurement start signal from the CPU 21, the progress information is output to the CPU 21.

  The memory 25 includes an electrically rewritable nonvolatile memory such as a flash memory, and an electrically rewritable volatile memory such as a DRAM (Dynamic Random Access Memory) and an SDRAM (Synchronous Dynamic Random Access Memory). The memory 25 stores various adjustment values at the time of factory shipment in addition to the above-described program for operating the CPU 21. In addition, image data output from the imaging unit 3 is temporarily stored. In the present embodiment, the latest image data for 0.5 seconds is stored (the image data for 30 frames is stored because it is 60 fps). Further, as described above, since the tracking unit 15 determines whether the subject is moving or stationary for each area 3Aa, the history of the determination result is stored.

  Next, the operation of this embodiment will be described with reference to FIGS. First, an example of a subject and focusing at that time will be described with reference to FIG. In FIG. 3, the vertical axis represents a change in time, the time T0 is the current time, the time T1 is 0.1 seconds ago, the time T2 is 0.3 seconds ago, and the time T3 is 0.5 seconds ago. The image sensor 3A is divided into 20 parts (A, A) to (E, D) (in FIG. 1B, it is divided into 30 parts, but here, an example of 20 parts is shown).

  The tracking unit 15 compares the image data at the time T3 and the time T1 for each area on the basis of the time T3 up to a certain time, and determines whether the subject is moving or stationary in each area. Similarly, the image data at time T3 and time T2 and the image data at time T3 and time T0 are compared for each area to determine whether the subject is moving or stationary in each area. Note that the time T3 is used as a reference time, and it is not limited to determining whether the subject is moving or stationary in each area. For example, the time T0 (current) is used as a reference and compared with the times T1, T2, and T3. May be.

  In the example shown in FIG. 3, the subjects in all areas (A, A) to (E, D) of the image sensor 3A are stationary at time T3, and only the area (B, C) moves at time T2. The area is stationary, and at time T1, only the areas (C, A), (D, A), (B, C) move and the other areas are stationary.

  Assume that the user touches the area (D, C) at time T0. Since there is a delay of about 0.5 seconds from when the eye is recognized to when it is actually touched, the user intends the subject in the area (D, C) at time T3 (0.5 seconds before). I think it touched. In the example shown in FIG. 3, the subject in the area (D, C) at the time T3 does not move at the times T2, T1, and T0 and remains stationary. A focusing operation is performed on (D, C), and a release operation is performed by controlling so as to achieve an appropriate exposure.

  In this way, in the example shown in FIG. 3, it is determined whether the subject in the touched area was moving or stationary. If the result of the determination is that the subject is stationary, the touched area is focused and remains as it is. Release operation is being performed.

  Next, another example of the subject and focusing at that time will be described with reference to FIG. In the example of FIG. 3, the subject in the touch area is stationary, but in the example of FIG. 4, the subject in the touch area is moving. 4, as in FIG. 3, the vertical axis represents a change in time (time T0 to time T3), and the image sensor 3A includes areas (A, A) to (E, D).

  Also in the example in FIG. 4, the image processing unit 5 uses time T3 as a reference time, image data at time T3 and time T1, image data at time T3 and time T2, and image data at time T3 and time T0. Comparison is made for each area to determine whether the subject is moving or stationary in each area.

  Assume that the user touches the area (C, C) at time T0. As described above, since there is a delay of about 0.5 seconds from the recognition by the eye to the actual touch, the user moves to the area (C, C) at time T3 (0.5 seconds before). It seems to have touched the intended subject. In the example shown in FIG. 4, the subject that was in the area (C, C) at time T3 was stationary at times T2 and T1 (at least between 0.5 seconds and 0.1 seconds before). Moves from time T1 to T0 (from 0.1 seconds ago to the present) and moves to the area (D, c). Therefore, a focusing operation is performed on the coordinates (D, C) (also referred to as AF area) of the destination area, and a release operation is performed by controlling so as to achieve proper exposure.

  In this way, in the example shown in FIG. 4, it is determined whether the subject in the touched area has been stopped a little before, and the subject in the area just before is focused and the release operation is performed. That is, AF detection is performed in consideration of visual delay and subject movement in order to perform a focusing operation or the like on the subject that has been stationary until the time T1 immediately before the touch area (C, C). The area for use is changed from the touch area (C, C) to the AF area (D, C).

  Next, the operation of this embodiment will be described using the flowchart shown in FIG. This flow is executed by the CPU 21 in accordance with the program stored in the memory 25. When the imaging operation starts, this flow starts. First, it is determined whether or not the touch panel unit 17 has been touched (S1). When the imaging operation is started, image data is output from the imaging unit 3 at a rate of 60 frames per second, and live view display is performed on the display unit 7 based on the image data. In this step, whether or not the user has touched the display screen of the display unit 7 is determined based on the touch detection signal from the touch panel unit 17.

  If the result of determination in step S1 is that it has not been touched, the monitor result of each local area area is recorded (S3). As described above, it is determined whether the subject is moving or stationary for each area 3Aa, and the determination result is recorded in the memory 25. In addition, image data (30 frames) corresponding to the latest 0.5 seconds is temporarily stored in the memory 25 while being updated. In step S3, when image data is recorded and still / motion of the subject for each area is recorded, the process returns to step S1.

  If the result of determination in step S1 is that a touch has been made, it is next determined whether or not the subject in the touched area has moved (S7). In step S3, the history of the stillness / movement of the subject for each area is recorded for each frame. In this step, it is determined using this history whether the subject has moved or remained stationary in the area belonging to the touched coordinates. In the determination, if it is not moving at all times remaining in the history, it is determined No, and if it is moving at at least one time, it is determined Yes.

  If the result of determination in step S7 is that the subject in the touched area has moved, it is next determined whether or not the subject has stopped for a first fixed time before touching (S9). Here, it is determined whether or not the image data has been stopped for the first predetermined time before the touch using the image data of the latest predetermined time temporarily stored in step S3. In the present embodiment, the first fixed time is 0.5 seconds, and whether or not the subject in the touched area has been stationary from the present (T0) to 0.5 seconds before (T3). Determine. In the example described with reference to FIG. 3, it is determined as Yes because it has been stationary from 0.5 seconds before to the present time (first fixed time). On the other hand, in the example described with reference to FIG. 4, it was stationary from 0.5 seconds before to 0.1 seconds ago, but it is moving from 0.1 seconds before to the present. No is determined.

  If the result of determination in step S9 is that it has not stopped for a certain period of time before touching, the subject that has been in the touched area is tracked (S11). Here, since the subject that was in the area touched by the user has moved, the subject is tracked. For example, as in the example shown in FIG. 4, the subject that has been stationary in the touch area (C, C) from time T3 to T1 is tracked. As a tracking method, the local vector may be calculated by the tracking unit 15 and tracked. However, by comparing the image data of the touched area with the image data of the area adjacent to the area, the moving direction can be determined. The amount of movement may be obtained and tracked. The area where the tracked subject exists is defined as an AF area.

  If the result of determination in step S7 is No, or if the result of determination in step S9 is Yes, or if the subject is tracked in step S11, then in-focus and release is performed (S21). If the determination in step S7 is No and the determination in step S9 is Yes, the subject intended by the user exists in a stationary state in the touched area. Perform focusing operation. On the other hand, when the subject is tracked in step S11, the focusing operation is performed on the AF area where the tracked subject exists.

  The focusing operation performed in step S21 performs focusing by contrast AF using image data from the selected area. Also, the subject brightness is calculated using the image data from the selected area, and the exposure control value is calculated so as to achieve proper exposure. When the calculation of the focusing operation and the exposure control value is completed, the release operation is performed. When the release operation ends, this flow ends.

  As described above, in the first embodiment of the present invention, the delay time (first constant time) from when the user wants to touch to when the user actually touches is taken into consideration, the delay period of the touched area is changed. The movement of the subject is determined, and an area for performing the focusing operation is selected. For this reason, it is possible to focus on a subject intended by the user even for a moving subject.

  In step S3 of the flow of the present embodiment, the determination result of the stillness / movement of the subject is stored in the memory 25 for each area every time image data for one frame is output. Is used to determine whether or not there is a moving subject in the touched area. For this reason, when touch panel part 17 is touched, it can judge quickly.

  In step S9 of the flow of the present embodiment, the current, 0.1 second, 0.3 second, and 0.5 second previous image data are determined when determining the stillness / movement of the subject in the area 3Aa. Are respectively determined to determine whether they have moved 0.1 seconds ago, 0.3 seconds ago, or 0.5 seconds ago. For this reason, it becomes possible to shorten calculation time.

  Further, as described above, the CPU 21 has a function as a determination unit that determines a subject to be focused, and this determination unit is an area touched before a delay time (first fixed time) of the touch operation. The subject that was in the camera is focused (see S9 in FIG. 2). In addition, the determination unit focuses on the subject that has been in the touched area from a certain time before to the present (see 9 in FIG. 2 and FIG. 3).

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, it is determined whether or not there is a stationary object in the touch area for the first predetermined time. If the object has moved, the subject is tracked. It was. On the other hand, in the second embodiment, it is determined whether or not there is an object still in the touch area before the second certain time (first certain time <second certain time). The tracking method is changed according to this result.

  Since the configuration in the present embodiment is the same as the block diagram shown in FIG. 1 according to the first embodiment, detailed description thereof is omitted. The operation of this embodiment will be described with reference to FIG. The example shown in FIG. 6 shows a tracking method when there is a subject that has moved from before the second fixed time. In FIGS. 3 and 4, the vertical axis represents time, but in FIG. 6, the horizontal axis represents time. The time T0 indicates the current time (touched time), the time T11 is a time corresponding to 28 frames before, the time T12 is a time corresponding to 29 frames before, and the time T13 is 30 frames before (about 0. This is the time corresponding to 5 seconds ago.

  It is assumed that the area (B, C) (position P in the drawing) is touched at time T0. Also in this embodiment, it is assumed that it takes about 0.5 seconds as a delay time from when the user wants to touch to when the user actually touches. At time T13 (0.5 seconds before touch) corresponding to this delay time, the subject in area (B, C) moves to area (C, A) at time T12, T13, and further to time T0 ( At present, it moves to area (E, b) (position Q in the figure). The movement of the subject can be tracked by calculating a local vector in the tracking unit 15.

  In the present embodiment, it is a case where the user does not stand still within a first fixed time (for example, 0.5 seconds) before touching, and further, a second fixed time (for example, 0.1 seconds before touching). If it has stopped before, track in the adjacent area. On the other hand, if it has moved from before the second fixed time before the touch, the subject is tracked using the local vector as described with reference to FIG.

  Next, the operation of this embodiment will be described using the flowchart shown in FIG. This flow is executed by the CPU 21 in accordance with the program stored in the memory 25, as in the first embodiment.

  When the imaging operation starts, this flow starts. First, it is determined whether or not it has been touched (S1). If the result of determination is that it has not been touched, monitor results for each local area area are recorded (S3), and the process returns to step S1. If the result of determination in step S1 is touch, it is determined whether or not the subject in the touched area has moved (S7). If the result of this determination is Yes, it is determined whether or not the first fixed time before touching has been stopped (S9). Since the processing in each step from the above-described steps S1 to S9 is the same as the flow shown in FIG. 2 according to the first embodiment, detailed description thereof is omitted.

  If the result of determination in step S9 is that it has not stopped for the first fixed time before touching, it is next determined whether or not it has stopped before touching and before the second fixed time (S13). In the present embodiment, since the first certain time is 0.5 seconds and the second certain time is 0.1 seconds, the touch is performed between 0.5 seconds and 0.1 seconds before the touch. It is determined whether or not the subject in the designated area is stationary. In this determination, the monitor result stored in step S3 may be used, and the current image data described with reference to FIGS. 3 and 4 and 0.1 seconds, 0.3 seconds, 0.5 seconds. You may carry out by comparing with each previous image data.

  If the result of determination in step S13 is Yes, the subject that has been in the touched area before the second predetermined time is tracked (S15). Since the subject has been stationary in the touched area from 0.5 seconds to 0.1 seconds ago, the subject is tracked. In tracking, as described with reference to FIG. 6, tracking may be performed using a local vector. However, in this embodiment, image data when touched 0.5 seconds ago and the current touched area are used. Tracking is performed by comparing the image data of adjacent areas to determine which area the subject is adjacent to. Since the subject moved immediately before touching, the probability of being present in an area adjacent to the touch area is high, and tracking can be performed in a shorter time than tracking using a local vector.

  On the other hand, if the result of determination in step S13 is No, the subject existing in the area touched before the first predetermined time is tracked (S17). Since the determination result in step S13 was No, the movement was made from the second predetermined time before (before 0.1 seconds in the present embodiment), so the movement to an area away from the adjacent area of the touch area There is a possibility. Therefore, as described with reference to FIG. 6, the tracking unit 15 tracks the subject by using the image data of each frame, and obtains which frame subject currently exists.

  If the result of determination in step S7 is No, if the result of determination in step S9 is Yes, or if tracking of the subject is performed in step S15 or S17, in-focus release as in the first embodiment. (S21). When the focusing operation and the release operation are performed, this flow is finished.

  As described above, in the second embodiment of the present invention, the period from the first predetermined time (0.5 seconds in the present embodiment) to the second predetermined time (0.1 seconds in the present embodiment). The tracking method is changed in steps S15 and S17 when the subject in the touch area is stationary and when the subject in the touch area has moved since the second predetermined time. For this reason, it becomes possible to select an appropriate tracking method according to the movement of the subject from the time of touching (current) to the first predetermined time.

  Further, as described above, the CPU 21 has a function as a determination unit that determines a subject to be focused, and this determination unit focuses on a subject that has existed in a touched area until a predetermined time ago. Perform (see S15).

  In the present embodiment, the first fixed time is 0.5 seconds and the second fixed time is 0.1 seconds. However, the present invention is not limited to this. The certain time of 1 may be about a delay time from when the user wants to touch until the user actually touches, and the second certain time may be shorter than the first certain time. You may make it change the 1st and 2nd fixed time according to a user's characteristic. Further, in the tracking method described with reference to FIG. 6 (S17 in FIG. 5), tracking is performed using image data output for each frame. You may change suitably also for every. In addition, when stopped before the second predetermined time, the tracking beyond the adjacent area by the integration of the local vectors as described with reference to FIG. 6 is performed without being limited to the tracking in the adjacent area. But of course it does n’t matter.

  As a first modification of the present embodiment, in step S13, tracking may be performed on a subject that has been stationary for a certain period of time from the present to the first certain period of time. . In this case, the tracking unit 15 tracks the subject existing in the touch area and makes a determination based on the tracking result.

(Third embodiment)
Next, a third embodiment of the present invention will be described with reference to FIGS. In the first and second embodiments, control is performed so as to track the subject existing in the touch area before the first predetermined time corresponding to the delay time required for the user's touch and to focus on this. On the other hand, in the third embodiment, control is performed so as to track the subject that has been in the touched area for the longest time and focus on the subject.

  Since the configuration in the present embodiment is the same as the block diagram shown in FIG. 1 according to the first embodiment, detailed description thereof is omitted. First, the operation of the present embodiment will be described with reference to FIGS. 9 and 10.

  In the example illustrated in FIG. 9, time T <b> 0 indicates the timing at which the user touches the touch panel unit 17. The time T25 is a timing before the time T0 by a time corresponding to the first fixed time. At this time T25, the frame image F1 is output, and thereafter, the frame image F2 (time T24), the frame image F3 (time T23), and the frame image F4 (time T22) are sequentially output in this order.

  In the present embodiment, local vectors are calculated for the frame images F1, F2, F3, F4,... With reference to the touched area in the frame image F1 at time T25. That is, it is determined to which of the frame images F2, F3, and F4 the subject that has existed in the touch area at time T25 has moved. Similarly, local vectors are calculated for the frame images F2, F3, F4,... With reference to the touched area in the frame image F2 at time T24. That is, it is determined to which of the frame images F2, F3, and F4 the subject that was present in the touch area at time T24 has moved. Subsequently, for the frame images F3, F4,..., The movement of the subject existing in the touch area is similarly obtained.

  An example of the movement of the subject existing in the touch area will be described with reference to FIG. It is assumed that the area (B, C) is touched at time T0. The first search is tracking with reference to the frame image F1, and tracks the movement of the subject in the touched area (B, C) at time T25. At time T25, subject A exists in area (B, C), at time T24, subject A exists in area (B, C), at time T23, subject A exists in area (C, A), and at time T22. Then, the subject A exists in the area (C, A), and the subject A exists in the area (D, A) at the time T21. Accordingly, in the first search result, the touch area stay time of the subject A is a time corresponding to two frames.

  The second search is tracking based on the frame image F2, and tracks the movement of the subject in the area (B, C) at time T24. At time T24, subject A exists in area (B, C), at time T23, subject A exists in area (C, A), at time T22, subject A exists in area (C, A), and time T21. Then, the subject A exists in the area (D, A). Therefore, in the second search result, the touch area stay time of the subject A is equivalent to one frame.

  The third search is tracking with reference to the frame image F3, and tracks the movement of the subject in the area (B, C) at time T23. At time T23, subject B exists in area (B, C), at time T22, subject B exists in area (C, C), and at time T21, subject B exists in area (C, A). In the drawing, the position of the subject A is also shown. FIG. 9 shows a specific example of the frame images F1 to F3, but the tracking of the subject existing in the touch area is performed in the same manner until immediately before time T0. Therefore, in the third search result, the touch area stay time of the subject B is equivalent to one frame.

  Returning to FIG. 9, when the stay time of the subject existing in the touch area is obtained for all the frame images up to the touched time T0, the AF area to be focused on is next identified based on the vector calculation in each frame. Do. That is, the area where the subject that has stayed the longest among the subjects existing in the touch area at the time T0 is specified based on the frame images F1, F2, F3, F4. In the example shown in FIG. 10, there are only three of F1, F2, and F3. However, in this case, the subject A stays in the touch area longer than the subject B, so the subject at time T0. The area where A exists is specified as the AF area.

  When the AF area is specified, focusing is performed on the AF area. That is, the lens 1 is focused based on the contrast signal of the image data of the specified AF area.

  Next, the operation in the present embodiment will be described with reference to the flowcharts shown in FIGS. In the flowchart shown in FIG. 7, steps S1 to S15 are the same as the flowchart shown in FIG. 5 according to the second embodiment, and thus detailed description is omitted, and only different step S19 is described.

  As a result of the determination in step S7, if it has moved before the first fixed time before touching, and if the result of determination in step S13 has moved before the second fixed time before touching, A subject that has been in a long time is searched (S19). Here, as described with reference to FIGS. 9 and 10, the subject that has stayed in the touch area for the longest time is searched. The detailed operation of searching for a subject will be described with reference to FIG.

  Next, the search flow in step S19 will be described with reference to FIG. In the search flow shown in FIG. 8, first, n is set to the number of frames for a fixed time (S31). In the present embodiment, since the first fixed time is 0.5 seconds and the number of frames is 60 per second, n = 30. As described above, the first fixed time and the number of frames are examples, and may be determined according to the design value of the camera.

  Subsequently, a motion trajectory based on the touched area from the moment of touching to n frames before is calculated (S33). Here, as described with reference to FIG. 9, the frame image F1, F2,... And the subject in the touched area are sequentially tracked according to n.

  Next, the result calculated in step 33 is stored in the storage area (memory 25) (S35). When the result is stored, n = n-1 is calculated (S37), and it is determined whether the subtracted n has become 0 (S39). If the result of this determination is not 0, the flow returns to step S33 to calculate a motion trajectory with the touched area as the base point for the next frame image, and the result is stored in the storage area.

  If n = 0 as a result of the determination in step S39, then the area that is present on the most touched area among the searched subjects is determined as the AF area (S41). When the AF area is determined, the search flow is terminated and the original flow is restored.

  As described above, in the third embodiment of the present invention, each of the image frames from the first predetermined time to the present is used as a base point, and the subject existing in the touch area at the time of touch (current) is tracked to the present, The area where the longest subject in the touch area at the time of touching is at the time of touching (currently) is selected as the AF area. For example, in the case of a Susuki ear that swings in the wind and swings as a subject, the Susuki ear and background may enter the touch area. In such a case, in general, the ears of the Japanese pampas grass are often in the touch area for a longer time, so that it is possible to focus on the subject intended by the user.

  Further, as described above, the CPU 21 has a function as a determination unit that determines a subject to be focused, and this determination unit focuses on the subject that has been longest in a certain period of time in the touched area. Matching is performed (see S19).

  In this embodiment, the subject is tracked using all the frame images included in the first fixed time as a base point. However, the subject is tracked every other frame image or every other two frame images. Of course, you can do it.

(Fourth embodiment)
Next, a fourth embodiment of the present invention will be described with reference to FIG. In the first to third embodiments, the touch is one point, but in the fourth embodiment, a moving object is searched for in a rectangular range formed by two points touched by the user, and the movement of the moving object and the touch of the touch are detected. An AF area is set in consideration of the delay time. In the first to third embodiments, the AF area is set, focused, and released once to release, but in the fourth embodiment, after the first shooting, When the slide operation is performed, focusing is performed at the end point of the slide, and the second shooting is performed.

  Since the configuration in the present embodiment is the same as the block diagram shown in FIG. 1 according to the first embodiment, detailed description thereof is omitted. The operation of this embodiment will be described with reference to FIG. When imaging starts, it is first determined whether or not a single point is touched (S1A). Here, whether or not the user has touched one point on the display screen of the display unit 7 is determined based on touch detection from the touch panel unit 17.

  If the result of determination in step S1A is not a one-point touch, it is next determined whether or not it is a two-point touch (S2). When the subject is moving around, it may be difficult to specify the subject with a single point touch. In such a case, the subject can be easily specified by touching two diagonal points of the rectangle including the subject that moves around. Therefore, in the present embodiment, the subject can be designated by two-point touch. In this step, whether or not the user has touched two points on the display screen of the display unit 7 is determined based on touch detection from the touch panel unit 17.

  If the result of determination in step S <b> 2 is not a two-point touch, the monitor result of each local area area is recorded as in step S <b> 3 of FIG. 2 according to the first embodiment (S <b> 3). Here, as described above, for each area 3Aa, it is determined whether the subject in the area is moving or stationary, and the determination result is stored in the memory 25. When the monitor result is recorded, next imaging is performed (S4). Here, one frame of image data of the subject image is acquired by the imaging unit 3, and the acquired image data is temporarily stored in the memory 25. This temporary storage is retained for at least the first predetermined time.

  If the result of determination in step S2 is a two-point touch, a moving object is searched for in a rectangle obtained by the two-point touch (S5). Here, the moving subject is searched for in the area included in the rectangle obtained by the two-point touch using the monitor result in step S3.

  Since the processes in steps S7, S9, and S11 are the same as those in the flowchart of FIG. 2 according to the first embodiment, a detailed description thereof will be omitted, but the case where the process proceeds from step S5 to step S9 will be supplemented.

  If a moving subject is found in the rectangle determined by the two-point touch in step S5 between the first predetermined time and the present time, it is determined in step S9 whether or not it has stopped for the first predetermined time before the touch. If the result of this determination is Yes, in step S11, the moving object subject is tracked, and the area where the moving object is present is set as the AF area. On the other hand, if a moving subject is not found in the rectangle determined by the two-point touch in step S5, the determination result in step S9 is Yes, and the area in the rectangle is set as the AF area.

  If the result of determination in step S7 is No, the result of determination in step S9 is Yes, or if tracking is performed in step S11, then focusing is performed while tracking is performed (S23). Here, the tracking operation is continued for the moving subject, and the release operation is executed with the subject focused and the exposure set appropriately. When the release operation is executed, image data is acquired from the imaging unit 3.

  Once the release operation has been performed, it is next determined whether or not a slide operation has been performed (S25). When the touch panel unit 17 is touched, the AF area is set in consideration of the delay time until the user touches, but the user sets the manual AF area in addition to the automatically set AF area. You may want to In this case, the touched finger may be slid as it is to the area that the user wants to set. In step S25, based on the detection output from the touch panel unit 17, it is determined whether a slide operation has been performed.

  If the result of determination in step S25 is that a slide operation has been performed, the release operation is then performed with the focus at the slide end point (S27). Here, the end point of the slide operation is determined based on the detection output from the touch panel unit 17, and the area including the end point is determined. Then, a focusing operation and an exposure control operation are performed based on the image data from the determined area, and a release operation is performed to acquire image data of the subject image.

  If the result of determination in step S25 is that there has been no slide operation, or focus is achieved at the slide end point in step S27 and release is performed, the imaging flow ends.

  As described above, in the fourth embodiment of the present invention, a moving subject is searched for in a rectangle with two touched points as diagonals, and the motion of the searched moving subject and the delay time until the touch are considered. The area where the subject intended by the user is present is selected. By touching two points, even a moving subject can be easily specified.

  In the present embodiment, when the user performs a slide operation after touching, the subject at the end point of the slide operation is focused and the second shooting is performed. For this reason, in addition to shooting in the automatically determined AF area, shooting in the AF area determined by the user's manual operation can be performed.

  In this embodiment, the processes in steps S7 to S11 are the same as those in the first embodiment, but are replaced with steps S7 to S17 in the second embodiment or steps S7 to S19 in the third embodiment. Of course it doesn't matter.

  As described above, in each embodiment or modification of the present invention, the photographing lens is focused according to the touch operation on the touch panel unit 17 and the movement of the subject image detected based on the image data from the imaging unit 3. The target subject is determined. Further, based on the movement of the subject from a predetermined time before the touch operation on the touch panel unit 17, the AF area to be focused on by the photographing lens is determined. For this reason, even if the subject is moving when touched, it is possible to focus on the subject intended by the user.

  In each embodiment or modification of the present invention, the determination of whether or not the subject is stationary or moving and the tracking of the subject are processed by the tracking unit 15 by hardware. However, the present invention is not limited to this. The image processing unit 5 or the like may be performed by other hardware, or the CPU 21 may of course be performed by software.

  Further, in each embodiment and modification of the present invention, whether the subject is stationary or moving is obtained by comparing the current image data with the past image data. Of course, the detection may be performed by other methods.

  Further, in each embodiment or modification of the present invention, when the subject in the touched area is moved when the touch operation is performed, the area to be focused is determined by the movement of the subject for a certain time before the touch. Had changed. However, the present invention is not limited to this, and when one point is touched for a long time, AF may be performed on the touched area as it is, and photographing may be performed. In order to perform such an operation, for example, in the flow of FIG. 2, when it is determined that the touch operation is performed in Step S <b> 1, it is determined whether the touch operation is continued for a predetermined time before the determination of Step S <b> 7. If the touch operation is continued for a predetermined time, the process proceeds to step S21, AF is performed, and photographing is performed.

  In each embodiment and modification of the present invention, a digital camera has been described as an apparatus for photographing. However, a digital single-lens reflex camera or a compact digital camera may be used as a camera, and a video camera or movie camera may be used. It may be a camera for moving images such as a mobile phone, a smart phone, a personal digital assistant (PDA), a game device, or the like.

  In addition, regarding the operation flow in the claims, the specification, and the drawings, even if it is described using words expressing the order such as “first”, “next”, etc. It does not mean that it is essential to implement in this order.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Lens, 3 ... Imaging part, 3A ... Imaging element, 3Aa ... Area, 3Ab ... Aggregate, 5 ... Image processing part, 7 ... Display part, 9 * ..Recording unit, 11 ... Bus, 13 ... Lens control unit, 15 ... Tracking unit, 17 ... Touch panel unit, 21 ... CPU, 23 ... Timer, 25 ... Memory

Claims (4)

An imaging unit that photoelectrically converts a subject image and outputs image data;
A display unit that displays the subject image based on the image data output from the imaging unit;
A touch panel for detecting which of the areas divided into a plurality of touches on the display screen of the display unit;
A motion detection unit that divides the imaging surface of the imaging unit into a plurality of areas so as to correspond to the area, and detects the movement of the subject for each area based on the image data;
A memory that stores a history of movement of the subject detected by the motion detection unit for each area;
AF area subject to subject movement from a certain time before touch operation on the touch panel is determined based on the movement history of the subject stored in the memory, and the focus of the photographing lens is determined based on the determination result A determination unit for determining
An automatic focus adjustment unit for focusing on the area determined by the determination unit;
I have a,
The determination unit determines the AF area by comparing adjacent areas when the subject is stationary between a first fixed time and a second fixed time based on the movement history of the subject, An imaging device, wherein a vector is used to determine the AF area when a subject has moved between the first fixed time and the second fixed time . An imaging unit that photoelectrically converts a subject image and outputs image data;
A display unit that displays the subject image based on the image data output from the imaging unit;
A touch panel for detecting which of the areas divided into a plurality of touches on the display screen of the display unit;
A motion detection unit that divides the imaging surface of the imaging unit into a plurality of areas so as to correspond to the area, and detects the movement of the subject for each area based on the image data;
A memory that stores a history of movement of the subject detected by the motion detection unit for each area;
The movement of the subject from a predetermined time before the touch operation on the touch panel is determined based on the history of the movement of the subject stored in the memory, and the subject of focusing of the photographing lens is determined based on the determination result A determination unit for determining an AF area,
An automatic focus adjustment unit for focusing on the area determined by the determination unit;
Have
The determination unit determines an AF area by comparing adjacent areas when the subject is stationary before the predetermined time based on the movement history of the subject, and determines the predetermined area. An imaging apparatus, wherein the AF area is determined using a vector when a subject has moved from before a predetermined time . In a control method in an imaging device having an imaging unit that converts a subject image into image data and a display unit that can detect a touch operation,
A storage step of detecting movement of the subject based on the image data from the imaging unit and storing a history of movement of the subject;
A detection step for detecting whether or not the touch operation is performed;
In the detection step, when it is detected that the touch operation has been performed , the subject between the first fixed time and the second fixed time is determined based on the movement history of the subject stored in the storage step. If the object is stationary, the AF area is determined by comparing adjacent areas. If the subject is moving from the first predetermined time to the second predetermined time, the AF is performed using a vector. A decision step to determine the area;
A shooting step for focusing and releasing the AF area determined in the determination step;
A method for controlling an imaging device, comprising: In a control method in an imaging device having an imaging unit that converts a subject image into image data and a display unit that can detect a touch operation,
A storage step of detecting movement of the subject based on the image data from the imaging unit and storing a history of movement of the subject;
A detection step for detecting whether or not the touch operation is performed;
In the detection step, when it is detected that the touch operation has been performed, the subject has been stationary until a predetermined time based on the movement history of the subject stored in the storage step. A determination step of determining an AF area by comparing adjacent areas, and determining the AF area using a vector if the subject has moved from before the predetermined time,
A shooting step for focusing and releasing the AF area determined in the determination step;
A method for controlling an imaging device, comprising: