JP2014200034A - Image capturing device, image capturing method, image capturing program, and mobile communication terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make photographing easy.SOLUTION: An identifying unit 121 identifies a region where a color in an image indicated by image data obtained by an imaging element 110 is included in a prescribed range and that borders with an end of the image. A calculation unit 122 calculates frequency distribution of pixels included in the region identified by the identifying unit 121 in a first direction of the image, and in a second direction intersecting with the first direction. A determination unit 123 determines a capturing range based on the frequency distribution calculated by the calculation unit 122. A capturing unit 124 stores image data indicating an image in the capturing range determined by the determination unit 123 in the image indicated by the image data obtained by the imaging element 110 in a storage unit 130 at prescribed capture timing.

Description

  The present invention relates to an image capturing device, an image capturing method, an image capturing program, and a mobile communication terminal.

  In recent years, with the advancement of image sensors, image sensors with a large number of pixels have been mounted on portable communication terminals and the like. A mobile communication terminal or the like may not have an optical zoom function from the viewpoint of portability. In a mobile communication terminal or the like that is not equipped with an optical zoom function, for example, a technique (digital zoom) is known in which the focal length of a lens is fixed on the wide-angle side and a composition is cut out on image data by utilizing a high number of pixels.

  In addition, a technique is known in which an image is binarized using an in-vehicle camera, and a vehicle is recognized from horizontal and vertical histograms (see, for example, Patent Document 1 below). In addition, a technique for determining whether or not the conveyance mechanism of the printer is installed tilted from the histogram shape in the X direction and Y direction of the printed material is known (for example, see Patent Document 2 below). In addition, a technique for performing framing based on a photographer's ring is known (see, for example, Patent Document 3 below).

JP-A-2005-090974 JP 2011-148149 A JP 2000-101898 A

  However, the above-described conventional technique has a problem that photographing is not easy, for example, a specific ring is required for framing.

  In one aspect, an object of the present invention is to provide an image capturing device, an image capturing method, an image capturing program, and a mobile communication terminal capable of facilitating photographing.

  In order to solve the above-described problems and achieve the object, according to one aspect of the present invention, a region of a predetermined color in an image indicated by image data obtained by an image sensor and at an end of the image is displayed. A contact area is specified, a frequency distribution in a first direction in the image of a pixel included in the specified area and a second direction intersecting the first direction is calculated, and a capture range based on the calculated frequency distribution is calculated. An image capturing device for storing image data indicating an image in the determined capture range among images represented by the image data obtained by the image sensor at a predetermined capture timing, and storing the image data in a storage device. An image capture method, an image capture program, and a mobile communication terminal are proposed.

  According to one aspect of the present invention, it is possible to facilitate shooting.

FIG. 1-1 is a diagram illustrating an example of a configuration of an image capturing device and a photographing device according to an embodiment. 1-2 is a diagram illustrating an example of a signal flow in the image capturing device and the imaging device illustrated in FIG. 1-1. FIG. 2 is a diagram illustrating an example of a hardware configuration of the photographing apparatus. FIG. 3A is a flowchart (part 1) illustrating an example of a still image capturing process. FIG. 3B is a flowchart (part 2) illustrating an example of a still image capturing process. FIG. 4 is a flowchart illustrating an example of finger area specifying processing. FIG. 5 is a flowchart illustrating an example of a framing operation detection process. FIG. 6A is a flowchart illustrating an example of the determination process (for the left hand) of the capture frame [n]. FIG. 6B is a flowchart illustrating an example of the determination process (for the right hand) of the capture frame [n]. FIG. 7 is a flowchart illustrating an example of the detection process of the capture operation. FIG. 8A is a diagram (part 1) illustrating an example of specifying a finger region. FIG. 8B is a diagram (part 2) illustrating an example of specifying a finger region. FIG. 8C is a diagram (part 3) illustrating an example of specifying the finger area; FIG. 8D is a diagram (part 4) illustrating an example of specifying a finger region; FIG. 9 is a diagram illustrating an example of determination of a capture frame. FIG. 10 is a diagram illustrating another example of determination of a capture frame. FIG. 11 is a diagram illustrating an example of detection of the capture operation (for the left hand). FIG. 12 is a diagram illustrating an example of detection of the capture operation (for the right hand). FIG. 13 is a diagram illustrating another example of determination of a capture frame. FIG. 14 is a diagram illustrating a specific example of the capturing operation performed by the photographer. FIG. 15 is a flowchart illustrating an example of detection processing of a capture operation with a thumb. FIG. 16 is a diagram illustrating an example of detection of a capture operation with a thumb. FIG. 17 is a flowchart illustrating an example of a moving image capturing process.

  Exemplary embodiments of an image capturing device, an image capturing method, an image capturing program, and a mobile communication terminal according to the present invention will be described below in detail with reference to the drawings.

(Embodiment)
(Configuration of image capturing device and photographing device according to embodiment)
FIG. 1-1 is a diagram illustrating an example of a configuration of an image capturing device and a photographing device according to an embodiment. 1-2 is a diagram illustrating an example of a signal flow in the image capturing device and the imaging device illustrated in FIG. 1-1. As illustrated in FIGS. 1-1 and 1-2, the imaging apparatus 100 according to the embodiment includes an imaging element 110, an image capturing device 120, and a storage device 130.

  The image sensor 110 is an electronic component that converts light into an electrical signal, and is a solid-state image sensor in which a plurality of unit pixels that receive incident light are arranged two-dimensionally. The image sensor 110 outputs image data corresponding to the incident light to the image capturing device 120. The storage device 130 stores image data indicating an image captured by the image capturing device 120 among images represented by image data obtained by the image sensor 110.

  The image capturing device 120 includes a specifying unit 121, a calculating unit 122, a determining unit 123, and a capturing unit 124. The image data output from the image sensor 110 is input to the specifying unit 121 and the capturing unit 124.

  The specifying unit 121 specifies a predetermined region in the image indicated by the image data output from the image sensor 110. The specifying unit 121 notifies the calculating unit 122 of the specified area. The predetermined area specified by the specifying unit 121 is an area of a predetermined color and is an area in contact with the edge of the image. The predetermined color is, for example, a range corresponding to the color of a human finger (for example, skin color), and can be defined by, for example, a range of brightness of red, green, and blue, or a range of hue, saturation, brightness, and the like. . Thereby, the area | region where the finger | toe was reflected among the images can be specified. In addition, by specifying the area in contact with the edge of the image, it is possible to specify the area in which the photographer's finger is captured in the image indicated by the image data.

  The calculating unit 122 calculates the frequency distribution in the first direction and the second direction of the image of the pixels included in the region notified from the specifying unit 121. The first direction and the second direction are directions that intersect (for example, orthogonal to) each other. For example, the first direction is the vertical direction of the image, and the second direction is the horizontal direction of the image. The calculation unit 122 notifies the determination unit 123 of each calculated frequency distribution.

  The determination unit 123 determines the capture range of the image indicated by the image data output from the image sensor 110 into the storage device 130 based on each frequency distribution notified from the calculation unit 122. The determining unit 123 notifies the capturing unit 124 of the determined capture range.

  The capture unit 124 generates image data indicating an image in the capture range notified from the determination unit 123 among the images represented by the image data output from the image sensor 110 at a predetermined capture timing. Then, the capturing unit 124 stores the generated image data in the storage device 130. As a result, it is possible to capture an image in the capture range determined based on the region where the photographer's finger is captured in the image indicated by the image data output from the image sensor 110.

  Thereby, the photographer can perform framing by the shape and position of the finger placed in front of the image sensor 110 (position taken by the image sensor 110). For this reason, photographing can be facilitated.

  For example, in an imaging device mounted on a smartphone or the like, it may be possible to determine the composition by a touch operation on the touch panel of the main body. However, in this case, composition determination may be difficult due to a shake of the main body due to a touch operation. On the other hand, by using the image capturing device 120, it is possible to perform framing without directly touching the photographing device or the like, so that composition determination can be facilitated.

<Example of determination of capture range based on frequency distribution>
The determination unit 123 detects a position based on the peak position of the frequency distribution in the first direction and the maximum value in the second direction in the frequency distribution in the second direction, and a position on the positive side of the maximum value in the second direction. Then, a first determination process for determining the capture range based on the detection result may be performed. Thereby, for example, when the right side is the forward direction, the capturing range of the L-shaped convex left lower made by the left hand that the photographer put out in front of the photographing apparatus 100 can be determined. For this reason, the capture range can be determined by a more intuitive operation.

  Further, the determination unit 123 detects a position based on the peak position of the frequency distribution in the first direction and the minimum value in the second direction in the frequency distribution in the second direction, and a position on the negative side of the minimum value in the second direction. And you may perform the 2nd determination process which determines the taking-in range based on a detection result. As a result, for example, when the right side is the forward direction, it is possible to determine the L-shaped capturing range that is formed by the right hand that the photographer put out in front of the photographing apparatus 100 and has a convex shape on the lower right. For this reason, the capture range can be determined by a more intuitive operation.

  Further, the determination unit 123 determines the position in the second direction of the specified region in the image indicated by the image data (right or left), and switches between the first determination process and the second determination process based on the determination result. Good. Thus, the photographer can specify the capture range with any of the right hand and the left hand, and can further improve convenience.

<Acquisition operation by finger movement>
Further, when the image capturing device 120 captures a still image, the capturing timing of the image by the capturing unit 124 may be a timing when a predetermined change in the frequency distribution notified from the calculating unit 122 is detected. Thereby, the photographer can perform the capturing operation by the movement of the finger taken out in front of the photographing apparatus 100. For this reason, photographing can be facilitated.

  For example, the image capturing timing by the capturing unit 124 may be a timing at which the number of predetermined peak positions in the frequency distribution in the first direction changes. Alternatively, the image capture timing by the capture unit 124 may be a predetermined difference between a predetermined peak position of the frequency distribution in the first direction and a minimum value or maximum value in the first direction of the frequency distribution in the first direction. It may be the timing when the change is detected. Thereby, an image can be captured by an operation such as bending a finger taken out in front of the photographing apparatus 100 by the photographer. For this reason, capture can be instructed by a more intuitive operation.

  For example, the capture operation may be performed by pressing the shutter button or touching the touch panel provided on the digital camera. In this case, the captured image may be blurred (blurred) by pressing or touching the shutter button. ) May increase. On the other hand, by using the image capture device 120, it is possible to perform the capture operation without pressing the shutter button or performing a touch operation, so that it is possible to suppress blurring of the captured image. . Further, the framing and capture operations can be smoothly performed by the movement of the photographer's finger.

<Other import operations>
However, the capture timing of the image by the capture unit 124 is not limited to the above timing, and for example, a certain time has elapsed since the capture of the specific utterance by the photographer or the capture operation was instructed. Timing can also be used. Thereby, it is possible to suppress blurring of the captured image while facilitating composition determination.

  The image capture timing by the capture unit 124 may be when a shutter button is pressed or a touch operation on a touch panel provided in the digital camera is performed. Also in this case, composition determination can be facilitated.

<Capture video>
When the image capturing device 120 captures a moving image, the capturing timing of the image by the capturing unit 124 may be a periodic capturing timing corresponding to the frame rate of the moving image. As a result, the photographer can take a moving image while performing framing according to the shape of the finger placed in front of the image sensor 110. For this reason, photographing can be facilitated.

  For example, in an imaging device mounted on a smartphone or the like, it may be possible to determine the composition by a touch operation or the like on a touch panel provided in the imaging device. However, in this case, if framing is performed by a touch operation or the like during shooting of a moving image, the moving image to be captured (blurring) may increase. On the other hand, by using the image capture device 120, it is possible to perform moving image shooting while performing framing without performing a touch operation or the like on the shooting device, so that motion image blurring can be suppressed. it can.

(Hardware configuration of the imaging device)
FIG. 2 is a diagram illustrating an example of a hardware configuration of the photographing apparatus. The imaging apparatus 100 shown in FIGS. 1-1 and 1-2 can be applied to, for example, the mobile communication terminal 200 shown in FIG. The mobile communication terminal 200 includes a communication device 201, an information processing device 202, an objective lens 203, an image sensor 204, an image buffer memory 205, a display device 206, a storage device 207, and an input interface 208. ing.

  The communication device 201 is a communication interface that performs communication with the outside of the mobile communication terminal 200 by radio, for example. The communication device 201 is controlled by the information processing device 202. For communication by the communication device 201, various communication methods such as cellular communication defined in 3GPP (3rd Generation Partnership Project) and communication of WLAN (Wireless Local Area Network) can be applied. .

  The information processing apparatus 202 governs overall control of the mobile communication terminal 200. In addition, the information processing apparatus 202 controls the objective lens 203. Examples of control of the objective lens 203 include aperture control and focus control. In addition, the information processing apparatus 202 performs a capture process based on the image data obtained by the image sensor 204. The information processing apparatus 202 can be realized by an electric circuit such as a CPU (Central Processing Unit) and an FPGA (Field Programmable Gate Array).

  The objective lens 203 forms an image outside the mobile communication terminal 200 on the image sensor 204. The objective lens 203 may be a single focus lens without a zoom function, for example.

  The image sensor 204 converts a video image formed by the objective lens 203 into image data. For example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like can be used for the imaging element 204.

  The image buffer memory 205 is used as a work area for image processing by the information processing apparatus 202. For example, the image buffer memory 205 stores image data obtained by the image sensor 204 and the like. As the image buffer memory 205, for example, a RAM (Random Access Memory) can be used.

  The display device 206 displays an image or the like for the user of the mobile communication terminal 200 under the control of the information processing device 202.

  The storage device 207 stores image data and the like under the control of the information processing device 202. As the storage device 207, for example, a non-volatile memory such as a magnetic disk or a flash memory can be used. The storage device 207 may be an external memory that can be attached to and detached from the mobile communication terminal 200, such as a memory card. The storage device 207 may store various programs for operating the mobile communication terminal 200. The program stored in the storage device 207 is loaded into a memory such as the image buffer memory 205 and executed by the information processing device 202.

  The input interface 208 is an input device that receives an operation input from a user. For example, the input interface 208 can be realized by a key (for example, a keyboard) or a remote controller. Further, the display device 206 and the input interface 208 may be realized by a touch panel or the like.

  The image sensor 110 illustrated in FIGS. 1-1 and 1-2 can be realized by the image sensor 204, for example. The image capturing device 120 illustrated in FIGS. 1-1 and 1-2 can be realized by the information processing device 202, for example. The storage device 130 illustrated in FIGS. 1-1 and 1-2 can be realized by the storage device 207, for example.

(Processing by information processing device)
FIGS. 3A and 3B are flowcharts illustrating an example of a still image capturing process. The information processing apparatus 202 illustrated in FIG. 2 executes, for example, each step illustrated in FIGS. 3-1 and 3-2 when capturing a still image.

<Detection of framing operation>
First, the information processing apparatus 202 acquires image data from the image sensor 204 as illustrated in FIG. 3A (step S301). Next, the information processing apparatus 202 displays the image indicated by the image data acquired in step S301 on the display device 206 (step S302). Next, the information processing apparatus 202 performs a finger region specifying process in which the photographer's finger is included, which is included in the image indicated by the image data acquired in step S301 (step S303). The finger region specifying process will be described later (see, for example, FIG. 4).

  Next, the information processing apparatus 202 performs a framing operation detection process by the photographer based on the finger area specified by the specifying process in step S303 (step S304). The framing operation by the photographer is an operation based on the position, shape, etc. of the photographer's finger placed in front of the objective lens 203 of the mobile communication terminal 200. The detection process of the framing operation will be described later (see, for example, FIG. 5).

  Next, the information processing apparatus 202 determines whether or not there has been a framing operation by the photographer based on the detection result in step S304 (step S305). When there is no framing operation (step S305: No), the information processing apparatus 202 returns to step S301. Accordingly, it is possible to wait for a framing operation by the photographer while performing a live view in which a captureable image is displayed in real time.

<Determination of capture frame>
If there is a framing operation in step S305 (step S305: Yes), it can be determined that the photographer has started the framing operation. In this case, the information processing apparatus 202 starts the first timer (step S306). The first timer is realized by, for example, software executed by the information processing apparatus 202, and is a timer that measures an elapsed time since the start of the first timer.

  Further, the information processing apparatus 202 stores “1” in the counter n (step S307). The counter n is information stored in the image buffer memory 205 or the like, for example. The order of step S306 and step S307 may be reversed.

  Next, the information processing apparatus 202 proceeds to step S308. Steps S308 to S310 are the same as steps S301 to S303. Subsequent to step S310, the information processing apparatus 202 performs a process of determining the captured frame [n] based on the finger area specified by the specifying process in step S310 (step S311). The capture frame [n] is a range to be captured in the storage device 207 in the image indicated by the image data obtained by the image sensor 204. The determination process of the fetch frame [n] will be described later (see, for example, FIGS. 6-1 and 6-2).

  Next, the information processing apparatus 202 causes the display device 206 to display the captured frame [n] determined in step S311 on the image indicated by the image data acquired in step S308 (step S312). Thus, the photographer can recognize the captured frame [n] determined by his / her current framing operation.

  Next, the information processing apparatus 202 determines whether or not the capture frame [n] determined in the current step S311 is the same as the capture frame [n−1] determined in the previous step S311 ( Step S313). When the captured frame [n] is not the same as the captured frame [n−1] (step S313: No), it can be determined that the photographer has changed the framing operation. In this case, the information processing apparatus 202 restarts the first timer (step S314), and proceeds to step S316.

  In step S313, when the captured frame [n] is the same as the captured frame [n-1] (step S313: Yes), it can be determined that the photographer has not changed the framing operation. In this case, the information processing apparatus 202 increments (+1) the counter n (step S315).

  Next, the information processing apparatus 202 determines whether the time measured by the first timer has exceeded the first threshold (step S316). If the measured time does not exceed the first threshold (step S316: No), it can be determined that a certain time has not elapsed since the photographer fixed the framing operation. In this case, the information processing apparatus 202 returns to step S308. Thereby, it is possible to wait until a certain time elapses after the photographer fixes the framing operation.

<Capture at import timing>
In step S316, when the measured time exceeds the first threshold (step S316: Yes), it can be determined that a certain time has elapsed since the photographer fixed the framing operation. In this case, the information processing apparatus 202 proceeds to step S317 illustrated in FIG. 3-2 (reference A).

  That is, the information processing apparatus 202 notifies the photographer that the capture frame is determined to be the current capture frame [n] (step S317). The notification in step S317 may be performed by voice using a speaker or the like provided in the mobile communication terminal 200, or may be performed by highlighting the portion of the captured frame [n] displayed in step S312. .

  Next, the information processing apparatus 202 starts the second timer (step S318). The second timer is realized by, for example, software executed by the information processing apparatus 202, and is a timer that measures an elapsed time since the start of the second timer. Next, the information processing apparatus 202 performs a capturing operation detection process by the photographer (step S319). The detection process of the capturing operation will be described later (see, for example, FIG. 7).

  Next, the information processing apparatus 202 determines whether or not there has been a capture operation based on the detection result in step S319 (step S320). When there is no capture operation (step S320: No), the information processing apparatus 202 determines whether the time measured by the second timer has exceeded the second threshold (step S321). If the measured time does not exceed the second threshold (step S321: No), the information processing apparatus 202 returns to step S320.

  In step S321, when the measured time exceeds the second threshold (step S321: Yes), the information processing apparatus 202 determines that there has been no capture operation by the photographer for a predetermined time or more after the capture frame is determined. can do. In this case, the information processing apparatus 202 returns to step S301 illustrated in FIG. 3A (reference numeral B) and starts again from the detection of the framing operation.

  In step S320, if there is a capture operation (step S320: Yes), the information processing apparatus 202 acquires image data from the image sensor 204 (step S322). Next, the information processing apparatus 202 causes the storage device 207 to store image data indicating an image in the current captured frame [n] among the image data acquired in step S322 (step S323). As a result, image data indicating an image in a range designated by the photographer through a framing operation among images indicated by image data obtained by the image sensor 204 can be taken into the storage device 207.

  Further, the information processing apparatus 202 displays an image in the captured frame [n] of the image data acquired in step S322 by the display apparatus 206 (step S324), and ends a series of processes. By step S324, the photographer can confirm the content of the captured image data.

(Finger area identification process)
FIG. 4 is a flowchart illustrating an example of finger area specifying processing. In steps S303 and S310 illustrated in FIG. 3A, the information processing apparatus 202 executes, for example, each step illustrated in FIG. 4 as the finger region specifying process. First, the information processing apparatus 202 determines whether or not the color is included in a predetermined range (for example, skin color) for each pixel of the image indicated by the image data obtained by the image sensor 204 (step S401).

  Next, the information processing apparatus 202 extracts a region in which pixels determined to include a color within the predetermined range in the image indicated by the image data based on the determination result in step S401 (step S402). Next, the information processing apparatus 202 identifies, as a finger region, a region that touches the edge of the image indicated by the image data among the regions extracted in step S402 (step S403), and ends a series of identifying processes.

(Framing operation detection process)
FIG. 5 is a flowchart illustrating an example of a framing operation detection process. In step S304 illustrated in FIG. 3A, the information processing apparatus 202 executes, for example, each step illustrated in FIG. 5 as the framing operation detection process. First, the information processing apparatus 202 calculates the frequency distribution in the Y-axis direction and the X-axis direction of the finger region in the image indicated by the image data (step S501).

  Next, the information processing apparatus 202 detects a peak position in the frequency distribution in the Y-axis direction calculated in step S501 (step S502). Further, the information processing apparatus 202 detects the peak position in the frequency distribution in the X-axis direction calculated in step S501 (step S503). The peak position is, for example, a distribution position where the frequency changes from increasing to decreasing with respect to the distribution direction. For example, the peak position can be detected by calculating the differential value of the frequency with respect to the change in the distribution direction.

  Next, the information processing apparatus 202 determines whether the number of peak positions is 1 in each frequency distribution in the Y-axis direction and the X-axis direction based on the detection results in steps S502 and S503 (step S504). . In the case where the number of peak positions is not 1 in at least one of the frequency distribution in the Y-axis direction and the frequency distribution in the X-axis direction (step S504: No), the information processing apparatus 202 displays the photographer's image taken out before the objective lens 203. It is determined that there has been no framing operation with a finger (step S505), and the series of detection processes is terminated.

  In step S504, when the number of peak positions is 1 in each frequency distribution in the Y-axis direction and the X-axis direction (step S504: Yes), it can be determined that an L-shaped finger region has been detected. In this case, the information processing apparatus 202 determines that there has been a framing operation by the photographer's finger that is put out in front of the objective lens 203 (step S506), and ends a series of detection processing.

(Fetching frame [n] determination process)
FIG. 6A is a flowchart illustrating an example of the determination process (for the left hand) of the capture frame [n]. In step S <b> 311 illustrated in FIG. 3A, the information processing apparatus 202 executes, for example, each step illustrated in FIG. 6A as the determination process of the captured frame [n]. With respect to FIG. 6A, a case where the photographer performs a framing operation by placing the finger of the left hand in front of the objective lens 203 will be described.

  First, the information processing apparatus 202 calculates the frequency distribution in the Y-axis direction and the X-axis direction of the finger region in the image indicated by the image data obtained by the image sensor 204 (step S601). Next, the information processing apparatus 202 detects the maximum value Ym in the Y-axis direction in the frequency distribution in the Y-axis direction calculated in step S601 (step S602). Further, the information processing apparatus 202 detects the maximum value Xm in the X-axis direction in the frequency distribution in the X-axis direction calculated in step S601 (step S603).

  Next, the information processing apparatus 202 detects the peak position Yp1 in the frequency distribution in the Y-axis direction calculated in step S601 (step S604). Next, the information processing apparatus 202 calculates the length YLTmax in the Y-axis direction of the capture frame by Ym−Yp1 (step S605). Ym is the maximum value detected in step S602. Yp1 is the peak position detected in step S604.

  Next, the information processing apparatus 202 calculates diagonal coordinates of the capture frame (step S606). For example, the information processing apparatus 202 calculates (Xm, Yp1) and (Xm + (N * YLTmax), Ym) as diagonal coordinates of the captured frame based on the results of steps S602 to S605. N is the ratio (aspect ratio) of the length in the X-axis direction to the length in the Y-axis direction of the capture frame. Next, the information processing apparatus 202 determines the captured frame [n] as a range based on the diagonal coordinates calculated in step S606 (step S607), and ends a series of determination processes.

  FIG. 6B is a flowchart illustrating an example of the determination process (for the right hand) of the capture frame [n]. In step S311 illustrated in FIG. 3A, the information processing apparatus 202 may execute, for example, the steps illustrated in FIG. 6B as the determination process of the captured frame [n]. FIG. 6B illustrates a case where the photographer performs a framing operation by placing the finger of the right hand in front of the objective lens 203.

  As illustrated in FIG. 6B, when the photographer performs the framing operation with the finger of the right hand, in step S603, the information processing apparatus 202 determines the minimum in the X axis direction in the frequency distribution in the X axis direction calculated in step S601. The value Xmin is detected. In step S606, the information processing apparatus 202 calculates (Xmin, Yp1) and (Xmin− (N * YLTmax), Ym) as diagonal coordinates of the captured frame.

(Detection processing of import operation)
FIG. 7 is a flowchart illustrating an example of the detection process of the capture operation. In step S319 illustrated in FIG. 3B, the information processing apparatus 202 executes, for example, each step illustrated in FIG. First, the information processing apparatus 202 acquires image data from the image sensor 204 (step S701).

  Next, the information processing apparatus 202 performs a finger region specifying process in which the photographer's finger is included, which is included in the image indicated by the image data acquired in step S701 (step S702). The finger region specifying process in step S702 can be realized by, for example, the specifying process shown in FIG. Next, the information processing apparatus 202 calculates the frequency distribution in the Y-axis direction and the X-axis direction of the finger region in the image indicated by the image data acquired in step S701 (step S703).

  Next, the information processing apparatus 202 detects a peak position in the frequency distribution in the Y-axis direction calculated in step S703 (step S704). Next, the information processing apparatus 202 determines whether or not the number of peak positions in the frequency distribution in the Y-axis direction detected in step S704 is 2 (step S705). If the number of peak positions in the frequency distribution in the Y-axis direction is not 2 (step S705: No), the information processing apparatus 202 determines that there is no capture operation by the photographer (step S706), and a series of detection processes is performed. finish.

  In step S705, when the number of peak positions in the frequency distribution in the Y-axis direction is 2 (step S705: Yes), the information processing apparatus 202 detects the peak position in the frequency distribution in the X-axis direction calculated in step S703. (Step S707). Next, the information processing apparatus 202 determines whether or not the number of peak positions in the frequency distribution in the X-axis direction detected in step S707 is 1 (step S708). If the number of peak positions in the frequency distribution in the X-axis direction is not 1 (step S708: No), the information processing apparatus 202 proceeds to step S706.

  In step S708, when the number of peak positions in the frequency distribution in the X-axis direction is 1 (step S708: Yes), the information processing apparatus 202 proceeds to step S709. That is, the information processing apparatus 202 acquires two peak positions Yp1 and Yp2 (Yp1 <Yp2) in the frequency distribution in the Y-axis direction detected in step S704 (step S709).

  Next, the information processing apparatus 202 determines whether or not the ratio Yp2 / Yp1 of the peak position Yp2 to the peak position Yp1 is smaller than a predetermined ratio based on the peak positions Yp1 and Yp2 acquired in step S709 (step S710). . If the ratio Yp2 / Yp1 is not smaller than the predetermined ratio (step S710: No), the information processing apparatus 202 proceeds to step S706.

  In step S710, when the ratio Yp2 / Yp1 is smaller than the predetermined ratio (step S710: Yes), it can be determined that the photographer has bent one fingertip. In this case, the information processing apparatus 202 determines that there has been a capture operation by the photographer (step S711), and ends a series of detection processes.

(Finger area identification)
Next, a specific example of the finger region in the case where the photographer performs a framing operation with the left hand finger placed in front of the objective lens 203 will be described. Hereinafter, for convenience, the lower left of the screen indicated by the image data is defined as the origin (0, 0), the right side of the X axis is the positive direction, and the upper side of the Y axis is the positive direction.

  8A to 8D are diagrams illustrating an example of specifying the finger region. First, as shown in FIG. 8A, it is assumed that image data indicating an image 800 is obtained by the image sensor 204. The image 800 is displayed by the display device 206 (live view). In the example illustrated in FIG. 8A, the image 800 includes subject areas 801 to 806.

  Further, it is assumed that only the subject areas 801, 803, and 805 in the image 800 are flesh-colored. The subject area 801 is a portion where the photographer's finger is captured. The information processing apparatus 202 determines whether or not the luminance (R, G, B) of each color is included in a predetermined range (R1, G1, B1) to (R2, G2, B2) for each pixel of the image 800. Thus, it is determined whether or not the color is a skin color. For example, the information processing apparatus 202 binarizes each pixel of the image 800 by setting a skin color pixel to “1” and a non-skin color pixel to “0”.

  Then, the information processing apparatus 202 extracts subject regions 801, 803, and 805, which are regions in which skin-colored pixels are continuous, by extracting a region in which “1” pixels are continuous, as illustrated in FIG. can do.

  Next, the information processing apparatus 202 identifies, as a finger region, a region that touches the end of the image 800 among the extracted subject regions 801, 803, and 805. For example, as illustrated in FIG. 8C, the information processing apparatus 202 identifies a subject area 801 that is in contact with the end of the image 800 among the subject areas 801, 803, and 805.

  In addition, the information processing apparatus 202 may directly specify a region in which “1” pixels are continuous and in contact with the edge of the image 800. For example, the information processing apparatus 202 uses the method of starting the origin (0, 0) of the image 800 as a start point and sequentially scanning the pixels of the image 800 to connect the points as follows. The shape (contour) can be extracted.

(1) Search for one untracked pixel on the boundary of the image 800. If there is one pixel, the one pixel is recorded as the start point.

(2) A search is made counterclockwise around the recorded start point pixel to identify one pixel on the boundary, and the identified one pixel is marked (boundary).

(3) If the specified pixel does not match the start point, the process returns to (2). If they match, the process returns to (1) to search for the start point of a new boundary.

  Then, as illustrated in FIG. 8D, the information processing apparatus 202 masks subject areas 803 and 805 other than the identified subject area 801 among the subject areas 801, 803, and 805. Thereby, a subject area 801 can be obtained as a finger area included in the image 800.

(Determination of capture frame)
Next, a specific example of determination of a capture frame (see, for example, FIG. 6-1) when the photographer performs a framing operation with the left finger placed in front of the objective lens 203 will be described.

  FIG. 9 is a diagram illustrating an example of determination of a capture frame. 9, the same parts as those shown in FIG. 8-4 are denoted by the same reference numerals, and the description thereof is omitted. The Y-axis direction histogram 910 is a histogram showing the frequency (Y-axis pixel cumulative number) distribution in the Y-axis direction in the subject area 801 specified as the finger area. The X-axis direction histogram 920 is a histogram showing the frequency (X-axis pixel cumulative number) distribution in the X-axis direction in the subject region 801 specified as the finger region.

  The maximum value Ym is the maximum value in the Y-axis direction in the frequency distribution in the Y-axis direction indicated by the Y-axis direction histogram 910. The peak position Yp1 is a peak position with the maximum frequency in the frequency distribution in the Y-axis direction indicated by the Y-axis direction histogram 910. YLTmax is a difference between the maximum value Ym and the peak position Yp1.

  The maximum value Xm is the maximum value in the X-axis direction in the frequency distribution in the X-axis direction indicated by the X-axis direction histogram 920. The peak position Xp1 is a peak position with the maximum frequency in the frequency distribution in the X-axis direction indicated by the X-axis direction histogram 920.

  The information processing apparatus 202 calculates coordinates 911 and 912 in the image 800 as diagonal coordinates of the captured frame. The coordinates 911 are (Xm, Yp1). The coordinates 912 are (Xm + (N * YLTmax), Ym). N is the ratio (aspect ratio) of the length in the X-axis direction to the length in the Y-axis direction of the capture frame. Then, the information processing apparatus 202 determines the capture frame 913 having the coordinates 911 and 912 as diagonal coordinates as the capture range.

  Next, a specific example of determination of a capture frame (see, for example, FIG. 6-2) when the photographer performs a framing operation by putting the finger of the right hand in front of the objective lens 203 will be described.

  FIG. 10 is a diagram illustrating another example of determination of a capture frame. In FIG. 10, the same parts as those shown in FIG.

  The minimum value Xmin is the minimum value in the X-axis direction in the frequency distribution in the X-axis direction indicated by the X-axis direction histogram 920. When the photographer puts his right hand finger in front of the objective lens 203 and performs a framing operation, the information processing apparatus 202 uses, for example, coordinates 911 and 912 in the image 800 shown in FIG. Calculate as angular coordinates. The coordinates 911 are (Xmin, Yp1). The coordinates 912 are (Xmin− (N * YLTmax), Ym). Then, the information processing apparatus 202 determines the capture frame 913 having the coordinates 911 and 912 as diagonal coordinates as the capture range.

  Further, the information processing apparatus 202 may determine whether the photographer performs the framing operation with the left hand or the right hand. Then, the information processing apparatus 202 determines the left-hand determination process illustrated in FIGS. 6A and 6B and the right-hand determination process illustrated in FIGS. Do one of the following.

  For example, if the minimum value Xmin is smaller than half the length XFramax in the X-axis direction of the image 800, the information processing apparatus 202 determines that the photographer is performing the framing operation with the left hand, and FIGS. The left-hand determination process shown in FIG. On the other hand, if the minimum value Xmin is larger than half of the length XFramax in the X-axis direction of the image 800, the information processing apparatus 202 determines that the photographer is performing the framing operation with the right hand, and FIG. The right-hand determination process shown in FIG. Thereby, even if the photographer performs the framing operation with either the left or right hand, the determination process of the captured frame can be performed.

  However, the determination of whether the photographer performs the framing operation with either the left hand or the right hand is not limited to this, and various determination methods can be used. For example, the determination may be made based on a comparison between the frequency of X = 0 in the X-axis direction histogram 920 and the frequency of X = XFramax in the X-axis direction histogram 920.

(Detection of capture operation)
Next, a specific example of the capture operation detection (for example, see FIG. 7) when the photographer performs the capture operation with his / her left hand in front of the objective lens 203 will be described.

  FIG. 11 is a diagram illustrating an example of detection of the capture operation (for the left hand). In FIG. 11, the same parts as those shown in FIG. As shown in FIG. 11, the photographer bends the index finger at the timing when the photograph is desired to be captured. As a result, two peak positions Yp1 and Yp2 are generated in the Y-axis direction histogram 910.

  When the two peak positions Yp1 and Yp2 are detected in the Y-axis direction histogram 910, the information processing apparatus 202 determines whether or not the ratio Yp2 / Yp1 of the peak position Yp2 to the peak position Yp1 is smaller than a predetermined ratio. Then, the information processing apparatus 202 determines that the capturing operation has been performed by the photographer when the ratio Yp2 / Yp1 is smaller than the predetermined ratio. Thus, the image data can be taken in when the photographer bends the fingertip.

  Further, when the photographer bends the index finger, the maximum value Ym decreases. For this reason, the information processing apparatus 202 may determine that a capture operation has been performed when the amount of decrease in the maximum value Ym within a predetermined period exceeds a predetermined value. Alternatively, the information processing apparatus 202 may determine that the capture operation has been performed when the ratio Ym / Yp1 of the maximum value Ym to the peak position Yp1 is smaller than a predetermined ratio. Thereby, the capture operation can be detected without detecting the peak position Yp2.

  Next, a specific example of the detection of the capture operation when the photographer performs the capture operation with the right hand finger placed in front of the objective lens 203 will be described.

  FIG. 12 is a diagram illustrating an example of detection of the capture operation (for the right hand). In FIG. 12, the same parts as those shown in FIG. As shown in FIG. 12, the photographer bends the index finger of the right hand at the timing when the photograph is desired to be captured. As a result, two peak positions Yp1 and Yp2 are generated in the Y-axis direction histogram 910.

  Also in this case, when two peak positions Yp1 and Yp2 are detected in the Y-axis direction histogram 910, the information processing apparatus 202 determines whether or not the ratio Yp2 / Yp1 of the peak position Yp2 to the peak position Yp1 is smaller than a predetermined ratio. to decide. Then, the information processing apparatus 202 determines that the capturing operation has been performed by the photographer when the ratio Yp2 / Yp1 is smaller than the predetermined ratio. As a result, the photographer can capture the image data by bending the fingertip of the right hand.

  Further, when the photographer bends the index finger, the maximum value Ym decreases. For this reason, the information processing apparatus 202 may determine that a capture operation has been performed when the amount of decrease in the maximum value Ym within a predetermined period exceeds a predetermined value. Alternatively, the information processing apparatus 202 may determine that the capture operation has been performed when the ratio Ym / Yp1 of the maximum value Ym to the peak position Yp1 is smaller than a predetermined ratio. Thereby, the capture operation can be detected without detecting the peak position Yp2.

(Other examples of determination of capture frame)
Next, another specific example of the determination of the capture frame when the photographer performs the framing operation with the left hand finger in front of the objective lens 203 will be described.

  FIG. 13 is a diagram illustrating another example of determination of a capture frame. In FIG. 13, the same parts as those shown in FIG. As illustrated in FIG. 13, the information processing apparatus 202 may calculate the coordinates 911 by (Xp1, Yp1) and the coordinates 912 by (Xp1 + (N * YLTmax), Ym). Thereby, the L-shaped portion designated by the photographer's finger matches the lower left corner of the capture frame 913, and the photographer can perform the framing operation more intuitively.

  The same applies to the case where the photographer performs the framing operation by putting the finger of the left hand in front of the objective lens 203. For example, in FIG. 10, the information processing apparatus 202 may calculate the coordinates 911 by (Xp1, Yp1) and calculate the coordinates 912 by (Xp1 + (N * YLTmax), Ym). Thereby, the L-shaped portion designated by the photographer's finger matches the lower left corner of the capture frame 913, and the photographer can perform the framing operation more intuitively.

  Next, a specific example of the capturing operation by the photographer in this case will be described.

  FIG. 14 is a diagram illustrating a specific example of the capturing operation performed by the photographer. In FIG. 14, the same parts as those shown in FIG. For example, as shown in FIG. 13, in the case where the coordinates 911 are calculated by (Xp1, Yp1) and the coordinates 912 are calculated by (Xp1 + (N * YLTmax), Ym), the photographer is at a timing at which he wants to capture an image. For example, move your left finger to the left and then bend your index finger. Thereby, it is possible to avoid the bent fingertip portion of the subject area 801 being included in the capture frame 913.

(Still another example of determination of capture frame)
For example, in FIG. 13, the information processing apparatus 202 may calculate the coordinates 911 by (Xp1 + Xoffset, Yp1 + Yoffset) and calculate the coordinates 912 by (Xp1 + (N * YLTmax) + Xoffset, Ym + Yoffset).

  As a result, a position shifted by Xoffset in the positive direction of the X axis and by Yoffset in the positive direction of the Y axis with respect to the L shape indicated by the photographer's finger coincides with the lower left corner of the capture frame 913. For this reason, the photographer can perform the framing operation more intuitively, and even after the framing operation, even if the index finger is bent without shifting the left hand, the bent fingertip portion of the subject area 801 is captured in the capture frame 913. Inclusion can be avoided.

  In addition, the capture operation may be an operation of further opening or tilting the index finger with respect to the thumb. Also in this case, it can be avoided that the bent fingertip portion of the subject area 801 is included in the capture frame 913.

(Uptake operation with thumb)
Next, an operation for taking in with the photographer's thumb will be described.

(Detection processing of import operation)
FIG. 15 is a flowchart illustrating an example of detection processing of a capture operation with a thumb. In step S319 illustrated in FIG. 3B, the information processing apparatus 202 may execute, for example, each step illustrated in FIG. 15 as the capture operation detection process. Steps S1501 to S1504 shown in FIG. 15 are the same as steps S701 to S704 shown in FIG.

  Following step S1504, the information processing apparatus 202 determines whether the number of peak positions in the frequency distribution in the Y-axis direction detected in step S1504 is 1 (step S1505). If the number of peak positions in the frequency distribution in the Y-axis direction is not 1 (step S1505: No), the information processing apparatus 202 determines that there is no capture operation by the photographer (step S1506), and a series of detection processes is performed. finish.

  When the number of peak positions in the frequency distribution in the Y-axis direction is 1 in step S1505 (step S1505: Yes), the information processing apparatus 202 detects the peak position in the frequency distribution in the X-axis direction calculated in step S1503. (Step S1507). Next, the information processing apparatus 202 determines whether the number of peak positions in the frequency distribution in the X-axis direction detected in step S1507 is 2 (step S1508). When the number of peak positions in the frequency distribution in the X-axis direction is not 2 (step S1508: No), the information processing apparatus 202 proceeds to step S1506.

  In step S1508, when the number of peak positions in the frequency distribution in the X-axis direction is 2 (step S1508: Yes), the information processing apparatus 202 proceeds to step S1509. That is, the information processing apparatus 202 acquires two peak positions Xp1 and Xp2 (Xp1 <Xp2) in the frequency distribution in the X-axis direction detected in step S1507 (step S1509).

  Next, the information processing apparatus 202 determines whether or not the ratio Xp2 / Xp1 of the peak position Xp2 to the peak position Xp1 is smaller than a predetermined ratio based on the peak positions Xp1 and Xp2 acquired in step S1509 (step S1510). . When the ratio Xp2 / Xp1 is not smaller than the predetermined ratio (step S1510: No), the information processing apparatus 202 proceeds to step S1506.

  In step S1510, if the ratio Xp2 / Xp1 is smaller than the predetermined ratio (step S1510: Yes), it can be determined that the photographer has bent one fingertip. In this case, the information processing apparatus 202 determines that there has been a capture operation by the photographer (step S1511), and ends a series of detection processes.

(Detection of capture operation with thumb)
Next, a specific example of detection of the capture operation with the thumb will be described.

  FIG. 16 is a diagram illustrating an example of detection of a capture operation with a thumb. In FIG. 16, the same parts as those shown in FIG. As shown in FIG. 16, the photographer bends his thumb at a timing when he / she wants to capture a photograph. As a result, two peak positions Xp1 and Xp2 are generated in the X-axis direction histogram 920.

  When the two peak positions Xp1 and Xp2 are detected in the X-axis direction histogram 920, the information processing apparatus 202 determines whether or not the ratio Xp2 / Xp1 of the peak position Xp2 to the peak position Xp1 is smaller than a predetermined ratio. Then, the information processing apparatus 202 determines that the capturing operation has been performed by the photographer when the ratio Xp2 / Xp1 is smaller than the predetermined ratio. Thereby, image data can be taken in when the photographer bends the thumb.

  Further, when the photographer bends the thumb, the maximum value Xm decreases. For this reason, the information processing apparatus 202 may determine that the capture operation has been performed when the reduction amount of the maximum value Xm within the predetermined period exceeds the predetermined value. Alternatively, the information processing apparatus 202 may determine that the capture operation has been performed when the ratio Xm / Xp1 of the maximum value Xm with respect to the peak position Xp1 is smaller than a predetermined ratio. Thereby, the capture operation can be detected without detecting the peak position Xp2.

(Apply to video)
Next, an application example of the photographing apparatus 100 to a moving image will be described.

(Video capture processing)
FIG. 17 is a flowchart illustrating an example of a moving image capturing process. The information processing apparatus 202 illustrated in FIG. 2 executes, for example, each step illustrated in FIG. 17 when capturing a moving image.

  Steps S1701 to S1704 shown in FIG. 17 are the same as steps S301 to S304 shown in FIG. After step S1704, the information processing apparatus 202 determines whether or not a framing operation has been performed by the photographer based on the detection result in step S1704 (step S1705). If there is no framing operation (step S1705: No), the image data acquired in step S1701 is stored in the storage device 207 (step S1706), and the process returns to step S1701.

  In step S1705, when there is a framing operation (step S1705: Yes), the information processing apparatus 202 performs an acquisition frame determination process based on the finger area identified by the identification process in step S1703 (step S1707). The determination process in step S1707 can be realized, for example, by the determination process illustrated in FIGS. 6-1 and 6-2.

  Next, the information processing apparatus 202 causes the storage device 207 to store image data indicating an image in the captured frame determined in step S1707 among the image data acquired in step S1701 (step S1708). The capture frame determined in step S1707 is displayed on the image indicated by the image data acquired in step S1701 by the display device 206 (step S1709).

  Next, the information processing apparatus 202 determines whether or not to finish moving image shooting (step S1710). The determination as to whether or not to end the moving image shooting can be performed by determining whether or not an end instruction from the photographer has been received through the input interface 208, for example. When it is determined that moving image shooting is to be ended (step S1710: Yes), the information processing apparatus 202 ends a series of processes.

  If it is determined in step S1710 that moving image shooting is not to be ended (step S1710: No), the information processing apparatus 202 returns to step S1701. At this time, the information processing apparatus 202 may return to step S1701 after waiting until the next capture period corresponding to the frame rate of the moving image is reached.

  The moving image capturing process is not limited to the above steps. For example, once the framing operation is detected, the information processing apparatus 202 may fix the capture frame until the next framing operation is detected.

  Further, for example, when a human face is included in the capture frame, the information processing apparatus 202 may cause the position of the capture frame to follow the change in the position of the human face. Thereby, it is possible to continue photographing without aiming out the target person.

  As described above, according to the image capturing device, the image capturing method, the image capturing program, and the mobile communication terminal, it is possible to facilitate photographing.

  Further, for example, as compared with a technique of performing framing on the basis of a photographer's ring, framing can be performed without wearing a specific ring every time photographing is performed, so that convenience can be improved.

  Note that the image capturing method described in the present embodiment can be realized, for example, by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The program may be distributed via a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Additional remark 1) The specific part which specifies the area | region which is the area | region of the predetermined color among the images which the image data obtained by the image pick-up element shows, and touches the edge part of the said image,
A calculating unit that calculates a frequency distribution in a first direction and a second direction intersecting the first direction of the image included in the region specified by the specifying unit;
A determination unit that determines a capture range based on the frequency distribution calculated by the calculation unit;
A capture unit that stores, in a storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing device comprising:

(Additional remark 2) The said determination part is a positive side from the peak position of the frequency distribution of the said 1st direction, the position based on the maximum value of the said 2nd direction in the frequency distribution of the said 2nd direction, and the maximum value of the said 2nd direction. The image capture device according to appendix 1, wherein the capture range is determined by the position of the image.

(Additional remark 3) The said determination part is a negative side rather than the minimum value of the said 2nd direction and the position based on the peak value of the frequency distribution of the said 1st direction, and the minimum value of the said 2nd direction in the frequency distribution of the said 2nd direction The image capture device according to appendix 1, wherein the capture range is determined by the position of the image.

(Supplementary note 4)
The capture range by a position based on the peak position of the frequency distribution in the first direction and the maximum value in the second direction in the frequency distribution in the second direction, and a position on the positive side of the maximum value in the second direction. A first determination process for determining
The capture range according to a peak position of the frequency distribution in the first direction and a position based on the minimum value in the second direction in the frequency distribution in the second direction and a position on the negative side of the minimum value in the second direction. A second determination process for determining
The supplementary note 1 is characterized in that: a position in the second direction of the region in the image is determined, and the first determination process and the second determination process are switched based on a determination result. Image capture device.

(Appendix 5) An image capturing device for capturing a still image,
The predetermined capture timing is a timing at which a predetermined change in the frequency distribution calculated by the calculation unit is detected.
The image capturing device according to any one of Appendices 1 to 4, wherein

(Additional remark 6) The said predetermined capture timing is a timing when the number of the predetermined peak positions of the frequency distribution of the said 1st direction changed, The image capture apparatus of Additional remark 5 characterized by the above-mentioned.

(Supplementary Note 7) The predetermined capture timing is a predetermined difference between a predetermined peak position of the frequency distribution in the first direction and a minimum value or a maximum value in the first direction in the frequency distribution in the first direction. 6. The image capturing device according to appendix 5, wherein the change is detected at a timing.

(Appendix 8) An image capturing device for capturing a moving image,
The predetermined capture timing is a periodic timing.
The image capturing device according to any one of Appendices 1 to 4, wherein

(Additional remark 9) The area | region which is the area | region of the predetermined color among the images which the image data obtained by the image pick-up element shows, and contact | connects the edge part of the said image,
Calculating a frequency distribution in a first direction and a second direction intersecting the first direction in the image of pixels included in the identified region;
Determine the capture range based on the calculated frequency distribution,
Storing, in a storage device, image data indicating an image of the determined capture range among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing method characterized by the above.

(Appendix 10)
An area of a predetermined color in an image indicated by image data obtained by an image sensor, which is in contact with an edge of the image,
Calculating a frequency distribution in a first direction and a second direction intersecting the first direction in the image of pixels included in the identified region;
Determine the capture range based on the calculated frequency distribution,
Storing, in a storage device, image data indicating an image of the determined capture range among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing program for executing processing.

(Appendix 11) Image sensor;
A storage device;
A specifying unit that specifies a region of a predetermined color in an image indicated by image data obtained by the image sensor and is in contact with an end of the image;
A calculating unit that calculates a frequency distribution in a first direction and a second direction intersecting the first direction of the image included in the region specified by the specifying unit;
A determination unit that determines a capture range based on the frequency distribution calculated by the calculation unit;
A capture unit that stores, in the storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
A mobile communication terminal comprising:

(Additional remark 12) The specific part which specifies the area | region where the finger | toe was image | photographed among the images which the image data obtained by the image pick-up element showed, and touched the edge part of the said image,
A determination unit that determines a capture range based on the area specified by the specification unit;
A capture unit that stores, in a storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing device comprising:

DESCRIPTION OF SYMBOLS 100 Image pick-up apparatus 110,204 Image pick-up element 120 Image capture device 121 Identification part 122 Calculation part 123 Determination part 124 Capture part 130,207 Storage device 200 Mobile communication terminal 201 Communication apparatus 202 Information processing apparatus 203 Objective lens 205 Image buffer memory 206 Display device 208 Input interface 800 Image 801 to 806 Subject area 910 Y-axis direction histogram 911, 912 Coordinates 913 Capture frame 920 X-axis direction histogram

Claims (7)

A specifying unit that specifies a region of a predetermined color in an image indicated by image data obtained by an image sensor and is in contact with an end of the image;
A calculating unit that calculates a frequency distribution in a first direction and a second direction intersecting the first direction of the image included in the region specified by the specifying unit;
A determination unit that determines a capture range based on the frequency distribution calculated by the calculation unit;
A capture unit that stores, in a storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing device comprising: An image capturing device that captures still images,
The predetermined capture timing is a timing at which a predetermined change in the frequency distribution calculated by the calculation unit is detected.
The image capturing device according to claim 1. An image capturing device for capturing a moving image,
The predetermined capture timing is a periodic timing.
The image capturing device according to claim 1. An area of a predetermined color in an image indicated by image data obtained by an image sensor, which is in contact with an edge of the image,
Calculating a frequency distribution in a first direction and a second direction intersecting the first direction in the image of pixels included in the identified region;
Determine the capture range based on the calculated frequency distribution,
Storing, in a storage device, image data indicating an image of the determined capture range among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing method characterized by the above. On the computer,
An area of a predetermined color in an image indicated by image data obtained by an image sensor, which is in contact with an edge of the image,
Calculating a frequency distribution in a first direction and a second direction intersecting the first direction in the image of pixels included in the identified region;
Determine the capture range based on the calculated frequency distribution,
Storing, in a storage device, image data indicating an image of the determined capture range among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing program for executing processing. An image sensor;
A storage device;
A specifying unit that specifies a region of a predetermined color in an image indicated by image data obtained by the image sensor and is in contact with an end of the image;
A calculating unit that calculates a frequency distribution in a first direction and a second direction intersecting the first direction of the image included in the region specified by the specifying unit;
A determination unit that determines a capture range based on the frequency distribution calculated by the calculation unit;
A capture unit that stores, in the storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
A mobile communication terminal comprising: A specifying unit that specifies a region in which a finger is captured in an image indicated by image data obtained by an image sensor and is in contact with an end of the image;
A determination unit that determines a capture range based on the area specified by the specification unit;
A capture unit that stores, in a storage device, image data indicating an image in the capture range determined by the determination unit among images represented by the image data obtained by the imaging element at a predetermined capture timing;
An image capturing device comprising:

Images