JP2012120003A - Imaging device, imaging device control method, and control program of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device which has functions of detecting the shape of a frame for identifying a range to be imaged and imaging the range to be imaged identified by the frame, and to provide an imaging device control method and a control program of the same.SOLUTION: An imaging device 100 of this invention comprises: imaging means 101 which executes imaging and generates image data; frame candidate detection means 102 which detects, from the image data generated by the imaging means 101, the shape of a frame candidate identifying the range to be imaged; and control means 103 which controls the imaging means to image the range to be imaged identified by the frame candidate detected by the frame candidate detection means.

Description

  The present invention relates to a photographing apparatus, a control method in the photographing apparatus, and a control program therefor, and particularly relates to a technique for specifying a photographing range at the time of camera photographing.

  Various techniques have been proposed to increase the added value of cameras. Japanese Patent Application Laid-Open No. 2004-228561 discloses a camera technique that allows a user to take a picture with a natural feeling without feeling uncomfortable by providing a framing (determining the shooting range) means to the camera. Japanese Patent Application Laid-Open No. 2004-228561 discloses a digital camera technology that performs shooting by controlling the zoom magnification to be maximized in a state in which a plurality of subjects are included by a user specifying a plurality of subjects. .

  Patent Document 3 discloses a technique of a digital camera equipped with a function of automatically performing framing in order to photograph a person at a target size. Patent Document 4 discloses a digital camera technique that can automatically track a subject designated by a user and photograph the subject.

JP 2005-121838 A JP 2005-269153 A JP 2007-228007 A JP 2009-117960 A

  However, in the techniques disclosed in Patent Documents 1 to 4, when the user captures an outside scene from the indoor window, the position of the image capturing device is adjusted so that the user adjusts the capturing range within the window frame. It is necessary to adjust the angle and so on. For this reason, there is a possibility that it takes time and effort to shoot. In addition, it is not easy for the user to specify the shooting range.

  The present invention has been made to solve such problems, and an object of the present invention is to provide a photographing apparatus excellent in a photographing range specifying function, a control method in the photographing apparatus, and a control program therefor.

  An imaging apparatus according to the present invention executes imaging and generates image data, and frame candidate detection means for detecting a shape of a frame candidate for specifying an imaging range from the image data generated by the imaging means And control means for controlling the imaging means so as to take an image of a shooting range specified by the frame candidate detected by the frame candidate detection means.

  The method for controlling a photographing apparatus according to the present invention includes a step of processing photographing data to generate image data, a step of detecting a shape of a frame candidate for specifying a photographing range from the generated image data, and the frame candidate The step of controlling the photographing apparatus so as to photograph the photographing range specified by.

  A control program for an image capturing apparatus according to the present invention includes: a process for processing image data to generate image data; a process for detecting a shape of a frame candidate for specifying an image capturing range from the generated image data; and the frame candidate The imaging apparatus is caused to execute processing for controlling the imaging apparatus so as to capture the imaging range specified by.

  According to the present invention, it is possible to provide a photographing apparatus excellent in a photographing range specifying function, a control method in the photographing apparatus, and a control program thereof.

1 is a block diagram illustrating an example of an overall configuration of a photographing apparatus according to a first embodiment. FIG. 3 is a block diagram illustrating an example of an overall configuration of a photographing apparatus according to a second embodiment. FIG. 10 is an explanatory diagram for explaining processing for specifying a photographing range by the photographing apparatus according to the second embodiment; FIG. 6 is a block diagram illustrating an example of an overall configuration of a photographing apparatus according to a third embodiment. FIG. 10 is a first explanatory diagram for explaining processing for specifying a photographing range by the photographing apparatus according to the third embodiment; FIG. 10 is a second explanatory diagram for explaining a process of specifying a photographing range by the photographing apparatus according to the third embodiment. FIG. 10 is a third explanatory diagram for explaining processing for specifying an imaging range by the imaging apparatus according to the third embodiment; FIG. 10 is a fourth explanatory diagram for explaining processing for specifying a photographing range by the photographing apparatus according to the third embodiment; FIG. 10A is a first explanatory diagram for explaining processing for specifying a photographing range by the photographing apparatus according to the fourth embodiment; FIG. 10 is a second explanatory diagram for explaining a process of specifying a photographing range by the photographing apparatus according to the fourth embodiment. FIG. 10 is a third explanatory diagram for explaining processing for specifying a photographing range by the photographing apparatus according to the fourth embodiment;

Embodiment 1
Embodiment 1 of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram illustrating an example of the overall configuration of the imaging apparatus 100 according to the present embodiment. The imaging apparatus 100 includes an imaging unit 101, a frame candidate detection unit 102, and a control unit 103. The photographing apparatus 100 is an apparatus having a photographing function, for example, a camera, a digital camera, a portable terminal (such as a mobile phone, a portable information terminal, a smartphone) having a camera photographing function, or a camera having a glasses-type display.

  The imaging unit 101 has a function of capturing a still image or a moving image, and includes an imaging element (image sensor) such as a CCD or a CMOS. In the image pickup unit 101, the incident image light in the shooting range is condensed on the image pickup element by an optical lens. The image sensor converts the condensed video light into photographing data. The imaging unit 101 converts the captured data into image data, and outputs the image data to the frame candidate detection unit 102 and the control unit 103. The imaging unit 101 includes a processor such as a CPU (Central Processing Unit).

  The frame candidate detection unit 102 has a function of detecting the shape of the frame candidate that specifies the shooting range from the image data generated by the imaging unit 101. The frame candidate detection unit 102 outputs data of the shooting range specified by the frame candidate to the control unit 103. The data of the shooting range may be coordinate information for specifying the shooting range in the image data, or may be image data of the shooting range. Other data may be used as long as the shooting range can be specified. Note that the frame candidate detection means 102 includes a processor such as a CPU, for example.

  The detection of the shape of the frame candidate in the frame candidate detection unit 102 will be further described. The frame candidate detection unit 102 has a function of extracting features of image data, recognizing a closed region such as a square, a circle, or a polygon, and detecting a shape as a frame candidate. With this function, the frame candidate detection unit 102 can detect, for example, a window frame, a frame, and the like.

  Alternatively, the frame candidate detection unit 102 may recognize a virtual closed region as a shape that is a frame candidate. As an example of “virtual closed region”, both the thumb and forefinger are L-shaped (the angle between the thumb and forefinger of the same hand is substantially perpendicular), and the thumb and left hand of the right hand It is conceivable that the thumb, the right index finger and the left index finger are arranged substantially in parallel. In this case, the frame candidate detection means 102 recognizes a virtual rectangle based on the shape of the thumb and index finger of both hands. Further, it may have a function of recognizing the virtual frame as a frame candidate shape by the action of a hand drawing a virtual frame. The frame candidate detection means 102 may detect the shape of the frame candidate by comparing the image data with a prestored frame pattern.

  The control unit 103 controls the imaging unit 101 and the frame candidate detection unit 102. For example, when the control unit 103 acquires the data of the shooting range specified by the frame candidate from the frame candidate detection unit 102, the control unit 103 outputs an instruction to control the imaging unit 101 so that only the specific shooting range is shot. . As a specific example of the control, the control unit 103 controls the zoom and the direction of the imaging unit 101 (or the direction of the lens when the imaging unit 101 includes a lens). When the image pickup unit 101 is equipped with an optical zoom function, the control unit 103 automatically adjusts the zoom magnification so that a specific shooting range is as large as possible in the image pickup device. However, when the image pickup unit 101 is equipped with a digital zoom function, the control unit 103 sets a trimming range used as image data for shooting as a specific shooting range so that only a specific shooting range is shot. . In addition, the control unit 103 may control the imaging unit 101 to execute autofocus so that a specific imaging range is clearly captured.

  Further, the control means 103 has storage means for acquiring image data from the imaging means 101 and storing it. The control unit 103 includes, for example, a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like in the photographing apparatus 100. The CPU controls the photographing apparatus 100 by reading a program stored in the ROM and various application programs loaded in the RAM. Various programs for controlling the photographing apparatus 100 are stored in the ROM. The RAM appropriately stores data necessary for the CPU to execute various processes. Note that other non-volatile memory may be used instead of the ROM.

  Hereinafter, processing of each unit of the photographing apparatus 100 when the user performs photographing using the photographing apparatus 100 will be described. First, the control unit 103 outputs an imaging instruction to the imaging unit 101 in accordance with a user instruction. In response to the instruction, the imaging unit 101 performs shooting, converts the shooting data, and generates image data. The imaging unit 101 outputs the image data to the frame candidate detection unit 102 and the control unit 103.

  The frame candidate detection unit 102 detects the shape of the frame candidate that specifies the shooting range from the image data generated by the imaging unit 101. When the frame candidate detection unit 102 detects the shape of the frame candidate from the image data, the frame candidate detection unit 102 outputs data of the shooting range specified by the frame candidate to the control unit 103. The control unit 103 controls the imaging unit 101 so as to capture the specified imaging range. A specific example in which the control unit 103 controls the imaging unit 101 is as described above.

  As described above, according to the imaging apparatus according to the present embodiment, the shape of the frame specifying the imaging range can be detected and the imaging range specified by the frame can be captured, so that the user can easily specify the imaging range. can do.

Embodiment 2
The second embodiment of the present invention will be described below with reference to the drawings. Note that the description of the same points as in the first embodiment will be omitted as appropriate. FIG. 2 is a block diagram illustrating an example of the overall configuration of the imaging apparatus 100 in the present embodiment. The imaging apparatus 100 includes a frame candidate detection unit 102, a control unit 103, a camera unit 104, an image processing unit 105, a display data generation unit 106, a display unit 107, and an imaging range selection unit 108. A specific example of the imaging apparatus 100 is the same as that of the first embodiment, and a description thereof will be omitted. The camera unit 104 and the image processing unit 105 correspond to the imaging unit 101 of the first embodiment.

  The frame candidate detection means 102 performs the same processing as in the first embodiment. In the present embodiment, the frame candidate detection unit 102 can detect a plurality of frame candidates.

  The control unit 103 controls the frame candidate detection unit 102, the camera unit 104, the image processing unit 105, the display unit 107, and the shooting range selection unit 108. The control unit 103 includes a storage unit 113 that acquires image data from the image processing unit 105 and stores it, in addition to the camera control unit 112 that controls the zoom or shooting direction of the camera unit 104. Further, the control unit 103 selects a shooting range from a plurality of shooting range candidates detected by the frame candidate detection unit 102 in accordance with the information from the shooting range selection unit 108. The camera control unit 112 automatically controls the zoom, shooting direction, and the like of the camera unit 104 so that only the selected shooting range is shot.

  In addition, the control unit 103 acquires coordinate data necessary for specifying the detected frame candidate from the frame candidate detection unit 102. The control means 103 generates data indicating a frame for each detected frame candidate, and outputs the data to the display data generation means 106 together with the coordinate data of the corresponding frame candidate. A specific configuration example of the control unit 103 is the same as that of the first embodiment, and a description thereof will be omitted.

  The camera unit 104 has a function of capturing a still image or a moving image, and includes a sensor unit 110 and a lens unit 111. The sensor means 110 is an image sensor, such as a CCD or CMOS. The lens unit 111 includes an optical lens and its drive system. When the optical lens provided in the lens unit 111 condenses the image of the shooting range on the image sensor provided in the sensor unit 110, the camera unit 104 acquires the shooting data.

  The image processing unit 105 converts the photographic data output from the camera unit 104 to generate image data. The image data generated by the image processing unit 105 is output to the frame candidate detection unit 102, the control unit 103, and the display data generation unit 106.

  Based on the image data output from the image processing unit 105, the frame candidate frame data output from the control unit 103, and the corresponding coordinate data, the display data generation unit 106 displays an image to be displayed on the display unit 107. Generate display data. That is, the display data generation unit 106 generates display data of an image in which the position of the shooting range or shooting range candidate (frame or frame candidate) is indicated by a frame in the image data output from the image processing unit 105. The display data generation unit 106 outputs the display data of the synthesized image to the display unit 107. The display data generation unit 106 is configured by an IC (Integrated Circuit) including, for example, a CPU, a ROM, a RAM, and the like.

  The display unit 107 displays an image based on the display data generated by the display data generation unit 106. The display means 107 is specifically a display device such as a liquid crystal display.

  The imaging range selection unit 108 is a device that is operated by the user and selectively inputs an arbitrary imaging range candidate based on any of the plurality of imaging range candidates displayed on the display unit 107. Specific examples of the shooting range selection means 108 include four-directional keys provided on a mobile phone, an input device that can be freely moved by the user, such as an analog pointing device, and the user's voice can be recognized. Devices are possible.

  Hereinafter, with reference to FIG. 3, a frame selection process of the imaging apparatus 100 according to the present embodiment will be described. In particular, FIG. 3 shows a shooting range when the user takes a picture outside the window frame from the room. The initial imaging range 200 (at the start of framing) is an indoor wall including window frames 201 and 202 of two windows. In addition, the user can see the outdoor scenery through the windows defined by the window frames 201 and 202. In this example, a landscape with a tree and a bench (scenery in the shooting range 203) can be seen from the window related to the window frame 202.

  When the user shoots the initial shooting range 200, the camera unit 104 sequentially updates and shoots the initial shooting range 200, and outputs the shooting data of the initial shooting range 200 to the image processing unit 105. The image processing unit 105 processes the shooting data to generate image data, and outputs the image data to the display data generation unit 106. The display data generation means 106 outputs the image data to the display means 107, so that the display means 107 sequentially updates and displays the image data of the initial photographing range 200. Hereinafter, this display state is also referred to as a preview state.

  At this time, the frame candidate detection unit 102 detects the window frames 201 and 202 as the shape of the frame candidate for specifying the shooting range from the image data input from the image processing unit 105. The frame candidate detection means 102 outputs the coordinate data necessary for specifying these frame candidates (window frames 201 and 202) to the control means 103.

  Based on the coordinate data output from the frame candidate detection unit 102, the control unit 103 generates data such as a frame candidate frame and outputs the frame candidate data to the display data generation unit 106 together with the coordinate data. In this example, the control means 103 generates data of a red frame that is a frame candidate frame and clearly displays it together with the coordinate data of the window frames 201 and 202 in order to clearly indicate that the window frames 201 and 202 are within the shooting range. The data is output to the data generation means 106. The frame candidate frame data of the window frame 201 is associated with the coordinate data of the window frame 201, and the frame candidate frame data of the window frame 202 is associated with the coordinate data of the window frame 202, and the display data generation unit 106. Is output. The control means 103 may generate data for a frame of another color instead of the red frame. Further, instead of the frame data, data serving as a mark such as an arrow may be generated.

  The display data generation unit 106 uses the window candidate frame data and coordinate data output from the control unit 103 and the image data of the initial shooting range 200 output from the image processing unit 105 to display a window frame in the initial shooting range 200. Display data indicating the positions of 201 and 202 is generated. The display data generation unit 106 outputs the display data to the display unit 107. The display unit 107 displays the image generated by the display data generation unit 106. In this example, the display data generated by the display data generation means 106 is image data in which the window frames 201 and 202 are displayed with a red frame in the initial shooting range 200 of FIG. That is, the display unit 107 displays an image in which the window frames 201 and 202 are displayed with a red frame in the initial shooting range 200. When the user visually recognizes the display unit 107, the window frames 201 and 202 are displayed in red, so that the user can clearly recognize that the photographing range candidate is within the window frames 201 and 202.

  The user visually recognizes the image displayed on the display unit 107, operates the shooting range selection unit 108, and selects the window frame 202 as a frame of the shooting range. For example, the photographing apparatus 100 is a portable terminal, the display unit 107 is a liquid crystal display, and the photographing range selection unit 108 is various keys including four-direction keys. In that case, the liquid crystal display displays an image in which the window frames 201 and 202 are displayed with a red frame in the initial photographing range 200. The user selects an image related to the window frame 202 from images related to the window frames 201 and 202 by using four-direction keys or the like. Thereby, the user selects the inside of the window frame 202 (shooting range 203) as the shooting range.

  By the user's operation, the shooting range selection unit 108 outputs information for selecting the shooting range 203 as the shooting range to the control unit 103. The control unit 103 controls the camera unit 104 by the camera control unit 112 based on the information output from the shooting range selection unit 108. Specifically, the camera control unit 112 adjusts the optical zoom magnification, the lens orientation, and the like in the lens unit 111 so that the imaging range 203 is captured most greatly with respect to the sensor unit 110. Through the above processing, the user can take a picture of the landscape (shooting range 203) in the window frame 202.

  At this time, the control unit 103 changes the image displayed on the display unit 107 in response to the user selecting the window frame 202 as the frame of the shooting range. Before the user selects the window frame 202, the display unit 107 displays an image in which the window frames 201 and 202 are displayed with a red frame in the initial shooting range 200. However, after the user selects the window frame 202, the display means 107 displays the window frame 202 in a dark red frame and the window frame 201 in a light red frame in the initial shooting range 200. In addition, the control means 103 performs control. That is, the control unit 103 generates thin red frame data for the window frame 201 and outputs the data to the display data generation unit 106 in association with the coordinate data of the window frame 201. Similarly, the control unit 103 generates dark red frame data for the window frame 201, associates it with the coordinate data of the window frame 202, and outputs it to the display data generation unit 106. The display data generation unit 106 generates display data of an image to be displayed on the display unit 107 based on the output data, and the display unit 107 generates an image based on the display data. As described above, the display unit 107 displays an image in which the window frame 202 is displayed with a dark red frame and the window frame 201 is displayed with a light red frame in the initial photographing range 200. Note that the window frame 201 may be displayed in a frame of another color such as white or yellow instead of red. Alternatively, the display unit 107 may be divided into an upper part and a lower part, and the upper photographing area 200 may be displayed on the upper screen, and the photographing area 203 may be displayed on the lower screen. The image displayed as described above changes as appropriate according to the shooting range selected by the user.

  As described above, according to the imaging apparatus according to the present embodiment, it is possible to automatically determine a frame candidate such as a window frame and to control imaging so that the imaging range specified by the frame is maximized. . As a result, the user can easily perform framing. In addition, the photographing apparatus includes a display unit and a photographing range selection unit, and displays images related to a plurality of photographing range candidates on the display unit. The user can select a desired shooting range among the shooting range candidates by operating the shooting range selection unit while viewing this image.

  Generally, in a portable terminal having a camera photographing function such as a digital camera or a mobile phone, a user uses a display device such as a finder or a liquid crystal screen at the time of photographing, and shoots a visible range by the display device. It is determined as an indication of the range or shooting range. When the user captures only a part of the range that is visible from the display device, the user performs control to change or adjust the imaging range by himself / herself. For example, the user may shoot a desired shooting range by adjusting the camera direction, moving the shooting position, or adjusting the shooting range using optical zoom, digital zoom, or the like. Take control. For example, the user may shoot only the outside scenery reflected in the window from the room or on the train.

  However, in such a case, it may be troublesome for the user to manually perform framing to maximize the shooting range (scenery reflected in the window) so that the window frame is not reflected. In some cases, it may be difficult to make adjustments, for example, the camera does not have a zoom function, or a desired shooting range cannot be shot within a range that the camera can zoom. In addition, when a user shoots a part of the scenery while visually recognizing the surrounding scenery through a glasses-type display, etc., the difference between the optimum viewing range for checking the surroundings and the desired shooting range. Therefore, it may be difficult to determine the shooting range. In such cases, the user may not be able to take a picture, such as missing a photo opportunity.

  By using the imaging apparatus according to the present embodiment, the user can take an image without the difficulty associated with the above framing.

  In this embodiment, the window frame is not included in the shooting range. However, the control unit 103 uses the sensor frame 110 as the shooting range within the window frame 202 (shooting range 203) and the window frame 202 as the shooting range. May be controlled so that the largest image is captured. That is, the user may be able to take a landscape image in the window frame 202 so that the window frame 202 is included at the end of the shooting range. Further, instead of outputting image data from the image processing unit 105 to the control unit 103, similar image data may be output from the frame candidate detection unit 102 to the control unit 103.

Embodiment 3
The third embodiment of the present invention will be described below with reference to the drawings. FIG. 4 is a block diagram illustrating an example of the overall configuration of the image capturing apparatus 100. The imaging apparatus 100 according to FIG. 4A is obtained by replacing the frame candidate detection unit 102 in the imaging apparatus 100 according to FIG. The configuration of each other part of the imaging apparatus 100 according to FIG. 4A is the same as that of the imaging apparatus 100 according to FIG.

  Hereinafter, the frame pattern comparison unit 109 will be described. The frame pattern comparison unit 109 has a function of detecting a frame candidate by detecting the feature of the image data and comparing it with the stored pattern data of the frame. Other functions are the same as those of the frame candidate detection unit 102. The frame pattern comparison unit 109 includes an image data feature detection unit 114, a frame detection pattern data storage unit 115, and a comparison unit 116, as shown in FIG.

  The image data feature detection unit 114 detects image features from the image data input from the image processing unit 105. Image features that can be detected by the image data feature detection unit 114 include a virtual closed region in addition to a closed region such as a circle, square, or other polygon. Details of the latter shape will be described later. Image data relating to the detected image features (hereinafter also referred to as image feature data) is output to the comparison means 116.

  The frame detection pattern data storage means 115 stores frame pattern data that determines the shooting range of camera shooting. This pattern data may be originally stored in the photographing apparatus 100 or may be stored by the user. The frame detection pattern data storage unit 115 outputs the stored frame information to the comparison unit 116 in response to a request from the comparison unit 116.

  The comparison unit 116 compares the image feature data output from the image data feature detection unit 114 with the frame pattern data output from the frame detection pattern data storage unit 115, and the frame pattern data is included in the image feature data. It is determined whether or not there is a similar shape. In other words, the comparison unit 116 determines whether or not the image data output from the image processing unit 105 has a shape similar to the data stored in the frame detection pattern data storage unit 115. When there is a similar shape, the comparison unit 116 determines that the shape is a frame candidate shape, and outputs coordinate data for specifying the frame candidate to the control unit 103.

  With the above configuration, the frame pattern comparison unit 109 detects the feature of the image data, and detects the frame candidate by comparing it with the stored pattern data of the frame. The image data feature detection unit 114 and the comparison unit 116 include a processor such as a CPU, and the frame detection pattern data storage unit 115 includes a memory such as a ROM.

  The “virtual closed region” detected by the frame pattern comparison unit 109 will be described with reference to FIG. FIG. 5 is a first explanatory diagram for describing processing in which the photographing apparatus 100 specifies a photographing range in the present embodiment. 5 (a) and 5 (b) show that in the shooting direction of the camera means 104, the left hand 301 and the thumb of the right hand 302 and the forefinger have the above-mentioned L-shape, and the right and left index fingers, The state which has arrange | positioned the thumbs of the left hand substantially parallel is shown. (Note that the palm of the right hand is in front and the back of the hand is in front of the left hand.) The frame pattern comparing means 109 is shown in FIGS. 5 (a) and 5 (b) depending on the shape of the thumb and index finger of the left hand 301 and right hand 302. The virtual rectangles 303 and 304 are recognized. The insides of the virtual rectangles 303 and 304 are photographed by the photographing apparatus 100 as photographing ranges 305 and 306.

  When the camera unit 104 captures the shape of the left hand 301 and the right hand 302 shown in FIG. In that case, the image data relating to shooting is output from the image processing means 105 to the image data feature detection means 114.

  The image data feature detection unit 114 detects the shapes of the thumb and index finger of the left hand 301 and the right hand 302 shown in FIG. 5 as image feature data based on the image data input from the image processing unit 105. This image feature data is output to the comparison means 116.

  The comparison unit 116 compares the output image feature data with the frame pattern data output from the frame detection pattern data storage unit 115. The frame detection pattern data storage unit 115 stores the shape of both hands similar to the shape shown in FIG. 5A as frame detection pattern data. Based on the pattern data stored in the frame detection pattern data storage unit 115, the comparison unit 116 indicates that the shape of both hands shown in FIG. 5A is a shape indicating a “virtual closed region”. judge.

  The frame detection pattern data storage unit 115 stores data such as parameters for determining the position and size of a virtual rectangle set by the shape and position of the left hand 301 and the right hand 302. The comparison unit 116 recognizes the virtual rectangle 303 by acquiring the data from the frame detection pattern data storage unit 115. The comparison unit 116 outputs the coordinate data indicating the range (coordinate data of the rectangle 303) to the control unit 103, with the inside of the virtual rectangle 303 (the shooting range 305) as a shooting range candidate. Thereafter, the control executed by the control means 103 is the same as in the first and second embodiments. As described above, the imaging apparatus 100 can capture the imaging range 305.

  The comparison unit 116 recognizes the virtual rectangle by determining the corners and sides of the virtual rectangle based on the parameters for determining the position of the virtual rectangle. The comparison unit 116 recognizes a virtual rectangle as follows, for example. In FIG. 5A, the frame pattern comparison unit 109 sets an extension line from the tip of the index finger of the left hand 301 as the first side of the virtual rectangle. This first side corresponds to the lower side of the virtual rectangle 303. Further, the frame pattern comparison unit 109 sets a normal line from the index finger so as to touch the thumb of the left hand. This normal is set as the second side of the virtual rectangle. This second side corresponds to the left side of the virtual rectangle 303. Further, the location where the first side and the second side intersect is set as the first corner of the virtual rectangle. This first corner is the lower left corner of the virtual rectangle 303. As described above, the frame pattern comparison unit 109 determines the corners and sides of the virtual rectangle in the left hand 301. The frame pattern comparison unit 109 performs the same setting for the right hand 302 and determines the corners and sides of the virtual rectangle. In this way, the comparison unit 116 recognizes the virtual rectangle 303 by determining the diagonal and both sides of the virtual rectangle. In addition, when the imaging device 100 includes a level like a level detector, even if the position of the hand is slightly inclined from the horizontal, the bottom of the virtual rectangle (imaging range) is horizontal. It is possible to correct automatically.

  As described above, when the user determines the shooting range, even if there is no frame candidate indicating a closed area such as a window frame in the scene captured by the camera unit 104, the shooting range can be obtained with both hands of the user or the like. By indicating this, it is possible to determine the shooting range.

  In the detection of frame candidates at the time of shooting, the positional relationship between the left hand 301 and the right hand 302 may not be fixed, and the positions of the left hand 301 and the right hand 302 may be changed as shown in FIGS. 5A to 5B. Good. In that case, the comparison unit 116 determines the frame candidate as a virtual rectangle 304 based on the changed positional relationship between the left hand 301 and the right hand 302. The comparison unit 116 sets the inside of the virtual rectangle 304 (shooting range 306) as a shooting range candidate and outputs coordinate data indicating the range to the control unit 103. With the above processing, the image capturing apparatus 100 can image the inside of the virtual rectangle 304 as the image capturing range 306.

  Further, the “virtual closed region” detected by the frame pattern comparison unit 109 will be described with reference to FIG. FIG. 6 is a second explanatory diagram for describing processing in which the photographing apparatus 100 specifies a photographing range in the present embodiment. FIG. 6 shows a state in which a person has an L-shaped shape of the thumb and index finger of the left hand 301 in the shooting direction of the camera means 104. The frame pattern comparison means 109 detects a virtual rectangle as a frame candidate from the shape of the left hand 301 as follows. As a result, the user can shoot the shooting range 307 inside the virtual rectangle as the shooting range.

  Here, the processing of each unit when the camera unit 104 captures the shape of the left hand 301 shown in FIG. 6A will be described. In that case, the image data relating to shooting is output from the image processing means 105 to the image data feature detection means 114.

  The image data feature detection unit 114 detects, as image feature data, the state in which the thumb and index finger of the left hand 301 are in an L shape as shown in FIG. 5 from the image data input from the image processing unit 105. . This image feature data is output to the comparison means 116.

  The comparison unit 116 compares the output image feature data with the frame pattern data output from the frame detection pattern data storage unit 115. The frame detection pattern data storage means 115 stores a left hand shape similar to the shape shown in FIG. 6A as frame detection pattern data. Based on the pattern data stored in the frame detection pattern data storage unit 115, the comparison unit 116 indicates that the shape shown in FIG. 6A is a shape in which a “virtual closed region” is shown. judge.

  The frame detection pattern data storage unit 115 stores data such as parameters for determining the position and size of a virtual rectangle set according to the shape of the left hand 301. The comparison unit 116 obtains the data from the frame detection pattern data storage unit 115, thereby setting a virtual rectangle (contour part of the shooting range 307) and detecting it as a frame candidate. Thereafter, the comparison unit 116 and the control unit 103 perform the same processing as described above. From the above, the photographing apparatus 100 can photograph the photographing range 307.

  The comparison unit 116 recognizes the virtual rectangle by determining the corners and sides of the virtual rectangle based on FIG. 5 and parameters for determining the position of the virtual rectangle. The comparison unit 116 sets a virtual rectangle as follows, for example. In FIG. 6A, the frame pattern comparison unit 109 sets an extension line from the tip of the index finger of the left hand 301 as the first side of the virtual rectangle. This first side corresponds to the lower side of the virtual rectangle. Further, the frame pattern comparison unit 109 sets a normal line from the index finger so as to touch the thumb of the left hand. This normal is set as the second side of the virtual rectangle. This second side corresponds to the left side of the virtual rectangle. Further, the location where the first side and the second side intersect is set as the first corner of the virtual rectangle. This first corner is the lower left corner of the virtual rectangle. As described above, the frame pattern comparison unit 109 determines the corners and sides of the virtual rectangle. As described above, when the imaging apparatus 100 includes a level like a level detector, even if the position of the hand is slightly inclined from the horizontal, the bottom of the virtual rectangle (imaging range) is horizontal. It is possible to automatically correct so that

  Thereafter, the frame pattern comparison unit 109 sets a virtual rectangle by determining the lengths of the first side and the second side using the parameters stored in the frame detection pattern data storage unit 115. In FIG. 6A, the horizontal length of the virtual rectangle is 1.2 times the length of the index finger of the left hand 301. The length in the vertical direction is 1.4 times the length of the perpendicular drawn from the tip of the thumb of the left hand 301 to the index finger. As described above, the frame pattern comparison unit 109 recognizes the virtual rectangle by determining the corners of the virtual rectangle and the positions and lengths of the two sides.

  Of course, the user can arbitrarily enlarge or reduce the original shooting range determined by the user as described above by key operation, voice recognition operation, or the like. For example, in FIG. 6B, the user expands the shooting range 307 set in FIG. As a result, the user can expand the imaging range that the imaging apparatus 100 captures.

  When the user changes the initial shooting range, the user changes the shooting range by using a hand other than the hand indicating the shooting range to perform a gesture such as opening or closing a finger. May be. In that case, the frame detection pattern data storage means 115 stores the relationship between each gesture such as opening and closing a finger and the above-described deformation operation such as enlargement / reduction of the virtual rectangle in association with each other. .

  FIG. 7 is a third explanatory diagram for describing processing in which the photographing apparatus 100 specifies the photographing range in the present embodiment. FIG. 7 shows an example of a gesture performed by the user with the right hand. In FIG. 7A, the user performs an operation of moving the index finger of the right hand 309 from the lower left to the upper right outside the imaging range 307. The comparison unit 116 recognizes the movement of the right hand 309 from the image data, and performs processing associated with the movement from the frame detection pattern data storage unit 115. In this case, the frame detection pattern data storage means 115 is modified so as to expand the vertical length and horizontal length of the virtual rectangle in the right direction as “the movement of moving the index finger of the right hand from the lower left to the upper right”. Are stored in association with each other. The comparison unit 116 acquires the information from the frame detection pattern data storage unit 115, and detects a virtual rectangle (contour portion of the shooting range 308) shown in FIG. 7B as a frame candidate. As described above, the user can change the shooting range 307 to the shooting range 308. Note that the right hand 309 may perform a gesture inside instead of outside the shooting range.

  6 and 7, it has been described that the frame pattern comparison unit 109 detects the frame candidate using the shape of the left hand 301, but the frame candidate may be detected using the shape of the right hand 302.

  Further, as shown in FIG. 8, the frame pattern comparison unit 109 may recognize the virtual frame as the shape of the frame candidate based on the motion of the hand drawing the virtual frame. FIG. 8 is a fifth explanatory diagram for describing processing in which the photographing apparatus 100 specifies the photographing range in the present embodiment. FIG. 8 shows a state where the fingertip of the index finger of the left hand 401 of the user draws a virtual ellipse 402 in the shooting direction of the camera unit 104. At this time, the frame detection pattern data storage unit 115 stores information such that a virtual frame drawn by “the operation of drawing a frame with a fingertip” is recognized as a frame candidate by the comparison unit 116. The comparison unit 116 acquires the information from the frame detection pattern data storage unit 115, thereby recognizing a virtual ellipse 402 drawn by the fingertip of the index finger of the left hand 401 as a frame candidate shape. As described above, the user can designate the inside of the virtual ellipse 402 as the imaging range 403 by drawing the virtual ellipse 402 with the fingertip of the index finger of the left hand 401. Of course, the user may draw a virtual frame using a part of the hand other than the fingertip.

  The imaging device 100 described in Embodiment 3 can be used for a digital camera, a portable terminal having a camera function, and the like. Further, it is considered that the photographing apparatus 100 is particularly useful when applied to an apparatus that performs camera photographing while visually recognizing surrounding scenery through a glasses-type display or the like. In this type of device, it is desirable that the field of view from the display (the optimum viewing range for confirming the surroundings) is wide in order to prevent accidents and the like due to a narrow field of view. However, it is considered that the user's desired shooting range is often a part of the field of view during camera shooting. In this case, there is a difference between the optimum viewing range for checking the surroundings and the desired shooting range, and it may be difficult to determine the shooting range. In this case, the user can easily perform framing while ensuring a wide field of view from the display by manually determining the shooting range as shown in FIGS. 5 to 8 with the shooting apparatus 100 shown in the third embodiment. can do.

  The frame detection pattern data stored in the frame detection pattern data storage unit 115 is not limited to the hand, and any shape can be applied as long as the same shape recognition is possible. Also, a plurality of frame detection pattern data can be stored, and an application such as switching the frame detection pattern data used by the user according to the situation is possible.

  As described above, the frame detection pattern data storage unit 115 stores the pattern data of the shape for detecting the shooting range, so that the frame pattern comparison unit 109 allows the image data to have a shape similar to the pattern. The range specified thereby can be recognized as the shooting range.

Embodiment 4
Embodiment 4 of the present invention will be described below with reference to the drawings. Note that the overall configuration of the photographing apparatus 100 is the same as that of the second embodiment, and a description thereof will be omitted. In the photographing apparatus 100 according to the present embodiment, when the shape of the image data photographed by the camera does not match the shape of the photographing range selected by the user in the second embodiment, the control unit 103 appropriately sets the photographing range. This is a technique of the photographing apparatus that adjusts.

  The shape of image data to be photographed will be described with reference to FIG. FIG. 9 is a first explanatory diagram for explaining processing for specifying an imaging range by the imaging device according to the fourth embodiment. The image data captured by the camera has a vertical / horizontal ratio of vertical 2: horizontal 3, vertical 3: horizontal 4 or vertical 9: horizontal 16 due to customary factors, optimization to the shape of the display device, image sensor shape, and the like. It is common that it becomes a rectangle. The former image data ratio 501 is shown in FIG. 9A, and the latter image data ratio 502 is shown in FIG. 9B.

  However, as described above, the shooting range is determined by detecting frame candidates and the like. In this case, the determined shooting range may not have a ratio of vertical 2: horizontal 3, vertical 3: horizontal 4, vertical 9: horizontal 16, or the like. For example, in FIG. 9C, the determined rectangular shooting range 503 does not have a vertical / horizontal ratio of 3: 3. (In the rectangle in the range indicated by the dots in FIG. 9C, the aspect ratio is 3: 4.)

  In such a case, the imaging apparatus 100 according to the present embodiment corrects the imaging range 503 determined based on frame detection or the like, and corrects the imaging range so that the aspect ratio is as described above. For example, in the case where the control unit 103 detects that the shooting range is the shooting range 503 in FIG. 9C and the ratio of the vertical 3: horizontal 4 image data is not reached, the control unit 103 sets the vertical 3: The shooting range is automatically adjusted to the corrected shooting range 504 so that the horizontal ratio is 4. After that, the camera unit 104 is controlled so that the corrected shooting range 504 is shot. As described above, the user can automatically shoot the corrected shooting range 504 as shown in FIG. 9D. That is, the image data that has been shot and stored in the storage unit 113 has the corrected shooting range 504 as the shooting range.

  In FIGS. 9C and 9D, the case where the ratio of the image data is vertical 3: horizontal 4 has been described. However, the control unit 103 similarly performs vertical 2: horizontal 3, vertical 9: horizontal. The shooting range can be modified to a ratio of 16 or any other desired size.

  10 and 11, correction of the shooting range performed by the control unit 103 when the shooting range determined by frame detection or the like is not a rectangle but another shape will be described. 10 and 11 are second and third explanatory diagrams for explaining processing for specifying a shooting range by the shooting device according to the fourth embodiment.

  FIG. 10A shows that an oval window frame 601 is included in the initial shooting range 600 of the shooting apparatus 100. In FIG. 10A, the window candidate detection unit 102 detects the window frame 601 as a frame candidate, and the user performs an operation so that the inside of the window frame 601 is photographed. FIG. 10B shows that when the shooting range is determined as described above, the control unit 103 automatically corrects the shooting range. The corrected shooting range 602 is a shooting range determined by the control means 103. The corrected shooting range 602 is a rectangle, and the ratio of length to width is the ratio of general image data, like the corrected shooting range 504 described above.

  When the range in the window frame 601 is determined as the shooting range by the user's operation, the camera control unit 112 in the control unit 103 causes the corrected shooting range 602 to be shot the largest in the window frame 601. The camera means 104 is controlled. Specifically, the camera control unit 112 controls the zoom magnification, the direction of the camera, and the like. In this way, the user can shoot with the corrected shooting range 602 as the shooting range, as shown in FIG. 10C, without manually correcting the shooting range.

  As described above, even when the frame candidate is a non-rectangular shape used in general camera shooting as shown in FIG. 10, the actual shooting range is controlled so as to be the maximum within the determined shooting range. The means 103 executes control. Thereby, the imaging device 100 can perform imaging with appropriate framing.

  Further, FIG. 11 shows a state in which the corrected shooting range is controlled to be displayed within the determined frame candidate maximum by the control of the similar control unit 103. FIG. 11A is the same as FIG. 10A, and a description thereof is omitted.

  FIG. 11B shows the shooting range when the frame candidate detection unit 102 detects the window frame 601 as a frame candidate and the user performs camera shooting in the shooting range specified by the window frame 601. FIG. In that case, the control unit 103 controls the camera control unit 112 so that the corrected shooting range 603 includes all the scenery in the window frame 601 and includes the scenery in the window frame 601 at the maximum. The means 104 is controlled. The corrected shooting range 603 is rectangular, and has a general aspect ratio as described above. In this way, the user can perform shooting using the corrected shooting range 603 as the shooting range as shown in FIG. 11C without manually correcting the shooting range.

  Note that the control unit 103 may automatically trim only the image range within the selected frame candidate and store the image in the storage unit 113 as illustrated in FIG. 11D after shooting the corrected shooting range 603. Is possible. Further, the control unit 103 may perform processing such that the corrected shooting range 603 is displayed on the display unit 107. The same applies to the corrected shooting range 504 in FIG. 9 and the corrected shooting range 602 in FIG.

  As described above, in the fourth embodiment, after shooting, the user can perform shooting without performing post-processing such as trimming image data.

  In the application of the present invention described in the first to fourth embodiments, an electronic viewfinder (EVF) or an electronic viewfinder such as a liquid crystal display is used for the photographing apparatus 100 rather than an optical viewfinder. Therefore, it is considered that the user can shoot more suitably. In particular, when the user performs close-up shooting, a parallax is generated due to a shift in the center of the shooting lens of the shooting apparatus 100 and the center of the user's field of view, so the above-described electronic viewfinder is used. Is considered desirable. For example, as in the second embodiment, when the user or the like performs an operation such as showing a frame using his / her hand, it is assumed that the user's hand is in the vicinity of the photographing apparatus 100. In that case, it may be a problem whether the photographing apparatus 100 can accurately detect the hand movement performed by the user due to the above-described parallax. In such a case, the above-described electronic viewfinder is considered more suitable.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, the image pickup means (camera means) may be provided outside the image pickup apparatus. In addition, the present invention can be applied for the purpose of editing images, moving image data, etc. stored externally or sent from outside in real time. For example, an image, moving image data, or the like is input to the editing device as image data, and the editing device detects a frame candidate in the input image data in the same manner as the method described in the embodiment, so that shooting after editing is performed. An example of determining the range is conceivable.

  In the third embodiment, even when the camera unit 104 detects a closed shape using a hand, the frame pattern comparison unit 109 may detect the closed shape as a frame candidate. As an example of the “closed shape using the hand”, a shape such as a circle or a square using a plurality of fingers is considered as an example.

  In the third embodiment, the frame pattern comparison unit 109 detects a hand shape or motion as a frame candidate related to the hand shape or motion based on the pattern data stored in the frame detection pattern data storage unit 115. did. In this case, the control unit 103 may control the camera unit 104 so as to automatically shoot a shooting range related to the frame candidate related to the shape or movement of the hand even if another frame candidate is detected. Good.

  In the second to fourth embodiments, when the frame candidate detection unit 102 (frame pattern comparison unit 109) detects a plurality of frame candidates, the user manually indicates a portion that is a frame candidate in the shooting range. Thus, the user may select a frame. For example, in FIG. 3, when the user performs an operation of pointing the window frame 202 to the camera unit 104, the control unit 103 detects that the window frame 202 is selected as a frame and performs shooting. The photographing apparatus 100 is controlled so as to perform photographing with the range 203 as the photographing range.

  In the first to fourth embodiments, when the photographing apparatus 100 photographs a landscape in the window frame, the control unit 103 performs the following determination, and performs shooting using the window frame as a photographing range. You may control. The distance between the photographing apparatus 100 and the subject in the landscape in the window frame is different from the distance between the photographing apparatus 100 and the window frame. Therefore, the control unit 103 controls the camera unit 104 to detect that the focus on the window frame is different from the focus on the subject. Further, the frame candidate detection unit 102 outputs information indicating that the window frame shape is a frame candidate to the control unit 103. Based on the above information, the control means 103 determines that the frame candidate is the window frame, and controls the camera means 104 to control the photographing within the window frame. . Note that the shooting control of the control unit 103 may be automatically performed when the control unit 103 determines that the frame candidate is a window frame, or notifies the user of switching of the shooting mode by a display unit or the like. Then, the user may determine whether to perform this shooting control.

DESCRIPTION OF SYMBOLS 100 Imaging device 101 Imaging means 102 Frame candidate detection means 103 Control means 104 Camera means 105 Image processing means 106 Display data generation means 107 Display means 108 Imaging range selection means 109 Frame pattern comparison means 110 Sensor means 111 Lens means 112 Camera control means 113 Storage means 114 Image data feature detection means 115 Frame detection pattern data storage means 116 Comparison means 200 Initial shooting range 201, 202 Window frame 203 Shooting range 301 Left hand 302 Right hand 303, 304 Virtual rectangles 305, 306, 307, 308 Range 309 Right hand 401 Left hand 402 Virtual ellipse 403 Shooting range 501, 502 Image data ratio 503 Shooting range 504 Corrected shooting range 600 Shooting range 601 Window frames 602, 603 Corrected shooting range

Claims (9)

Imaging means for performing imaging and generating image data;
Frame candidate detection means for detecting the shape of a frame candidate for specifying a shooting range from the image data generated by the imaging means;
Control means for controlling the imaging means so as to shoot an imaging range specified by the frame candidate detected by the frame candidate detection means;
An imaging device comprising: The imaging device
Display data generating means for generating display data indicating the position of the frame candidate in the image data based on the image data and the frame candidate;
Display means for displaying an image based on the display data generated by the display data generating means;
A photographing range selecting means that allows a user to select the image displayed on the display means;
The control unit controls the imaging unit to shoot a shooting range specified by the frame candidate related to the selected image;
The imaging device according to claim 1. The frame candidate detection means is capable of detecting a plurality of the frame candidates,
The control means controls the imaging means so as to capture an imaging range specified by the frame candidate selected from the plurality of frame candidates;
The imaging device according to claim 2. The frame candidate detection means detects the shape or movement of the hand from the image data, and recognizes the shape of the frame candidate based on the shape or movement of the hand.
The imaging device according to claim 1. The frame candidate detection means recognizes the shape of the frame candidate as a closed region by determining the corners and sides of the virtual rectangle based on the shape of the hand,
The imaging device according to claim 4. The frame candidate detecting means recognizes the movement of the hand as a gesture, and changes the shape of the recognized frame candidate based on the gesture.
The imaging device according to claim 4 or 5. The frame candidate detection means recognizes the virtual frame as the shape of the frame candidate based on the motion of a hand drawing a virtual frame.
The imaging device according to claim 4. Processing image data to generate image data;
Detecting a shape of a frame candidate for specifying a shooting range from the generated image data;
Controlling the photographing device to photograph the photographing range specified by the frame candidate;
A method for controlling an imaging apparatus comprising: Processing image data to generate image data;
A process of detecting the shape of a frame candidate for specifying a shooting range from the generated image data;
A process for controlling the photographing device to photograph the photographing range specified by the frame candidate;
An imaging device control program that causes the imaging device to execute the above.

Images