JP2015046038A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device that hardly reduces operability even when a user is away from a screen, and enables a gesture operation.SOLUTION: An imaging device comprises: an image pickup element that photographs a subject; a hand detection part that detects a position of a hand of the subject from a subject image photographed by the image pickup element; an enlargement image generation part that generates an enlargement image enlarging an area including the hand detected by the hand detection part at an enlargement ratio in accordance with a size of the hand from the subject image photographed by the image pickup element; a display part that displays the enlargement image generated by the enlargement image generation part and a plurality of symbols superimposing the enlargement image, and is visually recognizable from the subject; and a function execution part that, in response to proximity of the hand in the enlargement image displayed by the display part to any of the plurality of symbols, executes a function corresponding to the symbol.

Description

  The present invention relates to an imaging apparatus.

  2. Description of the Related Art Conventionally, an apparatus capable of performing a function operation such as a cursor by a so-called gesture such as gesture or hand gesture is known. For example, Patent Document 1 discloses an information processing apparatus that detects a region of a user's hand from captured image data including an image of a subject so that the user can move the cursor in the screen by an operation using the hand. Have been described.

JP 2011-221787 A

  In the prior art, when the cursor in the screen is moved over the button by a hand gesture operation, the command assigned to the button is executed. However, when the user moves away from the screen, the command is displayed on the screen. It was difficult to perform detailed operations such as visually recognizing a cursor or button and aligning the positions of both.

The image pickup apparatus according to claim 1 is picked up by an image pickup device that picks up a subject image, a hand detection unit that detects a position of a hand of the subject from the subject image picked up by the image pickup device, and the image pickup device. A magnified image creating unit that creates an enlarged image obtained by enlarging an area including the hand detected by the hand detecting unit with an enlargement ratio corresponding to the size of the hand, and the enlarged image creating unit. A display unit that displays the enlarged image and a plurality of symbols superimposed on the enlarged image, and a hand in the enlarged image displayed by the display unit is one of the plurality of symbols. A function execution unit that executes a function corresponding to the symbol in response to the proximity.
The image pickup apparatus according to claim 7 displays an image pickup device for picking up a subject image, a subject image picked up by the image pickup device, a plurality of symbols superimposed on the subject image, and a cursor superimposed on the subject image. The hand detection unit detects the display unit that is visible from the subject, the hand detection unit that detects the position of the subject's hand from the subject image captured by the imaging device, and the cursor by the display unit. A cursor moving unit that moves the moving amount according to the amount of change in the position of the hand, and the cursor displayed by the display unit corresponding to the symbol when the cursor is close to one of the plurality of symbols. A function execution unit that executes a function to perform the function, and the cursor moving unit increases the amount of movement of the cursor as the hand detected by the hand detecting unit is smaller. And butterflies.

  According to the present invention, it is possible to provide an imaging device capable of hand gesture operation that does not deteriorate operability even when the user moves away from the screen.

1 is a block diagram illustrating a configuration of an imaging apparatus according to a first embodiment of the present invention. 1 is a perspective view of an imaging device 10. FIG. 4 is a diagram illustrating an example of a display screen of a liquid crystal monitor 24. FIG. It is a figure explaining the creation method of an enlarged image. It is a figure explaining the creation method of an enlarged image. It is a flowchart of the hand gesture operation process which the control part 23 performs. It is a block diagram which shows the structure of the imaging device which concerns on the 2nd Embodiment of this invention. 4 is a diagram illustrating an example of a display screen of a liquid crystal monitor 24. FIG.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the imaging apparatus according to the first embodiment of the present invention. The imaging device 10 is a so-called compact type digital camera integrated with a lens. The imaging apparatus 10 includes an imaging optical system 21, an imaging element 22, a control unit 23, a liquid crystal monitor 24, a memory card 25, an operation unit 26, a DRAM 27, and a flash memory 28.

  The photographing optical system 21 is composed of a plurality of lenses, and forms a subject image on the imaging surface of the imaging element 22. The photographing optical system 21 is a so-called zoom lens having a variable focal length. The controller 23 can zoom up and down the photographing optical system 21 by driving an actuator (not shown). In FIG. 1, the photographing optical system 21 is illustrated as one lens.

  The image pickup device 22 is an image pickup device such as a CMOS or a CCD, for example, and picks up a subject image formed by the photographing optical system 21 and outputs an image pickup signal. The control unit 23 is an electronic circuit that controls each unit of the imaging apparatus 10 and includes a CPU and its peripheral circuits. A predetermined control program is written in advance in the flash memory 28 which is a nonvolatile storage medium. The control unit 23 controls each unit by reading and executing a control program from the flash memory 28. This control program uses the DRAM 27, which is a volatile storage medium, as a work area.

  The liquid crystal monitor 24 is a display device using a liquid crystal panel. The control unit 23 causes the image sensor 22 to repeatedly capture a subject image every predetermined cycle (for example, 1/60 second). Then, various image processes are performed on the imaging signal output from the imaging element 22 to create a so-called through image, which is displayed on the liquid crystal monitor 24. In addition to the above-described through image, for example, a setting screen for setting shooting parameters is displayed on the liquid crystal monitor 24.

  The control unit 23 performs various image processing on the imaging signal output from the imaging element 22 to create captured image data, and stores the image data in a memory card 25 that is a portable storage medium. The operation unit 26 has various operation members such as push buttons, and outputs an operation signal to the control unit 23 in response to the operation members being operated.

  The control unit 23 includes a hand detection unit 23a, an enlarged image creation unit 23b, and a function execution unit 23c in software form. Each of these units is realized by software by the control unit 23 executing a predetermined control program stored in the flash memory 28. Each of these units can be configured as an electronic circuit.

  The hand detection unit 23 a detects the position of the hand of the subject from the subject image captured by the image sensor 22. The enlarged image creating unit 23b enlarges an enlarged region including the hand detected by the hand detecting unit 23a from the subject image captured by the image sensor 22 at an enlargement rate corresponding to the size of the hand (details later). Create a description. The function execution unit 23c executes a function corresponding to the icon in response to the hand in the enlarged image displayed on the liquid crystal monitor 24 approaching one of a plurality of icons (detailed later).

  FIG. 2 is a perspective view of the imaging apparatus 10. As shown in FIG. 2A, the housing of the imaging device 10 has a plate shape, and the liquid crystal monitor 24 is provided on the wide surface 40. Further, on another wide surface (not shown) facing the wide surface 40, a lens barrel (not shown) in which the photographing optical system 21 is built is provided. The subject is located in the direction indicated by the arrow x in FIG. 2A, that is, in the direction opposite to the display screen 51 of the liquid crystal monitor 24.

  In the following description, of the two wide surfaces of the housing of the imaging device 10, the wide surface 40 on which the liquid crystal monitor 24 is installed is referred to as the back surface, and the wide surface (not shown) on which the lens barrel is installed is referred to as the back surface. Called the front.

  The liquid crystal monitor 24 is configured to be rotatable by a shaft portion 42 provided at the upper part of the housing of the imaging device 10. In FIG. 2A, the liquid crystal monitor 24 is accommodated on the back surface of the imaging device 10. The user can turn the liquid crystal monitor 24 to the upper part of the imaging device 10 with the shaft portion 42 as a fulcrum.

  A state in which the liquid crystal monitor 24 is rotated to the maximum is shown in FIG. At this time, the display screen 51 of the liquid crystal monitor 24 faces the direction indicated by the arrow x in the drawing, that is, the same direction as the lens barrel. Therefore, when the imaging apparatus 10 is in the state shown in FIG. 2B, the person who is the subject can visually recognize the display screen 51. For example, when the imaging apparatus 10 performs a so-called live view display on the display screen 51, the person who is the subject can visually recognize his / her own image on the display screen 51.

  The housing of the imaging apparatus 10 is provided with a release button 43, a power button 44, and other buttons 45, 46, 47, 48, and 49 for performing various operations. These buttons are connected to the operation unit 26 described above, and the operation unit 26 outputs an operation signal to the control unit 23 in response to pressing of the button.

(Explanation of hand gesture operation)
When the liquid crystal monitor 24 faces the subject, that is, in the direction of the arrow x as illustrated in FIG. 2B, the control unit 23 sets the hand gesture operation mode for the imaging apparatus 10. When the hand gesture operation mode is set, a person who is a subject (a user who is a subject) can perform operations such as still image shooting and zoom operation by hand gestures (hand gesture). Note that even when the hand gesture operation mode is set, operations using the operation unit 26, such as taking a still image with a release switch, can be performed as usual.

  For example, when a photographer wants to take an image of himself / herself, the user takes the image pickup apparatus 10 with one hand and points the image pickup apparatus 10 toward himself / herself. At this time, it is difficult to operate an operation member provided on the back surface 40 of the imaging device 10 or the like. If the hand gesture operation mode is used, it is possible to perform shooting, zoom-in, or the like without operating an operation member provided on the housing.

  In addition, when the imaging device 10 is fixed with a tripod or the like, and shooting is performed away from the imaging device 10, shooting can be performed using a self-timer function or the like, but an operation such as shooting a movie or zooming in is performed. It is difficult. Even in such a case, if the hand gesture operation mode is used, it is possible to perform shooting, zoom-in, or the like without operating the operation member provided in the housing.

  When the hand gesture operation mode is set, the control unit 23 causes the image sensor 22 to repeatedly capture a subject image every predetermined cycle (for example, 1/60 second). Then, a through image is created from the imaging signal output from the imaging element 22 and displayed on the liquid crystal monitor 24. The hand detection unit 23a performs palm detection processing on the imaging signal that is the basis of the through image. Since the image pickup device 22 repeatedly outputs the image pickup signal at every predetermined cycle, the palm detection process by the hand detecting unit 23a is also repeatedly executed at every predetermined cycle. Note that the palm detection process may be performed on the through image, not on the imaging signal that is the basis of the through image. The execution period of the palm detection process may be longer than the imaging period. For example, the palm detection process may be performed only once for every two imaging operations.

  When the palm is detected by the hand detection unit 23a, the enlarged image creation unit 23b starts creating an enlarged image. The control unit 23 stops the creation of the through image, and instead displays the enlarged image created by the enlarged image creation unit 23 b on the liquid crystal monitor 24. In the following description, it is assumed that one palm is detected by the hand detection unit 23a. For example, when there are a plurality of palms, such as when a plurality of people are included in the shooting range, the same processing may be performed on any one palm. For example, the palm with the highest priority may be determined based on the result of the face recognition and the preset priority for each person, or the palm that can be detected first in the shooting screen is as follows. It is good also as performing the process demonstrated by.

  Note that when the hand gesture operation mode is set, the control unit 23 displays the through image and the enlarged image on the liquid crystal monitor 24 while being horizontally reversed. In the following description, the through image and the enlarged image are described as being displayed on the entire display screen, but the size of the through image and the enlarged image may be different from the size of the display screen. For example, a through image or an enlarged image may be displayed with a size that is slightly smaller than the size of the display screen.

  FIG. 3 is a diagram showing a display screen of the liquid crystal monitor 24 when a palm is detected in the hand gesture operation mode. The display screen 51 is a screen in which four icons 52a, 52b, 52c, and 52d, which are user interfaces (UI) for performing hand gesture operations, are superimposed on an enlarged image displayed on the entire screen. The icons 52a, 52b, 52c, and 52d are symbols corresponding to a zoom-up function, a still image release function, a zoom-down function, and a moving image release function, respectively.

  When a palm is detected for the first time, the enlarged image creating unit 23b sets an enlarged region including the palm 53 detected by the hand detecting unit 23a in the imaging signal that is the basis of the through image. The enlarged area is an area smaller than the photographing screen, with the center of gravity position of the detected palm 53 as the center. Thereafter, the enlarged image creating unit 23b extracts an image corresponding to the enlarged region from the imaging signal, and creates an enlarged image obtained by enlarging the image with an enlargement ratio corresponding to the size of the palm 53 detected first. Since the image pickup element 22 repeatedly outputs the image pickup signal at every predetermined cycle, the enlarged image creation unit 23b also repeatedly creates the enlarged image at every predetermined cycle.

  Note that the enlarged image may be created from the through image. Further, the enlarged image creation cycle may be longer than the imaging cycle. For example, an enlarged image may be created only once for every two imaging operations. In this case, the frame rate of the enlarged image is lower than the frame rate of the through image. In addition, the imaging cycle for creating the enlarged image may be different from the imaging cycle for creating the through image.

  The user (subject person) visually recognizes the display screen 51 shown in FIG. 3 and recognizes the positional relationship between the palm 53 reflected on the display screen 51 and the four icons 52a, 52b, 52c, and 52d. Then, the palm is moved in the direction of the icon corresponding to the desired function. When the palm 53 in the enlarged image overlaps any icon, the function execution unit 23c executes a function corresponding to the icon. For example, when the user puts the palm 53 on the icon 52b written as “still image release”, the function execution unit 23c shoots a still image.

  When some function is executed by the function execution unit 23c, the hand detection unit 23a cannot detect the palm 53, or when a predetermined time (for example, 5 seconds) elapses after the display of the enlarged image by the control unit 23 is started. The control unit 23 stops displaying the enlarged image and resumes displaying the through image. In addition, the enlarged image creation unit 23b stops creating the enlarged image.

  Next, an enlarged image created by the enlarged image creation unit 23b will be described in detail. Now, as shown in FIG. 4A, it is assumed that the subject person 54 is separated from the imaging device 10 by a distance D1. Here, when the subject person 54 turns his palm toward the imaging device 10, as shown in FIG. 4B, the palm 53 appears in the shooting screen 55 of the imaging device 22 with the width W1. The enlarged image creating unit 23b creates an enlarged image 57 shown in FIG. 4C so that the palm 53 has a width Z. The enlargement ratio P at this time is Z / W1. In FIG. 4C, for the sake of explanation, four icons 52a, 52b, 52c, and 52d are shown superimposed on the enlarged image 57, but actually, the enlarged image 57 has four icons 52a and 52b. , 52c, 52d are not included.

  An enlarged area 58 that is the basis of the enlarged image 57 is an area in the shooting screen 55 centered on the center of gravity of the palm 53. The width X1 of the enlarged region 58 is determined by dividing the width X2 of the enlarged image 57 by the magnification rate P. Similarly, the height Y1 of the enlarged region 58 is determined by dividing the height Y2 of the enlarged image 57 by the enlargement factor P.

  When the subject person 54 moves the palm by a certain distance in the real space, the palm 53 moves by the length L1 on the shooting screen 55. At this time, in the enlarged image 57, the palm 53 moves by a length M1 obtained by multiplying the length L1 by the enlargement ratio P = Z / W1.

  Next, as shown in FIG. 5A, it is assumed that the same subject person 54 as in FIG. 4A is separated from the imaging device 10 by a distance D2 longer than the distance D1. Here, when the subject person 54 directs the palm 53 toward the imaging device 10, as shown in FIG. 5 (b), the palm 53 appears on the photographing screen 55 of the image sensor 22 smaller than in FIG. 4 (b). That is, the width W2 of the palm 53 on the shooting screen 55 in FIG. 5B is smaller than the width W1 shown in FIG.

  The enlarged image creating unit 23b creates the enlarged image 57 shown in FIG. 5C so that the palm 53 has the width Z as in the case of FIG. The enlargement ratio P at this time is Z / W2. Further, the width X3 of the enlarged region 58 on which the enlarged image 57 is based is determined by dividing the width X2 of the enlarged image 57 by the enlargement ratio P. Similarly, the height Y3 of the enlarged region 58 is determined by dividing the height Y2 of the enlarged image 57 by the enlargement factor P.

  When the subject person 54 moves the palm in the real space by the same distance in the same direction as in FIG. 4B, the palm 53 moves by the length L2 on the photographing screen 55. This length L2 is shorter than the length L1 shown in FIG. At this time, in the enlarged image 57, the palm 53 moves by a length M2 obtained by multiplying the length L2 by the enlargement ratio P = Z / W2. This length M2 is substantially the same as the length M1 shown in FIG. That is, the enlarged image creating unit 23b determines the enlargement ratio P so that the moving distance of the palm 53 in the enlarged image 57 is the same if the moving distance of the palm in the real space is the same.

  This is to make the amount of palm movement necessary to execute each function constant. The farther the subject person 54 is from the imaging apparatus 10, the smaller the detection size of the palm 53. Therefore, even if the actual movement distance (in real space) of the palm is the same, the movement distance of the palm 53 on the shooting screen 55 is different between when the subject person 54 is close to the imaging device 10 and when the subject person 54 is far from the imaging device 10. Will change. Therefore, if the four icons 52 a, 52 b, 52 c, 52 d are simply superimposed on the through image and the subject person 54 is far from the imaging device 10, it becomes necessary to move the palm very greatly.

  As the palm 53 on the shooting screen 55 is smaller (the subject person 54 is farther), the enlargement ratio P of the enlarged image 57 is increased, so that the subject person 54 always has the same amount of hand gestures regardless of the shooting distance. It is possible to cause the function execution unit 23c to execute the functions 52c and 52d.

  FIG. 6 is a flowchart of the hand gesture operation process executed by the control unit 23. The process shown in FIG. 6 is included in a control program that the control unit 23 reads from the flash memory 28 and executes.

  First, in step S100, the control unit 23 determines whether or not the liquid crystal monitor 24 is rotated and is in the state shown in FIG. The control unit 23 repeatedly executes the process of step S100 until the liquid crystal monitor 24 rotates to the position shown in FIG. If the liquid crystal monitor 24 is rotating, the control unit 23 advances the process to step S110.

  In step S110, the control unit 23 causes the image sensor 22 to capture a subject image. In step S120, the control unit 23 creates a through image based on the imaging signal output from the imaging element 22 by the imaging in step S110. In step S130, the control unit 23 displays the through image created in step S120 on the display screen 51 of the liquid crystal monitor 24, and displays icons 52a, 52b, 52c, and 52d superimposed on the through image. In step S140, the hand detection unit 23a attempts to detect the palm 53 by performing known pattern matching or the like on the image signal output from the image sensor 22 by the image capturing in step S110. In step S150, the control unit 23 determines whether or not the palm 53 is detected from the imaging signal in step S140. If the palm 53 is not detected, the control unit 23 advances the process to step S110. On the other hand, when the palm 53 is detected, the control unit 23 advances the process to step S160.

  In step S160, the enlarged image creating unit 23b sets the position and range of the enlarged region 58 and sets the enlargement ratio P of the enlarged image 57 according to the position and size of the palm 53 detected in step S140.

  In step S <b> 170, the control unit 23 causes the image sensor 22 to capture a subject image. In step S180, the enlarged image creating unit 23b creates the enlarged image 57 based on the imaging signal output from the imaging element 22 by the imaging in step S170. In step S190, the control unit 23 displays the enlarged image 57 created in step S180 on the display screen 51 of the liquid crystal monitor 24, and displays icons 52a, 52b, 52c, and 52d superimposed on the enlarged image 57. In step S200, the hand detection unit 23a attempts to detect the palm 53 by performing known pattern matching or the like on the image signal output from the image sensor 22 by the image capturing in step S170. In step S210, the control unit 23 determines whether or not the palm 53 is detected from the imaging signal in step S200. If the palm 53 is not detected, the control unit 23 advances the process to step S110. On the other hand, if the palm 53 has been detected, the control unit 23 advances the process to step S220.

  In step S220, the control unit 23 determines whether or not a predetermined time (for example, 5 seconds) has elapsed since the execution of step S160. If the predetermined time has elapsed, the control unit 23 advances the process to step 110. On the other hand, when the predetermined time has not elapsed, the control unit 23 advances the process to step S230.

  In step S230, the function execution unit 23c determines whether or not the palm 53 detected in step S200 overlaps any of the four icons 52a, 52b, 52c, and 52d. If the palm 53 is not overlapped, the function execution unit 23c advances the process to step S170. On the other hand, if the palm 53 overlaps any icon, the function execution unit 23c advances the process to step S240. In step S240, the function execution unit 23c executes a function corresponding to the icon that overlaps the palm 53.

According to the imaging apparatus according to the first embodiment described above, the following operational effects can be obtained.
(1) The enlarged image creating unit 23b enlarges the enlarged region 58 including the palm detected by the hand detecting unit 23a from the subject image picked up by the image pickup device 22 at an enlargement rate P corresponding to the size of the palm 53. The enlarged image 57 is created. The function execution unit 23c executes a function corresponding to the icon when the palm 53 in the enlarged image 57 displayed on the liquid crystal monitor 24 comes close to any of the four icons 52a, 52b, 52c, and 52d. . According to the imaging device 10 having the above configuration, the operability is not deteriorated even when the user moves away from the screen.

(2) The enlarged image creation unit 23b creates an enlarged image 57 centered on the initial position of the palm 53 detected by the hand detection unit 23a. Since it did in this way, the user can always consider the base point of hand gesture operation as the center of a screen, and operativity improves.

(3) The magnified image creation unit 23b creates a magnified image 57 having a larger magnification rate P as the palm 53 detected by the hand detection unit 23a is smaller. Since it did in this way, even if it is a case where a user moves away from a screen, operativity does not fall.

(4) The liquid crystal monitor 24 displays the enlarged image 57 on the entire display screen 51. Since it did in this way, the enlarged image 57 can be shown to a user with sufficient visibility.

(Second Embodiment)
Hereinafter, the imaging device 110 according to the second embodiment of the present invention will be described. In the following description, differences from the imaging device 10 according to the first embodiment will be mainly described, and the same parts as those in the first embodiment are the same as those in the first embodiment. Reference numerals are assigned and description is omitted.

  FIG. 7 is a block diagram showing a configuration of the imaging apparatus 110 according to the second embodiment of the present invention. The imaging device 110 has a configuration in which the control unit 23 of the imaging device 10 according to the first embodiment is replaced with a control unit 123 different from this.

  The control unit 123 includes a cursor movement unit 123b, a function execution unit 123c, and a hand detection unit 23a that is the same as that of the first embodiment, depending on the software form. Each of these units is realized by software when the control unit 123 executes a predetermined control program stored in the flash memory 28.

  The cursor moving unit 123b moves a cursor (described later) displayed on the liquid crystal monitor 24 according to the movement of the palm 53 detected by the hand detecting unit 23a. The function execution unit 123c executes a function corresponding to the icon when a cursor (described later) comes close to any of the icons displayed on the liquid crystal monitor 24.

(Explanation of hand gesture operation)
When the liquid crystal monitor 24 faces the subject, that is, in the direction of the arrow x as illustrated in FIG. 2B, the control unit 123 sets the hand gesture operation mode in the imaging device 110. Hereinafter, the hand gesture operation mode of this embodiment will be described in detail.

  FIG. 8 is a diagram showing a display screen of the liquid crystal monitor 24 when the palm 53 is detected in the hand gesture operation mode. When the palm 53 is detected for the first time, the control unit 123 displays the cursor 61 at the position where the palm 53 is detected. Thereafter, the hand detection unit 23a repeatedly detects the palm 53.

  The cursor moving unit 123b moves the cursor 61 according to the movement of the palm 53 when the position of the palm 53 detected by the hand detecting unit 23a has changed from the previous detection, that is, when the palm 53 has moved. Let Thereby, the cursor 61 follows the movement of the palm 53 on the display screen 51 of the liquid crystal monitor 24.

  The user (subject person 54) recognizes the positional relationship between the cursor 61 and the four icons 52a, 52b, 52c, and 52d by visually recognizing the display screen 51 shown in FIG. Then, the palm 53 is moved in the direction of the icon corresponding to the desired function. The cursor 61 moves following the movement of the palm 53. When the cursor 61 overlaps any icon on the display screen 51, the function execution unit 23c executes a function corresponding to the icon. For example, when the cursor 61 overlaps the icon 52 a written “Zoom-up”, the function execution unit 23 c zooms in the photographing optical system 21 and increases the focal length of the photographing optical system 21.

  If any function is executed by the function execution unit 23c or the hand detection unit 23a cannot detect the palm 53, the control unit 23 stops displaying the cursor 61 and the icons 52a, 52b, 52c, and 52d.

  Next, the movement process of the cursor 61 by the cursor moving unit 123b will be described in detail. Now, as shown in FIG. 4A, it is assumed that the subject person 54 is separated from the imaging device 10 by a distance D1. Here, when the subject person 54 turns his palm toward the imaging device 10, as shown in FIG. 4B, the palm 53 appears in the shooting screen 55 of the imaging device 22 with the width W1.

When the subject person 54 moves the palm by a certain distance in the real space, the palm 53 moves by the length L1 on the shooting screen 55. At this time, the cursor moving unit 123b moves the cursor 61 on the display screen 51 by the moving distance S1 determined by the following equation (1). Here, C is a predetermined constant representing the sensitivity of the cursor 61 to the movement of the palm 53. The moving direction of the cursor 61 is the same as the moving direction of the palm 53.
S1 = C × L1 / W1 (1)

  Next, as shown in FIG. 5A, it is assumed that the same subject person 54 as in FIG. 4A is separated from the imaging device 110 by a distance D2 longer than the distance D1. Here, when the subject person 54 turns his palm toward the imaging device 10, as shown in FIG. 5B, the palm 53 appears on the shooting screen 55 of the image sensor 22 smaller than in FIG. 4B. That is, the width W2 of the palm 53 on the shooting screen 55 in FIG. 5B is smaller than the width W1 shown in FIG.

When the subject person 54 moves the palm in the real space by the same distance in the same direction as in FIG. 4B, the palm 53 moves by the length L2 on the photographing screen 55. This length L2 is shorter than the length L1 shown in FIG. At this time, the cursor moving unit 123b moves the cursor 61 on the display screen 51 by the moving distance S2 determined by the following equation (2). Here, C is the same constant as the above-described formula (1).
S2 = C × L2 / W2 (2)

  That is, the cursor moving unit 123b determines the moving distance of the cursor 61 so that the moving distance of the cursor 61 on the display screen 51 is the same if the moving distance of the palm in the real space is the same.

According to the imaging apparatus according to the second embodiment described above, the following operational effects can be obtained.
(1) The cursor moving unit 123b moves the cursor 61 displayed on the liquid crystal monitor 24 by a moving amount corresponding to the amount of change in the position of the palm 53 detected by the hand detecting unit 23a. The function execution unit 123c executes the function corresponding to the icon 61 when the cursor 61 displayed on the liquid crystal monitor 24 comes close to any of the four icons 52a, 52b, 52c, and 52d. The cursor moving unit 123b increases the amount of movement of the cursor 61 as the palm 53 detected by the hand detecting unit 23a is smaller. According to the imaging apparatus 110 having the above configuration, the operability is not deteriorated even when the user moves away from the screen.

  The following modifications are also within the scope of the present invention, and one or a plurality of modifications can be combined with the above-described embodiment.

(Modification 1)
In the first embodiment, the enlarged image 57 may be displayed smaller than the display screen 51 of the liquid crystal monitor 24. For example, a subject image (through image) captured by the image sensor 22 is displayed on the entire surface of the display screen 51 of the liquid crystal monitor 24, and an enlarged image 57 of a quarter size of the display screen 51 is superimposed on a part thereof. It may be displayed. In this way, by displaying the enlarged image 57 smaller than the display screen 51 superimposed on the subject image, it is possible to continuously check the composition or the like during the gesture operation. Conversely, an enlarged image 57 smaller than the display screen 51 can be displayed by being superimposed on the enlarged image 57 displayed on the entire surface of the display screen 51.

  As described above, when the enlarged image 57 smaller than the display screen 51 is displayed, the display unit of the enlarged image 57 may be set as appropriate by the control unit 23. For example, if the control unit 23 is configured so that the enlarged image 57 is displayed so as not to overlap with a person corresponding to the palm 53 (a person with the palm 53 facing the imaging device 10), even during a gesture operation. It becomes possible to confirm the posture and facial expression of the person.

(Modification 2)
In the second embodiment, the cursor moving unit 123b always increases the amount of movement of the cursor 61 as the size of the palm 53 detected by the hand detecting unit 23a is smaller. The cursor 61 is configured to be movable. Alternatively, the cursor moving unit 123b may determine the amount of movement of the cursor 61 using information other than the size of the palm 53.

  For example, even if the shooting distance is the same, it is expected that the size of the palm 53 on the shooting screen 55 is different between the case where the subject person 54 who turns the palm toward the imaging device 110 is a child and the case where the subject person 54 is an adult. The Therefore, the control unit 123 is provided with an age estimation unit that estimates the age of the subject person 54 corresponding to the palm 53 (the person with the palm facing the imaging device 110), and the cursor moving unit 123b is estimated by the age estimation unit. Depending on the age, the amount of movement of the cursor 61 may be changed. The age estimation unit is configured to detect whether the face of the person is a child's face or an adult's face by, for example, known pattern matching. Thereby, it is possible to estimate whether the person is a child or an adult. If the subject person is a child, the cursor moving unit 123b sets the value of the constant C in the above formulas (1) and (2) to be larger than usual so that the cursor 61 moves more greatly. In this way, the cursor can be moved in consideration of the size of the palm 53 associated with the age difference, and the operability of the imaging device 110 is improved.

(Modification 3)
In the first embodiment, the reason why the function execution unit 23c executes various functions is that the palm 53 overlaps one of the icons 52a, 52b, 52c, and 52d. This is an example of the trigger, and the function execution unit 23c only needs to be configured to execute a function when the palm 53 is close to the icon, and the palm 53 does not necessarily overlap the icons 52a, 52b, 52c, and 52d. It does not have to be. For example, the function may be executed when the palm 53 moves a certain distance toward the icon, or the function may be executed when a rectangle circumscribing the palm 53 and a rectangle circumscribing the icon overlap.

(Modification 4)
In the first embodiment, the control unit 23 detects the position of the hand of the subject by detecting the palm 53 from the subject image picked up by the image sensor 22. The controller 23 may detect the position of the subject's hand by detecting something other than the palm 53. For example, the position of the hand of the subject may be detected by detecting fingers and wrists by pattern matching. Further, it may be possible to detect a hand wearing a glove or the like. Even when the control unit 23 is configured as described above, the present invention can be applied as long as it is possible to detect that the hand of the subject is close to the icons 52a, 52b, 52c, and 52d. It is.

  Furthermore, the present invention is not limited to hand gestures. If a predetermined gesture (gesture) performed by the subject is detected in the same manner as the above-described hand gesture (hand gesture), it is possible to realize the operation of the imaging apparatus using a part other than the hand.

(Modification 5)
There may be more or less than four icons 52a, 52b, 52c, and 52d provided in the screen. The arrangement can also be determined arbitrarily, and may be arranged at a place other than the four corners of the display screen as in the above-described embodiments. Further, the function assigned to each icon may be different from those exemplified in the above-described embodiments, and is a function that can be executed by the function execution units 23c and 123c (for example, reproduction mode setting, on / off of the auxiliary light emitting device, etc.). Anything is acceptable. A user may be allowed to assign an arbitrary function to each icon. Further, the icons 52a, 52b, 52c, and 52d including characters representing each function have been described as an example. However, a different symbol (for example, a picture representing a function) may be used.

(Modification 6)
In the above description, the embodiment in which the present invention is applied to a lens-integrated digital camera has been described. However, the present invention is not limited to such an embodiment. For example, a so-called single-lens reflex digital camera capable of exchanging lenses is used. It is also possible to apply the present invention to a digital camera with no interchangeable lens that does not have a reflex mirror.

  As long as the characteristics of the present invention are not impaired, the present invention is not limited to the above-described embodiments, and other forms conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention. .

DESCRIPTION OF SYMBOLS 10,110 ... Imaging device, 21 ... Imaging optical system, 22 ... Imaging device, 23 ... Control part, 23a ... Hand detection part, 23b ... Enlarged image creation part, 23c, 123c ... Function execution part, 24 ... Liquid crystal monitor, 25 ... Memory card, 26 ... Operation unit, 27 ... DRAM, 28 ... Flash memory, 52a, 52b, 52c, 52d ... Icon, 123b ... Cursor moving unit

Claims (9)

An image sensor for capturing a subject image;
A hand detection unit that detects the position of the hand of the subject from the subject image captured by the imaging device;
An enlarged image creation unit that creates an enlarged image obtained by enlarging an area including the hand detected by the hand detection unit at an enlargement rate according to the size of the hand from the subject image captured by the imaging device;
A display unit that displays the magnified image created by the magnified image creation unit and a plurality of symbols superimposed on the magnified image;
A function execution unit that executes a function corresponding to the symbol in response to a hand in the enlarged image displayed by the display unit approaching any of the plurality of symbols;
An imaging apparatus comprising: The imaging device according to claim 1,
The enlarged image creation unit creates the enlarged image centered on the initial position of the hand detected by the hand detection unit. The imaging device according to claim 1 or 2,
The enlarged image creating unit creates the enlarged image having a larger magnification rate as the hand detected by the hand detecting unit is smaller. In the imaging device according to any one of claims 1 to 3,
The display unit displays the enlarged image on the entire surface of a display screen. In the imaging device according to any one of claims 1 to 3,
The display device displays the subject image picked up by the image sensor on the entire surface of the display screen, and displays the enlarged image smaller than the display screen so as to be superimposed on the subject image. The imaging apparatus according to claim 5,
The said display part displays the said enlarged image so that it may not overlap with the person corresponding to the hand detected by the said hand detection part. An image sensor for capturing a subject image;
A display unit that is visible from the subject, and displays a subject image captured by the imaging device, a plurality of symbols superimposed on the subject image, and a cursor superimposed on the subject image;
A hand detection unit that detects the position of the hand of the subject from the subject image captured by the imaging device;
A cursor moving unit that moves the cursor by the display unit by a moving amount corresponding to the amount of change in the position of the hand detected by the hand detecting unit;
A function execution unit that executes a function corresponding to the symbol when the cursor displayed by the display unit approaches one of the plurality of symbols;
The imaging apparatus characterized in that the cursor movement unit increases the movement amount of the cursor as the hand detected by the hand detection unit is smaller. The imaging apparatus according to claim 7,
An age estimation unit for estimating the age of a subject corresponding to the hand detected by the hand detection unit;
The imaging apparatus according to claim 1, wherein the cursor moving unit changes the amount of movement of the cursor according to the age estimated by the age estimating unit. The imaging device according to claim 8,
The age estimation unit estimates the age of a subject based on the face of the subject.

Images