JP2010114842A - Image capturing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image capturing apparatus with which a picture intended by a photographer can easily be taken by using visible light communication. <P>SOLUTION: The image capturing apparatus includes a face position specifying unit for specifying a position of a face in a photographic image, a face recognition unit for recognizing the position of the face included in the photographic image, a position decision unit for determining a positional relationship between the position specified by the face position specifying unit and the position recognized by the face recognition unit, a data modulation unit for modulating information based on the decision result of the position decision unit, and a visible light emission unit for emitting a visible light on which the information modulated by the data modulation unit is superimposed. As a result, the picture intended by a photographer can easily be taken by using the visible light communication. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method, and particularly relates to an imaging apparatus having a visible light communication function.

  In the field of imaging devices such as digital still cameras, LEDs (Light Emitting Diodes) are used to emit auxiliary light that assists shooting in order to reduce power consumption and reduce the size and weight of the device. Are beginning to be used. And the visible light communication technique which superimposes and transmits information on the light emitted from the LED has started to be used in the field of imaging devices (see, for example, Patent Documents 1 and 2).

  When using a digital still camera to photograph yourself, there is a method of photographing in a self-timer mode after fixing the digital still camera on a tripod or table and determining the angle. In addition, when trying to photograph one's own image, there is a method in which a face detection function is incorporated in a digital still camera and automatic photographing is started when the subject's face becomes a smile.

JP 2007-312204 A JP 2007-295446 A

  However, when the self-timer mode is used to photograph yourself after fixing the digital still camera and determining the angle, it is difficult to photograph so that the face comes to a desired position. In other words, when shooting in the self-timer mode, it is often possible to finally shoot a desired image by repeating the shooting by reciprocating between the camera and the standing position many times and confirming the shot image many times. There was a problem that it took time. Also, even when the subject's condition is detected and automatic shooting is performed, the photographer cannot determine his / her position, and the background is hidden even when the face is in focus. There was a problem that it was difficult to take pictures as intended.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is a new and improved technique capable of easily taking a photograph as intended using visible light communication. Another object of the present invention is to provide an imaging apparatus and an imaging method.

  In order to solve the above problem, according to an aspect of the present invention, a face position specifying unit that specifies a face position in a captured image, a face recognition unit that recognizes the position of a face included in the captured image, and a face position A position determination unit that determines the positional relationship between the position specified by the specification unit and the position recognized by the face recognition unit, a data modulation unit that modulates information based on the determination result in the position determination unit, and a data modulation unit An imaging device is provided that includes a visible light emitting unit that emits visible light on which modulated information is superimposed.

  According to this configuration, the face position specifying unit specifies the position of the face in the captured image, and the face recognition unit recognizes the position of the face included in the captured image. Then, the position determination unit determines the positional relationship between the position specified by the face position specification unit and the position recognized by the face recognition unit, the data modulation unit modulates information based on the determination result in the position determination unit, The visible light emitting unit emits visible light on which the information modulated by the data modulating unit is superimposed. As a result, face recognition processing is performed on the image to be imaged, and data is generated according to the positional relationship between the face position recognized as a result of the face recognition processing and the position of the face specified in advance. By transmitting the data by optical communication, it is possible to easily take a photograph as intended using visible light communication.

  As a result of the determination by the position determination unit, if the position specified by the face position specifying unit and the position recognized by the face recognition unit match, the data modulation unit modulates information to start shooting. Also good.

  The position determination unit emits visible light on which information indicating that the visible light emitting unit starts photographing is superimposed, and then determines the positional relationship between the position specified by the face position specifying unit and the position recognized by the face recognition unit. If the position specified by the face position specifying unit does not match the position recognized by the face recognizing unit as a result of the determination by the position determining unit, the data modulating unit Information may be modulated.

  As a result of the determination by the position determination unit, if the position specified by the face position specifying unit and the position recognized by the face recognition unit do not match, the data modulation unit modulates information for moving the face position May be.

  In order to solve the above problem, according to another aspect of the present invention, a face position specifying step for specifying a face position in a captured image, and a face recognition step for recognizing the position of a face included in the captured image, A position determination step for determining a positional relationship between the position specified in the face position specification step and the position recognized in the face recognition step, a data modulation step for modulating information based on the determination result in the position determination step, and data There is provided an imaging method including a visible light emission step of emitting visible light on which information modulated in the modulation step is superimposed.

  According to this configuration, the face position specifying step specifies the position of the face in the captured image, and the face recognition step recognizes the position of the face included in the captured image. The position determination step determines the positional relationship between the position specified in the face position specification step and the position recognized in the face recognition step, the data modulation step modulates information based on the determination result in the position determination step, The visible light emitting step emits visible light on which the information modulated in the data modulation step is superimposed. As a result, face recognition processing is performed on the image to be imaged, and data is generated according to the positional relationship between the face position recognized as a result of the face recognition processing and the position of the face specified in advance. By transmitting the data by optical communication, it is possible to easily take a photograph as intended using visible light communication.

  As described above, according to the present invention, it is possible to provide a new and improved imaging apparatus and imaging method capable of easily taking a photograph as intended using visible light communication.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  First, the configuration of an imaging apparatus according to an embodiment of the present invention will be described. FIG. 1 is an explanatory diagram illustrating a configuration of an imaging apparatus 100 according to an embodiment of the present invention. Hereinafter, the configuration of the imaging apparatus 100 according to the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 5, the imaging apparatus 100 according to the first embodiment of the present invention includes a zoom lens 102, a diaphragm 104, a focus lens 106, driving devices 102a, 104a, and 106a, and a CMOS image sensor 108. An amplifier integrated CDS (Correlated Double Sampling) circuit 110, an A / D converter 112, an image input controller 114, an image signal processing unit 116, a compression processing unit 120, and an LCD (Liquid Crystal Display) driver. 122, LCD 124, control unit 128, operation unit 132, memory 134, VRAM (Video Random Access Memory) 136, media controller 138, recording medium 140, and motor driver 142a. 142b, and 142c, an LED driver 156, configured to include a LED 158, a.

  The zoom lens 102 is a lens in which the focal length is continuously changed by being moved back and forth in the optical axis direction by the driving device 102a. The zoom lens 102 changes the size of the subject and shoots. The diaphragm 104 adjusts the amount of light entering the CMOS image sensor 108 by the driving device 104a when taking an image. The focus lens 106 adjusts the focus of the subject by being moved back and forth in the optical axis direction by the driving device 106a. In the present embodiment, a focus evaluation value is obtained by performing exposure control over a plurality of exposure times while driving the focus lens 106 from a long distance to a short distance.

  In this embodiment, only one zoom lens 102 and focus lens 106 are shown, but the number of zoom lenses 102 may be two or more, and the number of focus lenses 106 may be two or more. Good.

  The CMOS image sensor 108 is an example of an XY address type image sensor of the present invention, and is an element for converting light incident from the zoom lens 102, the diaphragm 104, and the focus lens 106 into an electrical signal. In this embodiment, the incident light is controlled by the electronic shutter to adjust the time for extracting the electric signal. However, the time for extracting the electric signal may be adjusted by controlling the incident light using the mechanical shutter.

  The CDS circuit 110 is a circuit in which a CDS circuit that is a kind of sampling circuit that removes noise from the electrical signal output from the CMOS image sensor 108 and an amplifier that amplifies the electrical signal after removing the noise are integrated. is there. In the present embodiment, the imaging apparatus 100 is configured using a circuit in which a CDS circuit and an amplifier are integrated. However, the CDS circuit and the amplifier may be configured as separate circuits.

  The A / D converter 112 converts the electrical signal generated by the CMOS image sensor 108 into a digital signal, and generates raw image data.

  The image input controller 114 controls input of raw image data generated by the A / D converter to the memory 134.

  The image signal processing unit 116 adjusts the light amount gain correction and the white balance for the raw image data obtained from the CMOS image sensor 108. The image signal processing unit 116 has a function as an exposure data acquisition unit of the present invention, and acquires exposure data of a photographed image. The exposure data includes a focus evaluation value (AF evaluation value) and an AE (Auto Exposure) evaluation value, and the image signal processing unit 116 calculates the focus evaluation value and the AE evaluation value.

  The compression processing unit 120 compresses the image whose light amount gain correction and white balance adjustment have been performed by the image signal processing unit 116 into image data of an appropriate format. The image compression format may be a reversible format or an irreversible format. As an example of a suitable format, you may convert into a JPEG (Joint Photographic Experts Group) format and a JPEG2000 format.

  The LCD 124 displays a live view display before photographing operation, various setting screens of the imaging apparatus 100, and photographed images. Display of image data and various information of the imaging apparatus 100 on the LCD 124 is performed via the LCD driver 122.

  The control unit 128 issues a signal-related command to the CMOS image sensor 108, the CDS circuit 110, or the like, or issues an operation-related command for the operation of the operation unit 132. In the present embodiment, only one control unit is included, but a signal-related command and an operation-related command may be executed by separate control units (for example, divided into a CPU and a DSP). .

  The operation unit 132 is provided with members for operating the imaging apparatus 100 and performing various settings at the time of shooting. The members arranged in the operation unit 132 may include a power button, a cross key and a selection button for selecting a shooting mode, a shutter button for starting a shooting operation of the subject, and the like.

  The memory 134 temporarily stores captured images. The memory 134 has a storage capacity sufficient to store a plurality of images. Reading and writing of images to and from the memory 134 is controlled by the image input controller 114. As the memory 134, for example, an SDRAM (Synchronous Dynamic Random Access Memory) may be used as shown in FIG.

  The VRAM 136 holds contents displayed on the LCD 124, and the resolution and the maximum number of colors of the LCD 124 depend on the capacity of the VRAM 136.

  The recording medium 140 is an example of an image recording unit, and records captured images and images synthesized by the image synthesis unit 118. Input / output to / from the recording medium 140 is controlled by the media controller 138. As the recording medium 140, a memory card that is a card-type storage device that records data in a flash memory can be used.

  The motor drivers 142a, 142b, and 142c control the driving devices 102a, 104a, and 106a that operate the zoom lens 102, the diaphragm 104, and the focus lens 106. By operating the zoom lens 102, the diaphragm 104, and the focus lens 106 via the motor drivers 142a, 142b, and 142c, the size of the subject, the amount of light, and the focus are adjusted.

  The LED driver 156 supplies current to the LED 158. The LED 158 is an example of the visible light emitting unit of the present invention, and emits light upon receiving a current supplied from the LED driver 156. The LED 158 receives light from the LED driver 156 and emits light, so that the subject can be irradiated with light.

  Only one LED 158 that emits the same color may be provided, or a plurality of LEDs 158 that emit the same color may be provided. Furthermore, the imaging device of the present invention may further include LEDs that emit light in different colors (for example, three primary colors of red, blue, and green).

  And the imaging device 100 concerning this embodiment is provided with the visible light communication function which transmits information with the visible light which LED158 emits. The imaging apparatus 100 can transmit information superimposed on visible light by controlling the light emission pattern of the LED 158 in the control unit 128.

  The control unit 128 described above includes a timing generator (TG) 144, a face position designation unit 146, a face recognition unit 148, a position determination unit 150, and a data modulation unit 152.

  The timing generator 144 inputs a timing signal to the CMOS image sensor 108. The shutter speed is determined by the timing signal from the timing generator 144. That is, the drive of the CMOS image sensor 108 is controlled by the timing signal from the timing generator 144, and the image signal from the subject is incident within the time that the CMOS image sensor 108 is driven, so that the electrical signal that is the basis of the image data is generated. Generated.

  The face position designating unit 146 designates the position of the face in the image to be captured by the image capturing apparatus 100. The position of the face in the image to be imaged by the imaging apparatus 100 can be designated by the photographer's operation, and the face position is designated by the face position designation unit according to the operation of the photographer.

  The face recognition unit 148 recognizes the position of a face included in an image to be captured by the image capturing apparatus 100. The face position in the image to be imaged by the imaging apparatus 100 is designated in advance by the face position designation unit 146, and the face recognition unit 148 recognizes the position of the face included in the image to be imaged by the imaging apparatus 100. Thus, it is possible to determine whether or not the face is in a position desired by the photographer.

  The position determination unit 150 determines the positional relationship between the face position designated by the face position designation unit 146 and the face position recognized by the face recognition unit 148. The content of data to be modulated by the data modulation unit 152 described later is determined by the determination result of the position determination unit 150.

  When the position determination unit 150 determines that the face position specified by the face position specifying unit 146 matches the face position recognized by the face recognition unit 148, the control unit 128 displays the data modulation unit. 152 is instructed to modulate the information indicating that the position is correct. On the other hand, if the position determination unit 150 determines that the face position specified by the face position specifying unit 146 and the face position recognized by the face recognition unit 148 do not match, the control unit 128 Instructs the modulation unit 152 to modulate information indicating that the positions are different.

  Note that the positional relationship determination processing in the position determination unit 150 does not start immediately after the face recognition unit 148 can recognize the face, but the face position recognized as a result of the face recognition processing in the face recognition unit 148. May be started at a point in time that does not move beyond a predetermined range for a predetermined time.

  The data modulation unit 152 modulates information corresponding to the determination result of the position determination unit 150 into visible light communication data. As described above, when the position determination unit 150 determines that the face position specified by the face position specifying unit 146 matches the face position recognized by the face recognition unit 148, the control unit 128. Based on the instruction, the information indicating that the position is correct is modulated. If the position determination unit 150 determines that the face position designated by the face position designation unit 146 and the face position recognized by the face recognition unit 148 do not match, the control unit 128 instructs Based on this, the information indicating that the positions are different is modulated. Details of specific information will be described later. In addition, the modulation method to the data for visible light communication is not directly related to the present invention, and therefore a detailed description is omitted here.

  The configuration of the imaging apparatus 100 according to the embodiment of the present invention has been described above using FIG. Next, the operation of the imaging apparatus 100 according to an embodiment of the present invention will be described.

  FIG. 2 is a flowchart for explaining the operation of the imaging apparatus 100 according to the embodiment of the present invention. Hereinafter, the operation of the imaging apparatus 100 according to the embodiment of the present invention will be described with reference to FIG.

  In order to photograph one's own image using the imaging apparatus 100 according to the embodiment of the present invention, first, a photographing place is selected, and the position of the face in the photographed image is designated by operation of the imaging apparatus 100 (step S102). .

  FIG. 3 is an explanatory diagram for explaining an example in which the position of the face in the photographed image is designated using the imaging device 100. FIG. 3 shows a state in which a face frame 162 for setting the position of the subject's face is displayed on the LCD 124. The face frame 162 can be moved on the LCD 124 by using the up / down / left / right buttons 132b with respect to the image displayed on the LCD 124 of the imaging apparatus 100 in the live view. Further, the size of the face frame can be changed using the zoom button 132c. The operation of the face frame 162 is controlled by the face position designation unit 146.

  When the position of the face is specified in step S102, the operation mode of the imaging apparatus 100 is subsequently shifted to the shooting determination mode (step S104). In the present embodiment, the shooting determination mode is performed by performing face recognition processing on an image that enters the imaging apparatus 100 through the zoom lens 102, the diaphragm 104, and the focus lens 106, and the face position exists at a predetermined position. In this case, it is a mode in which shooting is automatically started. You may make it transfer to imaging | photography judgment mode, for example by operation of the shutter button 132a and the up / down / left / right button 132b by the photographer.

  When the operation mode of the imaging apparatus 100 is shifted to the shooting determination mode in step S104, the face recognition unit 148 performs face recognition on an image that enters the imaging apparatus 100 through the zoom lens 102, the diaphragm 104, and the focus lens 106. Execute the process. An image that enters the imaging apparatus 100 through the zoom lens 102, the diaphragm 104, and the focus lens 106 may be displayed on the LCD 124 as a live view.

  Then, the position determination unit 150 detects a shift between the face position obtained by executing the face recognition processing by the face recognition unit 148 and the position of the face frame specified in step S102 (step S106). Then, as a result of the determination in step S106, the position determination unit 150 determines whether the face position obtained by executing the face recognition process in the face recognition unit 148 matches the face position specified in step S102. (Step S108). Note that the positional relationship determination processing in the position determination unit 150 in step S108 does not start immediately after the face recognition unit 148 can recognize the face, but is recognized as a result of the face recognition processing in the face recognition unit 148. It may be started when the position of the face that has been moved does not move beyond a predetermined range for a predetermined time.

  FIG. 4 is an explanatory diagram illustrating an example of the determination of the position of the face of the subject by the imaging apparatus 100. In FIG. 4, the face detection process is performed on the image displayed on the LCD 124 by entering the imaging apparatus 100 through the zoom lens 102, the diaphragm 104, and the focus lens 106, and the detected face and the face frame 162 specified in advance are displayed. The positional relationship will be described. In the example illustrated in FIG. 4, the position of the face detected by the face detection process is shifted to the left from the position of the face frame 162.

  As a result of the determination in step S108, the position of the face obtained by executing the face recognition processing by the face recognition unit 148 does not match the position of the face frame specified in step S102, and is specified in step S102. If there is no face at the position of the face frame, the data modulation unit 152 modulates data for notifying the subject of the movement of the face position, and generates visible light communication data (step S110). . The data for notifying the movement of the face position is generated by, for example, characters, images, sounds, and the like. For example, when notifying the subject of the movement of the face position by characters, the visible light communication data is generated by modulating character data such as “right” and “left”. Further, for example, when notifying the subject of the movement of the face position by an image, visible light communication data is generated by modulating image data such as a right-pointing or left-pointing arrow. Further, for example, when notifying the subject of the movement of the face position by voice, voice data such as “right” and “left” is modulated to generate visible light communication data.

  In addition, even when a face is present at the position of the face frame specified in step S102, if the face is too large relative to the face frame, the position determination unit 150 causes the person to be photographed to the imaging apparatus 100. You may decide that you are too close. In such a case, the control unit 128 instructs the data modulation unit 152 to modulate data for prompting the user to leave the imaging apparatus 100.

  In addition, even when a face is present at the position of the face frame specified in step S102, if the face is too small with respect to the face frame, the position determination unit 150 causes the subject to move from the imaging device 100. You may decide that you are too far away. In such a case, the control unit 128 instructs the data modulation unit 152 to modulate data for prompting the data modulation unit 152 to approach the imaging device 100.

  When two or more faces are detected as a result of executing the face recognition processing by the face recognition unit 148, the face closest to the position of the face frame specified in step S102 is selected among the detected faces. The position determination process may be performed on the face closest to the position of the face frame specified in step S102.

  In addition, when two or more faces are detected as a result of the face recognition processing performed by the face recognition unit 148, the data modulation unit 152 provides data for notifying the photographed person that a plurality of people are captured. You may modulate.

  When the visible light communication data is generated in step S110, the imaging apparatus 100 superimposes the data on the visible light emitted from the LED 158 and transmits the visible light communication data (step S112). When visible light communication data is transmitted from the imaging apparatus 100, the process returns to step S106, and the face recognition process by the face recognition unit 148 is executed again. The visible light emitted from the LED 158 is received by, for example, a portable terminal held by the subject and demodulated by the portable terminal, whereby information from the imaging device 100 can be confirmed by the portable terminal.

  In addition, the visible light communication data generation method in the imaging apparatus 100 according to the present embodiment can use any method, and is not limited to a specific method. For example, visible light communication data is generated using a commonly used method (color multiplexing method) that assigns data to LEDs that emit light in red, blue, and green colors and adjusts the light emission pattern. May be.

  FIG. 5 shows an example when information from the imaging apparatus 100 is received by visible light. FIG. 5 illustrates the imaging device 100 and the mobile terminal 200 that receives information from the imaging device 100. The mobile terminal 200 is a terminal having a function of receiving visible light emitted from the LED 158, demodulating information based on the light emission pattern of the LED 158, and outputting the demodulated information. The portable terminal 200 is desirably held by a person who is a subject when photographing using the imaging apparatus 100. Note that the mobile terminal 200 can demodulate information superimposed on visible light.

  In step S112, when visible light is emitted from the LED 158 of the imaging apparatus 100, the mobile terminal 200 receives the visible light from the LED 158 and demodulates information based on the received light emission pattern. The mobile terminal 200 can output the information generated by the imaging device 100 by displaying the demodulated information on a screen or by outputting it from a speaker.

  For example, as in the example illustrated in FIG. 4, when the position of the subject's face is shifted to the left from the position of the face frame 162 specified in advance, the imaging apparatus 100 (for the subject) Information prompting to move to the left (viewed from the side) is transmitted superimposed on the visible light. Visible light emitted from the imaging device 100 is received by the portable terminal 200 held by the subject and demodulated, so that the person who is the subject can know which direction he should move. It becomes possible.

  On the other hand, as a result of the face recognition process in step S106 and the determination process in step S108, if a face is present at the position of the face frame specified in step S102, data notifying the start of shooting is sent to the data modulation unit 152. To generate visible light communication data (step S114). Then, the imaging apparatus 100 transmits the visible light communication data generated in step S114 for notifying the start of photographing superimposed on the visible light emitted from the LED 158 (step S116). Visible light on which data for notifying the start of imaging is superimposed is received by the portable terminal 200 held by the subject and demodulated, so that the person who is the subject grasps that the imaging device 100 starts shooting. It becomes possible to do.

  In step S116, when the imaging apparatus 100 transmits visible light communication data for notifying the start of imaging superimposed on visible light emitted from the LED 158, the imaging apparatus 100 subsequently shifts to the self-timer mode ( Step S118). Then, when a predetermined time has elapsed, the imaging apparatus 100 automatically executes an imaging process to photograph the subject (step S120). Note that when the imaging apparatus 100 shifts to the self-timer mode, the imaging apparatus 100 may start light emission of the LED for the self-timer. When the imaging apparatus 100 starts light emission of the self-timer LED, the subject can recognize the start of shooting by the self-timer.

  The operation of the imaging apparatus 100 according to the embodiment of the present invention has been described above with reference to FIGS. As described above, by using the imaging device 100 according to the embodiment of the present invention, it is possible to instruct a shooting position with respect to a subject located at a location away from the imaging device 100.

  Note that if the face recognition unit 148 does not detect a face even after executing a face recognition process before a predetermined time elapses after the transition to the shooting determination mode in step S104, the control unit 128 The shooting determination mode may be stopped. In addition, even if a predetermined time has elapsed since the transition to the shooting determination mode in step S104 above, if a face is not detected even if face recognition processing is executed by the face recognition unit 148, the face can be recognized. The visible light communication data may be generated by modulating the data modulation unit 150 to the effect that the data does not exist, and the visible light communication data may be superimposed on the visible light emitted from the LED 158 and transmitted.

  In the above-described example, when a face exists at the position of the face frame specified in advance as a result of the face recognition process, the imaging apparatus 100 transmits data notifying the start of shooting and proceeds to the self-timer mode as it is. However, there may be a case where the subject moves from the time when the data for notifying the start of shooting is transmitted until the self-timer mode is entered. In the following, a case will be described in which the process of determining the face position is executed again from the time when the data for notifying the start of shooting is transmitted until the mode is shifted to the self-timer mode.

  FIG. 6 is a flowchart for explaining another example of the operation of the imaging apparatus 100 according to the embodiment of the present invention. Hereinafter, another example of the operation of the imaging apparatus 100 according to the embodiment of the present invention will be described with reference to FIG.

  In the flowchart shown in FIG. 6, steps S102 to S116 are the same as the steps in the flowchart shown in FIG.

  In step S116, when the imaging apparatus 100 transmits the visible light communication data for notifying the start of shooting superimposed on the visible light emitted from the LED 158, the face recognition is performed before the mode is shifted to the self-timer mode. The face recognition process by the unit 148 and the face position determination process by the position determination unit 150 are executed, and it is determined whether or not the face of the subject is located at the face position specified in advance (step S122).

  As a result of the determination in step S122, if the face of the subject detected by the face recognition unit 148 is located at the face position specified in advance, the imaging apparatus 100 shifts to the self-timer mode as it is (step S124). ) After a predetermined time elapses, the imaging apparatus 100 automatically executes an imaging process to photograph the subject (step S126). When the imaging apparatus 100 shifts to the self-timer mode, the imaging apparatus 100 may start light emission of the self-timer LED. When the imaging apparatus 100 starts light emission of the self-timer LED, the subject can recognize the start of shooting by the self-timer.

  On the other hand, as a result of the determination in step S122, when the face of the subject detected by the face recognition unit 148 is no longer positioned at the face position designated in advance, the control unit 128 instructs the data modulation unit 152 to designate the face. Instructs to modulate the data indicating the deviation of the face from the position. Receiving the instruction, the data modulation unit 152 modulates data notifying the deviation of the face from the designated position, and generates visible light communication data (step S128). Then, the imaging apparatus 100 transmits the visible light communication data generated in step S128 for notifying the deviation of the face from the designated position superimposed on the visible light emitted from the LED 158 (step S130).

  It should be noted that the data notifying the deviation of the face from the designated position is not modulated when a slight positional deviation occurs, and the face of the subject detected by the face recognition unit 148 overlaps the face frame designated in advance. However, the modulation may be performed by the data modulation unit 152 only when it is not.

  In step S130, the imaging device 100 that has transmitted visible light communication data for notifying the deviation of the face from the designated position subsequently stops the operation of the self-timer in the control unit 128 (step S132). 128 instructs the data modulation unit 152 to modulate data notifying the stop of the operation of the self-timer. Receiving the instruction, the data modulation unit 152 modulates the data notifying the stop of the operation of the self-timer and generates visible light communication data (step S134).

  Then, the imaging apparatus 100 transmits the visible light communication data generated in step S134 for notifying the stop of the operation of the self-timer superimposed on the visible light emitted from the LED 158 (step S136). When the visible light communication data for notifying the stop of the operation of the self-timer is transmitted in step S136, the process returns to step S106 and the face recognition process by the face recognition unit 148 is executed. If the imaging device 100 has started to emit the self-timer LED when starting the self-timer operation, when the imaging device 100 stops the self-timer operation, the self-timer LED It is desirable to stop the light emission.

  In this way, if the subject has moved between sending the data to notify the start of shooting and shifting to the self-timer mode, the deviation of the face from the position specified in advance and the stop of the self-timer, By transmitting from the imaging device 100 by visible light communication, it is possible to notify the subject located at a location away from the imaging device 100 that the subject has shifted from the position designated in advance. Then, the subject can receive information transmitted from the imaging device 100 by holding a device (for example, the portable terminal 200) that can demodulate data transmitted by visible light communication.

  In the above-described example, information regarding the deviation of the face from the designated position and the stop of the self-timer is generated by the imaging device 100 and transmitted twice from the imaging device 100. However, the present invention is limited to such an example. It goes without saying that it is not done. For example, information regarding deviation from the specified position and stopping of the self-timer may be collectively transmitted from the imaging apparatus 100 by visible light communication at a time.

  As described above, according to an embodiment of the present invention, the imaging apparatus 100 is used to designate the position of a face in an image to be captured in advance and shift to the imaging determination mode. When the face recognition process is executed and the position designated in advance matches the position of the face recognized by the face recognition process, the imaging process is automatically started by the imaging apparatus 100. If the face positions do not match, information that prompts the subject to move the face position is transmitted using visible light communication. Thereby, when taking a photograph of himself / herself, the photograph can be taken with a desired layout without reciprocating between the imaging apparatus 100 and his / her standing position many times.

  Note that the above-described operation of the imaging apparatus 100 may be performed by storing a computer program in the imaging apparatus 100, and reading out the computer program and sequentially executing the computer program.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to the example which concerns. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  The present invention can be applied to an imaging apparatus, and in particular, can be applied to an imaging apparatus having a visible light communication function.

It is explanatory drawing explaining the structure of the imaging device 100 concerning one Embodiment of this invention. 6 is a flowchart for explaining the operation of the imaging apparatus 100 according to the embodiment of the present invention. It is explanatory drawing explaining an example in the case of designating the position of the face in a picked-up image. It is explanatory drawing shown about an example of the position determination of a to-be-photographed object. An example in the case of receiving the information from the imaging device 100 with visible light is shown. It is a flowchart explaining another example of operation | movement of the imaging device 100 concerning one Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 102 Zoom lens 104 Aperture 106 Focus lens 102a, 104a, 106a Driving device 108 CMOS image sensor 110 CDS circuit 112 A / D converter 114 Image input controller 116 Image signal processing unit 120 Compression processing unit 122 LCD driver 124 LCD
128 Control Unit 132 Operation Unit 132a Shutter Button 132b Up / Down / Left / Right Button 132c Zoom Button 134 Memory 136 VRAM
138 Media controller 140 Recording medium 144 Timing generator 146 Face position designation unit 148 Face recognition unit 150 Position determination unit 152 Data modulation unit 156 LED driver 158 LED
200 Mobile terminal

Claims (5)

A face position designating unit for designating the position of the face in the captured image;
A face recognition unit that recognizes the position of the face included in the captured image;
A position determination unit that determines a positional relationship between the position specified by the face position specifying unit and the position recognized by the face recognition unit;
A data modulation unit that modulates information based on a determination result in the position determination unit;
A visible light emitter that emits visible light on which information modulated by the data modulator is superimposed;
An imaging apparatus.   If the position specified by the face position specifying unit matches the position recognized by the face recognizing unit as a result of the determination by the position determining unit, the data modulation unit starts shooting. The imaging device according to claim 1, wherein the imaging device is modulated. The position determination unit emits visible light on which information indicating that the visible light emitting unit starts the photographing is superimposed, and then the position designated by the face position designation unit and the position recognized by the face recognition unit Again determine the positional relationship with
The data modulation unit is configured to stop photographing when the position specified by the face position specifying unit and the position recognized by the face recognition unit do not match as a result of the determination by the position determining unit. The imaging device according to claim 2, which modulates information.   As a result of the determination by the position determination unit, if the position specified by the face position specifying unit and the position recognized by the face recognition unit do not match, the data modulation unit moves the face position The imaging device according to claim 1, which modulates the information. A face position specifying step for specifying the position of the face in the captured image;
A face recognition step for recognizing the position of the face included in the captured image;
A position determination step for determining a positional relationship between the position specified in the face position specifying step and the position recognized in the face recognition step;
A data modulation step for modulating information based on the determination result in the position determination step;
A visible light emitting step of emitting visible light on which the information modulated in the data modulation step is superimposed;
An imaging method including:

Images