JP2012138819A - Image pickup device, image pickup method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image which has had desired lighting applied to a desired part thereof.SOLUTION: A main control unit 51, by letting those pixels of a display unit 21 which constitute a partial area emit light, and while making the area function as illumination with which a part of the subject is irradiated, executes control for having the subject photographed by an image pickup unit 22. An image cutout unit 61 under the control of the main control unit 51, when the subject is successively photographed by the image pickup unit 22 while plural areas of the display unit 21 each are made to function successively as illumination, cuts out data for a partial area from each of the data of plural photographed images successively generated by the image pickup unit 22 to generate image data. An image synthesizing unit 62 synthesizes data of plural images cut out by the image cutout unit 61 to generate data of a synthesized image.

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program, and more particularly to a technique capable of obtaining an image in a state where desired lighting is performed on a desired portion.

2. Description of the Related Art Conventionally, a technique (lighting technique) that changes an image in a real space by applying illumination in the real space is known. An imaging device such as a camera captures an image by using this lighting technology, for example, by reducing the shadow of the real space to be imaged or conversely adding a shadow, thereby achieving an effect. It is possible to generate typical captured image data.
In Patent Document 1, a plurality of lighting patterns that exhibit various lighting effects are stored. By selecting a lighting pattern that exhibits a desired effect, a lighting pattern corresponding to the selected lighting pattern is stored. A technique for shooting with settings is disclosed.

Japanese Patent Laid-Open No. 11-24138

However, in the technique disclosed in Patent Document 1 described above, illumination is merely set in accordance with the timing of one imaging. In other words, the illumination is set only in consideration of the lighting state of the entire real space to be imaged.
Therefore, it is very difficult to set illumination with local lighting, such as performing desired lighting on a desired part without affecting other parts of the real space to be imaged. .
Specifically, for example, it is assumed that an image in which a shadow is generated in a specific part of a subject is requested. In order to meet such a demand, even if the technique disclosed in Patent Document 1 described above is used, it is very difficult to set illumination so that a shadow is generated only at a specific portion. That is, in the technique disclosed in Patent Document 1, it is originally assumed that lighting is set in consideration of lighting so that the entire subject is as shadowless as possible. Even if this setting is made, it is very difficult to set an appropriate illumination, such as a shadow not being able to be produced well at a specific part, or conversely, a shadow being produced at another part that originally does not require a shadow.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide an imaging apparatus, an imaging method, and a program capable of obtaining an image in a state where desired lighting is performed on a desired portion. And

According to one aspect of the invention,
Display means for displaying an image by emitting light from each pixel;
Imaging means for generating captured image data by imaging a subject;
Among the pixels of the display means, each pixel constituting a part of the region is caused to emit light so that the region is functioned as illumination for illuminating a part of the subject, and the subject is applied to the imaging unit. Control means for executing control for imaging;
Under the control of the control means, when each of the plurality of regions of the display means sequentially functions as the illumination, and the subject is sequentially imaged by the imaging means, a plurality of images that are sequentially generated by the imaging means For each of the captured image data, image cutout means for generating a partial area data as cutout image data,
Image combining means for generating combined image data by combining the data of the plurality of clipped images generated by the image cutting means;
An imaging apparatus comprising:

  According to another aspect of the present invention, there is provided an imaging method and program corresponding to the above-described imaging apparatus according to one aspect of the present invention.

  According to the present invention, it is possible to easily obtain an image in a state where desired lighting is performed on a desired portion.

1 is an external configuration diagram illustrating an external appearance of an imaging apparatus according to a first embodiment of the present invention. It is a schematic diagram for demonstrating the lighting which concerns on this invention. 2 shows an example of a composite image obtained as a result of combining the left half of the captured image obtained by the lighting shown in FIG. 2A and the right half of the captured image obtained by the lighting shown in FIG. ing. 2A shows an example of a composite image obtained as a result of combining the right half of the captured image obtained by the lighting shown in FIG. 2A and the left half of the captured image obtained by the lighting shown in FIG. ing. It is a block diagram which shows the hardware structure of the imaging device 1 of FIG. It is a functional block diagram which shows the functional structure for performing the lighting mode imaging process about the imaging device 1 of this embodiment. It is a figure which shows an example of the structure of the imaging sequence data which shows the procedure of the lighting mode imaging process of 1st Embodiment. It is a flowchart explaining an example of the flow of an imaging process. It is a flowchart explaining an example of the detailed flow of a mode switch process. It is a flowchart explaining an example of the detailed flow of a writing mode imaging process. It is a figure which shows the structure of the external appearance of the imaging device 1 which concerns on 2nd Embodiment. It is a figure which shows an example of the structure of the imaging sequence data which shows the procedure of the lighting mode imaging process in 2nd Embodiment. It is a flowchart explaining an example of the flow of the imaging process which concerns on 2nd Embodiment. It is a flowchart explaining an example of the flow of the light selection process which concerns on 2nd Embodiment. It is a flowchart explaining an example of the detailed flow of the mode switch process which concerns on 2nd Embodiment. It is a flowchart explaining an example of the detailed flow of the lighting mode imaging process which concerns on 2nd Embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings as appropriate.
[First Embodiment]
FIG. 1 is a diagram illustrating an appearance of an imaging apparatus 1 according to the first embodiment of the present invention.
As illustrated in FIG. 1, the imaging device 1 includes a frame 11, a display unit 21, and an imaging unit 22.

The frame 11 includes a fixed frame 11A and a rotating frame 11B.
11 A of fixed frames are comprised so that surroundings other than the center upper part of the display part 21 may be covered, and it connects with the rotation frame 11B arrange | positioned at the center upper part.

  The rotating frame 11B is disposed at the upper center of the display unit 21 and is rotatably connected to the fixed frame 11A. The rotation frame 11B is provided with an imaging opening 11Ba. In the present embodiment, the rotation frame 11B is configured to be rotatable from the front surface (the surface on which the display surface of the display unit 21 exists) to the back surface of the imaging device 1.

  The imaging unit 22 is stored in the rotation frame 11B and configured to be able to image a subject (for example, a human face 100 in FIG. 2 described later) from the imaging opening 11Ba. Details of the imaging unit 22 will be described later.

The display unit 21 includes, for example, an LCD (Liquid Crystal Display).
The display unit 21 displays an image by emitting light from each pixel. In this case, since the brightness (luminance) of each pixel is variable, in this embodiment, an aggregate of pixels that emit light with a certain level of brightness (hereinafter, the aggregate of pixels is appropriately referred to as an “area”). Functions as illumination for irradiating a user (such as a user having the face 100 described later) viewing the display surface of the display unit 21.
Specifically, as shown in FIG. 1A, when a user (a user having a face 100 to be described later) looks at the display surface of the display unit 21, the left end of the display unit 21 serves as an area that functions as illumination. An area A is provided in the part, and an area B is provided in the right end part of the display part 21. Details of the display unit 21 will be described later.

  Next, lighting by the imaging apparatus 1 having the above-described external configuration will be described with reference to FIGS.

FIG. 2 is a schematic diagram for explaining lighting according to the present invention.
FIG. 2A shows the state of the face 100 of the person who is the subject in the case of lighting in which the area A is in the light emission state and the area B is in the non-light emission state.
FIG. 2B shows the state of the face 100 of the person who is the subject in the case of lighting in which the area A is in a non-light emitting state and the area B is in a light emitting state.
2A and 2B (hereinafter referred to as “plan view”) represents a state of the face 100 when a person is viewed from above.
2A and 2B (front view) (hereinafter referred to as “front view”) represents the face 100 when a person is viewed from the imaging unit 18. That is, the face 100 appears in the captured image in the state shown in the front view.
2A and 2B (hereinafter referred to as “cutout view”) represents a state in which the left or right side of the face 100 in the front view state is cut out. . Naturally, since the human face 100 in the real space cannot be cut out, the state of the image cut out from the captured image by the image processing described later is shown in the cut-out diagram.

As shown in FIG. 2A, in the case of lighting in which the area A is in a light emission state and the area B is in a non-light emission state, the light from the area A is transmitted from the imaging unit 18 as shown in the plan view of FIG. By the way, the left side of the person's face 100 is irradiated, but the right side is not irradiated. For this reason, a shadow SA is generated on the right side of the human face 100 when viewed from the imaging unit 18.
For this reason, when the imaging unit 22 captures the human face 100 with the lighting in the state of FIG. 2A, a captured image as shown in the plan view of FIG. Data of the captured image is generated.

On the other hand, as shown in FIG. 2B, in the case of lighting in which the area A is in a non-light-emitting state and the area B is in a light-emitting state, as shown in the plan view of FIG. As seen from FIG. 18, the right side of the person's face 100 is irradiated, but the left side is not irradiated. For this reason, a shadow SB is generated on the right side of the person's face 100 when viewed from the imaging unit 18.
For this reason, when the imaging unit 22 captures the human face 100 with the lighting in the state of FIG. 2B, the captured image as shown in the plan view of FIG. Data of the captured image is generated.

  In this case, the imaging apparatus 1 uses image data including the left side of the face 100 with the shadow SA (see the cut-out diagram in the figure) from the captured image data obtained by the lighting in the state of FIG. Can be cut out. Similarly, the imaging apparatus 1 uses image data including the right side of the face 100 with the shadow SB from the captured image data obtained by the lighting in the state of FIG. Can be cut out. And the imaging device 1 can produce | generate the data of a synthesized image as shown in FIG. 3 by synthesize | combining two data cut out in this way.

3 shows a composite image obtained as a result of combining the left half of the captured image obtained by the lighting shown in FIG. 2A and the right half of the captured image obtained by the lighting shown in FIG. An example is shown.
As described above, the imaging apparatus 1 according to the present embodiment generates data of an image (composite image) in which shadows SA and SB are formed on the contour portions on both sides of the face 100 of the subject person as shown in FIG. Can do.

Here, a viewer who views an image as shown in FIG. 3 visually recognizes that the face 100 is smaller than the actual object. Although the size of the face 100 itself does not change, the contour portions on both sides are darkened by the shadows SA and SB. Therefore, compared to the case where the shadows SA and SB are not present on the contour portions on both sides due to the illusion of human eyes. It is because it is recognized small.
As described above, the imaging device 1 of the present embodiment can generate image data that looks like a small face.
Also, in such a composite image, the shadow of the nose is clearly visible, the nose edge is bright, the base of the nose is dark, so the nose looks sharp and high, and a shadow called a beautiful face in recent years is added. It is also possible to achieve the effect of being able to.

In other words, the image in which the face 100 looks like a small face in this way is an image in a state in which lighting for generating the shadows SA and SB on the contour portions on both sides of the face 100 is performed.
Such lighting can be easily realized by the imaging apparatus 1 of the present embodiment, and it is very difficult to realize even if the conventional technique described above in the “Background Art” column is applied. In the conventional technique, only one side of the subject is irradiated with light, and as a result, although shadows can be made on the opposite side of the subject (face 100 in this example), shadows are made on both sides of the subject. Because you can't.

  Furthermore, as illustrated in FIG. 4, the imaging device 1 of the present embodiment can generate data of an image (composite image) including a face 100 without a shadow.

  FIG. 4 shows a composite image obtained as a result of combining the right half of the captured image obtained by the lighting shown in FIG. 2A and the left half of the captured image obtained by the lighting shown in FIG. An example is shown.

Here, the right half of the captured image obtained by the lighting shown in FIG. 2A includes the right half (as viewed from the imaging unit 22) of the face 100 captured with illumination from one direction of the area 21A. It should be noted that.
Similarly, the left half of the captured image obtained by the lighting shown in FIG. 2B includes the left half surface (as viewed from the imaging unit 22) of the face 100 captured with illumination from one direction of the area 21B. It should be noted that.
That is, when the right half surface and the left side surface of the face 100 are combined, the face 100 without a shadow does not occur without causing the conventional problem that light due to unnecessary illumination overlaps to cause a change in color. It should be noted that an image including is obtained.

Here, the conventional problem that a change in color occurs due to overlapping of light from unnecessary illumination refers to the following problem.
In other words, even with the conventional technique described above in the “Background Art” column, it is possible to create a shadow-free state on the subject by illuminating the subject from a plurality of directions.
However, in this case, light may overlap in at least a part of the subject due to illumination from at least two of a plurality of directions. In this case, when attention is paid to a portion where light overlaps, the illumination is originally unnecessary except for illumination from a direction in which the portion is directly irradiated. In a portion where light overlaps due to such unnecessary illumination, a color difference occurs between other portions where light does not overlap.
In order to suppress such a color difference, if the illumination light from the direction directly irradiating the part is increased, the part is different from the actual color appearance.
In addition, it is virtually impossible to arrange illumination so that light does not overlap in all parts of the subject.
Such a problem is a conventional problem in that light due to unnecessary illumination overlaps to cause a change in color.

In summary, the imaging apparatus 1 of the present embodiment can easily perform lighting that does not cause such a conventional problem.
As a result, as shown in FIG. 4, it is possible to obtain an image with little change in color and without emphasizing the unevenness (ie, wrinkles, etc.) on the surface of the face 100 of the subject person.

  As described above, the imaging apparatus 1 according to the present embodiment performs the imaging operation with lighting as described above a plurality of times, and synthesizes different partial images out of a plurality of captured image data obtained as a result. As a result, the data of the composite image can be generated. Such a series of processing by the imaging apparatus 1 is hereinafter referred to as “lighting mode imaging processing”.

Next, an internal configuration of the imaging apparatus 1 capable of executing such a lighting mode imaging process will be described.
Specifically, first, the hardware configuration of the imaging apparatus 1 in FIG. 1 will be described.
FIG. 5 is a block diagram illustrating a hardware configuration of the imaging apparatus 1 of FIG.

  In addition to the display unit 21 and the imaging unit 22 described above, the imaging device 1 further includes a CPU (Central Processing Unit) 31, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 33, and an image processing unit 34. A bus 35, an input / output interface 36, an operation unit 37, a storage unit 38, a communication unit 39, and a drive 40.

The CPU 31 executes various processes according to a program recorded in the ROM 32 or a program loaded from the storage unit 38 to the RAM 33.
The RAM 33 appropriately stores data necessary for the CPU 31 to execute various processes.

The image processing unit 34 includes a DSP (Digital Signal Processor), a VRAM (Video Random Access Memory), and the like, and performs various image processing on image data in cooperation with the CPU 31.
For example, the image processing unit 34 performs image processing such as noise reduction, white balance, and camera shake correction on the captured image data output from the imaging unit 22.

  The CPU 31, ROM 32, RAM 33, and image processing unit 34 are connected to each other via a bus 35. An input / output interface 36 is also connected to the bus 35. In addition to the display unit 21 and the imaging unit 22 described above, an operation unit 37, a storage unit 38, a communication unit 39, and a drive 40 are connected to the input / output interface 36.

  The display unit 21 is composed of an LCD as described above, and displays various images stored as data in the storage unit 38 and the removable medium 41. In addition, as described above, the area 21A and the area 21B (FIG. 1) are constant. It also functions as an illumination by emitting light at a brightness (luminance) or higher.

  Although not shown, the imaging unit 22 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 22.
It is assumed that the output signal of the imaging unit 22 is the “captured image data” described above. Accordingly, captured image data is output from the imaging unit 22 and is appropriately supplied to the CPU 31, the image processing unit 34, the storage unit 38, and the like.

  The operation unit 37 includes various buttons, switches, and the like, and accepts user instruction operations. An operation unit 37, a shutter button (not shown), and a mode switch (not shown) described later are configured.

  The storage unit 38 is configured by a DRAM (Dynamic Random Access Memory) or the like, and stores image data output from the image processing unit 34 or the like. The storage unit 38 also stores various data necessary for processing by the image processing unit 34 and the like. Details of data stored in the storage unit 38 will be described later.

  The communication unit 39 controls communication performed with another device (not shown) via a network including the Internet.

  A removable medium 41 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 40. The program read from the removable medium 41 by the drive 40 is installed in the storage unit 38 as necessary. The removable medium 41 can also store various data such as image data stored in the storage unit 38 in the same manner as the storage unit 38. For example, the removable medium 41 stores data such as a composite image in the present embodiment.

The hardware configuration of the imaging apparatus 1 according to the present embodiment has been described above with reference to FIG.
Next, a functional configuration for realizing the execution function of the lighting mode imaging process among the functions of the imaging apparatus 1 having such a hardware configuration will be described with reference to FIG.
FIG. 6 is a functional block diagram showing a functional configuration for executing the lighting mode imaging process for the imaging apparatus 1 of the present embodiment.

  When the writing mode imaging process is executed, the main control unit 51 and the storage control unit 52 function in the CPU 31.

  The main control unit 51 executes the lighting mode imaging process by appropriately controlling the storage control unit 52 in the CPU 31 and devices external to the CPU 31, such as the display unit 21, the imaging unit 22, the image processing unit 34, and the like. .

For example, the main control unit 51 controls the brightness (brightness) of each pixel constituting the above-described area 21A or area 21B in the display area of the display unit 21 to be a certain level or more, whereby the area 21 or the area 21B. To function as lighting.
Note that, in this way, setting the brightness (luminance) of each pixel in the area 21A and the area 21B to be equal to or higher than the level (luminance value) functioning as illumination is expressed as “the area 21A is lit”. On the other hand, setting the brightness (luminance) of each pixel in the area 21A and the area 21B to be equal to or less than a level (luminance value) that does not function as illumination is expressed as “turn off”.
That is, the main control unit 51 controls lighting and extinguishing of each of the area of the display unit 21 and the area 22 independently, so that the lighting shown in FIG. 2A and FIG. Realize various lighting.

Further, for example, the main control unit 51 executes control for causing the imaging unit 22 to image the subject in a state in which various types of lighting such as the lighting shown in FIGS. 2A and 2B are realized.
Specifically, for example, first, the main control unit 51 performs control so that the imaging unit 22 captures the face 100 in the lighting state illustrated in FIG. Thereby, the captured image as shown in the front view of FIG. 2A, that is, the data of the captured image including the face 100 with the shadow SA on the left side is output from the imaging unit 22 and supplied to the image processing unit 34. The
Next, the main control unit 51 performs control so that the imaging unit 22 images the face 100 in the lighting state illustrated in FIG. As a result, as shown in the front view of FIG. 2B, captured image data including the face 100 with the shadow SB on the right side is output from the imaging unit 22 and supplied to the image processing unit 34.
Details will be described later when the functional configuration of the image processing unit 34 is described. In the image processing unit 34, the synthesized image shown in FIG. The data of the composite image of the face 100 in which the shadow SA is generated and the shadow SB is generated on the right side is generated and supplied to the storage control unit 52 of the CPU 31.

Based on the control of the main control unit 51, the storage control unit 52 executes control for storing data of a composite image (see FIG. 3 and FIG. 4) supplied from the image processing unit 34 described later in the removable medium 41. .
Note that the storage destination of data by the control of the storage control unit 52 is the removable medium 41 in the present embodiment, but is not particularly limited thereto, and is connected via the storage unit 38 or the communication unit 39. It may be in another device.

  In the present embodiment, the main control unit 51 and the storage control unit 52 described above are configured by a combination of the CPU 31 and a program executed by the CPU 31, that is, a combination of hardware and software. However, this is merely an example, and it is naturally possible to transfer at least part of the functions of the main control unit 51 and the storage control unit 52 to other components (such as the image processing unit 14) other than the CPU 31.

Next, a functional configuration of the image processing unit 34 will be described.
When the writing mode imaging process is executed, the image cutting unit 61 and the image composition unit 62 function in the image processing unit 34.
Note that the image cutout unit 61 and the image composition unit 62 are provided in the image processing unit 34 is merely an example, and at least a part of the image cutout unit 61 and the image composition unit 62 is replaced with the image processing unit 34. Of course, it is also possible to transfer to other components (CPU31 etc.).

Based on the control of the main control unit 51, the image cutout unit 61 partially cuts out data of a partial area of the captured image from the captured image data supplied from the imaging unit 22. Hereinafter, data of an image cut out by the image cutout unit 61 is referred to as “cutout image data”.
Specifically, the image cutout unit 61 generates data of a region corresponding to the lighting state from the captured image data as cutout image data.
More specifically, for example, in the first imaging of the imaging unit 22 in the above-described example, since the lighting state illustrated in FIG. 2A is described above, the imaging as illustrated in the front view of FIG. Image data, that is, data of a captured image including the face 100 with the shadow SA on the left side is supplied to the image cutout unit 61. Therefore, the image cutout unit 61 stores data corresponding to such a lighting state, that is, data of a region including the left half of the face 100 in which the shadow SA is generated (region shown in the cut-out diagram in FIG. 2A). Are generated as data of the first cut-out image.
Further, for example, in the second imaging of the imaging unit 22 in the above-described example, since the lighting state illustrated in FIG. 2B is described above, the captured image illustrated in the front view of FIG. Data of the captured image including the face 100 in which the shadow SB is generated is supplied to the image cutout unit 61. Therefore, the image cutout unit 61 stores data in an area corresponding to such a lighting state, that is, an area including the right half of the face 100 in which the shadow SB is generated (an area shown in the cut-out diagram in FIG. 2B). Are generated as data of the second cut-out image.

Based on the control of the main control unit 51, the image composition unit 62 synthesizes data of two or more clipped images generated by the image cutout unit 61 to generate composite image data.
Specifically, for example, in the above-described example, after the image capturing unit 22 captures the image twice, the image cropping unit 61 includes a cut-out image including the left half of the face 100 in which the shadow SA has occurred (in FIG. 2A). Each data of a cutout image including the right half of the face 100 in which the shadow SB is generated (see the cutout drawing of FIG. 2B) is generated and supplied to the image composition unit 62. .
In this case, the image combining unit 62 combines the data of these two cut-out images to combine the combined image shown in FIG. 4, that is, the face 100 in which the shadow SA is generated on the left side and the shadow SB is generated on the right side. Image data is generated and supplied to the storage control unit 52 of the CPU 31.
Then, as described above, the composite image data is stored in the removable medium 41 or the like under the control of the storage control unit 52.

  The functional configuration of the imaging apparatus 1 for realizing the execution function of the lighting mode imaging process has been described above with reference to FIG.

Here, as shown in FIG. 7, imaging sequence data is stored in the storage unit 38.
The imaging sequence data is data in which the procedure of the lighting mode imaging process is set. The main control unit 51 of the CPU 31 executes the lighting mode imaging process according to the imaging sequence data.
FIG. 7 is a diagram illustrating an example of a structure of imaging sequence data indicating a procedure of the lighting mode imaging process according to the first embodiment.

In the present embodiment, since the imaging sequence data in FIG. 7 has a matrix structure, a collection of items in the horizontal direction in FIG. 7 is hereinafter referred to as “row”, and a collection of items in the vertical direction in FIG. Is called a "column". A predetermined procedure is associated with the predetermined line. In other words, items “order” and “imaging sequence” are arranged in a predetermined row in order to specify a procedure corresponding to the row.
The k-th row from the top (k is an integer value within the range of 1 to the total number of procedures, and in the example of FIG. 7, it is an integer value within the range of 1 to 6. However, the item name of FIG. 7 is described. “Excludes the top row”) stores “k” as the processing order in the lighting mode imaging process.
The “imaging sequence” in the k-th row from the top stores the contents of the process to be executed k-th in the lighting mode imaging process.
That is, the lighting mode imaging process is realized by sequentially executing the processes described in the “imaging sequence” of each row in order from the top.
Note that the flowchart created according to the imaging sequence of the example of FIG. 7 is the lighting mode imaging process in the present embodiment, and is shown in FIG. Therefore, the description of each process described in the “imaging sequence” in each row of the imaging sequence will be described later as the description of FIG.

Note that the imaging sequence data stored in the storage unit 38 is merely an example, and may be stored in, for example, the removable medium 41 or the like.
The imaging sequence data is data that can be arbitrarily set by the user. That is, the user can register imaging sequence data obtained by combining various desired processes in a desired order by operating the operation unit 37. In other words, the contents of FIG. 7 of the imaging sequence data are merely examples.

The functional configuration of the imaging apparatus 1 that can realize the lighting mode imaging process has been described above.
Next, with reference to FIGS. 8 to 10, the flow of the imaging process executed by the imaging apparatus 1 having the functional configuration of FIG. 6 will be described.
The imaging process here refers to a series of processes until a process selected by the user is executed among a lighting mode imaging process with lighting by the display unit 21 and an imaging process without lighting by the display unit 21. Say.
That is, in the present embodiment, two modes of “lighting mode” and “normal mode” are provided as operation modes at the time of imaging of the imaging apparatus 1. The user can select a desired mode from these two modes by performing a predetermined operation on the operation unit 37.

FIG. 8 is a flowchart for explaining an example of the flow of such imaging processing.
The imaging process is started when, for example, the imaging apparatus 1 is turned on, a predetermined operation is performed on the operation unit 37 by the user, and an instruction to start an imaging operation is given.

  In step S <b> 1, the main control unit 51 in FIG. 6 executes initialization processing for performing various initial settings for the imaging apparatus 1.

In step S2, the main control unit 51 executes a mode switch process.
The mode switch process is a process for selectively switching and setting one mode from a plurality of modes.
In the present embodiment, as described above, two modes of the normal mode and the lighting mode that are set by default can be selectively set as the operation mode at the time of imaging.
Details of the mode switch process will be described later with reference to the flowchart of FIG.

In step S3, the main control unit 51 determines whether or not SHTF is 1.
SHTF is an abbreviation for switch flag. The switch flag is a flag in which “1” is set when an instruction to record a captured image is given, and “0” is set when the instruction is not made.
When SHTF is “0”, it is determined as NO in Step S3, and the process proceeds to Step S7. However, the processing after step S7 will be described later.
On the other hand, when SHTF is “1”, it is determined as YES in Step S3, and the process proceeds to Step S4.

  In step S4, the main control unit 51 determines whether or not the lighting mode is set as the operation mode during imaging.

If the lighting mode is set, it is determined as YES in step S4, and the process proceeds to step S5.
In step S5, the imaging apparatus 1 executes a lighting mode imaging process.
In the present embodiment, the lighting mode imaging process is executed according to the imaging sequence shown in FIG.
Details of the lighting mode imaging process will be described later with reference to FIG.

When the normal mode is set instead of such a lighting mode, it is determined as NO in Step S4, and the process proceeds to Step S6.
In step S6, the imaging apparatus 1 executes normal mode imaging processing.
The normal imaging process refers to a series of processes from when the imaging unit 22 performs a normal imaging operation in a state where the display unit 21 is not functioning as an illumination function and to store captured image data obtained as a result.
Note that the normal imaging process of the present embodiment ends when the captured image data is saved and then the SHTF (switch flag) is changed from “1” to “0”.

Thus, when it is determined that the SHTF is 1 and YES in the process of step S3, the lighting mode is set (when it is determined YES in the process of step S4). The lighting mode imaging process of step S5 is executed, and when the normal mode is set (when it is determined NO in the process of step S4), the normal mode imaging process of step S6 is executed. The When these imaging processes are completed, the process proceeds to step S7.
If it is determined that SHTF is 0 and NO in step S3, the lighting mode imaging process in step S5 and the normal mode imaging process in step S6 are not executed, and the process proceeds to step S7. move on.

In step S7, the main control unit 51 determines whether or not an instruction to end the process has been issued.
The instruction to end the process is not particularly limited. For example, in this embodiment, an instruction to switch to another operation mode, for example, an image display instruction is adopted as one of the instructions to end the process because the imaging apparatus 1 is configured with a digital photo frame. For example, in the present embodiment, an instruction to turn off the power of the imaging apparatus 1 is also adopted as one of the instructions for ending the process.
When such an instruction to end the process is not given, it is determined as NO in Step S7, and the process returns to Step S2. In other words, the loop process of steps S2 to S7 is repeatedly executed until an instruction to end the process is made, and each time the SHTF is 1, the lighting mode imaging process or the normal mode imaging process is executed. The
Thereafter, when an instruction to end the process is given, it is determined as YES in Step S7, and the imaging process ends.

The flow of the imaging process executed by the imaging apparatus 1 having the functional configuration of FIG. 6 has been described above with reference to FIG. Next, a detailed flow of the mode switch process in step S2 in the above-described imaging process will be described with reference to FIG.
FIG. 9 is a flowchart for explaining an example of a detailed flow of the mode switch process.

  In the imaging process, as described above, when the initialization process is executed in the process of step S1, the process proceeds to step S2, and the following series of processes of step S21 to step S24 are executed as the mode switch process. Is done.

In step S21, the main control unit 51 in FIG. 6 determines whether or not the mode switch is in the ON state.
The mode switch is a switch that is pressed by the user when switching the imaging operation mode of the imaging apparatus 1 among the various buttons and various switches constituting the operation unit 37. Although not shown, the frame 11 (see FIG. 1). In the present embodiment, the mode switch is configured as a physical switch. However, the mode switch is not particularly limited thereto, and may be configured as a software switch displayed on an image for GUI (Graphical User Interface).

When the mode switch is in the ON state, it is determined as YES in Step S21, and the process proceeds to Step S22.
In step S22, the main control unit 51 executes mode inversion.
The mode inversion refers to a process of switching the setting of the imaging operation mode of the imaging apparatus 1 from one of the normal mode and the lighting mode to the other.

  When mode inversion is executed, the process proceeds to step S23. When the mode switch is in the OFF state, it is not necessary to reverse the mode. Therefore, it is determined as NO in step S21, and the process proceeds to step S23 without executing the process in step S22.

In step S23, the main control unit 51 determines whether or not the shutter button is in the ON state.
The shutter button is a switch that is pressed by the user when an instruction is given to save an image of a captured image obtained as a result of imaging a subject among various buttons and various switches constituting the operation unit 37. Although not, it is provided on the frame 11 (FIG. 1). In this embodiment, the shutter button is configured as a physical switch. However, the present invention is not limited to this, and the shutter button may be configured as a software switch displayed on a GUI image.

  When the shutter button is in the OFF state (when the shutter button is not pressed), it is determined as NO in step S23, and the mode switch process ends. That is, the process of step S2 in FIG. 8 ends, and the process proceeds to step S3. In this case, since SHTF remains set to “0”, it is determined as NO in the process of step S3, and the lighting mode imaging process of step S5 and the normal mode imaging process of step S6 are not executed. .

On the other hand, when the shutter button is in the ON state (when the shutter button is pressed), it is determined as YES in Step S23, and the process proceeds to Step S24.
In step S24, the main control unit 51 sets SHTF from “0” to “1” (SHIFT ← 1).
As a result, the mode switch process ends. That is, the process of step S2 in FIG. 8 ends, and the process proceeds to step S3. In this case, since SHTF is set to “1”, it is determined as YES in the process of step S3, and the lighting mode imaging process of step S5 or the normal mode imaging process of step S6 is executed. .

In the above, the mode switch process of step S2 was demonstrated among the imaging processes of FIG.
Next, a detailed flow of the lighting mode imaging process in step S5 in the imaging process will be described with reference to FIG.
FIG. 10 is a flowchart illustrating an example of a detailed flow of the lighting mode imaging process.

  As described above, when the lighting mode is set in the mode switch process in step S2 and SHTF is set to “1” as the shutter button is pressed, YES is obtained in each process in steps S3 and S4. It is determined. As a result, the following series of processing from step S41 to step S49 is executed as the lighting mode processing in step S5.

In step S41, the main control unit 51 turns on only the first area of the display unit 21 (turns off the second area).
For example, it is assumed that an area 21A on the left side as viewed from the user (subject) viewing the display unit 21 is set as the first area. That is, it is assumed that such setting is made in the imaging sequence data of FIG.
In this case, only the area 21A is fully lit (the area 21B is turned off), and the lighting state in FIG. 2A, that is, the lighting state in which the left side (viewed by the user) of the user's face 100 as the subject is irradiated. become.

In step S42, the main control unit 51 causes the imaging unit 22 to image the subject in a state where only the first area is completely lit after the process of step S41, and as a result, the captured image data output from the imaging unit 22 is captured. Then, the data is taken into the image cutting unit 61 as the first image data.
In the above example, since the image is captured in the lighting state of FIG. 2A, the captured image data in which the shadow SA appears on the left side of the user's face 100 (as viewed from the person viewing the captured image) is the first image. The data is taken into the image cutout unit 61.

In step S43, the main control unit 51 turns on only the second area of the display unit 21 (the first area is turned off).
For example, it is assumed that the area 21B on the right side as viewed from the user (subject) viewing the display unit 21 is set as the second area. That is, it is assumed that such a setting is made in the imaging sequence data of FIG.
In this case, only the area 21B is fully lit (the area 21A is turned off), and the lighting state in FIG. 2B, that is, the lighting state in which the right side (viewed by the user) of the user's face 100 as the subject is irradiated. become.

In step S44, the main control unit 51 causes the imaging unit 22 to image the subject in a state where only the second area is completely lit after the process of step S43, and the captured image data output from the imaging unit 22 as a result is obtained. Then, the data is taken into the image cutout unit 61 as the second image data.
In the above example, since the image is captured in the lighting state of FIG. 2B, the captured image data in which the shadow SB appears on the right side of the user's face 100 (as viewed from the person viewing the captured image) is the second image. The data is taken into the image cutout unit 61.

In step S45, the image cutout unit 61 generates half of the shadowed data as the first cutout image data from the first image data.
In the above-described example, as shown in the cut-out diagram of FIG. 2A, data on the left half (as viewed from the person viewing the captured image) on the side where the shadow SA exists is generated as data of the first cut-out image.

In step S <b> 46, the image cutout unit 61 generates half of the shadowed data as second cutout image data from the second image data.
In the above-described example, as shown in the cutout diagram of FIG. 2B, data on the right half (as viewed from the person viewing the captured image) on the side where the shadow SB exists is generated as data of the second cutout image.

In step S <b> 47, the image composition unit 62 synthesizes the data of the first clipped image and the second clipped image, thereby generating synthesized image data.
In the above-described example, the image data shown in FIG. 3, that is, the image data including the face 100 with shadows SA and SB on both cheeks is generated as the composite image data.

  In step S48, the storage control unit 52 stores the composite image data generated in the process of step S47 in the removable medium 41 or the like.

  In step S46, the main control unit 51 sets SHTF to “0” (SHTF ← 0).

  Thereby, the lighting mode imaging process is completed. That is, the process of step S5 in FIG. 8 ends, and then the process proceeds to step S7.

As described above, the imaging apparatus 1 according to the present embodiment includes the display unit 21, the imaging unit 22, the main control unit 51, the image cutout unit 61, and the image composition unit 62.
The display unit 21 displays an image by emitting each pixel.
The imaging unit 22 generates captured image data by imaging a subject.
The main control unit 51 emits each pixel constituting a part of the pixels of the display unit 21 so that the area functions as illumination for illuminating a part of the subject, and the imaging unit Control for causing the subject to image 22 is executed.
When the subject is sequentially imaged by the imaging unit 22 in each state in which each of the plurality of areas of the display unit 21 functions as illumination sequentially under the control of the main control unit 51, the image cutout unit 61 is as follows. Operate. In other words, the image cutout unit 61 generates partial area data as cutout image data for each of a plurality of picked up image data sequentially generated by the image pickup unit 22.
The image composition unit 62 generates composite image data by combining the data of a plurality of clipped images generated by the image cutout unit 61.

Here, the main control unit 51 can easily change the area of the display unit 21 that functions as illumination so that desired lighting is performed on a desired portion of the subject.
Thus, every time the area of the display unit 21 that functions as illumination is changed, the imaging unit 22 captures an image of a subject, and as a result, based on the data of a plurality of captured images generated by the imaging unit 22, image clipping is performed. The combined image data generated by the unit 61 and the image combining unit 62 is image data in a state where desired lighting is performed on a desired portion.
Desired lighting means that a user (a photographer who matches a subject in the present embodiment) creates a desired state as a state in which light is emitted to a subject (a state in which no shadow is generated or generated). It means you can.
As described above, the user can easily obtain an image in a state where desired lighting is performed on a desired portion by using the imaging device 1 of the present embodiment.

Specifically, for example, the main control unit 51 causes the area 21A of the display unit 21 to function as illumination so as to irradiate the left side of the subject (as viewed from the subject) and cause a shadow on the right side (see FIG. 2A). )), The first control for causing the imaging unit 22 to image the subject is executed.
The main control unit 51 also causes the imaging unit 22 to image the subject in a state where the area 21B of the display unit 21 functions as illumination so as to irradiate the right side of the subject (as viewed from the subject) and cause a shadow on the left side. The second control is executed.

In this case, for example, the image cutout unit 61 has a shadow among the subjects from the data of the captured image (first image) generated by the imaging unit 22 as a result of the first control of the main control unit 51. Data of an image including substantially half of the side (for example, an image as shown in the cutout diagram of FIG. 2A) is generated as data of the first cutout image.
The image cutout unit 61 also includes an image including approximately half of the subject on the shadowed side from the captured image data generated by the imaging unit 22 as a result of the second control of the main control unit 51 ( For example, data of an image as shown in the cutout diagram of FIG. 2A is generated as data of the second cutout image.
Then, the image composition unit 62 synthesizes the data of the first clipped image and the second clipped image, thereby generating synthesized image data.
Thereby, for example, when a person including the face 100 is captured as a subject, an image including the face 100 having shadows SA and SB on both cheeks as shown in FIG. 3 is obtained as a composite image. . A viewer who sees such an image visually recognizes the face 100 smaller than the actual size due to the optical illusion. That is, an image that looks like a small face as a composite image can be easily obtained in this way.

In addition, for example, the image cutout unit 61 includes, on the side of the subject on which no shadow is generated, from the data of the captured image (first image) generated by the imaging unit 22 as a result of the first control of the main control unit 51. Data of an image including approximately half (for example, an image not shown in the cutout diagram of FIG. 2A) is generated as data of the first cutout image.
The image cutout unit 61 also includes an image including approximately half of the subject on the side where no shadow is generated from the captured image data generated by the imaging unit 22 as a result of the second control of the main control unit 51 ( For example, the data of the image not shown in the cutout diagram of FIG. 2A is generated as the data of the second cutout image.
Then, the image composition unit 62 synthesizes the data of the first clipped image and the second clipped image, thereby generating synthesized image data.
Thus, for example, when a person including the face 100 is imaged as a subject, an image as shown in FIG. 4 as a composite image, that is, light due to unnecessary illumination overlaps to cause a change in color. Thus, an image including the face 100 having no shadow is obtained.

Here, in order to illuminate the subject, instead of the area of the display unit 21 (area 21A or area 21B), a plurality of flash devices or a plurality of illumination devices are used to control these light emission timings. It is possible to execute processing equivalent to the above-described lighting mode imaging processing.
However, even if only a plurality of flash devices and a plurality of lighting devices are employed, the entire imaging device 1 becomes large, and lighting control using these devices becomes complicated.
On the other hand, as in the present embodiment, by using a liquid crystal display or the like originally provided as the display unit 21 as the imaging device 1 for illumination, the imaging device 1 can be downsized. At the same time, lighting control can be realized simply and easily because only the function originally provided as the imaging apparatus 1 such as adjusting the luminance of each pixel is used.

In addition, the storage unit 38 of the imaging apparatus 1 according to the present embodiment changes the area that functions as the illumination in the display unit 21 a plurality of times, and causes the imaging unit 22 to image the subject each time the area that functions as the illumination changes. The imaging sequence data indicating the procedure to follow is held.
The main control unit 51 executes control according to the imaging sequence data.
By using such imaging sequence data, lighting control can be realized easily and easily.
Furthermore, the user can easily reflect the desired pattern of lighting by setting the imaging sequence data by himself / herself.

The imaging device 1 according to the first embodiment of the present invention has been described above.
Next, an imaging apparatus 1 according to the second embodiment of the present invention will be described.

[Second Embodiment]
The imaging device 1 according to the second embodiment can have basically the same hardware configuration and functional configuration as the imaging device 1 according to the first embodiment. That is, each of FIGS. 5 and 6 shows the hardware configuration and the functional configuration of the imaging apparatus 1 according to the second embodiment as they are. Therefore, the description of the hardware configuration and the functional configuration of the imaging apparatus 1 according to the second embodiment is omitted.

FIG. 11 is a diagram illustrating an external configuration of the imaging apparatus 1 according to the second embodiment.
FIG. 11A is a front view of the imaging apparatus 1. FIG. 11B is a perspective view of the imaging apparatus 1 when imaging a subject. FIG. 11C is a front view of the subject when the image capturing apparatus 1 captures an image in the state of FIG.

As can be easily understood by comparing FIG. 1 and FIG. 11, in the first embodiment, the two areas 21A and 21B (FIG. 1) at both ends of the display unit 21 function as illumination. Four areas 22a to 22d when the display area of the section 21 is divided by two diagonal lines function as illumination.
Thereby, in comparison with the lighting pattern that is possible by the combination of lighting or extinguishing of the two areas 21A and 21B of the first embodiment, the combination of lighting or extinguishing of the four areas 21a to 21d of the second embodiment is possible. The possible lighting patterns will be more precise, more sophisticated, and more patterns.

As a result, in the first embodiment, only one lighting mode is provided, whereas in the second embodiment, a plurality of lighting modes are selectable.
In other words, the imaging sequence data stored in the storage unit 38 is configured to be selectable for each of a plurality of lighting modes in the second embodiment.

FIG. 12 is a diagram illustrating an example of the structure of imaging sequence data indicating the procedure of the lighting mode imaging process according to the second embodiment.
FIG. 12A is a diagram illustrating an example of the structure of imaging sequence data indicating each mode in the lighting mode. FIG. 12B is a diagram illustrating an example of the structure of the imaging sequence data indicating the procedure of the lighting mode imaging process in the selected mode.

In the present embodiment, in order to specify a procedure corresponding to the predetermined line, a “write No.” and a “name” as shown in FIG. 12A and a predetermined line as shown in FIG. Each item is arranged. Further, as shown in FIG. 12B, items of “order” and “imaging sequence” are arranged.
As shown in FIG. 12A, the k-th row from the top (k is an integer value within the range of 1 to the total number of modes, and in the example of FIG. “Light No.” of the integer value within the range) stores each mode number and k of the lighting modes. In “Name”, the name of the mode corresponding to the mode number is stored.
Further, as shown in FIG. 12B, the k-th row from the top (k is an integer value within the range of 1 to the total number of procedures, and in the example of FIG. 12B, within the range of 1 to 6. (However, the top row in which the item names of FIG. 12B are described is excluded), “k” is stored as the processing order in the lighting mode imaging process.
The “imaging sequence” in the k-th row from the top stores the contents of the process to be executed k-th in the lighting mode imaging process.
That is, the lighting mode imaging process is realized by sequentially executing the processes described in the “imaging sequence” of each row in order from the top.
Note that a flowchart created according to the imaging sequence in the example of FIG. 12B is the lighting mode imaging process in the present embodiment, and is shown in FIG. Therefore, description of each process of the contents described in “imaging sequence” in each row of the imaging sequence will be described later as an explanation of a flowchart according to FIG.

Note that the imaging sequence data stored in the storage unit 38 is merely an example, and may be stored in, for example, the removable medium 41 or the like.
The imaging sequence data is data that can be arbitrarily set by the user. That is, the user can register imaging sequence data obtained by combining various desired processes in a desired order by operating the operation unit 37. In other words, the contents of FIG. 7 of the imaging sequence data are merely examples.

  In the present embodiment, among the selectable lighting modes, “light No. 1” and “name: mode with shadow” are modes corresponding to the lighting mode described in the first embodiment, and a shadow is applied to the contour of the subject. It is a mode to make. This mode is, for example, a mode suitable for generating an image that makes a face look smaller. Further, “light No. 2” and “name: no shadow mode” are modes in which a shadow is not formed on the subject, and is a mode suitable for generating an image that makes a shape stand out on a jewel, for example.

Next, the flow of imaging processing executed by the imaging device 1 having the functional configuration of FIG. 6 will be described with reference to FIGS.
Hereinafter, for convenience of explanation, an imaging process in the case where the lighting mode specified by “light No. 2” and “name: no shadow mode” is selected will be described as an example, but another lighting mode is selected. In this case, the flow of the imaging process is the same.
FIG. 12 is a flowchart illustrating an example of the flow of imaging processing according to the second embodiment. Hereinafter, for convenience of explanation, an imaging process when the lighting mode specified by “light No. 2” and “name: no shadow mode” is selected will be described as an example, but other lighting modes may also be selected. The flow of the imaging process is the same.
The imaging process is started when, for example, the imaging apparatus 1 is turned on, a predetermined operation is performed on the operation unit 37 by the user, and an instruction to start an imaging operation is given.

  In step S <b> 101, the main control unit 51 in FIG. 6 executes initialization processing for performing various initial settings for the imaging apparatus 1.

In step S102, the main control unit 51 executes a mode switch process.
The mode switch process is a process for selectively switching and setting one mode from a plurality of modes.
In the present embodiment, as described above, two modes of the normal mode and the lighting mode that are set by default can be selectively set as the operation mode at the time of imaging.
Details of the mode switch process will be described later with reference to the flowchart of FIG.

In step S <b> 103, the main control unit 51 determines whether SHTF is 1.
SHTF is an abbreviation for switch flag. The switch flag is a flag in which “1” is set when an instruction to record a captured image is given, and “0” is set when the instruction is not made.
If SHTF is “0”, it is determined as NO in step S103, and the process proceeds to step S7. However, the processing after step S107 will be described later.
On the other hand, if SHTF is “1”, it is determined as YES in step S103, and the process proceeds to step S104.

  In step S104, the main control unit 51 determines whether or not the preset mode is set as the operation mode during imaging. The preset mode is a preset mode.

If the preset mode is set, it is determined as YES in step S104, and the process proceeds to step S105.
In step S105, the imaging apparatus 1 executes a lighting mode imaging process.
In the present embodiment, the lighting mode imaging process is executed according to the imaging sequence shown in FIG.
Details of the lighting mode imaging process will be described later with reference to FIG.

If the normal mode is set instead of such a lighting mode, it is determined as NO in step S104, and the process proceeds to step S106.
In step S106, the imaging apparatus 1 executes normal mode imaging processing.
The normal imaging process refers to a series of processes from when the imaging unit 22 performs a normal imaging operation in a state where the display unit 21 is not functioning as an illumination function and to store captured image data obtained as a result.
Note that the normal imaging process of the present embodiment ends when the captured image data is saved and then the SHTF (switch flag) is changed from “1” to “0”.

Thus, when it is determined that the SHTF is 1 and YES is determined in the process of step S103, the lighting mode is set (when it is determined YES in the process of step S104). The lighting mode imaging process of step S105 is executed, and when the normal mode is set (when it is determined NO in the process of step S104), the normal mode imaging process of step S106 is executed. The When these imaging processes are completed, the process proceeds to step S107.
On the other hand, if it is determined that SHTF is 0 and NO in step S103, the lighting mode imaging process in step S105 and the normal mode imaging process in step S106 are not executed, and the process proceeds to step S107. move on.

In step S107, the main control unit 51 determines whether or not an instruction to end the process is given.
The instruction to end the process is not particularly limited. For example, in this embodiment, an instruction to switch to another operation mode, for example, an image display instruction is adopted as one of the instructions to end the process because the imaging apparatus 1 is configured with a digital photo frame. For example, in the present embodiment, an instruction to turn off the power of the imaging apparatus 1 is also adopted as one of the instructions for ending the process.
When such an instruction to end the process is not given, it is determined as NO in Step S107, and the process returns to Step S102. In other words, the loop process of steps S102 to S107 is repeatedly executed until an instruction to end the process is made, and each time the SHTF is 1, the lighting mode imaging process or the normal mode imaging process is executed. The
Thereafter, when an instruction to end the process is given, it is determined as YES in Step S107, and the imaging process ends.

The flow of the imaging process executed by the imaging apparatus 1 having the functional configuration of FIG. 6 has been described above with reference to FIG. Next, a detailed flow of the mode switch process in step S102 in the above-described imaging process will be described with reference to FIG.
FIG. 14 is a flowchart illustrating an example of a detailed flow of the mode switch process according to the second embodiment.

  In the imaging process, as described above, when the initialization process is executed in the process of step S1, the process proceeds to step S102, and the following series of processes from step S121 to step S124 are executed as the mode switch process. Is done.

In step S121, the main control unit 51 in FIG. 6 determines whether or not the mode switch is in the ON state.
The mode switch is a switch that is pressed by the user when switching the imaging operation mode of the imaging apparatus 1 among the various buttons and various switches constituting the operation unit 37. Although not shown, the frame 11 (see FIG. 1). In the present embodiment, the mode switch is configured as a physical switch. However, the mode switch is not particularly limited thereto, and may be configured as a software switch displayed on a GUI image.

If the mode switch is in the ON state, it is determined as YES in step S121, and the process proceeds to step S122.
In step S122, the main control unit 51 performs mode inversion.
The mode inversion refers to a process of switching the setting of the imaging operation mode of the imaging apparatus 1 from one of the normal mode and the lighting mode to the other.

  When mode inversion is executed, the process proceeds to step S123. When the mode switch is in the OFF state, mode inversion is not necessary, so that it is determined as NO in step S121, and the process proceeds to step S123 without executing the process in step S122.

In step S123, the main control unit 51 determines whether or not the select switch is in an ON state.
The select switch is a switch that is pressed by the user when instructing mode selection among various buttons and various switches constituting the operation unit 37. Although not shown, the select switch is provided on the frame 11 (FIG. 1). It has been. In the present embodiment, the select switch is configured as a physical switch, but is not particularly limited thereto, and may be configured as a software switch that is displayed on a GUI image.

  When the select switch is in the OFF state (when the select switch is not pressed), it is determined as NO in Step S123, and the process proceeds to Step S125.

  On the other hand, when the select switch is in the ON state (when the shutter button is pressed), it is determined as YES in Step S123, and the process proceeds to Step S124.

  In step S124, the main control unit 51 performs a light selection process. The light selection process is a process for selecting “light No.”.

  When the write selection process is executed, the process proceeds to step S125. Note that when the select switch is in the OFF state, the light selection process is unnecessary, so that it is determined NO in step S123, and the process proceeds to step S125 without executing the process in step S124.

  In step S125, the main control unit 51 determines whether or not the shutter button is in the ON state.

  If the shutter button is in the OFF state (when the shutter button is not pressed), it is determined NO in step S125, and the mode switch process ends. That is, the process of step S102 in FIG. 13 is completed, and the process proceeds to step S103. In this case, since the SHTF remains set to “0”, it is determined as NO in the process of step S103, and the lighting mode imaging process in step S105 and the normal mode imaging process in step S106 are not executed. .

On the other hand, when the shutter button is in the ON state (when the shutter button is pressed), it is determined as YES in Step S125, and the process proceeds to Step S126.
In step S126, the main control unit 51 sets SHTF from “0” to “1” (SHIFT ← 1).
As a result, the mode switch process ends. That is, the process of step S102 in FIG. 13 is completed, and the process proceeds to step S103. In this case, since SHTF is set to “1”, it is determined as YES in the process of step S103, and the lighting mode imaging process of step S105 or the normal mode imaging process of step S106 is executed. .

The detailed flow of the mode switch process has been described above with reference to FIG. Next, a detailed flow of the write selection process in step S124 in the mode switch process described above will be described with reference to FIG.
FIG. 15 is a flowchart for explaining an example of a detailed flow of a light selection process according to the second embodiment.

In step S1241, the main control unit 51 determines whether “light NO.” Is selected.
If “light NO.” Is selected, it is determined as YES in step S1241, and the process proceeds to step S1242. If “light NO.” Is not selected, it is determined as NO in step S1241, and the process proceeds to step S1244.

  In step S1242, the main control unit 51 reads the lighting setting. Specifically, the main control unit 51 refers to the data of the imaging sequence “light NO.” Selected in step S1241 from the storage unit 38. In this embodiment, reference is made to the data of the imaging sequence of “Light No. 2” shown in FIG.

  In step S1243, the main control unit 51 turns on the backlight. Specifically, the main control unit 51 causes the display unit 21 to emit light in accordance with the “light No. 2” imaging sequence in FIG. In this way, the display unit 21 notifies the user of the operation in the lighting mode selected by emitting light in the order of the imaging sequence.

  In step S1244, the main control unit 51 determines whether or not the OK switch is turned on. Specifically, the main control unit 51 determines whether or not an OK switch (not shown) is operated. If the OK switch is operated, YES is determined in step S1244, and the process proceeds to step S125 in FIG. If the OK switch is not operated, NO is determined in step S1244, the process returns to step S1241, and the subsequent processes are repeated.

The detailed flow of the light selection process in step S124 in the mode switch process in step S2 of the imaging process in FIG. 13 has been described above.
Next, a detailed flow of the lighting mode imaging process in step S105 in the imaging process will be described with reference to FIG.
FIG. 16 is a flowchart for explaining an example of a detailed flow of the lighting mode imaging processing according to the second embodiment.

  As described above, when the lighting mode is set in the mode switch process in step S102 and SHTF is set to “1” as the shutter button is pressed, YES is determined in each process in steps S103 and S104. It is determined. As a result, the following series of processing from step S141 to step S144 is executed as the lighting mode imaging processing in step S105.

  In step S <b> 141, each unit of the imaging device 1 executes capturing of data of each image according to the imaging sequence. The fetching of data of each image is a process of fetching captured image data taken in a predetermined lighting state into the image cutout unit 61.

Specifically, the main control unit 51 turns on only the first area of the display unit 21 (turns off the second to fourth areas).
For example, it is assumed that an area 22a on the left side as viewed from the user (subject) viewing the display unit 21 is set as the first area. That is, it is assumed that such a setting is made in the imaging sequence data of FIG.
In this case, only the area 22a is turned on (the areas 22b to 22d are turned off), and the lighting state of a in FIG. 11C, that is, the left side of the user's face 100 as a subject (as viewed from the user) is irradiated. Will be in the lighting state.

Next, the main control unit 51 causes the imaging unit 22 to image the subject in a state where only the first area is lit, and the captured image data output from the imaging unit 22 as a result is used as the first image data. The image is cut out by the image cutout unit 61.
In the above example, since the image is captured in the lighting state of a in FIG. 11C, the captured image data without a shadow on the right side of the user's face 100 (as viewed by the person viewing the captured image) is the first image. The data is taken into the image cutout unit 61.

Next, the main control unit 51 turns on only the second area of the display unit 21 (the first, third, and fourth areas are turned off).
For example, it is assumed that an area 22b on the left side as viewed from the user (subject) viewing the display unit 21 is set as the second area. That is, it is assumed that such setting is made in the imaging sequence data of FIG.
In this case, only the area 22b is turned on (the areas 22a, 22c to 22d are turned off), and the lighting state shown in FIG. 11C, that is, the left side of the user's face 100 as the subject (from the user's perspective). ) Is illuminated.

Next, the main control unit 51 causes the imaging unit 22 to image a subject in a state where only the second area is fully lit, and the captured image data output from the imaging unit 22 as a result is used as second image data. The image is cut out by the image cutout unit 61.
In the above-described example, since the image is captured in the lighting state of b in FIG. 11C, the captured image data without a shadow on the left side of the user's face 100 (as viewed from the person viewing the captured image) is the second image. The data is taken into the image cutout unit 61.

Next, the main control unit 51 turns on only the third area of the display unit 21 (the first, second, and fourth areas are turned off).
For example, it is assumed that an area 22c on the left side as viewed from the user (subject) viewing the display unit 21 is set as the third area. That is, it is assumed that such a setting is made in the imaging sequence data of FIG.
In this case, only the area 22c is turned on (the areas 22a, 22b to 22d are turned off), and the lighting state of c in FIG. 11C, that is, the upper side of the user's face 100 as the subject (from the user's perspective). ) Is illuminated.

Next, the main control unit 51 causes the imaging unit 22 to image the subject in a state where only the third area is fully lit, and the captured image data output from the imaging unit 22 as a result is used as third image data. The image is cut out by the image cutout unit 61.
In the above-described example, since the image is captured in the lighting state of c in FIG. 11C, the captured image data having no shadow above the user's face 100 (as viewed from the person viewing the captured image) is the third image. The data is taken into the image cutout unit 61.

Next, the main control unit 51 turns on only the fourth area of the display unit 21 (the first to third areas are turned off).
For example, it is assumed that an area 22d on the left side as viewed from the user (subject) viewing the display unit 21 is set as the fourth area. That is, it is assumed that such a setting is made in the imaging sequence data of FIG.
In this case, only the area 22d is turned on (the areas 22a to 22c are turned off), and the lighting state of d in FIG. 11C, that is, the lower side of the user's face 100 as a subject (as viewed from the user). The lighting will be illuminated.

Next, the main control unit 51 causes the imaging unit 22 to image the subject in a state where only the fourth area is fully lit, and the captured image data output from the imaging unit 22 as a result is used as the fourth image data. The image cutout unit 61 is made to take in.
In the above example, since the image is captured in the lighting state of d in FIG. 11C, the captured image data having no shadow on the lower side of the user's face 100 (as viewed by the person viewing the captured image) is the fourth. The image data is taken into the image cutout unit 61 as image data.

  In step S142, each unit of the imaging device 1 generates combined image data by combining the data of each image according to the combining method.

Specifically, the image cutout unit 61 generates the data of the a portion on the side without a shadow as the data of the first cutout image from the data of the first image.
In the above-described example, as shown in FIG. 11C, the data of the portion a (with respect to the person viewing the captured image) without the shadow is generated as the data of the first cutout image.

Next, the image cutout unit 61 generates data of the portion b on the side having no shadow as data of the second cutout image from the data of the second image.
In the above-described example, as shown in FIG. 11C, the data of the b portion without a shadow (as viewed from the person viewing the captured image) is generated as the data of the second cutout image.

Next, the image cutout unit 61 generates, from the third image data, the data of the c portion without a shadow as the third cutout image data.
In the above-described example, as shown in FIG. 11C, the data of the c portion without the shadow (as viewed from the person viewing the captured image) is generated as the data of the third cutout image.

Next, the image cutout unit 61 generates d portion data without a shadow as data of the fourth cutout image from the data of the fourth image.
In the above-described example, as shown in FIG. 11C, the data of the d portion without a shadow (as viewed from the person viewing the captured image) is generated as the data of the fourth cutout image.

Next, the image synthesizing unit 62 generates synthesized image data by synthesizing the data of the first clipped image to the fourth clipped image.
In the above example, the image shown in FIG. 4, that is, data of an image having no shadow on the face 100 is generated as composite image data.

  In step S48, the storage control unit 52 stores the composite image data generated in the process of step S47 in the removable medium 41 or the like. Thereafter, the main control unit 51 sets SHTF to “0” (SHTF ← 0).

  Thereby, the lighting mode imaging process is completed. That is, the process of step S105 in FIG. 13 ends, and then the process proceeds to step S107.

As described above, the imaging device 1 according to the second embodiment can have basically the same hardware configuration and functional configuration as the imaging device 1 according to the first embodiment. Therefore, the second embodiment can achieve the same effect as the first embodiment.
Furthermore, in the second embodiment, four areas 21a to 21d can be set as regions to function as illumination in the display unit 21.
For this reason, it becomes possible to register in the imaging sequence data a plurality of lighting modes corresponding to each of a plurality of procedures that are different from each other in a region that functions as illumination and a change order of the region. In this case, the main control unit 51 can select one of a plurality of lighting modes registered in the imaging sequence and execute control according to the selected lighting mode.
Thereby, the user can freely and easily register a lighting mode suitable for various situations and conditions.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the image combining unit 62 is configured to combine each part of data of a plurality of captured images that are sequentially captured, but the present invention is not limited to this. For example, the imaging apparatus 1 may be configured so that a part of the captured images can be re-photographed so that the synthesis target image can be replaced before synthesis.

  In the above-described embodiment, the imaging unit 22 repeats the imaging operation a plurality of times (so-called continuous shooting) by pressing the shutter button once. However, the imaging operation of the imaging unit 22 is not limited to this. I can't. For example, the imaging apparatus 1 may be configured to perform a single imaging operation when a shutter button is pressed once. With this configuration, it is possible to perform imaging after waiting for the subject to be in a state suitable for imaging.

Moreover, the area | region made to function as illumination in the display part 21 was made into the two areas 21A and 21B in the above-mentioned 1st Embodiment, and was made into the four areas 21a thru | or the area 21d in the above-mentioned 2nd Embodiment. Not limited. That is, the number, shape, position and size in the display unit 21 and the like of the region that functions as illumination in the display unit 21 may be arbitrary.
As described above, by making the area functioning as illumination in the display unit 21 arbitrary without being fixed, it is possible to easily realize lighting patterns corresponding to various situations and conditions.

  In the above-described embodiment, the display unit 21 is configured by an LCD, but is not limited to this, and can emit light at a constant brightness (luminance) for each arbitrarily set (function as illumination) area. Any display member, that is, any display member that can function as illumination can be used. For example, the display part 21 can also be comprised with the display member which has LED (Light Emitting Diode) and an OEL (Organic Electro-Luminescence: Organic EL) element as a light source.

  In the above-described embodiment, the electronic apparatus to which the present invention is applied has been described by taking the imaging apparatus 1 such as a digital camera as an example, but is not particularly limited thereto. The present invention can be applied to general electronic devices capable of executing the scale display process described above. Specifically, for example, the present invention can be applied to a notebook personal computer, a video camera, a portable navigation device, a mobile phone device, a portable game machine, and the like.

  The series of processes described above can be executed by hardware or can be executed by software. For example, the series of processes described above can be executed by hardware or can be executed by software. In other words, the functional configuration of FIG. 3 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG. In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

  When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium. The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only configured by the removable medium 41 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. The recording medium etc. provided in The removable medium 41 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body is configured by, for example, the ROM 12 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 21 ... Display part, 22 ... Imaging part, 31 ... CPU, 32 ... ROM, 33 ... RAM, 34 ... Image processing part, 35 ... -Bus, 36 ... I / O interface, 37 ... Operation unit, 38 ... Storage unit, 39 ... Communication unit, 40 ... Drive, 41 ... Removable media, 51 ... Main control , 52... Storage control unit, 61... Image cropping unit, 62.

Claims (8)

Display means for displaying an image by emitting light from each pixel;
Imaging means for generating captured image data by imaging a subject;
Among the pixels of the display means, each pixel constituting a part of the region is caused to emit light so that the region is functioned as illumination for illuminating a part of the subject, and the subject is applied to the imaging unit. Control means for executing control for imaging;
Under the control of the control means, when each of the plurality of regions of the display means sequentially functions as the illumination, and the subject is sequentially imaged by the imaging means, a plurality of images that are sequentially generated by the imaging means For each of the captured image data, image cutout means for generating a partial area data as cutout image data,
Image combining means for generating combined image data by combining the data of the plurality of clipped images generated by the image cutting means;
An imaging apparatus comprising: The control means, as the control,
A first control for causing the imaging means to image the subject in a state where the first area of the display means functions as illumination so as to irradiate the left side of the subject and cause a shadow on the right side;
A second control for causing the imaging means to image the subject in a state where the second area of the display means functions as illumination so as to irradiate the right side of the subject and cause a shadow on the left side;
Execute each
The imaging device according to claim 1. The image cutting means is
From the captured image data generated by the imaging unit as a result of the first control of the control unit, data of an image including approximately half of the subject on which the shadow is generated is converted into the first cut-out image data. As data,
From the captured image data generated by the imaging unit as a result of the second control of the control unit, the image data including approximately half of the subject on which the shadow is generated is converted into the second cut-out image data. As data,
The image synthesizing unit generates the data of the synthesized image by synthesizing the data of the first cutout image and the second cutout image generated by the image cutout unit;
The imaging device according to claim 2. The image cutting means is
From the captured image data generated by the imaging unit as a result of the first control of the control unit, data of an image including approximately half of the subject on the side where no shadow is generated is obtained. As data,
From the captured image data generated by the imaging unit as a result of the second control of the control unit, image data including approximately half of the subject on the side where no shadow is generated is converted into the second cut-out image data. As data,
The image synthesizing unit generates the data of the synthesized image by synthesizing the data of the first cutout image and the second cutout image generated by the image cutout unit;
The imaging device according to claim 2. A holding unit that holds imaging sequence data indicating a procedure for causing the imaging unit to image the subject each time the region that functions as illumination in the display unit is changed a plurality of times and the region that functions as illumination changes. In addition,
The control means executes the control according to the imaging sequence data held in the holding means.
The imaging device according to any one of claims 1 to 4. In the imaging sequence data held in the holding means, as an operation mode of the imaging apparatus, there are a plurality of modes corresponding to each of a plurality of procedures in which the region functioning as illumination and the order of change of the region are different. Registered,
The control means selects one mode from the plurality of modes registered in the imaging sequence data, and executes the control according to the selected one mode.
The imaging device according to claim 5. Display means for displaying an image by emitting light from each pixel;
Imaging means for generating captured image data by imaging a subject;
In an imaging method executed by an imaging apparatus comprising:
Among the pixels of the display means, each pixel constituting a part of the region is caused to emit light so that the region is functioned as illumination for illuminating a part of the subject, and the subject is applied to the imaging unit. A control step for executing control for imaging;
In the state where each of the plurality of areas of the display unit sequentially functions as the illumination by the control process of the control step, when the subject is sequentially imaged by the imaging unit, a plurality of images sequentially generated by the imaging unit For each of the captured image data, an image cutting step for generating a partial area data as cut image data,
An image synthesis step of generating data of a composite image by combining the data of the plurality of cut-out images generated by the processing of the image cut-out step;
An imaging method including: Display means for displaying an image by emitting light from each pixel;
Imaging means for generating captured image data by imaging a subject;
A computer for controlling an imaging apparatus comprising:
Among the pixels of the display means, each pixel constituting a part of the region is caused to emit light so that the region is functioned as illumination for illuminating a part of the subject, and the subject is applied to the imaging unit. A control function for executing control for imaging;
In the state where each of the plurality of regions of the display unit sequentially functions as the illumination due to the display of the control function, when the subject is sequentially imaged by the imaging unit, a plurality of images sequentially generated by the imaging unit are generated. For each of the captured image data, an image cutout function for generating a partial area data as cutout image data,
An image composition function for generating data of a composite image by combining the data of the plurality of cut-out images generated by exhibiting the image cut-out function;
A program that realizes

Images