JP2005024971A - Photographing system, illumination system and illumination condition setting method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing system capable of obtaining desirable illumination states for various kinds of subjects in order to perform photographing, and to provide an illumination condition setting method. <P>SOLUTION: The photographing system is equipped with an illumination part which illuminates at least a part of a subject and whose illumination condition can be varied, a video acquiring part which acquires the video information of the subject, an illumination decision part which analyzes the illumination state for the subject based on the video information acquired by the video acquiring part and decides the propriety of the illumination state, and an illumination equipment control part which controls an illumination condition based on the result of decision by the illumination decision part. Thus, an inconvenience that the illumination state for the subject suitable for photography is not always produced corresponding to various kinds of subjects by the photographing system in the conventional manner is eliminated. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a photographing system, a lighting system, and a lighting condition setting method for a lighting system that includes a plurality of lighting devices.
[0002]
[Prior art]
Conventionally, the following techniques have been proposed as techniques for photographing a subject with illumination means. In this technique, sample images obtained by photographing various subjects under optimal illumination conditions are stored together with illumination conditions corresponding to the respective sample images. When photographing an actual subject, a sample image is read out and displayed on a display device, a sample image most suitable for the purpose of photographing is selected, an illumination condition corresponding to the optimum sample image is called, and illumination is performed under the called illumination condition. The means is controlled to illuminate an actual subject and photographed with a camera. (For example, Patent Document 1)
[0003]
[Patent Document 1]
Japanese Patent Laid-Open No. 11-24138
[0004]
[Problems to be solved by the invention]
However, the conventional technology simply reproduces the illumination state corresponding to a specific sample image selected from a limited number of sample images taken in the past. It was not always possible to create a fully optimized lighting condition for the subject.
[0005]
In addition, in the conventional technique, the photographer himself selects an optimal sample image based on an ambiguous selection criterion that cannot be accurately explained. Therefore, the optimum sample image to be selected depends on the photographer. In the end, however, the success or failure of the photo was very dependent on the eye and skill of each photographer selecting the sample image.
[0006]
Furthermore, in the conventional technique, when the positional relationship between the lighting device and the subject is changing, as in the case where the subject is not a stationary object but a moving object that moves from moment to moment, the conventional method has real-time characteristics. Because there was not, we could not cope at all.
[0007]
In addition, in the conventional technology, for example, a picture intended for a graphic effect such as increasing the brightness of only a specific part (for example, a main subject) of a subject on the screen and making it stand out from the background, or a staging effect. It was difficult to shoot.
[0008]
Furthermore, the conventional technique cannot distribute the luminance range of the subject surface illuminated by the illumination device in a balanced manner in the dynamic range of the camera image sensor.
[0009]
That is, the dynamic range of the image sensor of the camera is limited, and the normal camera has an exposure amount (exposure time, aperture) with respect to a target point of interest (for example, a main subject such as a person) based on a standard reflectance of 18%. ) Is determined, the video signal is saturated in a portion of the subject that is too bright, and the image signal is obscured. Conversely, in the portion of the subject that is too dark, the image signal is obscured. Here, when white-out occurs, for example, when halation occurs due to specular reflection or reflection of illumination light on the subject surface, or when black-out occurs, for example, the shadow of the blind spot of the illumination light appears on the subject. It includes cases that occur. In order to keep the brightness range of the entire subject within the dynamic range of the camera's image sensor in a well-balanced manner, the cameraman artificially measures the brightness from each surface of the subject while changing the orientation and brightness of the lighting device. The brightness range from each surface of the subject was adjusted to a latitude corresponding to the dynamic range of the camera image sensor, and this work was cumbersome and required high skill.
[0010]
An object of the present invention is to provide an imaging system and an illumination condition setting method that can solve any one of the above-described problems and obtain a preferable illumination state for photographing various subjects.
[0011]
Another object of the present invention is to provide an illumination system capable of illuminating a lighting object with a favorable impression.
[0012]
[Means for solving the problems]
In order to solve the above-described problems, a first aspect of the present invention includes a lighting condition variable lighting unit that illuminates at least a part of a subject, a video acquisition unit that acquires video information of the subject, Based on the video information acquired by the video acquisition unit, the lighting state of the subject is analyzed, and an illumination determination unit that determines suitability of the lighting state, and the lighting condition is controlled based on a determination result by the illumination determination unit An imaging system including a lighting device control unit.
[0013]
A second aspect of the present invention is the imaging system according to the first aspect, wherein the illumination condition includes an intensity of illumination light of the illumination unit, an illumination angle of the illumination unit with respect to the subject, and the subject of the illumination unit And at least one selected from the spectral characteristics of the illumination light.
[0014]
A third aspect of the present invention is the imaging system according to the first or second aspect, wherein the illumination determination unit determines the appropriateness of the illumination state based on screen division type photometry of the video information. is there.
[0015]
A fourth aspect of the present invention is the imaging system according to any one of the first to third aspects, wherein a main subject identifying unit that identifies a main subject in the subject, the main subject, the illumination unit, and the A relative position grasping unit for grasping a relative positional relationship with the video acquisition unit and an illumination unit self-running means for causing the illumination unit to self-run based on the relative positional relationship are provided.
[0016]
A fifth aspect of the present invention is the imaging system according to any one of the first to third aspects, wherein a main subject identifying unit that identifies a main subject in the subject, the main subject, the illumination unit, and the A relative position grasping unit for grasping a relative positional relationship with the image obtaining unit; an illuminating unit self-running means for causing the illumination unit to self-run based on the relative positional relationship; and the image obtaining unit based on the relative positional relationship. It is provided with a self-propelling means for a video acquisition unit that is self-propelled.
[0017]
A sixth aspect of the present invention is an illumination condition setting method for determining an illumination condition of an illumination system including a plurality of illumination devices that illuminates an illumination object, and first individually illuminates each illumination device individually. The characteristic is to turn off all the remaining lighting devices, illuminate the lighting object while changing the lighting conditions of each lighting device and measure the brightness of the lighting object, the lighting conditions of each lighting device and the This is obtained by obtaining the relationship with the luminance of the illumination object.
[0018]
According to a seventh aspect of the present invention, there is provided the illumination condition setting method according to the sixth aspect, wherein the control is further performed by turning off all of the plurality of illumination devices and measuring the luminance of the illumination object. This is to evaluate in advance the influence of non-target light sources.
[0019]
According to an eighth aspect of the present invention, there is provided an illumination unit having a variable illumination condition for illuminating an illumination target, a video acquisition unit for acquiring video information of the illumination target, and video information acquired by the video acquisition unit. An illumination determination unit that analyzes an illumination state of the illumination object based on the determination result and determines whether the illumination state is appropriate; and an illumination device control unit that controls the illumination condition based on a determination result by the illumination determination unit. Lighting system.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
Before explaining the imaging systems of the first to fourth embodiments and the illumination condition setting method of the fifth embodiment, the four types of illumination devices 2 used in these embodiments are shown in FIGS. The description will be given with reference.
[0021]
The illumination device 2 in FIG. 13A is of a type that can change the radiation intensity of illumination light by an external control signal, and FIG. 13B shows the illumination light by the control signal from the outside. FIG. 13C is a type that can change the illumination direction in addition to the radiation intensity. FIG. 13C further moves the illumination light within a limited range such as on the rail by an external control signal. This is a type configured to be able to vary the position where the light is emitted. FIG. 13D is a type that moves autonomously (self-propelled), illuminates by changing the position and direction of illumination light, and is used in the illumination systems of the third and fourth embodiments. These various illumination devices 2 shown in FIGS. 13A, 13B, 13C, and 13D are appropriately selected depending on the photographing application. For example, when used in a place where the limited elements are strong, such as a photo studio specialized in portrait photography, the type shown in FIG. 13A is sufficient, and an expensive angle changing mechanism and moving mechanism are unnecessary. In addition, for example, various types of illumination devices such as the type shown in FIGS. 13B and 13C are used for illumination of a main subject such as a person, and the type shown in FIG. 13D is used for a near background. You may mix and use.
[0022]
[First Embodiment]
FIG. 1 is a diagram illustrating an imaging system 10 according to the present embodiment, and FIG. 2 is a flowchart illustrating the operation of the imaging system according to the present embodiment. FIG. 3 is a diagram illustrating an example of a state in which the photographing system 10 shoots a subject while illuminating the subject, and FIG. 4 is a diagram illustrating an illumination state of a subject screen acquired at the photographing site in FIG. . The imaging system 10 of the present embodiment is preferably used when the subject is almost stationary, the image acquisition unit 1 is in a fixed position, the illumination device 2 is of the type shown in FIG. 13C, and the illumination direction is variable. And the illumination position is variable only within a limited range.
[0023]
As shown in FIG. 1, the imaging system 10 of the present embodiment includes a video acquisition unit 1, a lighting device 2, a lighting analysis determination unit 3, and a lighting device control unit 4.
[0024]
In FIG. 1, the illumination system 2 of the type shown in FIG. 13C is installed at a predetermined position around the subject 5 in the photographing system 10 of the present embodiment, and illuminates each part of the subject.
[0025]
An example of how the illumination device 2 illuminates the subject is shown in FIG. In FIG. 3, lighting devices 2- (1), 2- (2), 2- (3), 2- (4), and 2- (5) are respectively viewed from the right side of the main subject and the middle scene. Illumination from the left of the main subject and the middle scene, foreground illumination, right near background illumination, and left near background illumination are appropriately shared. As described above, each lighting device 2 divides and illuminates the subject 5 in a location, and illuminates so that there are as few places where the subject 5 as a whole is not illuminated as much as possible, and as few as possible where there are overlapping illuminations. Direction and lighting position are adjusted in advance. However, a portion of the subject 5 that is illuminated with natural light, such as a distant view, is not subject to illumination by the lighting device 2. Thus, an example of the relationship between the area illuminated by each of the lighting devices 2- (1), 2- (2), 2- (3), 2- (4), 2- (5) and the subject screen As shown in FIG. The subject screen shown in FIG. 4 is divided into five areas (that is, areas of illuminations A to E) and one distant view area.
[0026]
The image acquisition unit 1 of the imaging system 10 of the present embodiment includes a plurality of photodetectors that extend in two dimensions, receives the subject light 6, and outputs the video signal 7 of the subject 5 to the illumination analysis determination unit 3. As the video acquisition unit 1, a CCD or CMOS type imaging device that finally captures an image can be used. The video acquisition unit 1 has a small number of pixels (that is, the number of photodetectors) dedicated to the detection of the illumination state, apart from an image pickup device that finally captures an image with an emphasis on processing speed and readability at an arbitrary position. If a CMOS type imaging device (for example, having a maximum of several thousand pixels at the maximum) is provided, a more preferable photographing system can be configured. In the case where an imaging device dedicated for illumination state detection is provided as the video acquisition unit 1, the subject field of the final imaging device for image capturing is exactly matched with the subject field of the imaging device dedicated for illumination state detection.
[0027]
The illumination analysis determination unit 3 of the imaging system 10 of the present embodiment has a plurality of (for example, 9 × 7 = 63) video screens (hereinafter referred to as subject screens) of the video signal 7 of the subject 5 input from the video acquisition unit 1. Divide into split screens.
[0028]
FIG. 4 shows the subject screen, the above-described divided screen, and the lighting devices 2- (1), 2- (2), 2- (3), 2- (4), and 2- (5). An example of the relationship is shown. The divided screen signal may be divided so that the boundaries overlap as necessary. As this photometry technique, for example, the Nikon F5 (trade name) camera 3D-RGB multi-pattern photometry technique of Nikon Corporation can be used.
[0029]
The illumination analysis determination unit 3 of the imaging system 10 according to the present embodiment determines whether the illumination state of the subject 5 is good based on the divided screen signal. Examples of the determination criteria include the following. The first is whether or not the luminance in the divided screen is within a predetermined range. It is determined that the luminance in all the divided screens is within the predetermined range 1, and the lighting state is determined to be negative if there is at least one divided screen in which the luminance in the divided screen is partly outside the predetermined range 1. The second is a determination as to whether or not the luminance of each divided screen is balanced as a whole subject screen. For this determination, the average luminance of each divided screen is calculated, and it is determined whether or not this average luminance is within the predetermined range 2. Here, the predetermined range 2 is narrower than the predetermined range 1 and is included in the predetermined range 1. If the average luminance of each divided screen is within the predetermined range 2, it is acceptable.
[0030]
Here, the predetermined range 1 and the predetermined range 2 are a subject luminance latitude range that can correspond to the dynamic range of the image sensor of the final shooting camera, and a drawing concept set by the photographer in advance (for example, in anticipation of the video effect). The contrast is intentionally enhanced by, for example, increasing the luminance of the subject over the background).
[0031]
The illumination analysis determination unit 3 of the imaging system 10 according to the present embodiment analyzes the illumination state by the method as described above, and determines and outputs a determination signal 8 to the illumination device control unit 4. The determination signal 8 is a signal indicating whether the illumination state is good for each divided screen (that is, for each coordinate position of the divided screen), and when the illumination state is negative, from the center value of the predetermined range 1 or the center value of the predetermined range 2. A differential signal is included. Hereinafter, the center value of the predetermined range 1 and the center value of the predetermined range 2 are simply referred to as reference values in the present specification.
[0032]
The lighting device control unit 4 of the photographing system 10 of the present embodiment compares the coordinate position of the divided screen and the number of the lighting device 2 (indicated by (1), (2), (3), (4), and (5) in FIG. 1). A table indicating the correspondence relationship is stored, and the number of the target lighting device 2 that indicates that the lighting state is negative and the lighting condition needs to be changed is identified from the input determination signal 8 with reference to this table. To do. The illumination device control unit 4 calculates the change amount of the illumination condition from the difference signal. This change amount is an amount corresponding to the relative change amount of the radiation intensity of the illumination light of the illumination device 4 subject to illumination adjustment. The change amount, the input control signal of the illumination device 2 acquired in advance, the illumination light intensity, Based on the relationship, the magnitude of the control signal 9 for changing to an appropriate luminance is calculated, and the changed control signal 9 is output to the target lighting device 2.
[0033]
For example, with respect to the halation part X at the coordinate position (6, 4) shown in FIG. 4, the amount of illumination light of the illumination device (2- (1)) for the main subject illumination A is reduced to eliminate high luminance. Output a control signal. For the halation part Y at the coordinate position (8, 2), a control signal for eliminating the high luminance by reducing the illumination light quantity of the illumination device (2- (4)) for the near background illumination D is output. To do. Further, a control signal is output to the shadow portion at the coordinate position (3, 7) so as to eliminate the low luminance by increasing the illumination light quantity of the illumination device (2- (3)) of the foreground illumination C.
[0034]
The radiation intensity of the illumination light of the target illumination device 2 changes according to the control signal 9, and the brightness of the target divided screen is optimized.
[0035]
In the imaging system of the present embodiment, the radiation intensity of illumination light is changed with the first priority when there is a problem with the brightness of any of the divided screens and correction is required. By doing in this way, the brightness | luminance of an object division | segmentation screen can be corrected, without changing the range of an irradiation area | region.
[0036]
The illumination direction of the target illumination device 2 is changed with the second priority only when the luminance of the target divided screen cannot be effectively corrected only by adjusting the radiation intensity of the illumination light performed with the first priority. For example, when the divided screen to be subjected to luminance correction is located at the end of the irradiation area of the target illumination device 2, the illumination direction is set so that the divided screen to be subjected to luminance correction is located in the middle of the illumination area of the target illumination device 2. If it changes, the brightness | luminance of object division | segmentation screen can be corrected effectively by adjustment of the radiation intensity of illumination light. Further, when a specular reflection portion is generated on the target divided screen, the specular reflection portion can be corrected so as not to exist on the subject screen by changing the illumination direction of the target lighting device 2.
[0037]
The illumination position of the illumination device 2 is changed only when the brightness cannot be adjusted effectively even if the illumination direction is adjusted. This change of the illumination position is effective in eliminating the shadow when, for example, a shadow of illumination is generated on the subject 5 surface.
[0038]
In order to adjust the improper luminance portion on the subject screen as finely as possible, it is preferable that the number of divided screens is as large as possible within the range allowed by the calculation processing speed and as fine as possible.
[0039]
The operation of the imaging system 10 of this embodiment will be described below with reference to the flowchart shown in FIG. 2 and FIG.
[0040]
In step S1, the initial illumination conditions of the illumination device 2 are set to illuminate the subject 5, and the operation proceeds to step S2. In this initial lighting condition, as described above, each lighting device 2 divides and illuminates the subject 5 in a place, and the number of places where the entire subject is not illuminated is as small as possible, and the places are illuminated in duplicate. The illumination direction and the illumination position are adjusted so as to reduce as much as possible. The radiant intensity of the illumination light from the illuminating device 2 is not particularly limited.
[0041]
In step S2, the video acquisition unit 1 receives the subject light 6 to acquire a video signal, outputs video signals 7 of a plurality of divided screens divided from the subject screen to the illumination analysis determination unit 3, and the operation proceeds to step S3. Transition.
[0042]
In step S3, the illumination analysis determination unit 3 analyzes the luminance range of each divided screen and the average luminance of each divided screen based on the video signal 7, and moves the operation to step S4.
[0043]
In step S4, illumination determination is performed. That is, it is determined whether the brightness of each divided area is appropriate (good) or inappropriate (not) by comparing with the predetermined range 1 and the predetermined range 2 stored in advance. If not, the operation proceeds to step S6.
[0044]
If other photographing preparations such as focusing are completed in step S5, photographing recording is performed.
[0045]
In step S6, a divided area having an inappropriate luminance is specified, a difference signal from the reference value of the inappropriate luminance value is obtained, and the operation proceeds to step S7.
[0046]
In step S7, the lighting device 2 corresponding to the divided screen with inappropriate luminance is identified with reference to the table describing the relationship between the coordinate position of the divided screen and the number of the lighting device 2, and the operation proceeds to step S8.
[0047]
In step S8, a new control signal for a new lighting condition is obtained based on the difference signal obtained in step S6 and a table of the relationship between the magnitude of the input control signal of the lighting device 2 and the luminance signal of the corresponding divided screen that are acquired and stored in advance. The operation is shifted to step S9.
[0048]
For example, with respect to the halation part X at the coordinate position (6, 4) shown in FIG. 4, the amount of illumination light of the illumination device (2- (1)) for the main subject illumination A is reduced to eliminate high luminance. Generate a control signal. For the halation part Y at the coordinate position (8, 2), a control signal is generated so as to eliminate the high luminance by reducing the illumination light amount of the illumination device (2- (4)) for the near background illumination D. To do. In addition, for the shadow portion at the coordinate position (3, 7), a control signal is generated so as to eliminate the low luminance by increasing the intensity of the illumination light of the illumination device (2- (3)) of the foreground illumination C. To do.
[0049]
In step S9, a new control signal is output to the illumination device, the subject 5 is illuminated under the new illumination conditions, and the operation proceeds to step S2.
[0050]
The above operation is repeated until the illumination determination becomes good in step S4. If the illumination determination becomes good, the final shooting is performed as soon as other conditions are satisfied.
[0051]
FIG. 5 is a diagram showing a photograph taken in this way, in which a flower and a vase are taken together with the background as main subjects.
[0052]
Depending on the type of subject, even if the flow of FIG. 2 is repeated, the illumination state may not be improved as expected, and the illumination determination may not be good. At this time, an alarm is issued to change the radiation direction of illumination light and the radiation position of illumination light in addition to the radiation intensity of illumination light. This change may be made automatically or artificially by observing the acquired image on a monitor screen. Further, the illumination determination criterion itself may be relaxed by expanding the predetermined range 1 or the predetermined range 2 or increasing the reference value as necessary.
[0053]
In the imaging system of the present embodiment, the luminance of the divided screen divided from the subject screen is analyzed to determine whether the lighting state is good or not, and the lighting adjustment is performed so that the lighting state is good in units of divided screens. The brightness can be kept within the latitude range, and a preferable photograph can be taken.
[0054]
[Second Embodiment]
The imaging system of this embodiment is shown in FIG. The imaging system of this embodiment is the same as that of the first embodiment in that it is preferably applied when the subject is stationary, but the imaging system of this embodiment identifies the main subject from the subject 5. This is different from the photographing system of the first embodiment in that the illumination adjustment is performed with priority on the main subject.
[0055]
Hereinafter, the imaging system of this embodiment will be described with reference to FIG. The imaging system 10 of this embodiment includes a video acquisition unit 1, an illumination device 2, an illumination analysis determination unit 3, an illumination device control unit 4, and a main subject identification unit 13.
[0056]
Since the illumination device 2 of the imaging system 10 of the present embodiment is the same as the illumination device 2 of the imaging system 10 of the first embodiment, the description thereof is omitted.
[0057]
In addition, the video acquisition unit 1 of the imaging system 10 of the present embodiment acquires the video signal 7 of the subject 5 in the same manner as the video acquisition unit 1 of the imaging system 10 of the first embodiment. This video signal 7 is output to the subject identification unit 13.
[0058]
The main subject identifying unit 13 of the photographing system 10 of the present embodiment analyzes the video signal 7 and identifies the main subject from the subject screen. When it is known in advance that the main subject is a person, for identification of this person, for example, Isao Baba, et al., “HeadFinder: Multi-person tracking using monocular moving image, image sensing” Symposium 2001, pages 363 to 368, (2001) "can be used. This technique is based on the hypothesis that “the moving circle in a normal scene is the head of a person”, and finds a moving circle from the image and considers the found circle as the head of the subject. It is a method of identifying a person by. In addition to this, a human part is found in the subject screen using techniques such as skin color identification, contour detection, difference detection with the previous screen, or temperature measurement using infrared rays, and this human part is used as the main subject, and the rest Divide the part as background. Next, the divided screen on which the main subject is located on the subject screen is specified. Not only the divided screen in which the main subject is entirely positioned but also the divided screen in which the main subject is partially positioned is classified as the main subject divided screen. The remaining divided screens in the subject screen are classified as background divided screens. A segmentation signal 14 describing segmentation information between the main subject division screen and the background division screen is output to the illumination analysis determination unit 3.
[0059]
The illumination analysis determination unit 3 of the imaging system 10 according to the present embodiment determines the quality of the illumination on the subject 5 based on the video signal 7 and the segmentation signal 14 received from the video acquisition unit 1. This determination method is basically the same as the determination method in the first embodiment, but the imaging system of this embodiment has a predetermined range 1 and a predetermined range 2 between the main subject division screen and the background division screen. Characterized by different sizes. That is, a narrower allowable range is set for the main subject division screen than for the background division screen, and brightness adjustment (ie, illumination) is given priority to the main subject division screen over the background division screen. Adjustment).
[0060]
The illumination analysis determination unit 3 of the imaging system 10 of the present embodiment analyzes and determines the illumination state by the method as described above, and then outputs a determination signal 8 to the illumination device control unit 4. The determination signal 8 includes a quality signal for the illumination state for each divided screen (that is, for each coordinate position of the divided screen), and a difference signal from the reference value when the illumination state is negative.
[0061]
Since the illumination device control unit 4 of the imaging system 10 of the present embodiment is the same as the illumination device control unit of the imaging system of the first embodiment, the description thereof is omitted.
[0062]
The operation of the imaging system 10 of this embodiment will be described below with reference to the flowchart shown in FIG. 8 and FIG.
[0063]
First, in step S1, an initial illumination condition is set to illuminate the subject 5, and the operation proceeds to step S2. The initial illumination condition setting method is the same as that in the first embodiment.
[0064]
In step S2, the video acquisition unit 1 receives subject light to acquire a video signal, outputs this video signal 7 to the illumination analysis determination unit 3 and the main subject identification unit 13, and the operation proceeds to step S3.
[0065]
In step S3, a person (namely, main subject) is identified from the subject screen, and the operation proceeds to step S4.
[0066]
In step S4, the main subject and the background are separated, that is, the main subject and the background are distinguished to acquire the video signal of the divided screen, and the operation proceeds to step S5.
[0067]
In step S5, the luminance of the background divided screen is analyzed, and the operation proceeds to step S6.
[0068]
In step S6, it is determined whether the luminance of the background divided screen is within the reference value. If not, the operation proceeds to step S7.
[0069]
In step S7, a divided screen with an inappropriate luminance is specified, and the operation proceeds to step S8.
[0070]
In step S8, referring to the table showing the relationship between the coordinate value of the divided screen and the number of the lighting device, the lighting device corresponding to the divided screen having an inappropriate luminance is specified, and the operation proceeds to step S9.
[0071]
In step S9, based on the difference signal from the reference value of the luminance of the divided screen whose luminance is inappropriate and the table of the relationship between the magnitude of the input control signal of the lighting device and the luminance signal of the corresponding divided screen that are acquired and stored in advance. A new control signal is calculated, and the operation proceeds to step S10.
[0072]
In step S10, the illumination device is illuminated under the illumination condition corresponding to the new control signal, and the operation proceeds to step S5.
[0073]
In step S11, the luminance of the divided screen of the main subject is analyzed, and the operation proceeds to step S12.
[0074]
In step S12, it is determined whether or not the luminance of the divided screen of the main subject is within the reference value. If good, the operation proceeds to step S13, and if not, the operation proceeds to step S7.
[0075]
In order to speed up the response, it is also possible to shift from step S4 directly to the operation of step S11 without performing background illumination determination, and adjust the illumination of only the main subject.
[0076]
In the photographing system of the present embodiment, the main subject such as a person is preferentially adjusted in lighting, so that the brightness of the main subject such as a person can be kept within the latitude range and a preferable photograph can be taken.
[0077]
[Third Embodiment]
The imaging system of this embodiment is shown in FIG. The imaging system of the present embodiment is intended for a moving main subject, and the video acquisition unit 1 is set at a fixed position, and has a self-propelled device for the main subject such as a moving person entering the frame. The illumination device 2 moves around and moves to the optimum position to illuminate the main subject. The photographing system of the present embodiment is the same as the photographing system of the second embodiment in that the main subject is cut out from the subject 5, and the photographing system of the present embodiment performs illumination adjustment only for the main subject.
[0078]
Hereinafter, the imaging system of this embodiment will be described with reference to FIG. The imaging system 10 of this embodiment includes a video acquisition unit 1, a main subject identification unit 13, an illumination analysis determination unit 3, a relative position determination unit 16, a main control unit 18, a lighting device control unit 4, and a lighting device 2 with a self-propelled device. It consists of.
[0079]
The illumination device 2 of the imaging system 10 of the present embodiment is the same as the illumination device 2 of the imaging system 10 of the first embodiment in that the radiation intensity of illumination light is changed based on a control signal 9 input from the outside. In the present embodiment, the illumination device 2 further includes a moving unit that can freely move based on the control signal 9 without being limited to a rail position at a position suitable for illuminating the main subject.
[0080]
The video acquisition unit 1 of the imaging system 10 of the present embodiment outputs the video signal 7 of the subject 5 to the illumination analysis determination unit 3 and the main subject identification unit 13.
[0081]
Since the method of identifying the main subject by the main subject identifying unit 13 of the imaging system 10 of the present embodiment is the same as the method already described in the second embodiment, description thereof is omitted. The main subject identification unit 13 of the present embodiment is the same as the imaging system of the second embodiment in that it outputs the segmentation signal 14 to the illumination analysis determination unit 3, but in addition, the main subject identification signal 15 is sent to the main control unit. 18 is output. The main subject identification signal is a signal for identifying the main subject on the subject screen.
[0082]
The illumination analysis determination unit 3 of the imaging system 10 according to the present embodiment determines the quality of illumination on the main subject based on the video signal 7 and the segmentation signal 14 received from the video acquisition unit 1. Since this criterion is the same as the method already described in the first embodiment, the description is omitted.
[0083]
The illumination analysis determination unit 3 of the imaging system 10 of the present embodiment analyzes and determines the illumination state of the main subject as described above, and outputs the determination signal 8 to the main control unit 18. This determination signal 8 includes a quality signal for the illumination state for each divided screen of the main subject (ie, for each coordinate position of the divided screen), and each difference signal from the reference value if the illumination state is negative.
[0084]
The relative position grasping unit 16 of the photographing system according to the present embodiment detects the relative positions among the main subject, the video acquisition unit 1, and the illumination device 2, and outputs the relative position signal 16 to the main control unit 18. In order to grasp the relative position, a stereo camera, a GPS, a gyro sensor, or the like that processes an image and identifies a main subject in the subject can be used. The relative position grasping by the GPS or gyro sensor can be performed, for example, by taking the difference between the position signals acquired by the GPS or the gyro sensor included in each of the main subject, the video acquisition unit 1 and the illumination device 2. . If there is another means for grasping based on the relative position of the main subject such as a person with respect to the video acquisition unit 1 by image processing for analyzing the video signal of the subject, the main subject such as a person needs to have a position acquisition means. There is no.
[0085]
In the main control unit 18 of the imaging system 10 of the present embodiment, the relation data between the input control signal of the illumination device 2 and the illumination light intensity, the angle characteristic data of the radiation intensity of the illumination light, and the illuminance calculation on the object plane are previously stored. Formula data is acquired and stored in advance. Based on these data, the relative position signal 17, the main subject identification signal 15, and the determination signal 8, the movement plan and the lighting plan of the lighting device 2 are made, and the movement plan and the lighting plan signal 19 are output to the lighting device control unit 4. To do.
[0086]
The lighting device control unit 4 of the photographing system 10 according to the present embodiment generates a control signal 9 based on the movement plan and the lighting plan signal 19 and outputs the control signal 9 to the lighting device 2.
[0087]
Hereinafter, the operation of the photographing system 10 of the present embodiment will be described with reference to the flowchart shown in FIG. 10 and FIG.
[0088]
First, in step S1, an initial arrangement of the lighting device, the video acquisition unit, and the subject (or a background when the main subject is not in the frame) is performed, an initial illumination condition is set, the subject 5 is illuminated, and the operation is performed in step S2. Migrate to The initial illumination condition setting method is the same as that in the first embodiment.
[0089]
In step S2, the video signal is acquired by the video acquisition unit.
[0090]
In step S3, when a main subject such as a person has moved into the frame and already exists, the main subject is identified from the subject screen, and the operation proceeds to step S4.
[0091]
In step S4, the main subject and the background are separated, that is, the main subject and the background are distinguished to acquire the video signal of the divided screen, and the operation proceeds to step S5.
[0092]
In step S5, it is determined whether or not the luminance of the divided screen of the main subject is within the reference value. If not, a divided screen having an inappropriate luminance is specified, and the operation proceeds to step S7.
[0093]
In step S7, the relative positions of the main subject, the video acquisition unit, and the lighting device at this time are grasped, and the operation proceeds to step S8. The main subject is also located relative to the subject screen.
[0094]
In step S8, the main controller performs a lighting equipment movement plan and a lighting plan.
[0095]
In step S9, the lighting device control unit moves the lighting device to a preferred position for illuminating the main subject, and performs control for illuminating the lighting device with an appropriate emitted light intensity.
[0096]
In the imaging system of the present embodiment, when the main subject moving to the image acquisition unit jumps in, the illumination device moves to a preferred position and illuminates with an appropriate emitted light intensity, so that the luminance of the main subject is within the latitude range. You can adjust to the desired picture.
[0097]
[Fourth Embodiment]
The imaging system of this embodiment is shown in FIG. The imaging system of the present embodiment is the same as the imaging system of the third embodiment in that it is intended for a moving main subject, but both the video acquisition unit 1 and the lighting device 2 are used as main subjects such as people. On the other hand, it differs from the imaging system of the third embodiment in that it has both self-propelled means for moving to the optimum position.
[0098]
Hereinafter, the imaging system 10 of the present embodiment will be described with reference to FIG. The imaging system 10 of the present embodiment includes a video acquisition unit 1, a main subject identification unit 13, an illumination analysis determination unit 3, a relative position determination unit 16, a main control unit 18, a lighting device control unit 4, and a video acquisition unit control unit 24. It is comprised from the lighting equipment 2 with a self-propelled means, and the image | video acquisition part 1 with a self-propelled means.
[0099]
The lighting device 2 of the photographing system 10 of the present embodiment is the same as the lighting device 2 of the photographing system 10 of the third embodiment in that the lighting device 2 is self-propelled upon receiving the lighting device control signal 9 and illuminates. .
[0100]
Since the image acquisition itself of the image acquisition unit 1 of the imaging system 10 of the present embodiment is the same as that of the image acquisition unit of the imaging system of the first embodiment, description thereof is omitted. The video acquisition unit 1 of the imaging system 10 of the present embodiment moves based on the video acquisition unit control signal 22 generated based on the relative position of the main subject with respect to the video acquisition unit 1, and moves to change the orientation of the camera. With In addition, the video acquisition unit 1 of the imaging system 10 of the present embodiment outputs the video signal 7 to the illumination analysis determination unit 3 and the main subject identification unit 13.
[0101]
Since the method of identifying the main subject by the main subject identifying unit 13 of the imaging system 10 of the present embodiment is the same as the method already described in the third embodiment, description thereof is omitted.
[0102]
The illumination analysis determination unit 3 of the imaging system 10 of the present embodiment determines the quality of the illumination on the main subject based on the video signal 7 input from the video acquisition unit 1 and the segment signal 14 input from the main subject identification unit 13. The determination signal 8 is output to the main control unit. Since this determination method is the same as the method already described in the first embodiment, the description thereof is omitted.
[0103]
The relative position grasping unit 16 of the photographing system 10 according to the present embodiment detects the relative position among the main subject, the video acquisition unit 1, and the illumination device 2, and outputs the relative position signal 17 to the main control unit 18. Since the relative position grasping method is the same as the method already described in the third embodiment, the description thereof is omitted here.
[0104]
In the main control unit 18 of the imaging system 10 of the present embodiment, the relation data between the input control signal of the illumination device 2 and the illumination light intensity, the angle characteristic data of the radiation intensity of the illumination light, and the illuminance calculation on the object plane are previously stored. Expression data is acquired and stored in advance. Based on these data, the relative position signal 17, the main subject identification signal 15, and the determination signal 8, a movement plan and a lighting plan for the lighting device 2 are made and moved. The plan and lighting plan signal 19 is output to the lighting device control unit 4.
[0105]
The main control unit 18 acquires the relative position of the main subject with respect to the video acquisition unit 1 based on the main subject identification signal 15. The direction of the relative position is detected by the position of the person (main subject) on the subject screen, and the distance is detected by the size of the head of the person. Of course, the relative position of the main subject with respect to the video acquisition unit 1 may be acquired based on the relative position signal 17. The main control unit 18 outputs a video acquisition unit movement plan signal 21 to the video acquisition unit control unit 24 based on this relative position and a predetermined shooting composition.
[0106]
The lighting device control unit 4 of the photographing system 10 according to the present embodiment generates the lighting device control signal 9 based on the movement plan and the lighting plan signal 19 and outputs the lighting device control signal 9 to the lighting device 2.
[0107]
The video acquisition unit control unit 24 of the imaging system of the present embodiment generates a video acquisition unit control signal 22 based on the video acquisition unit movement plan signal 21 and outputs the video acquisition unit control signal 22 to the video acquisition unit 1.
[0108]
Transmission of the lighting device control signal 9 and the video acquisition unit control signal 22 to each controlled object may be either wireless or wired.
[0109]
Note that the video acquisition unit 1 of the imaging system of the present embodiment has a self-running means, but other main subject identification unit 13, illumination analysis determination unit 3, main control unit 18, lighting device control unit 4, video acquisition unit. Any one or more of the control units 24 may self-run together with the video acquisition unit 1.
[0110]
Hereinafter, the operation of the photographing system 10 of the present embodiment will be described with reference to the flowchart shown in FIG.
[0111]
First, in step S1, the video acquisition unit is positioned at an initial predetermined position (may be an arbitrary position), and the lighting device performs initial illumination (may have zero radiation intensity) from an initial predetermined position (may be an arbitrary position). Operation proceeds to step S2.
[0112]
In step S2, the video acquisition unit acquires a video signal, and the operation proceeds to step S3.
[0113]
In step S3, a main subject such as a person on the subject screen of the video signal is identified, its position is specified, and the operation proceeds to step S4.
[0114]
In step S4, the divided screen of the main subject and the divided screen of the main subject are separated from the subject screen to obtain a divided screen signal, and the operation proceeds to step S5.
[0115]
In step S5, the video acquisition unit is moved based on the position of the main subject specified in step S3 so as to obtain a predetermined shooting composition, and the operation proceeds to step S4.
[0116]
In step S6, whether or not the illumination state of the main subject is good is determined. If good, the operation proceeds to step S10, and if not, the operation proceeds to step S7.
[0117]
In step S7, the relative positional relationship among the main subject, the video acquisition unit, and the lighting device is grasped, and the operation proceeds to step S8.
[0118]
In step S8, an illumination plan for performing preferable illumination is made based on the relative positional relationship, and the operation proceeds to step S9.
[0119]
In step S9, the lighting device moves to a preferred position, performs illumination with a preferred radiation intensity, and proceeds to step S2.
[0120]
In step S10, photographing is recorded as necessary.
[0121]
In order to better grasp the concept of the imaging system 10 of the present embodiment, the simplest example will be described with reference to FIG.
[0122]
In this example, two illumination devices 2 illuminate the main subject 23 from the left side and the right side. Reference numeral 25 denotes a subject range (imaging range) of the video acquisition unit 1. In this state, the photographing system adjusts the lighting state, and when the main subject moves to the upper left toward the position indicated by “x”, the video acquisition unit 1 and the lighting device 2 move in parallel with each other in a relative positional relationship. Move and illuminate while holding
[0123]
The imaging system of the present embodiment grasps the relative positional relationship among the main subject, the video acquisition unit, and the lighting equipment, and the video acquisition unit and the illumination unit can move together, so it is optimal for the moving main subject as well. While tracking at the position and the optimum angle, the luminance range of the main subject can be adjusted within the latitude to continue taking favorable pictures.
[0124]
[Fifth Embodiment]
The present embodiment relates to an illumination condition setting method for determining illumination conditions of a plurality of illumination devices 2 that illuminate a subject 5 in an imaging system as shown in FIGS. 1, 7, 9, and 11. is there. In general, the cause of high luminance such as halation is not the reflection of the illumination light emitted from the lighting device 2, but the light emission of the subject itself or the light source (sunlight or room light) that is not controlled. is there. As a countermeasure, first, before performing optimization control, all lighting devices are turned off and only lighting effects created by light sources other than controllable lighting devices are recognized and analyzed. First of all, it is necessary to know whether it is caused by the problem. If it is possible to avoid lighting problems by controlling the lighting device group, grasp the lighting characteristics and lighting area of each lighting device, and optimize the lighting by the method described in the first to fourth embodiments. If not, a warning is issued to inform the photographer that the shooting environment itself will be reviewed.
[0125]
The illumination condition setting method of this embodiment will be described with reference to the flowchart shown in FIG.
[0126]
First, in step S1, lighting device 2- (1), lighting device 2- (2), lighting device 2- (3), lighting device 2- (4), and lighting device 2- (5) are all turned off, and step S2 Migrate the operation.
[0127]
In step S2, a video signal (luminance) of the divided screen of the subject video is acquired, and the operation proceeds to step S3. If it is determined at this stage that the luminance problem cannot be resolved only by controlling the lighting device, an alarm is issued to the photographer.
[0128]
In step S3, the luminance signal of the divided screen is stored in the storage device, and the operation proceeds to step S4.
[0129]
In this way, the influence of sunlight and self-luminous objects that are not controlled is acquired in advance and stored.
[0130]
In step S4, one target lighting device is turned on, and the operation proceeds to step S5. Non-target lighting equipment remains off.
[0131]
While increasing the control signal to the target lighting device in step S5, the luminance signal of the divided screen corresponding to the lighting region shared by the target lighting device is acquired, and the magnitude of the control signal and the lighting region shared by the target lighting device The relationship with the size of each luminance signal of all the divided screens corresponding to is acquired, and the operation proceeds to step S6. When the luminance signal of the divided screen is a signal from a plurality of photodetectors, the average value of these signals is usually used as the luminance signal of the divided screen because of the number of data.
[0132]
In step S6, the luminance signal from the light source other than the control target stored in step S3 is subtracted from the luminance signal of the divided screen acquired in step S5, and the size of the control signal to the target lighting device and the illumination shared by the target lighting device The relationship with the magnitude of the net luminance signal of the divided screen corresponding to the area is acquired, and the operation proceeds to step S7.
[0133]
In step S7, the relationship between the control signal for the lighting device acquired in step S6 and the net luminance signal of the divided screen is stored as a control signal-luminance signal table.
[0134]
This relationship is called in step S8 in the flowchart of the operation of the imaging system of the first embodiment shown in FIG. 2, and is a difference signal, a current control signal, and a table of the called control signal-luminance signal relationship. To determine the magnitude of the new control signal.
[0135]
According to the lighting condition setting method of the present embodiment, since the relationship between the magnitude of the control signal of each control device and the brightness of the corresponding divided screen is acquired, the magnitude of the control signal to the lighting device is set. As a result, the luminance range of the subject can be accurately set within the predetermined range 1 or the predetermined range 2.
[0136]
In addition, according to the illumination condition setting method of the present embodiment, if the influence of the light source that is not controlled in steps S1, S2, and S3 is evaluated in advance, the luminance range of the subject can be more accurately and accurately determined. It can be within the predetermined range 1 or the predetermined range 2.
[0137]
As described above, according to the imaging systems of the second to fourth embodiments, the main subject is identified, and the relative positional relationship such as “main subject” and “background (= distant view, middle view or other target object, close view)” is determined. Since it is clear, it is possible to obtain various effects such as, for example, enhancing the illumination light only on the main subject to enhance the brightness contrast with the background.
[0138]
As described above, in the first to fifth embodiments, the description has been given of the case of shooting with a shooting device such as a camera. However, the techniques of the first to fifth embodiments not only record or output the video acquired by the video acquisition unit for viewing, but also illuminate the audience on the spot, such as a concert or a stage. It can be easily understood that it is also effective when viewing the stage itself. (For example, the lighting of the background is turned off in synchronization with the situation of each scene of the stage play, and a specific actor (main subject) is illuminated and tracked to keep the speaker standing up. Is possible.)
For example, the techniques described in the first to fifth embodiments can be applied to a lighting system that illuminates the stage in the theater as follows. At this time, the video acquisition unit is provided at the representative position of the spectator seat and is used not only for taking a picture but only for specifying the position of an object such as a person instead of the main subject. The video acquisition unit is adjusted so that the lens is directed to the stage and the video of the entire stage is stored on the screen. Then, a moving person (main subject) on the stage is identified by the above-described image processing technology, and a position is specified. Based on this specified position, a lighting effect that gives a lighting effect with a favorable impression as viewed from the audience Find the position, direction, and intensity of the illumination light. If a control signal is sent to a lighting device with a self-propelled means and controlled so as to ensure the position, direction, and illumination light intensity thus obtained, an illumination system capable of being automatically illuminated can be constructed. According to such an illumination system, since the illumination is adjusted based on the result of photometry of the object for each divided screen, the luminance range of the object can be adjusted to the luminance range of an impression preferable for the audience.
[0139]
In addition, all modifications that can be easily inferred from the description of the present embodiment are included in the scope of the right of the present invention.
[0140]
【The invention's effect】
According to the photographing system of the present invention, since the illumination of the subject is adjusted based on the video information acquired from the subject, the luminance range of each unit is set to an appropriate latitude corresponding to the dynamic range of the video acquisition unit for a wide variety of subjects. You can adjust the range to take a good picture.
[0141]
In addition, according to the illumination system of the present invention, since the illumination is adjusted based on the video information acquired from the object, the luminance range of each part of the object can be adjusted to the luminance range of the impression preferable for the audience.
[0142]
Moreover, according to the illumination condition setting method of the present invention, the luminance range of the object can be accurately set within a predetermined range.
[Brief description of the drawings]
FIG. 1 is a block diagram of a photographing system according to a first embodiment.
FIG. 2 shows a flowchart of the operation of the photographing system of the first embodiment.
FIG. 3 shows a state of photographing with the photographing systems of the first and second embodiments.
FIG. 4 is a diagram illustrating a subject screen, a divided screen, a shared area of each lighting device, a non-illuminated area, and a lighting defect.
FIG. 5 shows a subject screen or a photograph taken with a lighting defect eliminated.
FIG. 6 is a flowchart illustrating an illumination method determination method according to a fifth embodiment.
FIG. 7 is a block diagram of a photographing system according to a second embodiment.
FIG. 8 shows a flowchart of the operation of the imaging system of the second embodiment.
FIG. 9 is a block diagram of a photographing system according to a third embodiment.
FIG. 10 shows a flowchart of the operation of the imaging system of the third embodiment.
FIG. 11 is a block diagram of a photographing system according to a fourth embodiment.
FIG. 12 shows a flowchart of the operation of the photographing system of the fourth embodiment.
FIG. 13 shows four types of lighting devices.
FIG. 14 shows a simplified concrete example of the imaging system of the fourth embodiment.
[Explanation of symbols]
1 Video acquisition unit
2 Lighting equipment
3 lighting analysis judgment part
4 Lighting equipment control unit
5 Subject
6 Subject light
7 Video signal
8 Judgment signal
9 Lighting equipment control signal
10 Shooting system
11 Illumination direction variable mechanism
12 Illumination position variable mechanism
13 Main subject identification part
14 Classification signal
15 Main subject identification signal
16 Relative position grasper
17 Relative position signal
18 Main control unit
19 Movement plan and lighting plan signal
21 Video acquisition unit movement plan signal
22 Video acquisition unit control signal
23 Main subjects
24 Image acquisition unit control unit
25 Subject range

Claims (8)

An illumination unit that illuminates at least a part of the subject and has variable illumination conditions;
A video acquisition unit for acquiring video information of the subject;
An illumination determination unit that analyzes the illumination state of the subject based on the video information acquired by the video acquisition unit and determines the suitability of the illumination state;
An imaging system comprising: an illumination device control unit that controls the illumination condition based on a determination result by the illumination determination unit. The imaging system according to claim 1,
The illumination condition is at least one selected from intensity of illumination light of the illumination unit, illumination angle of the illumination unit with respect to the subject, position of the illumination unit with respect to the subject, and spectral characteristics of illumination light. A characteristic shooting system. The imaging system according to claim 1 or 2,
The imaging system, wherein the illumination determination unit determines appropriateness of the illumination state based on screen division type photometry of the video information. The imaging system according to any one of claims 1 to 3,
A main subject identifying unit for identifying a main subject in the subject;
A relative position grasping unit for grasping a relative positional relationship between the main subject, the illumination unit, and the video acquisition unit;
An imaging system comprising: illumination unit self-propelled means for causing the illumination unit to self-run based on the relative positional relationship. The imaging system according to any one of claims 1 to 3,
A main subject identifying unit for identifying a main subject in the subject;
A relative position grasping unit for grasping a relative positional relationship between the main subject, the illumination unit, and the video acquisition unit;
Illumination unit self-running means for causing the illumination unit to self-run based on the relative positional relationship;
An imaging system comprising: a video acquisition unit self-running means for causing the video acquisition unit to self-run based on the relative positional relationship. An illumination condition setting method for determining an illumination condition of an illumination system that illuminates an illumination object and includes a plurality of illumination devices,
First, individual lighting characteristics of each lighting device alone, turn off all remaining lighting devices, illuminate the lighting object while changing the lighting conditions of each lighting device and measure the luminance of the lighting object, An illumination condition setting method comprising: obtaining by obtaining a relationship between an illumination condition of each illumination device and a luminance of the illumination object. The illumination condition setting method according to claim 6,
Furthermore, before that, the lighting condition setting method characterized in that the influence of the light source outside the control target is preliminarily evaluated by turning off all of the plurality of lighting devices and measuring the luminance of the illumination target. An illumination section with variable illumination conditions for illuminating an illumination object;
A video acquisition unit for acquiring video information of the illumination object;
An illumination determination unit that analyzes the illumination state of the illumination object based on the video information acquired by the image acquisition unit and determines whether the illumination state is appropriate;
An illumination system comprising: an illumination device control unit that controls the illumination condition based on a determination result by the illumination determination unit.

Images