DE112018005062T5 - INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS, PROGRAM AND LIGHTING SYSTEM - Google Patents

Abstract

The present invention automatically controls the settings of light sources to maintain the design data by changing the light emissivity of each light source if the movement of a moving subject relative to an object to be imaged is a difference between an image that is obtained can, and caused the design data. This lighting system has an information processing device and a light emission unit. The information processing apparatus includes: a control unit that determines the settings for the light emitting unit in accordance with the design data indicating the characteristics of a desired image and the light emitting effects of the light emitting unit and controls the settings that are set so that the design data are retained if there is a change in the motif; and an output unit that outputs the settings to the light emission unit. The light emission unit has a light emission control unit that controls the light emission based on the settings output from the information processing device.

Description

TECHNICAL AREA

The present disclosure relates to an information processing device, an information processing method, a program and a lighting system.

STATE OF THE ART

A capturing technique for capturing an image in a state of irradiating (exposing) an object with light from multiple light sources is known. In photo and video (e.g., film) factories, lighting is often used as a technique to render an object impressively, such as to give the object a stereoscopic effect. However, to achieve a desired lighting effect, repeated adjustment for the multiple light sources and test detection after adjustment are required, and general lighting systems have a problem of requiring a lot of personnel and time. In view of such a situation, there has been proposed a detection simulation device that can set lighting conditions on a computer and can check an image obtained under the set lighting conditions on the computer (see, for example, Patent Document 1 below).

REFERENCE LIST

PATENT DOCUMENT

Patent Document 1: Japanese Patent Application, Laid-Open No. 2005-301785.

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

However, even if the lighting result can be simulated on the computer as in the technology described in Patent Document 1, there is a problem that the lighting conditions have to be trial and error set in order to obtain a desired lighting effect.

An object of the present disclosure is to provide an information processing device, an information processing method, a program, and a lighting system capable of easily making settings of a light emitting unit (light source) to obtain a desired lighting effect.

PROBLEM SOLUTIONS

• eine Steuereinheit, die dazu ausgelegt ist, eine Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben, zu bestimmen, wobei
• die Steuereinheit die bestimmte Einstellung steuert, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.

For example, the present disclosure is
an information processing device comprising:

• a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, wherein
• the control unit controls the particular setting to maintain the concept data in a case where a change has occurred in an object.

• Bestimmen einer Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben; und
• Steuern der bestimmten Einstellung, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.

For example, the present disclosure is
an information processing method comprising:

• Determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and
• Control the particular setting to keep the concept data in a case where a change has occurred in an object.

• Bestimmen einer Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben; und
• Steuern der bestimmten Einstellung, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.

For example, the present disclosure is
a program that causes a computer to perform the following processing:

• Determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and
• Control the particular setting to the concept data in one case maintain where a change occurred in an object.

• eine Informationsverarbeitungseinrichtung; und
• eine Lichtemissionseinheit,
• wobei die Informationsverarbeitungseinrichtung Folgendes aufweist:
  • eine Steuereinheit, die dazu ausgelegt ist, eine Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben, zu bestimmen, und die bestimmte Einstellung zu steuern, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist, und
  • eine Ausgabeeinheit, die dazu ausgelegt ist, die Einstellung zu der Lichtemissionseinheit auszugeben,
• wobei die Lichtemissionseinheit Folgendes aufweist:
  • eine Lichtemissionssteuereinheit, die dazu ausgelegt ist, die Lichtemission basierend auf der von der Informationsverarbeitungseinrichtung ausgegebenen Einstellung zu steuern.

For example, the present disclosure is
a lighting system comprising:

• an information processing device; and
• a light emission unit,
• the information processing device comprising:
  • a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, and to control the determined setting to keep the concept data in a case where a change occurred in an object, and
  • an output unit that is designed to output the setting for the light emission unit,
• wherein the light emission unit comprises:
  • a light emission control unit configured to control the light emission based on the setting output from the information processing device.

EFFECTS OF THE INVENTION

According to at least embodiments of the present disclosure, a light emission unit can be easily adjusted to obtain a desired lighting effect. Note that effects described herein are not necessarily limited and that any effects described in the present disclosure may occur. Furthermore, the content of the present disclosure is not interpreted in a limited manner by the exemplary effects.

Figure list

• 1 12 is a diagram illustrating a configuration example of a lighting system according to a first embodiment.
• 2nd FIG. 12 is a block diagram illustrating a configuration example of an imaging device according to the first embodiment.
• 3rd FIG. 12 is a block diagram illustrating a configuration example of a tablet computer according to the first embodiment.
• 4A to 4C FIG. 10 are block diagrams illustrating configuration examples of light sources according to the first embodiment.
• 5 11 is a diagram for describing calibration processing according to the first embodiment.
• 6 FIG. 12 is a diagram for describing an example of a dimming table according to the first embodiment.
• 7 12 is a flowchart illustrating an example of a processing flow of calibration processing according to the first embodiment.
• 8th 11 is a diagram for describing an example of a reference image and the like according to the first embodiment.
• 9 11 is a flowchart illustrating an example of a processing flow of the concept data generation processing according to the first embodiment.
• 10th FIG. 14 is a flowchart illustrating an example of a processing flow of lighting setting and detection processing according to the first embodiment.
• 11 FIG. 12 is a diagram illustrating a configuration example of a lighting system according to a second embodiment.
• 12A to 12C 14 are block diagrams illustrating a configuration example of a light source according to the second embodiment.
• 13 FIG. 12 is a flowchart illustrating an example of a processing flow of calibration processing according to the second embodiment.
• 14 FIG. 12 is a diagram for describing an example of a dimming table according to the second embodiment.
• 15 FIG. 12 is a diagram for describing an example of a reference image and the like according to the second embodiment.
• 16 FIG. 12 is a flowchart illustrating an example of a processing flow of lighting setting and detection processing according to the second embodiment.
• 17th Fig. 12 is a diagram for describing modifications.

MODE FOR CARRYING OUT THE INVENTION

• <1. Erste Ausführungsform>
• <2. Zweite Ausführungsform>
• <3. Modifikation>

Hereinafter, embodiments and the like of the present disclosure will be described with reference to the drawings. Note that the description is given in the following order.

• <1. First embodiment>
• <2. Second embodiment>
• <3. Modification>

Embodiments and the like to be described below are advantageous specific examples of the present disclosure, and the content of the present disclosure is not limited to these embodiments and the like.

<First embodiment>

First, a first embodiment according to the present disclosure will be described. The first embodiment is an embodiment for automatically performing a lighting setting to obtain one of them User desired lighting effect when the user captures a still image. The lighting setting means a setting for a light source (luminaire), and in the embodiment, a setting regarding the light emission intensity of the light source is described as an example. Note that the setting for the light source is not limited to the light emission intensity of the light source. For example, the setting can relate to the light emission intensity described above and / or a color temperature of the light emitted by the light source and / or a softness / hardness of the light and / or an irradiation area of the light and / or an irradiation direction of the light. The setting can be a specific value (in the case of the color temperature, for example, a specific value in units of Kelvin (K)) or can be a value (flag) corresponding to a level of light emission intensity (for example strong, moderate or weak light emission intensity) or the direction of irradiation of the Light (for example slightly to the right, to the left or the like with respect to a reference direction).

[Configuration example of the lighting system]

1 illustrates a configuration example of a lighting system (lighting system 10th ) according to the first embodiment of the present disclosure. The lighting system 10th has an imaging device 1 , a tablet computer (hereinafter referred to as a tablet computer 2nd designated), which is an example of an information processing device, and a plurality of light sources (light emission units). The lighting system 10th according to the current embodiment has three light sources (light sources 3A , 3B and 3C) that correspond to a lighting technique called three-lamp lighting. For example, the light source 3A Fill light called the light source 3B is called the guide light and the light source 3C is called background light. An object 4th using the imaging device 1 captured in a state where the light sources 3A to 3C Emit light. In the current embodiment, the light source emit 3A and the light source 3B immediate light (flash light emission) synchronized with the detection. In addition, the light source emits 3C light is not immediately in sync with the detection even though it emits light at the time of detection, and is steady light that constantly emits light. The object 4th is in 1 schematically illustrated as one person. The object 4th however, is not limited to one person and may be multiple people, other living things such as pets, works of art or the like.

Communication can occur between the imaging device 1 and the tablet computer 2nd and between the tablet computer 2nd and the light sources 3A to 3C be performed. For example, wireless communication based on WiFi (registered trademark) is performed between the devices. Wireless communication based on a communication standard other than WiFi (registered trademark) can be performed, communication using infrared rays can be performed, or wired communication can be performed. For example, the devices communicate with each other after known coupling processing is performed to enable these devices to recognize each other and to be able to communicate with each other.

[Imaging device]

(Configuration example of the imaging device)

Next, configuration examples of the devices constituting the lighting system will be described 10th form. First, a configuration example of the imaging device 1 described. 2nd illustrates a configuration example of the imaging device 1 . The imaging device 1 has, for example, an optical imaging system 101 , a dedicated phase difference auto focus (AF) sensor 102, an imaging element 103 , a preprocessing circuit 104 , a camera processing circuit 105 , an image memory 106 and a camera control unit 107 , a graphics interface (Graphics I / F) 108, a display 109 , an input unit 110 , a reader / writer (R / W) 111, a storage unit 112 and a camera communication unit 113 on.

The optical imaging system 101 has a detection lens 101A (including a focusing lens, a zoom lens and the like) for focusing light from an object onto the imaging element 103 , a lens drive mechanism 101B that performs focusing adjustment by moving the focusing lens, and a shutter mechanism, an iris mechanism, and the like. This lens and these mechanisms are based on a control signal from the camera control unit 107 controlled. The lens drive mechanism 101B sets an AF operation by moving the detection lens 101A along a direction of the optical axis according to the control signal from the camera control unit 107 is delivered. An optical image of the object through the optical imaging system 101 is obtained is on the imaging element 103 formed as an imaging device.

The dedicated phase difference AF sensor 102 is a dedicated auto focus Phase difference detection type sensor. Through the detection lens 101A Concentrated object light is reflected by a semitransparent mirror or the like to be in the dedicated phase difference AF sensor 102 to enter. One by the dedicated phase difference AF sensor 102 Detected focus detection signal is the camera control unit 107 fed.

The illustration element 103 is a CCD (Charge Coupled Device), a complementary metal oxide semiconductor (CMOS) or the like. The illustration element 103 converts that through the detection lens 101A incident light photoelectrically into an amount of charge and forms an image. The illustration element 103 has a normal imaging pixel and a phase difference detection pixel. An image plane phase difference AF sensor 103A is an auto focus sensor that has multiple phase difference detection pixels. That through the image plane phase difference AF sensor 103A detected focus detection signal is the camera control unit 107 fed.

The preprocessing circuit 104 performs a sample hold for one of the imaging element 103 output image signal to maintain a favorable signal-to-noise (S / N) ratio through correlated double-scan processing (CDS processing). It also controls the preprocessing circuit 104 amplification by automatic gain control processing (AGC processing) and performs analog / digital (A / D) conversion and outputs a digital image signal.

The camera processing circuit 105 applies signal processing to the image signal from the preprocessing circuit 104 such as white balance adjustment processing, color correction processing, gamma correction processing, Y / C conversion processing, and automatic exposure processing (AE processing).

The image storage 106 is a volatile memory such as a buffer memory configured by a dynamic random access memory (DRAM) and temporarily stores image data on which the predetermined processing by the preprocessing circuit 104 and the camera processing circuit 105 was applied.

The camera control unit 107 is configured, for example, by a central processing unit (CPU) and has a read-only memory (ROM) 107A and a random access memory (RAM) 107B on. The ROM 107A stores a program that is read and executed by the CPU and the like. The RAM 107B is used as a working memory for the CPU. The CPU controls the entire imaging device 1 by performing different types of processing according to the ROM 107A executes the stored program and creates commands. For example, the CPU controls the AF described above. Although details will be described below, the camera control unit controls 107 each unit of the imaging device 1 so that the detection is performed in a state in which each of the multiple light sources 3A to 3C Light emitted based on the appropriate setting.

The graphics I / F 108 generated from that of the camera control unit 107 supplied image signal on the display 109 image signal to be displayed and supplies the image signal to the display 109 to display an image. The ad 109 shows a captured passage image, one in the storage unit 112 recorded image or the like.

The ad 109 is configured by a liquid crystal display (LCD), an organic electroluminescence (EL) display or the like.

The input unit 110 has, for example, a power button for switching the power supply on / off, a trigger button for issuing an instruction to start recording a captured image, a control element for zoom adjustment, a touchscreen that is integral with the display 109 is formed, and the like. If an entry in the input unit 110 is made, a control signal corresponding to the input is generated and sent to the camera control unit 107 spent. Then the camera control unit guides 107 perform arithmetic processing and control according to the control signal.

The R / W 111 is an interface with which the storage unit 112 is connected, which records image data generated by imaging. The R / W 111 writes from the camera control unit 107 fed data into the storage unit 112 and returns that from the storage unit 112 read data to the camera control unit 107 out. The storage unit 112 is, for example, a hard disk, a memory stick (registered trademark of Sony Corporation), an SD memory card, a USB memory (Universal Serial Bus) or the like. An image is stored in a compressed state based on a JPEG standard (Joint Photographic Experts Group) or the like. In addition, data in EXIF (Exchangeable Image File Format), including information regarding the stored image and additional information such as date and time of acquisition, is also stored in association with the image. The storage unit 112 can in the imaging device 1 can be installed on the Imaging device 1 attachable / removable, or both.

The camera communication unit 113 is a configuration for the imaging device 1 for communication with other devices (for example the tablet computer 2nd ) and has functions necessary for communication, such as an antenna and a modulation / demodulation function. For example, the image data is generated by the imaging device 1 captured image from the imaging device 1 through the camera communication unit 113 to the tablet computer 2nd transfer.

(Basic operating example for the imaging device)

Here is a basic operation in the imaging device described above 1 described. Before capturing an image, the imaging element 103 received and photoelectrically converted signals sequentially to the preprocessing circuit 104 fed. The preprocessing circuit 104 applies CDS processing, AGC processing and the like to the input signal and further converts the input signal into an image signal.

The camera processing circuit 105 performs image quality correction processing for that from the preprocessing circuit 104 delivered image signal and delivers the image signal via the camera control unit 107 to the graphic I / F 108 as a continuous image signal 109 displayed. The user sees that on the display 109 displayed passage picture and can adjust a viewing angle.

In this state the camera control unit gives 107 when the input unit release button 110 is pressed, the control signal to the imaging optical system 101 to operate shutters that the imaging optical system 101 form. This gives the imaging element 103 an image signal for one frame.

The camera processing circuit 105 applies image quality correction processing to the image signal for a single image generated by the imaging element 103 via the preprocessing circuit 104 is supplied and supplies the processed image signal to the camera control unit 107 . The camera control unit 107 compresses and encodes the input image signal and delivers the generated encoded data to the R / W 111 . As a result, a data file of a captured still image is stored in the storage unit 112 about the R / W 111 saved. Note that when capturing a moving image, the processing described above is performed in real time in response to a moving image capturing instruction. A still image can be captured at the time of capturing a moving image by pressing the release button at the time of capturing the moving image.

Meanwhile, in a case of playback, one reads in the storage unit 112 saved image file the camera control unit 107 a selected still image file from the storage unit 112 about the R / W 111 in response to one from the input unit 110 entered operation. Decompression-decoding processing is applied to the read image file. Then the decoded image signal is sent through the camera control unit 107 to the graphic I / F 108 delivered. This creates a in the storage unit 112 saved still image or moving image on the display 109 displayed.

[Configuration example of the tablet computer]

3rd illustrates a configuration example of a tablet computer 2nd . The tablet computer 2nd has a portable size and has, for example, a control unit 201 , a communication unit (hereinafter referred to as a tablet communication unit) 202 included in the tablet computer, a display unit 203 , an input unit 204 , an R / W 205 and a storage unit 206 on.

The control unit 201 has a CPU and the like and includes ROM and RAM (not illustrated). The ROM stores a program that is read and executed by the CPU and the like. The RAM is used as a working memory for the CPU. Furthermore, the control unit 201 a dimming table generation unit 201A and a dimming information generation unit 201B as functions. The control unit 201 determines the settings of the light sources 3A to 3C according to concept data, the image characteristic desired by the user and light emission results of the light sources 3A to 3C specify.

The tablet communication unit 202 as an example of an output unit is a configuration for the tablet computer 2nd to communicate with other devices (e.g. the imaging device 1 and the light sources 3A to 3C ) and has functions necessary for communication, such as an antenna and a modulation / demodulation function. For example, the image data from the imaging device 1 transmitted image through the tablet communication unit 202 received and the received image data are the control unit 201 fed. Furthermore, the setting for each of the light sources 3A to 3C from the tablet communication unit 202 transmitted to the corresponding light source. It should be noted that the tablet communication unit 202 according to the current embodiment also has a function to be connected to a network such as the Internet.

The display unit 203 is configured by a liquid crystal display, an organic EL display, or the like. The display unit 203 displays images and videos obtained over the Internet, television programs, game screens, menu screens, and the like. The display unit also shows 203 a reference image referred to when the user accepts an input to generate concept data, which will be described below. It should be noted that the display unit 203 in accordance with the current embodiment is configured as a touchscreen and is configured to accept various inputs. That is, the display unit 203 also acts as the input unit 204 .

The input unit 204 For example, is a physical button, such as a push button or a slide button, a touch screen, or the like, and is a collective term for configurations that accept user input. If an entry in the input unit 204 is made, a control signal corresponding to the input is generated and sent to the control unit 201 spent. Then the control unit leads 201 perform arithmetic processing and control according to the control signal. The input unit 204 is also used to accept an input to generate the concept data to be described below.

The R / W 205 writes data to the storage unit 206 and reads data from the storage unit 206 . The storage unit 206 is, for example, a hard disk, a memory stick (registered trademark of Sony Corporation), an SD memory card, a USB memory or the like. The storage unit 206 can in the tablet computer 2nd can be installed on the tablet computer 2nd attachable / detachable from this or can be both.

It should be noted that the tablet computer 2nd may have a different configuration than the configuration described above. For example, the tablet computer 2nd have a speaker device or the like. An operating example of the tablet computer 2nd will be described below.

[Configuration example of the light source]

4th illustrates configuration examples of light sources, and 4A illustrates a configuration example of the light source 3A , 4B illustrates a configuration example of the light source 3B and 4C illustrates a configuration example of the light source 3C .

As in 4A illustrates, the light source 3A for example, a light emission unit (a light emission body) 301A, a dimming control unit 302A and a light source communication unit 303A on. The light emission unit 301A For example, is a flash source, such as a strobe, and emits light in synchronism with the detection by the imaging device 1 . The dimming control unit 302A controls the light emission intensity, light emission timing, and the like of the light emission unit 301A based on dimming information generated by the light source communication unit 303A be received. The light source communication unit 303A will be for the light source 3A used to work with other devices (for example the imaging device 1 and the tablet computer 2nd ) to communicate.

As in 4B illustrates, the light source 3B for example, a light emission unit (a light emission body) 301B, a dimming control unit 302B and a light source communication unit 303B on. The light emission unit 301B For example, is a flash source, such as a strobe, and emits light in synchronism with the detection by the imaging device 1 . The dimming control unit 302B controls the light emission intensity, light emission timing, and the like of the light emission unit 301B based on dimming information generated by the light source communication unit 303B be received. The light source communication unit 303B will be for the light source 3B used to work with other devices (for example the imaging device 1 and the tablet computer 2nd ) to communicate.

As in 4C illustrates, the light source 3C for example, a light emission unit (a light emission body) 301C, a dimming control unit 302C and a light source communication unit 303C on. The light emission unit 301C is for example a fluorescent lamp or a light emitting diode (LED). The dimming control unit 302C controls the light emission intensity of the light emission unit 301C based on dimming information generated by the light source communication unit 303C be received. The light source communication unit 303C will be for the light source 3C used to work with other devices (for example the imaging device 1 and the tablet computer 2nd ) to communicate. It it should be noted that the configurations of the light sources 3A to 3C can of course be different.

As an example, each of the light sources 3A to 3C designed to emit light with three light emission intensity levels (weak, medium and strong). Of course, the light sources can 3A to 3C Emit light at two light emission intensity levels or at multiple levels, such as four or more light emission intensity levels. In addition, for example, the light emission intensity "weak" of the light source 3A and the light emission intensity "weak" of the light source 3B be the same light emission intensity or different light emission intensity levels.

[Processing performed in the first embodiment]

Next, the processing performed in the first embodiment, including operation of each device, will be described. In the present embodiment, in order to simplify the description, the processing performed in the first embodiment is divided into three types of processing: “calibration processing”, “concept data generation processing” and “lighting setting and detection processing”, and each type of processing is described in order . It should be noted that the three types of processing do not need to be performed in the order described below and the order of processing can be changed within a scope where there is no technical contradiction, the processing can be performed in parallel or any type of processing can be done continuously. For example, the calibration processing can be performed after the concept data generation processing, or the calibration processing and the concept data generation processing can be performed in parallel.

(Calibration processing)

The calibration processing is processing for previously measuring an influence of light by light emission on the image of the object in a case of the light emission result of each light source, particularly, each light source emits light in a different pattern, on a one-to-one basis, and obtain one Table that is a measurement result (in the following, the table is appropriately referred to as a dimming table).

The calibration processing is schematic with reference to FIG 5 described. First the light source emits 3A Light in different light emission patterns. In the current example, the light source emits 3A Light with different light emission intensity levels. However, the different light emission patterns can be different color temperatures or the like. This applies in a similar way to the other light sources. It should be noted that the light sources 3B and 3C stay off without emitting light.

The light source 3A emits light with the light emission intensity "weak" in synchronization with the detection, and detection is performed. Next, the light source emits 3A Light with the light emission intensity "medium strong" synchronized with the detection, and a detection is carried out. Next, the light source emits 3A Light with the light emission intensity "strong" in synchronism with the detection, and detection is performed. Images obtained through the acquisitions are temporarily stored in the image memory, for example 106 the imaging device 1 saved.

Next, the light source emits 3B Light with different light emission intensity levels. It should be noted that the light sources 3A and 3C stay off without emitting light. The light source 3B emits light with the light emission intensity "weak" in synchronization with the detection, and detection is performed. Next, the light source emits 3B Light with the light emission intensity "medium strong" synchronized with the detection, and a detection is carried out. Next, the light source emits 3B Light with the light emission intensity "strong" in synchronism with the detection, and detection is performed. Images obtained through the acquisitions are temporarily stored in the image memory, for example 106 the imaging device 1 saved.

Next, the light source emits 3C Light with different light emission intensity levels. It should be noted that the light sources 3A and 3B stay off without emitting light. The detection is carried out in a state in which the light source 3C Light with the light emission intensity "weak" emitted. Next, the detection is performed in a state in which the light source 3C Light emitted with the light emission intensity "medium". The detection is carried out in a state in which the light source 3C Light with the light emission intensity "strongly" emitted. Images obtained through the acquisitions are temporarily stored in the image memory, for example 106 the imaging device 1 saved.

Image data of nine images obtained by the acquisitions are obtained from the imaging device 1 to the tablet computer 2nd transfer. That is, the image data is sent from the camera communication unit 113 transferred and the Image data is through the tablet communication unit 202 receive. The received image data are from the tablet communication unit 202 to the control unit 201 delivered. The dimming table generation unit 201A the control unit 201 analyzes and extracts image information for each of the nine images.

The image information is spatial sensor information that corresponds to the light emission pattern of each light source. In the current embodiment, a luminance level is used for each pixel making up the image. Note that to reduce the amount of information, a level of luminance in a unit of block of any size instead of data compressed for each pixel or other suitable method can be used as image information. In addition, the processing for analyzing and obtaining the image information by the imaging device 1 can be performed, and only the image information can be obtained from the imaging device 1 to the tablet computer 2nd be transmitted.

The dimming table generation unit 201A that has obtained the image information generates a dimming table according to the light emission result of each light source. 6 illustrates an example of a dimming table (dimming table TA1 ) according to the first embodiment. The dimming table TA1 For example, includes the type of light source (information such as an identifier that can identify the light source), light emission intensity, and image information (in the present embodiment, the luminance level of each pixel of the image captured with the light emission intensity) that are associated with each other.

Note that the dimming table generation unit 201A generated dimming table TA1 about the R / W 205 into the storage unit 206 can be written and saved there. For example, if the same or a similar object is detected in the same studio, this can perform calibration processing using that in the storage unit 206 stored dimming table TA1 be omitted. The dimming table TA1 may be stored in storage (for example, storage in the cloud) that is not the storage unit 206 or can be transmitted and distributed through communication to other devices.

Further, for example, in a case where a change in image information with respect to a change in light emission intensity is known, image information corresponding to a light emission intensity different from a predetermined light emission intensity can be generated using image information corresponding to the predetermined light emission intensity to simplify calibration processing. For example, in relation to the light source 3A the dimming table generation unit 201A predict and generate the image information corresponding to the light emission intensity "moderate" and the light emission intensity "strong" based on the image information in the case of emitting light with the light emission intensity "weak". This can reduce the number of acquisitions and simplify calibration processing.

It should be noted that the object (the object to be captured) is advantageously the same in the calibration processing, but may differ from the object in the “lighting setting and detection processing”. For example, the object in calibration processing may be an object that is similar to the object in “lighting adjustment and detection processing” (a person with a similar face size or skin color in a case where the object is a person) .

7 FIG. 14 is a flowchart illustrating an example of a processing flow of calibration processing. In step ST11 becomes an instruction to emit light with the light emission intensity "weak" to a predetermined light source (for example, the light source 3A ) issued. This instruction takes place, for example, via the input unit 204 of the tablet computer 2nd . It should be noted that since the light source 3A Light emitted in synchronization with the acquisition, synchronization information, such as the timing for synchronizing the light emission and acquisition, from the tablet computer 2nd to the light source 3A and to the imaging device 1 be transmitted. Then processing continues with the steps ST12 and ST13 away.

In the steps ST12 and ST13 the detection is performed at the timing indicated by the synchronization information, and the light source 3A emits light with the light emission intensity "weak" in synchronization with the detection. In particular, the camera control unit controls 107 the imaging device 1 each unit of the imaging device 1 such that the acquisition is carried out at the timing indicated by the synchronization information. Furthermore causes the dimming control unit 302A the light source 3A the light emission unit 301A To emit light with the light emission intensity "weak" at the timing indicated by the synchronization information. Then the processing goes to step ST14 over.

In step ST14 becomes one by capturing in step ST13 image obtained from the imaging device 1 to the tablet computer 2nd transfer. Then the dimming table generating unit generates 201A of the tablet computer 2nd an element of the dimming table TA1 by analyzing the image information of the image in the case where the light source 3A Light with the light emission intensity "weak" emitted. Then the processing goes to step ST15 over.

In step ST15 becomes an instruction to emit light with the light emission intensity "medium strength" to the light source 3A given. This instruction is also used, for example, using the input unit 204 of the tablet computer 2nd spent. It should be noted that, as described above, since the light source 3A Light emitted in synchronization with the acquisition, the synchronization information, such as the timing for synchronizing the light emission and acquisition, from the tablet computer 2nd to the light source 3A and to the imaging device 1 be transmitted. Then processing continues with the steps ST16 and ST17 away.

In the steps ST16 and ST17 the detection is performed at the timing indicated by the synchronization information, and the light source 3A emits light with the light emission intensity "medium" synchronously with the detection. In particular, the camera control unit controls 107 the imaging device 1 each unit of the imaging device 1 such that the acquisition is carried out at the timing indicated by the synchronization information. Furthermore causes the dimming control unit 302A the light source 3A the light emission unit 301A To emit light with the light emission intensity “medium strength” at the timing indicated by the synchronization information. Then the processing goes to step ST18 over.

In step ST18 becomes one by capturing in step ST16 image obtained from the imaging device 1 to the tablet computer 2nd transfer. Then the dimming table generating unit generates 201A of the tablet computer 2nd an element of the dimming table TA1 by analyzing the image information of the image in the case where the light source 3A Light emitted with the light emission intensity "medium". Then the processing goes to step ST19 over.

In step ST19 becomes an instruction to emit light with the light emission intensity "strong" to the light source 3A spent. This instruction is also used, for example, using the input unit 204 of the tablet computer 2nd spent. It should be noted that, as described above, since the light source 3A Light emitted in synchronization with the acquisition, the synchronization information, such as the timing for synchronizing the light emission and acquisition, from the tablet computer 2nd to the light source 3A and to the imaging device 1 be transmitted. Then processing continues with the steps ST20 and ST21 away.

In the steps ST20 and ST21 the detection is performed at the timing indicated by the synchronization information, and the light source 3A emits light with the light emission intensity "strong" in synchronization with the detection. In particular, the camera control unit controls 107 the imaging device 1 each unit of the imaging device 1 such that the acquisition is carried out at the timing indicated by the synchronization information. Furthermore causes the dimming control unit 302A the light source 3A the light emission unit 301A To emit light with the light emission intensity "strong" at the timing indicated by the synchronization information. Then the processing goes to step ST22 over.

In step ST22 becomes one by capturing in step ST21 image obtained from the imaging device 1 to the tablet computer 2nd transfer. Then the dimming table generating unit generates 201A of the tablet computer 2nd an element of the dimming table TA1 by analyzing the image information of the image in the case where the light source 3A Light with the light emission intensity "strongly" emitted. Then the processing goes to step ST23 over.

In step ST23 it is determined whether or not all parts of the processing using the light sources have been completed. In the current example, processing is using the light source 3B and the light source 3C has not been completed and processing returns to step ST11 back. Then, similarly to the processing described above, the light source 3B causes light to emit at different light emission intensity levels, and an element of the dimming table TA1 is generated based on the image information of the image obtained at that time. Similar processing is used for the light source 3C carried out. It should be noted that since the light source 3C is no flash emission, the detection can be done by the input unit 110 the imaging device 1 is operated in a state in which the light source 3C is caused to emit light with a predetermined light emission intensity. That is, the synchronization information does not have to go to the imaging device 1 and the light source 3C be transmitted.

In step ST23 is used in a case where all parts of the processing are processed using the Light sources that have been completed in 6 illustrated dimming table TA1 based on the elements of the dimming table obtained in the respective parts of the processing in the steps ST14 , ST18 and ST22 were obtained. Then the processing ends.

(Concept data generation processing)

Next, the concept data generation processing will be described. The concept data is data indicating a desired image characteristic (by the user), and in particular data indicating the brightness for each area of the object.

The concept data is, for example, using the input unit 204 of the tablet computer 2nd specified. The display unit 203 displays the reference image referred to when input to the input unit 204 Is accepted. For example, as in 8th illustrates a reference image IM1 on the display unit 203 displayed. The user performs an operation based on his concept for the input unit 204 with reference to the reference image IM1 by.

As the reference picture IM1 For example, one of the nine images obtained by the calibration processing described above can be used. This eliminates the need for the reference image IM1 record yourself. Furthermore, the reference picture IM1 be an image obtained by capturing the object captured by the "lighting setting and capturing processing". The detection at this time can be performed in a state in which only ambient light (indoor light that is not related to the detection) is emitted in a state in which the light sources 3A to 3C do not emit light. In addition, the reference image IM1 be a template image that is selected according to a predetermined result of recognizing known people or face recognition with respect to the object detected in the “lighting setting and detection processing”. In this case, the predetermined processing is carried out, for example, by the control unit 201 carried out. In addition, the original image may be an image obtained by reading the data stored in the storage unit 206 stored image by the R / W 205 is obtained, or it may be an image obtained from the Internet or the like.

9 FIG. 14 is a flowchart illustrating an example of a processing flow of the concept data generation processing. A specific example of the concept data generation processing will be described with reference to FIG 8th and 9 described. The concept data generation processing is started when, for example, a predetermined key of the input unit 204 is pressed or touched. In step ST31 becomes the reference image IM1 on the display unit 203 displayed. Then the processing goes to step ST32 over.

In step ST32 the user performs an input based on the concept with reference to the reference image IM1 by. For example, as in 8th illustrates two areas AR1 and AR2 set for the object. For example, the brightness is specified so that the brightness of the area AR1 becomes a suitable exposure and the brightness of the area AR2 becomes 2/3 (about 66%) of the appropriate exposure. The setting of the areas and the specification of the brightness are made using the input unit 204 carried out. In the current embodiment, the configuration (e.g., brightness) corresponding to the input becomes in the reference image IM1 reflected every time an input by the input unit 204 is carried out. For example, as in 8th illustrates the brightness of the area AR2 slightly dark. Note that adjustments to the brightness of a background and the like can be made, although this is not illustrated. When the user finishes specifying the brightness or the like, the user presses or touches an end key or the like to finish the input based on the concept. Then the processing goes to step ST33 over.

In step ST33 concept data based on the in step ST32 made entry. The concept data is, for example, by the control unit 201 generated. As described above, the concept data is data indicating that, for example, a right half of the face is correctly exposed and a left half of the face is exposed by 2/3 of the appropriate exposure. Then the processing ends.

It should be noted that the concept data in the storage unit 206 can be saved. If an object with a similar face size, skin color or the like is then detected, the previous concept data can be obtained from the storage unit 206 read and used. Furthermore, the concept data can be communicated or the like via the tablet communication unit 202 be distributed. For example, the concept data of a well-known photographer has its own value. The fee calculation for the distribution of the concept data can therefore provide a new business model that uses the concept data as a main element.

(Lighting setting-and-detection processing)

Next, the lighting setting and detection processing will be described. 10th FIG. 12 is a flowchart illustrating an example of a processing flow of the lighting setting and detection processing. After the process is started, the dimming information generation unit calculates and determines 201B in step ST41 the light emission intensity of each light source according to the concept data and the dimming table TA1 . The influence of light on the image of the object in a case where each light source emits light with a certain light emission intensity is according to the dimming table TA1 already known. In addition, for example, in a case where light from the light source 3A and light from the light source 3B be emitted at a predetermined location, the brightness of the location is a sum of the brightness. For this reason, the dimming information generation unit 201B determine how much light emission intensity is required for each light source to emit light, the brightness for each area specified in the concept data with reference to the dimming table TA1 to implement.

In the case of the 8th Illustrated concept data are, for example, the dimming information of the light source 3A generated such that the light emission intensity of the light source 3A “Dim”, the dimming information of the light source 3B are generated such that the light emission intensity of the light source 3B "Strong" and the dimming information of the light source 3C are generated such that the light emission intensity of the light source 3C Becomes "medium strong". Note that in a case where a composition that completely matches the composition based on the concept data cannot be implemented, the dimming information is generated to implement a composition that is so close to the composition based on the concept data as possible. As an optimization method for obtaining an optimal lighting setting (dimming information) for the concept data, a quasi-Newton method, a downhill simplex method, a dual simplex method, a sequential linear quadratic programming or the like can be used. Then the processing goes to step ST42 over.

In step ST42 gives the tablet computer 2nd the dimming information indicating the light emission intensity of each light source to the corresponding light source. For example, the tablet computer transmits 2nd the dimming information using the tablet communication unit 202 to the corresponding light source. Then the processing goes to step ST43 over.

In step ST43 becomes the object 4th detected in a state in which each light source emits light based on the dimming information. For example, those of the light source 3A corresponding dimming information by the light source communication unit 303A receive. The dimming control unit 302A causes the light emission unit 301A To emit light with the light emission intensity "weak" based on the received dimming information. Furthermore, those of the light source 3B corresponding dimming information by the light source communication unit 303B receive. The dimming control unit 302B causes the light emission unit 301B To emit light with the light emission intensity “strong” based on the received dimming information. Furthermore, those of the light source 3C corresponding dimming information by the light source communication unit 303C receive. The dimming control unit 302C causes the light emission unit 301C To emit light with the light emission intensity "medium-strong" on the basis of the received dimming information. Then the acquisition by the imaging device 1 performed in the state in which each light source emits light. An image obtained by the capture appears on the display 109 the imaging device 1 displayed. The image obtained by the acquisition can be obtained from the imaging device 1 to the tablet computer 2nd transferred and on the display unit 203 are displayed. Then the processing goes to step ST44 over.

In step ST44 the adjustment (fine adjustment) is carried out by the user as required. As the adjustment, the user can directly adjust the light emission intensity of some or all of the light sources. In addition, the concept data itself can be fine-tuned. Then, the dimming information can be generated again based on the concept data after the fine adjustment, and the detection can be performed again in the state where each light source emits light with the light emission intensity that corresponds to the dimming information. In addition, the detection can be carried out several times with changed light emission intensity of each light source.

It should be noted that in the processing described above, the detection and light emission must be synchronized because the light source 3A and the light source 3B are a flash emission. The synchronization information for synchronization may be included in the dimming information, or it may be a light emission instruction to the light source 3A and the light source 3B are issued when the trigger button of the imaging device 1 is pressed in a state in which the light source 3C continues to emit light. Furthermore, in the processing described above, the dimming information was generated for each light source. However, the dimming information can be information in which the light emission intensity of all light sources is written, and each light source can select its own light emission intensity from the dimming information.

Example of the Effect Obtained in the First Embodiment

According to the first embodiment described above, the settings of the light sources for obtaining a lighting effect desired by the user can be carried out automatically. Since a person who adjusts the light source is not required, detection by a small number of people (at least one person) is possible even if the lighting system becomes large.

Regardless of whether the adjustment is done manually or by simulation using a computer, adjusting the light source to obtain a desired lighting effect requires time and effort. Because a general lighting system uses multiple light sources, the settings are more time consuming and labor intensive. However, according to the present embodiment, the user can reduce the time and effort required to adjust the light sources and perform efficient detection because the settings of the light sources are made by simply setting the concept data according to the result of the lighting detection, in other words, a desired image configuration (for Example of the brightness for each area of the object). Further, since the number of attempts to adjust the light sources and cause the light sources to emit light can be reduced, the load on the light sources can be reduced and the durability of the light sources can be improved.

In addition, since the detection is actually carried out under lighting optimized for the concept, a high quality image (still image in the present embodiment) can be obtained which cannot be implemented by an image processing software.

<Second embodiment>

Next, a second embodiment according to the present disclosure will be described. Note that the aspects described in the first embodiment can be applied to the second embodiment unless otherwise specified, and similarly, configurations of the same kind are given the same reference numerals and redundant description is appropriately omitted.

[Problems to be considered when capturing moving images under lighting]

The second embodiment is an embodiment for automatically performing a lighting setting to obtain a lighting effect desired by a user when the user captures a moving image. The basic processing is similar to the processing in the first embodiment, and the setting for each light source is automatically performed based on concept data set by the user.

Incidentally, when capturing a moving image under lighting, a standpoint specific to the moving image must be taken into account. 11 illustrates a lighting system (lighting system 10A ) according to the second embodiment, in which a moving image is captured under illumination. The lighting system 10A has an imaging device 1 and a tablet computer 2nd described in the first embodiment. In addition, the lighting system points 10A for example a light source 5A (Fill light), a light source 5B (Guide light) and a light source 5C (Background light) as light sources. It should be noted that the light sources 5A to 5C , since a moving image is acquired in the present embodiment, emit a constant light rather than a flash emission (instant light).

When capturing a moving image, there is generally an object that moves (moving object), such as a person, and an object that does not move, such as a background. In the in 11 illustrated lighting system 10A is a person 6 illustrated as an example of the moving object and a wall 7 is illustrated as the background. The person 6 is mainly with light from the light source 5A and the light source 5B irradiated, and the wall 7 is mainly with light from the light source 5C irradiated.

The present embodiment assumes a case of detecting a state in which the person is 6 in a depth direction, more specifically, from the back (depth side) to the front (front side) with respect to the imaging device 1 emotional. It is believed that the user desires a composition that matches the brightness of the person 6 (Brightness of the reflected light) not with the movement of the person 6 changes. In In such a case, a method called a wiping method is generally used, in which an amount of light is adjusted so that it is constant while the light source is covered with a diffuser. However, the wiping process requires a highly qualified technique. Therefore, in the case of arranging personnel capable of wiping in any light source, personnel capable of wiping must be ensured as a requirement. In addition, the cost of capturing the moving image increases due to rewards and the like for the personnel. As described above, in the case of capturing a moving image under lighting, the problem of increasing the personnel and increasing the cost associated with the increase in personnel becomes more pronounced than when capturing a still image under lighting. Details of the second embodiment will be described based on such a viewpoint.

[Device Configurations]

Because of configurations of the imaging device 1 and the tablet computer 2nd each with reference to the 2nd and 3rd a redundant description is omitted. Note that although details are described below, a control unit 201 certain settings related to the light sources 5A to 5C controls to maintain structural data in a case where an object changes when a moving image is captured.

The 12A to 12C illustrate configuration examples of light sources 5A to 5C . The light source 5A has a light emission unit 501A , a dimming control unit 502A and a light source communication unit 503A similar to the light source 3A on. The light source 5B has a light emission unit 501B , a dimming control unit 502B and a light source communication unit 503B similar to the light source 3B on. The light source 5C has a light emission unit 501C , a dimming control unit 502C and a light source communication unit 503C similar to the light source 3C on. Note that redundant description is omitted because the function of each unit is the same as the function of each unit in the light source 3A . The light sources 5A to 5C are designed to emit light at three light emission intensity levels, for example "weak", "medium" and "strong".

[Processing performed in the second embodiment]

Next, the processing performed in the second embodiment, including an operation of each device, will be described. In the second embodiment, to simplify the description, the processing is divided into three types of processing: “calibration processing”, “concept data generation processing” and “lighting setting and detection processing”, and each type of processing is then described in order. The three types of processing do not need to be performed in the order described below, and the order of processing can be changed within a scope where there is no technical contradiction, the processing can be performed in parallel, or any type of processing can be performed continuously.

(Calibration processing)

First, the calibration processing according to the second embodiment will be described. 13 FIG. 12 is a flowchart illustrating an example of a processing flow of calibration processing according to the second embodiment. It should be noted that processing that corresponds to that in the flowchart in 7 described processing is similar, is denoted by the same reference numerals and a redundant description may be omitted.

After processing is started, moves to step ST51 the person 6 than the moving object to a place AA . The place AA is for example a position where the person is 6 begins to move. Then the light source emits 5A in steps ST11 to ST22 for example, sequentially light with the Light emission intensity "low", "medium" and "strong", and a detection is carried out in every light emission state. This detection can be a still picture or a moving picture. With each detection, image information corresponding to each light emission intensity is analyzed, and an element of a dimming table is generated by a dimming table generation unit 201A generated. When the acquisition is complete, processing goes to step ST23 away.

In step ST23 it is determined whether all of the processing (detection) using each light source at a predetermined location (location AA in the current example) or not. In the current example, processing is using the light sources 5B and 5C has not been completed and processing returns to step ST11 back. Then the light source emits 5B in steps ST11 to ST22 for example, sequentially light with the light emission intensity "low", "medium" and "strong", and a detection is carried out in each light emission state. The light source also emits 5C for example, sequentially light with the light emission intensity "low", "medium" and "strong", and a detection is carried out in each light emission state. With each detection, image information corresponding to each light emission intensity is analyzed, and an element of a dimming table is generated by a dimming table generation unit 201A generated. When the acquisition is complete, processing goes to step ST23 away.

Because the detection using the light sources 5A , 5B and 5C in the state in which the person is 6 at the place AA is completed, the determination is in the processing in step ST23 affirmative, and the process moves on ST52 away. In step ST52 it is determined whether the acquisition has been completed in all locations or not. In the current example, the determination is in step processing ST52 negative and the processing moves to step ST53 away.

In step ST53 the person moves 6 than the moving object to a place BB . The place BB For example, is a position where the person 6 has stopped moving, that is, a final stop position. Then processing returns to step ST11 back. Then the light source emits 5A in steps ST11 to ST22 for example, sequentially light with the light emission intensity "low", "medium" and "strong", and a detection is carried out in each light emission state. With each detection, image information corresponding to each light emission intensity is analyzed, and an element of a dimming table is generated by a dimming table generation unit 201A generated. Similar processing is done for the other light sources 5B and 5C carried out. Then the processing goes to step ST23 over.

In step ST23 it is determined whether all of the processing (detection) using each light source at a predetermined location (location BB in the current example) or not. In a case where the detection using the light sources 5A , 5B and 5C is completed, processing continues with step ST52 away. As described above, step ST52 determines whether the capture is complete at all locations or not. In the current example, capture locations are the two locations of the location AA which is a movement start position of the person 6 is, and the place BB which is a movement stop position. Hence the determination in step ST52 affirmative and the process ends.

14 illustrates an example of a dimming table (dimming table TA2 ) obtained by the calibration processing according to the second embodiment. The dimming table TA2 is a table in which the type of light source, the light emission intensity, the position information of the person 6 and a luminance level of each pixel of an image captured at that time is associated with each other. It should be noted that the position information of the person 6 can be expressed by different types of information. For example, known person extraction processing is performed on the basis of an image in the detection, whereby an area obtained by the person is obtained 6 (Area in which the person 6 located) at the place AA is occupied, and the area can be used as the position information. Furthermore, distance information of the person 6 can be used at any location as the position information based on a depth map obtained by a distance measuring sensor or by image processing. The person also moves 6 while holding a beacon and information transmitted from the beacon to any location can be used as the position information. Combined information of the above information elements can also be used as position information.

It should be noted that the dimming table TA2 has a larger amount of information than the dimming table described in the first embodiment TA1 . Simply put, the information is increased by the number of capture locations, and in the example described above, the capture is at that location AA and the place BB carried out so that the amount of information in the dimming table TA2 is about twice the amount of information in the dimming table TA1 . Therefore, for example, the luminance level of each pixel in the dimming table TA2 be compressed using a known compression technology. Furthermore, in the dimming table TA2 only the luminance levels of the pixels existing in an area specified by concept data to be described below are described.

(Concept data generation processing)

Next, the concept data generation processing according to the second embodiment will be described. The processing flow of the concept data generation processing according to the second embodiment is basically the same as that of the concept data generation processing according to the first embodiment. That is, setting the concept data using an input unit 204 is performed by the user in a state in which a reference image is on a display unit 203 a tablet computer 2nd is shown.

15 11 is a diagram for describing an example of the concept data according to the second embodiment. A reference picture IM2 is on the display unit 203 displayed. The reference picture IM2 is, for example, a picture (still picture) when the user is in place AA located. This image can be an image obtained by calibration processing, or it can be a separately captured image.

The user enters the concept data using the input unit 204 a. For example, an area AR3 including the person 6 and a background area AR4 specified. Then, for example, the concept data for maintaining the brightness of the person 6 and the background (the intensity of the light reflected from the objects) by the user. This also includes the brightness of the person 6 and the background at the detection start position (the state in which the moving object at the location AA which is conveniently referred to as an initial state in the following description) is set as the concept data.

It should be noted that the setting of the concept data is an example and is not limited to this example. For example, a rectangular area was illustrated in the example described above. However, a person can be extracted and a setting made for the person himself (for example, to maintain the brightness of the person). Furthermore, as in the example described above, in the case of maintaining the brightness of the moving object and the background, the concept data of “maintaining the brightness of all objects (including the background)” can be easily set without specifying areas. The object to be set in the concept data is not only set by the user, but can also be recognized automatically by person extraction or face recognition.

(Lighting setting-and-detection processing)

Next, the lighting setting and detection processing according to the second embodiment will be described. 16 FIG. 12 is a flowchart illustrating an example of a processing flow of the lighting setting and detection processing. After processing is started, generated in step ST61 a dimming information generation unit 201B Dimming information that indicates the light emission intensity of each light source based on the concept data and the dimming table TA2 . That is, the dimming information generation unit 201B generates the dimming information for each light source with reference to the dimming table TA2 so the brightness of the person 6 and the background matches or approaches the brightness in the initial state indicated by the concept data. As described in the first embodiment, as an optimization method for obtaining an optimal lighting setting (dimming information) for the concept data, a quasi-Newton method, a downhill simplex method, a dual simplex method, a sequential linear quadratic programming or the like be applied. Then the processing goes to step ST62 over.

In step ST62 gives the tablet computer 2nd the dimming information indicating the light emission intensity of each light source to the corresponding light source. For example, the tablet computer transmits 2nd the dimming information using the tablet communication unit 202 to the corresponding light source. That of the light source 5A corresponding dimming information is provided by the light source communication unit 503A receive. The dimming control unit 502A controls the light emission intensity of the light emission unit 501A based on the received dimming information. That of the light source 5B corresponding dimming information is provided by the light source communication unit 503B receive. The dimming control unit 502B controls the light emission intensity of the light emission unit 501B based on the received dimming information. That of the light source 5C corresponding dimming information is provided by the light source communication unit 503C receive. The dimming control unit 502C controls the light emission intensity of the light emission unit 501C based on the received dimming information. Then the processing goes to step ST63 over.

In step ST63 becomes the acquisition of a moving image by the imaging device 1 started in the state where each light source emits light based on the dimming information, and an image for one frame is obtained as a result of the detection. The image obtained is from the imaging device 1 to the tablet computer 2nd transfer. After the transferred image through the tablet communication unit 202 is received, the image of the control unit 201 fed. Then the processing goes to step ST64 over.

In step ST64 the control unit calculates 201 a difference between that in step ST64 obtained image of a single image and the concept data. An example of the difference calculation method is described. The control unit 201 extracts a portion that corresponds to the area AR3 equals to the person 6 contains, from the image of a single image. Then the control unit compares 201 an average value of the brightness (luminance) of each pixel in the area AR3 with an average value of the brightness of each pixel in the area AR3 in the initial state and calculates the difference. A similar calculation is made for the area AR4 carried out. Then the processing goes to step ST65 over.

In step ST65 it is determined whether the in step ST64 calculated difference with respect to at least one of the areas AR3 or AR4 is equal to or greater than a predetermined threshold or not. For example, the predetermined threshold value is expediently set to a value that makes it possible to visually recognize a change in brightness. In a case where the difference is not equal to or larger than the predetermined threshold, the processing goes to step ST66 away.

In step ST66 it is determined whether the capturing of the moving image has been completed or not. When the detection of the moving picture has been completed, the processing proceeds to step ST67, and the adjustment (fine adjustment) for the detected moving picture is performed as necessary. In the current example, the determination is in step ST66 negative because the acquisition of only one frame has been completed and processing returns to step ST63 back. Then the processing of the steps ST63 and ST64 for a frame to be captured next.

The current embodiment assumes the case where the person is 6 moved from the depth to the front as described above. While the person 6 approaches the front, the distance between the light source increases 5A and the light source 5B and the person 6 off, in other words, the person 6 is getting lighter. Therefore, the processing in step ST65 affirmative at a certain timing. In this case, processing returns to step ST61 back.

In step ST61 calculates the dimming information generation unit 201B the dimming information new. That is, the dimming information generation unit 201B calculates the dimming information with reference to the dimming table TA2 new so the brightness of the person 6 and the background coincide with the brightness by the concept data at the current position of the person 6 is specified. Conceptually, the light emission intensity of the light source 5A and the light source 5B decreased. However, the brightness of the background decreases and the concept data cannot be implemented. Accordingly, the light emission intensity of the light source 5C elevated. This can result in a case where there is a change due to the movement of the person 6 occurs, the setting regarding each light source can be controlled to maintain the concept data. In particular, the brightness of the person 6 and the background according to the concept data. Then the processing goes to step ST62 and the dimming information indicating the light emission intensity of each light source is from the tablet computer 2nd output (transmitted) to each corresponding light source. Then, the detection of a moving image is carried out in a state in which each light source emits light based on the newly calculated dimming information. The processing described above is repeated during the acquisition of the moving image.

It should be noted that in the 14 illustrated dimming table TA2 only image information is described about when the person 6 in the two places AA and BB is present. Therefore, an influence of the light emission with the light emission intensity by a certain light source on the object at a location between the location AA and the place BB (In the following, the location is referred to as location CC where appropriate; it should be noted that location CC can be any position) using the location information AA and the place BB can be interpolated. For example, in a case where the light source 5A Light with the light emission intensity "weakly" emitted, the luminance level of a pixel in an area by the person 6 is taken in place CC using the luminance level of a pixel in a case where the light source 5A Light with the light emission intensity "weak" emits in a state in which the person is 6 at the place AA and the luminance level of a pixel in a case where the light source 5A Light with the light emission intensity "weak" emits in a state in which the person is 6 locally BB be predicted. Furthermore, in a case where a certain light source emits light with a certain light emission intensity, the luminance level of a pixel can be in a state in which the person is 6 located at the location CC using a change in the spatial position of the person 6 (Change in depth information) can be predicted.

Note that a plurality of the locations CC are set, and the luminance level of each pixel in a case where a certain light source emits light with a certain light emission intensity can be obtained in advance by the above-described calibration processing at the location CC. As a result, the processing load for recalculating the dimming information can be reduced. The setting of the plurality of locations CC between the location AA and the place BB can by the User can be set or can be set automatically as needed. For example, in a case where a change is equal to or greater than a threshold in the brightness of the person 6 is detected in a case where the light source 3A Light emitted with the light emission intensity "weak", position information of the position, the light source, the light emission intensity of the light source and the luminance level of each pixel in the dimming table TA2 described in association with each other.

Note that the degree of change in brightness associated with movement between images is small. Therefore, the processing in the steps ST63 to ST65 in arbitrary units (e.g. in units of 10 frames) instead of in units of a frame.

Example of the Effect Obtained in the Second Embodiment

By executing the processing described above, the settings of the light sources are automatically performed to maintain the concept data even in a case where a moving object is present in an object and a difference between an image made according to the movement of the moving object is obtained, and the concept data occurs. Therefore, according to the second embodiment, the settings of the light sources to obtain a lighting effect desired by the user can be performed automatically even when a moving image is captured. Furthermore, a moving image can be obtained that matches the concept data, regardless of the speed at which the person moves 6 emotional. In addition, effects similar to those in the first embodiment described above can be obtained.

<modification>

The multiple embodiments of the present disclosure have been specifically described. However, the content of the present disclosure is not limited to the above-described embodiments, and various modifications can be made based on the technical idea of the present disclosure. Modifications are described below. Note that the modifications to be described below can be applied to the first and second embodiments unless otherwise specified or in a range where there is no technical contradiction.

In the above-described embodiments, a plurality of concept data can be set, and a plurality of dimming information corresponding to the respective concept data can be generated. The detection can then be carried out several times in a state in which the light sources emit light based on the respective plurality of dimming information.

An image based on the concept data and an image obtained by actual detection may differ by a predetermined amount or more due to a performance limit of a light source or the like. In such a case, a warning or an error in the notification can be issued. As an example, pixel values of pixels forming the image based on the concept data and pixel values of pixels forming the image obtained by actual detection are compared, and in a case where there is a certain number of pixels having a difference equal to or larger than a threshold, the images are determined to differ by a predetermined amount or more. The notification of a warning or an error is made by sound, display, vibration or the like.

In the above-described embodiments, settings such as shutter speed, sensitivity and an aperture of the imaging device can be used 1 be changed. Such settings for the imaging device 1 can be done according to user preferences, such as widening the aperture to blur the background, or can be done to compensate for the performance limit of a light source.

In the above-described embodiments, the light sources can be in the imaging device 1 be installed or to the imaging device 1 attachable / detachable from this or can be lights small enough to be held in the hand of the user. In addition, the detection can be done indoors or outdoors, and some of the light sources can be ambient light (natural light) such as sunlight. Furthermore, the shapes, sizes and arrangement positions of the light sources are only schematically illustrated and are not limited to the examples illustrated in the above-described embodiments. In addition, the number of light sources is not limited to three. Although several dozen light sources can be used in a large production facility, the present technology can be applied to such a large lighting system. Furthermore, a part the light sources are ambient light and another or more of the light sources can be lights.

In the above-described embodiments, the processing for obtaining the dimming information may be performed by another device (e.g., a cloud computer) instead of the tablet computer 2nd be performed. Furthermore, the processing for obtaining the dimming information by the imaging device 1 be performed. In addition, the imaging device 1 or some other device, some or all of the functions of the tablet computer 2nd exhibit. In a case where the tablet computer 2nd the tablet computer can have an imaging function 2nd instead of the imaging device 1 Capture images. In this case, the control unit 201 of the tablet computer 2nd the function of the camera control unit 107 the imaging device 1 exhibit. As described above, the device whose configuration implements the functions in the above-described embodiments can be changed as needed.

The configuration for performing communication (for example, the tablet communication unit 202 ) can be a communication adapter or the like connected to the tablet computer 2nd attachable / detachable from this.

The place where the input using the tablet computer 2nd and the location where the acquisition is performed may not be in the same location, but may be in different locations. For example, a person responsible for determining the concept gives the concept data using the tablet computer 2nd at home or the like and transmits the concept data to a studio in which the acquisition is carried out. A device installed in the studio can perform detection after the dimming information for each light source is generated based on the dimming table and the concept data, and can control the light emission intensity of the light source and the like. This means that the person responsible for determining the concept no longer has to go to the location where the recording is carried out.

In the second embodiment described above, an example of maintaining the brightness of the person and the background has been described as an example of the concept data. However, the conceptual data are not limited to the example. For example, the concept data can be concept data in which a change in brightness is specified. In particular, concept data in which it is specified that a person becomes lighter or darker with a movement of the person can be the concept data. Then, as described in the second embodiment described above, the setting of each light source is appropriately changed to cancel a difference from the concept data caused by the movement of the person, and the concept data is implemented. In addition, the concept data may include, for example, time information, such as how much a person becomes bright after a predetermined time.

In the second embodiment, in a case where a recording rate of the imaging device 1 Is 60 frames per second (fps) and an image generation rate is a high speed such as 120 fps or 240 fps, the calibration processing and the processing for recalculating the dimming information are performed using an image that is not used for recording.

In the second embodiment described above, the movement of the person 6 using the rear-front direction as an example. However, a left-right direction, a diagonal direction, a combined direction of the aforementioned directions, or the like can be used.

The present disclosure can also be implemented by an apparatus, method, program, system, and the like. For example, a program for performing the functions described in the embodiments is made downloadable, and a device that does not have the control function described in the embodiments loads and installs the program, and thereby can perform the control described in the embodiments. The present disclosure can also be implemented by a server that distributes such a program.

In the above-described embodiments, the number of light emission patterns of each light source in the calibration processing is set to one type, and the light emission intensity obtained by an automatic through-the-lens (TTL) dimming function of the imaging device can be considered as the light emission intensity of the light emission pattern each Light source can be used. At this time, it is advantageous to carry out the detection only under ambient light that is not emitted by all light sources.

In the above-described embodiments, the user can be notified in a case where an image obtained by a detection in the calibration processing includes an area that is overexposed or underexposed and exceeds or falls below an upper or lower limit of the luminance value. The image obtained by the detection can be displayed at the time of the notification, and the area that is overexposed or underexposed can be highlighted.

In the above-described embodiments, in a case where the color temperature of each light source is different in the calibration processing, the color temperature of each light can be multiplied by a coefficient to suppress an influence by a difference in color temperature and used. Further, in a case where the color temperature is different depending on the light emission amount even with the same light source, the color temperature can be multiplied and used by a coefficient according to the light emission amount.

In the above-described embodiments, an example of creating the dimming table from the image obtained by detection in the calibration processing has been described. However, the embodiments are not limited to the example. For example, the image information obtained by the acquisition can be used as it is without being converted into the dimming table. The image information used at this time is advantageously a raw image to ensure the number of colors represented by a bit depth of a simulation image and a gradation in order to avoid an influence of gamma.

In the above-described embodiments, an example of using the above-described optimization method to obtain optimal dimming information in the lighting setting and detection processing has been described. In a case of applying the image information obtained by the detection as it is to the lighting setting and detection processing, the lighting setting and detection processing can be performed by another method. In particular, a simulation image of the results of the illumination detection is generated by a comparison brightness combination of images obtained by the detection, and the user confirms the generated image. As a result of the confirmation, in a case where the generated image is a desired simulation image, the dimming information for obtaining a detection result similar to the generated simulation image is transmitted to each light source in response to user operation. On the other hand, in a case where the generated image is not the desired simulation image due to the confirmation, an adjustment is made to obtain a simulation image desired by the user by using a coefficient for the luminance value of each image to be used for a comparison brightness combination. is changed in response to user operation. The dimming information for obtaining a detection result similar to the simulation image after the user adjustment is transmitted to each light source in response to the user operation after the user adjustment is finished.

Using the comparison brightness combination described above, an ambient light component and a light emission component can be calculated separately from each light source. Corresponding pixel values are compared between a captured image only under ambient light and an image emitted by light, and the light emission component can be obtained by obtaining a larger pixel value. Since the relationship between the light emission intensity of a light source and the reflected light obtained by a linear function with a slope of 1 is represented in a log-log graph, the light emission component can be calculated. This considerably reduces the computing effort in the simulation. Furthermore, as the method of comparison brightness combination, a color comparison brightness combination can be used, which carries out a comparison with a total value of RGB.

Furthermore, the simulation image on the display unit 203 be displayed for the user to confirm the simulation image by the comparison brightness combination described above, as for example in 17th is illustrated. At this time, the image that is only acquired under ambient light can be displayed as the reference image IM3 in the initial state, or a simulation image by preset predetermined comparison brightness combination can be displayed. At this time, a comparison brightness combination image selection unit can be used 601 for selecting image information to be used for the comparison brightness combination and a coefficient setting unit 602 for setting a coefficient for the luminance value of each image information item are displayed simultaneously with the IM3. This allows the user to use the comparison brightness combination image selection unit 601 and the coefficient setting unit 602 operate while referencing the reference image IM3, whereby a desired simulation image is adjusted based on the user's own concept. Furthermore, the display unit 203 a light source information display unit 603 to display information of each connected light source, a recalibration instruction unit 604 to issue a recalibration instruction, a Main registration instruction unit 605 for transferring the dimming information to each light source and continuing with the main acquisition and a simulation image output unit 606 to output a simulation image that is displayed as a completed image.

Here, the comparison brightness combination can be performed between the image information acquired only under ambient light and the light emission pattern image information of each light source, or between the image information acquired only under ambient light and the image information of a luminance value difference between the light emission pattern image information of each light source and the image information only be recorded under ambient light. As a result, an influence of a difference in the ambient light as a function of the time of acquisition of the image information that is to be used for the comparison brightness combination can be reduced.

In the above-described embodiments, when a change in a light exposure state of an object is detected by each light source, the imaging device, or the information processing device, some or all of the calibration processing, concept data generation processing, and lighting setting and detection processing can be performed again. Alternatively, part or all of the processes of calibration processing, concept data generation processing, and lighting setting and detection processing can be performed again by a user operation. It can be assumed that the exposure state of an object changes by increasing / decreasing the number of light sources, moving the position of the object or the light source, changing the reflectivity of the object itself, changing a setting value of the imaging device or the light source, attaching / Removing an accessory such as a diffuser or changing the weather or ambient light changes. Each light source, the imaging device or the information processing device detects the change in the exposure state of the object by detecting a user operation, various sensors, changing a captured image, or the like. In the case of detecting the change in the exposure state of the object by the detection of a user operation, various sensors, change in a captured image, or the like, some or all of the various types of processing may be automatically performed again, or the change in the exposure state of the object may be so Users will be notified.

• (1) Eine Informationsverarbeitungsvorrichtung, die Folgendes aufweist:
  • eine Steuereinheit, die dazu ausgelegt ist, eine Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben, zu bestimmen, wobei
  • die Steuereinheit die bestimmte Einstellung steuert, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.
• (2) Die Informationsverarbeitungseinrichtung nach (1), wobei die Konzeptdaten Daten sind, die die für jeden Bereich des Objekts spezifizierte Helligkeit angeben.
• (3) Die Informationsverarbeitungseinrichtung nach (1) oder (2), wobei die Steuereinheit eine Dimmungstabelle, die dem Lichtemissionsergebnis der Lichtemissionseinheit entspricht, auf Basis der Bildinformationen eines Bildes, das in einem Fall erhalten wurde, in dem die Lichtemissionseinheit Licht in einem vorbestimmten Lichtemissionsmuster emittiert hat, erzeugt.
• (4) Die Informationsverarbeitungseinrichtung nach (3), wobei das Lichtemissionsmuster die Lichtemissionsintensität der Lichtemissionseinheit ist.
• (5) Die Informationsverarbeitungseinrichtung nach (3) oder (4), wobei die Steuereinheit die dem Lichtemissionsergebnis der Lichtemissionseinheit entsprechende Dimmungstabelle auf Basis von Positionsinformationen eines sich bewegenden Objekts, das in dem Objekt enthalten ist, erzeugt.
• (6) Die Informationsverarbeitungseinrichtung nach (5), wobei die Steuereinheit Bildinformationen, die einer vorbestimmten Lichtemissionsintensität entsprechen, und vorbestimmte Positionsinformationen verwendet, um Bildinformationen zu erzeugen, die Positionsinformationen entsprechen, die sich von den vorbestimmten Positionsinformationen unterscheiden.
• (7) Die Informationsverarbeitungseinrichtung nach (3), wobei das Lichtemissionsmuster eine Farbtemperatur der Lichtemissionseinheit ist.
• (8) Die Informationsverarbeitungseinrichtung nach einem von (3) bis (7), wobei die Bildinformationen räumliche Sensorinformationen sind, die dem Lichtemissionsmuster der Lichtemissionseinheit entsprechen.
• (9) Die Informationsverarbeitungseinrichtung nach (8), wobei die Bildinformationen ein Luminanzpegel in einer Pixeleinheit oder einer Einheit eines Blocks mit einer beliebigen Größe sind.
• (10) Die Informationsverarbeitungseinrichtung gemäß einem von (1) bis (9), die ferner Folgendes beinhaltet:
  • eine Eingabeeinheit, die dazu ausgelegt ist, eine Eingabe zum Erzeugen der Konzeptdaten anzunehmen.
• (11) Die Informationsverarbeitungseinrichtung nach (10), die ferner Folgendes aufweist:
  • eine Anzeigeeinheit, die dazu ausgelegt ist, ein Referenzbild anzuzeigen, auf das Bezug genommen werden soll, wenn die Eingabe angenommen wird.
• (12) Die Informationsverarbeitungseinrichtung nach einem von (1) bis (11), wobei die Einstellung der Lichtemissionseinheit eine Einstellung in Bezug auf die Lichtemissionsintensität der Lichtemissionseinheit und/oder eine Farbtemperatur des von der Lichtemissionseinheit emittierten Lichts und/oder die Weichheit/Härte des Lichts und/oder den Bestrahlungsbereich des Lichts und/oder eine Bestrahlungsrichtung des Lichts ist.
• (13) Die Informationsverarbeitungseinrichtung gemäß einem von (1) bis (12), die ferner Folgendes aufweist:
  • eine Ausgabeeinheit, die dazu ausgelegt ist, die Einstellung der Lichtemissionseinheit auszugeben.
• (14) Die Informationsverarbeitungseinrichtung nach einem von (1) bis (13), wobei das Objekt ein durch einen Benutzer spezifiziertes Objekt und/oder ein automatisch erkanntes Objekt ist.
• (15) Ein Informationsverarbeitungsverfahren, das Folgendes aufweist:
  • Bestimmen einer Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben; und
  • Steuern der bestimmten Einstellung, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.
• (16) Ein Programm, das einen Computer veranlasst, die folgende Verarbeitung auszuführen:
  • Bestimmen einer Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben; und
  • Steuern der bestimmten Einstellung, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist.
• (17) Ein Beleuchtungssystem, das Folgendes aufweist:
  • eine Informationsverarbeitungseinrichtung; und
  • eine Lichtemissionseinheit,
  • wobei die Informationsverarbeitungseinrichtung Folgendes aufweist:
    • eine Steuereinheit, die dazu ausgelegt ist, eine Einstellung einer Lichtemissionseinheit gemäß Konzeptdaten, die eine Charakteristik eines gewünschten Bildes und ein Lichtemissionsergebnis der Lichtemissionseinheit angeben, zu bestimmen, und die bestimmte Einstellung zu steuern, um die Konzeptdaten in einem Fall beizubehalten, in dem eine Änderung in einem Objekt aufgetreten ist, und
    • eine Ausgabeeinheit, die dazu ausgelegt ist, die Einstellung zu der Lichtemissionseinheit auszugeben,
  • wobei die Lichtemissionseinheit Folgendes aufweist:
    • eine Lichtemissionssteuereinheit, die dazu ausgelegt ist, die Lichtemission basierend auf der von der Informationsverarbeitungseinrichtung ausgegebenen Einstellung zu steuern.
• (18) Das Beleuchtungssystem nach (17), wobei die Informationsverarbeitungseinrichtung das Lichtemissionsergebnis der Lichtemissionseinheit unter Verwendung eines Bildes berechnet, das nicht aufgezeichnet werden soll.

The present disclosure can also employ the following configurations.

• (1) An information processing device comprising:
  • a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, wherein
  • the control unit controls the particular setting to maintain the concept data in a case where a change has occurred in an object.
• ( 2nd ) The information processing facility according to ( 1 ), where the concept data is data indicating the brightness specified for each area of the object.
• (3) The information processing facility according to ( 1 ) or ( 2nd ), wherein the control unit generates a dimming table corresponding to the light emission result of the light emission unit based on the image information of an image obtained in a case where the light emission unit has emitted light in a predetermined light emission pattern.
• (4) The information processing facility according to ( 3rd ), wherein the light emission pattern is the light emission intensity of the light emission unit.
• (5) The information processing facility according to ( 3rd ) or ( 4th ), wherein the control unit generates the dimming table corresponding to the light emission result of the light emission unit on the basis of position information of a moving object contained in the object.
• (6) The information processing facility according to ( 5 ), wherein the control unit uses image information corresponding to a predetermined light emission intensity and predetermined position information to generate image information corresponding to position information different from the predetermined position information.
• (7) The information processing facility according to ( 3rd ), wherein the light emission pattern is a color temperature of the light emission unit.
• (8) The information processing device according to one of ( 3rd ) to ( 7 ), in which the image information is spatial sensor information corresponding to the light emission pattern of the light emission unit.
• (9) The information processing facility according to ( 8th ), the image information being a luminance level in a pixel unit or a unit of a block of any size.
• (10) The information processing device according to one of ( 1 ) to ( 9 ), which also includes:
  • an input unit that is designed to accept an input for generating the concept data.
• (11) The information processing device according to (10), which further comprises:
  • a display unit configured to display a reference image to be referenced when the input is accepted.
• (12) The information processing device according to one of ( 1 ) to ( 11 ), wherein the setting of the light emission unit is a setting with respect to the light emission intensity of the light emission unit and / or a color temperature of the light emitted by the light emission unit and / or the softness / hardness of the light and / or the irradiation range of the light and / or an irradiation direction of the light is.
• (13) The information processing device according to one of ( 1 ) to ( 12 ), which also includes:
  • an output unit that is configured to output the setting of the light emission unit.
• (14) The information processing device according to one of ( 1 ) to ( 13 ), the object being an object specified by a user and / or an automatically recognized object.
• (15) An information processing method comprising:
  • Determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and
  • Control the particular setting to keep the concept data in a case where a change has occurred in an object.
• (16) A program that causes a computer to perform the following processing:
  • Determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and
  • Control the particular setting to keep the concept data in a case where a change has occurred in an object.
• (17) A lighting system comprising:
  • an information processing device; and
  • a light emission unit,
  • the information processing device comprising:
    • a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, and to control the determined setting to keep the concept data in a case where a change occurred in an object, and
    • an output unit that is designed to output the setting for the light emission unit,
  • wherein the light emission unit comprises:
    • a light emission control unit configured to control the light emission based on the setting output from the information processing device.
• (18) The lighting system according to ( 17th ), wherein the information processing device calculates the light emission result of the light emission unit using an image that is not to be recorded.

Reference symbol list

1

Imaging device

2nd

Tablet computer

3A to 3C, 5A to 5C

Light source

10th

Lighting system

107

Camera control unit

201

Control unit

201A

Dimming table generation unit

201B

Dimming information generation unit

202

Tablet communication unit

203

Display unit

204

Input unit

303A to 303C, 503 to 503C

Light source communication unit

Claims (18)

Information processing device comprising: a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, wherein the control unit controls the particular setting to maintain the concept data in a case where a change has occurred in an object. Information processing device after Claim 1 , the concept data being data indicating the brightness specified for each area of the object. Information processing device after Claim 1 wherein the control unit generates a dimming table corresponding to the light emission result of the light emission unit based on the image information of an image obtained in a case where the light emission unit has emitted light in a predetermined light emission pattern. Information processing device after Claim 3 , wherein the light emission pattern is the light emission intensity of the light emission unit. Information processing device after Claim 4 , wherein the control unit generates the dimming table corresponding to the light emission result of the light emission unit based on position information of a moving object contained in the object. Information processing device after Claim 5 wherein the control unit uses image information corresponding to a predetermined light emission intensity and predetermined position information to generate image information corresponding to position information different from the predetermined position information. Information processing device after Claim 3 , wherein the light emission pattern is a color temperature of the light emission unit. Information processing device after Claim 3 , wherein the image information is spatial sensor information corresponding to the light emission pattern of the light emission unit. Information processing device after Claim 8 , wherein the image information is a luminance level in a unit pixel or unit block of any size. Information processing device after Claim 1 that further comprises: an input unit that is configured to accept an input for generating the concept data. Information processing device after Claim 10 further comprising: a display unit configured to display a reference image to be referenced when the input is accepted. Information processing device after Claim 1 , wherein the setting of the light emission unit is a setting with respect to the light emission intensity of the light emission unit and / or a color temperature of the light emitted by the light emission unit and / or the softness / hardness of the light and / or the irradiation range of the light and / or an irradiation direction of the light . Information processing device after Claim 1 further comprising: an output unit configured to output the setting of the light emission unit. Information processing device after Claim 1 , wherein the object is an object specified by a user and / or an automatically recognized object. Information processing method comprising: Determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and Control the particular setting to keep the concept data in a case where a change has occurred in an object. A program that causes a computer to perform the following processing: determining a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit; and controlling the determined setting to maintain the concept data in a case where a change has occurred in an object. Lighting system comprising: an information processing device; and a light emission unit, the information processing device comprising: a control unit configured to determine a setting of a light emission unit according to concept data indicating a characteristic of a desired image and a light emission result of the light emission unit, and to control the determined setting to keep the concept data in a case where a change occurred in an object, and an output unit which is designed to output the setting for the light emission unit, wherein the light emission unit comprises: a light emission control unit configured to control the light emission based on the setting output from the information processing device. Lighting system according to Claim 17 wherein the information processing device calculates the light emission result of the light emission unit using an image that is not to be recorded.

Images