WO2011111296A1 - 撮影装置および情報検出方法 - Google Patents
撮影装置および情報検出方法 Download PDFInfo
- Publication number
- WO2011111296A1 WO2011111296A1 PCT/JP2011/000655 JP2011000655W WO2011111296A1 WO 2011111296 A1 WO2011111296 A1 WO 2011111296A1 JP 2011000655 W JP2011000655 W JP 2011000655W WO 2011111296 A1 WO2011111296 A1 WO 2011111296A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- light
- information
- shooting
- image
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 142
- 238000003384 imaging method Methods 0.000 title claims abstract description 102
- 238000005286 illumination Methods 0.000 claims abstract description 183
- 238000012545 processing Methods 0.000 claims description 122
- 230000035945 sensitivity Effects 0.000 claims description 34
- 230000000295 complement effect Effects 0.000 claims description 3
- 229910044991 metal oxide Inorganic materials 0.000 claims description 3
- 150000004706 metal oxides Chemical class 0.000 claims description 3
- 239000004065 semiconductor Substances 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 abstract description 9
- 238000000034 method Methods 0.000 description 183
- 230000008569 process Effects 0.000 description 156
- 238000010586 diagram Methods 0.000 description 49
- 230000008859 change Effects 0.000 description 18
- 230000006870 function Effects 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 7
- 230000009467 reduction Effects 0.000 description 6
- 238000012937 correction Methods 0.000 description 5
- 230000010354 integration Effects 0.000 description 5
- 230000004397 blinking Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001678 irradiating effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000013404 process transfer Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000030279 gene silencing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
Definitions
- the present invention relates to a photographing apparatus for photographing in an environment irradiated with illumination light.
- Patent Document 1 discloses a photographing apparatus that restricts the use of the apparatus by restricting a photographing function with respect to a photographing target that emits a light pattern that changes with time (hereinafter, conventional photographing Device).
- a conventional photographing apparatus controls the photographing apparatus by detecting a control ID as information superimposed on light.
- the present invention has been made to solve the above-described problems, and an object of the present invention is to provide a photographing apparatus or the like that can detect information superimposed on light at a low cost.
- a photographing apparatus photographs a subject irradiated with illumination light on which information is superimposed.
- the imaging device includes an imaging element unit that converts light from the subject into a video signal, and a light / dark pattern detected from the video signal converted by the imaging element unit, thereby obtaining the information superimposed on the illumination light.
- a light pattern detection unit to detect, a comparison unit that compares the detection information that is the information detected by the light pattern detection unit with predetermined determination information, and a specific image according to a comparison result by the comparison unit
- the display part which displays.
- the image sensor section converts light from the subject into a video signal.
- the light pattern detection unit detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal. That is, a dedicated light receiving element for detecting information superimposed on the light is not required other than the image pickup element unit that converts light into a video signal. Therefore, detection of information superimposed on light can be realized at low cost.
- the image pickup device unit converts light from the subject into the video signal using a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and the video signal indicates RAW data corresponding to a picture.
- the light pattern detection unit calculates luminance values of a plurality of pixels constituting a picture corresponding to the RAW data using the RAW data, and the light pattern detection unit calculates a plurality of luminance values corresponding to the picture. Is detected as the light / dark pattern.
- the image sensor unit converts light from the subject into the video signal using a CCD (Charge-Coupled Device) image sensor, and the video signal includes a plurality of pictures each corresponding to a plurality of pictures.
- CCD Charge-Coupled Device
- the light pattern detection unit calculates luminance values of a plurality of pixels constituting a picture corresponding to the RAW data using the RAW data, and the light pattern detection unit The state of each luminance value corresponding to each of the above is detected as the light / dark pattern.
- the video signal indicates RAW data corresponding to a picture
- the photographing apparatus further uses the RAW data to determine luminance values of a plurality of pixels constituting a picture corresponding to the RAW data.
- An image processing unit for calculating is provided, and the light pattern detection unit detects a plurality of luminance value states corresponding to the picture as the light / dark pattern.
- the comparison unit determines whether or not the detection information and the determination information match by comparing the detection information with the determination information, and the display unit includes the detection information. If the determination information matches the determination information, the specific image is displayed. If the detection information does not match the determination information, the specific image is not displayed.
- a storage unit for storing the determination information is provided.
- the determination information indicates an instruction for prohibiting photographing
- the photographing apparatus further performs photographing as an operation mode of the photographing apparatus when the detection information matches the determination information.
- a mode setting unit for setting a photographing prohibition mode that is not permitted is provided, and the specific image indicates that photographing is prohibited.
- the photographing apparatus further includes a flash light emitting unit for emitting flash light, and the determination information indicates an instruction for prohibiting emission of the flash light at the time of photographing, and the photographing apparatus Further includes a light emission control unit that controls the flash light emission unit to turn off the light emission of the flash light at the time of shooting when the detection information matches the determination information, and the specific image is the flash Indicates that light emission is prohibited.
- a flash light emitting unit for emitting flash light
- the determination information indicates an instruction for prohibiting emission of the flash light at the time of photographing
- the photographing apparatus Further includes a light emission control unit that controls the flash light emission unit to turn off the light emission of the flash light at the time of shooting when the detection information matches the determination information, and the specific image is the flash Indicates that light emission is prohibited.
- the determination information indicates an instruction for increasing the ISO sensitivity at the time of shooting
- the imaging device further sets the ISO sensitivity at the time of shooting when the detection information matches the determination information.
- An ISO sensitivity changing unit that performs control to increase is provided.
- the photographing apparatus further includes an auxiliary light unit that emits auxiliary light for assisting autofocus, and the determination information includes an instruction for turning off the auxiliary light during photographing.
- the imaging apparatus further includes an auxiliary light control unit that controls the auxiliary light unit to turn off the emission of the auxiliary light during imaging when the detection information matches the determination information.
- the determination information indicates an instruction for prohibiting shooting of a still image
- the shooting apparatus further sets an operation mode of the shooting apparatus when the detection information matches the determination information.
- a mode setting unit for setting a still image shooting prohibition mode in which still image shooting is not permitted.
- the determination information indicates an instruction for prohibiting shooting of a moving image
- the shooting apparatus further sets an operation mode of the shooting apparatus when the detection information and the determination information match.
- a mode setting unit is provided for setting a moving image shooting prohibition mode in which moving image shooting is not permitted.
- the determination information indicates an instruction for prohibiting the output of the shutter sound
- the photographing apparatus further includes a speaker for outputting sound
- the detection information matches the determination information.
- a shutter sound control unit that controls the speaker not to output sound as the shutter sound.
- the photographing apparatus further includes a mechanical shutter unit for changing an exposure time by opening and closing a mechanical shutter, and the determination information indicates an instruction for opening the mechanical shutter, and the photographing apparatus Further includes a mechanical shutter control unit that controls the mechanical shutter unit to open the mechanical shutter when the detection information matches the determination information.
- the determination information indicates an instruction to reduce the luminance of the image
- the photographing apparatus further determines the luminance of the image being displayed by the display unit when the detection information matches the determination information.
- a display control unit that performs control to be lowered is provided.
- the determination information indicates an instruction to lower the brightness of the image
- the photographing apparatus further includes an EVF (Electronic View Finder) for displaying the image, and the detection information matches the determination information.
- EVF Electronic View Finder
- a display control unit that performs control to reduce brightness of an image being displayed at least one of the display unit and the EVF.
- the imaging device further includes an operation unit that accepts an operation from outside, a status notification unit for emitting status light for notifying an operation state of the imaging device, and the operation unit, A status notification control unit that controls the status notification unit to blink the status light at a predetermined period corresponding to the operation state of the imaging device when an operation for notifying the operation state of the imaging device is received; Prepare.
- the status notification unit can grasp the operation state of the photographing apparatus by blinking the status light at a predetermined cycle.
- the determination information indicates an instruction for prohibiting shooting of a still image
- the display unit displays a moving image as an operation mode of the shooting device when the detection information matches the determination information.
- the specific image for prompting whether or not to set a moving image shooting mode for shooting is displayed.
- the determination information indicates an instruction for prohibiting the shooting of a moving image
- the display unit displays a still image as an operation mode of the shooting device when the detection information matches the determination information.
- the specific image for prompting whether or not to set a still image shooting mode for shooting is displayed.
- the information detection method is performed by a photographing apparatus that photographs a subject irradiated with illumination light on which information is superimposed.
- the imaging apparatus includes an imaging element unit that converts light from the subject into a video signal and a display unit for displaying an image, and the information detection method includes the video signal converted by the imaging element unit.
- all or some of a plurality of components constituting such an imaging apparatus may be realized as a system LSI (Large Scale Integration).
- the present invention may be realized as an information detection method in which the operation of a characteristic component included in the photographing apparatus is a step.
- the present invention may also be realized as a program that causes a computer to execute each step included in such an information detection method.
- the present invention may be realized as a computer-readable recording medium that stores such a program.
- the program may be distributed via a transmission medium such as the Internet.
- detection of information superimposed on light can be realized at low cost.
- FIG. 1 is a block diagram illustrating a configuration of an imaging system according to the first embodiment.
- FIG. 2 is a diagram for explaining light emitted by the straight tube fluorescent lamp.
- FIG. 3 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 4 is a block diagram illustrating a configuration of the photographing apparatus.
- FIG. 5 is a diagram illustrating a determination information table as an example.
- FIG. 6 is a diagram illustrating an instruction information table as an example.
- FIG. 7 is a block diagram illustrating a functional configuration of the processing unit.
- FIG. 8 is a flowchart of the illumination handling process.
- FIG. 9 is a diagram illustrating a picture as an example.
- FIG. 10 is a diagram for explaining a method of detecting information superimposed on illumination light using a plurality of pictures.
- FIG. 11 is a flowchart of the imaging assistance control process.
- FIG. 12 is a flowchart of the mode switching control process.
- FIG. 13 is a diagram illustrating a specific image as an example.
- FIG. 14 is a diagram illustrating a specific image as an example.
- FIG. 15 is a flowchart of the display control process.
- FIG. 16 is a block diagram illustrating a configuration of an imaging system according to a modification of the first embodiment.
- FIG. 17 is a block diagram illustrating a configuration of the photographing apparatus.
- FIG. 18 is a flowchart of the illumination handling process A.
- FIG. 19 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 19 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 20 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 21 is a diagram for explaining a method for detecting a light / dark pattern of a specific period superimposed on illumination light using a plurality of pictures.
- FIG. 22 is a block diagram illustrating a characteristic functional configuration of the photographing apparatus.
- FIG. 1 is a block diagram illustrating a configuration of an imaging system 1000 according to the first embodiment.
- the photographing system 1000 includes an illumination 50 and a photographing device 100.
- the photographing apparatus 100 is a digital camera such as a digital still camera or a digital video camera.
- the illumination 50 irradiates light superimposed with information, details of which will be described later.
- the light irradiated by the illumination 50 is referred to as illumination light.
- the illumination 50 is a straight tube fluorescent lamp that operates with an AC voltage.
- the illumination light is applied to a subject (for example, a person) in the vicinity of the illumination 50.
- the photographing apparatus 100 receives light L10 emitted from a subject irradiated with illumination light.
- the illumination 50 is not limited to a straight tube fluorescent lamp, but may be an LED (Light Emitting Diode) illumination, an inverter type fluorescent lamp, etc., which will be described later.
- the illumination 50 irradiates illumination light using an AC voltage supplied from a commercial power source (not shown).
- FIG. 2 is a diagram for explaining light emitted by a straight tube fluorescent lamp.
- FIG. 2A is a diagram showing a waveform of an AC voltage.
- the frequency of the AC voltage is 60 Hz.
- 60 Hz is the frequency of the AC power supply mainly supplied in the western Japan region.
- the frequency of the AC voltage may be 24 Hz, 50 Hz, 59.94 Hz, 120 Hz, or the like.
- FIG. 2B is a diagram showing a change in the amount of illumination light emitted by the straight tube fluorescent lamp operating with the AC voltage in FIG.
- the period of change in the amount of illumination light emitted by the straight tube fluorescent lamp is referred to as a low frequency illumination period.
- the low frequency illumination period corresponds to the power supply frequency (for example, 60 Hz) of the shooting location (for example, the western Japan region).
- the low frequency illumination cycle is T / 2 seconds, where one cycle of the AC voltage in FIG. 2A is T seconds.
- the light amount at the position intersecting the horizontal axis is not 0, but indicates a small amount of light. The same applies to the amount of light shown in the drawings described later.
- FIG. 2 (c) is an image diagram showing the change in the amount of light in FIG. 2 (b).
- the part near white shows that the light which a straight tube
- the illumination 50 has a power supply control circuit (not shown).
- a method of superimposing information on the illumination light when the illumination 50 is a straight tube fluorescent lamp will be described.
- the power supply control circuit of the illumination 50 superimposes information on the illumination light by changing the waveform of the AC voltage used for irradiating light.
- FIG. 3 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 3A is a diagram illustrating an example of a waveform of an alternating voltage in which the waveform is changed.
- the power supply control circuit of the illumination 50 can generate an AC voltage having a waveform as shown in FIG.
- the power supply voltage in the period ⁇ is 0V.
- the illumination 50 may generate an alternating voltage having a waveform as shown in FIG. 3A by a method of changing the light emission method.
- FIG. 3B is a diagram showing a change in the amount of light irradiated by the illumination 50 using the AC voltage in FIG. 3B, for example, by defining a period in which the luminance is 0 as “1” and defining a period in which the luminance is not 0 as “0”, information can be superimposed on the illumination light.
- the present invention is not limited to this, and information may be superimposed on illumination light by defining a period in which the luminance is 0 as “0” and a period in which the luminance is not 0 as “1”.
- the illumination 50 can superimpose information on the illumination light by generating a waveform corresponding to the period ⁇ in FIG.
- information may be superimposed on the illumination light in an arbitrary period, for example, other than defining the period in which the information is superimposed on the illumination light according to the period of the AC voltage.
- FIG. 3 (c) is an image diagram showing the change in the amount of light in FIG. 3 (b).
- FIG. 4 is a block diagram showing a configuration of the photographing apparatus 100.
- the imaging apparatus 100 includes a mechanical shutter unit 111, an image sensor unit 112, an image processing unit 120, an EVF (Electronic View Finder) 131, a display unit 132, and a storage unit 143. Prepare.
- the mechanical shutter unit 111 includes a mechanical shutter for blocking light from the outside.
- the mechanical shutter unit 111 opens or closes the mechanical shutter according to an instruction from the outside.
- the mechanical shutter unit 111 changes the exposure time by opening and closing the mechanical shutter.
- the exposure time due to the operation of the mechanical shutter of the mechanical shutter unit 111 is referred to as a mechanical exposure time.
- the image sensor unit 112 includes an image sensor and an AD conversion unit.
- the image sensor is a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
- the image sensor has an electronic shutter.
- the image sensor unit 112 can change the exposure time by controlling the electronic shutter. Below, the exposure time by control of an electronic shutter is called electronic exposure time.
- Each of the CMOS image sensor and the CCD image sensor includes a plurality of color filters arranged in a matrix.
- the arrangement of the plurality of color filters is a Bayer arrangement.
- the arrangement of the plurality of color filters is not limited to the Bayer arrangement, and may be another arrangement.
- the AD converter converts analog signals into digital signals.
- the image sensor of the image sensor unit 112 receives the light L10.
- the image sensor unit 112 converts the received light L10 into an electric signal by an image sensor, and converts the electric signal into an s (natural number) bit digital signal (hereinafter referred to as a video signal) by an AD converter.
- the video signal is a signal indicating RAW data corresponding to each of a plurality of pictures constituting a moving image.
- the number of pictures per second in the moving image varies depending on the electronic exposure time. For example, when the electronic exposure time is 1/30 seconds, the number of pictures per second in the moving image is 30. In this case, the RAW data indicated by the video signal changes every 1/30 seconds.
- the image sensor unit 112 transmits the video signal to the image processing unit 120 and the light pattern detection unit 141.
- the image processing unit 120 performs image processing N.
- the image processing unit 120 performs demosaic processing on each RAW data indicated by the received video signal. Thereby, the image processing unit 120 obtains RGB data corresponding to each RAW data. Then, the image processing unit 120 performs a color conversion process for obtaining a luminance signal and a color difference signal from each RGB data, thereby obtaining a luminance signal (Y) and a color difference signal (C) corresponding to each RGB data.
- the image processing unit 120 transmits the luminance signal and the color difference signal to the EVF 131 and the display unit 132.
- the image processing N processes such as white balance adjustment, gamma correction, gain correction, distortion correction, and enlargement / reduction zoom are performed as necessary.
- the RGB data obtained by the image processing N may be transmitted to the EVF 131 and the display unit 132.
- the EVF 131 has a small LCD (Liquid Crystal Display) that displays an image using a backlight.
- the EVF 131 displays an image using the LCD.
- the EVF 131 may have a display device other than the LCD.
- the EVF 131 displays an image based on the luminance signal and the color difference signal (or RGB data) transmitted from the image processing unit 120.
- the display unit 132 is an LCD that displays an image using a backlight.
- the display unit 132 displays an image.
- the display unit 132 may be a display device other than the LCD.
- the display unit 132 displays an image based on the luminance signal and the color difference signal (or RGB data) transmitted from the image processing unit 120.
- the storage unit 143 is a nonvolatile memory. Note that the storage unit 143 may be a volatile memory (for example, SRAM). The information stored in the storage unit 143 may be information read from a ROM (not shown) and stored in the storage unit 143.
- the storage unit 143 stores a determination information table T100 for detecting information superimposed on the illumination light.
- the process in which the determination information table T100 is stored in the storage unit 143 does not matter.
- the determination information table T100 may be stored in the storage unit 143 via a recording medium.
- the determination information table T100 transmitted via a communication line or the like may be stored in the storage unit 143.
- the determination information table T100 input via the input device may be stored in the storage unit 143.
- FIG. 5 is a diagram showing a determination information table T100 as an example.
- “number” is a number for specifying “determination code”.
- the “determination code” is determination information for detecting information superimposed on the illumination light.
- the determination code is expressed as a binary number as an example.
- the determination code is not limited to binary numbers, and may be expressed by other symbols (for example, alphabets).
- instruction is an instruction corresponding to a corresponding determination code. Although details will be described later, the photographing apparatus 100 performs processing in accordance with the instruction.
- the illumination 50 stores an instruction information table T50 indicating some or all of the plurality of instruction codes shown in the determination information table T100.
- FIG. 6 is a diagram showing an instruction information table T50 as an example.
- “number” is a number for specifying “instruction code”.
- the “instruction code” is instruction information for controlling the photographing apparatus 100.
- the instruction code is expressed by a binary number.
- the instruction code is not limited to binary numbers, and may be expressed by other symbols (for example, alphabets).
- instruction is an instruction corresponding to the corresponding instruction code.
- the instruction information table T50 shows a plurality of instruction codes as instruction information, but only one instruction code may be shown.
- the illumination 50 irradiates the illumination light by superimposing all the instruction codes shown in the instruction information table T50 on the illumination light, for example, by the method described in FIG. All the instruction codes shown in the instruction information table T50 are repeatedly superimposed on the illumination light emitted by the illumination 50 continuously in a predetermined cycle.
- instruction code superimposed on the illumination light may be a part of the instruction codes instead of all the instruction codes shown in the instruction information table T50.
- the imaging apparatus 100 further includes a light pattern detection unit 141, a comparison unit 142, a processing unit 150, an operation unit 170, a flash light emission unit 171, an auxiliary light unit 172, A speaker 181 and a status notification unit 182 are provided.
- the light pattern detection unit 141 performs processing described later using a video signal received from the image sensor unit 112.
- the comparison unit 142 performs processing described later using information received from the light pattern detection unit 141.
- the processing unit 150 is an MPU (Micro Processing Unit). Note that the processing unit 150 is not limited to the MPU, and may be another circuit having an arithmetic function, a dedicated circuit for performing a specific process, or the like. The processing unit 150 performs various processes to be described later by executing a program stored in a memory (not shown).
- MPU Micro Processing Unit
- the operation unit 170 includes a plurality of buttons and a dial for the user to operate.
- the operation unit 170 detects the operation state of the user with respect to a plurality of buttons and dials, and transmits operation information indicating the operation state to the processing unit 150.
- the processing unit 150 performs processing corresponding to the received operation information. That is, the operation unit 170 is an interface for the user to operate the photographing apparatus 100. Hereinafter, the operation of the operation unit 170 performed by the user is also referred to as an operation U.
- the flash light emission unit 171 emits the flash light at the time of shooting.
- the auxiliary light unit 172 includes light emitting elements such as LEDs and infrared light bulbs.
- the auxiliary light unit 172 emits auxiliary light using the light emitting element according to control by an auxiliary light control unit 154 described later.
- the auxiliary light is, for example, light for assisting autofocus during shooting.
- the amount of light L10 can be increased even when the amount of light L10 from the subject is small.
- Speaker 181 outputs sound.
- the status notification unit 182 has a light emitting element such as an LED.
- the status notification unit 182 emits status light using the light emitting element according to control by a status notification control unit 160 described later.
- the status light is light for notifying the operation state of the image capturing apparatus 100.
- the status notification unit 182 notifies the operating state of the imaging apparatus 100 by setting the blinking cycle of the status light emitted from the light emitting element to a predetermined blinking cycle.
- the operating state of the imaging device 100 is, for example, a shooting state.
- the status notification unit 182 may have a plurality of light emitting elements. In this case, the operating state of the photographing apparatus 100 may be notified by a combination of light emitted from a plurality of light emitting elements.
- the photographing apparatus 100 has, as operation modes, a still image photographing mode, a moving image photographing mode, a photographing prohibiting mode, a light emission prohibiting mode, a still image photographing prohibiting mode, and a moving image photographing prohibiting mode.
- Each operation mode becomes valid when set, and becomes invalid when released.
- the photographing apparatus 100 performs an operation corresponding to each of a plurality of set operation modes. For example, when a still image shooting mode and a light emission prohibition mode are set as the operation mode of the image capturing apparatus 100, the image capturing apparatus 100 performs an operation corresponding to each of the still image shooting mode and the light emission prohibition mode.
- the still image shooting mode is a mode for shooting a still image.
- the moving image shooting mode is a mode for shooting a moving image.
- All or part of the light pattern detection unit 141 and the comparison unit 142 included in the imaging apparatus 100 may be configured by hardware such as an LSI (Large Scale Integration). Further, all or a part of the image processing unit 120, the light pattern detection unit 141, the comparison unit 142, and the processing unit 150 may be configured by hardware such as one LSI (Large Scale Integration). .
- all or part of the light pattern detection unit 141, the comparison unit 142, and the image processing unit 120 may be a module of a program executed by a processor such as a CPU.
- FIG. 7 is a block diagram showing a functional configuration of the processing unit 150.
- the processing unit 150 includes a photographing prohibition setting unit 151, a light emission control unit 152, an image generation unit 153, an auxiliary light control unit 154, a mode setting unit 155, an operation determination unit 156, a shutter sound control unit 157, A mechanical shutter control unit 158, a display control unit 159, a status notification control unit 160, and an ISO sensitivity change unit 161 are included.
- the mode setting unit 155 sets various modes to be described later as the operation mode of the photographing apparatus 100.
- the ISO sensitivity changing unit 161 performs processing for extending the exposure time of the image sensor unit 112, processing for adjusting gain, processing for adjusting gain in the image processing unit 120, and the like.
- the photographing prohibition setting unit 151, the light emission control unit 152, the image generation unit 153, the auxiliary light control unit 154, the mode setting unit 155, the operation determination unit 156, the shutter sound control unit 157, and the mechanical shutter control included in the processing unit 150 are included. All or part of the unit 158, the display control unit 159, the status notification control unit 160, and the ISO sensitivity change unit 161 may be configured by hardware such as an LSI.
- All or part of the status notification control unit 160 and the ISO sensitivity changing unit 161 may be a module of a program executed by the processing unit 150.
- the illumination handling process is performed when the still image shooting mode or the moving image shooting mode is set as the operation mode of the shooting apparatus 100.
- Each of the still image shooting mode and the moving image shooting mode is set, for example, when an operation U for setting a corresponding shooting mode is performed.
- the processing unit 150 When the still image shooting mode or the moving image shooting mode is set, the processing unit 150 performs control for shooting on each unit in the shooting apparatus 100. For example, the processing unit 150 transmits an instruction to open the shutter to the mechanical shutter unit 111. The mechanical shutter unit 111 opens the shutter according to the received instruction. Thereby, the image sensor of the image sensor unit 112 receives the light L10 from the subject.
- the light L10 includes light emitted from a subject irradiated with illumination light from the illumination 50.
- the light L10 includes illumination light from the illumination 50. That is, the light L10 is light on which information superimposed on illumination light is superimposed.
- the image sensor unit 112 converts the received light L10 into an electric signal using an image sensor, and converts the electric signal into the video signal described above using an AD conversion unit.
- the video signal is a signal indicating RAW data corresponding to each of a plurality of pictures constituting a moving image.
- the number of pictures per second in the moving image varies depending on the electronic exposure time. For example, when the electronic exposure time is 1/30 seconds, the number of pictures per second in the moving image is 30. In this case, the RAW data indicated by the video signal changes every 1/30 seconds.
- the image sensor unit 112 transmits the video signal to the image processing unit 120 and the light pattern detection unit 141.
- the image processing unit 120 performs the image processing N described above. As a result, the luminance signal and the color difference signal are transmitted to the EVF 131 and the display unit 132. Each of the EVF 131 and the display unit 132 displays an image based on the received luminance signal and color difference signal.
- each of the image processing unit 120 and the light pattern detection unit 141 receives a video signal from the image sensor unit 112. It is a process performed when
- FIG. 8 is a flowchart of the illumination handling process.
- step S110 information detection processing is performed.
- the information detection process a process of detecting information superimposed on the light L10 from the video signal is performed. That is, processing for detecting information superimposed on the illumination light emitted by the illumination 50 is performed.
- the light pattern detection unit 141 performs a signal conversion process.
- the signal conversion processing the light pattern detection unit 141 performs demosaic processing on each RAW data indicated by the received video signal. Accordingly, the light pattern detection unit 141 obtains RGB data corresponding to each RAW data.
- the light pattern detection unit 141 obtains a luminance signal and a color difference signal corresponding to each RGB data by performing a color conversion process for obtaining a luminance signal and a color difference signal from each RGB data.
- the luminance signal indicates the luminance value of a plurality of pixels constituting a picture corresponding to each RAW data. That is, the light pattern detection unit 141 uses each RAW data to calculate the luminance values of a plurality of pixels constituting a picture corresponding to the RAW data.
- the light pattern detection unit 141 detects information superimposed on the illumination light from each luminance value.
- the illumination 50 is assumed to be a straight tube fluorescent lamp as an example.
- the illumination 50 is assumed to operate with an AC voltage having a period T as an example. That is, the low frequency illumination cycle of the illumination 50 is T / 2 seconds.
- the image sensor of the imaging element unit 112 is a CMOS image sensor.
- the electronic exposure time is set equal to or shorter than the low frequency illumination period, or The electron exposure time needs to be at least twice as long as the low frequency illumination period.
- the electronic exposure time is the same as the low frequency illumination cycle or shorter than the low frequency illumination cycle, a difference in brightness occurs in the field or frame unit as in the CCD image sensor.
- the electronic exposure time is set to at least twice the low frequency illumination cycle.
- the electronic exposure time is 2 T seconds, which is four times the low frequency illumination period T / 2 seconds.
- one picture indicated by the luminance signal obtained by the light pattern detection unit 141 in the information detection process is as the following picture P100.
- FIG. 9 is a diagram showing a picture P100 as an example. Note that although the subject image is actually displayed in the picture P100, the subject image is not shown for the sake of explanation.
- the right side of the picture P100 shows a change in the amount of illumination light having a period of T / 2 seconds when the vertical direction of the picture P100 is time.
- the light pattern detection unit 141 sets, in the picture P100, an area corresponding to a part where the amount of illumination light is equal to or greater than a predetermined value as a determination area.
- the determination area is an area for detecting information.
- k determination areas are set in the picture P100.
- the interval between two adjacent determination areas in the vertical direction is constant.
- determination regions R10.1, 10.2, 10.3, and 10.4 are set in the picture P100 as shown in FIG.
- each of the determination regions R10.1, 10.2, 10.3, and 10.4 is also simply referred to as a determination region R10.
- the picture P100 is a picture when information is not superimposed on the illumination light.
- each determination region R10 is a high luminance region.
- the high luminance region is a region in which the average value of the luminance values of a plurality of pixels in the determination region R10 is equal to or greater than a predetermined determination threshold value. That is, the high luminance area is a bright area.
- the determination threshold is a threshold for detecting information.
- the determination area in which the average of the luminance values of a plurality of pixels in the determination area is less than the determination threshold is referred to as a low luminance area.
- each determination region R10 in the picture P100 is a high luminance region or a low luminance region.
- the picture P100 shows a certain light / dark pattern.
- the light pattern detection unit 141 determines whether the average value of the luminance values of the plurality of pixels in each determination region R10 in the picture P100 is greater than or equal to the determination threshold value, thereby determining “0” and “1”. ”Is detected. That is, the light pattern detection unit 141 detects information superimposed on the illumination light in units of at least two lines of the picture P100.
- the light pattern detection unit 141 detects information superimposed on the illumination light by detecting the state of a plurality of luminance values corresponding to the picture P100 as a light / dark pattern.
- Each luminance value is a value obtained from the video signal. That is, the light pattern detection unit 141 detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal.
- the determination areas R10.1, 10.2, 10.3, and 10.4 in the picture P100 are a low luminance area, a high luminance area, a high luminance area, and a high luminance area, respectively.
- the light pattern detection unit 141 determines whether or not the average value of the luminance values of the plurality of pixels in each determination region R10 in the picture P100 is higher than the determination threshold, whereby the instruction code “1000” is set. To detect.
- the light pattern detection unit 141 detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal.
- information is detected from one picture.
- information may be detected from a plurality of pictures.
- the value for detecting information is not limited to the average value of the luminance values of the plurality of pixels in the determination region R10, and may be a variance value of the luminance values of the plurality of pixels in the determination region R10.
- the information detection method is not limited to the above method.
- the information may be detected by calculating the number of occurrences of low-luminance area portions in a predetermined time.
- the illumination 50 is assumed to be a straight tube fluorescent lamp as an example.
- the illumination 50 is assumed to operate with an AC voltage having a period T as an example. That is, the low frequency illumination cycle of the illumination 50 is T / 2 seconds.
- the image sensor of the imaging element unit 112 is a CCD image sensor.
- the CCD image sensor is configured to read data in units of one picture, the exposure time (electronic exposure time) of each pixel in one picture is almost the same. Therefore, in order to detect information from the video signal, a plurality of pictures are required.
- the electronic exposure time is T / 8 seconds which is 1/4 times the low frequency illumination period T / 2 seconds.
- FIG. 10 is a diagram for explaining a method of detecting information superimposed on illumination light using a plurality of pictures.
- FIG. 10A is a diagram showing a change in the amount of illumination light having a period of T / 2 seconds.
- FIG. 10B is a diagram showing a part of a plurality of pictures indicated by the luminance signal obtained in the information detection process.
- Some of the plurality of pictures are pictures P11, P12, P13, P14, and P15.
- an image of the subject is actually displayed, but the image of the subject is not shown for the sake of explanation.
- Pictures P11, P12, P13, P14, and P15 are generated in the order of pictures P11 to P15. That is, the picture P15 is a picture generated after the picture P11.
- Each of the pictures P11, P12, P13, P14, and P15 corresponds to the time axis of FIG.
- the light pattern detection unit 141 sets a picture corresponding to a portion where the amount of illumination light is a predetermined value or more as a determination picture.
- the determination picture is a picture for detecting information.
- the pictures P11, P12, P13, P14, and P15 in FIG. 10B are pictures when information is not superimposed on the illumination light.
- an odd-numbered picture is set as a determination picture. That is, as an example, it is assumed that pictures P11, P13, and P15 are set as determination pictures.
- the pictures P11, P13, and P15 are high-intensity pictures.
- the high-intensity picture is an area where the average value of the luminance values of a plurality of pixels constituting the determination picture is equal to or greater than a predetermined determination threshold value P. That is, the high brightness picture is an overall bright picture.
- the determination threshold value P is a threshold value for detecting information.
- the determination picture in which the average of the luminance values of a plurality of pixels constituting the determination picture is less than the determination threshold value P is referred to as a low luminance picture.
- FIG. 10C is a diagram showing each picture when information is superimposed on illumination light.
- each determination picture is a high-intensity picture or a low-intensity picture.
- the plurality of determination pictures show a certain light / dark pattern.
- the light pattern detection unit 141 detects “0” and “1” by determining whether or not the average value of the luminance values of the plurality of pixels constituting each determination picture is equal to or greater than the determination threshold value P. To do.
- the light pattern detection unit 141 detects information superimposed on the illumination light by detecting the state of each luminance value corresponding to each of the plurality of pictures as a light / dark pattern.
- Each luminance value is a value obtained from the video signal. That is, the light pattern detection unit 141 detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal.
- the pictures P11, P13, and P15 as determination pictures are a low-intensity picture, a high-intensity picture, and a high-intensity picture, respectively.
- the light pattern detection unit 141 determines whether or not the average value of the luminance values of a plurality of pixels constituting each determination picture (for example, the picture P11) is higher than the determination threshold value P, thereby indicating the instruction code “ 100 "is detected.
- each picture is processed by the interlace method, each picture is an odd field or an even field. Therefore, information superimposed on the illumination light is detected in field units.
- the low frequency illumination cycle is longer than the cycle of each field in the video signal. That is, in this case, the information superimposed on the illumination light can be detected by making the period of each field in the video signal shorter than the low frequency illumination period.
- the low frequency illumination cycle is longer than the cycle of each frame in the video signal. That is, in this case, information superimposed on the illumination light can be detected by making the cycle of each frame in the video signal shorter than the low frequency illumination cycle.
- the light pattern detection unit 141 detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal.
- the value for detecting information is not limited to the average value of the luminance values of a plurality of pixels constituting each determination picture, and is, for example, a variance value of the luminance values of a plurality of pixels constituting each determination picture. May be.
- the information detection method is not limited to the above method.
- the information may be detected by calculating the number of low-intensity pictures that appear in a predetermined time.
- the light pattern detection unit 141 detects all instruction codes as instruction information superimposed on the illumination light by the method described above. Then, the light pattern detection unit 141 transmits all detected instruction codes to the comparison unit 142.
- step S120 it is determined whether there is a photographing prohibition instruction for prohibiting photographing. Specifically, whether any of the received instruction codes (instruction information) matches the determination code corresponding to the “shooting prohibition” instruction shown in the determination information table T100 of FIG. Determine whether or not. That is, the comparison unit 142 determines whether or not the detection information matches the determination information by comparing all the instruction codes as the instruction information with the determination code as the determination information. That is, the process of step S120 is a process in which the comparison unit 142 compares the detection information that is information detected by the process of step S110 with predetermined determination information.
- the determination code corresponding to the “shooting prohibition” instruction indicates an instruction for prohibiting shooting.
- the determination result by the comparison unit 142 is notified to the processing unit 150.
- step S120 If NO in step S120, the process proceeds to step S200. On the other hand, if YES in step S120, the process proceeds to step S130 described later.
- step S200 an imaging assistance control process is performed.
- FIG. 11 is a flowchart of the imaging assistance control process.
- step S210 it is determined whether or not there is a flash light prohibition instruction for prohibiting flash light emission. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “flash light prohibition” instruction shown in the determination information table T100. Determine. The determination code corresponding to the instruction “prohibit flash light” indicates an instruction for prohibiting flash light emission during photographing. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S210 If YES in step S210, the process proceeds to step S211. On the other hand, if NO at step S210, the process proceeds to step S220 described later.
- step S211 the light emission control unit 152 controls the flash light emission unit 171 to turn off the flash light emission during photographing. Specifically, as the operation mode of the photographing apparatus 100, a light emission prohibition mode in which flash light emission is not permitted is set. Accordingly, the flash light emitting unit 171 does not emit flash light during shooting.
- step S212 flash photography prohibition notification processing is performed.
- the image generation unit 153 generates a specific image A indicating a message indicating that flash light emission is prohibited.
- the message is, for example, a message that “shooting using flash light is prohibited”.
- the image generation unit 153 transmits the generated specific image A to the display unit 132.
- the display unit 132 displays the received specific image A.
- the specific image A may be displayed by the EVF 131.
- the specific image (for example, the specific image A) may be displayed by being superimposed on the image being displayed by the display unit 132.
- step S220 it is determined whether there is an auxiliary light-off instruction for turning off the emission of auxiliary light at the time of shooting. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “auxiliary light off” instruction shown in the determination information table T100. Determine. The determination code corresponding to the “auxiliary light off” instruction indicates an instruction to turn off the emission of auxiliary light at the time of shooting. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S220 If YES in step S220, the process proceeds to step S221. On the other hand, if NO at step S220, the process proceeds to step S230 described later.
- step S221 the auxiliary light control unit 154 transmits an instruction to turn off the auxiliary light to the auxiliary light unit 172.
- the auxiliary light unit 172 turns off the emission of the auxiliary light by receiving the instruction.
- the auxiliary light control unit 154 controls the auxiliary light unit 172 to turn off the emission of auxiliary light at the time of shooting.
- step S222 an auxiliary light off notification process is performed.
- the image generation unit 153 generates a specific image B indicating a message indicating that the emission of auxiliary light has been turned off.
- the message is, for example, a message “Auxiliary light emission has been turned off”.
- the image generation unit 153 transmits the generated specific image B to the display unit 132.
- the display unit 132 displays the received specific image B.
- the specific image B may be displayed by the EVF 131.
- step S230 it is determined whether there is an ISO sensitivity increase instruction for increasing the ISO sensitivity at the time of shooting. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “ISO sensitivity increase” instruction shown in the determination information table T100. Determine. The determination code corresponding to the “ISO sensitivity increase” instruction indicates an instruction for increasing the ISO sensitivity at the time of shooting. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S230 If YES in step S230, the process proceeds to step S231. On the other hand, if NO at step S230, the imaging assistance control process ends, the process returns to the illumination handling process, and the process proceeds to step S300.
- the ISO sensitivity increase instruction is, for example, an instruction for compensating for a shortage of light quantity when there is a flash light prohibition instruction or the like.
- step S231 ISO sensitivity increase processing is performed.
- the ISO sensitivity changing unit 161 controls the image sensor unit 112 so that the exposure time in the image sensor unit 112 is longer than the exposure time set at the present time.
- the ISO sensitivity changing unit 161 controls the image sensor unit 112 so as to increase the gain at the time of AD conversion. Furthermore, the ISO sensitivity changing unit 161 may control the image processing unit 120 so as to increase the gain in gamma correction or gain correction in the image processing N.
- the ISO sensitivity changing unit 161 performs control to increase the ISO sensitivity at the time of shooting.
- the ISO sensitivity changing unit 161 When there is an instruction to decrease the ISO sensitivity instead of the ISO sensitivity increase instruction, the ISO sensitivity changing unit 161 performs control to decrease the ISO sensitivity at the time of photographing of the photographing apparatus 100 according to the instruction. Also good.
- step S232 an ISO sensitivity increase notification process is performed.
- the image generation unit 153 generates a specific image C indicating a message indicating that the ISO sensitivity has been increased.
- the message is, for example, a message “ISO sensitivity has been increased”.
- the image generation unit 153 transmits the generated specific image C to the display unit 132.
- the display unit 132 displays the received specific image C.
- the specific image C may be displayed by the EVF 131.
- the instruction code may indicate an instruction for correcting the video signal or the luminance signal. In this case, the influence of the luminance signal change due to flicker can be eliminated.
- step S300 a mode switching control process is performed.
- FIG. 12 is a flowchart of the mode switching control process.
- step S310 the mode setting unit 155 determines whether or not the still image shooting mode is set as the operation mode of the shooting apparatus 100. If YES in step S310, the process proceeds to step S320. On the other hand, if NO at step S310, the process proceeds to step S340 described later.
- step S320 it is determined whether or not there is a still image shooting prohibition instruction for prohibiting still image shooting.
- the comparison unit 142 determines whether any of the received instruction codes (instruction information) matches the determination code corresponding to the “still image capturing prohibition” instruction shown in the determination information table T100. Determine whether.
- the determination code corresponding to the instruction “prohibit still image shooting” indicates an instruction for prohibiting shooting of a still image.
- the determination result by the comparison unit 142 is notified to the processing unit 150.
- step S320 If YES in step S320, the process proceeds to step S321. On the other hand, if NO at step S320, the process proceeds to step S360 described later.
- step S321 the mode setting unit 155 sets a still image shooting prohibition mode in which still image shooting is not permitted as the operation mode of the shooting apparatus 100. In this case, the still image shooting mode setting is canceled. As a result, the photographing apparatus 100 is not permitted to capture a still image.
- step S322 a still image shooting prohibition notification process is performed.
- the image generation unit 153 generates the following specific image G100 indicating a message indicating that still image shooting is prohibited and a message prompting whether to set the moving image shooting mode.
- the image generation unit 153 transmits the generated specific image G100 to the display unit 132.
- the display unit 132 displays the received specific image G100.
- FIG. 13 is a diagram showing a specific image G100 as an example.
- the specific image G100 indicates a message indicating that still image shooting is prohibited.
- the specific image G100 indicates a message that prompts whether or not to set a moving image shooting mode for shooting a moving image as the operation mode of the image capturing apparatus 100.
- step S330 operation determination unit 156 determines whether or not a moving image shooting setting operation has been performed.
- the moving image shooting setting operation is an operation U for setting the moving image shooting mode as the operation mode of the shooting apparatus 100.
- the operation unit 170 accepts the moving image shooting setting operation, the operation unit 170 transmits operation information indicating the moving image shooting setting operation to the processing unit 150. Thereby, the operation determination unit 156 determines whether or not a moving image shooting setting operation has been performed.
- step S330 If YES in step S330, the process proceeds to step S331. On the other hand, if NO at step S330, the process proceeds to step S130 described later.
- step S331 the mode setting unit 155 sets the moving image shooting mode as the operation mode of the shooting apparatus 100. In this case, the still image shooting mode setting is canceled.
- each operation of the mechanical shutter unit 111, the image sensor unit 112, and the image processing unit 120 is an operation for performing moving image shooting.
- step S340 it is determined whether or not there is a moving image shooting prohibition instruction for prohibiting moving image shooting.
- the comparison unit 142 determines whether any of the received instruction codes (instruction information) matches the determination code corresponding to the “movie shooting prohibited” instruction shown in the determination information table T100. Determine.
- the determination code corresponding to the instruction “movie shooting prohibited” indicates an instruction for prohibiting movie shooting.
- the determination result by the comparison unit 142 is notified to the processing unit 150.
- step S340 If YES in step S340, the process proceeds to step S341. On the other hand, if NO at step S340, the process proceeds to step S360 described later.
- step S341 the mode setting unit 155 sets a moving image shooting prohibition mode in which shooting of moving images is not permitted as the operation mode of the shooting apparatus 100. In this case, the setting of the moving image shooting mode is cancelled. As a result, the photographing apparatus 100 is not permitted to shoot moving images.
- step S342 a moving image shooting prohibition notification process is performed.
- the image generation unit 153 generates the following specific image G200 indicating a message indicating that moving image shooting is prohibited and a message prompting whether to set the still image shooting mode.
- the image generation unit 153 transmits the generated specific image G200 to the display unit 132.
- the display unit 132 displays the received specific image G200.
- FIG. 14 is a diagram illustrating a specific image G200 as an example.
- the specific image G200 indicates a message indicating that moving image shooting is prohibited. Further, the specific image G200 indicates a message asking whether or not to set a still image shooting mode for shooting a still image as an operation mode of the image capturing apparatus 100.
- step S350 operation determination unit 156 determines whether or not a still image shooting setting operation has been performed.
- the still image shooting setting operation is an operation U for setting a still image shooting mode as an operation mode of the shooting apparatus 100.
- the operation unit 170 receives a still image shooting setting operation, the operation unit 170 transmits operation information indicating the still image shooting setting operation to the processing unit 150. Thereby, the operation determination unit 156 determines whether or not a still image shooting setting operation has been performed.
- step S350 the process proceeds to step S351.
- step S350 the mode switching control process ends, the process returns to the illumination corresponding process in FIG. 8, and the process proceeds to step S130 described later.
- step S351 the mode setting unit 155 sets the still image shooting mode as the operation mode of the shooting apparatus 100. In this case, the setting of the moving image shooting mode is cancelled.
- the operations of the mechanical shutter unit 111, the image sensor unit 112, and the image processing unit 120 are operations for performing still image shooting.
- step S310 is performed again.
- step S320 If NO in step S320, the process proceeds to step S360.
- step S120 when there is a still image shooting prohibition instruction and a moving image shooting prohibition instruction, there is a shooting prohibition instruction. Therefore, in this case, YES is determined in step S120, and the process proceeds to step S130. Therefore, in the mode switching control process, a state in which the processes of steps S321 and S341 are permanently repeated does not occur.
- step S360 it is determined whether there is a shutter sound prohibition instruction for prohibiting the output of the shutter sound. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “shutter sound prohibition” instruction shown in the determination information table T100. Determine. The determination code corresponding to the “shutter sound prohibition” instruction indicates an instruction for prohibiting the output of the shutter sound. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S360 If YES in step S360, the process proceeds to step S361. On the other hand, if NO at step S360, the process proceeds to step S370 to be described later.
- step S361 shutter sound off processing is performed.
- the shutter sound control unit 157 performs a process for preventing the shutter sound from being output from the speaker 181. This process is, for example, a process of setting the volume of the shutter sound transmitted to the speaker 181 to zero. Note that a process for silencing such as powering down the speaker 181 may be performed. That is, the shutter sound control unit 157 controls the speaker 181 not to output sound as shutter sound.
- step S362 a shutter sound prohibition notification process is performed.
- the image generation unit 153 generates a specific image D indicating a message indicating that the output of the shutter sound is prohibited.
- the message is, for example, a message “Shutter sound output is prohibited”.
- the image generation unit 153 transmits the generated specific image D to the display unit 132.
- the display unit 132 displays the received specific image D.
- the specific image D may be displayed by the EVF 131.
- step S370 it is determined whether or not there is a mechanical shutter opening instruction for opening the mechanical shutter. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “mechanical shutter release” instruction shown in the determination information table T100. Determine. The determination code corresponding to the “mechanical shutter release” instruction indicates an instruction for opening the mechanical shutter. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S370 If YES in step S370, the process proceeds to step S371. On the other hand, if NO in step S370, the mode switching control process ends, the process returns to the illumination corresponding process in FIG. 8, and the process proceeds to step S400.
- step S371 the mechanical shutter control unit 158 controls the mechanical shutter unit 111 to open the mechanical shutter.
- the electronic shutter in the image sensor unit 112 is also controlled.
- a mechanical shutter release notification process is performed.
- the image generation unit 153 generates a specific image E indicating a message indicating that the mechanical shutter is open.
- the message is, for example, a message “Mechanical shutter is open”.
- the image generation unit 153 transmits the generated specific image E to the display unit 132.
- the display unit 132 displays the received specific image E.
- the specific image E may be displayed by the EVF 131.
- step S400 a display control process is performed.
- FIG. 15 is a flowchart of the display control process.
- step S410 it is determined whether or not there is an image display off instruction for turning off the image display. Specifically, whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “image display off” instruction shown in the determination information table T100. Determine. The determination code corresponding to the “image display off” instruction indicates an instruction not to display an image. The determination result by the comparison unit 142 is notified to the processing unit 150.
- step S410 If YES in step S410, the process proceeds to step S411. On the other hand, if NO at step S410, the process proceeds to step S420.
- step S411 an image display off notification process is performed.
- the image generation unit 153 generates a specific image F indicating a message to hide the image.
- the message is, for example, a message “Turn off image display”.
- the image generation unit 153 transmits the generated specific image F to the display unit 132.
- the display unit 132 displays the received specific image F.
- the specific image F may be displayed by the EVF 131.
- step S412 an image display off process is performed.
- the display control unit 159 controls the image processing unit 120 not to transmit the luminance signal and the color difference signal to each of the EVF 131 and the display unit 132.
- each of the EVF 131 and the display unit 132 does not display an image.
- processing for setting the luminance value indicated by the luminance signal to 0 processing for turning off the power supplied to the EVF 131 and the display unit 132 may be performed.
- step S420 it is determined whether or not there is an EVF switching instruction.
- the comparison unit 142 determines whether any of the received instruction codes (instruction information) matches the determination code corresponding to the “EVF switching” instruction shown in the determination information table T100. judge.
- the determination code corresponding to the “EVF switching” instruction indicates an instruction to switch the display target from the display unit 132 to the EVF 131.
- the determination result by the comparison unit 142 is notified to the processing unit 150.
- step S420 If YES in step S420, the process proceeds to step S421. On the other hand, if NO at step S420, the process proceeds to step S430 described later.
- step S421 EVF switching notification processing is performed.
- the image generation unit 153 generates a specific image G that indicates a message indicating that the object to be displayed is switched to EVF.
- the message is, for example, a message that “the object to display an image is switched from the main display device to the EVF”.
- the image generation unit 153 transmits the generated specific image G to the display unit 132.
- the display unit 132 displays the received specific image G.
- the specific image G may be displayed by the EVF 131.
- step S422 EVF switching processing is performed.
- the display control unit 159 controls the image processing unit 120 not to transmit the luminance signal and the color difference signal to the display unit 132 but to only the EVF 131.
- the display unit 132 does not display an image, and only the EVF 131 displays an image.
- the display control unit 159 performs control so that power is not supplied to the display unit 132 with respect to a power source (not shown) that supplies power to the display unit 132.
- the photographing apparatus 100 may include an OVF (Optical View Finder) instead of the EVF 131.
- OVF Optical View Finder
- the mechanical shutter unit 111 may be controlled so that the OVF can be used, and power may not be supplied to the display unit 132.
- step S430 it is determined whether or not there is a luminance reduction instruction for reducing the luminance of the image.
- the comparison unit 142 determines whether or not any of the received instruction codes (instruction information) matches the determination code corresponding to the “luminance reduction” instruction shown in the determination information table T100. judge.
- the determination code corresponding to the instruction “decrease brightness” indicates an instruction to decrease the brightness of the image.
- the determination result by the comparison unit 142 is notified to the processing unit 150.
- step S430 If YES in step S430, the process proceeds to step S431. On the other hand, if NO at step S430, the process proceeds to step S440 described below.
- a luminance reduction notification process is performed.
- the image generation unit 153 generates a specific image H indicating a message indicating that the luminance of the image is reduced.
- the message is, for example, a message that “the brightness of the image is reduced”.
- the image generation unit 153 transmits the generated specific image H to the display unit 132.
- the display unit 132 displays the received specific image H.
- the specific image H may be displayed by the EVF 131.
- step S432 display luminance reduction processing is performed.
- the display control unit 159 controls the image processing unit 120 to reduce each luminance value indicated by the luminance signal by a predetermined ratio (for example, 30%). That is, the display control unit 159 performs control to lower the luminance of the image being displayed on at least one of the display unit 132 and the EVF 131.
- the present invention is not limited to the above process, and for example, a process of reducing the amount of light of each backlight of the display unit 132 and the EVF 131 may be performed.
- step S440 the operation determination unit 156 determines whether or not there has been a status display operation.
- the status display operation is an operation U for notifying the operation state of the photographing apparatus 100.
- the operation unit 170 receives the status display operation, the operation unit 170 transmits operation information indicating the status display operation to the processing unit 150. Thereby, the operation determination part 156 determines whether there was status display operation.
- step S440 the process proceeds to step S441.
- the status display operation is performed, for example, when the EVF 131 and the display unit 132 do not display an image by performing the process of step S412.
- step S440 the display control process ends, the process returns to the illumination corresponding process in FIG. 8, and the process proceeds to step S510.
- step S441 status display processing is performed.
- the status notification control unit 160 controls the status notification unit 182 to blink the status light at a predetermined cycle corresponding to the operation state of the photographing apparatus 100.
- the status notification unit 182 notifies the user of the operation state of the imaging device 100 by using a light emitting element to blink status light at a predetermined cycle. Note that the process in which the status notification unit 182 blinks the status light at a predetermined cycle is continued until, for example, an operation U for interrupting the process is performed.
- the operating state of the photographing apparatus 100 is, for example, a state during exposure or a state where data is recorded on a recording medium.
- the predetermined cycle is, for example, 0.1 seconds.
- the predetermined cycle is, for example, 100 seconds. In this case, the light emitting element of the status notification unit 182 is almost continuously lit.
- step S120 If YES in step S120, NO in step S330, or NO in step S350, the process proceeds to step S130.
- step S130 shooting prohibition mode setting processing is performed.
- the mode setting unit 155 sets a photographing prohibition mode in which photographing is not permitted as the operation mode of the photographing apparatus 100.
- the operations of the mechanical shutter unit 111, the image sensor unit 112, the image processing unit 120, and the like used for photographing are stopped. As a result, the photographing apparatus 100 cannot perform an operation for photographing.
- step S131 photographing prohibition notification processing is performed.
- the image generation unit 153 generates a specific image J indicating a message indicating that shooting is prohibited.
- the message is, for example, a message “Shooting is prohibited at this place”.
- the image generation unit 153 transmits the generated specific image J to the display unit 132.
- the display unit 132 displays the received specific image J.
- the specific image J may be displayed by the EVF 131. Then, the process proceeds to step S510.
- step S510 the operation determination unit 156 determines whether or not a shooting end operation has been performed.
- the shooting end operation is, for example, an operation U for canceling the setting of a set shooting mode (moving image shooting mode or still image shooting mode).
- the photographing end operation is, for example, an operation for setting a mode for browsing a still image or a moving image obtained by photographing as the operation mode of the photographing apparatus 100.
- the operation unit 170 When the operation unit 170 accepts the photographing end operation, the operation unit 170 transmits operation information indicating the photographing end operation to the processing unit 150. Thereby, the operation determination unit 156 determines whether or not there has been a photographing end operation.
- step S510 the mode setting unit 155 cancels the setting of the set shooting mode (moving image shooting mode or still image shooting mode), and the illumination processing ends. On the other hand, if NO at step S510, the process at step S120 is performed again.
- the interrupt process is a process for turning off the power of the imaging apparatus 100, for example.
- the light pattern detection unit 141 detects information superimposed on the illumination light by detecting a light / dark pattern from the video signal. That is, a dedicated light receiving element for detecting information superimposed on the light is not required other than the imaging element unit 112 that converts light into a video signal. Therefore, detection of information superimposed on light can be realized at low cost.
- the photographing apparatus 100 performs various processes according to the instruction indicated by the determination code that matches the instruction code as the detected instruction information. Therefore, the photographing apparatus 100 can be controlled according to the place where the illumination 50 is installed, the situation, and the like, without taking time and effort to the user. That is, the convenience of the imaging device 100 can be improved.
- the photographing apparatus 100 of the present embodiment for example, it is possible to prevent unintentional flash emission during photographing at a flash photographing prohibited place (such as a museum).
- the present embodiment it is possible to detect a light / dark pattern from the luminance value calculated by the image processing unit. As a result, the number of target imaging devices can be increased.
- the photographing apparatus 100 it is possible to prevent the photographing apparatus 100 from photographing the subject that emits the light L10.
- the photographing apparatus 100 it is possible to prevent the photographing apparatus 100 from photographing with the flash light on the subject that emits the light L10.
- the photographing apparatus 100 by increasing the ISO sensitivity at the time of photographing by the photographing apparatus 100, it is possible to compensate for the shortage of light amount and to perform good photographing.
- the photographing apparatus 100 it is possible to prevent the photographing apparatus 100 from photographing a still image with respect to a subject that emits the light L10.
- the photographing apparatus 100 it is possible to prevent the photographing apparatus 100 from photographing a moving image with respect to a subject that emits the light L10.
- the photographing apparatus 100 it is possible to prevent the photographing apparatus 100 from outputting sound as shutter sound.
- the mechanical shutter can be automatically opened in the photographing apparatus 100.
- the luminance of the image being displayed on the display unit can be reduced in the photographing apparatus 100. Thereby, the light leakage to the surroundings can be reduced to the minimum.
- the status notification unit blinks the status light at a predetermined cycle, so that the operation state of the photographing apparatus can be grasped.
- the user can easily set the moving image shooting mode by displaying the specific image for prompting whether or not to set the moving image shooting mode.
- the user can easily set the still image shooting mode by displaying the specific image for prompting whether or not to set the still image shooting mode.
- the image is not displayed on the display unit 132 and the image is displayed only on the EVF 131. Thereby, the light leakage to the surroundings can be reduced to the minimum.
- FIG. 16 is a block diagram illustrating a configuration of an imaging system 1000A according to a modification of the first embodiment.
- the imaging system 1000A is different from the imaging system 1000 of FIG. 1 in that an imaging apparatus 100A is provided instead of the imaging apparatus 100. Since the other configuration of the imaging system 1000A is the same as that of the imaging system 1000, detailed description will not be repeated.
- FIG. 17 is a block diagram showing a configuration of the image capturing apparatus 100A.
- the configuration of the photographing apparatus 100A is the same as that of the photographing apparatus 100 in FIG.
- the imaging device 100A differs from the imaging device 100 of FIG. 4 in the processing of the imaging element unit 112, the image processing unit 120, and the light pattern detection unit 141. Since the processing of each other part in the photographing apparatus 100A is the same as that of the photographing apparatus 100, detailed description will not be repeated.
- the image sensor unit 112 transmits the video signal to the image processing unit 120.
- the image processing unit 120 obtains a luminance signal and a color difference signal by performing the above-described image processing N.
- the image processing unit 120 transmits the luminance signal and the color difference signal to the EVF 131 and the display unit 132 and transmits the luminance signal (Y) to the light pattern detection unit 141. Send.
- illumination handling process A a specific process performed by the imaging apparatus 100A according to the present embodiment.
- processing different from the first embodiment will be mainly described.
- the illumination handling process A is performed when the still image shooting mode or the moving image shooting mode is set as the operation mode of the shooting apparatus 100A.
- the processing unit 150 performs control for shooting on each unit in the shooting apparatus 100A.
- the image sensor unit 112 transmits a video signal to the image processing unit 120.
- the image processing unit 120 obtains a luminance signal and a color difference signal by performing the above-described image processing N.
- the luminance signal indicates the luminance value of a plurality of pixels constituting a picture corresponding to each RAW data. That is, the image processing unit 120 uses the RAW data to calculate the luminance values of a plurality of pixels constituting a picture corresponding to the RAW data.
- the image processing unit 120 transmits the luminance signal (Y) to the light pattern detection unit 141 every time the luminance signal and the color difference signal are obtained.
- the following illumination handling process A is performed when the light pattern detection unit 141 receives a luminance signal (Y) from the image processing unit 120 in the image capturing apparatus 100A in which the still image capturing mode or the moving image capturing mode is set. It is a process performed.
- FIG. 18 is a flowchart of the illumination handling process A.
- the process with the same step number as the step number of FIG. 8 is performed in the same way as the process described in the first embodiment, so detailed description will not be repeated.
- the illumination handling process A is different from the illumination handling process of FIG. 8 in that step S110A is performed instead of step S110.
- the information detection process A in step S110A is different from the information detection process in step S110 in that no signal conversion process is performed. Since the other processes are the same as those in step S110, detailed description will not be repeated.
- the light pattern detection unit 141 detects information superimposed on the illumination light from each luminance value indicated by the luminance signal received from the image processing unit 120. Note that the process of detecting information is the same as the process of step S110, and therefore detailed description will not be repeated. Thereby, the light pattern detection unit 141 detects information superimposed on the illumination light by detecting the state of a plurality of luminance values corresponding to the picture as a light / dark pattern.
- step S110A Since the processing after step S110A is the same as the processing described in the first embodiment, detailed description will not be repeated.
- the same effect as that of the first embodiment can be obtained. That is, detection of information superimposed on light can be realized at low cost.
- the illumination 50 may be, for example, LED (Light Emitting Diode) illumination, an inverter type fluorescent lamp, or the like.
- LED lighting converts an AC voltage supplied from a commercial power source into a DC voltage, and irradiates illumination light using the DC voltage.
- the power supply control circuit of the illumination 50 superimposes information on the illumination light by changing the waveform of the DC voltage used for irradiating light.
- FIG. 19 is a diagram for explaining a method of superimposing information on illumination light.
- FIG. 19 (a) is a diagram showing the same AC voltage waveform as FIG. 2 (a).
- the LED illumination has a constant brightness and does not have a period of change in light quantity.
- the amount of illumination light can be changed as shown in FIG. That is, a bright / dark cycle can be generated in the illumination light.
- Information can be superimposed on the illumination light by generating a waveform corresponding to the period ⁇ in FIG.
- FIG. 19 (d) is an image diagram showing a change in the amount of light in FIG. 19 (c).
- FIG. 20 (a) is a diagram showing the same AC voltage waveform as FIG. 2 (a).
- the inverter type fluorescent lamp uses an AC voltage supplied from a commercial power source (not shown) to generate a higher frequency AC voltage (hereinafter referred to as a high frequency AC voltage). Therefore, when the inverter type fluorescent lamp uses a high-frequency AC voltage, the illumination light of the inverter type fluorescent lamp maintains a substantially constant brightness as shown in FIG.
- the amount of illumination light can be changed greatly. That is, a bright / dark cycle can be generated in the illumination light.
- Information can be superimposed on the illumination light by generating a waveform corresponding to the period ⁇ in FIG.
- FIG. 20 (d) is an image diagram showing a change state of the light amount in FIG. 20 (c).
- the illumination 50 is an inverter type fluorescent lamp
- a method for detecting a light / dark pattern with a specific period superimposed on illumination light using a plurality of pictures will be described with reference to FIG.
- FIG. 21A is a diagram showing a change in light amount when information of a 5-bit specific period ⁇ is placed (superposed) on illumination light having a frequency of 120 Hz.
- the horizontal direction of Fig.21 (a) shows a time-axis.
- FIG. 21B is a diagram illustrating a part of a plurality of pictures indicated by the luminance signal obtained in the information detection process.
- Some of the plurality of pictures are pictures P201, P202, P203, P204, and P205.
- an image of the subject is actually displayed, but the image of the subject is not shown for the sake of explanation.
- Pictures P201, P202, P203, P204, and P205 are generated in the order of pictures P201 to P205. That is, the picture P205 is a picture generated after the picture P201.
- Each of the pictures P201, P202, P203, P204, and P205 corresponds to the time axis of FIG.
- the light pattern detection unit 141 sets, in the pictures P201 to P205, a picture corresponding to a portion where the amount of illumination light is a predetermined value or more as a determination picture.
- the determination picture is a picture for detecting information.
- pictures of P201 and P204 are set as determination pictures as an example of the specific period information.
- the pictures P202, P203, and P205 are high-intensity pictures.
- the high luminance picture is defined as “0” and the low luminance picture is defined as “1”.
- the light pattern detection unit 141 detects “0” and “1” by determining whether or not the average value of the luminance values of the plurality of pixels constituting each determination picture is equal to or greater than the determination threshold value P. To do.
- the light pattern detection unit 141 can determine that the instruction code “10010” as the instruction information of the specific period is superimposed.
- the comparison unit 142 reads the instruction code from the storage unit 143 and returns the content that matches the instruction code “10010” to the processing unit 150. For example, when the instruction code is “10010”, the instruction corresponding to the instruction code is prohibited from flash light from FIG.
- the light pattern detection unit 141 detects information of a specific period superimposed on the illumination light by detecting a light / dark pattern from the video signal.
- the method of superimposing information on the illumination light is not limited to the above method.
- the power control circuit of the illumination 50 may control the voltage so that the light time and the dark time are not equal.
- two periods of the specific time are defined as “1”, and one period of the specific time is defined as “0”, so that the information corresponding to the discontinuous period in the illumination light is held. It may be allowed.
- Each of the image capturing apparatuses 100 and 100A includes the EVF 131 and does not include the OVF, but may include the OVF.
- each of the image capturing apparatuses 100 and 100A includes the flash light emitting unit 171, but the present invention is not limited to this.
- Each of the imaging devices 100 and 100A may include a flash light emitting unit 171 outside.
- each of the imaging devices 100 and 100A may not include the flash light emitting unit 171. In that case, the process related to the flash in the imaging auxiliary control process of FIG. 11 may not be performed.
- each of the imaging devices 100 and 100A includes the auxiliary light unit 172, but may not include the auxiliary light unit 172. In that case, the process related to the auxiliary light unit 172 of the imaging auxiliary control process may not be performed.
- the user in the automatic switching process, may not be notified in advance of the switching. However, the user may be notified using the display unit 132 or the EVF 131 that the user is to be switched before switching.
- FIG. 22 is a block diagram illustrating a characteristic functional configuration of the image capturing apparatus 200.
- the imaging device 200 corresponds to the imaging device 100 or the imaging device 100A. That is, FIG. 22 is a block diagram showing main functions related to the present invention among the functions of the image capturing apparatus 100 or the image capturing apparatus 100A.
- the photographing apparatus 200 photographs a subject irradiated with illumination light on which information is superimposed.
- the imaging apparatus 200 functionally includes an imaging element unit 210, a light pattern detection unit 220, a comparison unit 230, and a display unit 240.
- the image sensor unit 210 converts light from the subject into a video signal.
- the image sensor unit 210 corresponds to the image sensor unit 112.
- the light pattern detection unit 220 detects the information superimposed on the illumination light by detecting a light / dark pattern from the video signal converted by the image sensor unit 210.
- the light pattern detection unit 220 corresponds to the light pattern detection unit 141.
- the comparison unit 230 compares the detection information, which is the information detected by the light pattern detection unit 220, with predetermined determination information.
- the comparison unit 230 corresponds to, for example, the comparison unit 142 that performs the process of step S120 of FIG.
- the display unit 240 displays a specific image according to the comparison result by the comparison unit 230.
- the display unit 240 corresponds to, for example, the display unit 132 that displays the specific image J in step S131 of FIG.
- imaging element unit 210 the light pattern detection unit 220, and the comparison unit 230 included in the imaging apparatus 200 may be configured by hardware such as an LSI (Large Scale Integration). Good.
- all or a part of the image sensor unit 210, the light pattern detection unit 220, and the comparison unit 230 may be a module of a program executed by a processor such as a CPU.
- the imaging device 100 or the imaging device 100A in the present invention has been described based on the embodiments, the present invention is not limited to these embodiments. Unless it deviates from the meaning of this invention, the form which carried out various deformation
- all or some of the plurality of components constituting the photographing apparatus 100 or the photographing apparatus 100A may be configured by hardware. Further, all or a part of the constituent elements constituting the photographing apparatus 100 or the photographing apparatus 100A may be a module of a program executed by a CPU (Central Processing Unit) or the like.
- a CPU Central Processing Unit
- the system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip. Specifically, a microprocessor, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. It is a computer system comprised including.
- the image processing unit 120, the light pattern detection unit 141, the comparison unit 142, and the processing unit 150 may be configured by one system LSI.
- the number of units that execute the above-described processing may be one or plural. That is, centralized processing may be performed, or distributed processing may be performed.
- the present invention may be realized as an information detection method in which the operation of a characteristic component included in the imaging device 100 or the imaging device 100A is a step.
- the information detection method according to the present invention corresponds to all or part of the illumination handling process A in FIG. 8 or the illumination handling process A in FIG. 18 (for example, steps S110, S120, S131, etc.).
- the information detection method according to the present invention does not necessarily include all corresponding steps in FIG. 8 or FIG. That is, the information detection method according to the present invention need only include the minimum steps that can realize the effects of the present invention.
- the minimum steps that can realize the effect of the present invention are, for example, steps S110, S120, and S131 of FIG.
- the present invention may be realized as a program that causes a computer to execute each step included in such an information detection method. Further, the present invention may be realized as a computer-readable recording medium that stores such a program. The program may be distributed via a transmission medium such as the Internet.
- the present invention can be used as a photographing apparatus capable of detecting information superimposed on light at a low cost.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
Description
図1は、第1の実施の形態における撮影システム1000の構成を示すブロック図である。
図16は、第1の実施の形態の変形例における撮影システム1000Aの構成を示すブロック図である。
第1の実施の形態および第1の実施の形態の変形例では、照明50が直管型蛍光灯である場合について説明したが、本発明はこれに限定されない。照明50は、例えば、LED(Light Emitting Diode)照明、インバーター式蛍光灯等であってもよい。
撮影装置100,100Aの各々は、EVF131を備えており、OVFを備えていないが、OVFを備えていてもよい。
図22は、撮影装置200の特徴的な機能構成を示すブロック図である。撮影装置200は、撮影装置100又は撮影装置100Aに相当する。つまり、図22は、撮影装置100又は撮影装置100Aの有する機能のうち、本発明に関わる主要な機能を示すブロック図である。
100,100A,200 撮影装置
111 メカシャッター部
112,210 撮像素子部
120 画像処理部
131 EVF
132,240 表示部
141,220 光パターン検出部
142,230 比較部
143 記憶部
150 処理部
151 撮影禁止設定部
152 発光制御部
153 画像生成部
154 補助光制御部
155 モード設定部
156 操作判定部
157 シャッター音制御部
158 メカシャッター制御部
159 表示制御部
160 ステータス報知制御部
161 ISO感度変更部
170 操作部
171 フラッシュ発光部
172 補助光部
181 スピーカー
182 ステータス報知部
1000,1000A 撮影システム
Claims (20)
- 情報が重畳された照明光が照射される被写体を撮影する撮影装置であって、
前記被写体からの光を映像信号に変換する撮像素子部と、
前記撮像素子部により変換された前記映像信号から明暗パターンを検出することにより、前記照明光に重畳された前記情報を検出する光パターン検出部と、
前記光パターン検出部により検出された前記情報である検出情報と予め定められた判定情報とを比較する比較部と、
前記比較部による比較結果に応じて、特定画像を表示する表示部とを備える
撮影装置。 - 前記撮像素子部は、CMOS(Complementary Metal Oxide Semiconductor)イメージセンサを使用して前記被写体からの光を前記映像信号に変換し、
前記映像信号は、ピクチャに対応するRAWデータを示し、
前記光パターン検出部は、前記RAWデータを用いて該RAWデータに対応するピクチャを構成する複数の画素の輝度値を算出し、
前記光パターン検出部は、該ピクチャに対応する複数の輝度値の状態を、前記明暗パターンとして検出する
請求項1に記載の撮影装置。 - 前記撮像素子部は、CCD(Charge Coupled Device)イメージセンサを使用して前記被写体からの光を前記映像信号に変換し、
前記映像信号は、複数のピクチャにそれぞれ対応する複数のRAWデータを示し、
前記光パターン検出部は、前記各RAWデータを用いて該RAWデータに対応するピクチャを構成する複数の画素の輝度値を算出し、
前記光パターン検出部は、前記複数のピクチャの各々に対応する各輝度値の状態を前記明暗パターンとして検出する
請求項1に記載の撮影装置。 - 前記映像信号は、ピクチャに対応するRAWデータを示し、
前記撮影装置は、さらに、
前記RAWデータを用いて、該RAWデータに対応するピクチャを構成する複数の画素の輝度値を算出する画像処理部を備え、
前記光パターン検出部は、該ピクチャに対応する複数の輝度値の状態を、前記明暗パターンとして検出する
請求項1に記載の撮影装置。 - 前記比較部は、前記検出情報と前記判定情報とを比較することにより、前記検出情報と前記判定情報とが一致するか否かを判定し、
前記表示部は、前記検出情報と前記判定情報とが一致する場合、前記特定画像を表示し、前記検出情報と前記判定情報とが一致しない場合、前記特定画像を表示しない
請求項1~4のいずれか1項に記載の撮影装置。 - 前記判定情報を記憶する記憶部を備える、
請求項1~5のいずれか1項に記載の撮影装置。 - 前記判定情報は、撮影を禁止するための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、前記撮影装置の動作モードとして、撮影が許可されない撮影禁止モードを設定するモード設定部を備え、
前記特定画像は、撮影が禁止されている旨を示す
請求項1~6のいずれか1項に記載の撮影装置。 - 前記撮影装置は、さらに、
フラッシュ光を発光するためのフラッシュ発光部を備え、
前記判定情報は、撮影時における前記フラッシュ光の発光を禁止するための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、撮影時における前記フラッシュ光の発光をオフにするよう前記フラッシュ発光部を制御する発光制御部を備え、
前記特定画像は、前記フラッシュ光の発光が禁止されている旨を示す
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、撮影時におけるISO感度を増加させるための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、撮影時におけるISO感度を増加させる制御を行うISO感度変更部を備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記撮影装置は、さらに、
オートフォーカスを補助するための補助光を発光する補助光部を備え、
前記判定情報は、撮影時における前記補助光の発光をオフにするための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、撮影時における前記補助光の発光をオフにするよう前記補助光部を制御する補助光制御部を備える、
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、静止画の撮影を禁止するための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、前記撮影装置の動作モードとして、静止画の撮影が許可されない静止画撮影禁止モードを設定するモード設定部を備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、動画の撮影を禁止するための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、前記撮影装置の動作モードとして、動画の撮影が許可されない動画画撮影禁止モードを設定するモード設定部を備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、シャッター音の出力を禁止するための指示を示し、
前記撮影装置は、さらに、
音声を出力するためのスピーカーと、
前記検出情報と前記判定情報とが一致する場合、前記スピーカーに前記シャッター音としての音声を出力させないよう制御するシャッター音制御部とを備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記撮影装置は、さらに、
メカシャッターの開閉により露光時間を変更するためのメカシャッター部を備え、
前記判定情報は、前記メカシャッターを開放するための指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、前記メカシャッターを開放させるよう前記メカシャッター部を制御するメカシャッター制御部を備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、画像の輝度を下げる指示を示し、
前記撮影装置は、さらに、
前記検出情報と前記判定情報とが一致する場合、前記表示部が表示中の画像の輝度を下げさせる制御を行う表示制御部を備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、画像の輝度を下げる指示を示し、
前記撮影装置は、さらに、
画像を表示するためのEVF(Electronic View Finder)と、
前記検出情報と前記判定情報とが一致する場合、前記表示部および前記EVFの少なくとも一方の表示中の画像の輝度を下げさせる制御を行う表示制御部とを備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記撮影装置は、さらに、
外部からの操作を受付ける操作部と、
前記撮影装置の動作状態を報知するためのステータス光を発光するためのステータス報知部と、
前記操作部が、前記撮影装置の動作状態を報知するための操作を受付けた場合、前記ステータス報知部に前記撮影装置の動作状態に対応する所定の周期で前記ステータス光を点滅させる制御を行うステータス報知制御部とを備える
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、静止画の撮影を禁止するための指示を示し、
前記表示部は、前記検出情報と前記判定情報とが一致する場合、前記撮影装置の動作モードとして、動画を撮影するための動画撮影モードを設定するか否かを促すための前記特定画像を表示する、
請求項1~6のいずれか1項に記載の撮影装置。 - 前記判定情報は、動画の撮影を禁止するための指示を示し、
前記表示部は、前記検出情報と前記判定情報とが一致する場合、前記撮影装置の動作モードとして、静止画を撮影するための静止画撮影モードを設定するか否かを促すための前記特定画像を表示する、
請求項1~6のいずれか1項に記載の撮影装置。 - 情報が重畳された照明光が照射される被写体を撮影する撮影装置が行う情報検出方法であって、
前記撮影装置は、
前記被写体からの光を映像信号に変換する撮像素子部と、
画像を表示するための表示部とを備え、
前記情報検出方法は、
前記撮像素子部により変換された前記映像信号から明暗パターンを検出することにより、前記照明光に重畳された前記情報を検出する検出ステップと、
前記検出ステップにより検出された前記情報である検出情報と予め定められた判定情報とを比較する比較ステップと、
前記表示部が、前記比較ステップによる比較結果に応じて特定画像を表示するステップとを備える、
情報検出方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012504291A JP5821019B2 (ja) | 2010-03-09 | 2011-02-07 | 撮影装置および情報検出方法 |
CN201180011633.7A CN102783134B (zh) | 2010-03-09 | 2011-02-07 | 摄影装置以及信息检测方法 |
US13/600,510 US8982233B2 (en) | 2010-03-09 | 2012-08-31 | Imaging apparatus for imaging an object subject to illuminating light on which information is overlaid and information detection method |
US14/617,029 US9432573B2 (en) | 2010-03-09 | 2015-02-09 | Apparatus for detecting information overlaid on light and system including the apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010052198 | 2010-03-09 | ||
JP2010-052198 | 2010-03-09 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/600,510 Continuation US8982233B2 (en) | 2010-03-09 | 2012-08-31 | Imaging apparatus for imaging an object subject to illuminating light on which information is overlaid and information detection method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011111296A1 true WO2011111296A1 (ja) | 2011-09-15 |
Family
ID=44563134
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/000655 WO2011111296A1 (ja) | 2010-03-09 | 2011-02-07 | 撮影装置および情報検出方法 |
Country Status (4)
Country | Link |
---|---|
US (2) | US8982233B2 (ja) |
JP (2) | JP5821019B2 (ja) |
CN (2) | CN105007419B (ja) |
WO (1) | WO2011111296A1 (ja) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5564636B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP5564630B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP2015097381A (ja) * | 2012-12-27 | 2015-05-21 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 制御方法、情報通信装置、およびプログラム |
JP2020178353A (ja) * | 2012-12-27 | 2020-10-29 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | プログラム、装置および制御方法 |
US11372615B2 (en) | 2018-06-19 | 2022-06-28 | Panasonic Intellectual Property Management Co., Ltd. | Imaging apparatus |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103905739A (zh) * | 2012-12-28 | 2014-07-02 | 联想(北京)有限公司 | 电子设备控制方法及电子设备 |
JP5974913B2 (ja) * | 2013-01-25 | 2016-08-23 | 富士通株式会社 | 撮像方法、撮像装置及び撮像プログラム |
JP6210772B2 (ja) * | 2013-07-22 | 2017-10-11 | キヤノン株式会社 | 情報処理装置、撮像装置、制御方法、及びプログラム |
CN105657162B (zh) * | 2015-12-28 | 2019-05-14 | Oppo广东移动通信有限公司 | 移动终端拍照快门的音量控制方法及装置 |
CN109599050B (zh) * | 2019-01-31 | 2022-04-05 | 合肥鑫晟光电科技有限公司 | 一种显示面板画质改善方法及其装置、显示装置 |
US11271747B2 (en) | 2019-09-16 | 2022-03-08 | Lawrence Livermore National Security, Llc | Optical authentication of images |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005174877A (ja) * | 2003-12-15 | 2005-06-30 | Matsushita Electric Works Ltd | 放電灯点灯装置、照明器具並びに照明システム |
JP2007043579A (ja) * | 2005-08-04 | 2007-02-15 | Advanced Telecommunication Research Institute International | 対象物識別システム及び検出装置 |
JP2007096556A (ja) * | 2005-09-28 | 2007-04-12 | Pentax Corp | フリッカノイズ低減装置 |
JP2008005438A (ja) * | 2006-06-26 | 2008-01-10 | Canon Inc | 撮像装置及び撮像方法 |
JP2008078845A (ja) * | 2006-09-20 | 2008-04-03 | Casio Comput Co Ltd | 情報記録装置及び情報記録制御プログラム |
JP2009177254A (ja) * | 2008-01-21 | 2009-08-06 | Ricoh Co Ltd | 撮影装置 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000152217A (ja) * | 1998-11-09 | 2000-05-30 | Toshiba Corp | 映像取得制限システム、映像取得許否信号送信装置および映像取得制限装置 |
US7619657B2 (en) * | 2000-10-04 | 2009-11-17 | Fujifilm Corp. | Recording apparatus, communications apparatus, recording system, communications system, and methods therefor for setting the recording function of the recording apparatus in a restricted state |
JP2005136535A (ja) * | 2003-10-29 | 2005-05-26 | Hitachi Ltd | 情報処理装置、携帯電子機器および撮影制限システム |
WO2005050975A1 (en) | 2003-11-19 | 2005-06-02 | Matsushita Electric Industrial Co.,Ltd. | Digital camera system with means for restricting image acquisition |
JP2005333482A (ja) * | 2004-05-20 | 2005-12-02 | Fuji Photo Film Co Ltd | 撮影制限システム、撮影装置及び撮影制限方法 |
JP2006301417A (ja) * | 2005-04-22 | 2006-11-02 | Fuji Photo Film Co Ltd | 撮影システム及び光通信装置並びに撮影装置 |
JP2008294654A (ja) * | 2007-05-23 | 2008-12-04 | Sony Corp | 撮像システム、撮像装置、撮像方法、撮像制御方法、プログラム |
JP5170646B2 (ja) * | 2008-02-04 | 2013-03-27 | カシオ計算機株式会社 | 情報記録システム、情報記録装置及び情報記録制御プログラム |
JP2009188865A (ja) * | 2008-02-08 | 2009-08-20 | Casio Comput Co Ltd | 画像処理装置、及び、プログラム |
US20090268023A1 (en) * | 2008-04-27 | 2009-10-29 | Wen-Hsiung Hsieh | Surveillance camera device with a light source |
JP4730402B2 (ja) | 2008-06-30 | 2011-07-20 | カシオ計算機株式会社 | 撮像装置、撮像制御方法及びプログラム |
US8463072B2 (en) * | 2008-08-29 | 2013-06-11 | Adobe Systems Incorporated | Determining characteristics of multiple light sources in a digital image |
JP5493455B2 (ja) * | 2009-05-01 | 2014-05-14 | ソニー株式会社 | 画像処理装置、画像処理方法、プログラム |
KR20120038467A (ko) * | 2009-07-03 | 2012-04-23 | 코닌클리즈케 필립스 일렉트로닉스 엔.브이. | 비동기 램프 식별 방법 및 시스템 |
-
2011
- 2011-02-07 CN CN201510404421.5A patent/CN105007419B/zh active Active
- 2011-02-07 WO PCT/JP2011/000655 patent/WO2011111296A1/ja active Application Filing
- 2011-02-07 JP JP2012504291A patent/JP5821019B2/ja active Active
- 2011-02-07 CN CN201180011633.7A patent/CN102783134B/zh active Active
-
2012
- 2012-08-31 US US13/600,510 patent/US8982233B2/en active Active
-
2015
- 2015-02-09 US US14/617,029 patent/US9432573B2/en active Active
- 2015-05-07 JP JP2015095263A patent/JP2015136194A/ja active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005174877A (ja) * | 2003-12-15 | 2005-06-30 | Matsushita Electric Works Ltd | 放電灯点灯装置、照明器具並びに照明システム |
JP2007043579A (ja) * | 2005-08-04 | 2007-02-15 | Advanced Telecommunication Research Institute International | 対象物識別システム及び検出装置 |
JP2007096556A (ja) * | 2005-09-28 | 2007-04-12 | Pentax Corp | フリッカノイズ低減装置 |
JP2008005438A (ja) * | 2006-06-26 | 2008-01-10 | Canon Inc | 撮像装置及び撮像方法 |
JP2008078845A (ja) * | 2006-09-20 | 2008-04-03 | Casio Comput Co Ltd | 情報記録装置及び情報記録制御プログラム |
JP2009177254A (ja) * | 2008-01-21 | 2009-08-06 | Ricoh Co Ltd | 撮影装置 |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5564636B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP5564630B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP5564631B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP5564632B1 (ja) * | 2012-12-27 | 2014-07-30 | パナソニック株式会社 | 情報通信方法 |
JP2015046860A (ja) * | 2012-12-27 | 2015-03-12 | パナソニック株式会社 | 情報通信方法 |
JP2015046862A (ja) * | 2012-12-27 | 2015-03-12 | パナソニック株式会社 | 情報通信方法 |
JP2015097381A (ja) * | 2012-12-27 | 2015-05-21 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 制御方法、情報通信装置、およびプログラム |
JP2015097376A (ja) * | 2012-12-27 | 2015-05-21 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 情報通信方法 |
JP2020178353A (ja) * | 2012-12-27 | 2020-10-29 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | プログラム、装置および制御方法 |
US11372615B2 (en) | 2018-06-19 | 2022-06-28 | Panasonic Intellectual Property Management Co., Ltd. | Imaging apparatus |
Also Published As
Publication number | Publication date |
---|---|
JP2015136194A (ja) | 2015-07-27 |
CN102783134B (zh) | 2015-08-12 |
JPWO2011111296A1 (ja) | 2013-06-27 |
CN102783134A (zh) | 2012-11-14 |
CN105007419B (zh) | 2018-05-08 |
US9432573B2 (en) | 2016-08-30 |
CN105007419A (zh) | 2015-10-28 |
US8982233B2 (en) | 2015-03-17 |
US20120327262A1 (en) | 2012-12-27 |
JP5821019B2 (ja) | 2015-11-24 |
US20150156411A1 (en) | 2015-06-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5821019B2 (ja) | 撮影装置および情報検出方法 | |
US7711257B2 (en) | Image quality in cameras using flash | |
JP2007300541A (ja) | 撮像装置及びそのプログラム | |
JP4912113B2 (ja) | 光源状態検出装置及び方法並びに撮像装置 | |
JP2007174537A (ja) | 撮像装置 | |
US10560638B2 (en) | Imaging apparatus and imaging method | |
US10057503B2 (en) | Image processing apparatus and method for applying a virtual light source to an image | |
JP2009077057A (ja) | 撮像装置、撮像装置の制御方法 | |
JP2007316599A (ja) | 表示制御装置、及び、表示制御プログラム | |
WO2015127594A1 (zh) | 一种拍摄补光的控制方法、装置及终端 | |
JP2011166753A (ja) | 撮像装置 | |
JP2006080942A (ja) | 画像処理装置、画像処理プログラム、画像処理方法及び撮像装置 | |
JP2012119840A (ja) | 撮像装置 | |
JP4003657B2 (ja) | 電子カメラ | |
JP2007060327A (ja) | 撮像装置 | |
JP2006042000A (ja) | デジタルカメラ用クレードルおよびデジタルカメラシステム | |
JP5984533B2 (ja) | 撮像装置、その制御方法およびプログラム | |
JP2009276610A (ja) | 画像表示装置,画像表示方法及び撮像装置 | |
JP2008098805A (ja) | デジタルカメラ装置およびそのフリッカ補正方法 | |
JPH1169217A (ja) | 電子カメラ及びその電子シャッター制御方法 | |
JP2012134585A (ja) | カメラ | |
JP5846856B2 (ja) | カメラ付インターホン装置 | |
JP2009218660A (ja) | 映像ディスプレイ装置 | |
WO2020071108A1 (ja) | 画像処理装置および画像処理方法 | |
JP2006222806A (ja) | 撮影装置、撮影装置の制御方法及び制御プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180011633.7 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11752964 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012504291 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11752964 Country of ref document: EP Kind code of ref document: A1 |