JP2008294654A - Imaging system, imaging apparatus, imaging method, imaging control method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily control imaging prohibition/permission from a subject side, and also to appropriately control the imaging prohibition/permission according to various situations and apparatuses. <P>SOLUTION: A person or the like who wants to control imaging etc., mounts a light emission device. The light emission device outputs imaging control information indicating imaging prohibition by the use of a light emission signal. An imaging apparatus detects the light emission signal when imaging, but performs control to prohibit the recording processing of an imaging image signal when a imaging control signal indicating the imaging prohibition is detected. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging system including an imaging device and a light emitting device, an imaging device and an imaging method thereof, an imaging control method applicable to the imaging device, and a program for imaging control.

JP-A-2005-223601

  Imaging devices such as video cameras and digital still cameras have been remarkably widespread, and downsizing of the devices has been promoted. In this situation, there are concerns about acts that infringe on the privacy and portrait rights of individuals through easy imaging.

Many people dislike taking images without permission, but a small-scale system that controls imaging according to the intention of the subject has not yet been developed.
For this reason, for example, it is considered to prevent so-called voyeurism by using the technique proposed in Patent Document 1 and the like.
In the technique of Patent Document 1, specific pattern information and an IC tag are embedded in a subject that is not desired to be imaged, such as a picture or a book. On the camera side, the specific pattern information and IC tag information are recognized, and imaging is forcibly restricted (prohibited). Further, if such a specific pattern information or IC tag is not embedded in a subject for which imaging is not specifically prohibited, the camera recognizes that there is no specific pattern information or IC tag information on the subject and performs imaging. Can be executed.
As a result, it is possible to avoid suffering from so-called digital shoplifting for a subject that is not desired to be imaged, and it is possible to freely permit the subject to be imaged.

However, the above-described technique cannot easily respond to a request that a person wants to arbitrarily prohibit or permit imaging for himself / herself depending on the situation.
In addition, it is impossible to respond to a request for permitting only a specific camera to capture an image.
Therefore, according to the present invention, prohibition control and permission control can be easily realized with respect to imaging (recording of a captured image), and imaging prohibition / permission control can be appropriately realized according to various situations and devices. Objective.

The imaging system of the present invention includes a light emitting device attached to a subject and an imaging device.
The light-emitting device includes information generation means capable of generating at least imaging control information indicating that imaging is prohibited, and output means for outputting the imaging control information generated by the information generation unit as a light emission signal.
The imaging apparatus includes an imaging processing unit that performs imaging processing of incident light from a subject to generate a captured image signal, a recording processing unit that performs recording processing of a captured image signal obtained by the imaging processing unit, and the imaging In response to obtaining light emission signal detection means for analyzing the captured image signal obtained by the processing means and detecting the light emission signal, and imaging control information indicating that imaging is prohibited as the light emission signal detected by the light emission signal detection means. Control means for performing control to prohibit recording processing by the recording processing means for the captured image signal obtained by the imaging processing means.

  In addition, the control unit of the imaging apparatus performs a process for registering the imaging permission of the light emitting device identification information of the specific light emitting device. The light emitting device outputs imaging control information including light emitting device identification information as a light emission signal. In this case, the control means of the image pickup device is the light emitting device identification information included in the light emission signal even when the image pickup control information indicating the image pickup prohibition is obtained as the light emission signal detected by the light emission signal detection means. However, in the case of the light emitting device identification information registered for imaging permission, control is performed to permit recording processing by the recording processing means for the captured image signal obtained by the imaging processing means.

  The imaging apparatus further includes an orientation detection unit that detects an imaging direction by the imaging processing unit, and the control unit obtains imaging control information indicating that imaging is prohibited as a light emission signal detected by the light emission signal detection unit. For a predetermined period from the point in time, control is performed to prohibit recording processing of the picked-up image signal by image pickup in the image pickup direction determined to be the same as the image pickup direction detected by the azimuth detecting unit at the time point.

The imaging device of the present invention is an imaging device that constitutes the imaging system.
The imaging method of the present invention includes a step of performing imaging processing of incident light from a subject to generate a captured image signal, and a step of analyzing the captured image signal and detecting a light emission signal output from an external light emitting device. When the imaging control information indicating imaging prohibition is not detected as the light emission signal, recording processing of the captured image signal is permitted, and when imaging control information indicating imaging prohibition is obtained as the emission signal, the captured image signal is acquired. And a step of prohibiting the recording process.

The imaging control method of the present invention is an imaging control method of an imaging apparatus including the imaging processing unit, the recording processing unit, and the light emission signal detection unit, and prohibits imaging as a light emission signal detected by the light emission signal detection unit. A step of determining whether or not imaging control information to be obtained has been obtained, and the recording processing means for the captured image signal obtained by the imaging processing means in response to determining that the imaging control information indicating prohibition of imaging has been obtained. And a step of prohibiting the recording process.
The program of the present invention is a program that causes the arithmetic processing unit of the imaging apparatus to execute the imaging control method.

According to the present invention, when a subject such as a person or an article wearing the light emitting device is to be imaged by the imaging device, the light emitting signal detection unit detects the light emission signal from the light emitting device on the imaging device side. It will be. When an imaging control signal indicating that imaging is prohibited is detected as the light emission signal, the control unit performs control to prohibit recording processing of the captured image signal.
In other words, if the light emission signal from the light emitting device on the subject side includes information indicating that the imaging is prohibited (the recording processing of the captured image signal is prohibited), it is possible to forcibly limit the imaging of the subject by the imaging device. Unauthorized imaging such as voyeurism can be prevented.
Of course, if the light emission signal does not include information indicating prohibition of imaging (adding information indicating that imaging is permitted), prohibition control of the recording processing of the captured image signal is not performed on the imaging apparatus side. Recording processing of the captured image signal can be executed. Accordingly, the prohibition / permission of imaging can be arbitrarily controlled on the light emitting device side.
Further, it is possible to perform control such that only a specific imaging device is allowed to capture an image (recording process of a captured image signal). In other words, the light emission signal includes the light emitting device identification information, and the light emitting device identification information is registered on the image pickup device side of the image pickup device that permits the image pickup. On the imaging device side, even if a light emission signal indicating that imaging is prohibited is detected, if the light emitting device identification information included in the light emission signal is registered for imaging permission, the captured image signal recording process can be executed. . As a result, it is possible to permit only a specific image capturing apparatus to capture an image and prohibit other image capturing apparatuses from capturing an image.
In addition, on the imaging device side, by performing prohibition control on imaging (recording processing of the captured image signal) in the imaging direction that is regarded as the same for a predetermined period after detecting the imaging prohibition signal, the imaging device side Thus, even when imaging is performed in a state where the emission signal cannot be detected in the captured image, the prohibition control can be appropriately performed.

According to the present invention, it is possible to arbitrarily and easily prohibit imaging (recording processing of a captured image signal) by the imaging device on the subject side on which the light emitting device is mounted. As a result, for example, people who have been infringed on their portrait rights or privacy due to, for example, sneak shots, can limit their imaging.
In addition, it is possible to permit imaging to a specific imaging apparatus, and appropriate imaging prohibition / permission control according to the will and situation can be realized.

Embodiments of the present invention will be described below. The description will be given in the following order.
[1. Imaging system overview]
[2. Configuration example of light emitting device]
[3. Configuration example of imaging apparatus]
[4. Imaging control operation]
[5. Example of pairing process]
[6. Processing example during imaging]
[7. Effect of embodiment, modification, and program]

[1. Imaging system overview]

As an imaging system of the embodiment, FIG. 1 shows a badge-type light emitting device 1 and an imaging device 10 as a digital still camera.

  The light emitting device 1 has a structure that can be worn on clothes or the like by a user who does not want to take an image of himself / herself, for example. For example, it is only necessary that the user can be worn around the chest as shown in the figure. As will be described later, the light emitting device 1 is not limited to a badge type.

For example, the light emitting device basically outputs a light emission signal at all times. For example, a light emission signal is output as light pulse pattern light emission. However, the output of the light emission signal is not always performed, and the light emission signal output may be started / finished by a user operation or some trigger.
The light emission signal may use visible light, or may be based on invisible light such as infrared light.
This light emission signal is obtained by making imaging control information into a pulse pattern of visible light or invisible light. And as imaging control information sent out as a light emission signal, the information which prohibits imaging with respect to the imaging device 10 can be included. The imaging prohibition in this case does not prohibit imaging in the sense that a captured image signal is generated by photoelectrically converting subject light with an imaging device, but processing that records the captured image signal as a still image or a moving image. It can be said that it is prohibited.

In the imaging device 10, for example, when the imaging direction is determined with the user wearing the light emitting device 1 as a subject, the captured image signal in the preview (monitor state before the shutter operation is performed) Will be included. The imaging apparatus 10 performs an analysis process on a captured image signal generated by subjecting subject light to photoelectric conversion by the imaging device, and whether or not a light emission signal is included in the captured image being previewed. The light emission signal is decoded to detect the contents of the imaging control information.
If imaging prohibition information is detected, imaging, that is, recording processing of a captured image signal, is not performed even when a user of the imaging apparatus 10 performs a shutter operation. In other words, it is impossible to capture an image of a person wearing the light emitting device 1 as a subject.

In other words, if the person wearing the light emitting device 1 thinks that he or she does not want to be imaged by another person's imaging device 10 unnecessarily, the light emitting device 1 should always output a light emission signal including information on prohibition of imaging. That's fine.
As will be described in detail later, it is also possible to permit imaging to a specific imaging device 1.
Further, there is a case where the light emitting device 1 is not included in the captured image signal by performing a zoom operation on the imaging device 10 side. For example, it is a case where only the face of the user wearing the light emitting device 1 on the chest is imaged up. However, in the case of this example, even when the light emitting device 1 deviates from the captured image of the image capturing device 10 and the light emission signal cannot be recognized, the image capturing prohibition process is performed.

[2. Configuration example of light emitting device]

FIG. 2 shows a configuration example of the light emitting device 1. 2A shows an internal configuration of the light emitting device 1, and FIG. 2B shows an example of a manipulator on the back surface of the badge type light emitting device 1, for example.
As shown in FIG. 2B, a prohibition / permission setting switch 6 and a pairing switch 7 are formed on the back side of the light emitting device 1 as operators that are operated by the user. The prohibition / permission setting switch 6 is, for example, a slide switch, and the slide position can be arbitrarily operated such that the user sets the prohibition position when the user wants to perform the imaging prohibition control, and sets the permission position when the user wants to permit the imaging.
The pairing switch 7 is a pressing key that the user presses when performing a pairing process to be described later.
Although not shown, it is assumed that a certain attachment mechanism for the user to attach the light emitting device 1 to clothes or the like is formed on the back surface of the light emitting device 1.

As an internal configuration of the light emitting device 1, a transmission information generating unit 2, a memory unit 3, a modulating unit 4 and a light emitting unit 5 are provided as shown in FIG.
The transmission information generation unit 2 is configured by, for example, a microcomputer or a signal processor. The sending information generation unit 2 detects the operation position of the prohibition / permission setting switch 6 and the operation state of the pairing switch 7.
The memory unit 3 is formed of, for example, a nonvolatile solid-state memory. The memory unit 3 stores a light emitting device ID assigned to each individual light emitting device 1.
The transmission information generation unit 2 generates imaging control information based on the operation position of the prohibition / permission setting switch 6, the operation state of the pairing switch 7, and the light emitting device ID stored in the memory unit 3.

An example of the imaging control information is shown in FIG. The imaging control information is, for example, 22-bit information. The first 1 bit is a pairing bit, the next 1 bit is an imaging control bit, and the subsequent 20 bits are a light emitting device ID. Note that the 20-bit light emitting device ID is merely an example.
The 20-bit light emitting device ID is information stored in the memory unit 3 and is unique identification information for each light emitting device 1. The transmission information generation unit 2 applies the light emitting device ID read from the memory unit 3 to the latter 20 bits of the imaging control information.
Then, the transmission information generation unit 2 sets the value of the pairing bit and the imaging control bit according to the operation status of the pairing switch 7 and the prohibition / permission setting switch 6. In the normal state, that is, when the pairing switch 7 is not pressed, the pairing bit is set to “0”, while the pairing bit is set to “1” while the pairing switch 7 is pressed.
When the prohibition / permission setting switch 6 is set to the “permitted” position, the imaging control bit is set to “0”, and when the prohibition / permission setting switch 6 is set to the “prohibited” position, the imaging control is performed. The bit is set to “1”.
The transmission information generation unit 2 generates such imaging control information and supplies it to the modulation unit 4 at all times. Since the light emitting device ID is fixed, the contents of the imaging control information (pairing bit or imaging control) output from the transmission information generating unit 2 when the pairing switch 7 or the prohibition / permission setting switch 6 is operated. Bit value) will change.

  Actually, the transmission information generation unit 2 adds information to which the imaging device 10 recognizes that it is a light emission signal from the light emitting device 1 and synchronization bit information in addition to the 22-bit imaging control information. Should be output.

The modulation unit 4 modulates the luminance of the light emitting unit 5 based on the supplied imaging control information. For example, the light emitting unit 5 is a light emitting element such as an LED (Light Emitting Diode), and the modulation unit 4 is a light emission driving circuit thereof. The modulation unit 4 drives the light emitting unit 5 to emit light so that light emission is performed based on the pulse pattern of the 22-bit imaging control information.
With such a light emitting device 1, a light emission signal including a pairing bit, an imaging control bit, and a light emitting device ID is always output.

[3. Configuration example of imaging apparatus]

Next, a configuration example of the imaging device 10 will be described with reference to FIG.
The imaging device 10 includes an imaging unit 11, an imaging signal processing unit 12, a display unit 13, a storage unit 14, a light emission signal detection unit 15, a control unit 16, an operation unit 17, and an orientation measurement unit 18.

The control unit 16 includes, for example, a microcomputer including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a nonvolatile memory unit, and an interface unit, and controls the entire imaging apparatus 10. To do. The control unit 16 performs various arithmetic processes based on a program stored in an internal ROM or the like, and exchanges control signals and the like with each unit to cause each unit to execute a required operation.
In the control unit 16, a memory unit 16a is shown, which corresponds to the ROM, RAM, and nonvolatile memory unit. In the nonvolatile memory unit, for example, registration information of the light emitting device ID is stored in a pairing process described later. The RAM of the memory unit 16a is used as a work area for various arithmetic processes.

The imaging unit 11 includes an imaging optical system, an imaging element unit, a timing generator, and an analog front end.
The imaging optical system in the imaging unit 11 includes an imaging lens, a lens system including an aperture, a zoom lens, a focus lens, and a drive system for causing the lens system to perform a focus operation and a zoom operation. Provided.
In addition, in the imaging device section in the imaging unit 11, a solid-state imaging device array that detects imaging light obtained by the imaging optical system and generates an imaging signal by performing photoelectric conversion is provided. The solid-state imaging device array is, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
In the analog front end of the image pickup unit 11, a sample hold / AGC (Automatic Gain Control) circuit that performs gain adjustment and waveform shaping on a signal obtained by the solid-state image pickup device, a gain amplifier for sensitivity adjustment, and a video A / D converter For example, and outputs captured image data as digital data.
The timing generator in the imaging unit 11 generates a shutter pulse for the solid-state imaging device, a sampling pulse used in the analog front end, and the like.

The imaging signal processing unit 12 performs various digital signal processing on the captured image data obtained by the imaging unit 11. For example, white balance processing, luminance processing, color signal processing, blur correction processing, and the like are performed on the captured image data.
The imaging signal processing unit 12 also performs compression processing for recording processing of captured image data. Furthermore, image processing for monitor display (preview display) and playback image display is also performed.

The storage unit 14 is used for storing captured image data. The storage unit 14 may be configured by a solid-state memory such as a RAM or a flash memory, or may be configured by an HDD (Hard Disk Drive), for example. Further, instead of a built-in recording medium, a portable recording medium, for example, a recording / reproducing drive corresponding to a recording medium such as a memory card incorporating a solid-state memory, an optical disk, a magneto-optical disk, or a hologram memory may be used.
Of course, both a built-in type memory such as a solid-state memory and an HDD, and a recording / reproducing drive for a portable recording medium may be mounted.
The storage unit 14 records and stores captured image data supplied from the imaging signal processing unit 12 based on the control of the control unit 16.
Also, based on the control of the control unit 16, the recorded data can be read and supplied to the display unit 13 via the imaging signal processing unit 12, for example.

The display unit 13 includes a display panel unit such as a liquid crystal panel and a display driving circuit that drives the display panel unit.
Preview image data and reproduced image data are supplied from the imaging signal processing unit 12 to the display unit 13, and these images are displayed on the display unit 13. The preview image data is captured image data of a current subject image captured by the imaging unit 11 and processed by the imaging signal processing unit 12. The reproduced image is image data as an image reproduced in the storage unit 14.

The light emission signal detection unit 15 is supplied with the captured image data from the imaging signal processing unit 12, performs an analysis process on the captured image data, and includes a light emission signal output from the light emitting device 1 as a captured image. Is detected. If a light emission signal is included, the imaging control information sent as a pulse pattern of the light emission signal is decoded.
At the time of preview, the captured image of each frame captured by the imaging unit 11 is supplied to the display unit 13 as a preview image as a moving image, whereby the user of the imaging device 10 determines a subject while viewing the display unit 13 or zooms. By performing an operation or the like, a subject image as an object to be imaged is determined. For example, the imaging signal processing unit 12 supplies the captured image data of each frame to the light emission signal detecting unit 15 at the time of preview or shutter operation. The light emission signal detection unit 15 performs an analysis process as to whether or not the light emission pulse pattern is included in the captured image data supplied in this way.
When a light emission signal is detected in the captured image data, the light emission pattern is analyzed from each successive frame image, and the above-described imaging control information as shown in FIG. 3 is decoded. The light emission signal detection unit 15 sequentially notifies the control unit 16 of the presence / absence of detection of the light emission signal and the imaging control information decoded from the light emission signal.

As the operation unit 17, various operators for user operations are provided. For example, an operation element such as a key or a dial may be provided to detect a user operation as a key operation or the like, or a touch pad or a touch panel may be provided. For example, a touch panel may be provided in the display unit 2 and an operation input may be performed by a user touching the display screen.
Examples of operations by these operators include, for example, power on / off operations, imaging system operations (for example, shutter operations, zoom, focus, aperture adjustment operations, and signal processing instruction operations), display-related operations (for example, display contents) Selection and display adjustment operations) can be executed.
Operation information of the operation unit 17 is supplied to the control unit 16. The control unit 16 controls each unit based on the operation information. For example, the zoom operation, the focus operation, and the like in the imaging unit 11 are controlled, the control for causing the storage unit 14 to perform recording processing of the captured image data is performed in response to the shutter operation, and the display content on the display unit 13 is controlled. Do.

  The azimuth measuring unit 18 includes an azimuth sensor and detects the azimuth θ as an imaging direction by the imaging device 10. Information on the detected imaging direction θ is supplied to the control unit 16.

The configuration of the imaging device 10 has been described above, but this is only an example. Addition and deletion of various components are naturally conceivable depending on the actual operation example and function.

[4. Imaging control operation]

An imaging control operation by the light emitting device 1 and the imaging device 10 configured as described above will be described with an example.
FIG. 5A shows a preview image on the imaging device 10 in a state where the imaging device 10 is directed toward the person A wearing the light emitting device 1. That is, the image is preview-displayed on the display unit 13 based on the captured image data captured by the imaging unit 11.
For example, the user of the imaging device 10 (hereinafter referred to as a cameraman) is a person who is unrelated to the person A wearing the light emitting device 1 included in the preview image, and the person A is taken by other people. Assume that the light-emitting device 1 is mounted after the prohibition / permission setting switch 6 of the light-emitting device 1 is set to the prohibited position.

For example, it is assumed that the cameraman performs a shutter operation with a preview image as shown in FIG. However, in that case, the imaging device 10 detects that the light emission signal detection unit 15 detects the light emission signal from the light emitting device 1 in the captured image data, and detects that the imaging control bit = 1 (imaging prohibited). For this reason, the control unit 16 of the imaging apparatus 10 performs an imaging prohibition control process. In response to the shutter operation, a message “shooting prohibited” is displayed on the display unit 13 as shown in FIG. 5D to inform the photographer that shooting is not possible.
That is, even if the control unit 16 responds to the shutter operation, the storage unit 14 does not execute processing for recording the captured image data of one frame at the timing as a captured still image. As a result, the person A can be prevented from being imaged against his will.

Further, the cameraman does not perform the shutter operation in the state of the preview image of FIG. 5A, for example, performs the zoom operation to capture the face of the person A up, and the preview image (the captured image data captured by the imaging unit 11). ) Is changed from FIG. 5B to FIG. 5C.
For example, in the state where the captured image data of FIG. 5C is obtained, the light emitting device 1 is not included in the captured image data. For this reason, at this time, the light emission signal detection unit 15 cannot detect the light emission signal and cannot recognize the information on prohibition of imaging.
However, the control unit 16 of the imaging apparatus 10 performs prohibition control of imaging in the imaging direction, which is regarded as the same direction as that at the time of recognition of the light emission signal, for a predetermined period after the light emission signal including the imaging prohibition information is once recognized. The imaging direction regarded as the same direction may be, for example, an imaging direction within a predetermined angle range with reference to the imaging direction at the time of light emission signal recognition.
For this reason, for example, even when the cameraman performs a shutter operation in the state of the preview image in FIG. 5C, the control unit 16 performs the image capturing prohibition control process. Then, as shown in FIG. 5D, a message “shooting prohibited” is displayed on the display unit 13 to inform the photographer that shooting is not possible.
That is, also in this case, the control unit 16 does not execute processing for recording the captured image data of one frame at the timing as a captured still image by the storage unit 14 even in response to the shutter operation.
Therefore, for example, even if the cameraman performs a zoom operation so as to avoid the light-emitting device 1 of the person A, or even if the imaging direction is slightly shifted within the range considered to be the same direction, the person A is imaged against the will. You can avoid that.
In particular, in general, when imaging, the light-emitting device 1 starts previewing in a wide-angle state, and a cameraman performs a zooming operation to determine a subject or determines an imaging direction while previewing. When the person A wearing is in the imaging direction, the light emitting device 1 (light emission signal) is very likely to enter the preview image even for a moment. For this reason, when imaging prohibition is recognized by a light emission signal, imaging prohibition control is performed for imaging in the imaging direction that is considered to be the same for a predetermined period, thereby appropriately reflecting the intention that the subject side does not want to be imaged. It can be.

On the other hand, if the person A wants a photographer to take an image, or if it does not matter who is currently taken, the prohibition / permission setting switch 6 of the light emitting device 1 may be set to the permission position. .
In that case, on the imaging device 10 side, even if the light emission signal is recognized, the imaging control information with the imaging control bit = 0 (imaging permission) is recognized, and the control unit 16 does not perform the imaging prohibition control. That is, even in the situation as shown in FIG. 5A, the storage unit 14 can record the captured image data as a still image that is normally captured in accordance with the shutter operation.

Further, there is a case where a certain person permits a specific cameraman to capture an image, but wants to prohibit an image captured by another unspecified cameraman.
For example, an artist at a concert venue may only allow a photographer who has contracted to take an image and want to avoid unauthorized imaging by a general customer.
In such a case, a pairing process is performed in advance between the light emitting device 1 worn by the artist and the imaging device 10 of the contract photographer. This is processing for registering the light emitting device ID of the light emitting device 1 in the imaging device 10 of the contract photographer.
Thereafter, for example, during a concert, the artist wears the light emitting device 1. At this time, the prohibition / permission setting switch 6 is set to the prohibition position.
The paired imaging device 10 recognizes the light emission signal from the light emitting device 1 and recognizes the imaging control bit = 1 (imaging prohibition) when imaging with the artist as the subject, but is included in the light emission signal. Since the light emitting device ID being registered is the light emitting device ID registered by the pairing process, the control unit 16 does not perform the imaging prohibition control. Thereby, according to the imaging device 10 of the contract photographer, imaging can be performed freely.
On the other hand, since the imaging device 10 of an unspecified number of other cameramen has not been paired, even if an attempt is made to image an artist as an object, the imaging device 10 recognizes the light emission signal from the light emitting device 1 and the imaging control bit = 1. Since imaging prohibition control is performed upon recognizing (imaging prohibition), imaging (recording of captured image data) cannot be performed.

[5. Example of pairing process]

The above-described pairing process will be described. FIG. 6 shows processing executed by the control unit 16 of the imaging apparatus 10 as pairing processing.
When performing the pairing process, on the imaging device 10 side, the user operates the operation unit 17 to instruct the pairing mode.
In response to the pairing mode operation, the control unit 16 advances the processing of FIG. 6 from step F101 to F102, and starts the pairing processing. First, the control unit 16 starts preview processing. That is, imaging is performed by the imaging unit 11, preview display is executed on the display unit 13, and captured image data is supplied to the light emission signal detection unit 15.

In this state, the pairing switch 7 of the light emitting device 1 is pressed to make the imaging device 10 recognize the light emission signal. While the pairing switch 7 is being pressed, a light emission signal is output with the pairing bit = 1 in FIG.
When the imaging device 10 images the light emitting device 1 (the imaging direction is directed toward the light emitting device 1 in the preview state), the light emission signal is detected by the light emission signal detection unit 15.
The control unit 16 makes a determination in steps F103, F104, and F105 based on the notification from the light emission signal detection unit 15.

If the light emission signal detection unit 15 has notified the light emission signal detection, the process proceeds from step F103 to F104, where the decoding data of the imaging control information from the light emission signal detection unit 15 is confirmed, and is the pairing bit = 1? Confirm whether or not.
If the pairing bit = 1, the process proceeds to step F106, and registration processing of the light emitting device ID included in the imaging control information is performed. That is, an area for registering the light emitting device ID is prepared as imaging permission registration in the nonvolatile memory unit of the internal memory unit 16a, and the current light emitting device ID is registered as the light emitting device ID permitting imaging.
In step F107, a registration completion message is displayed on the display unit 13, and the pairing mode processing ends.

On the other hand, if the light emission signal is not detected in step F103 or the pairing bit = 1 is not detected in step F104 and the predetermined time has elapsed, or the user performs the pairing mode end operation, When an operation for instructing the operation is performed, it is determined as a registration error, and the process proceeds from step F105 to F108. Then, a registration error message is displayed on the display unit 13 and the pairing mode processing is terminated.
For example, when the pairing switch 7 is not pressed on the light emitting device 1 side during registration, or when the state where the imaging device 10 does not recognize the light emitting device 1 as a subject continues for a certain period of time, or when the user performs another operation on the imaging device 10 In the event that the user has no intention to perform the pairing mode, the process is terminated.

The above is an example of the processing in the pairing mode, and various other processing examples for registering the light emitting device ID are conceivable.
For example, when the pairing mode operation on the imaging device 10 side is not required, and the imaging device 10 images the light emitting device 1 with the pairing switch 7 pressed on the light emitting device 1 side (that is, the pairing bit on the imaging device 10 side). = 1)), a simple processing example of registering the light emitting device ID at that time is also conceivable.

The light emitting device ID registered by the pairing process may be valid for an indefinite period after registration (that is, the pairing state is always continued), but the registration may be invalidated for a certain period. Good. For example, once the pairing process is performed, the registration of the light emitting device ID may be automatically deleted after a specific period of time such as 24 hours, 1 week, 2 hours, or the like has elapsed. This is to temporarily allow imaging. Moreover, you may enable it to select the period to permit at the time of a pairing process.

[6. Processing example during imaging]

A processing example at the time of imaging executed by the control unit 16 of the imaging apparatus 10 will be described with reference to FIG.
In response to the cameraman's power-on operation, the control unit 16 executes a power-on process of the imaging device 10 in step F200. When startup by power-on is completed, preview processing is first started in step F201. That is, the control unit 16 causes the imaging unit 11 and the imaging signal processing unit 12 to perform an imaging operation, supplies each frame of the obtained captured image data to the display unit 13 as a moving image, and executes a preview display on the display unit 13. Let
Also, during this preview operation, captured image data is supplied from the imaging signal processing unit 12 to the light emission signal detection unit 15, and the light emission signal detection unit 15 performs analysis processing of the captured image data and performs detection processing of the emission signal. Will start.

In step F202, the control unit 16 determines whether or not a predetermined time tR has elapsed since the detection time t. The detection time t is the time when the process of step F208 was performed in the most recent past, and this is the closest past time as the time when the imaging control information prohibiting imaging was obtained.
The predetermined time tR is, for example, a fixed time, and is a time set as a period for performing the imaging prohibition control in the same imaging direction from the detection time t. For example, a certain time is set as 5 minutes, 10 minutes, 1 hour, 12 hours, 24 hours, or the like.

If the time tR has elapsed since the detection time t, the control unit 16 turns off the detection flag and resets the detection time t in step F204. The detection flag is a flag that is turned on in the process of step F208 when imaging control information prohibiting imaging is obtained. Then, the process proceeds to Step F205.
If the detection time t is in the reset state at the time of step F202 and the detection time t as a particularly effective date is not recorded, the process may proceed from step F202 to F204 to F205.

In steps F205, F206, and F207, the control unit 16 makes a determination based on the detection process of the light emission signal detection unit 15.
That is, first, in step F205, the control unit 16 confirms whether or not the light emission signal is detected by the light emission signal detection unit 15.
In step F206, when a light emission signal is detected, it is confirmed whether or not the light emitting device ID included in the light emission signal is the light emitting device ID registered in the pairing process described above.
In Step F207, when the light emission signal is detected and the light emitting device ID is not the registered ID, it is confirmed whether or not the imaging control bit = 1.
When it is determined in step F205 that a light emission signal is not detected, or when it is determined that the light emitting device ID is registered for pairing in step F206, or in step F207, the imaging control bit is not 1 (that is, imaging permission). If it is determined, the process proceeds to step F210.
In step F210, it is confirmed whether or not the cameraman has performed a shutter operation. If the shutter operation has not been performed, the process returns to step F205 to perform the same determination processing as described above.

On the other hand, if the light emission signal is detected, the light emitting device ID is not registered for pairing, and the imaging control bit = 1, the control unit 16 proceeds to step F208.
In this case, the control unit 16 turns on the detection flag, and stores the time (for example, year / month / day / hour / minute / second) at this time as the detection time t. Furthermore, the azimuth (imaging direction) detected by the azimuth measuring unit 18 at this time is stored as the detection direction θ of the light emission signal.
In step F210, it is confirmed whether or not the cameraman has performed a shutter operation. If the shutter operation has not been performed, the process returns to step F205 to perform the same determination processing as described above.

When the shutter operation is detected in step F210, the control unit 16 advances the processing to step F211 and determines whether or not a light emission signal is detected at this point.
If a light emission signal is detected, it is determined in step F212 whether or not the light emitting device ID included in the light emission signal is registered for pairing.
Furthermore, if a light emission signal is detected and the light emitting device ID is not a registered ID, it is confirmed in step F213 whether or not the imaging control bit = 1.
If the imaging control bit = 1 (imaging prohibited), the process proceeds to step F218 without performing imaging control (recorded image data recording control) according to the shutter operation, and a message “imaging prohibited” is displayed on the display unit 13. Display (for example, the display of FIG. 5D) is executed, and the process returns to step F202. That is, imaging prohibition control is performed so that recording of captured image data in the storage unit 14 is not instructed despite the shutter operation being performed. For example, when a shutter operation is performed in the preview state of FIG. 5A, the processing proceeds in this way, and imaging is prohibited.

On the other hand, if it is determined in step F212 that the light emitting device ID has been registered for pairing, imaging is not prohibited, and the control unit 16 proceeds to step F217 to perform imaging execution control. That is, in accordance with the shutter operation, control is performed to record the captured image data of one frame at the timing as a still image in the storage unit 14. Based on this control, still image recording is performed in the storage unit 14. Then, the control unit 16 returns to Step F202.
Also, if it is determined in step F213 that the imaging control bit = 0 (imaging permission), since imaging is not prohibited, the control unit 16 proceeds to step F217 and performs imaging execution control. That is, in accordance with the shutter operation, control is performed to record the captured image data of one frame at the timing as a still image in the storage unit 14.

When a shutter operation is detected in step F210, a light emission signal may not be detected in step F211. For example, this is the case described with reference to FIG.
In that case, the process proceeds from step F210 to F214. In step F214, the control unit 16 checks whether or not the detection flag is on.
The case where the detection flag is on is a case where a light emission signal of imaging control bit = 1 is detected before pairing registration before the shutter operation time.
On the other hand, if the detection flag is off, the process does not proceed to step F208 before the shutter operation. That is, if the detection flag is off, imaging is not prohibited. Therefore, if the detection flag is OFF, the process proceeds to step F217, and the recording process of the captured image data corresponding to the shutter operation is normally executed.

If the detection flag is on in step F214, it is next determined in step F215 whether or not the time tR has elapsed from the detection time t. That is, it is determined whether or not a predetermined time tR has elapsed as the elapsed time after the detection time t is recorded in step F208 until the shutter operation is performed.
If the time tR or more has elapsed, a sufficient period has already elapsed since the detection flag was turned on, and imaging is not prohibited. For this reason, the process proceeds to step F217, and the recording process of the captured image data corresponding to the shutter operation is normally executed.
Note that, after the detection time t is reset in step F204, if a new detection time t is not stored in step F208, it may be determined that “time tR or more has elapsed”.

However, if the time tR or more has not passed yet, it is considered that the detection flag is still valid. In step F216, the difference between the current imaging direction θ ′ detected by the azimuth measuring unit 18 at this time and the detection direction θ stored in step F208 is confirmed.
If the difference between the detection direction θ and the current imaging direction θ ′ is within the angle θR, the current imaging direction θ ′ is regarded as the same direction as the detection direction θ.
If it is determined that the direction is the same, the imaging control corresponding to the shutter operation (recording control of the captured image data) is not performed, and the process proceeds to step F218 to display a message “prohibit imaging” on the display unit 13 (for example, FIG. 5 (d)) is executed, and the process returns to Step F202. That is, imaging prohibition control is performed such that recording of captured image data in the storage unit 14 is not instructed regardless of the shutter operation. This is processing when the shutter operation is performed in the state described with reference to FIG.

  If it is determined in step F216 that the difference between the detection direction θ and the current imaging direction θ ′ is wider than the angle θR and the current imaging direction θ ′ is not the same direction as the detection direction θ, the imaging is not prohibited. Proceeding to step F217, the captured image data recording process is normally executed in accordance with the shutter operation.

If it is determined in step F202 that tR time has not elapsed since the detection time t, the control unit 16 monitors the shutter operation in step F203.
If the shutter operation is performed, the process proceeds to step F216, and the difference between the current imaging direction θ ′ detected by the azimuth measuring unit 18 at this time and the detection direction θ previously stored in step F208 is confirmed. .
When it is determined that the current imaging direction θ ′ and the detection direction θ are the same direction, the process proceeds to step F218 without performing imaging control (recording control of captured image data) according to the shutter operation, and the display unit 13 The message display of “photographing prohibited” is executed, and the process returns to step F202.
If the difference between the detection direction θ and the current imaging direction θ ′ is wider than the angle θR, and it is determined that the current imaging direction θ ′ is not the same direction as the detection direction θ, the process proceeds to step F217 and the shutter operation is normally performed. Recording processing of captured image data according to the above is executed.

The above-described imaging control is executed by performing the processing in FIG. 7 described above.
That is, a person wearing the light emitting device 1 that outputs imaging control information indicating that imaging is prohibited as a light emission signal cannot be imaged (recording processing of captured image data) by the imaging device 10.
Even in a situation where the light emitting device 1 is not included in the captured image data, the same imaging direction is used within a predetermined time tR after the imaging control information indicating that imaging is prohibited from the light emitting device 1 is detected. Imaging is prohibited.
However, when the person wearing the light emitting device 1 is in the permission position of the prohibition / permission setting switch 6 of the light emitting device 1, the imaging device 10 registers the light emitting device ID of the light emitting device 1 by the pairing process. In this case, the person wearing the light emitting device 1 can be imaged.

[7. Effect of embodiment, modification, and program]

According to the embodiment described above, it is possible to arbitrarily and easily prohibit imaging (recording processing of a captured image signal) by the imaging device 10 on the subject side on which the light emitting device 1 is mounted. As a result, there is an effect that people who have a risk of infringement of portrait rights and privacy, for example, by voyeurism, can restrict imaging by their own intention.
In addition, it is possible to permit imaging to a specific imaging apparatus 10 by pairing processing, and it is possible to realize appropriate imaging prohibition / permission control according to the will and situation.
Further, since the light emitting device 1 transmits and outputs imaging control information using a light pulse pattern, there is no adverse effect on the human body in the transmission of imaging control information.
Furthermore, since the directional light is used, the imaging prohibition range can be controlled to be narrow, and the imaging with the imaging apparatus 10 is not prohibited more than necessary.

  The present invention is not limited to the above-described embodiment, and various modification examples are conceivable as a configuration example and processing example of the imaging device 10 and a configuration of the light-emitting device 1.

First, the light emitting device 1 is assumed to be a badge type that can be worn by a person on clothes or the like, but various forms of the light emitting device 1 can be considered.
For example, the light emitting device 1 is formed as a hairpin type, hair accessory type, earring type, necklace type, brooch type, bracelet type, wristwatch type, glasses type, tie pin type, armband type, ring type, etc. The user may be allowed to wear it in a state.
Moreover, it is good also as a structure which can be mounted | worn with the existing spectacles, sunglasses, an accessory, a hat, headphones, etc.
That is, the form of the light emitting device 1 is not limited at all, and may be any form as long as a person can wear it.

Moreover, you may attach the light-emitting device 1 to articles | goods instead of a person. For example, when it is desired to prohibit unlimited imaging of artworks such as paintings, crafts, software jackets such as music and movies, books, posters, photographs, etc., the light emitting device 1 is attached to those articles. That's fine. Or you may make it incorporate the light-emitting device 1 in articles | goods.
As a result, it is possible to restrict imaging not only for a person but also for a literary work or a product.

Although the imaging apparatus 10 has been described as an example of a digital still camera, the present invention can also be applied to a video camera that captures moving images. In the case of capturing a moving image with a video camera, at the time of detecting a light emission signal including imaging prohibition information at the time of previewing or moving image capturing (moving image recording), as an image capturing prohibition (moving image recording prohibition) process, If the subsequent recording start is prohibited or if recording is in progress, processing such as interrupting moving image recording may be performed.
The imaging device of the present invention is not only a device as a digital still camera and a video camera, but also a device such as a mobile phone, a PDA (Personal Digital Assistant), and a portable personal computer, and has a function as an imaging device. It is applicable if it has one.

Further, although the image recording process in the imaging apparatus 10 has been described as recording in the storage unit 14, transmitting the captured image data to an external device is also one form of the recording process referred to in the present invention.
In the case where the imaging device is a device that performs data communication with an external device by, for example, wired connection or wireless connection, or performs various network communication such as the Internet, a mobile phone communication network, a PHS communication network, an ad hoc network, and a LAN. The captured image data may be transmitted to the external device through such communication, and the captured image data may be recorded on the external device side. For this reason, when imaging prohibition information is included as a light emission signal of the light emitting device 1, it is appropriate to perform prohibition control by regarding the transmission of captured image data to such an external device as a recording process.

  Further, the imaging prohibition control is described as a process that does not execute the recording process for the captured image data. However, the example of the imaging prohibition control may be considered other than simply prohibiting the recording of the captured image data. For example, as imaging prohibition control, recording is performed after image processing such as blurring processing, mosaic processing, and replacement with a black image is performed on a pixel range where a person wearing the light emitting device 1 is captured in the captured image data. This is also included in the category of prohibiting imaging of the subject.

The program according to the embodiment is a program for processing of the control unit 16 described above. That is, this is a program that causes the control unit 16 that is a microcomputer (arithmetic processing unit) to execute the processes of FIGS.
Such a program can be recorded in advance in an HDD as a recording medium incorporated in a device such as a personal computer or an imaging apparatus, a ROM in a microcomputer having a CPU, a flash memory, or the like.
Alternatively, it may be temporarily stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magnet optical) disk, DVD (Digital Versatile Disc), Blu-ray disk, magnetic disk, semiconductor memory, memory card, etc. Can be stored (recorded) or permanently. Such a removable recording medium can be provided as so-called package software.
In addition to installing the program from a removable recording medium to a personal computer or the like, the program can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

It is explanatory drawing of the outline | summary of the imaging system of embodiment of this invention. It is explanatory drawing of the structure of the light-emitting device of embodiment. It is explanatory drawing of the imaging control information of embodiment. It is a block diagram of the imaging device of an embodiment. It is explanatory drawing of the imaging control operation | movement of embodiment. It is a flowchart of the example of the pairing process of embodiment. It is a flowchart of the example of a process at the time of imaging of embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Light-emitting device, 2 Transmission information generation part, 3 Memory part, 4 Modulation part, 5 Light-emitting part, 6 Prohibition / permission setting switch, 7 Pairing switch, 10 Imaging device, 11 Imaging part, 12 Imaging signal processing part, 13 Display Unit, 14 storage unit, 15 light emission signal detection unit, 16 control unit, 16a memory unit, 17 operation unit, 18 direction measurement unit

Claims (9)

As an imaging system consisting of a light emitting device attached to a subject and an imaging device,
The light emitting device
Information generating means capable of generating imaging control information indicating at least imaging prohibition;
Output means for outputting the imaging control information generated by the information generation unit as a light emission signal,
The imaging apparatus is
Imaging processing means for performing imaging processing of incident light from a subject to generate a captured image signal;
Recording processing means for performing recording processing of the captured image signal obtained by the imaging processing means;
A light emission signal detecting means for analyzing the captured image signal obtained by the image pickup processing means and detecting the light emission signal;
Control for prohibiting recording processing by the recording processing means for the captured image signal obtained by the imaging processing means in response to obtaining imaging control information indicating that imaging is prohibited as the light emission signal detected by the light emission signal detecting means. Control means for performing
An imaging system comprising: The control unit of the imaging device performs a process of permitting imaging registration of the light emitting device identification information of the specific light emitting device,
The light emitting device is configured to output imaging control information including light emitting device identification information as a light emission signal,
Even if the imaging control information indicating that imaging is prohibited is obtained as the light emission signal detected by the light emission signal detection means, the control means of the imaging device captures the light emitting device identification information included in the light emission signal. 2. The control according to claim 1, wherein when the light-emitting device identification information is registered for permission, control for permitting recording processing by the recording processing unit for a captured image signal obtained by the imaging processing unit is performed. Imaging system. The imaging apparatus further includes an orientation detection unit that detects an imaging direction by the imaging processing unit,
The control means has the same direction as the imaging direction detected by the azimuth detection means at the time point from the time point when the imaging control information indicating that imaging is prohibited is obtained as the light emission signal detected by the light emission signal detection means. The imaging system according to claim 1, wherein control for prohibiting recording processing of a captured image signal by imaging in an imaging direction to be determined is performed. Imaging processing means for performing imaging processing of incident light from a subject to generate a captured image signal;
Recording processing means for performing recording processing of the captured image signal obtained by the imaging processing means;
A light emission signal detection means for analyzing a captured image signal obtained by the image pickup processing means and detecting a light emission signal output from an external light emitting device;
Control for prohibiting recording processing by the recording processing means for the captured image signal obtained by the imaging processing means in response to obtaining imaging control information indicating that imaging is prohibited as the light emission signal detected by the light emission signal detecting means. Control means for performing
An imaging apparatus comprising:   The control means is a case where imaging control information indicating that imaging is prohibited is obtained as a light emission signal detected by the light emission signal detection means while performing processing for permitting registration of light emission device identification information of a specific light emission device. However, if the light-emitting device identification information included in the light-emission signal is the light-emitting device identification information registered for imaging permission, the recording processing by the recording processing unit for the captured image signal obtained by the imaging processing unit The image pickup apparatus according to claim 4, wherein control for permitting the control is performed. Further comprising an azimuth detecting means for detecting an imaging direction by the imaging processing means,
The control means has the same direction as the imaging direction detected by the azimuth detection means at the time point from the time point when the imaging control information indicating that imaging is prohibited is obtained as the light emission signal detected by the light emission signal detection means. 5. The image pickup apparatus according to claim 4, wherein control is performed to prohibit recording processing of a picked-up image signal by image pickup in an image pickup direction to be determined. Performing imaging processing of incident light from a subject to generate a captured image signal;
Analyzing the captured image signal and detecting a light emission signal output from an external light emitting device;
When imaging control information indicating that imaging is prohibited is not detected as the light emission signal, recording processing of the captured image signal is permitted. When imaging control information indicating that imaging is prohibited is acquired as the emission signal, the imaging image information about the imaging image signal is not detected. A step of prohibiting the recording process;
An imaging method comprising: Imaging processing means for performing imaging processing of incident light from a subject to generate a captured image signal;
Recording processing means for performing recording processing of the captured image signal obtained by the imaging processing means;
A light emission signal detection means for analyzing a captured image signal obtained by the image pickup processing means and detecting a light emission signal output from an external light emitting device;
As an imaging control method of an imaging apparatus provided with
Determining whether or not imaging control information indicating prohibition of imaging is obtained as the emission signal detected by the emission signal detection means;
In response to determining that imaging control information indicating imaging prohibition has been obtained, prohibiting recording processing by the recording processing unit for the captured image signal obtained by the imaging processing unit;
An imaging control method comprising: Imaging processing means for performing imaging processing of incident light from a subject to generate a captured image signal;
Recording processing means for performing recording processing of the captured image signal obtained by the imaging processing means;
A light emission signal detection means for analyzing a captured image signal obtained by the image pickup processing means and detecting a light emission signal output from an external light emitting device;
As a program for controlling the operation of an imaging apparatus equipped with
Determining whether or not imaging control information indicating prohibition of imaging is obtained as the emission signal detected by the emission signal detection means;
A program that causes the arithmetic processing unit to execute a step of prohibiting the recording processing by the recording processing unit for the captured image signal obtained by the imaging processing unit in response to determining that imaging control information indicating imaging prohibition has been obtained. .

Images