JPWO2016170765A1 - Object identification system, object identification method and program - Google Patents

Abstract

In order to enable only a detector to specify desired information projected on a detection target, an imaging means for imaging a detection area, feature data extracted on the image data, and feature data stored in a database And a target specifying means for generating position coordinates relating to the detection position of the detection target, and a control condition for the signal light to be irradiated to the detection target based on the photometric data and the notification signal, and the signal light based on the control condition The control condition is an information input / output device having a control means for controlling the emission of light and a projection means for irradiating signal light toward the detection target, and a shutter opening / closing condition for controlling the amount of incident light reaching the detector. It is set as an object identification system provided with the information recognition apparatus which sets based on this and controls opening and closing of a shutter according to a notification signal.

Description

  The present invention relates to a target specifying system, a target specifying method, and a program recording medium for specifying a detection target from a plurality of targets.

  A safer society can be realized if it is possible to reliably detect detection targets such as criminals and persons who need attention in a hustle and bustle. In recent years, with the progress of face authentication technology and the like, it is possible to authenticate a detection target from an image taken by a surveillance camera or the like. If the face authentication technology is used, the detection target can be extracted from the image taken by the surveillance camera.

  Japanese Patent Application Laid-Open No. 2004-133620 discloses a method that allows a monitor to easily perform a person confirmation operation by performing face authentication between a person reflected on a monitoring camera and an accumulated person.

  Further, in order to reliably capture the detected object, it is required to put some mark on the detection object. For example, the detection target can be marked by using a color ball, paint bullet, color spray, or the like that attaches a liquid containing a special dye to the detection target. However, in order to attach the special dye to the detection target, a technique for reliably applying an object to the moving detection target is required. In addition, it is difficult to attach the special dye only to the detection target in the crowd.

  Patent Document 2 discloses an apparatus that can cause the spotlight irradiation position to follow the position of an unspecified moving body. According to the apparatus of Patent Document 2, only a subject who moves around can be irradiated with a spotlight as a mark.

JP 2010-231402 A JP 2002-83383 A

  If the technique of patent document 1 and 2 is used, a detection target will be detected with a surveillance camera, and a spotlight can be irradiated as a mark only to the detected detection target. However, if a conspicuous mark is attached to the detection target detected in the crowd, a situation is assumed in which a panic occurs when the surroundings notice the mark, making it difficult to specify the detection target. In addition, it may be assumed that the detection target itself has noticed that it has been marked and is a trigger to escape.

  In order to solve the above-described problems, an object of the present invention is to provide a target specifying system that allows only a detector to specify desired information projected on a detection target.

  An object specifying system according to the present invention includes an imaging unit that images a detection area to generate image data, and that measures the brightness of the detection area to generate photometric data and outputs the image data and the photometric data, and a detection target The feature data is extracted from the input image data, the feature data extracted from the image data is compared with the feature data stored in the database, and the detection target is detected. When the position coordinates related to the position are extracted and the detection target is detected, the target specifying means for outputting a notification signal including the collation result and the position coordinates regarding the detection target, and control for causing the imaging means to image the detection area are performed. At the same time, the control conditions for the signal light to be irradiated to the detection target are set based on the input photometric data and the notification signal, and the signal light is set based on the control conditions. An information input / output device having a control means for performing emission control, and a projection means for irradiating signal light toward the detection target in accordance with the control of the control means, and incidence of light reaching a detector for detecting the detection target An information recognition device having a shutter for controlling the amount, setting an opening / closing condition of the shutter based on the control condition, and controlling the opening / closing of the shutter according to the notification signal.

  In the object specifying method of the present invention, the detection area is imaged to generate image data, and the brightness of the detection area is measured to generate photometric data, and feature data is extracted from the image data. The feature data extracted in step 3 is compared with the feature data stored in the database storing the feature data of the detection target, and the position coordinates related to the detection position of the detection target are extracted, and when the detection target is detected Generates a notification signal including the matching result and position coordinates regarding the detection target, sets control conditions for the signal light to be irradiated to the detection target based on the photometric data and the notification signal, and emits the signal light based on the control conditions Based on the control conditions, a shutter opening / closing condition that controls the incident amount of light that is emitted to the detection target and that reaches the detector that detects the detection target is set. And, controlling opening and closing the shutter in response to the notification signal.

  The program recording medium of the present invention captures a detection area to generate image data, and also performs processing for measuring the brightness of the detection area to generate photometric data, extracts feature data from the image data, and outputs image data. When the feature data extracted above is compared with the feature data stored in the database storing the feature data of the detection target, and the position coordinates related to the detection position of the detection target are extracted, and the detection target is detected Includes a process for generating a notification signal including a collation result and a position coordinate regarding the detection target, and a control condition for the signal light to be irradiated to the detection target based on the photometric data and the notification signal, and the signal based on the control condition Processing to emit light and emit signal light toward the detection target, and shutter opening / closing conditions to control the amount of incident light reaching the detector detecting the detection target Set based on the control condition, and records a target specifying program for executing a process of controlling opening and closing of the shutter to the computer in response to the notification signal.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the target specific system which can specify the desired information which only the detector projected on the detection target.

It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 1st Embodiment of this invention. It is a graph for demonstrating irradiation of the pulse laser which the information input / output device which concerns on the 1st Embodiment of this invention irradiates. It is a conceptual diagram for demonstrating the visibility of the pulse laser irradiated by the information input / output device which concerns on the 1st Embodiment of this invention. It is a conceptual diagram for demonstrating the visibility at the time of seeing the pulse laser irradiated by the information input / output device which concerns on the 1st Embodiment of this invention with shutter glasses. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the target specific system which concerns on the 1st Embodiment of this invention. 1 is a block diagram showing a configuration of an information input / output device according to a first embodiment of the present invention. It is a block diagram which shows the structure of the imaging means which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the projection means which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of an example of the projection means which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the optical system of the projection means which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the control means which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the object specific means based on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the information recognition apparatus which concerns on the 1st Embodiment of this invention. It is a conceptual diagram for demonstrating the relationship between the irradiation timing of the pulse laser by the projection apparatus of the information input / output device which concerns on the 1st Embodiment of this invention, and the opening / closing timing of the shutter of shutter glasses. It is a conceptual diagram for demonstrating the relationship between the irradiation timing of the pulse laser by the projection apparatus of the information input / output device which concerns on the 1st Embodiment of this invention, and the opening / closing timing of the shutter of shutter glasses. It is a block diagram which shows an example of the shutter glasses which implement | achieve the information recognition apparatus which concerns on the 1st Embodiment of this invention. It is a block diagram which shows another example of the shutter glasses which implement | achieve the information recognition apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart for demonstrating operation | movement of the information input / output apparatus which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the object specific means based on the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the target specific system which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows the structure of the control means which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows the structure of the target specific system which concerns on the 4th Embodiment of this invention. It is a block diagram which shows the structure of the control means which concerns on the 4th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 4th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 4th Embodiment of this invention. It is a conceptual diagram for demonstrating the relationship between the irradiation timing of the pulse laser by the projection apparatus of the information input / output device which concerns on the 4th Embodiment of this invention, and the opening / closing timing of the shutter of shutter glasses. It is a conceptual diagram for demonstrating the relationship between the irradiation timing of the pulse laser by the projection apparatus of the information input / output device which concerns on the 4th Embodiment of this invention, and the opening / closing timing of the shutter of shutter glasses. It is a conceptual diagram for demonstrating the relationship between the irradiation timing of the pulse laser by the projection apparatus of the information input / output device which concerns on the 4th Embodiment of this invention, and the opening / closing timing of the shutter of shutter glasses. It is a block diagram which shows the structure of the modification of the information input / output system which concerns on the 5th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 5th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 5th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 5th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 5th Embodiment of this invention. It is a conceptual diagram which shows an example of the utilization scene of the target specific system which concerns on the 5th Embodiment of this invention. It is a block diagram which shows the structure of the object specific means based on the 6th Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the object specific system which concerns on embodiment of this invention.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated using drawing. However, the preferred embodiments described below are technically preferable for carrying out the present invention, but the scope of the invention is not limited to the following. In all the drawings used for the description of the following embodiments, the same reference numerals are given to the same parts unless there is a particular reason. In the following embodiments, repeated description of similar configurations and operations may be omitted.

(First embodiment)
First, an outline of the target identification system 1 according to the first embodiment of the present invention will be described. The specific configuration and operation of the target identification system 1 will be described later.

  FIG. 1 is a conceptual diagram illustrating an example of a usage scene of the target identification system 1 according to the present embodiment.

  The interface apparatus 100 captures an image within the detection area 200 and verifies whether or not the detection target 210 is included in the captured detection area 200. When the interface device 100 detects the detection target 210 within the detection area 200, the interface device 100 projects the marking light 300 onto the detection target 210.

  In the target identification system 1 according to the present embodiment, in order to reduce the visibility with the naked eye, the marking light 300 emitted by the projection unit 30 is used as a pulse to lower the average illuminance.

A detector that recognizes the marking light 300 can capture the marking light 300 emitted in a pulse shape using the shutter glasses 600 and visually recognize the marking light 300 with relatively improved contrast. The shutter glasses 600 are realized by the same principle as the secure display disclosed in Non-Patent Document 1, for example. The shutter glasses 600 may be one using a technique different from that of Non-Patent Document 1.
(Non-Patent Document 1) “Liquid Crystal Privacy-Enhanced Displays for Mobile PCs”, J. Ishii, G. Saito, M. Imai and F. Okumura, SID'09 Digest, pp.243-246, 2009
Under daylight sunlight, the illuminance is as high as 50000-60000 lux. In order to emit the marking light 300 that can be viewed with the naked eye under sunlight, it is necessary to emit strong signal light. In some cases, it becomes necessary to emit illegal laser light as signal light. However, there is a legal limit on the upper limit of signal light, and it may be assumed that strong signal light cannot be continuously emitted.

  In addition, if a surrounding person can visually recognize the marking light 300, a panic may occur depending on circumstances. The detection target 210 is likely to escape when the marking light 300 is visually recognized. Therefore, it is necessary to irradiate the detection target 210 with strong signal light that is visible in the daylight without being recognized by the surroundings.

  In order to overcome such a situation, the following approach is taken in the present embodiment.

  First, the marking light 300 that can be visually recognized by the naked eye under sunlight is irradiated with the detection target 210 in a very short pulse shape, and is legalized. Second, the average illuminance of the pulsed marking light 300 is set to about 10 to 50 lux. As a result, the contrast of the signal light with respect to the background light is 1000: 1 or more, and the signal light is hardly visible with the naked eye.

  FIG. 2 is a conceptual diagram for explaining the illuminance of the marking light 300 irradiated to the detection target 210. For example, it is assumed that the illuminance of the marking light 300 applied to the detection target 210 is 1000 lux, and the average illuminance of the marking light 300 is 50 lux. If the contrast of the marking light 300 irradiated to the detection target 210 is sufficiently small with respect to the background light, the irradiated signal light cannot be recognized with the naked eye. This is because the naked eye cannot detect light whose contrast is too small with respect to the brightness of the background light.

  In FIG. 2, signal light having a constant luminance and pulse interval is illustrated, but the pulse interval of signal light can be set arbitrarily. For example, when the luminance of the signal light is lowered, the pulse interval can be made close and the brightness visually perceived by the detector can be made constant.

  FIG. 3 is a conceptual diagram for explaining the visibility when the marking light 300 irradiated on the detection target 210 is viewed with the naked eye when sunlight is used as background light.

  For example, suppose that daytime sunlight is 50000 lux. At this time, as shown in FIG. 3, when the marking light 300 having an average illuminance of 50 lux is irradiated onto the detection target 210, the contrast between the illuminance of the background light and the illuminance of the projection light becomes 1000: 1. That is, the marking light 300 cannot be visually recognized with the naked eye. In the present embodiment, using the contrast between the background light and the marking light 300, the detection light 210 is irradiated with the marking light 300 that cannot be detected with the naked eye.

  FIG. 4 is a conceptual diagram for explaining the visibility when the marking light 300 irradiated on the detection target 210 is viewed through the shutter glasses 600 when sunlight is used as background light.

  For a detector wearing the shutter glasses 600, since the shutter of the shutter glasses 600 is opened only for 1/100 time in one cycle, the brightness of the background light falls to about 500 lux. On the other hand, since the marking light 300 passes through the shutter only when the shutter is open, the average illuminance remains about 10 to 50 lux. As a result, the contrast between the background light and the marking light 300 is 10: 1, so that the detector wearing the shutter glasses 600 can fully see the marking light 300. Usually, the illuminance level described above changes depending on the environment. Therefore, in the present embodiment, the illuminance of the marking light 300 and the shutter opening time are automatically set according to the environment.

  For example, even if a device such as a head mounted display is used, it is possible to attach a virtual mark to the detection target 210, but it is difficult to make the marking light 300 coincide with the detection target 210. On the other hand, according to the target identification system 1 according to the present embodiment, the marking light 300 can be always matched with the detection target 210.

  FIG. 5 is an example in which the marking light 300 is projected only to the detection target 210 from among a plurality of people.

  The marking light 300 projected on the detection object 210 has a sufficiently small contrast with the background light, so that it cannot be visually recognized by surrounding people. On the other hand, the detector can visually recognize the marking light 300 by wearing the shutter glasses 600.

  That is, in the example of FIG. 5, the wearable interface device 100 detects the detection target 210 such as a criminal and irradiates the detection light 210 with the marking light 300. A detector such as a police officer can grasp the detection target 210 by observing the marking light 300 irradiated by the interface device 100 even if the detection target 210 is missed by himself / herself.

  The above is the description of the outline of the target identification system 1 according to the present embodiment.

<Configuration>
Next, the configuration of the target identification system 1 according to the first embodiment of the present invention will be described with reference to the drawings.

  FIG. 6 is a block diagram illustrating a configuration of the target identification system 1 according to the present embodiment. As shown in FIG. 6, the target identification system 1 according to this embodiment includes an information input / output device 10 and an information recognition device 60. In FIG. 1, the information input / output device 10 corresponds to the interface device 100, and the information recognition device 60 corresponds to the shutter glasses 600.

[Information input / output device]
As illustrated in FIG. 7, the information input / output device 10 according to the present embodiment includes an imaging unit 20, a control unit 40, and a projection unit 30.

[Imaging means]
FIG. 8 is a block diagram showing the configuration of the imaging means 20 according to this embodiment. The imaging unit 20 includes an imaging device 21, an image processor 23, an internal memory 24, a photometric sensor 25, and a data output unit 26.

  Although not shown, at least one lens is incorporated in the imaging means 20. The lens incorporated in the imaging unit 20 may have a zoom function that can change the focal length. The imaging unit 20 may be equipped with an autofocus function for automatically focusing. Moreover, it is preferable that the imaging unit 20 is equipped with a function applied to a general digital camera, such as a function of preventing camera shake.

  The imaging element 21 is an element for imaging an area including the detection area 200 and acquiring an image signal. The imaging element 21 is a photoelectric conversion element in which semiconductor components are integrated into an integrated circuit. The image pickup device 21 can be realized by a solid-state image pickup device such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS), for example. Normally, the imaging element 21 is configured by an element that captures light in the visible region, but may be configured by an element that can capture and detect electromagnetic waves such as infrared rays, ultraviolet rays, X-rays, gamma rays, radio waves, and microwaves.

  The image processor 23 performs image processing such as dark current correction, interpolation calculation, color space conversion, gamma correction, aberration correction, noise reduction, and image compression on the image data captured by the image sensor 21. An integrated circuit dedicated to processing. Note that when the image data is output without being processed, the image processor 23 can be omitted. The image processor 23 may be a processor designed to perform necessary processing.

  The internal memory 24 is a storage element that temporarily stores image data that cannot be processed when the image processor 23 performs image processing or processed image data. The image data captured by the image sensor 21 may be temporarily stored in the internal memory 24. The internal memory 24 may be configured by a general memory.

  The photometric sensor 25 is a sensor for measuring the illuminance of the detection area 200. The photometric sensor 25 can be realized by an electronic circuit that detects light using a photoelectric effect, such as a photoresistor or a photodiode. If the image sensor 21 has a photometric function, the photometric sensor 25 may be omitted.

  The photometric sensor 25 outputs the measured illuminance of the detection region 200 to the data output unit 26. Note that the illuminance of the detection region 200 acquired by the photometric sensor 25 may be used for the calculation of the image processor 23.

  As the photometric sensor 25, a sensor using a method classified into mirror meter type photometry, finder optical path photometry, cut capacitor type photometry, direct capacitor type photometry, sub-mirror type photometry, retractable sensor type photometry, etc. is applied. it can. In addition, as the photometric sensor 25, a method using a method classified into narrowing photometry, instantaneous narrowing photometry, open photometry, or the like can be applied. In addition, as the photometric sensor 25, a sensor using a method classified into spot photometry, partial photometry, full surface photometry, center-weighted photometry, multi-segment photometry, or the like can be applied. Note that the photometry methods given here are merely examples, and the scope of the present invention is not limited thereto.

  The data output unit 26 outputs the processed image data processed by the image processor 23 to the control means 40. Further, the data output unit 26 outputs the photometric data (illuminance) of the detection area 200 measured by the photometric sensor 25 to the control means 40.

[Projection means]
FIG. 9 is a block diagram showing the configuration of the projection means 30 according to this embodiment. The projection unit 30 includes a light source 31, a light source driving unit 32, and a projection unit 38.

  The light source 31 includes a light source that emits light 34 having a specific wavelength. In general, the light source 31 is configured to emit light 34 in the visible light region. The light source 31 may be configured to emit light 34 other than the visible light region such as the infrared region and the ultraviolet region.

  As the light source 31, for example, a light source such as a laser light source, an LED (Light Emitting Diode), a lamp, a discharge lamp, or a light bulb can be used. Note that the light emission source used for the light source 31 is not limited to the above. The light source 31 may be a reflector that reflects light emitted from another light source.

  The light source driver 32 drives the light source 31 based on the irradiation condition set by the control means 40 so that pulsed light with a specified output is emitted. Details of the irradiation conditions will be described later.

  The projection unit 38 projects the light 34 emitted from the light source 31 as signal light 39.

  The projection unit 30 may be a projection unit 30-1 equipped with a phase modulation type spatial modulation element as shown in FIG. 10, for example.

  FIG. 10 is a block diagram showing the configuration of the projection means 30-1 equipped with a phase modulation type spatial modulation element. The projection unit 30-1 includes a light source 310, a light source driving unit 320, a phase modulation element 350, a phase modulation element control unit 360, and a projection unit 380.

  The light source 310 includes a light source that emits laser light 340 having a specific wavelength. Usually, the light source 310 is configured to emit laser light 340 in the visible light region. Note that the light source 310 may be configured to emit laser light 340 other than the visible light region such as the infrared region or the ultraviolet region.

  The light source 310 does not uniformly project light onto a region within the projection range, but projects the light while concentrating it on a part. The projection unit 30-1 according to the present embodiment is often used for the purpose of projecting line drawings such as characters and symbols. When projecting line drawings such as characters and symbols, the amount of laser light 340 can be reduced, so that overall laser output can be suppressed. That is, the light source 310 can be composed of a small-sized and low-power light source and a low-output power source that drives the light source.

  The light source driving unit 320 drives the light source 310 so that pulsed light having a specified output is emitted based on the irradiation condition set by the control unit 40.

  The phase modulation element 350 includes a phase modulation type spatial modulation element that receives incident coherent laser light 340 having the same phase and modulates the phase of the incident laser light 340. The phase modulation element 350 emits the modulated light 370 that is modulated toward the projection unit 380.

  In the display area on the phase modulation element 350, a phase distribution for displaying a target image on the projection surface is displayed. The modulated light 370 reflected from the display region of the phase modulation element 350 becomes an image in which a kind of diffraction grating forms an aggregate, and the target image is formed by collecting the light diffracted by these diffraction gratings. The

  The phase modulation element 350 is realized by a spatial modulation element using, for example, a ferroelectric liquid crystal, a homogeneous liquid crystal, a vertical alignment liquid crystal, or the like. The phase modulation element 350 can be realized by, for example, LCOS (Liquid Crystal on Silicon). In addition, the phase modulation element 350 may be realized by, for example, a MEMS (Micro Electro Mechanical System).

  The phase modulation element control unit 360 changes the phase so that the parameter that determines the difference between the phase of the laser light 340 irradiated to the display area on the phase modulation element 350 and the phase of the modulation light 370 reflected from the display area changes. The modulation element 350 is controlled. Parameters that determine the difference between the phase of the laser light 340 irradiated on the display area on the phase modulation element 350 and the phase of the modulated light 370 reflected on the display area are optical characteristics such as refractive index and optical path length, for example. Parameters. For example, the phase modulation element control unit 360 changes the refractive index of the display area by controlling the voltage applied to the display area on the phase modulation element 350. As a result, the laser light 340 applied to the display area is appropriately diffracted based on the refractive index of the display area.

  That is, the phase distribution of the laser beam 340 irradiated to the phase modulation element 350 is modulated according to the optical characteristics of the display area. Note that the control of the phase modulation element 350 by the phase modulation element control unit 360 is not limited to the above.

  Projection unit 380 includes an optical system that projects modulated light 370 reflected by phase modulation element 350 as signal light 390.

  FIG. 11 is a conceptual diagram for explaining the optical configuration of the projection unit 30-1 according to the present embodiment. As shown in FIG. 11, in this embodiment, the laser light emitted from the light source 310 is converted into parallel laser light 340 by the collimator 53 and is incident on the display surface of the phase modulation element 350.

  In the present embodiment, as shown in FIG. 11, the incident angle of the laser beam 340 is made non-perpendicular with respect to the display surface on the phase modulation element 350. That is, in the present embodiment, the emission axis of the laser light emitted from the light source 310 is inclined with respect to the display surface on the phase modulation element 350. If the emission axis of the laser beam 340 is set obliquely with respect to the display surface on the phase modulation element 350, the efficiency can be improved because the laser beam 340 can be incident on the display surface of the phase modulation element 350 without using a beam splitter. be able to.

  The modulated light 370 modulated by the phase modulation element 350 is projected as signal light 390 by the projection unit 380. As illustrated in FIG. 11, the projection unit 380 includes a Fourier transform lens 381, an aperture 382, and a projection lens 383.

  The Fourier transform lens 381 is an optical lens for forming an image formed when the modulated light 370 reflected by the display surface on the phase modulation element 350 is projected at infinity at a nearby focal position.

  The aperture 382 has a function of erasing high-order light included in the light focused by the Fourier transform lens 381 and specifying an image region. The opening of the aperture 382 is set to be smaller than the image area of the projection image at the position of the aperture 382 and to block the peripheral area of the projection image. For example, the opening of the aperture 382 is formed to be rectangular or circular. The aperture 382 is preferably installed at the focal position of the Fourier transform lens 381, but may be shifted from the focal position as long as the function of erasing high-order light can be exhibited.

  The projection lens 383 is an optical lens that magnifies and projects the light focused by the Fourier transform lens 381. The projection lens 383 projects the signal light 390 so that the target image corresponding to the phase distribution input to the phase modulation element 350 is displayed on the projection surface.

[Control means]
When the detection target 210 is included in the detection area 200 captured by the imaging unit 20, the control unit 40 controls the projection unit 30 to project an appropriate image toward the detection target 210. The control unit 40 provides the projection unit 30 with image information corresponding to an operation performed on the user interface image included in the detection area 200 captured by the imaging unit 20 and projects an image related to the image information. The projection means 30 is controlled to do so. The control means 40 can be realized by the function of a microcomputer including, for example, an arithmetic device and a control device.

  Note that the control unit 40 may be configured to transmit the result of detecting the detection target 210 and information related to the operation performed on the detection area 200 to a host system such as a server at a predetermined timing.

  As illustrated in FIG. 12, the control unit 40 includes an imaging control unit 41, an irradiation condition setting unit 42, a processing unit 43, a storage unit 44, a projection control unit 45, and a communication unit 46. In addition, the control unit 40 includes a target specifying unit 50 for specifying the detection target 210. Although FIG. 12 shows a configuration in which the control means 40 includes the target specifying means 50, the control means 40 and the target specifying means 50 may be configured differently. The object specifying unit 50 will be described in detail later.

  The imaging control unit 41 controls the imaging unit 20 to image the detection area 200. The imaging control unit 41 causes the imaging unit 20 to image the detection area 200 at a predetermined timing. Further, the imaging control unit 41 acquires image data and photometry data output from the imaging unit 20. The imaging control unit 41 outputs the image data to the target specifying unit 50, outputs the photometric data to the irradiation condition setting unit 42, and outputs the image data and the photometric data to the processing unit 43.

  The irradiation condition setting unit 42 calculates an irradiation condition including a pulse condition and an output condition of the signal light emitted from the projection unit 30 based on the illuminance of the detection region 200 included in the photometric data. Note that the pulse condition includes a condition relating to a pulse width corresponding to the irradiation time of the signal light and a repetition period of emitting the signal light. The output conditions include conditions regarding the output intensity of the signal light, the illuminance in the detection region 200 of the signal light emitted with the output intensity, and the like. The irradiation condition setting unit 42 outputs the calculated irradiation condition of the signal light to the processing unit 43 and outputs the pulse condition of the signal light to the communication unit 46. The irradiation condition setting unit 42 may be configured to transmit the irradiation conditions to the projection control unit 45 or the communication unit 46 without going through the processing unit 43.

  The processing unit 43 acquires a notification signal including a position coordinate where the detection target 210 acquired from the target specifying unit 50 described later is detected and the irradiation condition calculated by the irradiation condition setting unit 42. The notification signal includes a collation result indicating whether or not the detection target 210 is detected, and includes the position coordinates of the detection target 210 when the detection target 210 is detected.

  The processing unit 43 clarifies the position coordinates of the projection image on the captured image and generates a control condition for projecting the signal light onto the detection target 210. Based on the position coordinates of the detection target 210, the processing unit 43 calculates an irradiation direction condition including the irradiation direction of the signal light irradiated toward the detection target 210 as one of the control conditions. Usually, the target specifying unit 50 detects the detection target 210 by face authentication. Therefore, the processing unit 43 determines the irradiation direction of the signal light so that the signal light can be irradiated to the body part below the face position of the detection target 210. The control conditions generated by the processing unit 43 include conditions relating to the pulse condition, output condition, and irradiation direction condition of the signal light.

  The processing unit 43 outputs the control conditions for the projection unit 30 to the projection control unit 45.

  The storage unit 44 stores a target image projected by the projection unit 30. The target image includes, for example, a predetermined image for identifying that the target irradiated with the target image is the detection target 210, such as X or ◯. The storage unit 44 may be configured to store data other than the target image. When the projection unit 30 includes a phase modulation type spatial modulation element as shown in FIG. 10, the storage unit 44 may store the phase distribution of the target image.

  When the projection control unit 45 acquires the control condition and the irradiation condition, the projection control unit 45 acquires an appropriate target image from the storage unit 44. And the projection control part 45 provides the acquired target image to the projection means 30, controls the projection means 30 based on control conditions and irradiation conditions, and projects the target image.

  The communication unit 46 transmits the pulse condition of the signal light set by the irradiation condition setting unit 42 to the projection unit 30. When the target specifying unit 50 is not included in the control unit 40, the communication unit 46 receives the notification signal output from the target specifying unit 50.

[Target identification method]
FIG. 13 is a block diagram illustrating a configuration of the target specifying unit 50 according to the present embodiment. The target specifying unit 50 according to the present embodiment includes a database 51, an image acquisition unit 52, an image analysis unit 53, a verification unit 54, and a verification result output unit 55.

  The database 51 stores feature data of face images including the detection target 210. The database 51 may store, for example, information on the shape of facial parts such as the nose, eyes, chin, cheekbones, and the relative positional relationship and size of these parts as feature data. Note that the data stored in the database 51 is not limited to the above. Further, the database 51 may store difference data between the feature data of the average face image created from a large number of face images and the feature data of each face image.

  In the present embodiment, the detection target 210 is detected using the feature data of the person's face image, but the detection target 210 may be detected using feature data other than the face image. For example, a person's hairstyle and physique can be set in the feature data. Further, if it is possible to analyze a moving image, it is possible to set the feature data such as how a person walks and how to walk.

  The image acquisition unit 52 acquires image data from the imaging control unit 41. The image acquisition unit 52 outputs the acquired image data to the image analysis unit 53.

  The image analysis unit 53 acquires image data from the image acquisition unit 52 and analyzes the acquired image data. The image analysis unit 53 detects a face image corresponding to a person's face from the analyzed image data, and extracts feature data from the detected face image. The image analysis unit 53 extracts feature data such as the shape of facial parts such as nose, eyes, chin, cheekbone, and the relative positional relationship and size of these parts from the facial image. At this time, the image analysis unit 53 associates the position data on the image data from which the face image is extracted with the feature data of the face image extracted from the image data.

  The image analysis unit 53 outputs data including the extracted feature data of the face image and the position coordinates corresponding to the face image to the matching unit 54.

  The collation unit 54 compares the feature data of the face image extracted by the image analysis unit 53 with the feature data of each face image stored in the database 51. The matching unit 54 may compare the feature data on the face images as they are, or may statistically digitize the face images and compare them. A general algorithm may be used as a specific algorithm for comparing face images. For example, the collation unit 54 can collate whether or not the detection target 210 is included in the detection region 200 imaged by the imaging unit 20 by performing template matching using a combination of characteristic facial parts.

  When the detection unit 210 is detected, the verification unit 54 outputs a determination result that the detection target 210 has been detected to the verification result output unit 55. At this time, the collation unit 54 outputs the position coordinates of the face image of the detection target 210 together with the determination result.

  When receiving the determination result that the detection target 210 has been detected, the collation result output unit 55 projects a notification signal including information indicating that the detection target 210 has been detected and the position coordinates of the face image of the detection target 210. Output to means 30.

[Information recognition device]
FIG. 14 is a block diagram showing the configuration of the information recognition apparatus 60 according to this embodiment. The information recognition apparatus 60 according to the present embodiment includes a receiving unit 61, an opening / closing timing setting unit 62, an opening / closing control unit 63, a shutter driving unit 64, and a shutter 65.

  The information recognition device 60 includes a shutter 65 that controls the amount of incident light reaching the detection person from the detection region 200. The information recognition device 60 sets the opening / closing conditions of the shutter 65 based on the control conditions set by the information input / output device 10. The information recognition device 60 controls the opening and closing of the shutter 65 in accordance with the notification signal output from the information input / output device 10.

  The receiving means 61 is means for receiving data output from the information input / output device 10. The receiving unit 61 receives data by wireless communication, for example. The receiving unit 61 receives the control condition set by the irradiation condition setting unit 42 of the control unit 40. The receiving unit 61 outputs the received control condition to the opening / closing timing setting unit 62. The receiving means 61 may include a general liquid crystal module image memory.

  The opening / closing timing setting means 62 sets the opening / closing conditions of the shutter 65 based on the control conditions received from the receiving means 61. The opening / closing timing setting means 62 outputs the set shutter opening / closing conditions to the opening / closing control means 63. For example, the opening / closing control means 63 can be realized by a general liquid crystal module timing controller.

  As shown in FIG. 15, the opening / closing timing setting means 62 sets the shutter 65 to open in a time zone including the timing when the signal light is emitted. The opening / closing timing setting means 62 does not always need to open the shutter 65 at the timing when the signal light is emitted. The opening / closing timing setting means 62 calculates a condition for relatively improving the contrast of the pulsed signal light applied to the detection target 210 with respect to the background light viewed through the shutter 65. Then, the opening / closing timing setting means 62 sets a shutter opening / closing condition that makes the signal light visible based on the calculated condition and the pulse condition included in the control condition.

  As shown in FIG. 16, the pulse interval of the signal light may not be uniform. In the example of FIG. 16, in the time zone B, the luminance of the signal light is lowered as compared with the time zone A. In time zone B, the visual brightness is made equal to the signal light in time zone A by narrowing the pulse interval. At this time, in the time zone B, the opening / closing timing setting means 62 sets the time for opening the shutter 65 shorter than the time zone A in order to improve the contrast.

  The opening / closing timing setting means 62 sets the opening / closing timing of the shutter 65 based on the brightness of the background light measured by the information input / output device 10 and the average brightness of the signal light applied to the detection target 210.

  For example, the background light is darker in the morning and evening, cloudy weather, and rainy weather than in the daytime in fine weather. In that case, the opening / closing timing setting means 62 sets the shutter opening / closing conditions so as to obtain an appropriate contrast while setting the average brightness of the irradiated signal light to be small. Further, for example, on a snowy mountain or a midsummer coast, the background light is brighter than in normal daytime. In that case, the opening / closing timing setting means 62 sets the average brightness of the signal light to be irradiated and sets the shutter opening / closing conditions so as to obtain an appropriate contrast.

  The opening / closing control means 63 controls the shutter driving means 64 that opens and closes the shutter 65 based on the shutter opening / closing conditions set by the opening / closing timing setting means 62. For example, the opening / closing control means 63 can be realized by a display controller of a general liquid crystal module. When the timing control and the display control are controlled by the same means, the opening / closing timing setting means 62 and the opening / closing control means 63 may be shared.

  The shutter driving unit 64 opens and closes the shutter 65 under the control of the opening / closing control unit 63. For example, the shutter driving unit 64 can be realized by an XY driver of a general liquid crystal module.

  The shutter 65 is opened and closed by the shutter driving means 64. For example, the shutter 65 blocks external light when in the closed state and allows external light to pass through when in the open state. Note that the shutter 65 does not have to completely block the external light when in the closed state, and may be such that the external light is dimmed when in the open state.

  The shutter 65 may be realized using, for example, a high-speed response liquid crystal, or may be realized using a MEMS (Micro Electro Mechanical System) shutter. When a normal TN (Twisted Nematic) liquid crystal is used, the brightness of the light passing through the shutter 65 falls to about 40% of the external light due to the insertion of a polarizing plate. Therefore, when viewing through the shutter 65 using TN liquid crystal, it is darker than when viewing with the naked eye. On the other hand, when the MEMS shutter is used, since there is no polarizing plate, it becomes brighter than the shutter 65 using TN liquid crystal. However, even if a MEMS shutter is used as the shutter 65, the aperture ratio is not 100%, so it is darker than when viewed with the naked eye. However, in the case of the MEMS shutter, the pupil is opened because the entire field of view becomes dark, and it feels brighter than when TN liquid crystal is used. The structure of the shutter 65 is not limited to that described here as long as external light can be blocked, passed, or dimmed.

  FIG. 15 shows an example in which the irradiation timing of the signal light and the opening / closing timing of the shutter 65 are synchronized.

  When receiving the pulse condition of the signal light, the information recognition device 60 opens the shutter 65 at the timing when the signal light is irradiated to the detection target 210 based on the pulse condition, and the shutter 65 at the timing when the signal light is not irradiated. Control to close. The information recognizing device 60 performs control so that the contrast of the signal light with respect to the background light sensed through the shutter 65 is relatively improved by opening and closing the shutter 65 so as to be visible.

  17 and 18 show an example of shutter glasses 600 according to the present embodiment. The shutter glasses 600 have a frame for disposing the shutter 65 in front of at least one eye of a person who detects the detection target 210. In the shutter glasses 600, a transparent body such as transparent glass or plastic may be installed at the position of the glasses lens, or only the shutter 65 may be installed. FIGS. 17 and 18 are examples for embodying the structure of the shutter glasses 600 according to the present embodiment, and do not limit the scope of the present invention.

  The shutter glasses 611 in FIG. 17 have a shutter 612 having the function of the shutter 65 mounted on at least one lens. The shutter glasses 611 are equipped with a control device 613 having functions of a receiving unit 61, an opening / closing timing setting unit 62, an opening / closing control unit 63, and a shutter driving unit 64. The control device 613 controls opening / closing of the shutter 611 under the pulse condition received from the information input / output device 10. Since the detector wearing the shutter glasses 611 can visually recognize the projection light projected by the information input / output device 10, the detection target 210 can be grasped.

  The shutter glasses 621 in FIG. 18 have a shutter 622 having the function of the shutter 65 mounted on at least one lens. The shutter glasses 621 are equipped with a control device 623 having at least the function of the shutter driving means 64. Furthermore, the shutter glasses 621 are equipped with a control device 624 having any of the functions of the receiving unit 61, the opening / closing timing setting unit 62, and the opening / closing control unit 63. In the example of FIG. 18, the shutter glasses 621 can be reduced in weight by sharing the control system of the shutter 622 into two systems. Normally, electric power is required to drive the shutter glasses 621. However, if a power source is prepared in the control device 624, it is possible to achieve both weight reduction of the shutter glasses 622 and an increase in capacity of the power source.

  The above is the description of the configuration of the target identification system 1 according to the present embodiment.

<Operation>
Next, the operation of the target identification system 1 according to this embodiment will be described.

  FIG. 19 is a flowchart for explaining the operation of the information input / output device 10 of the target identification system 1 according to this embodiment.

  In FIG. 19, the information input / output device 10 first images the detection area 200 (step S11). In the example of FIG. 19, it is assumed that photometric data of the detection area 200 is also acquired.

  Next, the information input / output device 10 generates image data from the captured image signal (step S12). At this time, the imaging means 20 of the information input / output device 10 converts an image signal that is analog data into image data that is digital data. In addition, the imaging unit 20 performs image processing on the image data as necessary.

  Next, the information input / output device 10 verifies the image data (step S13). At this time, the target specifying unit 50 of the information input / output device 10 extracts a face image from the image data, and verifies whether or not the extracted face image matches the detection target 210.

  When the extracted face image matches the detection target 210, that is, when the detection target 210 is found (Yes in step S14), the information input / output device 10 sets the irradiation condition of the signal light projected on the detection target 210 (Step S15). At this time, the irradiation condition setting unit 42 of the information input / output device 10 sets appropriate pulse conditions and output conditions for the signal light based on the photometric data. Note that step S15 may be executed in parallel with steps S12 to S14 at the next stage after step S11.

  On the other hand, if the extracted face image does not match the detection target 210, that is, if the detection target 210 has not been found (No in step S14), the process returns to step S11.

  When the irradiation condition of the signal light projected on the detection target 210 is set in step S15, the information input / output device 10 transmits the pulse condition included in the irradiation condition to the information recognition apparatus 60 (step S16).

  Then, the information input / output device 10 projects the projected light of the mark onto the detection target 210 (Step S17).

  The above is the description of the operation of the information input / output device 10 of the target identification system 1 according to the present embodiment. The information recognition device 60 opens and closes the shutter 65 based on the received pulse condition.

  As described above, according to the target specifying system according to the present embodiment, it is possible to irradiate the detection target with strong signal light that can be seen in daylight without being recognized by the surroundings. In addition, according to the target identification system according to the present embodiment, the detector can recognize the signal light emitted to the detection target using an information recognition device such as shutter glasses. As a result, according to the target identification system according to the present embodiment, only the detector can recognize desired information projected on the detection target.

(Use scene)
Here, a usage scene of the target identification system 1 according to the present embodiment will be described with reference to the drawings.

  FIG. 20 shows a usage scene in which the target identification system 1 is installed on the ceiling.

  When the target identification system 1 detects the detection target 210 at the position A, the target identification system 1 irradiates the detection target 210 with the marking light 300. The target identification system 1 irradiates the detection target 210 with two marking lights 300 at the position A. Then, even if the target identification system 1 realizes that the detection target 21 is irradiated with the marking light 300 and escapes, the target identification system 1 continuously detects the detection target 210 and continues to irradiate the marking light 300 even at the position B. Yes. That is, the target identification system 1 follows the detection target 210 that moves around in real time, and continues to irradiate the marking light 300 to the detection target 210.

  FIG. 21 shows a usage scene when a criminal who is the detection target 210 is located behind another person and the marking light 300 cannot be directly irradiated on the detection target 210.

  In such a case, the target identification system 1 irradiates the person positioned immediately before the detection target 210 with the marking light 300 “back criminal” to identify the detection target 210. That is, the target identification system 1 can identify the detection target 210 by irradiating the marking light 300 to another target object even if the marking light 300 cannot be directly irradiated to the detection target 210.

  FIG. 22 shows a usage scene when the target identification system 1 cannot directly irradiate the detection target 210 with the marking light 300.

  The target identification system 1 receives the detection notification of the detection target 210 from another system, and irradiates the ground with marking light 300 that notifies the detector that the detection target is approaching according to the received detection notification. The detector wearing the shutter glasses 600 knows the approach of the criminal who is the detection target 210 by visually recognizing the marking light 300 irradiated on the ground. Note that the target identification system 1 irradiates the marking light 300 on the displayable line 302 that can directly irradiate the detection target 210 with the marking light 300, and who is the detection target 210 among a plurality of persons approaching. May be shown.

(Second Embodiment)
FIG. 23 is a block diagram showing the configuration of the information recognition device 60-2 of the target identification system according to the second embodiment of the present invention. The target identification system according to the present embodiment has a configuration in which a photometric unit 66 is added to the information recognition device 60 of the target identification system 1 according to the first embodiment.

  The photometric means 66 is a photometric sensor that measures the brightness of the background light that has passed through the shutter 65. The photometric unit 66 may have the same configuration as the photometric sensor 25.

  The opening / closing timing setting means 62 sets conditions for making the signal light visible based on the brightness of the background light through the shutter 65 measured by the photometry means 66 and the averaged brightness of the pulsed signal light. .

  According to the present embodiment, since the brightness of the background light that has passed through the shutter 65 is actually measured, the visibility of the signal light can be set in accordance with the state of the background light such as actual weather conditions and illumination conditions. Therefore, it becomes possible to visually recognize the signal light more reliably.

(Third embodiment)
FIG. 24 is a block diagram showing the configuration of the target identification system 3 according to the third embodiment of the present invention. The target specifying system 3 according to the present embodiment is the first in that the target specifying device 50-3 that specifies the detection target 210 is connected to the information input / output device 10-2 and the information recognition device 60 via the network 70. This is different from the object identification system 1 according to the embodiment. The function of the target identifying device 50-3 may be assigned to a general server or the like.

  FIG. 25 is a block diagram showing the configuration of the control means 40-3 according to this embodiment. Unlike the control unit 40 according to the first embodiment, the control unit 40-3 according to the present embodiment does not include the target specifying device 50-3. The communication unit 46 of the control unit 40-3 according to the present embodiment is connected to the target specifying device 50-3 via the network 70. Since the other configuration of the control unit 40-3 is the same as that of the control unit 40 according to the first embodiment, description thereof is omitted.

  In the target specifying system according to the present embodiment, the target specifying device can be provided outside the control means, so that the information input / output device can be reduced in weight and size. In addition, if the target specifying device is placed on the high-performance server side, the detection processing of the detection target can be speeded up and the arithmetic processing of the control means can be reduced. In addition, since the power used for detection target processing by the target specifying device can be reduced, the power source mounted on the information input / output device can be reduced in size.

(Fourth embodiment)
FIG. 26 is a block diagram showing the configuration of the target identification system 4 according to the fourth embodiment of the present invention. The target identification system 4 according to this embodiment has a configuration in which a lighting device 80 is added to the target identification system 1 according to the first embodiment. The target identification system 4 according to this embodiment may have a configuration in which the illumination device 80 is added to the target identification system 3 according to the third embodiment.

  FIG. 27 is a block diagram showing the configuration of the control means 40-4 of the target identification system 4 according to this embodiment. The control unit 40-4 has a configuration in which an illumination control unit 47 is added to the control unit 40 of the target identification system 1 according to the first embodiment.

  The lighting device 80 irradiates specific light to a person who passes through a certain point or a person who stays at a certain point. That is, the illumination device 80 irradiates the target included in the detection region 200 with specific light. The specific light is light having a wavelength and a property different from those of the marking light 300. For example, illumination light for increasing the contrast of the marking light 300, dummy light for making the irradiation of the marking light 300 less conscious, and the like correspond to specific light.

  The illumination control unit 47 controls the illumination device 80 to emit specific light. For example, the illumination control unit 47 controls the illumination device 80 to irradiate specific light to all persons passing through a certain point.

  The illumination control unit 47 may switch the irradiation timing of specific light in accordance with the irradiation timing of the marking light 300 of the projection control unit 45. For example, the illumination control unit 47 controls the illumination device 80 to emit specific light at the irradiation timing of the marking light 300 of the projection control unit 45. For example, the illumination control unit 47 performs control to stop irradiation of specific light by the illumination device 80 at the irradiation timing of the marking light 300 of the projection control unit 45. However, the illumination control unit 47 may switch the irradiation of specific light at a timing different from the example given here.

  Moreover, the illumination control part 47 sets the area where the illuminating device 80 irradiates specific light. For example, when the lighting device 80 can individually irradiate a plurality of areas, the illumination control unit 47 can perform control to irradiate a specific area among the plurality of areas. Specifically, when the lighting device 80 includes a plurality of LEDs, the lighting control unit 47 controls to drive only the LEDs that irradiate the detection target 210 with specific light and not to drive other LEDs. can do. On the contrary, the illumination control unit 47 can control not to drive only the LED that irradiates the detection target 210 with specific light. Further, the illumination control unit 47 may be set to irradiate light only to a specific area by controlling the irradiation direction of the specific light by the lighting device 80. In addition, if a phase modulation type spatial modulation element is used for the illumination device 80, it is possible to irradiate only a specific area without changing the irradiation direction.

  FIG. 28 is a conceptual diagram illustrating an example of a usage scene of the target identification system 4 including the lighting device 80.

  For example, there may be cases where sufficient background light cannot be obtained at night or in a dark room. In such a case, the illumination device 80 sufficiently brightens the background light in the detection area. If the background light is sufficiently brightened, the information input / output device 10 can irradiate the detection light 210 with the marking light 300 using the method described in the first embodiment. In the case of the example in FIG. 28, the specific light emitted from the illumination device 80 may be illumination light with sufficient brightness.

  FIG. 29 is a conceptual diagram illustrating another example of a usage scene of the target identification system 4 including the lighting device 80.

  For example, in order to conduct some kind of check, all people who pass the checkpoint are guided to a specific place. In that particular place, a detection area 200 is set in which all persons who pass through the checkpoint must pass. Then, an illuminating device 80 for irradiating dummy marking light (hereinafter referred to as dummy light 303) to all persons passing through the detection region 200 is provided. In the case where consideration is given so that the dummy light 303 is not applied to a child or the like, the interface device 100 is used instead of the lighting device 80 so that the object that is authenticated as a child is not irradiated with the dummy light 303. That's fine.

  When the detection target 210 is detected, the interface apparatus 100 irradiates the marking light 300 to the detection target 210. For example, if the dummy light 303 and the marking light 300 are light of different wavelengths, the marking light 300 is visually recognized by the detector wearing the shutter glasses 600. At this time, if the dummy light 303 is a continuous wave, or the pulse condition of the dummy light 303 is different from that of the marking light 300, the marking light 300 can be more easily distinguished.

  In the case of FIG. 29, the interface device 100 may be a stationary type instead of a wearable. However, even in the case of FIG. 29, the interface device 100 may be wearable.

  As in the example of FIG. 29, if all the people are exposed to the dummy light 303, the surrounding people and the detection target 210 themselves are less likely to notice the marking light 300. Since the detector wearing the shutter glasses 600 can visually recognize the marking light 300 that hits the detection target 210, the detection target 210 can be identified.

  In general, in the case of an inspection, a plurality of police officers are present as detectors. In such a case, if the detection target 210 is specified through a single monitor or the like, it is impossible to instantly identify which person is the criminal of the detection target 210. According to the target identification system 4 according to the present embodiment, all the detectors wearing the shutter glasses 600 can identify the detection target 210 at the same time. In a scene where a criminal is arrested, such a time difference can greatly contribute to the criminal arrest.

  30 to 32 are conceptual diagrams for explaining how to control the opening and closing of the shutter 65 in accordance with the pulse condition of the signal light in the scene as shown in FIG. 30 to 32 are examples, and do not limit the scope of the present invention. Further, the pulse conditions and output conditions of the signal light in FIGS. 30 to 32 can be arbitrarily set.

  In the example of FIG. 30, the interface apparatus 100 performs control so that all persons passing through the detection region 200 are irradiated with the pulsed dummy light 303. Then, the interface apparatus 100 controls to irradiate the detection target 210 with the pulsed marking light 300 at a timing when the dummy light 303 is not irradiated. Since the dummy light 303 may be seen by all people, the pulse width can be set longer. On the other hand, the marking light 300 sets a short pulse condition that is not visible with the naked eye so that only the detector wearing the shutter glasses 600 can visually recognize. Then, the shutter 65 is set to open in accordance with the irradiation timing of the marking light 300. At this time, the shutter glasses 600 control the opening and closing of the shutter 65 so that the contrast of the marking light 300 with respect to the background light can be visually recognized through the shutter 65.

  In the example of FIG. 31, the interface device 100 irradiates all persons passing the detection region 200 with the continuous wave dummy light 303 and the detection target 210 with the pulsed marking light 300. Control. The continuous wave dummy light 303 is visible to all people. On the other hand, the marking light 300 sets a short pulse condition that cannot be visually recognized by the naked eye so that only the detector wearing the shutter glasses 600 can visually recognize. In the example of FIG. 31, the peak output of the marking light 300 is set to be stronger than the dummy light 303. Then, the shutter 65 is set to open in accordance with the irradiation timing of the marking light 300. At this time, the shutter glasses 600 control the opening and closing of the shutter 65 so that the contrast of the marking light 300 with respect to the background light can be visually recognized through the shutter 65.

  In the example of FIG. 32, as in the example of FIG. 30, the interface apparatus 100 performs control so that all persons passing through the detection region 200 are irradiated with the pulsed dummy light 303. Then, the interface apparatus 100 controls to irradiate the detection target 210 with the pulse-shaped marking light 300 at the timing when the dummy light 303 is not irradiated. The dummy light 303 may be visible to all or may not be visible. On the other hand, the marking light 300 sets a short pulse condition that cannot be visually recognized with the naked eye so that only the detector wearing the shutter glasses 600 can visually recognize. In the example of FIG. 32, the dummy light 303 is irradiated to each person passing through the detection region 200 at different irradiation timings. The shutter 65 is set to open only at the irradiation timing of the marking light 300. At this time, the shutter glasses 600 control the opening and closing of the shutter 65 so that the contrast of the marking light 300 with respect to the background light can be visually recognized through the shutter 65.

  As described above, according to the target specifying system according to the present embodiment, it is possible to project the projection light that can be detected only by the detector wearing the information recognition device onto the detection target even at night or in a dark room. Moreover, according to this embodiment, by irradiating all persons with dummy light, it is possible to irradiate the detection target with the marking light without being aware of the detection target itself and the surroundings.

(Fifth embodiment)
FIG. 33 is a block diagram showing the configuration of the information input / output system 110 that exhibits the information input / output function of the target identification system according to the fifth embodiment of the present invention.

  The information input / output system 110 according to the present embodiment includes an imaging device 120 having the function of the imaging unit 20, a projection unit 30, a control device 140 having the function of the control unit 40, and an illumination unit 81 having the function of the illumination device 80. . That is, the information input / output system 110 has a configuration in which an illumination unit 81 having the function of the illumination device 80 according to the fourth embodiment is added. The illumination unit 81 has the same function as the illumination device 80, and detailed description thereof is omitted.

  Further, the illumination unit 81 and the projection unit 30 constitute a light irradiation device 800. The light irradiation device 800 is provided as a device separate from the imaging device 120 and the control device 140 and operates under the control of the control device 140.

  Hereinafter, usage scenes of the target identification system including the information input / output system 110 according to the present embodiment will be described.

  FIG. 34 is an example of detecting the detection object 210 in a room. A plurality of light irradiation devices 800 are installed on the ceiling. The imaging device 120 and the control device 140 are installed at a position different from the installation position of the light irradiation device 800. The light irradiation device 800 may be configured to be controlled by the control device 140 through a network such as an intranet or the Internet.

  The left side of FIG. 34 shows a scene in which illumination light is irradiated as specific light from the light irradiation device 800 at the timing when the shutter glasses 600 worn by the detector are closed. At this time, illumination light from the light irradiation device 800 is irradiated to all persons in the room.

  The right side of FIG. 34 shows a scene in which the detection target 210 is irradiated with illumination light only from the light irradiation device 800 in the vicinity of the detection target 210 when the shutter glasses 600 worn by the detector are opened. At this time, the light irradiation device 800 that has not irradiated the illumination light irradiates the detection light 210 with the marking light 300. At this time, other persons in the room do not recognize the marking light 300.

  In the scene on the right side of FIG. 34, in conjunction with the timing of opening the shutter glasses 600, only a detection target 210 is irradiated with illumination light from a certain light irradiation device 800, and the detection target 210 is irradiated from a plurality of other light irradiation devices 800. The marking light 300 is irradiated. At this time, the illumination light applied to the detection target 210 from the light irradiation device 800 is darkened to the minimum necessary within a range where the detection target 210 can be visually recognized. As a result, the contrast of the marking light 300 is improved, and it becomes easier for only the detector wearing the shutter glasses 600 to detect the marking light 300. Further, if the detection target 210 is irradiated with illumination light from a plurality of light irradiation devices 800, it is possible to prevent a blind spot from occurring due to the posture of the detection target 210 or the standing position of the detector.

  FIG. 35 to FIG. 38 are examples in which marking light 300 is irradiated only to the detection target 210 while irradiating the band-shaped light from the light irradiation means 800 to all persons passing through a certain point. The light irradiation by the light irradiation device 800 in FIGS. 35 to 38 can be controlled at the timing as shown in FIGS. 30 to 32, the marking light 300 may be irradiated at the timing when the detection target 210 is irradiated with the signal light, and the dummy light 303 may be irradiated at other timings.

  FIG. 35 irradiates strip-shaped light toward the ground from a light irradiation device 800 installed on the ceiling or the like. The light irradiation device 800 scans the band-shaped light from the position C to the position C ′. Then, the light irradiation device 800 irradiates the detection target 210 with the marking light 300 at the timing of scanning the detection target 210. At this time, the dummy light 303 is projected onto a target other than the detection target 210 that passes between C and C ′. Irradiation apparatus 800 may scan so as to reciprocate the band-shaped light between position C and position C ′.

  Then, the control device 140 notifies the shutter glasses 600 of timing for irradiating the detection light 210 with the marking light 300. The shutter glasses 600 open the shutter 65 at the timing when the marking light 300 is irradiated on the detection target 210.

  FIG. 36 is a conceptual diagram of the band-shaped light irradiated from the light irradiation device 800 viewed from an angle different from that in FIG. In the example of FIG. 36, the imaging device 120 images a person who passes band-like light, and the control device 140 detects the face and position of the person on the captured image.

  When the person is at position A, if the light irradiation device 800 emits light, the dummy light 303 is projected on the face of the person. Therefore, the light irradiation apparatus 800 stops the light irradiation when the light is irradiated to the position of the face of the person. The light irradiation apparatus 800 irradiates light near the shoulder when the person is at position B, near the waist when the person is at position C, and near the knee when the person is at position D. That is, the light irradiation device 800 irradiates light while avoiding a human face.

  FIG. 37 shows an example in which a person other than the detection target 210 among persons passing between C and C ′ is irradiated with belt-shaped light from the light irradiation means 800.

  At the timing when the shutter glasses 600 are closed, the light irradiation device 800 irradiates a person other than the detection target 210 with band-shaped light as shown on the left side of FIG. At this time, the dummy light 303 is projected to the person irradiated with the band-like light. On the other hand, the light irradiation apparatus 800 does not irradiate the detection target 210 with band-shaped light. Then, the light irradiation device 800 irradiates the detection light 210 with the marking light 300 as shown on the right side of FIG.

  Since the detector wearing the shutter glasses 600 can visually recognize the marking light 300 at the timing when the shutter glasses 600 are opened, the detection target 210 can be detected without being known to the surroundings.

  FIG. 38 shows an example in which the band-shaped light is irradiated from the light irradiation means 800 to all persons passing between C-C ′.

  At the timing when the shutter glasses 600 are closed, the light irradiation device 800 irradiates all persons who pass between the positions C and C ′ with the band-shaped light as shown on the left side of FIG. At this time, the dummy light 303 is projected to all persons including the detection target 210. Then, the light irradiation device 800 projects the dummy light 304 different from the dummy light 303 onto the detection target 210 as shown on the right side of FIG.

  In addition, the light irradiation device 800 does not irradiate the same dummy light to everyone at the timing of closing the shutter glasses 600, and detects a dummy light (second dummy light) different from the dummy light 303 (first dummy light). Only the object 210 may be irradiated. At this time, when the marking light 300 and the second dummy light are combined, the information input / output system 100 forms an image having a specific meaning. At this time, the detector wearing the shutter glasses 600 can recognize an image having a specific meaning by recognizing an image in which the second dummy light and the marking light 300 are combined. According to the method of FIG. 38, when a specific meaningful image is projected onto the detection target 210, the specific image can be made more difficult to recognize from a third party.

(Sixth embodiment)
FIG. 39 is a block diagram showing a configuration of an information recognition device 60-6 of the target identification system according to the sixth embodiment of the present invention. The target identification system according to the present embodiment has a configuration in which an alarm unit 67 is added to the information recognition device 60 of the target identification system 1 according to the first embodiment.

  When the receiving unit 61 of the information recognition device 60-6 receives the notification signal, the alarm unit 67 notifies the detector that the detection target 210 has been detected. For example, the alarm means 67 notifies the detector that the detection target 210 has been detected by sound, vibration, smell, heat, physical stimulation, or the like. Note that the alarm means 67 may notify the detector that the detection target 210 has been detected by light that is visible only to the detector. However, when notifying the detection person that the detection object 210 has been detected, information other than the information given here may be used.

  According to the target identification system according to the present embodiment, it is possible to notify the detection person as an alarm that information about the detection target has been detected with information other than the visual information, so that the detection person can easily grasp the detection target more reliably.

(Hardware configuration)
Next, a hardware configuration for enabling the target identification system according to each embodiment of the present invention will be described using the computer 90 of FIG. 40 as an example. Note that the computer 90 in FIG. 40 is a configuration example for enabling the information input / output device according to each embodiment, and does not limit the scope of the present invention. Further, the information input / output device according to each embodiment is preferably a microcomputer having the function of the computer 90 of FIG. 40 in the case of the form of the interface device 100 as shown in FIG.

  As shown in FIG. 40, the computer 90 includes a processor 91, a main storage device 92, an auxiliary storage device 93, an input / output interface 95, and a communication interface 96. The processor 91, the main storage device 92, the auxiliary storage device 93, the input / output interface 95, and the communication interface 96 are connected to each other via a bus 99 so as to exchange data. The processor 91, the main storage device 92, the auxiliary storage device 93, and the input / output interface 95 are connected to a network such as the Internet or an intranet via a communication interface 96. The computer 90 is connected to a server or computer of a higher system via a network, and receives information related to the projection image from the higher system.

  The processor 91 expands the program stored in the auxiliary storage device 93 or the like in the main storage device 92, and executes the expanded program. In the present embodiment, a configuration using a software program installed in the computer 90 may be adopted. The processor 91 executes arithmetic processing and control processing of the information input / output device according to the present embodiment.

  The main storage device 92 has an area where the program is expanded. The main storage device 92 may be a volatile memory such as a DRAM (Dynamic Random Access Memory). In addition, a nonvolatile memory such as an MRAM (Magnetic Resistive Random Access Memory) may be configured and added as the main storage device 92.

  The auxiliary storage device 93 is means for storing data such as the phase distribution of the projected image. The auxiliary storage device 93 is configured by a local disk such as a hard disk or a flash memory. The phase distribution of the projected image can be stored in the main storage device 92, and the auxiliary storage device 93 can be omitted.

  The input / output interface 95 is a device that connects the computer 90 and peripheral devices based on a connection standard between the computer 90 and peripheral devices. The communication interface 96 is an interface for connecting to a network such as the Internet or an intranet based on standards and specifications. In FIG. 40, the interface is abbreviated as I / F (Interface). The input / output interface 95 and the communication interface 96 may be shared as an interface connected to an external device.

  You may comprise the computer 90 so that input devices, such as a keyboard, a mouse | mouth, and a touch panel, can be connected as needed. These input devices are used for inputting information and settings. Note that when the touch panel is used as an input device, the display unit of the display device may serve as the input unit of the input device. Data exchange between the processor 91 and the input device may be mediated by the input interface 95.

  The communication interface 96 is connected to a host system such as another computer or server through a network. The host system transmits the phase distribution of the basic image used in each embodiment of the present invention to the computer 90 via the communication interface 96. The host system transmits information related to the projection image used in each embodiment of the present invention to the computer 90 via the communication interface 96. The host system may generate the phase distribution of the projection image used in each embodiment of the present invention by itself or may acquire it from another device.

  The computer 90 may be provided with a display device for displaying various information. When the display device is provided, the computer 90 is preferably provided with a display control device (not shown) for controlling the display of the display device. The display device may be connected to the computer 90 via the input interface 95.

  The computer 90 may be provided with a reader / writer as necessary. The reader / writer is connected to the bus 99 and reads a data program from the recording medium and writes a processing result of the computer 90 to the recording medium between the processor 91 and a recording medium (program recording medium) (not shown). Mediate. The recording medium can be realized by a semiconductor recording medium such as an SD (Secure Digital) card or a USB (Universal Serial Bus) memory, for example. Further, the recording medium 516 may be realized by a magnetic recording medium such as a flexible disk, an optical recording medium such as a CD (Compact Disc) and a DVD (Digital Versatile Disc), and other recording media.

  The above is an example of the hardware configuration for enabling the target identification system according to each embodiment of the present invention. Note that the hardware configuration in FIG. 40 is an example of a hardware configuration for enabling the information input / output device according to each embodiment, and does not limit the scope of the present invention. A processing program for causing a computer to execute processing by the information input / output device according to each embodiment is also included in the scope of the present invention. Furthermore, a program recording medium recording the processing program according to each embodiment is also included in the scope of the present invention.

  In each of the embodiments of the present invention described above, the description has been made on the assumption that a police officer or a guard who is a detective criminalizes a criminal who is a detection target. The method of each embodiment can be applied to other cases. Note that the following scene is an example, and does not limit the scope of the present invention.

  For example, when a detection target suspected of fraud enters a gaming facility such as a pachinko parlor, casino, or game center, the security guard or the store clerk who marks the detection may mark this detection target. The method of the embodiment can be applied. For example, in a store such as a department store or a showroom, when a customer who has a history of damaging a product in the store or having behaved suspiciously has visited the store, the store clerk who is the detector detects the customer as a detection target. The method of this embodiment can also be applied to a scene to be marked. For example, in a public facility such as a park or open space, when a visitor with a history of nuisance or suspicious behavior has visited in the past, the administrator of the public facility that is the detector The method of this embodiment can also be applied to a scene where a visitor is marked as a detection target. In addition, the technique of each embodiment of the present invention can be applied even when an animal or an object is a detection target.

  This application claims the priority on the basis of Japanese application Japanese Patent Application No. 2015-085658 for which it applied on April 20, 2015, and takes in those the indications of all here.

DESCRIPTION OF SYMBOLS 1 Target identification system 10 Information input / output device 20 Imaging means 21 Imaging element 23 Image processor 24 Internal memory 25 Photometric sensor 26 Data output part 30 Projection means 31 Light source 32 Light source drive part 35 Phase modulation element 36 Phase modulation element control part 38 Projection Unit 40 control unit 41 imaging control unit 42 irradiation condition setting unit 43 processing unit 44 storage unit 45 projection control unit 46 communication unit 50 target specifying unit 51 database 52 image acquisition unit 53 image analysis unit 54 collation unit 55 collation result output unit 60 information Recognizing device 61 Receiving means 62 Opening / closing timing setting means 63 Opening / closing control means 64 Shutter driving means 65 Shutter 80 Illuminating device 81 Illuminating means 90 Computer 91 Processor 92 Main storage device 93 Auxiliary storage device 95 I / O interface 96 Communication interface Esu 99 bus 100 interface device 110 information output system 120 imaging device 140 controller 800 light radiation device

Claims (18)

An imaging unit that captures an image of the detection area to generate image data, and that measures the brightness of the detection area to generate photometric data, and outputs the image data and the photometric data;
Including a database for storing the feature data to be detected, extracting the feature data from the input image data, and comparing the feature data extracted from the image data with the feature data stored in the database In addition, when the position coordinate related to the detection position of the detection target is extracted, and the detection target is detected, target identification means for outputting a notification signal including a matching result and the position coordinate regarding the detection target;
The control unit controls the imaging unit to image the detection area, sets control conditions for signal light to be irradiated on the detection target based on the input photometric data and the notification signal, and sets the signal based on the control conditions. Control means for performing control to emit light;
An information input / output device having projection means for irradiating the signal light toward the detection target according to the control of the control means;
Information that includes a shutter that controls an incident amount of light reaching a detector that detects the detection target, sets the opening / closing condition of the shutter based on the control condition, and controls the opening / closing of the shutter according to the notification signal A target identification system comprising a recognition device. The object specifying means includes
An image analysis unit that outputs position coordinates on the image data of the detection target corresponding to the feature data extracted from the image data in association with the extracted feature data;
The feature data output by the image analysis unit and the feature data stored in the database are collated, and when the detection target is detected, information indicating that the detection target is detected; A collation unit that outputs position coordinates corresponding to the detection target;
The target identification system according to claim 1, further comprising: a collation result output unit that outputs the notification signal including information indicating that the detection target is detected and position coordinates corresponding to the detection target. The control means includes
Based on the illuminance of the detection area included in the photometric data, a pulse condition including a condition related to a pulse width and a repetition period of the signal light emitted by the projection unit, and an output condition including a condition related to the output of the signal light, An irradiation condition setting unit for setting irradiation conditions including:
With the notification signal and the irradiation condition as inputs, based on the position coordinates of the detection target included in the notification signal, the irradiation direction condition of the signal light to be irradiated to the detection target is calculated, and the irradiation direction condition and the The target specifying system according to claim 2, further comprising: a processing unit that sets a condition including an irradiation condition as the control condition. The information recognition device includes:
Receiving means for receiving the control condition;
Based on the control condition, a condition for relatively improving the contrast of the pulsed signal light irradiated to the detection target with respect to the background light passing through the shutter light is calculated, and the calculated condition and the An opening / closing timing setting means for setting an opening / closing condition of the shutter based on a pulse condition;
An opening / closing control means for performing opening / closing control of the shutter;
The object specifying system according to claim 3, further comprising: a shutter driving unit that drives the shutter according to the opening / closing control of the shutter. The opening / closing timing setting means includes
The target specifying system according to claim 4, wherein the shutter is opened in accordance with a timing at which the detection target is irradiated with the signal light. The information recognition device includes:
The target specifying system according to claim 4, further comprising a frame for disposing the shutter in front of at least one eye of the detector. The information recognition device includes:
The object specifying system according to any one of claims 1 to 6, further comprising photometric means for measuring the brightness of the detection area through the shutter. The object specifying means includes
The object specifying system according to any one of claims 1 to 7, configured on a server connected to the information input / output device and the information recognition device through a network.   The object specifying system according to claim 4, further comprising an illumination unit that illuminates the detection area. The illumination means includes
The target specifying system according to claim 9, wherein specific light is irradiated to a target included in the detection region in accordance with control of the control unit. The control means includes
When the target included in the detection region passes through a specific point, the illumination unit is controlled to scan and irradiate the specific light to the target included in the detection region,
The target specifying system according to claim 10, wherein when the detection target passes through the specific point, the projection unit is controlled to irradiate the detection target with the signal light. The control means includes
The target identification system according to claim 11, wherein the irradiation condition is set so that the signal light is emitted from the projection unit at a timing when the illumination unit does not irradiate the specific light. The control means includes
The target specifying system according to claim 11, wherein the irradiation condition is set such that an output of the signal light emitted from the projection unit is higher than an output of the specific light emitted from the illumination unit. The control means includes
The specific light is emitted from the illuminating unit at a different timing for each target included in the detection region, and the signal light is emitted from the projection unit at a timing at which the illuminating unit does not irradiate the specific light. The object specifying system according to claim 11, wherein the irradiation condition is set as follows. The information recognition device includes:
The target specifying system according to claim 1, further comprising an alarm unit that notifies that the detection target is detected when the notification signal is received. The projection means includes
A light source that emits the pulsed signal light of a specific wavelength;
A light source driving unit that drives the light source in accordance with the control of the control means;
A phase modulation element having a display surface on which the signal light emitted from the light source is incident, and displaying a phase distribution of a predetermined image projected on the detection target on the display surface;
A phase modulation element controller that displays a phase distribution of the predetermined image on a display surface of the phase modulation element;
The target specifying system according to claim 1, further comprising: a projection unit that projects the signal light emitted from the display surface of the phase modulation element onto a detection target. The detection area is imaged to generate image data, and the brightness of the detection area is measured to generate photometric data,
Feature data is extracted on the image data, and the feature data extracted on the image data is collated with feature data stored in a database storing the feature data of the detection target, and the detection target When the position coordinates related to the detection position are extracted and the detection target is detected, a notification signal including a collation result related to the detection target and the position coordinates is generated,
Based on the photometric data and the notification signal, a control condition for signal light to be emitted to the detection target is set, control is performed to emit the signal light based on the control condition, and the signal light is directed toward the detection target. And
An object specifying method for setting an opening / closing condition of a shutter for controlling an incident amount of light reaching a detector for detecting the detection object based on the control condition, and controlling the opening / closing of the shutter according to the notification signal. A process for capturing the detection area and generating image data, and measuring the brightness of the detection area to generate photometric data;
Feature data is extracted on the image data, and the feature data extracted on the image data is collated with feature data stored in a database storing the feature data of the detection target, and the detection target A process of extracting a position coordinate related to a detection position and generating a notification signal including the collation result related to the detection target and the position coordinate when the detection target is detected;
Based on the photometric data and the notification signal, a control condition for signal light to be emitted to the detection target is set, control is performed to emit the signal light based on the control condition, and the signal light is directed toward the detection target. The process of emitting
Based on the control condition, an opening / closing condition for a shutter that controls the amount of incident light reaching the detector that detects the detection target is set, and the computer executes a process for controlling the opening / closing of the shutter according to the notification signal. A program recording medium for recording a target specific program.

Images