CN105361851A - Sight line detection device - Google Patents

Sight line detection device Download PDF

Info

Publication number
CN105361851A
CN105361851A CN201510261387.0A CN201510261387A CN105361851A CN 105361851 A CN105361851 A CN 105361851A CN 201510261387 A CN201510261387 A CN 201510261387A CN 105361851 A CN105361851 A CN 105361851A
Authority
CN
China
Prior art keywords
light
light source
video camera
sight line
transparent member
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510261387.0A
Other languages
Chinese (zh)
Inventor
安田勇一
河内隆宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alps Alpine Co Ltd
Original Assignee
Alps Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alps Electric Co Ltd filed Critical Alps Electric Co Ltd
Publication of CN105361851A publication Critical patent/CN105361851A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides a sight line detection device. A light transmitting part before a light source and a camera is thin, and the strength can be guaranteed. An illuminating camera part (20) comprises a camera (21) and a light source (22). A front part (30), which is covered on the illuminating camera part (20), is formed by tightly connected a light transmitting part (31) and a light shielding part (35) through a bicolor moulding technology. So the strength can be guaranteed, even the thickness (t) of the covered part (32) in the front of light transmitting part (31) is less than 2 mm in front of the camera hole (23). By configuring a thin front covered part (32), the light emitted by the light source (22) will only propagate in the front covered part (32), and will not be emitted to the camera (21); and thus the phenomenon that the light is directly provided to the camera (21) is prevented.

Description

Sight line detector
Technical field
The sight line detector of the direction of visual lines of the object beyond the driver that the present invention relates to inspection vehicle.
Background technology
The method for viewing points detecting recorded in patent documentation 1,2 video cameras are towards the eyes of object.Around each video camera, be configured with to concentric circles 2 kinds of light sources, be configured with the light source of the light sending centre wavelength and 850nm along the circle apart from the near inner side of video camera, the circle along outside is configured with and sends the light source that centre wavelength is the light of 950nm.By irradiating the light of 850nm, bright pupil image can be obtained by video camera, obtaining dark pupil image by the light irradiating 950nm.
In this method for viewing points detecting, the difference image based on bright pupil image and dark pupil image obtains pupil image, and obtains the corneal reflex point of light source from dark pupil image.Based on pupil image and corneal reflex point, calculate vector from the corneal reflex point of the object the plane vertical with the datum line of pupil with being connected video camera to pupil, based on this vector and the sight line of the function that use specifies comes calculating object person relative to the direction of the datum line of each video camera.
Patent documentation 1: International Publication No. 2012/020760 publication
The method for viewing points detecting recorded in patent documentation 1,2 kinds of light sources are configured with around video camera, but when making video camera and 2 kinds of light sources spatially expose and configure, outward appearance as device is not preferred, preferably, the cover plate of the light conductivity jointly covered in the front of video camera and the front of light source is set.
But, need video camera and light source close to and configure, the centre wavelength especially sent for bright pupil image is that the light source of the light of 850nm needs with the optical axis of video camera close to configuring.With identical cover plate by when covering close to the video camera of configuration and the front of light source, there are the following problems: the light sent from light source is at the internal communication of cover plate, and a part for this light is easily caught on camera machine testing from cover plate outgoing.
Especially, when the gauge of described cover plate is larger, the light propagated in cover plate is easily incident to the inner face of cover plate with little angle of incidence (subvertical angle of incidence), and therefore a part for light externally sends and light is easily incident to video camera after the inner face transmission of cover plate.Therefore, preferably, the cover plate covering the front of light source and the front of video camera is formed thinner, when its gauge is set to below 2mm, the internal communication of cover plate light not easily in cover plate towards camera direction outgoing.
But thickness is that the intensity of the cover plate of below 2mm is very low, be difficult to cover video camera and the front both light source, and to form can be difficult by the cover plate of 2 video cameras and the wide area all covered close to light source configure with each video camera.
Summary of the invention
The present invention solves problem in the past, and object is to provide a kind of sight line detector, can form the light transparent member both video camera and light source jointly covered compared with unfertile land, at the light of the internal communication of light transparent member not easily towards video camera outgoing.
Sight line detector of the present invention, has: video camera, obtains the image in the region at least comprising eyes; And multiple light source, eyes to object provide detection light, the feature of described sight line detector is, the front of the front of described video camera and described light source is provided with forepiece, described forepiece is that light-blocking member and light transparent member are touched and molding each other, at described curtain-shaped cover member, be formed with the camera hole opposed with described video camera and the irradiation hole opposed with described light source, described light transparent member is formed continuously in the mode in the front covering described camera hole and described both irradiation holes.
Sight line detector of the present invention, by arranging the light transparent member covered continuously in the front of video camera and the front of light source, video camera and light source can not directly expose, and outward appearance can be made good.In addition, light transparent member and curtain-shaped cover member touch and arrange, and are strengthened by curtain-shaped cover member, so light transparent member can be configured to thin plate, when the internal communication of the light from light source in light transparent member, light can be reduced and escape to the video camera configured close to light source.
Preferably, in the present invention, the illumination image pickup part with described video camera and described light source is provided with two groups separated from one anotherly, and described light transparent member is formed as the described camera hole of the image pickup part that throws light on described in 2 groups and the front in described both irradiation holes to cover continuously.
2 groups illumination camera part from and configuration sight line detector in, employing 2 groups illumination whole video camera of image pickup part and the front of whole light sources cover by common light transparent member structure time, the outward appearance of the entirety of sight line detector becomes good.
Preferably, in the present invention, the front surface towards object of described light transparent member is tabular surface.
Preferably, in sight line detector of the present invention, described light transparent member has visible ray shielding function.
After visible ray cuts off by light transparent member, during from the forward observation of sight line detector, naked eyes can not observe video camera and light source, time in the car being configured at automobile, only can see light transparent member, and therefore outward appearance is good, does not also have incongruity even if be configured in car.
Preferably, in the present invention, the thickness of the described light transparent member covered in the front of described camera hole is below 2mm.
By the gauge of light transparent member is set as below described size, at the light of the internal communication of light transparent member not easily towards video camera outgoing.
Preferably, in the present invention, described light-blocking member and described light transparent member are all formed by synthetic resin material, and 2 parts are touched by two color molding procedure.
Or preferably, in the present invention, described light-blocking member is formed by metal, and described light transparent member is formed by synthetic resin material, 2 parts are molding by insert operation and are touched.
Invention effect
In the present invention, the front of video camera and light source is covered, so outward appearance becomes good, especially when light transparent member has visible ray cutting function by common light transparent member, video camera and light source cannot be observed visually, even if also there is no incongruity in the car being configured in automobile from front.
In addition, light transparent member is strengthened by light-blocking member, therefore, it is possible to the light transparent member opposed with the front of video camera is formed thinner, the probability that the light after the internal communication of light transparent member penetrates to camera direction can be reduced in, the situation of light source can be detected by restricted passage video camera.
Accompanying drawing explanation
Fig. 1 is the front view of the major part of the sight line detector representing embodiments of the present invention from front.
Fig. 2 is the solid of the major part of observing sight line detector from rear.
Fig. 3 represents the structure of sight line detector, and is the sectional view cut off by Fig. 1 with III-III line.
Fig. 4 is an amplification view part of Fig. 3 amplified.
Fig. 5 is the amplification view identical with Fig. 4 representing variation.
Fig. 6 is the amplification view identical with Fig. 4 representing variation.
Fig. 7 is the circuit block diagram of described sight line detector.
Fig. 8 is the key diagram represented towards the position relationship with sight line detector of the sight line of eyes to people.
Fig. 9 be for calculate according to the center of pupil center and corneal reflex light sight line towards key diagram.
Figure 10 is the front view of the sight line detector representing the second embodiment.
Symbol description
1: sight line detector
10,20: illumination image pickup part
11,21: video camera
12,22: light source (the first light source)
17,27: secondary light source
13,23: camera hole
14,24: irradiation hole
30: forepiece
31: light transparent member
32: anterior coating portion
32a: anterior face
32b: posterior face
35: light-blocking member
48: light source control portion
49: image acquiring section
50: pupil image test section
51: bright pupil image test section
52: dark pupil image test section
53: pupil center's calculating section
54: corneal reflex light center test section
55: direction of visual lines calculating section
40: eyes
42: pupil
45: the pip of cornea
O1, O2: optical axis
Detailed description of the invention
(formation of sight line detector)
As shown in the block diagram of fig. 7, the sight line detector 1 of embodiments of the present invention is made up of a pair illumination image pickup part 10,20 and calculation control unit CC.
As depicted in figs. 1 and 2, common forepiece 30 is arranged opposedly with illumination image pickup part 10 and the image pickup part 20 that throws light on.Illumination image pickup part 10 and the center standoff distance W of illumination image pickup part 20 and configure, but such as this distance W is set to and the interval of the eyes of people is consistent.
A pair light source 12,12 that illumination image pickup part 10 has video camera 11 and configures close to the both sides of video camera 11, a pair light source 22,22 that illumination image pickup part 20 has video camera 21 and configures close to the both sides of video camera 21.The optical axis (optical axis of video camera 11) of illumination image pickup part 10 is O1, and the optical axis (optical axis of video camera 21) of illumination image pickup part 20 is O2.The luminous optical axis of light source 12,12 is positioned at apart from the near position of optical axis O1, and the luminous optical axis of light source 22,22 is positioned at apart from the near position of optical axis O1.
Sight line detector 1 is arranged on the instrument board of automobile, the top etc. of windshield, and the optical axis O1 of illumination the image pickup part 10 and optical axis O2 of illumination image pickup part 20 is set near the eyes 40 of object.
Video camera (shooting part) 11,21 is made up of imaging apparatus and lens etc.Imaging apparatus is made up of CMOS (complementary metal film semiconductor), CCD (charge coupled cell) etc.Obtained the face image of the eyes comprising driver via lens by imaging apparatus.In imaging apparatus, detect light by multiple pixels of two-dimensional arrangements.
The luminous source of light source 12 is LED (light emitting diodes), sends wavelength 850nm or detects light with infrared light (near infrared light) conduct of its approximate wavelength.
Fig. 8 schematically represent the sight line of the eyes 40 of a side of object towards with illumination image pickup part 10 relation.Fig. 9 be for calculate according to the center of pupil center and corneal reflex light sight line towards key diagram.In (A) of Fig. 8 and (A) of Fig. 9, almost towards front, in (B) of Fig. 8 and (B) of Fig. 9, direction of visual lines VL is inclined left direction slightly towards sight line detector 1 for the direction of visual lines VL of object.
Eyes 40 have cornea 41 in front, and pupil 42 and crystalline lens 43 are positioned at the rear of cornea 41.And retina 44 is present in rearmost part.
The infrared light (near infrared light) of 850nm or wavelength approximate with it, not easily by intraocular moisture absorption, easily arrives the retina 44 being positioned at the inboard of eyeball always, and therefore this light is become many at retina 44 by the light quantity reflected.For this reason, when the light source 12,12 of the image pickup part 10 that throws light on is lighted, in the image obtained by the video camera 11 arranged close to light source 12,12, the infrared light after being reflected by retina 44 is detected after pupil 42, and pupil 42 seems bright.This image is bright pupil image.
When described light source 12,12 is lighted, after obtaining image by the video camera 21 of the illumination image pickup part 20 of the opposing party, video camera 11 now, away from light source 12,12, even if therefore be have passed pupil 42 by the light after retina 44 reflects, is also not easily detected by the video camera 21 being positioned at diagonally forward.For this reason, the image obtained by video camera 21 is compared with stated clearly pupil image, and pupil 42 is dimmed, and this image becomes dark pupil image.
Otherwise when light source 22,22 light yellows of the image pickup part 20 that throws light on, the image obtained by video camera 21 becomes bright pupil image, and the image obtained by video camera 11 becomes dark pupil image.
As depicted in figs. 1 and 2, forepiece 30 is made up of light transparent member 31 and light-blocking member 35.Light transparent member 31 and light-blocking member 35 are touched and molding each other by so-called two color molding procedure.That is, synthetic resin Material injection is molded light-blocking member 35 to mould, then, under the state that this light-blocking member 35 is arranged at the inside of other mould, in mould, inject synthetic resin and mold light transparent member 31.
Light transparent member 31 is visible ray cut-off filters, has and makes the near infrared ray centered by wavelength 850nm and ultrared wavelength region but the function cut off by visible ray.Light transparent member 31 is such as mixed into the filler of absorption visible ray and forms in transparent propylene.Therefore, light transparent member 31 is opaque when perusal.
Light-blocking member 35 is non-light transmittance relative to the near infrared light of the wave band of wavelengths centered 850nm and ultrared wave band, is also non-light transmittance relative to visible ray.Light-blocking member 35 such as by being mixed into various filler, pigment and being formed in resin material.
As depicted in figs. 1 and 2, light-blocking member 35 is OBL plate shapes.Forming the part of illumination image pickup part 10, light-blocking member 35 is having camera hole 13 and is positioned at the irradiation hole 14,14 of camera hole 13 both sides.At the back side of light-blocking member 35, be formed with from shading wall 15,15 with the intermediate riser in irradiation hole 14,14 of camera hole 13.The video camera 11 forming illumination image pickup part 10 is opposed with camera hole 13 from the back of light-blocking member 35, light source 12,12 from the back of light-blocking member 35 and irradiation hole 14,14 opposed.
Forming the part of illumination image pickup part 20, there is camera hole 23 at light-blocking member 35 opening and being positioned at the irradiation hole 24,24 of camera hole 23 both sides.At the back side of light-blocking member 35, be formed with from shading wall 25,25 with the intermediate riser in irradiation hole 24,24 of camera hole 23.The video camera 21 forming illumination image pickup part 20 is opposed with camera hole 23 from the back of light-blocking member 35, light source 22,22 from the back of light-blocking member 35 and irradiation hole 24,24 opposed.
As shown in Figure 2, at the both ends of the length direction of light-blocking member 35, be formed with the bracket 36,36 outstanding to direction, back.
In light transparent member 31, as shown in Figure 3, be formed with the front portion of touching with the front surface of light-blocking member 35 and be coated to portion 32, and as shown in Figure 2, the left and right sides wall portion 33b, the 33b that are formed with the upper and lower sides wall portion 33a, the 33a that rearward extend continuously from front portion is coated to the rising wood in portion 32 and lower edge and rearward extend continuously from front portion is coated to the left border portion in portion 32 and right border portion.
As shown in Figure 3, the front portion of light transparent member 31 is coated to portion 32 and is formed as continuously the whole region of the front surface of forepiece 30 one to be covered with uniform gauge t.Namely, anterior coating portion 32 is formed as continuously, cover camera hole 13 and the irradiation hole 14,14 of illumination image pickup part 10, and cover camera hole 23 and the irradiation hole 24,24 of irradiation image pickup part 20, and also cover the mid portion of illumination image pickup part 10 and illumination image pickup part 20.Further, the forward surface 32a in anterior coating portion 32 is tabular surfaces.
When from forward observation sight line detector 1, the whole region that the rectangular whole region shown in Fig. 1 presents anterior coating portion 32, this anterior face 32a is tabular surface.Light transparent member 31 not visible light transmissive, so when observing from front, light-blocking member 35 and video camera 21,22 and light source 12,22 are coated to portion 32 by front portion and block and can not see by naked eyes.Therefore, when sight line detector 1 being arranged on the front etc. of driver's seat of indoor of automobile, video camera, light source etc. can not enter in the visual field of driver, therefore can not bring incongruity to driver.
Light transparent member 31 and light-blocking member 35 are formed by two color molding procedure contiguity, though the gauge t therefore front portion being coated to portion 32 comparatively unfertile land be set to below 2mm, owing to being undertaken strengthening therefore, it is possible to fully guarantee intensity by light-blocking member 35.In addition, even if the gauge t front portion that the front in the front of camera hole 13,23 and irradiation hole 14,24 covers being coated to portion 32 is the thinner gauge of below 2mm, also can not deform, warpage etc.
Fig. 4 is the amplification view comprising video camera 21 set by irradiation image pickup part 20 and light source 22.
As shown in Figure 4, the detection light L1 sent from light source 22, from the irradiation hole 24 forwards outgoing of light-blocking member 35, is irradiated to the face area comprising object eyes after the front portion of transmission near infrared light is coated to portion 32 transmission.Behind the coating portion 32, reflected light L2 transmission front portion of the wavelength 850nm after face's reflection, camera 21 being shot detects.
The coating portion 32, light component transmission front portion of the part of the detection light L1 sent from light source 22, but the remaining light component detecting light L1 enters into the inside in anterior coating portion 32 and propagates therein.Be coated to the inside in portion 32 in front portion, detect light L1 and be coated to the intralaminar part being coated to portion 32 while that the boundary face of portion 32 and extraneous air and anterior face 32a and posterior face 32b being reflected in front portion in front portion and advance.As shown in Figure 4, cover camera hole 23 and the thin parts of the front portion opposed with the front of video camera 21 is coated to portion 32 to be gauge t be below 2mm time, the incident angle of the light posteriorly surperficial 32b incidence of propagating at intralaminar part easily becomes (angle of posterior face 32b and incident ray easily shoals) greatly, is coated to the light of the internal communication in portion 32 not easily from posterior face 32b to video camera 21 outgoing in front portion.
Therefore, from close to video camera 21 configuration light source 22 detection light L1 not easily camera 21 being shot detect, can prevent the image obtained by video camera 21 from becoming overexposure state.
In addition, at the back (rear portion) of forepiece 30, between video camera 21 and light source 22, shading wall 25 is provided with, so light from light source 22 can also be prevented from the back space of forepiece 30 directly to video camera 21.
Forepiece 30 is manufactured by two color molding procedure, thus the gauge t that the front portion opposed with the front of video camera 21 can be coated to portion 32 is thinner, even if the detection light L1 from light source 22 enters in anterior coating portion 32, also can limit this light and arrive video camera 21, therefore, it is possible to make light source 22 configure close to video camera 21 as far as possible.By making light source 22 close to video camera 21, thus easily detected by video camera 21 and to send from light source 22 and to be reflected at the retina 44 of eyes 40 and reflected light L2 after pupil 42 passes through, the bright pupil image that the brightness of pupil is high can be obtained.
In addition, this advantage has too in the illumination image pickup part 10 of the opposing party.
Calculation control unit CC shown in Fig. 7 is made up of the CPU of computer, memorizer, in each piece, carries out computing by performing preassembled software.
At calculation control unit CC, be provided with light source control portion 48, image acquiring section 49, pupil image test section 50, pupil center's calculating section 53, corneal reflex light center test section 54 and direction of visual lines calculating section 55.
Next, the detection action of sight line detector 1 is described.
The light source control portion 48 being arranged at calculation control unit CC carries out the switching of luminescence of light source 12,22 and the control etc. of the fluorescent lifetime of light source 12,22 that are arranged at illumination image pickup part 10,20.
Image acquiring section 49 obtains by every frame the face image photographed in three-dimensional mode from two video cameras 11,21.Be read in pupil image test section 50 by every frame by the image acquired by image acquiring section 49.Pupil image test section 50 has the function of bright pupil image test section 51 and dark pupil image test section 52.
In the sight line detector 1 shown in Fig. 1 and Fig. 2, when the light source 12,12 of the image pickup part 10 that throws light on has been lighted, obtain bright pupil image by the video camera 11 of the image pickup part 10 that throws light on, obtained dark pupil image by the video camera 21 of the image pickup part 20 that throws light on.Next, the light source 22,22 of illumination image pickup part 20 is lighted, and now, obtains bright pupil image by the video camera 21 of the image pickup part 20 that throws light on, obtains dark pupil image by the video camera 11 of the image pickup part 10 that throws light on.Bright pupil image is detected by bright pupil image test section 51, and dark pupil image is detected by dark pupil image test section 52.
In pupil image test section 50, obtain the difference of bright pupil image and the dark pupil image detected by dark pupil image test section 52 detected by bright pupil image test section 51, the shape generating pupil 42 becomes bright pupil image signal.This pupil image signal is provided to pupil center's calculating section 53.In pupil center's calculating section 53, by detecting the Luminance Distribution etc. of pupil image, calculate the center of pupil 42.
In addition, the dark pupil image signal detected by dark pupil image test section 52 is provided to corneal reflex light center test section 54.Dark pupil image signal comprises the luminance signal of local from the reflected light after pip 45 reflection of cornea 41.Reflected light from the pip 45 of cornea 41 is the light that imaging goes out Pu Kenye picture, as shown in Figure 9, in the imaging apparatus of video camera 11, obtains the dot pattern picture of very little area.At corneal reflex light center test section 54, image procossing is carried out to dot pattern picture, and according to its luminance part etc., obtain the center of the reflection light point image from cornea 41.
The pupil center calculated by pupil center's calculating section 53 is calculated value and calculates value by the corneal reflex light center that corneal reflex light center test section 54 calculates and is provided to direction of visual lines calculating section 55.In direction of visual lines calculating section 55, according to pupil center calculate value and corneal reflex light center calculate value detect sight line towards.
In (A) of Fig. 8, the direction of visual lines VL of the eyes 40 of people is roughly towards front.Now, as shown in (A) of Fig. 9, the center of the pip 45 from cornea 41 is consistent with the center of pupil 42.On the other hand, in (B) of Fig. 8, the direction of visual lines VL of the eyes 40 of people is considerably towards left side.Now, as shown in (B) of Fig. 9, the center of pupil 42 offsets with the generation position, center of the pip 45 from cornea 41.
In direction of visual lines calculating section 55, calculate the air line distance α ((B) of Fig. 9) at the center of the center of pupil 42 and the pip 45 of cornea 41.In addition set the X-Y coordinate of the center of pupil 42 as initial point, calculate the inclination angle beta of line and the X-axis be connected with the center of pip 45 at the center of pupil 42.Calculate described air line distance α and described inclination angle beta based on by the image acquired by 2 video cameras 11,21, thus calculate direction of visual lines VL.
Fig. 5 and Fig. 6 represents the variation of the sight line detector 1 of described embodiment.
In the variation shown in Fig. 5, in the light transparent member 35 forming forepiece 30, the gauge local in anterior coating portion 32 is different.In the front of video camera 21, the gauge t blocking the part of camera hole 23 in anterior coating portion 32 is set as below 2mm, is coated to the light of the internal communication in portion 32 not easily to video camera 21 outgoing in this part in front portion.On the other hand, in the front of light source 22, the gauge T blocking the part 32c in irradiation hole 24 in anterior coating portion 32 is larger than described gauge t.Make in the front of light source 22 the gauge T of the part 32c in anterior coating portion 32 larger, thus the intensity of part 32c can be improved.In addition, at the part 32c being formed thick, various optical function can be played, such as, can form the diffraction grid etc. that the light quantity distribution for making from the light of light source 22 changes.
In the variation shown in Fig. 6, the gauge t blocking the part of camera hole 23 in anterior coating portion 32 is set as below 2mm, but is blocking the part in irradiation hole 24, is coated to portion 32 is formed with lens 32d in front portion.By these lens 32d, be set as the light moderately dispersed towards the face of object from the detection light L1 of light source 22 outgoing or detect light L1 and addition of directivity, to provide more light quantity near the eyes of face.
In addition, as other variation, the light-blocking member 35 of forepiece 30 can not be formed by metal material by synthetic resin material.Such as, form light-blocking member 35 by metallic plate, in so-called insert moulding operation, light-blocking member 35 and plastic light transparent member 31 are touched.Namely the light-blocking member 35 formed by metallic plate is kept in mould, to mold injects synthetic resin material, forms the light transparent member 31 of touching with light-blocking member 35.
In addition, can be separated into the metal parts of electric conductivity and multiplely partly form light-blocking member 35, and be molding by insert and make each metal parts integrated with light transparent member 31.In the case, multiple metal parts can be used as the circuit passband warp to each light source 11,22 supply electric current.
Figure 10 represents the sight line detector 101 of the second embodiment of the present invention.
This sight line detector 101, is provided with video camera 11 at illumination image pickup part 10, is provided with multiple first light source 12, and is configured with multiple secondary light source 17 in the outside of the first light source 12 in the left and right sides of video camera 11.In illumination image pickup part 20, also configure the first light source 22 in the left and right sides of video camera 21, and at the outside of the first light source 22 configuration secondary light source 17,27.
In the front view of Figure 10, video camera 11,21 and light source 12,17,22,27 are illustrated as and can see, but in fact, these anterior whole regions are coated to portion 32 by the front portion with the light transparent member 31 of visible ray cutting function and cover continuously, therefore cannot see video camera 11,21 and light source 12,17,22,27 by naked eyes from front.
First light source 12,17 as described in illustrated in embodiment comprise the LED of the infrared light (near infrared light) sending 850nm or wavelength approximate with it, but secondary light source 17,27 comprises the LED of the infrared light sending wavelength 940nm.The infrared light of 940nm is easily by the intraocular moisture absorption of the eyes of people.Therefore, even if reach the retina 44 being positioned at eyeball inboard, also less by the light quantity reflected.
In the sight line detector 101 shown in Figure 10, when image pickup part 10, first light source 12,12 that throws light on is lighted, obtain bright pupil image by video camera 11, obtain dark pupil image when secondary light source 17,17 is lighted by video camera 11.In addition, in illumination image pickup part 20, the first light source 22,22 is lighted, and obtains bright pupil image by video camera 21, obtains dark pupil image when secondary light source 27,27 is lighted by video camera 21.

Claims (7)

1. a sight line detector, has: video camera, obtains the image in the region at least comprising eyes; And multiple light source, the eyes to object provide detection light, and the feature of described sight line detector is,
The front of the front of described video camera and described light source is provided with forepiece, and described forepiece is that light-blocking member and light transparent member are touched and molding each other,
Be formed with the camera hole opposed with described video camera and the irradiation hole opposed with described light source at described light-blocking member, described light transparent member is formed continuously in the mode in the front covering described camera hole and described both irradiation holes.
2. sight line detector as claimed in claim 1, wherein,
The illumination image pickup part with described video camera and described light source is provided with two groups separated from one anotherly, and described light transparent member is formed as covering continuously to throw light on described in 2 groups described camera hole of image pickup part and the front in described both irradiation holes.
3. sight line detector as claimed in claim 1 or 2, wherein,
The front surface towards object of described light transparent member is tabular surface.
4. sight line detector as claimed in claim 1 or 2, wherein,
Described light transparent member has visible ray shielding function.
5. sight line detector as claimed in claim 1 or 2, wherein,
The thickness of the described light transparent member covered in the front of described camera hole is below 2mm.
6. sight line detector as claimed in claim 1 or 2, wherein,
Described light-blocking member and described light transparent member are all formed by synthetic resin material, and 2 parts are touched by two color molding procedure.
7. sight line detector as claimed in claim 1 or 2, wherein,
Described light-blocking member is formed by metal, and described light transparent member is formed by synthetic resin material, and 2 parts are molding by insert operation and are touched.
CN201510261387.0A 2014-08-29 2015-05-21 Sight line detection device Pending CN105361851A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-176144 2014-08-29
JP2014176144A JP2016049259A (en) 2014-08-29 2014-08-29 Visual axis detecting apparatus

Publications (1)

Publication Number Publication Date
CN105361851A true CN105361851A (en) 2016-03-02

Family

ID=55364847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510261387.0A Pending CN105361851A (en) 2014-08-29 2015-05-21 Sight line detection device

Country Status (2)

Country Link
JP (1) JP2016049259A (en)
CN (1) CN105361851A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109799610A (en) * 2017-11-16 2019-05-24 Aptiv技术有限公司 Eye tracking apparatus
CN111700586A (en) * 2020-07-01 2020-09-25 业成科技(成都)有限公司 Eye movement tracking device and electronic device using same
CN111714081A (en) * 2020-07-08 2020-09-29 岭南师范学院 Optical nondestructive special child detector based on multi-wavelength LED and detection method
CN113631979A (en) * 2019-03-26 2021-11-09 罗伯特·博世有限公司 Optical element and cover sheet having the same

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107389699B (en) * 2017-09-07 2023-10-27 歌尔科技有限公司 Through hole detection device
CN114760907A (en) * 2019-12-10 2022-07-15 索尼集团公司 Eye information detection device and image display apparatus
DE102021102309B3 (en) 2021-02-02 2022-02-17 Ford Global Technologies Llc Monitoring unit for a vehicle interior

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818954A (en) * 1988-07-14 1998-10-06 Atr Communication Systems Research Laboratories Method of detecting eye fixation using image processing
JP2007029712A (en) * 2005-06-23 2007-02-08 Honda Motor Co Ltd Visual axis detecting apparatus
US20070189742A1 (en) * 2006-02-07 2007-08-16 Honda Motor Co., Ltd. Method and apparatus for detecting sight line vector
US20070279590A1 (en) * 2003-12-25 2007-12-06 Yoshinobu Ebisawa Sight-Line Detection Method and Device, and Three-Dimensional View-Point Measurement Device
CN101803928A (en) * 2010-03-05 2010-08-18 北京智安邦科技有限公司 Video-based driver fatigue detection device
US20130107214A1 (en) * 2009-04-01 2013-05-02 Tobii Technology Ab Adaptive Camera And Illuminator Eyetracker
CN103885583A (en) * 2012-12-21 2014-06-25 托比伊科技公司 Device And Method Of Hardware Calibration Of Eye Tracker

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818954A (en) * 1988-07-14 1998-10-06 Atr Communication Systems Research Laboratories Method of detecting eye fixation using image processing
US20070279590A1 (en) * 2003-12-25 2007-12-06 Yoshinobu Ebisawa Sight-Line Detection Method and Device, and Three-Dimensional View-Point Measurement Device
JP2007029712A (en) * 2005-06-23 2007-02-08 Honda Motor Co Ltd Visual axis detecting apparatus
US20070189742A1 (en) * 2006-02-07 2007-08-16 Honda Motor Co., Ltd. Method and apparatus for detecting sight line vector
US20130107214A1 (en) * 2009-04-01 2013-05-02 Tobii Technology Ab Adaptive Camera And Illuminator Eyetracker
CN101803928A (en) * 2010-03-05 2010-08-18 北京智安邦科技有限公司 Video-based driver fatigue detection device
CN103885583A (en) * 2012-12-21 2014-06-25 托比伊科技公司 Device And Method Of Hardware Calibration Of Eye Tracker

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109799610A (en) * 2017-11-16 2019-05-24 Aptiv技术有限公司 Eye tracking apparatus
CN113631979A (en) * 2019-03-26 2021-11-09 罗伯特·博世有限公司 Optical element and cover sheet having the same
CN111700586A (en) * 2020-07-01 2020-09-25 业成科技(成都)有限公司 Eye movement tracking device and electronic device using same
CN111700586B (en) * 2020-07-01 2023-09-29 业成科技(成都)有限公司 Eye movement tracking device and electronic device using same
CN111714081A (en) * 2020-07-08 2020-09-29 岭南师范学院 Optical nondestructive special child detector based on multi-wavelength LED and detection method

Also Published As

Publication number Publication date
JP2016049259A (en) 2016-04-11

Similar Documents

Publication Publication Date Title
CN105361851A (en) Sight line detection device
CN104159786B (en) The standard sources of laser diode
JP5371472B2 (en) Ophthalmic equipment
JP6333238B2 (en) Raindrop detection on glass surface using camera and lighting
JP6246808B2 (en) Raindrop detection on glass surface using camera and lighting
JP6327753B2 (en) Pupil detection light source device, pupil detection device, and pupil detection method
JP2015527847A5 (en)
WO2011052323A1 (en) Fake finger determination device and fake finger determination method
CN108333860A (en) Control method, control device, depth camera and electronic device
CN110326029A (en) The system and method for obtaining the data of characterization three dimensional object
JP6360752B2 (en) Illumination imaging device
KR102370017B1 (en) Investigating method for optical portion embedded in intraoral scanner and system using the same
WO2016031666A1 (en) Line-of-sight detection device
US11179035B2 (en) Real-time removal of IR LED reflections from an image
JP2018054575A (en) Lens appearance inspection device
EP2830303B1 (en) Mouse having scanning function
JP2013533500A (en) Projector, projection surface, projection apparatus provided with data processing system, and operation method of said projection apparatus
CN108462819B (en) Method for operating a light source for a camera, light source, camera
JP2018190213A (en) Face recognition device and sight line detection device
JP6973783B2 (en) Lens appearance inspection device
JPH0658745A (en) Roughness observation device
JP6045071B2 (en) Vehicle display device
KR20150054381A (en) Mouse having scanning function
JP2016049262A (en) Lighting imaging device
WO2019111351A1 (en) Light blocking unit

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160302

WD01 Invention patent application deemed withdrawn after publication