US10137857B1 - Vehicle unlocking systems, devices, and methods - Google Patents
Vehicle unlocking systems, devices, and methods Download PDFInfo
- Publication number
- US10137857B1 US10137857B1 US15/683,375 US201715683375A US10137857B1 US 10137857 B1 US10137857 B1 US 10137857B1 US 201715683375 A US201715683375 A US 201715683375A US 10137857 B1 US10137857 B1 US 10137857B1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- camera
- iris
- keypad
- ultraviolet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/01—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles operating on vehicle systems or fittings, e.g. on doors, seats or windscreens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/23—Means to switch the anti-theft system on or off using manual input of alphanumerical codes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
- B60R25/252—Fingerprint recognition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
- B60R25/255—Eye recognition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/305—Detection related to theft or to other events relevant to anti-theft systems using a camera
-
- E—FIXED CONSTRUCTIONS
- E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
- E05B—LOCKS; ACCESSORIES THEREFOR; HANDCUFFS
- E05B85/00—Details of vehicle locks not provided for in groups E05B77/00 - E05B83/00
- E05B85/10—Handles
- E05B85/14—Handles pivoted about an axis parallel to the wing
- E05B85/16—Handles pivoted about an axis parallel to the wing a longitudinal grip part being pivoted at one end about an axis perpendicular to the longitudinal axis of the grip part
Definitions
- the present disclosure generally relates to vehicle unlocking systems, devices, and methods and, more specifically, using the same camera for both driver identity matching and detecting key presses on an ultraviolet keypad displayed in the vehicle window.
- a typical vehicle may be unlocked with a key.
- the vehicle may be unlocked without a key, if the driver enters a predetermined key code sequence via an input on the vehicle exterior.
- Vehicles may also include one or more settings that are customizable, such as seat position, default operation mode, audio presets, and more. These settings may change based on the identity of the driver.
- An example disclosed vehicle includes an ultraviolet ink keypad coupled to a window, and a camera directed at the window, configured to capture a key press on the ultraviolet keypad and an iris of a person outside the vehicle.
- the vehicle also includes a processor configured to detect the key press and iris.
- the processor is also configured to unlock the vehicle based on the detected key press.
- the processor is further configured to modify a vehicle setting based on a profile corresponding to the detected iris.
- An example disclosed method includes capturing, by a camera of a vehicle, a key press on an ultraviolet keypad coupled to a vehicle window.
- the method also includes capturing, by the camera, an iris of a person outside the vehicle window.
- the method further includes detecting, by a vehicle processor, the key press and the iris.
- the method still further includes unlocking the vehicle based on the detected key press.
- the method yet further includes modifying a vehicle setting based on a profile corresponding to the detected iris.
- Another example may include means for capturing, by a camera of a vehicle, a key press on an ultraviolet keypad coupled to a vehicle window.
- the example may also include means for capturing, by the camera, an iris of a person outside the vehicle window.
- the example may further include means for detecting, by a vehicle processor, the key press and the iris.
- the example may still further include means for unlocking the vehicle based on the detected key press.
- the example may yet further include means for modifying a vehicle setting based on a profile corresponding to the detected iris.
- FIGS. 1A and 1B illustrate overhead and side perspective views of an example vehicle according to embodiments of the present disclosure.
- FIG. 2 illustrates a simplified block diagram of electronic components of the vehicle of FIGS. 1A and 1B .
- FIG. 3 illustrates an example vehicle door according to embodiments of the present disclosure.
- FIGS. 4A and 4B illustrate perspective views of an example vehicle door and window according to embodiments of the present disclosure.
- FIG. 5 illustrates a flowchart of an example method according to embodiments of the present disclosure.
- example devices, systems, and methods disclosed herein relate to identifying a vehicle driver and enabling the driver to unlock a vehicle, using the same camera for both purposes.
- Vehicles may include technology that enables the vehicle to identify the driver or one or more other occupants in a secure manner, using biometric data such a fingerprint. This data can be used to unlock the vehicle and/or change one or more settings of the vehicle, to personalize the vehicle for the particular person identified.
- biometric data such as a fingerprint.
- fingerprint sensors can result in false positives, may not be accurate, and can cause increased costs and difficulty in manufacturing.
- Vehicles may also include key pads or number pads on the vehicle door or applique, enabling a driver to unlock the vehicle using a simple numeric code. These vehicles enable a driver to unlock the vehicle without the use of a key. This allows the user to unlock the vehicle in the event the key is locked inside, is lost, or is otherwise unavailable to the driver.
- Example embodiments disclosed herein may make use of a single camera for the purpose of detecting key presses on the vehicle window, as well as identifying the person outside the vehicle based on a detected iris. Iris recognition may be more secure than a fingerprint, reducing the likelihood of false positives and ensuring that only authorized people are able to unlock the vehicle.
- example vehicles disclosed herein may be configured to detect the presence of a person outside the vehicle. This may be done, for example, by detecting a touch on the door handle, using a proximity sensor, detecting the presence of a key fob, smart key, or phone-as-a-key (PaaK) device.
- a proximity sensor detecting the presence of a key fob, smart key, or phone-as-a-key (PaaK) device.
- the vehicle may activate a camera located inside the vehicle, positioned such that the field of view includes the head of the person.
- the camera may capture images of the person's face, detect an iris of the person's eye, and determine that the iris corresponds to one or more allowed profiles.
- the camera and/or a connected processor may be configured to perform facial recognition (rather than iris recognition). Further, the camera and/or a connected processor may be configured to determine a facial blood flow heart rate signature. And based on the detected face, iris, and/or heart rate signature, may modify or personalize one or more vehicle settings.
- the vehicle may begin modifying one or more vehicle settings.
- the profile may have a corresponding seat position, audio presets, or more, that may change based on the identity of the person and/or profile.
- the vehicle may activate one or more LEDs configured to illuminate an ultraviolet (UV) keypad.
- the UV keypad may include UV absorbent or reflective material positioned between two or more layers of material that make up the window.
- a driver may then put his or her finger on the keypad to enter the code to unlock the vehicle.
- the camera may be used to capture light reflected off the driver's finger, such that key presses can be determined. If the correct sequence of key presses is detected by the camera, the vehicle may be unlocked. In some instances, however, the vehicle may also require that the iris detection is performed as well. As such, some vehicles may require both that the iris corresponds to an allowed profile, and that the correct code is input to the UV keypad.
- Some examples disclosed herein may relate to situations in which a user has a key fob on their person.
- the vehicle may be in a welcome mode, in which it is actively or passively searching for the presence of a key fob or phone that functions as a key.
- the vehicle may detect the key (within a threshold distance, such as 4-5 meters), and may activate the camera to perform personalization.
- the UV keypad may not be used for coded entry.
- the vehicle may detect the presence of a person via a touch on a handle of the vehicle.
- the camera may then be activated to perform facial or iris detection, prior to the vehicle unlocking.
- the vehicle may begin personalizing the vehicle settings. And the vehicle may be unlocked based on a detection of the presence of the key fob.
- the camera may be activated for facial or iris recognition, in order to personalize the vehicle, prior to unlocking the vehicle via keypad coded entry. This may ensure that the camera is positioned such that it can capture the user's face. If the vehicle was unlocked first, the door may be opened and the camera may be moved out of position. As such, examples disclosed herein may require facial recognition prior to unlocking the vehicle, even where the facial recognition is not used to unlock the vehicle directly (rather the unlocking is done through detection of a key fob or entry of a key code).
- some examples may include the use of either or both of facial and iris recognition. Facial recognition may be less secure than iris detection, and may be used only for personalized access (i.e., the presence of a key or entry via a UV keypad may still be required). Iris recognition, however, may be more secure. As such, some examples may include the ability to toggle between using iris recognition for personalized access (i.e., a key or keypad may still be required) or for secure biometric access (i.e., unlocking the door without the use of a key or keypad entry).
- FIGS. 1A and 1B illustrate an example vehicle 100 according to embodiments of the present disclosure.
- Vehicle 100 may be a standard gasoline powered vehicle, a hybrid vehicle, an electric vehicle, a fuel cell vehicle, or any other mobility implement type of vehicle.
- Vehicle 100 may be non-autonomous, semi-autonomous, or autonomous.
- Vehicle 100 includes parts related to mobility, such as a powertrain with an engine, a transmission, a suspension, a driveshaft, and/or wheels, etc.
- vehicle 100 may include one or more electronic components.
- Vehicle 100 may include a UV keypad 102 , coupled to a window 104 , a windshield, or a rear glass. Vehicle 100 may also include a processor 110 .
- UV Keypad 102 may include UV absorbent or reflective material, such as a paint or dye, positioned between layers of glass or other material that makes up the vehicle window. When the UV keypad is exposed to UV light, it will shine or glow such that a person outside the vehicle can see it.
- the UV keypad may include numbers, letters, or other text that may make up a pass code or entry code to unlock the vehicle. The UV keypad will be discussed in more detail below with respect to FIGS. 3, 4A and 4B .
- Vehicle 100 may also include a camera, various LEDs (UV, near infrared (NIR), visible light, etc.), and one or more other components or devices which are discussed in further detail below.
- Processor 110 may be configured to carry out one or more functions described herein. For instance, processor 110 may be configured to determine when a person is present outside the vehicle, detect an iris (or face) based on images captured by the camera, determine that one or more keys of the UV keypad have been pressed, and modify one or more vehicle settings, for example. Other actions are possible as well.
- FIG. 2 illustrates an example block diagram 200 showing electronic components of vehicle 100 , according to some embodiments.
- the electronic components 200 include an on-board computing system 210 , infotainment head unit 220 , lights 230 , sensors 240 , electronic control unit(s) 250 , and vehicle data bus 260 .
- the on-board computing system 210 may include a microcontroller unit, controller or processor 110 and memory 212 .
- Processor 110 may be any suitable processing device or set of processing devices such as, but not limited to, a microprocessor, a microcontroller-based platform, an integrated circuit, one or more field programmable gate arrays (FPGAs), and/or one or more application-specific integrated circuits (ASICs).
- FPGAs field programmable gate arrays
- ASICs application-specific integrated circuits
- the memory 212 may be volatile memory (e.g., RAM including non-volatile RAM, magnetic RAM, ferroelectric RAM, etc.), non-volatile memory (e.g., disk memory, FLASH memory, EPROMs, EEPROMs, memristor-based non-volatile solid-state memory, etc.), unalterable memory (e.g., EPROMs), read-only memory, and/or high-capacity storage devices (e.g., hard drives, solid state drives, etc).
- the memory 212 includes multiple kinds of memory, particularly volatile memory and non-volatile memory.
- the memory 212 may be computer readable media on which one or more sets of instructions, such as the software for operating the methods of the present disclosure, can be embedded.
- the instructions may embody one or more of the methods or logic as described herein.
- the instructions reside completely, or at least partially, within any one or more of the memory 212 , the computer readable medium, and/or within the processor 110 during execution of the instructions.
- non-transitory computer-readable medium and “computer-readable medium” include a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. Further, the terms “non-transitory computer-readable medium” and “computer-readable medium” include any tangible medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term “computer readable medium” is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals.
- the infotainment head unit 220 may provide an interface between vehicle 100 and a user.
- the infotainment head unit 220 may include one or more input and/or output devices, such as display 102 .
- the input devices may include, for example, a control knob, an instrument panel, a digital camera for image capture and/or visual command recognition, a touch screen, an audio input device (e.g., cabin microphone), buttons, or a touchpad.
- the output devices may include instrument cluster outputs (e.g., dials, lighting devices), actuators, a heads-up display, a center console display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a flat panel display, a solid state display, etc.), and/or speakers.
- the infotainment head unit 220 includes hardware (e.g., a processor or controller, memory, storage, etc.) and software (e.g., an operating system, etc.) for an infotainment system (such as SYNC® and MyFord Touch® by Ford®, Entune® by Toyota®, IntelliLink® by GMC®, etc.).
- infotainment head unit 220 may share a processor with on-board computing system 210 . Additionally, the infotainment head unit 220 may display the infotainment system on, for example, a center console display of vehicle 100 .
- Lights 230 may include one or more LEDs or other light emitting devices.
- lights 230 may include one or more UV LEDs 232 and NIR LEDs 234 .
- the UV LEDs may be configured to illuminate the UV keypad, allowing a person to see the keypad.
- the keypad may ordinarily be transparent in the absence of UV light from the UV LEDs.
- NIR LED 234 may be configured to provide near-infrared light, such that a camera can capture images even in low light settings.
- the camera (discussed below), may be configured to detect facial features, key presses, and other objects within its field of view. Where there is adequate lighting above a threshold brightness, the camera may use visible light. To capture a key press, the visible light may bounce of a person's finger and be reflected into the camera. Alternatively, where there is not adequate lighting above the threshold brightness, there may not be enough visible light for the camera to operate effectively. In this situation, the NIR LED may provide sufficient light to bounce off the person's finger to be reflected into the camera. The same principle may apply where the camera captures the person's iris.
- Sensors 240 may be arranged in and around the vehicle 100 in any suitable fashion, and may be configured to determine one or more characteristics of vehicle 100 .
- accelerometer 242 may measure an acceleration of vehicle 100
- gyroscope 244 may measure a pitch, roll, yaw, or other change in vehicle 100
- camera 246 may be configured to capture and transmit images to be processed and/or displayed by vehicle 100 .
- Other sensors may be included as well, such as noise detection sensors, air flow sensors, and more.
- the ECUs 250 may monitor and control subsystems of vehicle 100 .
- ECUs 250 may communicate and exchange information via vehicle data bus 260 . Additionally, ECUs 250 may communicate properties (such as, status of the ECU 250 , sensor readings, control state, error and diagnostic codes, etc.) to and/or receive requests from other ECUs 250 .
- Some vehicles 100 may have seventy or more ECUs 250 located in various locations around the vehicle 100 communicatively coupled by vehicle data bus 260 .
- ECUs 250 may be discrete sets of electronics that include their own circuit(s) (such as integrated circuits, microprocessors, memory, storage, etc.) and firmware, sensors, actuators, and/or mounting hardware.
- ECUs 250 may include the telematics control unit 252 , the body control unit 254 , and the speed control unit 256 .
- the telematics control unit 252 may control tracking of the vehicle 100 , for example, using data received by a GPS receiver, communication module 230 , and/or one or more sensors.
- the body control unit 254 may control various subsystems of the vehicle 100 .
- the body control unit 254 may control power to a trunk latch, windows, power locks, power moon roof control, an immobilizer system, and/or power mirrors, etc.
- the speed control unit 256 may control the speed of vehicle 100 , via control of the brakes, drive train, and/or one or more other systems or devices. Other ECUs are possible as well.
- Vehicle data bus 260 may include one or more data buses that communicatively couple the on-board computing system 210 , infotainment head unit 220 , lights 230 , sensors 240 , ECUs 250 , and other devices or systems connected to the vehicle data bus 260 .
- vehicle data bus 260 may be implemented in accordance with the controller area network (CAN) bus protocol as defined by International Standards Organization (ISO) 11898-1.
- vehicle data bus 260 may be a Media Oriented Systems Transport (MOST) bus, or a CAN flexible data (CAN-FD) bus (ISO 11898-7). In some applications, the CAN and CAN-FD may share the same bus.
- CAN controller area network
- MOST Media Oriented Systems Transport
- CAN-FD CAN flexible data
- FIG. 3 illustrates a side view of a vehicle door 300 according to embodiments of the present disclosure.
- the vehicle door may include a window 304 , which may include a UV keypad 302 .
- door 300 may also include a handle 310 .
- FIG. 3 illustrates the UV keypad 302 as comprising 5 separate blocks, each corresponding to a pair of numbers (1 and 2, 3 and 4, etc.).
- the UV keypad may include numbers, letters, a combination of letters and numbers, and/or other text.
- UV keypad 302 may include more or fewer blocks, such that more or fewer separate inputs may be detected.
- door 300 and/or door handle 310 may include one or more sensors configured to detect the presence of a person outside the vehicle. This may include, for example, a capacitive or other type of touch sensor, one or more antennas, or more. These sensors may be used by the processor (such as processor 110 ) to determine when a person is present, in order to responsively activate the UV keypad and/or camera.
- FIGS. 4A and 4B illustrate perspective views of an example vehicle door 400 , according to some embodiments.
- this Figure illustrates a UV keypad 402 integrated with a vehicle window 404 .
- the door 400 also includes a camera 406 , a UV LED 420 and an NIR LED 422 .
- the Figure also illustrates a person 430 having an iris 432 within a field of view 408 of the camera.
- the UV keypad 402 may comprise a paint, dye, or other material that is sensitive or reactive to UV light.
- UV Keypad 402 may be integrated with window 404 by being positioned between layers 404 A and 404 B of the window.
- Layers 404 A and 404 B may be specialized glass that, when combined with a film layer between the two glass layers 404 A and 404 B, prevents UV light from outside the vehicle from affecting the UV Keypad. This may be achieved by having a sun UV blocking layer on the film layer surface adjacent to layer 404 A and a UV luminescent ink on the opposite side of the film layer adjacent to layer 404 B.
- one or more other layers or materials may be included within the construction of window 404 such that outside UV light does not illuminate the UV keypad.
- Camera 406 may be configured to have a field of view 408 that encompasses the UV keypad 402 .
- the field of view 408 may also be wide enough to encompass a person or part of a person located outside the vehicle.
- camera 406 may include a wide angle lens in order to capture both the UV keypad 402 as well as the person 430 .
- camera 406 may include one or more actuators or moveable elements configured to steer the field of view 408 and/or focal point into capturing either or both of the UV keypad 402 and the person 430 .
- camera 406 may be configured to capture the iris 432 of person 430 located outside the vehicle.
- the camera 406 may be activated, and/or the iris 432 may be captured by camera 406 in response to a processor determining that person 430 is located in proximity to the vehicle. In practice, this may occur in phases, wherein a first phase includes activating the camera in response to determining the person is located in proximity to the vehicle, and further capturing an image of the person's iris in response to detecting the face of the person.
- the processor may perform image processing in order to determine that the person's face is located in a proper location to capture an image of the iris, as well as to detect the iris itself from a larger image of the person's face.
- the proximity detection may include the vehicle detecting a valid keyfob or Phone-as-a-Key (PaaK). Though these devices may be valid keys, they can be shared. Therefore, even in the presence of these valid keys, activation of the camera to biometrically identify the user may allow personalization of vehicle settings to be customized to the user even when multiple users share a keyfob or phone.
- PaaK Phone-as-a-Key
- the iris capturing by camera 406 and/or detection by the processor may be performed in non-ideal lighting conditions.
- the vehicle may be located in a dimly lit garage, parking structure, or it may be night time in a dimly lit or unlit location.
- it may be useful to have a separate source of light that will enable the camera to accurately capture the person's iris.
- NIR LED 422 may provide near infrared light that is not visible to the human eye.
- the processor may be configured to determine a lighting condition surrounding the camera. This lighting condition may be rated on a scale, with the value depending on an amount of light received by the camera.
- the processor may compare the lighting condition to a reference threshold or value, such that lighting conditions above the threshold include enough light to capture and detect an iris, while lighting conditions below the threshold are not.
- This threshold may change based on one or more factors, and may be dependent on the image processing software used by the processor. For instance, more advanced image processing software may require less light in an image than less advanced software, while still providing the same confidence in iris detection. As such, the lighting condition threshold may change or be different based on the software used.
- the processor may select a light source to be used to detect the iris 432 . For example, where the lighting condition is above the threshold, the processor may select visible light as the light source. Alternatively, where the lighting condition is below the threshold, the processor may select the NIR LED as the light source. The selected light source may be used by camera 406 to capture the iris 432 .
- the processor may perform image processing in order to detect the iris.
- the detected iris may correspond to one or more profiles of the vehicle.
- a given vehicle may include multiple drivers, each having his or her own profile and corresponding iris.
- Each profile may have one or more preselected options, such as seat position, audio presets, and more.
- the processor may compare to a plurality of stored irises to determine whether it matches. Upon determination of a match, the vehicle may automatically change the settings to the values that correspond to the allowed profile.
- facial recognition may be performed. As such, it should be understood that the disclosure herein applies to facial recognition as well as iris detection.
- FIG. 4B illustrates UV keypad 402 integrated with window 404 , and a finger 440 in the process of selecting one of the blocks of UV keypad 402 that is illuminated by light from UV LED 420 .
- Camera 406 may be configured to capture light reflecting off finger 440 , such that the processor can process images received by camera 406 and detect the key press.
- UV LED 420 may be configured to emit light in the direction of UV keypad 420 in response to one or more sensors detecting that a person is present in proximity to the vehicle.
- UV LED 420 may be configured to emit light in response to the processor determining that a detected iris corresponds to an allowed profile. As such, the UV keypad may only be activated after an iris has been detected.
- camera 406 may be configured to capture key presses via light reflected off the finger 440 of a person outside the vehicle.
- the camera may be configured to use visible light, NIR light, or another type of light.
- the camera 406 and/or processor may be configured to select a light source based on a lighting condition surrounding the camera 406 , as described above with respect to detecting iris 432 .
- Camera 406 may be configured to capture multiple key presses in succession, and the processor may be configured to detect the key presses and determine that a particular pattern has been pressed. In response, the processor may unlock the vehicle.
- facial recognition may be performed first, followed by keypad entry.
- the person's face may be captured and recognized, and the processor may associate a unique or personalized key code with the face.
- the vehicle may begin modifying one or more vehicle settings (i.e., personalizing the vehicle).
- the UV keypad may be made available (i.e., the UV LED turned on, the camera repositioned or angled, etc.).
- the vehicle may be unlocked.
- iris recognition may be performed, and may negate the need for use of the UV keypad for entry. Iris recognition may be accurate enough and secure enough to make a key code entry unnecessary.
- FIG. 5 illustrates an example method 500 according to embodiments of the present disclosure.
- Method 500 may enable a vehicle to use the same camera for both iris detection and UV keypad entry, to unlock and personalize one or more settings of the vehicle.
- the flowchart of FIG. 5 is representative of machine readable instructions that are stored in memory and may include one or more programs which, when executed by a processor may cause vehicle 100 and/or one or more systems or devices described herein to carry out one or more functions described herein. While the example program is described with reference to the flowchart illustrated in FIG. 5 , many other methods for carrying out the functions described herein may alternatively be used.
- Method 500 may start at block 502 .
- method 500 may include determining whether a driver is within a proximity of the vehicle. This may include using a sensor on a door handle to detect when a person touches the door handle.
- the vehicle may include one or more antennas (such as BLUETOOTH or other short range communication) that may be used to determine when a key fob, smart key, or Phone as a Key device is within a predetermined range of the vehicle or driver's side door.
- antennas such as BLUETOOTH or other short range communication
- block 506 of method 500 may include activating the camera. This may include turning on the camera, and/or changing a position or angle of the camera such that the camera field of view includes an area outside the driver's side window.
- Block 508 of method 500 may include determining a lighting condition surrounding the camera. In some examples, this may include using the camera to detect an amount of light being received. Alternatively, one or more other vehicle sensors (such as ambient light sensors) may be used to determine an amount of light. If the determined level of light is above a threshold level, method 500 may proceed to block 512 . But if the level of light is below a threshold level needed to detect an iris, method 500 may proceed to block 510 .
- Block 510 of method 500 may include activating a NIR LED.
- This LED may provide light for the camera to capture the face of a person outside the vehicle window.
- the camera may use visible light, or light from another source.
- method 500 may include determining whether a face is located in the camera field of view (FOV). This may include performing image processing to detect a face. If no face is located in the FOV, the camera may continue to wait until a face is present. When a face is determined to be present, method 500 may include detecting an iris of the face at block 514 .
- FOV camera field of view
- method 500 may include determining whether the detected iris corresponds to an allowed profile. This may include comparing the detected iris to one or more stored irises, each corresponding to one or more allowed profiles. Each allowed profile may correspond to a person who is allowed to drive the vehicle. If the iris does not correspond to an allowed profile, method 500 may end at block 528 .
- method 500 may include modifying one or more vehicle settings based on the allowed profile at block 518 . This may include changing a seat position, audio presets, vehicle mode, and more.
- method 500 may include activating a UV LED.
- the UV LED may illuminate the UV keypad positioned in the driver's side window.
- Method 500 may then include capturing images of the window with the camera, in order to detect key presses on the UV keypad at block 522 .
- method 500 may include determining whether the detected key presses correspond to the correct combination or pass code. If the key presses do not, the system may rest back to block 522 to detect more key presses.
- method 500 may include unlocking the vehicle at block 526 .
- entry of the correct keycode may cause one or more vehicle settings to be customized or modified, without the need for iris or facial recognition.
- Method 500 may then end at block 528 .
- the use of the disjunctive is intended to include the conjunctive.
- the use of definite or indefinite articles is not intended to indicate cardinality.
- a reference to “the” object or “a” and “an” object is intended to denote also one of a possible plurality of such objects.
- the conjunction “or” may be used to convey features that are simultaneously present instead of mutually exclusive alternatives. In other words, the conjunction “or” should be understood to include “and/or”.
- the terms “includes,” “including,” and “include” are inclusive and have the same scope as “comprises,” “comprising,” and “comprise” respectively.
Abstract
Systems, devices, and methods are disclosed for unlocking a vehicle. An example vehicle includes an ultraviolet keypad coupled to a window. The vehicle also includes a camera directed at the window, configured to capture a key press of the ultraviolet keypad and an iris of a person outside the vehicle. And the vehicle further includes a processor configured to detect the key press and iris, unlock the vehicle based on the detected key press, and modify a vehicle setting based on a profile corresponding to the detected iris.
Description
The present disclosure generally relates to vehicle unlocking systems, devices, and methods and, more specifically, using the same camera for both driver identity matching and detecting key presses on an ultraviolet keypad displayed in the vehicle window.
A typical vehicle may be unlocked with a key. Alternatively, the vehicle may be unlocked without a key, if the driver enters a predetermined key code sequence via an input on the vehicle exterior.
Vehicles may also include one or more settings that are customizable, such as seat position, default operation mode, audio presets, and more. These settings may change based on the identity of the driver.
The appended claims define this application. The present disclosure summarizes aspects of the embodiments and should not be used to limit the claims. Other implementations are contemplated in accordance with the techniques described herein, as will be apparent to one having ordinary skill in the art upon examination of the following drawings and detailed description, and these implementations are intended to be within the scope of this application.
Example embodiments are shown for remote vehicle unlocking systems, devices, and methods. An example disclosed vehicle includes an ultraviolet ink keypad coupled to a window, and a camera directed at the window, configured to capture a key press on the ultraviolet keypad and an iris of a person outside the vehicle. The vehicle also includes a processor configured to detect the key press and iris. The processor is also configured to unlock the vehicle based on the detected key press. The processor is further configured to modify a vehicle setting based on a profile corresponding to the detected iris.
An example disclosed method includes capturing, by a camera of a vehicle, a key press on an ultraviolet keypad coupled to a vehicle window. The method also includes capturing, by the camera, an iris of a person outside the vehicle window. The method further includes detecting, by a vehicle processor, the key press and the iris. The method still further includes unlocking the vehicle based on the detected key press. And the method yet further includes modifying a vehicle setting based on a profile corresponding to the detected iris.
Another example may include means for capturing, by a camera of a vehicle, a key press on an ultraviolet keypad coupled to a vehicle window. The example may also include means for capturing, by the camera, an iris of a person outside the vehicle window. The example may further include means for detecting, by a vehicle processor, the key press and the iris. The example may still further include means for unlocking the vehicle based on the detected key press. And the example may yet further include means for modifying a vehicle setting based on a profile corresponding to the detected iris.
For a better understanding of the invention, reference may be made to embodiments shown in the following drawings. The components in the drawings are not necessarily to scale and related elements may be omitted, or in some instances proportions may have been exaggerated, so as to emphasize and clearly illustrate the novel features described herein. In addition, system components can be variously arranged, as known in the art. Further, in the drawings, like reference numerals designate corresponding parts throughout the several views.
While the invention may be embodied in various forms, there are shown in the drawings, and will hereinafter be described, some exemplary and non-limiting embodiments, with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated.
As noted above, example devices, systems, and methods disclosed herein relate to identifying a vehicle driver and enabling the driver to unlock a vehicle, using the same camera for both purposes. Vehicles may include technology that enables the vehicle to identify the driver or one or more other occupants in a secure manner, using biometric data such a fingerprint. This data can be used to unlock the vehicle and/or change one or more settings of the vehicle, to personalize the vehicle for the particular person identified. But fingerprint sensors can result in false positives, may not be accurate, and can cause increased costs and difficulty in manufacturing.
Vehicles may also include key pads or number pads on the vehicle door or applique, enabling a driver to unlock the vehicle using a simple numeric code. These vehicles enable a driver to unlock the vehicle without the use of a key. This allows the user to unlock the vehicle in the event the key is locked inside, is lost, or is otherwise unavailable to the driver.
Example embodiments disclosed herein may make use of a single camera for the purpose of detecting key presses on the vehicle window, as well as identifying the person outside the vehicle based on a detected iris. Iris recognition may be more secure than a fingerprint, reducing the likelihood of false positives and ensuring that only authorized people are able to unlock the vehicle.
In order to provide these benefits as well as others, example vehicles disclosed herein may be configured to detect the presence of a person outside the vehicle. This may be done, for example, by detecting a touch on the door handle, using a proximity sensor, detecting the presence of a key fob, smart key, or phone-as-a-key (PaaK) device.
Upon detection of a person outside the vehicle, the vehicle may activate a camera located inside the vehicle, positioned such that the field of view includes the head of the person. The camera may capture images of the person's face, detect an iris of the person's eye, and determine that the iris corresponds to one or more allowed profiles. In some examples, the camera and/or a connected processor may be configured to perform facial recognition (rather than iris recognition). Further, the camera and/or a connected processor may be configured to determine a facial blood flow heart rate signature. And based on the detected face, iris, and/or heart rate signature, may modify or personalize one or more vehicle settings.
Upon determination that the iris (or face) corresponds to an allowed profile, the vehicle may begin modifying one or more vehicle settings. For instance, the profile may have a corresponding seat position, audio presets, or more, that may change based on the identity of the person and/or profile.
In addition, the vehicle may activate one or more LEDs configured to illuminate an ultraviolet (UV) keypad. The UV keypad may include UV absorbent or reflective material positioned between two or more layers of material that make up the window. A driver may then put his or her finger on the keypad to enter the code to unlock the vehicle. The camera may be used to capture light reflected off the driver's finger, such that key presses can be determined. If the correct sequence of key presses is detected by the camera, the vehicle may be unlocked. In some instances, however, the vehicle may also require that the iris detection is performed as well. As such, some vehicles may require both that the iris corresponds to an allowed profile, and that the correct code is input to the UV keypad.
Some examples disclosed herein may relate to situations in which a user has a key fob on their person. The vehicle may be in a welcome mode, in which it is actively or passively searching for the presence of a key fob or phone that functions as a key. The vehicle may detect the key (within a threshold distance, such as 4-5 meters), and may activate the camera to perform personalization. In this example, the UV keypad may not be used for coded entry.
Similarly, where a key (fob or phone) is present but the vehicle is not in the welcome mode, or is not actively or passively searching for the key fob, the vehicle may detect the presence of a person via a touch on a handle of the vehicle. The camera may then be activated to perform facial or iris detection, prior to the vehicle unlocking. After the facial recognition is performed, the vehicle may begin personalizing the vehicle settings. And the vehicle may be unlocked based on a detection of the presence of the key fob.
In the examples described herein, the camera may be activated for facial or iris recognition, in order to personalize the vehicle, prior to unlocking the vehicle via keypad coded entry. This may ensure that the camera is positioned such that it can capture the user's face. If the vehicle was unlocked first, the door may be opened and the camera may be moved out of position. As such, examples disclosed herein may require facial recognition prior to unlocking the vehicle, even where the facial recognition is not used to unlock the vehicle directly (rather the unlocking is done through detection of a key fob or entry of a key code).
Further, some examples may include the use of either or both of facial and iris recognition. Facial recognition may be less secure than iris detection, and may be used only for personalized access (i.e., the presence of a key or entry via a UV keypad may still be required). Iris recognition, however, may be more secure. As such, some examples may include the ability to toggle between using iris recognition for personalized access (i.e., a key or keypad may still be required) or for secure biometric access (i.e., unlocking the door without the use of a key or keypad entry).
The on-board computing system 210 may include a microcontroller unit, controller or processor 110 and memory 212. Processor 110 may be any suitable processing device or set of processing devices such as, but not limited to, a microprocessor, a microcontroller-based platform, an integrated circuit, one or more field programmable gate arrays (FPGAs), and/or one or more application-specific integrated circuits (ASICs). The memory 212 may be volatile memory (e.g., RAM including non-volatile RAM, magnetic RAM, ferroelectric RAM, etc.), non-volatile memory (e.g., disk memory, FLASH memory, EPROMs, EEPROMs, memristor-based non-volatile solid-state memory, etc.), unalterable memory (e.g., EPROMs), read-only memory, and/or high-capacity storage devices (e.g., hard drives, solid state drives, etc). In some examples, the memory 212 includes multiple kinds of memory, particularly volatile memory and non-volatile memory.
The memory 212 may be computer readable media on which one or more sets of instructions, such as the software for operating the methods of the present disclosure, can be embedded. The instructions may embody one or more of the methods or logic as described herein. For example, the instructions reside completely, or at least partially, within any one or more of the memory 212, the computer readable medium, and/or within the processor 110 during execution of the instructions.
The terms “non-transitory computer-readable medium” and “computer-readable medium” include a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. Further, the terms “non-transitory computer-readable medium” and “computer-readable medium” include any tangible medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term “computer readable medium” is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals.
The infotainment head unit 220 may provide an interface between vehicle 100 and a user. The infotainment head unit 220 may include one or more input and/or output devices, such as display 102. The input devices may include, for example, a control knob, an instrument panel, a digital camera for image capture and/or visual command recognition, a touch screen, an audio input device (e.g., cabin microphone), buttons, or a touchpad. The output devices may include instrument cluster outputs (e.g., dials, lighting devices), actuators, a heads-up display, a center console display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a flat panel display, a solid state display, etc.), and/or speakers. In the illustrated example, the infotainment head unit 220 includes hardware (e.g., a processor or controller, memory, storage, etc.) and software (e.g., an operating system, etc.) for an infotainment system (such as SYNC® and MyFord Touch® by Ford®, Entune® by Toyota®, IntelliLink® by GMC®, etc.). In some examples the infotainment head unit 220 may share a processor with on-board computing system 210. Additionally, the infotainment head unit 220 may display the infotainment system on, for example, a center console display of vehicle 100.
The ECUs 250 may monitor and control subsystems of vehicle 100. ECUs 250 may communicate and exchange information via vehicle data bus 260. Additionally, ECUs 250 may communicate properties (such as, status of the ECU 250, sensor readings, control state, error and diagnostic codes, etc.) to and/or receive requests from other ECUs 250. Some vehicles 100 may have seventy or more ECUs 250 located in various locations around the vehicle 100 communicatively coupled by vehicle data bus 260. ECUs 250 may be discrete sets of electronics that include their own circuit(s) (such as integrated circuits, microprocessors, memory, storage, etc.) and firmware, sensors, actuators, and/or mounting hardware. In the illustrated example, ECUs 250 may include the telematics control unit 252, the body control unit 254, and the speed control unit 256.
The telematics control unit 252 may control tracking of the vehicle 100, for example, using data received by a GPS receiver, communication module 230, and/or one or more sensors. The body control unit 254 may control various subsystems of the vehicle 100. For example, the body control unit 254 may control power to a trunk latch, windows, power locks, power moon roof control, an immobilizer system, and/or power mirrors, etc. The speed control unit 256 may control the speed of vehicle 100, via control of the brakes, drive train, and/or one or more other systems or devices. Other ECUs are possible as well.
Vehicle data bus 260 may include one or more data buses that communicatively couple the on-board computing system 210, infotainment head unit 220, lights 230, sensors 240, ECUs 250, and other devices or systems connected to the vehicle data bus 260. In some examples, vehicle data bus 260 may be implemented in accordance with the controller area network (CAN) bus protocol as defined by International Standards Organization (ISO) 11898-1. Alternatively, in some examples, vehicle data bus 260 may be a Media Oriented Systems Transport (MOST) bus, or a CAN flexible data (CAN-FD) bus (ISO 11898-7). In some applications, the CAN and CAN-FD may share the same bus.
In some examples, door 300 and/or door handle 310 may include one or more sensors configured to detect the presence of a person outside the vehicle. This may include, for example, a capacitive or other type of touch sensor, one or more antennas, or more. These sensors may be used by the processor (such as processor 110) to determine when a person is present, in order to responsively activate the UV keypad and/or camera.
The UV keypad 402 may comprise a paint, dye, or other material that is sensitive or reactive to UV light. UV Keypad 402 may be integrated with window 404 by being positioned between layers 404A and 404B of the window. Layers 404A and 404B may be specialized glass that, when combined with a film layer between the two glass layers 404A and 404B, prevents UV light from outside the vehicle from affecting the UV Keypad. This may be achieved by having a sun UV blocking layer on the film layer surface adjacent to layer 404A and a UV luminescent ink on the opposite side of the film layer adjacent to layer 404B. Alternatively, one or more other layers or materials may be included within the construction of window 404 such that outside UV light does not illuminate the UV keypad.
In some examples, camera 406 may be configured to capture the iris 432 of person 430 located outside the vehicle. The camera 406 may be activated, and/or the iris 432 may be captured by camera 406 in response to a processor determining that person 430 is located in proximity to the vehicle. In practice, this may occur in phases, wherein a first phase includes activating the camera in response to determining the person is located in proximity to the vehicle, and further capturing an image of the person's iris in response to detecting the face of the person. The processor may perform image processing in order to determine that the person's face is located in a proper location to capture an image of the iris, as well as to detect the iris itself from a larger image of the person's face. The proximity detection may include the vehicle detecting a valid keyfob or Phone-as-a-Key (PaaK). Though these devices may be valid keys, they can be shared. Therefore, even in the presence of these valid keys, activation of the camera to biometrically identify the user may allow personalization of vehicle settings to be customized to the user even when multiple users share a keyfob or phone.
In some examples, the iris capturing by camera 406 and/or detection by the processor may be performed in non-ideal lighting conditions. For instance, the vehicle may be located in a dimly lit garage, parking structure, or it may be night time in a dimly lit or unlit location. In these examples, among others, it may be useful to have a separate source of light that will enable the camera to accurately capture the person's iris.
Based on the determined lighting condition, the processor may select a light source to be used to detect the iris 432. For example, where the lighting condition is above the threshold, the processor may select visible light as the light source. Alternatively, where the lighting condition is below the threshold, the processor may select the NIR LED as the light source. The selected light source may be used by camera 406 to capture the iris 432.
Once the iris 432 is captured, the processor may perform image processing in order to detect the iris. The detected iris may correspond to one or more profiles of the vehicle. A given vehicle may include multiple drivers, each having his or her own profile and corresponding iris. Each profile may have one or more preselected options, such as seat position, audio presets, and more. Upon detecting iris 432, the processor may compare to a plurality of stored irises to determine whether it matches. Upon determination of a match, the vehicle may automatically change the settings to the values that correspond to the allowed profile. In some examples, rather than iris detection, facial recognition may be performed. As such, it should be understood that the disclosure herein applies to facial recognition as well as iris detection.
In some examples, UV LED 420 may be configured to emit light in the direction of UV keypad 420 in response to one or more sensors detecting that a person is present in proximity to the vehicle. Alternatively, UV LED 420 may be configured to emit light in response to the processor determining that a detected iris corresponds to an allowed profile. As such, the UV keypad may only be activated after an iris has been detected.
In some examples, camera 406 may be configured to capture key presses via light reflected off the finger 440 of a person outside the vehicle. The camera may be configured to use visible light, NIR light, or another type of light. Further, the camera 406 and/or processor may be configured to select a light source based on a lighting condition surrounding the camera 406, as described above with respect to detecting iris 432.
In some examples, facial recognition may be performed first, followed by keypad entry. The person's face may be captured and recognized, and the processor may associate a unique or personalized key code with the face. And after the facial recognition has been performed, the vehicle may begin modifying one or more vehicle settings (i.e., personalizing the vehicle). In addition, after performing facial recognition, the UV keypad may be made available (i.e., the UV LED turned on, the camera repositioned or angled, etc.). And in response to entry of the personalized key code, the vehicle may be unlocked.
Further, in some examples iris recognition may be performed, and may negate the need for use of the UV keypad for entry. Iris recognition may be accurate enough and secure enough to make a key code entry unnecessary.
Upon detecting that a person is within proximity of the vehicle, block 506 of method 500 may include activating the camera. This may include turning on the camera, and/or changing a position or angle of the camera such that the camera field of view includes an area outside the driver's side window.
At block 512, method 500 may include determining whether a face is located in the camera field of view (FOV). This may include performing image processing to detect a face. If no face is located in the FOV, the camera may continue to wait until a face is present. When a face is determined to be present, method 500 may include detecting an iris of the face at block 514.
At block 516, method 500 may include determining whether the detected iris corresponds to an allowed profile. This may include comparing the detected iris to one or more stored irises, each corresponding to one or more allowed profiles. Each allowed profile may correspond to a person who is allowed to drive the vehicle. If the iris does not correspond to an allowed profile, method 500 may end at block 528.
However, if the iris does correspond to an allowed profile, method 500 may include modifying one or more vehicle settings based on the allowed profile at block 518. This may include changing a seat position, audio presets, vehicle mode, and more.
At block 520, method 500 may include activating a UV LED. The UV LED may illuminate the UV keypad positioned in the driver's side window. Method 500 may then include capturing images of the window with the camera, in order to detect key presses on the UV keypad at block 522.
At block 524, method 500 may include determining whether the detected key presses correspond to the correct combination or pass code. If the key presses do not, the system may rest back to block 522 to detect more key presses.
If the key presses are detected in the correct combination, method 500 may include unlocking the vehicle at block 526. In addition, entry of the correct keycode may cause one or more vehicle settings to be customized or modified, without the need for iris or facial recognition. Method 500 may then end at block 528.
In this application, the use of the disjunctive is intended to include the conjunctive. The use of definite or indefinite articles is not intended to indicate cardinality. In particular, a reference to “the” object or “a” and “an” object is intended to denote also one of a possible plurality of such objects. Further, the conjunction “or” may be used to convey features that are simultaneously present instead of mutually exclusive alternatives. In other words, the conjunction “or” should be understood to include “and/or”. The terms “includes,” “including,” and “include” are inclusive and have the same scope as “comprises,” “comprising,” and “comprise” respectively.
The above-described embodiments, and particularly any “preferred” embodiments, are possible examples of implementations and merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above-described embodiment(s) without substantially departing from the spirit and principles of the techniques described herein. All modifications are intended to be included herein within the scope of this disclosure and protected by the following claims.
Claims (20)
1. A vehicle comprising:
an ultraviolet keypad coupled to a window;
a camera directed at the window, configured to capture a key press of the ultraviolet keypad and an iris of a person outside the vehicle; and
a processor configured to:
responsive to detecting the iris, activate the ultraviolet keypad;
unlock the vehicle based on the detected key press; and
modify a vehicle setting based on a profile corresponding to the detected iris.
2. The vehicle of claim 1 , wherein the ultraviolet keypad coupled to the window comprises a layer of ultraviolet reflective material positioned between two layers of glass.
3. The vehicle of claim 1 , further comprising an ultraviolet LED configured to illuminate the ultraviolet keypad, wherein capturing the key press comprises capturing light reflected off a user's finger.
4. The vehicle of claim 3 , further comprising a near-infrared (NIR) LED, wherein capturing the key press comprises capturing NIR light reflected off the user's finger.
5. The vehicle of claim 1 , wherein the processor is further configured to:
determine a lighting condition surrounding the camera; and
based on the lighting condition surrounding the camera, select a light source used to detect the iris.
6. The vehicle of claim 5 , further comprising a near-infrared (NIR) LED, wherein the processor is further configured to:
determine that the lighting condition surrounding the camera is below a threshold level; and
responsively select NIR light as the light source used to detect the iris.
7. The vehicle of claim 5 , wherein the processor is further configured to:
determine that the lighting condition surrounding the camera is above a threshold level; and
responsively select visible light as the light source used to detect the iris.
8. The vehicle of claim 1 , wherein the processor is further configured to:
detect the person in proximity to the window; and
responsively activate the camera.
9. The vehicle of claim 1 , wherein the camera is coupled to a door of the vehicle.
10. The vehicle of claim 1 , wherein the camera is further configured to:
capture the iris; and
responsive to the processor determining that the detected iris corresponds to an allowed profile, capture the key press.
11. A method comprising:
capturing, by a camera of a vehicle having a window, an iris of a person outside the window;
responsive to detecting, by a vehicle processor, the iris, activating an ultraviolet keypad coupled to the window;
capturing, by the camera, a key press on the ultraviolet keypad;
unlocking the vehicle based on the detected key press; and
modifying a vehicle setting based on a profile corresponding to the detected iris.
12. The method of claim 11 , wherein the ultraviolet keypad coupled to the window comprises a layer of ultraviolet reflective material positioned between two layers of glass.
13. The method of claim 11 , further comprising an ultraviolet LED configured to illuminate the ultraviolet keypad, wherein capturing the key press comprises capturing light reflected off a user's finger.
14. The method of claim 13 , further comprising a near-infrared (NIR) LED, wherein capturing the key press comprises capturing NIR light reflected off the user's finger.
15. The method of claim 11 , further comprising:
determining a lighting condition surrounding the camera; and
based on the lighting condition surrounding the camera, selecting a light source used to detect the iris.
16. The method of claim 15 , further comprising:
determining that the lighting condition surrounding the camera is below a threshold level; and
responsively selecting near infrared (NIR) light as the light source used to detect the iris.
17. The vehicle of claim 15 , further comprising:
determining that the lighting condition surrounding the camera is above a threshold level; and
responsively selecting visible light as the light source used to detect the iris.
18. The method of claim 11 , further comprising:
detecting the person in proximity to the window; and
responsively activating the camera.
19. The method of claim 11 , wherein the camera is coupled to a door of the vehicle.
20. The method of claim 11 , further comprising:
prior to capturing the key press; capturing the iris;
determining, by the processor, that the iris corresponds to an allowed profile; and
responsively capturing the key press.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/683,375 US10137857B1 (en) | 2017-08-22 | 2017-08-22 | Vehicle unlocking systems, devices, and methods |
DE102018120343.8A DE102018120343A1 (en) | 2017-08-22 | 2018-08-21 | VEHICLE RELIEF SYSTEMS, DEVICES, AND METHOD |
CN201810956915.8A CN109421664A (en) | 2017-08-22 | 2018-08-21 | Vehicle system for unlocking, device and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/683,375 US10137857B1 (en) | 2017-08-22 | 2017-08-22 | Vehicle unlocking systems, devices, and methods |
Publications (1)
Publication Number | Publication Date |
---|---|
US10137857B1 true US10137857B1 (en) | 2018-11-27 |
Family
ID=64316124
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/683,375 Active US10137857B1 (en) | 2017-08-22 | 2017-08-22 | Vehicle unlocking systems, devices, and methods |
Country Status (3)
Country | Link |
---|---|
US (1) | US10137857B1 (en) |
CN (1) | CN109421664A (en) |
DE (1) | DE102018120343A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190220960A1 (en) * | 2018-01-15 | 2019-07-18 | Good Sportsman Marketing, Llc | Image enhancing wildlife camera |
EP3708442A1 (en) * | 2019-03-14 | 2020-09-16 | Ningbo Geely Automobile Research & Development Co. Ltd. | Window keypad system |
US20200300006A1 (en) * | 2017-11-03 | 2020-09-24 | Kiekert Ag | Emergency actuating device for a movable part of a vehicle |
US20220001724A1 (en) * | 2018-10-01 | 2022-01-06 | Brose Fahrzeugteile Se & Co. Kommanditgesellschaft, Bamberg | Door assembly with transmitter and receiver units for the wireless transmission of energy and/or data |
US11364917B2 (en) * | 2017-12-13 | 2022-06-21 | HELLA GmbH & Co. KGaA | Vehicle having a camera for detecting a body part of a user and method for the operation of the vehicle |
US20220222465A1 (en) * | 2021-01-11 | 2022-07-14 | Dus Operating Inc. | Camera assembly for a facial recognition system of a motor vehicle |
US11458927B2 (en) * | 2019-12-03 | 2022-10-04 | Hyundai Motor Company | In-vehicle payment system and method for generating authorization information using the same |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110154985A (en) * | 2019-06-12 | 2019-08-23 | 湖北东方星海科技实业有限公司 | One kind being based on iris recognition car door controller keyless access system |
JP2021005127A (en) * | 2019-06-25 | 2021-01-14 | 株式会社東海理化電機製作所 | Authentication apparatus and program |
Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0962894A2 (en) | 1998-05-30 | 1999-12-08 | Neil James Stevenson | A vehicle entry/exit control system |
US6031465A (en) * | 1998-04-16 | 2000-02-29 | Burgess; James P. | Keyless entry system for vehicles in particular |
US6323761B1 (en) | 2000-06-03 | 2001-11-27 | Sam Mog Son | Vehicular security access system |
DE10113950A1 (en) | 2001-03-22 | 2002-09-26 | Daimler Chrysler Ag | Iris recognition system for motor vehicle access authentication has a compact mirror arrangement that positions a user so that a camera is focussed on the eye for iris imaging |
US20060056663A1 (en) | 2004-09-13 | 2006-03-16 | Call Clark E M | Keyless entry using biometric identification |
US7034655B2 (en) * | 2002-08-06 | 2006-04-25 | Tri/Mark Corporation | Keypad module and method for electronic access security and keyless entry of a vehicle |
US20060145825A1 (en) * | 2005-01-05 | 2006-07-06 | Mccall Clark E | Virtual keypad for vehicle entry control |
US20060261272A1 (en) * | 2005-05-17 | 2006-11-23 | Denso Corporation | Imaging system |
US7255466B2 (en) * | 2005-05-17 | 2007-08-14 | Lear Corporation | Illuminated keyless entry control device |
US7417681B2 (en) * | 2002-06-26 | 2008-08-26 | Vkb Inc. | Multifunctional integrated image sensor and application to virtual interface technology |
US7637631B2 (en) * | 2004-12-03 | 2009-12-29 | Magna International, Inc. | Non-contact dead front actuation system and lighting assembly for providing keyless entry into a passenger compartment of a motor vehicle |
US8640946B1 (en) * | 1998-04-17 | 2014-02-04 | Diebold Self-Service Systems, Division Of Diebold, Incorporated | ATM that allows a user to select a desired transaction by touch dragging a displayed icon that represents the desired transaction |
US8643481B2 (en) * | 2010-09-17 | 2014-02-04 | Johnson Controls Technology Company | Interior rearview mirror assembly with integrated indicator symbol |
US20140200737A1 (en) * | 2012-03-05 | 2014-07-17 | Victor B. Lortz | User identification and personalized vehicle settings management system |
US20150009010A1 (en) * | 2013-07-03 | 2015-01-08 | Magna Electronics Inc. | Vehicle vision system with driver detection |
US8937528B2 (en) | 2012-09-12 | 2015-01-20 | Ford Global Technologies, Llc | Apparatus and method for registering users and managing biometric data thereof in a vehicle |
US8994495B2 (en) | 2012-07-11 | 2015-03-31 | Ford Global Technologies | Virtual vehicle entry keypad and method of use thereof |
US20150098630A1 (en) * | 2013-10-08 | 2015-04-09 | Sri International | Iris biometric recognition module and access control assembly |
US9150123B2 (en) * | 2010-09-01 | 2015-10-06 | Johnson Controls Gmbh | Device and method for adapting a sitting position |
US20160260206A1 (en) * | 2015-03-06 | 2016-09-08 | Samsung Electronics Co., Ltd. | Method and device for irradiating light for photographing iris |
US20160300410A1 (en) * | 2015-04-10 | 2016-10-13 | Jaguar Land Rover Limited | Door Access System for a Vehicle |
US9518408B1 (en) | 2015-05-21 | 2016-12-13 | Ford Global Technologies, Llc | Alternate backup entry for vehicles |
US9563998B2 (en) * | 2014-06-11 | 2017-02-07 | Veridium Ip Limited | System and method for facilitating user access to vehicles based on biometric information |
US9707912B1 (en) * | 2016-03-22 | 2017-07-18 | Ford Global Technologies, Llc | Human scanning for interior preferences setup |
US9848113B2 (en) * | 2014-02-21 | 2017-12-19 | Samsung Electronics Co., Ltd. | Multi-band biometric camera system having iris color recognition |
-
2017
- 2017-08-22 US US15/683,375 patent/US10137857B1/en active Active
-
2018
- 2018-08-21 CN CN201810956915.8A patent/CN109421664A/en active Pending
- 2018-08-21 DE DE102018120343.8A patent/DE102018120343A1/en active Pending
Patent Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6031465A (en) * | 1998-04-16 | 2000-02-29 | Burgess; James P. | Keyless entry system for vehicles in particular |
US8640946B1 (en) * | 1998-04-17 | 2014-02-04 | Diebold Self-Service Systems, Division Of Diebold, Incorporated | ATM that allows a user to select a desired transaction by touch dragging a displayed icon that represents the desired transaction |
EP0962894A2 (en) | 1998-05-30 | 1999-12-08 | Neil James Stevenson | A vehicle entry/exit control system |
US6323761B1 (en) | 2000-06-03 | 2001-11-27 | Sam Mog Son | Vehicular security access system |
DE10113950A1 (en) | 2001-03-22 | 2002-09-26 | Daimler Chrysler Ag | Iris recognition system for motor vehicle access authentication has a compact mirror arrangement that positions a user so that a camera is focussed on the eye for iris imaging |
US7417681B2 (en) * | 2002-06-26 | 2008-08-26 | Vkb Inc. | Multifunctional integrated image sensor and application to virtual interface technology |
US7034655B2 (en) * | 2002-08-06 | 2006-04-25 | Tri/Mark Corporation | Keypad module and method for electronic access security and keyless entry of a vehicle |
US20060056663A1 (en) | 2004-09-13 | 2006-03-16 | Call Clark E M | Keyless entry using biometric identification |
US7637631B2 (en) * | 2004-12-03 | 2009-12-29 | Magna International, Inc. | Non-contact dead front actuation system and lighting assembly for providing keyless entry into a passenger compartment of a motor vehicle |
US20060145825A1 (en) * | 2005-01-05 | 2006-07-06 | Mccall Clark E | Virtual keypad for vehicle entry control |
US20060261272A1 (en) * | 2005-05-17 | 2006-11-23 | Denso Corporation | Imaging system |
US7255466B2 (en) * | 2005-05-17 | 2007-08-14 | Lear Corporation | Illuminated keyless entry control device |
US9150123B2 (en) * | 2010-09-01 | 2015-10-06 | Johnson Controls Gmbh | Device and method for adapting a sitting position |
US8643481B2 (en) * | 2010-09-17 | 2014-02-04 | Johnson Controls Technology Company | Interior rearview mirror assembly with integrated indicator symbol |
US20140200737A1 (en) * | 2012-03-05 | 2014-07-17 | Victor B. Lortz | User identification and personalized vehicle settings management system |
US8994495B2 (en) | 2012-07-11 | 2015-03-31 | Ford Global Technologies | Virtual vehicle entry keypad and method of use thereof |
US8937528B2 (en) | 2012-09-12 | 2015-01-20 | Ford Global Technologies, Llc | Apparatus and method for registering users and managing biometric data thereof in a vehicle |
US20150009010A1 (en) * | 2013-07-03 | 2015-01-08 | Magna Electronics Inc. | Vehicle vision system with driver detection |
US20150098630A1 (en) * | 2013-10-08 | 2015-04-09 | Sri International | Iris biometric recognition module and access control assembly |
US9848113B2 (en) * | 2014-02-21 | 2017-12-19 | Samsung Electronics Co., Ltd. | Multi-band biometric camera system having iris color recognition |
US9563998B2 (en) * | 2014-06-11 | 2017-02-07 | Veridium Ip Limited | System and method for facilitating user access to vehicles based on biometric information |
US9783162B2 (en) * | 2014-06-11 | 2017-10-10 | Veridium Ip Limited | System and method for facilitating user access to vehicles based on biometric information |
US20160260206A1 (en) * | 2015-03-06 | 2016-09-08 | Samsung Electronics Co., Ltd. | Method and device for irradiating light for photographing iris |
US20160300410A1 (en) * | 2015-04-10 | 2016-10-13 | Jaguar Land Rover Limited | Door Access System for a Vehicle |
US9518408B1 (en) | 2015-05-21 | 2016-12-13 | Ford Global Technologies, Llc | Alternate backup entry for vehicles |
US9707912B1 (en) * | 2016-03-22 | 2017-07-18 | Ford Global Technologies, Llc | Human scanning for interior preferences setup |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200300006A1 (en) * | 2017-11-03 | 2020-09-24 | Kiekert Ag | Emergency actuating device for a movable part of a vehicle |
US11781350B2 (en) * | 2017-11-03 | 2023-10-10 | Kiekert Ag | Emergency actuating device for a movable part of a vehicle |
US11364917B2 (en) * | 2017-12-13 | 2022-06-21 | HELLA GmbH & Co. KGaA | Vehicle having a camera for detecting a body part of a user and method for the operation of the vehicle |
US20190220960A1 (en) * | 2018-01-15 | 2019-07-18 | Good Sportsman Marketing, Llc | Image enhancing wildlife camera |
US20220001724A1 (en) * | 2018-10-01 | 2022-01-06 | Brose Fahrzeugteile Se & Co. Kommanditgesellschaft, Bamberg | Door assembly with transmitter and receiver units for the wireless transmission of energy and/or data |
EP3708442A1 (en) * | 2019-03-14 | 2020-09-16 | Ningbo Geely Automobile Research & Development Co. Ltd. | Window keypad system |
US11458927B2 (en) * | 2019-12-03 | 2022-10-04 | Hyundai Motor Company | In-vehicle payment system and method for generating authorization information using the same |
US20220222465A1 (en) * | 2021-01-11 | 2022-07-14 | Dus Operating Inc. | Camera assembly for a facial recognition system of a motor vehicle |
Also Published As
Publication number | Publication date |
---|---|
DE102018120343A1 (en) | 2019-02-28 |
CN109421664A (en) | 2019-03-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10137857B1 (en) | Vehicle unlocking systems, devices, and methods | |
US10377234B2 (en) | Vehicle ignition systems and methods | |
US11766993B2 (en) | Automatic power door opening on sustained presence | |
US7248151B2 (en) | Virtual keypad for vehicle entry control | |
US10099656B2 (en) | Swipe and tap verification for entry system using swipe and tap touch switch | |
US8994495B2 (en) | Virtual vehicle entry keypad and method of use thereof | |
US9988016B1 (en) | Authentication of mobile devices for vehicle communication | |
US11167725B2 (en) | Iris-detection alignment for vehicle feature activation | |
US10220806B2 (en) | Monitoring and alerting vehicle occupants for ignition systems | |
US20190066424A1 (en) | Biometric authentication for a vehicle without prior registration | |
US10718148B2 (en) | Vehicle door assistance | |
US20140204211A1 (en) | Method and device for vehicle access control | |
CN111002946B (en) | Vehicle control method and control system | |
US20150353033A1 (en) | Hybrid entry system | |
US11267439B2 (en) | Activation of valet mode for vehicles | |
US10131321B1 (en) | System for keyless valet parking | |
CN109243024A (en) | A kind of automobile unlocking system and method based on recognition of face | |
CN110154978A (en) | Convenient for the method and apparatus of Vehicle locking | |
GB2512313A (en) | A system for controlling functions of a vehicle by speech | |
CN208861343U (en) | A kind of automobile system for unlocking based on recognition of face | |
KR102263153B1 (en) | Motion recognition device and operating method thereof | |
US11760309B2 (en) | Vehicle and control method thereof | |
JP2021091274A (en) | Window display system and vehicle system including the same | |
TWI738408B (en) | Pillars for smart cars | |
US20230222858A1 (en) | Systems and methods for activating a digital key based on a vital sign |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |