US20210264179A1 - Appartuses, Systems and Methods for Compressing Image Data that is Representative of a Series of Digital Images - Google Patents
Appartuses, Systems and Methods for Compressing Image Data that is Representative of a Series of Digital Images Download PDFInfo
- Publication number
- US20210264179A1 US20210264179A1 US15/964,209 US201815964209A US2021264179A1 US 20210264179 A1 US20210264179 A1 US 20210264179A1 US 201815964209 A US201815964209 A US 201815964209A US 2021264179 A1 US2021264179 A1 US 2021264179A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- location
- image
- orientation
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000003384 imaging method Methods 0.000 claims description 31
- 230000008859 change Effects 0.000 claims description 28
- 230000001413 cellular effect Effects 0.000 claims description 8
- 238000013144 data compression Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims 4
- 238000012544 monitoring process Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 13
- 210000003128 head Anatomy 0.000 description 9
- 230000006399 behavior Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000036544 posture Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Classifications
-
- G06K9/00832—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/01542—Passenger detection systems detecting passenger motion
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/01552—Passenger detection systems detecting position of specific human body parts, e.g. face, eyes or hands
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0053—Handover processes from vehicle to occupant
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
- G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/42—Determining position
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/0055—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots with safety arrangements
- G05D1/0061—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots with safety arrangements for transition from automatic pilot to manual pilot and vice versa
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
-
- G06K9/6202—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/593—Recognising seat occupancy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/11—Hand-related biometrics; Hand pose recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8006—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0062—Adapting control system settings
- B60W2050/0075—Automatic parameter input, automatic initialising or calibrating means
- B60W2050/0095—Automatic control mode change
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/54—Audio sensitive means, e.g. ultrasound
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/22—Psychological state; Stress level or workload
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/225—Direction of gaze
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/26—Incapacity
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
- B60Y2400/301—Sensors for position or displacement
- B60Y2400/3015—Optical cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
- B60Y2400/301—Sensors for position or displacement
- B60Y2400/3017—Radars
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30268—Vehicle interior
Definitions
- the present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data. More particularly, the present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data that is representative of a series of digital images.
- Vehicles are being provided with more complex systems.
- vehicles commonly include a plethora of entertainment systems, such as stereos, USB interfaces for mobile telephones, video players, etc.
- Vehicles often have a host of other operator interfaces, such as emergency calling systems, vehicle navigation systems, heating and air conditioning systems, interior and exterior lighting controls, air bags, seatbelts, etc.
- Vehicle operating environments are becoming more complex as well. For example, some roadways include u-turn lanes, round-a-bouts, no-left turn, multiple lanes one way in the morning and the other way in the afternoon, etc. Increases in traffic are also contributing to increased complexity.
- a vehicle in-cabin imaging device for compressing image data that is representative of at least one skeletal diagram of at least one occupant within an associated vehicle may include a processor and a memory.
- the image data may be stored on the memory, and the image data may be representative of a series of time-stamped digital images.
- the vehicle in-cabin imaging device may also include an image comparison module stored on the memory that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image.
- the vehicle in-cabin imaging device may further include an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- a computer-implemented method for automatically compressing image data that is representative of a series of images of an interior of a vehicle may include an image data receiving module stored on a memory that, when executed by a processor, causes the processor to receive image data.
- the image data may be representative of a series of time-stamped digital images.
- the method may also include an image comparison module stored on the memory that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image.
- the method may further include an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- a non-transitory computer-readable medium storing computer-readable instruction that, when executed by a processor, cause the processor to automatically compress image data associated with a series of images of an interior of a vehicle may include an image data receiving module that, when executed by a processor, causes the processor to receive image data.
- the image data may be representative of a series of time-stamped digital images.
- the non-transitory computer-readable medium may also include an image comparison module that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image.
- the non-transitory computer-readable medium may further include an image data compression module that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- an image data compression module that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- FIGS. 1A-1C depict various views of the interior of an example vehicle that illustrate locations of vehicle operator monitoring devices within the vehicle;
- FIGS. 2A-2C illustrate various example images constructed from data retrieved from the vehicle monitoring devices of FIGS. 1A-1C :
- FIG. 3 illustrates a block diagram of a computer network, a computer server and an on-board vehicle computer on which an exemplary vehicle occupant monitoring system and method may operate in accordance with the described embodiments;
- FIG. 4 illustrates a block diagram of an exemplary vehicle in-cabin imaging device for use in acquiring, analyzing, compressing, and transmitting images of a vehicle interior
- FIG. 5 depicts a flow diagram of an example method of acquiring, analyzing, compressing, and transmitting images of a vehicle interior.
- Apparatuses, systems and methods for acquiring images of occupants inside a vehicle may include using a vehicle in-cabin device that automatically compresses the associated image data.
- a vehicle in-cabin device may receive image data representative of a series of digital images.
- the vehicle in-cabin device may compare sequential images, within the series of digital images, and may time stamp a group of sequential images that are determined to be similar to one another (e.g., a group of sequential images may indicated that very little, if any, changed from one image to a next).
- a sequence of images may be represented by any one image within a correspondingly time-stamped range. Accordingly, associated memory, processing, and related data transmission requirements are reduced compared to previous approaches.
- Related methods and systems for generating data representative of vehicle in-cabin insurance risk evaluations may include, for example, the following capabilities: 1) determine whether a vehicle driver is looking at a road (i.e., tracking the driver's face/eyes, with emphasis on differentiating between similar actions, such as a driver who is adjusting a radio while looking at the road versus adjusting the radio while not looking at the road at all); 2) determine whether a driver's hands are empty (e.g., including determining an approximate size/shape of an object in a driver's hands to, for example, differentiate between a cell phone and a large cup, for example); 3) identify a finite number of vehicle occupant postures; and 4) vehicle occupant postures, that are logged, may be rotated and scaled to be normalized for a range of different drivers.
- An associated mobile application may accommodate all computer system platforms, such as, iOS, Android and Windows, to connect a vehicle in-cabin device to, for example, a cell phone.
- the mobile application may provide a user friendly interface for reporting and troubleshooting vehicle in-cabin device operation.
- the vehicle interior monitoring system 100 a may include a center-dash vehicle in-cabin device position 125 a located in a center area of a dash, a driver-side A-pillar vehicle in-cabin device position 135 a located in a driver side A-pillar 130 a , a passenger-side A-pillar vehicle in-cabin device position 145 a located in a passenger-side A-pillar 140 a and a rearview mirror vehicle in-cabin device position 160 a located on a bottom-side of the rearview mirror 155 a .
- the vehicle interior monitoring system 100 a may further, or alternatively, include vehicle in-cabin device positions in a driver-side visor 165 a , a passenger-side visor 170 a , a rearview mirror mounting bracket 150 a and, or the steering wheel 110 a .
- a position of a left-hand 115 a of a vehicle driver and, or a position of a right-hand 120 a of the vehicle driver, relative to, for example, a vehicle steering wheel 110 a may be determined based on data acquired from any one of the vehicle in-cabin device positions 125 a , 135 a , 145 a , 160 a .
- Any one of the vehicle in-cabin device positions 125 a , 135 a , 145 a , 160 a may be automatically determined based on, for example, an input from an image sensor, an infrared sensor, an ultrasonic sensor, a compass sensor, a GPS sensor, a microphone or any other suitable sensor.
- the vehicle monitoring system 100 b may include a driver-side B-pillar vehicle in-cabin device position 180 b located in a driver-side B-pillar 175 b and a center-dash vehicle in-cabin device position 125 b located in a center area of the dash. While not shown in FIG. 1B , the vehicle monitoring system 100 b may include a passenger-side B-pillar vehicle in-cabin device position and, or any other vehicle in-cabin device position as described in conjunction with FIG. 1A . The vehicle monitoring system 100 b may further include a display device 185 b . The display device 185 b may be located in, for example, a vehicle in-cabin device located in a center-console area.
- data acquired from the vehicle in-cabin device 125 b , 180 b may be used to automatically determine a location of the vehicle in-cabin device, a position of a driver-side seat 190 b , a passenger-side seat 195 b , a steering wheel 110 b and, or at least a portion of a vehicle driver (not shown in FIG. 1B ).
- the vehicle interior monitoring system 100 c may include a driver-side A-pillar vehicle in-cabin device position 135 c located in a driver side A-pillar 130 c , a passenger-side A-pillar vehicle in-cabin device position 145 c located in a passenger-side A-pillar 140 c and a rearview mirror vehicle in-cabin device position 160 c located on a bottom-side of the rearview mirror 155 c .
- the vehicle interior monitoring system 100 c may further, or alternatively, include vehicle in-cabin device positions in a rearview mirror mounting bracket 150 c and, or the steering wheel 110 c . While not shown in FIG.
- the vehicle monitoring system 100 c may include any other vehicle in-cabin device positions as described in conjunction with FIGS. 1A and 1B .
- data acquired from the vehicle in-cabin device position 135 c , 145 c may be used to automatically determine a location of the vehicle in-cabin device, a driver-side seat 190 c , a passenger-side seat 195 c , a steering wheel 110 c and, or at least a portion of a vehicle driver (not shown in FIG. 1C ).
- vehicle interiors 200 a , 200 b , 200 c are depicted.
- data acquired from a vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b of FIGS. 1A and 1B may be used to determine a position of at least a portion of a passenger 297 a within the vehicle interior 200 a .
- the data acquired from a vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b may be used to determine whether, or not the passenger 297 a is wearing a seatbelt 296 a .
- 1A and 1B may be used to determine a position and, or orientation of a vehicle driver's head 219 a and, or right-hand 220 a on a steering wheel 210 a .
- the data acquired from a vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b may be used to determine whether the vehicle driver's head 219 a is oriented toward a rearview mirror 255 a , oriented toward the driver-side A-pillar 230 a or oriented toward the front windshield.
- the data acquired from the vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b may be used to determine whether the driver is wearing a seatbelt 291 a .
- the vehicle interior 200 a may include a vehicle in-cabin device having a microphone 250 a located proximate the rearview mirror 255 a .
- data acquired from the microphone 250 a may be used to determine a source of sound within the vehicle interior 200 a and, or a volume of the sound.
- FIG. 2B depicts a vehicle interior 200 b including a driver-side A-pillar vehicle in-cabin device position 235 b located on a driver-side A-pillar 230 b .
- data acquired from the vehicle in-cabin device 235 b may be used to determine a position and, or orientation of a driver's head 219 b , the driver's left hand 215 b and, or right hand 220 b relative to the steering wheel 210 b .
- data acquired from the vehicle in-cabin device 235 b (along with any other suitably located vehicle in-cabin device) may be used to determine a gesture that the driver is performing with her left hand 215 b.
- a vehicle interior 200 b depicts a vehicle in-cabin device 260 c located on a bottom side of a rearview mirror 255 c opposite a rearview mirror mount 250 c .
- data acquired from the vehicle in-cabin device 260 c may be used to determine a position and, or orientation of a driver's head 219 c , the driver's left hand 215 c and, or right hand 220 c relative to the steering wheel 210 c .
- data acquired from the vehicle in-cabin device 260 c may be used to determine that the driver's head 219 c is oriented toward a cellular telephone 221 c in her right hand 220 c .
- a determination may be made that the driver is inattentive to the road based on the driver's head 219 c being oriented toward the cellular telephone 221 c.
- vehicle in-cabin system 300 may implement communications between a vehicle in-cabin device 305 and a remote computing device 310 (e.g., a remote server) to provide vehicle in-cabin device 305 location and/or orientation data, and vehicle interior occupant position data to, for example, an insurance related database 370 .
- the vehicle in-cabin system 300 may acquire data from a vehicle in-cabin device (e.g., position sensors within a vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b of FIGS.
- a vehicle in-cabin device e.g., position sensors within a vehicle in-cabin device 125 a , 135 a , 145 a , 160 a , 180 b of FIGS.
- the vehicle in-cabin system 300 may also acquire data from a microphone (e.g., microphone 250 a of FIG. 2A ) and determine a source of sound and volume of sound within a vehicle interior.
- a microphone e.g., microphone 250 a of FIG. 2A
- the vehicle in-cabin device 305 may include a memory 320 and a processor 325 for storing and executing, respectively, a module 321 .
- the module 321 stored in the memory 320 as a set of computer-readable instructions, may be related to a vehicle interior and occupant position data collecting application that, when executed on the processor 325 , causes vehicle in-cabin device location data to be stored in the memory 320 .
- Execution of the module 321 may also cause the processor 325 to generate at least one 3D model of at least a portion of a vehicle occupant (e.g., a driver and/or passenger) within the vehicle interior. Execution of the module 321 may further cause the processor 325 to associate the vehicle in-cabin device location data with a time and, or date. Execution of the module 321 may further cause the processor 325 to communicate with the processor 355 of the remote computing device 310 via the network interface 330 , the vehicle in-cabin device communications network connection 331 and the wireless communication network 315 .
- a vehicle occupant e.g., a driver and/or passenger
- the vehicle in-cabin device 305 may also include a compass sensor 327 , a global positioning system (GPS) sensor 329 , and a battery 323 .
- the vehicle in-cabin device 305 may further include an image sensor input 335 communicatively connected to, for example, a first image sensor 336 and a second image sensor 337 . While two image sensors 336 , 337 are depicted in FIG. 3 , any number of image sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted in FIGS. 1A-1C .
- the vehicle in-cabin device 305 may also include an infrared sensor input 340 communicatively connected to a first infrared sensor 341 and a second infrared sensor 342 . While two infrared sensors 341 , 342 are depicted in FIG. 3 , any number of infrared sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted in FIGS. 1A-1C .
- the vehicle in-cabin device 305 may further include an ultrasonic sensor input 345 communicatively connected to a first ultrasonic sensor 346 and a second ultrasonic sensor 347 . While two ultrasonic sensors 346 , 347 are depicted in FIG.
- any number of ultrasonic sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted in FIGS. 1A-1C .
- the vehicle in-cabin device 305 may also include a microphone input 350 communicatively connected to a first microphone 351 and a second microphone 352 . While two microphones 351 , 352 are depicted in FIG. 3 , any number of microphones may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted in FIGS. 1A-1C .
- the vehicle in-cabin device 305 may further include a display/user input device 325 .
- a first image sensor 336 may be located in a driver-side A-pillar (e.g., location of position sensor 135 a of FIG. 1A ), a second image sensor 337 may be located in a passenger-side A-pillar (e.g., location of position sensor 145 a of FIG. 1A ), a first infrared sensor 341 may be located in a driver-side B-pillar (e.g., location of position sensor 180 b of FIG.
- a second infrared sensor 342 may be located in a passenger-side B-pillar (not shown in the Figs.), first and second ultrasonic sensors 346 , 347 may be located in a center portion of a vehicle dash (e.g., location of position sensor 125 a of FIG. 1A ) and first and second microphones 351 , 352 may be located on a bottom portion of a vehicle interior rearview mirror (e.g., location of position sensor 160 a of FIG. 1A ).
- the processor 315 may acquire position data from any one of, or all of, these sensors 336 , 337 , 341 , 342 , 346 , 347 , 351 , 352 and generate at least one 3D model (e.g., a 3D model of at least a portion of a vehicle driver) based on the position data.
- the processor 315 may transmit data representative of at least one 3D model to the remote computing device 310 .
- the processor 315 may transmit the position data to the remote computing device 310 and the processor 355 may generate at least one 3D model based on the position data.
- the processor 315 or the processor 355 may retrieve data representative of a 3D model of a vehicle operator, and may compare the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model vehicle operator.
- the processor 315 and, or the processor 355 may generate a vehicle driver warning based on the comparison of the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model vehicle operator to warn the vehicle operator that his position is indicative of inattentiveness.
- the processor 315 and/or the processor 355 may generate an advisory based on the comparison of the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model of a vehicle operator to advise the vehicle operator how to correct her position to improve attentiveness.
- the network interface 330 may be configured to facilitate communications between the vehicle in-cabin device 305 and the remote computing device 310 via any hardwired or wireless communication network 315 , including for example a wireless LAN, MAN or WAN, WiFi, the Internet, or any combination thereof.
- the vehicle in-cabin device 305 may be communicatively connected to the remote computing device 310 via any suitable communication system, such as via any publicly available or privately owned communication network, including those that use wireless communication structures, such as wireless communication networks, including for example, wireless LANs and WANs, satellite and cellular telephone communication systems, etc.
- the vehicle in-cabin device 305 may cause insurance risk related data to be stored in a remote computing device 310 memory 360 and/or a remote insurance related database 370 .
- the remote computing device 310 may include a memory 360 and a processor 355 for storing and executing, respectively, a module 361 .
- the module 361 stored in the memory 360 as a set of computer-readable instructions, facilitates applications related to determining a vehicle in-cabin device location and/or collecting insurance risk related data.
- the module 361 may also facilitate communications between the computing device 310 and the vehicle in-cabin device 305 via a network interface 365 , a remote computing device network connection 366 and the network 315 and other functions and instructions.
- the computing device 310 may be communicatively coupled to an insurance related database 370 . While the insurance related database 370 is shown in FIG. 3 as being communicatively coupled to the remote computing device 310 , it should be understood that the insurance related database 370 may be located within separate remote servers (or any other suitable computing devices) communicatively coupled to the remote computing device 310 . Optionally, portions of insurance related database 370 may be associated with memory modules that are separate from one another, such as a memory 320 of the vehicle in-cabin device 305 .
- a vehicle in-cabin device 405 of a vehicle in-cabin device data collection system 400 is depicted along with method 500 of automatically compressing digital image data, that may be representative of images of a vehicle interior and, or transmitting related data to a remote server 310 .
- the vehicle in-cabin device 405 may be similar to the vehicle in-cabin device with insurance application 305 of FIG. 3 .
- the method 500 may be implemented by executing the modules 415 - 425 on a processor (e.g., processor 315 ).
- the vehicle in-cabin device 405 may include a time stamped image data receiving module 415 , a sequential image comparison module 420 , and a time range/sequence of images association module 425 stored in a memory 420 .
- the modules 415 - 425 may be stored in the memory 420 as a set of computer-readable instructions that, when executed by the processor 315 , may cause the processor 315 to automatically compress image data, that may be representative of images of an interior of a vehicle.
- the processor 315 may execute the time stamped image data receiving module 415 to, for example, cause the processor 315 to receive time stamped image data (block 505 ).
- the time stamped image data may be, for example, representative of a series of images of an interior of a vehicle.
- the processor 315 may receive current image data from, for example, at least one of a compass sensor 327 , a GPS sensor 329 , an image sensor 336 , 337 , an infrared sensor 341 , 342 , an ultrasonic sensor 346 , 347 , and/or a microphone 351 , 352 .
- the current image data may be representative of images, and/or features (e.g., a vehicle occupant head location/orientation, a vehicle occupant hand location/orientation, a vehicle occupant arm location/orientation, a vehicle occupant elbow location/orientation, a vehicle occupant torso location/orientation, a seat belt location, a cellular telephone location, a vehicle occupant eye location/orientation, a vehicle seat location/orientation, etc.) extracted from a respective image, of an interior of a vehicle.
- each image may be associated with a particular day and/or time of day.
- the processor 315 may execute the sequential image comparison module 420 to, for example, cause the processor 315 compare sequential images (block 510 ). For example, the processor 315 may compare sequential images to determine if a threshold change has occurred from one image to a next image within the sequence of images. The threshold change may be, for example, based on a number of pixels that have changed between a first image and a next image.
- the processor 315 may execute the time range/sequence of images association module 425 to, for example, cause the processor 315 to associate a sequence of images (block 515 ).
- the processor 315 may associate a sequence of images that have been determined to not have changed from one image to the next (block 510 ). Thereby, a sequence of images may be represented by any given image within the sequence, and a time range may be associated with the representative image.
- the processor 315 compares a sequence of five images and determines that little, or no, change has occurred from a first image to the fifth image, the sequence of images may be represented by any given one of the five images. Accordingly, memory, processing, and transmission requirements may be reduced by a factor of five. It should be understood that any number of sequential images may be determined to not have changed.
- a car-sharing insurance product could more specifically insure the driver, regardless of the car.
- Traditional underwriting looks at the driver-vehicle combination.
- car-sharing may allow an insurance company to more heavily weight the risk of the driver alone.
- the methods and systems of the present disclosure may allow car-sharing to get that risk information on the driver and carry it forward to whatever car they use. This would be tailored for that particular driver's behavior, rather than demographic and vehicle-use factors. This may allow certain car-sharing entities to have a cost advantage. If the car-sharing entities are paying less insurance, or more specific insurance, the car-sharing entities could pass those savings to their customers and have a retention strategy.
- the methods and systems of the present disclosure may allow for emergency responders by, for example, using gesture recognition systems from an aftermarket/insurance device in order to provide an estimate to first responders about the severity of the crash and what kinds of resources/equipment/expertise is required in order to extricate.
- gesture recognition systems from an aftermarket/insurance device in order to provide an estimate to first responders about the severity of the crash and what kinds of resources/equipment/expertise is required in order to triage—have some idea of what emergency medical needs could be upon arrival. Since the “golden hour” is so critical, and it's not always known how much of that hour has already expired, even a preliminary or broad clue could be helpful in the triage process.
- the aftermarket gesture recognition device is already operating at the time of the crash.
- Accelerometers in the device are able to recognize that a crash has occurred (if a pre-determined acceleration threshold has been reached).
- the device could transmit via the driver's phone (which is already connected via Bluetooth) or perhaps transmit using an onboard transmitter that uses emergency frequencies (and therefore does not require consumer to pay for data fees).
- gesture recognition from any original equipment or aftermarket gesture tracking device, whether or not for insurance purposes.
- the methods and systems of the present disclosure may allow for Transition from Automated to Manual Driving Mode in the case of vehicle automation systems operating the piloting functions with the human in a supervisory role. For example, the vehicle may encounter a situation where control may need to be transferred to the driver, but the driver may or may not be ready to resume control.
- the methods and systems of the present disclosure may allow gesture recognition systems, or any gesture recognition system, to be used to determine if the driver is ready to resume control. If he/she is not ready, then get his/her attention quickly.
- the gesture recognition would be used to ascertain whether the driver is ready to resume control by evaluating the driver's posture, the location of hands, the orientation of head, body language. Use machine learning to evaluate driver engagement/attention/readiness-to-engage based on those variables.
- the gesture recognition could be any original in-vehicle equipment or aftermarket device.
- the methods and systems of the present disclosure may distinguish between Automated and Manual driving modalities for variable insurance rating for a scenario where there are many vehicles that are capable of automatically operating the piloting functions, and are capable of the driver manually operating the piloting functions.
- the driver can elect to switch between automated and manual driving modes at any point during a drive.
- Gesture recognition would be utilized to distinguish whether a driver is operating the vehicle manually, or whether the vehicle is operating automatically. This could be determined through either OEM or aftermarket hardware.
- the sensors and software algorithms are able to differentiate between automatic and manual driving based on hand movements, head movements, body posture, eye movements. It can distinguish between the driver making hand contact with the steering wheel (to show that he/she is supervising) while acting as a supervisor, versus the driver providing steering input for piloting purposes. Depending on who/what is operating the vehicle would determine what real-time insurance rates the customer is charged.
- the methods and systems of the present disclosure may provide a tool for measuring driver distraction where gesture recognition may be used to identify, distinguish and quantify driver distracted for safety evaluation of vehicle automation systems. This would be used to define metrics and evaluate safety risk for the vehicle human-machine interface as a whole, or individual systems in the case where vehicles have automation and vehicle-to-vehicle/vehicle-to-infrastructure communication capabilities.
- Vehicle automation the vehicle is capable of performing piloting functions without driver input.
- Vehicle-to-vehicle/vehicle-to-infrastructure communication the vehicle may be capable of communicating data about the first vehicle dynamics or environmental traffic/weather conditions around the first vehicle.
- gesture recognition could be useful to quantify risk presented by driver distraction resulting from any vehicle system in the cabin (i.e. an entertainment system, a feature that automates one or more functions of piloting, a convenience system).
- vehicle automation systems and capabilities tools will be needed to evaluate the safety of individual systems in the car, or the car as a whole. Much uncertainty remains about how these systems will be used by drivers (especially those who are not from the community of automotive engineering or automotive safety). Determining whether they create a net benefit to drivers is a big question.
- the methods and systems of the present disclosure may allow gesture recognition to be used to identify the presence of distracted driving behaviors that are correlated with the presence of vehicle automation capabilities.
- the distraction could be quantified by duration that the driver engages in certain behaviors. Risk quantification may also be measured by weighting certain behaviors with higher severity than other behaviors, so the duration times are weighted. Risk quantification may also differentiate subcategories of behaviors based on degree of motion of hands, head, eyes, body. For example, the methods and systems of the present disclosure may distinguish texting with the phone on the steering wheel from texting with the phone in the driver's lap requiring frequent glances up and down. The latter would be quantified with greater risk in terms of severity of distraction. The purpose of this risk evaluation could be for reasons including but not limited to adhering to vehicle regulations, providing information to the general public, vehicle design testing or insurance purposes.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Mechanical Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Signal Processing (AREA)
- Evolutionary Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Aviation & Aerospace Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Graphics (AREA)
- Traffic Control Systems (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
Abstract
The present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data. More particularly, the present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data that is representative of a series of digital images.
Description
- The present application is a continuation of, and claims the benefit of, U.S. patent application Ser. No. 14/994,310, entitled APPARATUSES, SYSTEMS AND METHODS FOR COMPESSING IMAGE DATA THAT IS REPRESENTATIVE OF A SERIES OF DIGITAL IMAGES, filed Jan. 13, 2016, which claims benefit of priority, under 35 U.S.C. § 119(b), to U.S. Provisional Patent Application Ser. No. 62/102,672, entitled METHODS AND SYSTEMS FOR GENERATING DATA REPRESENTATIVE OF VEHICLE IN-CABIN INSURANCE RISK EVALUATIONS, filed Jan. 13, 2015, the disclosures of which are hereby incorporated herein in their entireties by reference for all purposes.
- The present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data. More particularly, the present disclosure is directed to apparatuses, systems and methods for automatically compressing digital image data that is representative of a series of digital images.
- Vehicles are being provided with more complex systems. For example, vehicles commonly include a plethora of entertainment systems, such as stereos, USB interfaces for mobile telephones, video players, etc. Vehicles often have a host of other operator interfaces, such as emergency calling systems, vehicle navigation systems, heating and air conditioning systems, interior and exterior lighting controls, air bags, seatbelts, etc.
- Vehicle operating environments are becoming more complex as well. For example, some roadways include u-turn lanes, round-a-bouts, no-left turn, multiple lanes one way in the morning and the other way in the afternoon, etc. Increases in traffic are also contributing to increased complexity.
- These additional complexities contribute to increases in driver distractions. A great deal of innovation is taking place related to vehicle in-cabin devices for identifying driver distractions, and for reducing driver distractions.
- What is needed are apparatuses, systems and methods for automatically compressing digital image data. What is further needed are methods and systems for generating data representative of vehicle in-cabin insurance risk evaluations based on data representative of skeletal diagrams of a driver that are indicative of driver distractions.
- A vehicle in-cabin imaging device for compressing image data that is representative of at least one skeletal diagram of at least one occupant within an associated vehicle may include a processor and a memory. The image data may be stored on the memory, and the image data may be representative of a series of time-stamped digital images. The vehicle in-cabin imaging device may also include an image comparison module stored on the memory that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image. The vehicle in-cabin imaging device may further include an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- In another embodiment, a computer-implemented method for automatically compressing image data that is representative of a series of images of an interior of a vehicle may include an image data receiving module stored on a memory that, when executed by a processor, causes the processor to receive image data. The image data may be representative of a series of time-stamped digital images. The method may also include an image comparison module stored on the memory that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image. The method may further include an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
- In a further embodiment, a non-transitory computer-readable medium storing computer-readable instruction that, when executed by a processor, cause the processor to automatically compress image data associated with a series of images of an interior of a vehicle may include an image data receiving module that, when executed by a processor, causes the processor to receive image data. The image data may be representative of a series of time-stamped digital images. The non-transitory computer-readable medium may also include an image comparison module that, when executed by a processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image. The non-transitory computer-readable medium may further include an image data compression module that, when executed by the processor, causes the processor to compress the image data, when the processor determines that a threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
-
FIGS. 1A-1C depict various views of the interior of an example vehicle that illustrate locations of vehicle operator monitoring devices within the vehicle; -
FIGS. 2A-2C illustrate various example images constructed from data retrieved from the vehicle monitoring devices ofFIGS. 1A-1C : -
FIG. 3 illustrates a block diagram of a computer network, a computer server and an on-board vehicle computer on which an exemplary vehicle occupant monitoring system and method may operate in accordance with the described embodiments; -
FIG. 4 illustrates a block diagram of an exemplary vehicle in-cabin imaging device for use in acquiring, analyzing, compressing, and transmitting images of a vehicle interior; and -
FIG. 5 depicts a flow diagram of an example method of acquiring, analyzing, compressing, and transmitting images of a vehicle interior. - Apparatuses, systems and methods for acquiring images of occupants inside a vehicle may include using a vehicle in-cabin device that automatically compresses the associated image data. For example, a vehicle in-cabin device may receive image data representative of a series of digital images. The vehicle in-cabin device may compare sequential images, within the series of digital images, and may time stamp a group of sequential images that are determined to be similar to one another (e.g., a group of sequential images may indicated that very little, if any, changed from one image to a next). Thereby, a sequence of images may be represented by any one image within a correspondingly time-stamped range. Accordingly, associated memory, processing, and related data transmission requirements are reduced compared to previous approaches.
- Related methods and systems for generating data representative of vehicle in-cabin insurance risk evaluations may include, for example, the following capabilities: 1) determine whether a vehicle driver is looking at a road (i.e., tracking the driver's face/eyes, with emphasis on differentiating between similar actions, such as a driver who is adjusting a radio while looking at the road versus adjusting the radio while not looking at the road at all); 2) determine whether a driver's hands are empty (e.g., including determining an approximate size/shape of an object in a driver's hands to, for example, differentiate between a cell phone and a large cup, for example); 3) identify a finite number of vehicle occupant postures; and 4) vehicle occupant postures, that are logged, may be rotated and scaled to be normalized for a range of different drivers.
- An associated mobile application may accommodate all computer system platforms, such as, iOS, Android and Windows, to connect a vehicle in-cabin device to, for example, a cell phone. In addition, to act as data connection provider to remote servers, the mobile application may provide a user friendly interface for reporting and troubleshooting vehicle in-cabin device operation.
- Turning to
FIGS. 1A-1C , vehicleinterior monitoring systems FIG. 1A , the vehicleinterior monitoring system 100 a may include a center-dash vehicle in-cabin device position 125 a located in a center area of a dash, a driver-side A-pillar vehicle in-cabin device position 135 a located in adriver side A-pillar 130 a, a passenger-side A-pillar vehicle in-cabin device position 145 a located in a passenger-side A-pillar 140 a and a rearview mirror vehicle in-cabin device position 160 a located on a bottom-side of therearview mirror 155 a. The vehicleinterior monitoring system 100 a may further, or alternatively, include vehicle in-cabin device positions in a driver-side visor 165 a, a passenger-side visor 170 a, a rearviewmirror mounting bracket 150 a and, or thesteering wheel 110 a. As described in detail herein, a position of a left-hand 115 a of a vehicle driver and, or a position of a right-hand 120 a of the vehicle driver, relative to, for example, avehicle steering wheel 110 a may be determined based on data acquired from any one of the vehicle in-cabin device positions cabin device positions - With reference to
FIG. 1B , thevehicle monitoring system 100 b may include a driver-side B-pillar vehicle in-cabin device position 180 b located in a driver-side B-pillar 175 b and a center-dash vehicle in-cabin device position 125 b located in a center area of the dash. While not shown inFIG. 1B , thevehicle monitoring system 100 b may include a passenger-side B-pillar vehicle in-cabin device position and, or any other vehicle in-cabin device position as described in conjunction withFIG. 1A . Thevehicle monitoring system 100 b may further include adisplay device 185 b. Thedisplay device 185 b may be located in, for example, a vehicle in-cabin device located in a center-console area. As illustrated inFIG. 1B , data acquired from the vehicle in-cabin device side seat 190 b, a passenger-side seat 195 b, asteering wheel 110 b and, or at least a portion of a vehicle driver (not shown inFIG. 1B ). - Turning to
FIG. 1C , the vehicleinterior monitoring system 100 c may include a driver-side A-pillar vehicle in-cabin device position 135 c located in a driver side A-pillar 130 c, a passenger-side A-pillar vehicle in-cabin device position 145 c located in a passenger-side A-pillar 140 c and a rearview mirror vehicle in-cabin device position 160 c located on a bottom-side of therearview mirror 155 c. The vehicleinterior monitoring system 100 c may further, or alternatively, include vehicle in-cabin device positions in a rearviewmirror mounting bracket 150 c and, or the steering wheel 110 c. While not shown inFIG. 1C , thevehicle monitoring system 100 c may include any other vehicle in-cabin device positions as described in conjunction withFIGS. 1A and 1B . As illustrated inFIG. 1C , data acquired from the vehicle in-cabin device position side seat 190 c, a passenger-side seat 195 c, a steering wheel 110 c and, or at least a portion of a vehicle driver (not shown inFIG. 1C ). - With reference to
FIGS. 2A-2C ,vehicle interiors cabin device FIGS. 1A and 1B (or any other suitably located vehicle in-cabin device) may be used to determine a position of at least a portion of apassenger 297 a within the vehicle interior 200 a. The data acquired from a vehicle in-cabin device passenger 297 a is wearing aseatbelt 296 a. As further illustrated inFIG. 2A , data acquired from a vehicle in-cabin device FIGS. 1A and 1B (or any other suitably located vehicle in-cabin device) may be used to determine a position and, or orientation of a vehicle driver'shead 219 a and, or right-hand 220 a on asteering wheel 210 a. For example, the data acquired from a vehicle in-cabin device head 219 a is oriented toward arearview mirror 255 a, oriented toward the driver-side A-pillar 230 a or oriented toward the front windshield. The data acquired from the vehicle in-cabin device seatbelt 291 a. In any event, the vehicle interior 200 a may include a vehicle in-cabin device having amicrophone 250 a located proximate therearview mirror 255 a. As described in detail herein, data acquired from themicrophone 250 a may be used to determine a source of sound within the vehicle interior 200 a and, or a volume of the sound. -
FIG. 2B depicts avehicle interior 200 b including a driver-side A-pillar vehicle in-cabin device position 235 b located on a driver-side A-pillar 230 b. As described in detail herein, data acquired from the vehicle in-cabin device 235 b (along with any other suitably located vehicle in-cabin device) may be used to determine a position and, or orientation of a driver'shead 219 b, the driver'sleft hand 215 b and, orright hand 220 b relative to thesteering wheel 210 b. For example, data acquired from the vehicle in-cabin device 235 b (along with any other suitably located vehicle in-cabin device) may be used to determine a gesture that the driver is performing with herleft hand 215 b. - Turning to
FIG. 2C , avehicle interior 200 b depicts a vehicle in-cabin device 260 c located on a bottom side of arearview mirror 255 c opposite arearview mirror mount 250 c. As described in detail herein, data acquired from the vehicle in-cabin device 260 c (along with any other suitably located vehicle in-cabin device) may be used to determine a position and, or orientation of a driver'shead 219 c, the driver'sleft hand 215 c and, orright hand 220 c relative to thesteering wheel 210 c. For example, data acquired from the vehicle in-cabin device 260 c (along with any other suitably located vehicle in-cabin device) may be used to determine that the driver'shead 219 c is oriented toward acellular telephone 221 c in herright hand 220 c. As also described in detail herein, a determination may be made that the driver is inattentive to the road based on the driver'shead 219 c being oriented toward thecellular telephone 221 c. - With reference to
FIG. 3 , a high-level block diagram of vehicle in-cabin system 300 is illustrated that may implement communications between a vehicle in-cabin device 305 and a remote computing device 310 (e.g., a remote server) to provide vehicle in-cabin device 305 location and/or orientation data, and vehicle interior occupant position data to, for example, an insurance relateddatabase 370. The vehicle in-cabin system 300 may acquire data from a vehicle in-cabin device (e.g., position sensors within a vehicle in-cabin device FIGS. 1A and 1B ) and generate three dimensional (3D) models of vehicle interiors and occupants as depicted inFIGS. 2A-2C . The vehicle in-cabin system 300 may also acquire data from a microphone (e.g.,microphone 250 a ofFIG. 2A ) and determine a source of sound and volume of sound within a vehicle interior. - For clarity, only one vehicle in-
cabin device 305 is depicted inFIG. 3 . WhileFIG. 3 depicts only one vehicle in-cabin device 305, it should be understood that any number of vehicle in-cabin devices 305 may be supported. The vehicle in-cabin device 305 may include amemory 320 and aprocessor 325 for storing and executing, respectively, amodule 321. Themodule 321, stored in thememory 320 as a set of computer-readable instructions, may be related to a vehicle interior and occupant position data collecting application that, when executed on theprocessor 325, causes vehicle in-cabin device location data to be stored in thememory 320. Execution of themodule 321 may also cause theprocessor 325 to generate at least one 3D model of at least a portion of a vehicle occupant (e.g., a driver and/or passenger) within the vehicle interior. Execution of themodule 321 may further cause theprocessor 325 to associate the vehicle in-cabin device location data with a time and, or date. Execution of themodule 321 may further cause theprocessor 325 to communicate with theprocessor 355 of theremote computing device 310 via thenetwork interface 330, the vehicle in-cabin devicecommunications network connection 331 and thewireless communication network 315. - The vehicle in-
cabin device 305 may also include acompass sensor 327, a global positioning system (GPS)sensor 329, and abattery 323. The vehicle in-cabin device 305 may further include animage sensor input 335 communicatively connected to, for example, afirst image sensor 336 and asecond image sensor 337. While twoimage sensors FIG. 3 , any number of image sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted inFIGS. 1A-1C . The vehicle in-cabin device 305 may also include aninfrared sensor input 340 communicatively connected to a firstinfrared sensor 341 and a secondinfrared sensor 342. While twoinfrared sensors FIG. 3 , any number of infrared sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted inFIGS. 1A-1C . The vehicle in-cabin device 305 may further include anultrasonic sensor input 345 communicatively connected to a firstultrasonic sensor 346 and a secondultrasonic sensor 347. While twoultrasonic sensors FIG. 3 , any number of ultrasonic sensors may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted inFIGS. 1A-1C . The vehicle in-cabin device 305 may also include amicrophone input 350 communicatively connected to afirst microphone 351 and asecond microphone 352. While twomicrophones FIG. 3 , any number of microphones may be included within a vehicle interior monitoring system and may be located within a vehicle interior as depicted inFIGS. 1A-1C . The vehicle in-cabin device 305 may further include a display/user input device 325. - As one example, a
first image sensor 336 may be located in a driver-side A-pillar (e.g., location ofposition sensor 135 a ofFIG. 1A ), asecond image sensor 337 may be located in a passenger-side A-pillar (e.g., location ofposition sensor 145 a ofFIG. 1A ), a firstinfrared sensor 341 may be located in a driver-side B-pillar (e.g., location ofposition sensor 180 b ofFIG. 1B ), a secondinfrared sensor 342 may be located in a passenger-side B-pillar (not shown in the Figs.), first and secondultrasonic sensors position sensor 125 a ofFIG. 1A ) and first andsecond microphones position sensor 160 a ofFIG. 1A ). Theprocessor 315 may acquire position data from any one of, or all of, thesesensors processor 315 may transmit data representative of at least one 3D model to theremote computing device 310. Alternatively, theprocessor 315 may transmit the position data to theremote computing device 310 and theprocessor 355 may generate at least one 3D model based on the position data. In either event, theprocessor 315 or theprocessor 355 may retrieve data representative of a 3D model of a vehicle operator, and may compare the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model vehicle operator. Theprocessor 315 and, or theprocessor 355 may generate a vehicle driver warning based on the comparison of the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model vehicle operator to warn the vehicle operator that his position is indicative of inattentiveness. Alternatively, theprocessor 315 and/or theprocessor 355 may generate an advisory based on the comparison of the data representative of the 3D model of at least a portion of the vehicle driver with data representative of at least a portion of the 3D model of a vehicle operator to advise the vehicle operator how to correct her position to improve attentiveness. - The
network interface 330 may be configured to facilitate communications between the vehicle in-cabin device 305 and theremote computing device 310 via any hardwired orwireless communication network 315, including for example a wireless LAN, MAN or WAN, WiFi, the Internet, or any combination thereof. Moreover, the vehicle in-cabin device 305 may be communicatively connected to theremote computing device 310 via any suitable communication system, such as via any publicly available or privately owned communication network, including those that use wireless communication structures, such as wireless communication networks, including for example, wireless LANs and WANs, satellite and cellular telephone communication systems, etc. The vehicle in-cabin device 305 may cause insurance risk related data to be stored in aremote computing device 310memory 360 and/or a remote insurance relateddatabase 370. - The
remote computing device 310 may include amemory 360 and aprocessor 355 for storing and executing, respectively, amodule 361. Themodule 361, stored in thememory 360 as a set of computer-readable instructions, facilitates applications related to determining a vehicle in-cabin device location and/or collecting insurance risk related data. Themodule 361 may also facilitate communications between thecomputing device 310 and the vehicle in-cabin device 305 via anetwork interface 365, a remote computingdevice network connection 366 and thenetwork 315 and other functions and instructions. - The
computing device 310 may be communicatively coupled to an insurance relateddatabase 370. While the insurance relateddatabase 370 is shown inFIG. 3 as being communicatively coupled to theremote computing device 310, it should be understood that the insurance relateddatabase 370 may be located within separate remote servers (or any other suitable computing devices) communicatively coupled to theremote computing device 310. Optionally, portions of insurance relateddatabase 370 may be associated with memory modules that are separate from one another, such as amemory 320 of the vehicle in-cabin device 305. - Turning to
FIGS. 4 and 5 , a vehicle in-cabin device 405 of a vehicle in-cabin devicedata collection system 400 is depicted along withmethod 500 of automatically compressing digital image data, that may be representative of images of a vehicle interior and, or transmitting related data to aremote server 310. The vehicle in-cabin device 405 may be similar to the vehicle in-cabin device withinsurance application 305 ofFIG. 3 . Themethod 500 may be implemented by executing the modules 415-425 on a processor (e.g., processor 315). - In any event, the vehicle in-
cabin device 405 may include a time stamped imagedata receiving module 415, a sequentialimage comparison module 420, and a time range/sequence ofimages association module 425 stored in amemory 420. The modules 415-425 may be stored in thememory 420 as a set of computer-readable instructions that, when executed by theprocessor 315, may cause theprocessor 315 to automatically compress image data, that may be representative of images of an interior of a vehicle. - The
processor 315 may execute the time stamped imagedata receiving module 415 to, for example, cause theprocessor 315 to receive time stamped image data (block 505). The time stamped image data may be, for example, representative of a series of images of an interior of a vehicle. Theprocessor 315 may receive current image data from, for example, at least one of acompass sensor 327, aGPS sensor 329, animage sensor infrared sensor ultrasonic sensor microphone - The
processor 315 may execute the sequentialimage comparison module 420 to, for example, cause theprocessor 315 compare sequential images (block 510). For example, theprocessor 315 may compare sequential images to determine if a threshold change has occurred from one image to a next image within the sequence of images. The threshold change may be, for example, based on a number of pixels that have changed between a first image and a next image. - The
processor 315 may execute the time range/sequence ofimages association module 425 to, for example, cause theprocessor 315 to associate a sequence of images (block 515). For example, theprocessor 315 may associate a sequence of images that have been determined to not have changed from one image to the next (block 510). Thereby, a sequence of images may be represented by any given image within the sequence, and a time range may be associated with the representative image. - As a particular example, if the
processor 315 compares a sequence of five images and determines that little, or no, change has occurred from a first image to the fifth image, the sequence of images may be represented by any given one of the five images. Accordingly, memory, processing, and transmission requirements may be reduced by a factor of five. It should be understood that any number of sequential images may be determined to not have changed. - A car-sharing insurance product could more specifically insure the driver, regardless of the car. Traditional underwriting looks at the driver-vehicle combination. For example, car-sharing may allow an insurance company to more heavily weight the risk of the driver alone. The methods and systems of the present disclosure may allow car-sharing to get that risk information on the driver and carry it forward to whatever car they use. This would be tailored for that particular driver's behavior, rather than demographic and vehicle-use factors. This may allow certain car-sharing entities to have a cost advantage. If the car-sharing entities are paying less insurance, or more specific insurance, the car-sharing entities could pass those savings to their customers and have a retention strategy.
- The methods and systems of the present disclosure may allow for emergency responders by, for example, using gesture recognition systems from an aftermarket/insurance device in order to provide an estimate to first responders about the severity of the crash and what kinds of resources/equipment/expertise is required in order to extricate. Using the gesture recognition systems from an aftermarket/insurance device in order to provide an estimate to first responders about the severity of the crash and what kinds of resources/equipment/expertise is required in order to triage—have some idea of what emergency medical needs could be upon arrival. Since the “golden hour” is so critical, and it's not always known how much of that hour has already expired, even a preliminary or broad clue could be helpful in the triage process. The aftermarket gesture recognition device is already operating at the time of the crash. It is collecting data about the driver's position/posture and the location of the arms relative to the body and structures in the vehicle (i.e. the steering wheel). Accelerometers in the device are able to recognize that a crash has occurred (if a pre-determined acceleration threshold has been reached). Upon crash detection the device could transmit via the driver's phone (which is already connected via Bluetooth) or perhaps transmit using an onboard transmitter that uses emergency frequencies (and therefore does not require consumer to pay for data fees). Using gesture recognition from any original equipment or aftermarket gesture tracking device, whether or not for insurance purposes.
- The methods and systems of the present disclosure may allow for Transition from Automated to Manual Driving Mode in the case of vehicle automation systems operating the piloting functions with the human in a supervisory role. For example, the vehicle may encounter a situation where control may need to be transferred to the driver, but the driver may or may not be ready to resume control. The methods and systems of the present disclosure may allow gesture recognition systems, or any gesture recognition system, to be used to determine if the driver is ready to resume control. If he/she is not ready, then get his/her attention quickly. The gesture recognition would be used to ascertain whether the driver is ready to resume control by evaluating the driver's posture, the location of hands, the orientation of head, body language. Use machine learning to evaluate driver engagement/attention/readiness-to-engage based on those variables. The gesture recognition could be any original in-vehicle equipment or aftermarket device.
- The methods and systems of the present disclosure may distinguish between Automated and Manual driving modalities for variable insurance rating for a scenario where there are many vehicles that are capable of automatically operating the piloting functions, and are capable of the driver manually operating the piloting functions. The driver can elect to switch between automated and manual driving modes at any point during a drive. Gesture recognition would be utilized to distinguish whether a driver is operating the vehicle manually, or whether the vehicle is operating automatically. This could be determined through either OEM or aftermarket hardware. The sensors and software algorithms are able to differentiate between automatic and manual driving based on hand movements, head movements, body posture, eye movements. It can distinguish between the driver making hand contact with the steering wheel (to show that he/she is supervising) while acting as a supervisor, versus the driver providing steering input for piloting purposes. Depending on who/what is operating the vehicle would determine what real-time insurance rates the customer is charged.
- The methods and systems of the present disclosure may provide a tool for measuring driver distraction where gesture recognition may be used to identify, distinguish and quantify driver distracted for safety evaluation of vehicle automation systems. This would be used to define metrics and evaluate safety risk for the vehicle human-machine interface as a whole, or individual systems in the case where vehicles have automation and vehicle-to-vehicle/vehicle-to-infrastructure communication capabilities. With Vehicle automation: the vehicle is capable of performing piloting functions without driver input. With Vehicle-to-vehicle/vehicle-to-infrastructure communication incorporated, the vehicle may be capable of communicating data about the first vehicle dynamics or environmental traffic/weather conditions around the first vehicle. For any entity looking to evaluate the safety or risk presented by a vehicle with automated driving capabilities, gesture recognition could be useful to quantify risk presented by driver distraction resulting from any vehicle system in the cabin (i.e. an entertainment system, a feature that automates one or more functions of piloting, a convenience system). With the rise of vehicle automation systems and capabilities, tools will be needed to evaluate the safety of individual systems in the car, or the car as a whole. Much uncertainty remains about how these systems will be used by drivers (especially those who are not from the community of automotive engineering or automotive safety). Determining whether they create a net benefit to drivers is a big question. The methods and systems of the present disclosure may allow gesture recognition to be used to identify the presence of distracted driving behaviors that are correlated with the presence of vehicle automation capabilities. The distraction could be quantified by duration that the driver engages in certain behaviors. Risk quantification may also be measured by weighting certain behaviors with higher severity than other behaviors, so the duration times are weighted. Risk quantification may also differentiate subcategories of behaviors based on degree of motion of hands, head, eyes, body. For example, the methods and systems of the present disclosure may distinguish texting with the phone on the steering wheel from texting with the phone in the driver's lap requiring frequent glances up and down. The latter would be quantified with greater risk in terms of severity of distraction. The purpose of this risk evaluation could be for reasons including but not limited to adhering to vehicle regulations, providing information to the general public, vehicle design testing or insurance purposes.
- This detailed description is to be construed as exemplary only and does not describe every possible embodiment, as describing every possible embodiment would be impractical, if not impossible. One may be implement numerous alternate embodiments, using either current technology or technology developed after the filing date of this application.
Claims (20)
1. A vehicle in-cabin imaging device for manipulating image data associated with an interior of a vehicle, the vehicle in-cabin imaging device comprising:
a processor and a memory, wherein image data is stored on the memory, wherein the image data is representative of a series of time-stamped digital images, wherein the image data is representative of a first image within the series of time-stamped digital images when a change between the first image and a next image within the series of time-stamped digital images is below a threshold change, and wherein the image data is representative of the next image when a change between the first image and the next image is above a threshold change;
a vehicle interior device data module stored on the memory that, when executed by the processor, causes the processor to receive at least one of: location data or orientation data from at least one vehicle in-cabin imaging device sensor, the location data being indicative of a location of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of timestamped digital images, and the orientation data being indicative of an orientation of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of time-stamped digital images,
wherein the processor determines at least one of: a location of the vehicle in-cabin imaging device based upon the location data, or an orientation of the vehicle in-cabin imaging device based upon the orientation data.
2. The vehicle in-cabin imaging device of claim 1 , the vehicle in-cabin imaging device further comprising:
an image comparison module stored on the memory that, when executed by the processor, causes the processor to compare at least two sequential images of the series of time-stamped digital images to determine if a threshold change has occurred from a first image to a next image.
3. The vehicle in-cabin imaging device of claim 2 , the vehicle in-cabin imaging device further comprising:
an image data compression module stored on the memory that, when executed by the processor, causes the processor to compress the image data, when the processor determines that the threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
4. The vehicle in-cabin imaging device as in claim 3 , wherein, when the processor determines that the threshold change has not occurred from the first image to the next image, a time range is associated with first image data or the next image data that is not deleted.
5. The vehicle in-cabin imaging device as in claim 4 , wherein the time range is based upon a first image time stamp.
6. The vehicle in-cabin imaging device as in claim 4 , wherein the time range is based upon a next image time stamp.
7. The vehicle in-cabin imaging device as in claim 1 , wherein the image data is representative of a three-dimensional location of at least a portion of at least one occupant within the vehicle interior and an orientation of the portion of the at least one vehicle occupant.
8. The vehicle in-cabin imaging device as in claim 1 , wherein the image data is representative of at least one of a vehicle occupant head location/orientation, a vehicle occupant hand location/orientation, a vehicle occupant arm location/orientation, a vehicle occupant elbow location/orientation, a vehicle occupant torso location/orientation, a seat belt location, a cellular telephone location, a vehicle occupant eye location/orientation, or a vehicle seat location/orientation.
9. The vehicle in-cabin imaging device as in claim 1 , wherein the image data is representative of an image feature associated with at least one of: a vehicle occupant head location/orientation, a vehicle occupant hand location/orientation, a vehicle occupant arm location/orientation, a vehicle occupant elbow location/orientation, a vehicle occupant torso location/orientation, a seat belt location, a cellular telephone location, a vehicle occupant eye location/orientation, or a vehicle seat location/orientation.
10. A computer-implemented method for manipulating image data associated with an interior of a vehicle, the method comprising:
receiving, at a processor and in response to the processor executing a vehicle interior device data module, at least one of: location data or orientation data from at least one vehicle in-cabin imaging device sensor, the location data being indicative of a location of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of time-stamped digital images and the orientation data being indicative of an orientation of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of time-stamped digital images, wherein the image data is representative of a first image within the series of time-stamped digital images when a change between the first image and a next image within the series of time-stamped digital images is below a threshold change, wherein the image data is representative of the next image when a change between the first image and the next image is above a threshold change, and wherein the processor determines at least one of: a location of the vehicle in-cabin imaging device based upon the location data, or an orientation of the vehicle in-cabin imaging device based upon the orientation data.
11. The computer-implemented method of claim 10 , the method further comprising:
receiving, at the processor and in response to the processor executing an image data receiving module, image data, wherein the image data is representative of a series of time-stamped digital images; and
comparing, at the processor and in response to the processor executing an image comparison module, at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image.
12. The computer-implemented method of claim 11 , the method further comprising:
compressing, at the processor and in response to the processor executing an image data compression module, the image data, when the processor determines that the threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
13. The computer-implemented method of claim 12 , wherein the image data is representative of an image feature that is associated with at least one of: a vehicle occupant head location/orientation, a vehicle occupant hand location/orientation, a vehicle occupant arm location/orientation, a vehicle occupant elbow location/orientation, a vehicle occupant torso location/orientation, a seat belt location, a cellular telephone location, a vehicle occupant eye location/orientation, or a vehicle seat location/orientation.
14. The computer-implemented method of claim 12 , wherein the image data is representative of at least one of: a vehicle occupant head location/orientation, a vehicle occupant hand location/orientation, a vehicle occupant arm location/orientation, a vehicle occupant elbow location/orientation, a vehicle occupant torso location/orientation, a seat belt location, a cellular telephone location, a vehicle occupant eye location/orientation, or a vehicle seat location/orientation.
15. The computer-implemented method of claim 12 , wherein the image data is representative of a three-dimensional location of at least one vehicle occupant within the vehicle interior.
16. The computer-implemented method of claim 12 , wherein the image data is representative of an orientation of at least a portion of at least one vehicle occupant within the vehicle interior.
17. The computer-implemented method of claim 12 , wherein the image data is representative of a three-dimensional location of at least a portion of at least one occupant within the vehicle interior and an orientation of the portion of the at least one vehicle occupant.
18. A non-transitory computer-readable medium storing computer-readable instructions that, when executed by a processor, cause the processor to manipulate image data associated with an interior of a vehicle, the non-transitory computer-readable medium comprising:
a vehicle interior device data module that, when executed by the processor, causes the processor to receive at least one of: location data or orientation data from at least one vehicle in-cabin imaging device sensor, the location data being indicative of a location of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of time-stamped digital images, and the orientation data being indicative of an orientation of the vehicle in-cabin imaging device relative to the vehicle occupant within the series of time-stamped digital images, wherein the image data is representative of a first image within the series of time-stamped digital images when a change between the first image and a next image within the series of time-stamped digital images is below a threshold change, and wherein the image data is representative of the next image when a change between the first image and the next image is above a threshold change,
wherein the processor determines at least one of: a location of the vehicle in-cabin imaging device based upon the location data, or an orientation of the vehicle in-cabin imaging device based upon the orientation data.
19. The non-transitory computer-readable medium of claim 18 , wherein the non-transitory computer-readable medium further comprises:
an image data receiving module that, when executed by the processor, causes the processor to receive image data, wherein the image data is representative of a series of timestamped digital images.
20. The non-transitory computer-readable medium of claim 19 , wherein the non-transitory computer-readable medium further comprises:
an image comparison module that, when executed by the processor, causes the processor to compare at least two sequential images, of the series of time-stamped digital images, to determine if a threshold change has occurred from a first image to a next image; and
an image data compression module that, when executed by the processor, causes the processor to compress the image data, when the processor determines that the threshold change has not occurred from the first image to the next image, by deleting either first image data associated with the first image, or next image data associated with the next image, from the image data.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/964,209 US20210264179A1 (en) | 2015-01-13 | 2018-04-27 | Appartuses, Systems and Methods for Compressing Image Data that is Representative of a Series of Digital Images |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562102672P | 2015-01-13 | 2015-01-13 | |
US14/994,310 US10013620B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for compressing image data that is representative of a series of digital images |
US15/964,209 US20210264179A1 (en) | 2015-01-13 | 2018-04-27 | Appartuses, Systems and Methods for Compressing Image Data that is Representative of a Series of Digital Images |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/994,310 Continuation US10013620B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for compressing image data that is representative of a series of digital images |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210264179A1 true US20210264179A1 (en) | 2021-08-26 |
Family
ID=59069534
Family Applications (24)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/994,440 Active 2036-05-23 US10147008B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining whether a vehicle system is distracting to a vehicle operator |
US14/994,415 Active 2036-02-01 US10325167B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for generating data representative of vehicle driver ratings |
US14/994,308 Active 2036-06-17 US10565460B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for classifying digital images |
US14/994,436 Active US9710717B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining vehicle operator distractions |
US14/994,431 Active 2036-04-06 US10147007B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining whether a vehicle is being operated in autonomous mode or manual mode |
US14/994,409 Active 2036-02-19 US9944296B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US14/994,305 Active US10607095B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for classifying digital images |
US14/994,310 Active 2036-07-24 US10013620B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for compressing image data that is representative of a series of digital images |
US14/994,299 Active 2036-03-26 US9886637B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for acquiring images of occupants inside a vehicle |
US14/994,424 Active US9690292B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for transitioning between autonomous and manual modes of vehicle operations |
US14/994,419 Active 2036-03-09 US10140533B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for generating data representative of vehicle occupant postures |
US15/482,916 Active 2036-02-11 US10241512B1 (en) | 2015-01-13 | 2017-04-10 | Apparatuses, systems and method for transitioning between autonomous and manual modes of vehicle operations |
US15/595,392 Active US9990554B1 (en) | 2015-01-13 | 2017-05-15 | Apparatuses, systems and methods for determining vehicle operator distractions |
US15/823,015 Active US10089542B1 (en) | 2015-01-13 | 2017-11-27 | Apparatuses, systems and methods for acquiring images of occupants inside a vehicle |
US15/886,971 Active US10189480B1 (en) | 2015-01-13 | 2018-02-02 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US15/920,678 Active 2036-02-01 US10229333B1 (en) | 2015-01-13 | 2018-03-14 | Apparatuses, systems and methods for determining vehicle operator distractions |
US15/964,209 Abandoned US20210264179A1 (en) | 2015-01-13 | 2018-04-27 | Appartuses, Systems and Methods for Compressing Image Data that is Representative of a Series of Digital Images |
US16/209,006 Active US10562536B1 (en) | 2015-01-13 | 2018-12-04 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US16/735,198 Active 2036-03-24 US11417121B1 (en) | 2015-01-13 | 2020-01-06 | Apparatus, systems and methods for classifying digital images |
US16/797,009 Active 2036-03-20 US11367293B1 (en) | 2015-01-13 | 2020-02-21 | Apparatuses, systems and methods for classifying digital images |
US17/039,916 Active US11373421B1 (en) | 2015-01-13 | 2020-09-30 | Apparatuses, systems and methods for classifying digital images |
US17/824,675 Pending US20220292851A1 (en) | 2015-01-13 | 2022-05-25 | Apparatuses, systems and methods for classifying digital images |
US17/859,866 Active US11685392B2 (en) | 2015-01-13 | 2022-07-07 | Apparatus, systems and methods for classifying digital images |
US18/144,701 Pending US20230271620A1 (en) | 2015-01-13 | 2023-05-08 | Apparatus, systems and methods for classifying digital images |
Family Applications Before (16)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/994,440 Active 2036-05-23 US10147008B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining whether a vehicle system is distracting to a vehicle operator |
US14/994,415 Active 2036-02-01 US10325167B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for generating data representative of vehicle driver ratings |
US14/994,308 Active 2036-06-17 US10565460B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for classifying digital images |
US14/994,436 Active US9710717B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining vehicle operator distractions |
US14/994,431 Active 2036-04-06 US10147007B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining whether a vehicle is being operated in autonomous mode or manual mode |
US14/994,409 Active 2036-02-19 US9944296B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US14/994,305 Active US10607095B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for classifying digital images |
US14/994,310 Active 2036-07-24 US10013620B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for compressing image data that is representative of a series of digital images |
US14/994,299 Active 2036-03-26 US9886637B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for acquiring images of occupants inside a vehicle |
US14/994,424 Active US9690292B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for transitioning between autonomous and manual modes of vehicle operations |
US14/994,419 Active 2036-03-09 US10140533B1 (en) | 2015-01-13 | 2016-01-13 | Apparatuses, systems and methods for generating data representative of vehicle occupant postures |
US15/482,916 Active 2036-02-11 US10241512B1 (en) | 2015-01-13 | 2017-04-10 | Apparatuses, systems and method for transitioning between autonomous and manual modes of vehicle operations |
US15/595,392 Active US9990554B1 (en) | 2015-01-13 | 2017-05-15 | Apparatuses, systems and methods for determining vehicle operator distractions |
US15/823,015 Active US10089542B1 (en) | 2015-01-13 | 2017-11-27 | Apparatuses, systems and methods for acquiring images of occupants inside a vehicle |
US15/886,971 Active US10189480B1 (en) | 2015-01-13 | 2018-02-02 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US15/920,678 Active 2036-02-01 US10229333B1 (en) | 2015-01-13 | 2018-03-14 | Apparatuses, systems and methods for determining vehicle operator distractions |
Family Applications After (7)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/209,006 Active US10562536B1 (en) | 2015-01-13 | 2018-12-04 | Apparatuses, systems and methods for determining distractions associated with vehicle driving routes |
US16/735,198 Active 2036-03-24 US11417121B1 (en) | 2015-01-13 | 2020-01-06 | Apparatus, systems and methods for classifying digital images |
US16/797,009 Active 2036-03-20 US11367293B1 (en) | 2015-01-13 | 2020-02-21 | Apparatuses, systems and methods for classifying digital images |
US17/039,916 Active US11373421B1 (en) | 2015-01-13 | 2020-09-30 | Apparatuses, systems and methods for classifying digital images |
US17/824,675 Pending US20220292851A1 (en) | 2015-01-13 | 2022-05-25 | Apparatuses, systems and methods for classifying digital images |
US17/859,866 Active US11685392B2 (en) | 2015-01-13 | 2022-07-07 | Apparatus, systems and methods for classifying digital images |
US18/144,701 Pending US20230271620A1 (en) | 2015-01-13 | 2023-05-08 | Apparatus, systems and methods for classifying digital images |
Country Status (1)
Country | Link |
---|---|
US (24) | US10147008B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11321951B1 (en) | 2017-01-19 | 2022-05-03 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for integrating vehicle operator gesture detection within geographic maps |
US11373421B1 (en) | 2015-01-13 | 2022-06-28 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for classifying digital images |
Families Citing this family (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11040725B2 (en) | 2015-09-04 | 2021-06-22 | Inrix Inc. | Manual vehicle control notification |
US9964949B2 (en) * | 2015-12-18 | 2018-05-08 | Gm Global Technology Operation Llc | Operating modes for autonomous driving |
US10527736B2 (en) * | 2016-03-17 | 2020-01-07 | Cm Hk Limited | Methods and mobile devices with electric vehicle transportation detection |
CN109070895B (en) * | 2016-04-18 | 2021-08-31 | 本田技研工业株式会社 | Vehicle control system, vehicle control method, and storage medium |
JP6733293B2 (en) * | 2016-04-28 | 2020-07-29 | 株式会社デンソー | Information processing equipment |
US11423671B1 (en) | 2016-06-14 | 2022-08-23 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for detecting vehicle occupant actions |
US9928433B1 (en) * | 2016-06-14 | 2018-03-27 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for determining when a vehicle operator is texting while driving |
US9928434B1 (en) * | 2016-06-14 | 2018-03-27 | State Farm Mutual Automobile Insurance Company | Appartuses, systems, and methods for determining when a vehicle occupant is using a mobile telephone |
IL246387A (en) * | 2016-06-22 | 2017-05-29 | Pointgrab Ltd | Method and system for determining body position of an occupant |
EP3291197A1 (en) * | 2016-08-30 | 2018-03-07 | Volvo Car Corporation | Method and system for establishing whether a road section is suitable for autonomous vehicle driving |
US10586122B1 (en) | 2016-10-31 | 2020-03-10 | United Services Automobile Association | Systems and methods for determining likelihood of traffic incident information |
US10152642B2 (en) * | 2016-12-16 | 2018-12-11 | Automotive Research & Testing Center | Method for detecting driving behavior and system using the same |
US10407079B1 (en) * | 2017-01-19 | 2019-09-10 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for determining distracted drivers associated with vehicle driving routes |
US10558874B1 (en) * | 2017-01-19 | 2020-02-11 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for generation and transmission of vehicle operation mode data |
US10943136B1 (en) * | 2017-01-19 | 2021-03-09 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for generating a vehicle driver signature |
US10366430B2 (en) * | 2017-02-06 | 2019-07-30 | Qualcomm Incorporated | Systems and methods for customizing amenities in shared vehicles |
US11493918B2 (en) * | 2017-02-10 | 2022-11-08 | Magna Electronics Inc. | Vehicle driving assist system with driver attentiveness assessment |
JP7238193B2 (en) * | 2017-07-21 | 2023-03-13 | ソニーセミコンダクタソリューションズ株式会社 | Vehicle control device and vehicle control method |
JP7080598B2 (en) * | 2017-07-21 | 2022-06-06 | ソニーセミコンダクタソリューションズ株式会社 | Vehicle control device and vehicle control method |
SE541715C2 (en) * | 2017-09-22 | 2019-12-03 | Scania Cv Ab | Method and system for promoting use of autonomous passenger vehicles |
US10572745B2 (en) | 2017-11-11 | 2020-02-25 | Bendix Commercial Vehicle Systems Llc | System and methods of monitoring driver behavior for vehicular fleet management in a fleet of vehicles using driver-facing imaging device |
US10339401B2 (en) * | 2017-11-11 | 2019-07-02 | Bendix Commercial Vehicle Systems Llc | System and methods of monitoring driver behavior for vehicular fleet management in a fleet of vehicles using driver-facing imaging device |
US11027741B2 (en) * | 2017-11-15 | 2021-06-08 | Electronics And Telecommunications Research Institute | Apparatus and method for estimating driver readiness and method and system for assisting driver |
DE102017222356A1 (en) * | 2017-12-11 | 2019-06-13 | Robert Bosch Gmbh | Method for operating a GNSS sensor of a vehicle |
CN108860158B (en) * | 2018-07-27 | 2021-08-24 | 平安科技(深圳)有限公司 | Vehicle and vehicle insurance fraud prevention early warning and storage medium |
DE102018215969A1 (en) * | 2018-09-19 | 2020-03-19 | Robert Bosch Gmbh | A method for classifying a non-driving activity of a driver with regard to an interruptibility of the non-driving activity when the driving task is requested to take over and a method for re-releasing a non-driving activity after an interruption of the non-driving activity due to a request to take over the driving task |
JP7091983B2 (en) * | 2018-10-01 | 2022-06-28 | トヨタ自動車株式会社 | Equipment control device |
FR3089328B1 (en) * | 2018-12-03 | 2021-07-23 | Valeo Comfort & Driving Assistance | Device and method for detecting distraction of a driver of a vehicle |
US11940790B2 (en) * | 2018-12-12 | 2024-03-26 | Allstate Insurance Company | Safe hand-off between human driver and autonomous driving system |
US11235776B2 (en) * | 2019-01-31 | 2022-02-01 | Toyota Motor Engineering & Manufacturing North America, Inc. | Systems and methods for controlling a vehicle based on driver engagement |
US11161430B2 (en) | 2019-02-07 | 2021-11-02 | Volvo Car Corporation | Vehicle occupant posture detection |
CN109886213B (en) * | 2019-02-25 | 2021-01-08 | 湖北亿咖通科技有限公司 | Fatigue state determination method, electronic device, and computer-readable storage medium |
US11281920B1 (en) * | 2019-05-23 | 2022-03-22 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for generating a vehicle driver signature |
EP3796209A1 (en) * | 2019-09-17 | 2021-03-24 | Aptiv Technologies Limited | Method and system for determining an activity of an occupant of a vehicle |
KR20190122606A (en) * | 2019-10-11 | 2019-10-30 | 엘지전자 주식회사 | Apparatus and method for monitoring object in vehicle |
CN110764402B (en) * | 2019-10-11 | 2023-03-07 | 北京航天长征飞行器研究所 | Reentry vehicle safety control method based on time window |
JP7347104B2 (en) * | 2019-10-16 | 2023-09-20 | トヨタ自動車株式会社 | Information processing device, non-temporary storage medium, and system |
US11565653B2 (en) | 2020-01-03 | 2023-01-31 | Aptiv Technologies Limited | Vehicle occupancy-monitoring system |
EP3845431B1 (en) * | 2020-01-06 | 2024-08-07 | Aptiv Technologies AG | Driver-monitoring system |
JP6937856B2 (en) * | 2020-02-13 | 2021-09-22 | 本田技研工業株式会社 | Driving assistance devices and vehicles |
CN111325292B (en) * | 2020-03-11 | 2023-05-02 | 中国电子工程设计院有限公司 | Object behavior recognition method and device |
US11912307B2 (en) | 2020-03-18 | 2024-02-27 | Waymo Llc | Monitoring head movements of drivers tasked with monitoring a vehicle operating in an autonomous driving mode |
US11513517B2 (en) * | 2020-03-30 | 2022-11-29 | Uatc, Llc | System and methods for controlling state transitions using a vehicle controller |
EP3915851B1 (en) * | 2020-05-28 | 2024-05-01 | Zenuity AB | System and method for estimating take-over time |
WO2021262166A1 (en) * | 2020-06-25 | 2021-12-30 | Hitachi America, Ltd. | Operator evaluation and vehicle control based on eyewear data |
JP7400672B2 (en) * | 2020-09-14 | 2023-12-19 | トヨタ自動車株式会社 | Vehicle control device |
CN112433619B (en) * | 2021-01-27 | 2021-04-20 | 国汽智控(北京)科技有限公司 | Human-computer interaction method and system for automobile, electronic equipment and computer storage medium |
JP2022129152A (en) * | 2021-02-24 | 2022-09-05 | 株式会社Subaru | Occupant monitoring device of vehicle |
JP2022129156A (en) * | 2021-02-24 | 2022-09-05 | 株式会社Subaru | In-vehicle multi-monitoring device of vehicle |
US11807257B2 (en) * | 2021-06-07 | 2023-11-07 | Toyota Connected North America, Inc. | Sensing interactions with unpermitted components within a vehicle |
US11718314B1 (en) | 2022-03-11 | 2023-08-08 | Aptiv Technologies Limited | Pedestrian alert system |
Family Cites Families (129)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7663502B2 (en) * | 1992-05-05 | 2010-02-16 | Intelligent Technologies International, Inc. | Asset system control arrangement and method |
US7164117B2 (en) * | 1992-05-05 | 2007-01-16 | Automotive Technologies International, Inc. | Vehicular restraint system control system and method using multiple optical imagers |
US5845000A (en) * | 1992-05-05 | 1998-12-01 | Automotive Technologies International, Inc. | Optical identification and monitoring system using pattern recognition for use with vehicles |
US5627765A (en) * | 1994-07-25 | 1997-05-06 | Avid Technology, Inc. | Method and apparatus for compressing and analyzing video and for creating a reference video |
US20070135982A1 (en) * | 1995-06-07 | 2007-06-14 | Automotive Technologies International, Inc. | Methods for Sensing Weight of an Occupying Item in a Vehicular Seat |
DE19637108B4 (en) | 1996-09-12 | 2005-10-27 | Adam Opel Ag | Occupant protection system for motor vehicles and a method for continuously monitoring the seating position of the occupant |
US5818535A (en) * | 1996-09-30 | 1998-10-06 | Alaris, Inc. | Method and apparatus for adaptive hybrid motion video compression and decompression |
US7769342B2 (en) * | 2000-04-27 | 2010-08-03 | Joseph Akwo Tabe | Mega-telecommunication and information system |
US20050162513A1 (en) * | 1999-07-07 | 2005-07-28 | Advanced Future Technologies, Inc. | Vehicle mounted navigation and incident recording device and method of operating |
US7085424B2 (en) * | 2000-06-06 | 2006-08-01 | Kobushiki Kaisha Office Noa | Method and system for compressing motion image information |
US7565230B2 (en) * | 2000-10-14 | 2009-07-21 | Temic Automotive Of North America, Inc. | Method and apparatus for improving vehicle operator performance |
WO2003010727A1 (en) * | 2001-07-25 | 2003-02-06 | Vislog Technology Pte Ltd. | Method and apparatus for processing image data |
US7262790B2 (en) * | 2002-01-09 | 2007-08-28 | Charles Adams Bakewell | Mobile enforcement platform with aimable violation identification and documentation system for multiple traffic violation types across all lanes in moving traffic, generating composite display images and data to support citation generation, homeland security, and monitoring |
JP4143956B2 (en) * | 2002-02-14 | 2008-09-03 | 富士フイルム株式会社 | Image display device and image management program |
US7200266B2 (en) * | 2002-08-27 | 2007-04-03 | Princeton University | Method and apparatus for automated video activity analysis |
ATE454849T1 (en) * | 2002-10-15 | 2010-01-15 | Volvo Technology Corp | METHOD FOR EVALUATION OF A PERSON'S HEAD AND EYE ACTIVITY |
WO2004081850A1 (en) * | 2003-03-13 | 2004-09-23 | Intelligent Mechatronic Systems Inc. | Visual classification and posture estimation of multiple vehicle occupants |
JP4247041B2 (en) * | 2003-04-01 | 2009-04-02 | 本田技研工業株式会社 | Face identification system |
US7266568B1 (en) * | 2003-04-11 | 2007-09-04 | Ricoh Company, Ltd. | Techniques for storing multimedia information with source documents |
KR100651397B1 (en) * | 2004-10-12 | 2006-11-29 | 삼성전자주식회사 | Apparatus and method for setting gyroscope zero point |
JP4741283B2 (en) * | 2005-05-16 | 2011-08-03 | セイコーエプソン株式会社 | Integrated circuit device, microcomputer and surveillance camera system |
US20060259206A1 (en) * | 2005-05-16 | 2006-11-16 | Smith Matthew R | Vehicle operator monitoring system and method |
JP4857825B2 (en) * | 2005-05-31 | 2012-01-18 | 豊田合成株式会社 | Crew protection method and protection structure |
DE102005026456B4 (en) * | 2005-06-09 | 2017-04-20 | Daimler Ag | Method for detecting fatigue |
US20070120697A1 (en) * | 2005-11-29 | 2007-05-31 | Ayoub Ramy P | Method and device for determining a location and orientation of a device in a vehicle |
US7659827B2 (en) * | 2006-05-08 | 2010-02-09 | Drivecam, Inc. | System and method for taking risk out of driving |
US8314708B2 (en) * | 2006-05-08 | 2012-11-20 | Drivecam, Inc. | System and method for reducing driving risk with foresight |
GB2440375A (en) * | 2006-07-21 | 2008-01-30 | Clearswift Ltd | Method for detecting matches between previous and current image files, for files that produce visually identical images yet are different |
JP4670803B2 (en) * | 2006-12-04 | 2011-04-13 | 株式会社デンソー | Operation estimation apparatus and program |
JP2008136789A (en) * | 2006-12-05 | 2008-06-19 | Nec Corp | Eyeball parameter estimating instrument and method |
US20080158357A1 (en) | 2007-01-03 | 2008-07-03 | International Business Machines Corporation | Apparatus for driver analysis using rearview mirror |
US7792328B2 (en) * | 2007-01-12 | 2010-09-07 | International Business Machines Corporation | Warning a vehicle operator of unsafe operation behavior based on a 3D captured image stream |
JP4895847B2 (en) * | 2007-02-08 | 2012-03-14 | アイシン精機株式会社 | 瞼 Detection device and program |
WO2008106804A1 (en) * | 2007-03-07 | 2008-09-12 | Magna International Inc. | Vehicle interior classification system and method |
US9117246B2 (en) * | 2007-07-17 | 2015-08-25 | Inthinc Technology Solutions, Inc. | System and method for providing a user interface for vehicle mentoring system users and insurers |
US20120252350A1 (en) | 2007-07-24 | 2012-10-04 | Allan Steinmetz | Vehicle safety device for reducing driver distractions |
US8520860B2 (en) * | 2007-12-13 | 2013-08-27 | Symbol Technologies, Inc. | Modular mobile computing headset |
CN101980660B (en) * | 2008-09-19 | 2013-01-16 | 松下电器产业株式会社 | Inattentiveness detecting device, inattentiveness detecting method |
WO2010042736A2 (en) * | 2008-10-08 | 2010-04-15 | Johnson Controls Technology Company | Sensor actuated storage compartment |
JP4613999B2 (en) * | 2008-12-22 | 2011-01-19 | 株式会社デンソー | Action estimation device, program |
US8260502B2 (en) * | 2009-04-22 | 2012-09-04 | Toyota Motor Engineering & Manufacturing North America, Inc. | Occupant detection and imaging system |
WO2010141460A1 (en) * | 2009-06-01 | 2010-12-09 | Swarmcast, Inc. | Data retrieval based on bandwidth cost and delay |
WO2010151603A1 (en) * | 2009-06-23 | 2010-12-29 | L&P Property Management Company | Drowsy driver detection system |
CA2754159C (en) * | 2009-08-11 | 2012-05-15 | Certusview Technologies, Llc | Systems and methods for complex event processing of vehicle-related information |
US9349156B2 (en) * | 2009-09-25 | 2016-05-24 | Arm Limited | Adaptive frame buffer compression |
US8280881B1 (en) | 2009-10-29 | 2012-10-02 | Google Inc. | Similar search queries and images |
EP2339507B1 (en) * | 2009-12-28 | 2013-07-17 | Softkinetic Software | Head detection and localisation method |
JP5018926B2 (en) * | 2010-04-19 | 2012-09-05 | 株式会社デンソー | Driving assistance device and program |
US20120028682A1 (en) | 2010-07-29 | 2012-02-02 | Chris Danne | Steering wheel attached cellular phone interface device for communication with alert system |
WO2013043228A1 (en) * | 2011-09-21 | 2013-03-28 | Cellepathy Ltd. | Restricting mobile device usage |
PL3255613T3 (en) * | 2010-12-15 | 2022-12-27 | Auto Telematics Ltd | Method and system for logging vehicle behaviour |
US20130030811A1 (en) * | 2011-07-29 | 2013-01-31 | Panasonic Corporation | Natural query interface for connected car |
US8606492B1 (en) * | 2011-08-31 | 2013-12-10 | Drivecam, Inc. | Driver log generation |
US8996234B1 (en) | 2011-10-11 | 2015-03-31 | Lytx, Inc. | Driver performance determination based on geolocation |
US8849803B2 (en) * | 2011-10-31 | 2014-09-30 | International Business Machines Corporation | Data collection for usage based insurance |
TWI447039B (en) * | 2011-11-25 | 2014-08-01 | Driving behavior analysis and warning system and method thereof | |
US9824064B2 (en) * | 2011-12-21 | 2017-11-21 | Scope Technologies Holdings Limited | System and method for use of pattern recognition in assessing or monitoring vehicle status or operator driving behavior |
US8527146B1 (en) * | 2012-01-30 | 2013-09-03 | Google Inc. | Systems and methods for updating vehicle behavior and settings based on the locations of vehicle passengers |
EP2811474B1 (en) * | 2012-02-01 | 2018-08-08 | Fico Mirrors, SA | Method and system for inferring the behaviour or state of the driver of a vehicle, use method and computer program for carrying out said method |
US20170247000A1 (en) * | 2012-03-14 | 2017-08-31 | Autoconnect Holdings Llc | User interface and virtual personality presentation based on user profile |
US8861804B1 (en) * | 2012-06-15 | 2014-10-14 | Shutterfly, Inc. | Assisted photo-tagging with facial recognition models |
US8441548B1 (en) * | 2012-06-15 | 2013-05-14 | Google Inc. | Facial image quality assessment |
US20140067434A1 (en) * | 2012-08-30 | 2014-03-06 | Agero, Inc. | Methods and Systems for Providing Risk Profile Analytics |
US9428052B1 (en) * | 2012-09-08 | 2016-08-30 | Towers Watson Software Limited | Automated distraction measurement of machine operator |
US9007198B2 (en) * | 2012-11-02 | 2015-04-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adaptive Actuator interface for active driver warning |
US20140139451A1 (en) * | 2012-11-20 | 2014-05-22 | Vincent Levesque | Systems and Methods For Providing Mode or State Awareness With Programmable Surface Texture |
US8825258B2 (en) * | 2012-11-30 | 2014-09-02 | Google Inc. | Engaging and disengaging for autonomous driving |
DE112013005975T5 (en) | 2012-12-14 | 2015-08-20 | Visteon Global Technologies, Inc. | System and method for automatically aligning an angle of a three-dimensional display within a vehicle |
US8930269B2 (en) * | 2012-12-17 | 2015-01-06 | State Farm Mutual Automobile Insurance Company | System and method to adjust insurance rate based on real-time data about potential vehicle operator impairment |
US8981942B2 (en) * | 2012-12-17 | 2015-03-17 | State Farm Mutual Automobile Insurance Company | System and method to monitor and reduce vehicle operator impairment |
US9104535B1 (en) * | 2012-12-19 | 2015-08-11 | Allstate Insurance Company | Traffic based driving analysis |
US8952819B2 (en) * | 2013-01-31 | 2015-02-10 | Lytx, Inc. | Direct observation event triggering of drowsiness |
US9149236B2 (en) | 2013-02-04 | 2015-10-06 | Intel Corporation | Assessment and management of emotional state of a vehicle operator |
US20140240132A1 (en) * | 2013-02-28 | 2014-08-28 | Exmovere Wireless LLC | Method and apparatus for determining vehicle operator performance |
US9020482B2 (en) * | 2013-03-06 | 2015-04-28 | Qualcomm Incorporated | Preventing driver distraction |
US20140257659A1 (en) * | 2013-03-11 | 2014-09-11 | Honda Motor Co., Ltd. | Real time risk assessments using risk functions |
US9122933B2 (en) * | 2013-03-13 | 2015-09-01 | Mighty Carma, Inc. | After market driving assistance system |
US9198113B2 (en) | 2013-03-15 | 2015-11-24 | Aswin Rajeevalochana | App for preventing phone functionality while driving |
JP6056612B2 (en) * | 2013-03-29 | 2017-01-11 | アイシン精機株式会社 | Image display control device and image display system |
US20140322676A1 (en) * | 2013-04-26 | 2014-10-30 | Verizon Patent And Licensing Inc. | Method and system for providing driving quality feedback and automotive support |
TWI532620B (en) * | 2013-06-24 | 2016-05-11 | Utechzone Co Ltd | Vehicle occupancy number monitor and vehicle occupancy monitoring method and computer readable record media |
EP3020252A1 (en) | 2013-07-10 | 2016-05-18 | Ciaran Hynes | Method and apparatus for limiting the use of a mobile communications device |
US20150025917A1 (en) * | 2013-07-15 | 2015-01-22 | Advanced Insurance Products & Services, Inc. | System and method for determining an underwriting risk, risk score, or price of insurance using cognitive information |
US10298741B2 (en) * | 2013-07-18 | 2019-05-21 | Secure4Drive Communication Ltd. | Method and device for assisting in safe driving of a vehicle |
US8930072B1 (en) * | 2013-07-26 | 2015-01-06 | Lytx, Inc. | Managing the camera acquiring interior data |
JP6433149B2 (en) * | 2013-07-30 | 2018-12-05 | キヤノン株式会社 | Posture estimation apparatus, posture estimation method and program |
US9505412B2 (en) * | 2013-08-02 | 2016-11-29 | Honda Motor Co., Ltd. | System and method for detection and utilization of driver distraction level |
US10311749B1 (en) * | 2013-09-12 | 2019-06-04 | Lytx, Inc. | Safety score based on compliance and driving |
US9340155B2 (en) * | 2013-09-17 | 2016-05-17 | Toyota Motor Sales, U.S.A., Inc. | Interactive vehicle window display system with user identification |
US9400564B2 (en) * | 2013-09-17 | 2016-07-26 | Toyota Motor Engineering & Manufacturing North America, Inc. | Interactive vehicle window display system with a safe driving reminder system |
US10210761B2 (en) * | 2013-09-30 | 2019-02-19 | Sackett Solutions & Innovations, LLC | Driving assistance systems and methods |
US9977591B2 (en) * | 2013-10-01 | 2018-05-22 | Ambient Consulting, LLC | Image with audio conversation system and method |
US9501693B2 (en) * | 2013-10-09 | 2016-11-22 | Honda Motor Co., Ltd. | Real-time multiclass driver action recognition using random forests |
WO2015061712A1 (en) * | 2013-10-24 | 2015-04-30 | Tourmaline Labs, Inc. | Systems and methods for collecting and transmitting telematics data from a mobile device |
US20150161913A1 (en) * | 2013-12-10 | 2015-06-11 | At&T Mobility Ii Llc | Method, computer-readable storage device and apparatus for providing a recommendation in a vehicle |
US10417486B2 (en) * | 2013-12-30 | 2019-09-17 | Alcatel Lucent | Driver behavior monitoring systems and methods for driver behavior monitoring |
EP2892020A1 (en) * | 2014-01-06 | 2015-07-08 | Harman International Industries, Incorporated | Continuous identity monitoring for classifying driving data for driving performance analysis |
US9073430B1 (en) * | 2014-01-07 | 2015-07-07 | International Business Machines Corporation | Driver reaction time measurement |
EP3103095A1 (en) | 2014-02-04 | 2016-12-14 | Sudak, Menachem | Monitoring system and method |
US20170174129A1 (en) | 2014-03-06 | 2017-06-22 | Sensedriver Technologies, Llc | Vehicular visual information system and method |
US20160189303A1 (en) * | 2014-03-21 | 2016-06-30 | Gil Emanuel Fuchs | Risk Based Automotive Insurance Rating System |
US9283847B2 (en) * | 2014-05-05 | 2016-03-15 | State Farm Mutual Automobile Insurance Company | System and method to monitor and alert vehicle operator of impairment |
AU2015297036B2 (en) * | 2014-05-09 | 2017-09-28 | Google Llc | Systems and methods for discerning eye signals and continuous biometric identification |
US20150363650A1 (en) * | 2014-06-13 | 2015-12-17 | Mauricio Braun | Distracted Driving Violation Detection and Reporting Technology |
JP6201927B2 (en) * | 2014-08-01 | 2017-09-27 | トヨタ自動車株式会社 | Vehicle control device |
US9365186B2 (en) * | 2014-08-17 | 2016-06-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Advanced seatbelt interlock using video recognition |
US9948898B2 (en) * | 2014-08-22 | 2018-04-17 | Verizon Patent And Licensing Inc. | Using aerial imaging to provide supplemental information about a location |
US20160063561A1 (en) * | 2014-08-29 | 2016-03-03 | Ford Global Technologies, Llc | Method and Apparatus for Biometric Advertisement Feedback Collection and Utilization |
US9911031B2 (en) * | 2014-09-05 | 2018-03-06 | The Boeing Company | Obtaining metrics for a position using frames classified by an associative memory |
US10131276B2 (en) * | 2014-09-30 | 2018-11-20 | Subaru Corporation | Vehicle sightline guidance apparatus |
WO2016055688A1 (en) * | 2014-10-07 | 2016-04-14 | Nokia Technologies Oy | Camera devices with a large field of view for stereo imaging |
US9747812B2 (en) * | 2014-10-22 | 2017-08-29 | Honda Motor Co., Ltd. | Saliency based awareness modeling |
US10147008B1 (en) | 2015-01-13 | 2018-12-04 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for determining whether a vehicle system is distracting to a vehicle operator |
US20160231746A1 (en) * | 2015-02-06 | 2016-08-11 | Delphi Technologies, Inc. | System And Method To Operate An Automated Vehicle |
US10033930B2 (en) * | 2015-02-16 | 2018-07-24 | Hangzhou Closeli Technology Co., Ltd. | Method of reducing a video file size for surveillance |
US10977255B2 (en) * | 2015-11-13 | 2021-04-13 | Accenture Global Solutions Limited | Analytics platform using telematics data |
EP3469437A4 (en) * | 2016-06-13 | 2020-03-25 | Xevo Inc. | Method and system for providing auto space management using virtuous cycle |
US11423671B1 (en) * | 2016-06-14 | 2022-08-23 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for detecting vehicle occupant actions |
US10163018B1 (en) * | 2016-06-14 | 2018-12-25 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for inferring a driving enviroment based on vehicle occupant actions |
US9990553B1 (en) * | 2016-06-14 | 2018-06-05 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for determining degrees of risk associated with a vehicle operator |
US9928433B1 (en) * | 2016-06-14 | 2018-03-27 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems, and methods for determining when a vehicle operator is texting while driving |
US9928434B1 (en) * | 2016-06-14 | 2018-03-27 | State Farm Mutual Automobile Insurance Company | Appartuses, systems, and methods for determining when a vehicle occupant is using a mobile telephone |
US9919648B1 (en) | 2016-09-27 | 2018-03-20 | Robert D. Pedersen | Motor vehicle artificial intelligence expert system dangerous driving warning and control system and method |
US9663118B1 (en) * | 2016-11-02 | 2017-05-30 | Smartdrive Systems, Inc. | Autonomous vehicle operator performance tracking |
EP3535646A4 (en) * | 2016-11-07 | 2020-08-12 | Nauto, Inc. | System and method for driver distraction determination |
US10943136B1 (en) * | 2017-01-19 | 2021-03-09 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for generating a vehicle driver signature |
US10417816B2 (en) * | 2017-06-16 | 2019-09-17 | Nauto, Inc. | System and method for digital environment reconstruction |
US10474916B2 (en) | 2017-11-20 | 2019-11-12 | Ashok Krishnan | Training of vehicles to improve autonomous capabilities |
US10958987B1 (en) | 2018-05-01 | 2021-03-23 | Amazon Technologies, Inc. | Matching based on video data |
-
2016
- 2016-01-13 US US14/994,440 patent/US10147008B1/en active Active
- 2016-01-13 US US14/994,415 patent/US10325167B1/en active Active
- 2016-01-13 US US14/994,308 patent/US10565460B1/en active Active
- 2016-01-13 US US14/994,436 patent/US9710717B1/en active Active
- 2016-01-13 US US14/994,431 patent/US10147007B1/en active Active
- 2016-01-13 US US14/994,409 patent/US9944296B1/en active Active
- 2016-01-13 US US14/994,305 patent/US10607095B1/en active Active
- 2016-01-13 US US14/994,310 patent/US10013620B1/en active Active
- 2016-01-13 US US14/994,299 patent/US9886637B1/en active Active
- 2016-01-13 US US14/994,424 patent/US9690292B1/en active Active
- 2016-01-13 US US14/994,419 patent/US10140533B1/en active Active
-
2017
- 2017-04-10 US US15/482,916 patent/US10241512B1/en active Active
- 2017-05-15 US US15/595,392 patent/US9990554B1/en active Active
- 2017-11-27 US US15/823,015 patent/US10089542B1/en active Active
-
2018
- 2018-02-02 US US15/886,971 patent/US10189480B1/en active Active
- 2018-03-14 US US15/920,678 patent/US10229333B1/en active Active
- 2018-04-27 US US15/964,209 patent/US20210264179A1/en not_active Abandoned
- 2018-12-04 US US16/209,006 patent/US10562536B1/en active Active
-
2020
- 2020-01-06 US US16/735,198 patent/US11417121B1/en active Active
- 2020-02-21 US US16/797,009 patent/US11367293B1/en active Active
- 2020-09-30 US US17/039,916 patent/US11373421B1/en active Active
-
2022
- 2022-05-25 US US17/824,675 patent/US20220292851A1/en active Pending
- 2022-07-07 US US17/859,866 patent/US11685392B2/en active Active
-
2023
- 2023-05-08 US US18/144,701 patent/US20230271620A1/en active Pending
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11373421B1 (en) | 2015-01-13 | 2022-06-28 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for classifying digital images |
US11417121B1 (en) | 2015-01-13 | 2022-08-16 | State Farm Mutual Automobile Insurance Company | Apparatus, systems and methods for classifying digital images |
US11685392B2 (en) | 2015-01-13 | 2023-06-27 | State Farm Mutual Automobile Insurance Company | Apparatus, systems and methods for classifying digital images |
US11321951B1 (en) | 2017-01-19 | 2022-05-03 | State Farm Mutual Automobile Insurance Company | Apparatuses, systems and methods for integrating vehicle operator gesture detection within geographic maps |
Also Published As
Publication number | Publication date |
---|---|
US10089542B1 (en) | 2018-10-02 |
US11417121B1 (en) | 2022-08-16 |
US10607095B1 (en) | 2020-03-31 |
US10140533B1 (en) | 2018-11-27 |
US10562536B1 (en) | 2020-02-18 |
US10013620B1 (en) | 2018-07-03 |
US9990554B1 (en) | 2018-06-05 |
US10241512B1 (en) | 2019-03-26 |
US11373421B1 (en) | 2022-06-28 |
US9944296B1 (en) | 2018-04-17 |
US11367293B1 (en) | 2022-06-21 |
US9886637B1 (en) | 2018-02-06 |
US10147007B1 (en) | 2018-12-04 |
US20220292851A1 (en) | 2022-09-15 |
US11685392B2 (en) | 2023-06-27 |
US10229333B1 (en) | 2019-03-12 |
US10147008B1 (en) | 2018-12-04 |
US20230271620A1 (en) | 2023-08-31 |
US9690292B1 (en) | 2017-06-27 |
US10325167B1 (en) | 2019-06-18 |
US20220343659A1 (en) | 2022-10-27 |
US9710717B1 (en) | 2017-07-18 |
US10189480B1 (en) | 2019-01-29 |
US10565460B1 (en) | 2020-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11685392B2 (en) | Apparatus, systems and methods for classifying digital images | |
US11003932B1 (en) | Apparatuses, systems, and methods for inferring a driving environment based on vehicle occupant actions | |
US10223603B1 (en) | Apparatuses, systems, and methods for determining when a vehicle occupant is using a mobile telephone | |
US10242274B1 (en) | Apparatuses, systems and methods for determining degrees of risk associated with a vehicle operator | |
US11897483B2 (en) | Apparatuses, systems and methods for determining distracted drivers associated with vehicle driving routes | |
US11861917B2 (en) | Apparatuses, systems, and methods for detecting vehicle occupant actions | |
US9928433B1 (en) | Apparatuses, systems, and methods for determining when a vehicle operator is texting while driving | |
US9996757B1 (en) | Apparatuses, systems, and methods for detecting various actions of a vehicle operator | |
US20210342612A1 (en) | Apparatuses, systems, and methods for determining vehicle operator distractions at particular geographic locations | |
US20240169744A1 (en) | Apparatuses, systems and methods for generation and transmission of vehicle operation mode data | |
US10891502B1 (en) | Apparatuses, systems and methods for alleviating driver distractions | |
US20220172494A1 (en) | Apparatuses, systems and methods for generating a vehicle driver signature | |
US20220148319A1 (en) | Apparatuses, systems and methods for integrating vehicle operator gesture detection within geographic maps |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |