US9862247B2 - Directional climate control system with infrared targeting - Google Patents

Directional climate control system with infrared targeting Download PDF

Info

Publication number
US9862247B2
US9862247B2 US14/492,637 US201414492637A US9862247B2 US 9862247 B2 US9862247 B2 US 9862247B2 US 201414492637 A US201414492637 A US 201414492637A US 9862247 B2 US9862247 B2 US 9862247B2
Authority
US
United States
Prior art keywords
pixels
temperature
thermographic
hvac
vehicle apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/492,637
Other versions
US20160082808A1 (en
Inventor
William Paul Perkins
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ford Global Technologies LLC
Original Assignee
Ford Global Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ford Global Technologies LLC filed Critical Ford Global Technologies LLC
Assigned to FORD GLOBAL TECHNOLOGIES, LLC reassignment FORD GLOBAL TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PERKINS, WILLIAM PAUL
Priority to US14/492,637 priority Critical patent/US9862247B2/en
Priority to DE102015115066.2A priority patent/DE102015115066A1/en
Priority to RU2015139328A priority patent/RU2681972C2/en
Priority to CN201510586762.9A priority patent/CN105437906B/en
Priority to BR102015024242-5A priority patent/BR102015024242A2/en
Priority to TR2015/11752A priority patent/TR201511752A2/en
Priority to MX2015013491A priority patent/MX364869B/en
Publication of US20160082808A1 publication Critical patent/US20160082808A1/en
Priority to US15/831,487 priority patent/US10179499B2/en
Priority to US15/831,486 priority patent/US10369865B2/en
Publication of US9862247B2 publication Critical patent/US9862247B2/en
Application granted granted Critical
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00Heating, cooling or ventilating [HVAC] devices
    • B60H1/00007Combined heating, ventilating, or cooling devices
    • B60H1/00021Air flow details of HVAC devices
    • B60H1/00028Constructional lay-out of the devices in the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00735Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
    • B60H1/00742Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00Heating, cooling or ventilating [HVAC] devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00814Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
    • B60H1/00821Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being ventilating, air admitting or air distributing devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00814Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
    • B60H1/00821Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being ventilating, air admitting or air distributing devices
    • B60H1/00871Air directing means, e.g. blades in an air outlet
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F28HEAT EXCHANGE IN GENERAL
    • F28FDETAILS OF HEAT-EXCHANGE AND HEAT-TRANSFER APPARATUS, OF GENERAL APPLICATION
    • F28F27/00Control arrangements or safety devices specially adapted for heat-exchange or heat-transfer apparatus
    • F28F27/02Control arrangements or safety devices specially adapted for heat-exchange or heat-transfer apparatus for controlling the distribution of heat-exchange media between different channels

Definitions

  • the present invention relates in general to automotive HVAC systems, and, more specifically, to automatic adjustment of steerable air outlets to direct treated air to optimize passenger comfort and reduce energy usage.
  • HVAC Heating, ventilating, and air conditioning
  • a blower passes air through heat exchangers and delivers conditioned air to various points within the passenger cabin.
  • Warm air may be provided by a heater core obtaining heat from coolant flowing in a combustion engine, for example. Cool air may be obtained using a compressor mechanically-driven by the engine.
  • Electrified vehicles such as hybrid electric vehicles (HEVs) and battery electric vehicles (BEVs) may instead use electrically powered devices such as PTC resistance heaters and electric air conditioning compressors.
  • HEVs hybrid electric vehicles
  • BEVs battery electric vehicles
  • the simplest climate control systems in motor vehicles provide the occupant with direct control of the intensity of heating or cooling, the operating speed of the blower, and the relative amount of air flow going to different registers. This requires the user to continually monitor and adjust the climate control settings in order to remain comfortable.
  • the vehicle occupants may not understand how to best control the HVAC system to optimize efficiency. They may turn the control knobs to a maximum output while aiming the blower vanes upward or downward away from their bodies, sending the conditioned air tumbling onto less important surfaces and requiring more energy to make the occupants comfortable. This also results in greater blower fan noise than is really necessary to achieve the desired thermal comfort.
  • ETC Electronic automatic temperature control
  • the present invention uses thermographic image processing to identify occupants' skin surfaces which can be targeted with a treated air stream using electronically-controlled vents which have two-axis directional control, and optionally have a nozzle control for focusing the air stream. Based on detected seat occupancy, airflow from multiple vents may be targeted at detected skin targets according to which seats are occupied. Thermographic images can be taken successively in order to update air stream direction and flow rate under changing conditions.
  • a vehicle apparatus in one aspect of the invention, includes a heating, ventilating, and air conditioning (HVAC) system having a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle.
  • HVAC heating, ventilating, and air conditioning
  • a thermographic imager is configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located.
  • the HVAC control circuit is configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid.
  • FIG. 1 is a perspective view of an automotive passenger compartment including an HVAC system with multiple, steerable air outlets or vents for providing climate control for occupants of the vehicle.
  • FIG. 2 is a block diagram showing one preferred embodiment of a vehicle apparatus of the invention.
  • FIGS. 3 and 4 are side views of steerable air outlets.
  • FIG. 5 shows a sequence of image data used in a preferred embodiment for aiming a steerable air outlet toward an occupant.
  • FIG. 6 is a flowchart of one preferred embodiment of a method for aiming a steerable air outlet.
  • FIG. 7 is a flowchart of one preferred embodiment for determining target areas.
  • FIGS. 8 and 9 are representative plots showing predetermined temperature ranges for identifying an occupant in a thermographic image.
  • FIG. 10 shows an array of pixels for a portion of a thermographic image after conversion to a bi-valued temperature map.
  • FIGS. 11 and 12 illustrate a sliding window at successive positions during filtering of a temperature map to coalesce regions within the bi-valued temperature map.
  • FIG. 13 illustrates an array of pixels after coalescing the regions.
  • FIG. 14 illustrates one preferred technique for locating a centroid within a coalesced region.
  • FIG. 1 shows a passenger compartment 10 of an automotive vehicle with various seating locations such as a front seat 11 and rear seats 12 .
  • a vehicle HVAC system includes a plurality of air outlets or vents 13 - 17 for directing respective streams of treated air into passenger compartment 10 .
  • One or more of vents 13 - 17 has a steerable outlet so that the direction and/or focus (i.e., spread) are automatically adjustable by the HVAC system.
  • FIG. 2 shows an HVAC system 20 with various components interconnected by an electrical system 21 preferably including an electrical wiring harness and a multiplex communication system as commonly used in the industry.
  • An HVAC control circuit 22 may preferably be comprised of a typical electronic module including customized circuits and/or one or more programmable microcontrollers with appropriate software and/or firmware as commonly deployed in automotive vehicles.
  • thermographic imager preferably taking the form of an infrared camera 23 , is disposed at a forward location in the passenger compartment in order to capture thermographic images covering a fixed region in and around front seating areas 25 and 26 .
  • Occupant seating area 26 may be provided for a driver, for example. HVAC controller may be configured to always assume that a driver is present.
  • occupant seating 25 may represent a passenger seat in which an occupant is potentially located but may also be unoccupied.
  • Another infrared camera 24 may be disposed in a rearward location in order to capture thermographic images covering a rear seat area in the passenger compartment including occupant areas 27 and 28 .
  • blowers 30 and 37 for right and left sides of the passenger compartment may be provided which are separately controllable with a variable speed determined by HVAC controller 22 .
  • Blower 30 provides a stream of treated air to controlled register vents 31 , 33 , and 35 .
  • Vent 31 is dash-mounted on a left, outer side of the dashboard near occupant seat 25 for providing an air stream 32 .
  • Vent 33 is dash-mounted at a left, inside location to supplying an airstream 34
  • vent 35 is a left floor vent for providing an airstream 36 .
  • At least one of vents 31 , 33 , and 35 is automatically steerable to direct an airstream at a desired target within occupant area 25 .
  • variable-speed blower 37 is coupled to dash-mounted front, inner, right vent 38 supplying an airstream 39 , front, outer, right vent 40 supplying airstream 41 , and right floor vent 42 supplying airstream 43 to occupant area 26 .
  • any combination of steerable and fixed vents can be employed.
  • a particular controlled vent can also be configured to direct an air stream alternately at different ones of the occupant areas.
  • a blower 44 also controlled by HVAC controller 22 supplies treated air streams to rear vents 45 , 47 , and 49 directing airstreams 46 , 48 , and 50 to occupant areas 27 and 28 as shown.
  • HVAC controller 22 is connected to or may include a lookup table 51 for purposes described in detail below.
  • HVAC controller 22 is connected to various sensors including an ambient outside air temperature sensor 52 , a cabin internal air temperature sensor 53 , and seat occupancy sensors 55 .
  • HVAC controller 22 is connected to a cabin-mounted human machine interface (HMI) 54 as known in the art.
  • the controlled vents include actuators that are activated by HVAC controller 22 based on signals from HMI 54 , sensors 52 , 53 , and 55 , and IR cameras 23 and/or 24 in order to direct treated air to obtain passenger comfort at an optimized energy usage.
  • FIG. 3 shows one example of a steerable air outlet vent 60 installed in an instrument panel or dashboard 61 .
  • An air duct 62 receiving treated air from a blower supplies the air to a movable outer vent shell 63 retained upon a cup-shaped base 64 .
  • a gimbal mounting 65 that can be rotated along one or more axes by a motor 66 under control of the HVAC controller is connected to shell 63 . By manipulating gimbal mount 65 , an air stream exits an opening in shell 63 to move in a desired direction.
  • Internal flaps or gates such as a flap 67 , may be disposed within shell 63 and coupled with an actuator motor 68 in order to shape (i.e., throttle) the edges of an exiting air stream in order to provide a desired focus of the outlet airstream.
  • FIG. 4 shows an alternative embodiment for steering an outlet airstream with a vent having controllable vanes 70 and 71 .
  • Each vane 70 and 71 has end pivot points 72 rotatably mounted to a vent housing (not shown).
  • the vanes are all interconnected by a linking rod 73 to maintain a parallel spacing.
  • the up and down motion of rod 73 rotates vanes 70 and 71 in concert in order to direct an outlet air stream along a controllable direction.
  • Rod 73 may be connected to an actuator motor (not shown) which is driven by the HVAC controller.
  • FIG. 5 depicts an overall process of the present invention for using a thermographic image to identify a target location for aiming an outlet air stream.
  • a thermographic image 75 is captured according to a fixed field of view using an infrared camera to return to multi-valued image with pixels having a color or intensity representing respective temperature values.
  • the multi-valued thermographic image is compressed to a bi-valued image 76 such that pixels falling within the predetermined range are colored white and all other pixels are colored black, for example.
  • image 76 comprises a temperature map in which regions of white pixels correspond to exposed areas of skin of a vehicle occupant.
  • a head region 81 and arm/hands regions 82 and 83 are discernible in temperature map 76 .
  • imaging noise causes regions 81 to 83 to contain scattered black pixels making the region harder to detect automatically by the controller.
  • Image 77 comprises a further processed image in which regions of the pixels falling within the predetermined temperature range have been coalesced so that the regions become substantially continuous with well defined borders and no scattering of black pixels within the regions.
  • coalescing may be performed by filtering using a sliding window to successively re-assign each pixel value to match a majority of the respective surrounding pixels.
  • the detected regions may be ranked according to size to allow the largest to be selected for targeting as shown in image 78 .
  • a centroid 88 of each selected continuous region is located in order to provide a precise target for steering the corresponding air outlet.
  • step 90 A preferred method of the invention is shown in FIG. 6 wherein outside ambient temperature and internal cabin temperature are measured in step 90 .
  • performance of the method may be initiated by unlocking or opening a door to indicate that a driving cycle of the vehicle is about to begin.
  • step 91 an initial thermographic image is captured, e.g., prior to any occupant being seated inside the passenger cabin. The initial image allows any particularly prominent infrared “hotspots” to be recorded and identified.
  • step 92 the HVAC system is activated in response to initial conditions as identified by the temperature measurements from step 90 and the initial IR image from step 91 .
  • the initial activation of the HVAC system may be based on historical HVAC settings for a temperature setpoint and blower speed that were set by the driver for similar conditions on previous trips, or according to default control values designed by the manufacturer.
  • the time for activating the HVAC may be determined in the conventional manner, such as when a vehicle engine is remotely started via a wireless controller or when the driver enters the vehicle and starts the engine or other power plant using an ignition key, for example.
  • thermographic image is captured in step 93 with the driver seating in the corresponding position.
  • the image in step 93 may potentially contain additional occupants who will be present for the impending drive cycle.
  • target areas are determined in step 94 .
  • the direction and/or focus of various HVAC air stream outlets are adjusted in step 95 .
  • the outlet temperature of the HVAC system and the blower speed or intensity may also be adjusted.
  • a new thermographic image may be captured in step 96 . Since the HVAC system is actively affecting the temperature environment when subsequent thermographic images are captured, the desired skin features may be masked in the image by the appearance of the air stream.
  • step 97 a check is performed in step 97 to determine whether the blower fan speed is above a threshold. If not, then target areas are determined in the subsequent image in step 94 and then the HVAC outputs are adjusted in step 95 . If the fan speed is above the threshold, then the subsequent thermographic image can be filtered in step 98 to remove the effects of the treated air flow in the image. Filtering can be performed based on the turbulent nature of an airflow as seen in a typical thermographic image (e.g., image regions with a certain texture can be deleted from the image). Alternatively, the fan speed can be temporarily reduced or turned off completely during the capturing of the thermographic image.
  • FIG. 7 shows a preferred method for determining target areas in greater detail.
  • the measured internal and external ambient temperatures are used to select the predetermined temperature range for identifying regions in the image showing an occupant's skin.
  • the external temperature indicates whether the occupant's skin is being raised or lowered from a normal body temperature by external conditions.
  • the internal cabin temperature helps identify the expected temperatures of interior surfaces within the vehicle (e.g., headrests).
  • the predetermined temperature range is determined empirically in order to include expected skin temperatures while excluding as many of the interior vehicle surfaces as possible.
  • values for the predetermined ranges are stored in a lookup table within or accessible to the HVAC control circuit.
  • the lookup may be organized according to index values for the internal and external temperatures.
  • FIG. 8 shows one example for specifying a temperature range corresponding to one particular external temperature and showing the changing range for varying internal temperature.
  • the predetermined range has a maximum value defined by a curve 107 and a minimum value defined by a curve 108 .
  • a predetermined range 110 is defined by the respective values of curves 17 and 108 .
  • a different predetermined range may be obtained such as range 111 at a higher internal temperature indicated at 113 .
  • FIG. 8 is representative of curves that are obtained for high external ambient temperatures (i.e., in situations calling for HVAC cooling).
  • the predetermined range may be wider at range 111 than at range 110 .
  • FIG. 9 is representative of colder external temperatures (i.e., a situation calling for heating of the passenger compartment) with curves 114 and 115 defining the maximum and minimum temperatures of the predetermined temperature range, respectively.
  • colder external temperatures i.e., a situation calling for heating of the passenger compartment
  • curves 114 and 115 defining the maximum and minimum temperatures of the predetermined temperature range, respectively.
  • thermographic image is compressed (i.e., converted) to a temperature map which assigns a first pixel value (e.g., a binary “1” for white) to each pixel falling within the predetermined temperature range and assigning a second pixel value (e.g., a binary “0” for black) if it corresponds to a temperature outside the predetermined range.
  • a first pixel value e.g., a binary “1” for white
  • second pixel value e.g., a binary “0” for black
  • thermograph image into a black and white temperature map and displaying the resulting image.
  • step 102 of FIG. 7 potential target regions are coalesced by filtering with a sliding window.
  • the sliding window is preferably comprised of a pixel array 122 centered on a pixel 123 .
  • window 122 is scanned over the thermographic image at each potential center pixel, with the value for each center pixel being reassigned a new value in a coalesced image such that its new value matches a majority value for the pixels of the temperature map within the sliding window at that position.
  • center pixel 123 would be assigned a binary value of 0 since most pixels within window 122 are black.
  • the average value for all the pixels within window 122 is determined (e.g., counting the white pixels and dividing by the number of pixels covered by the window), with the resulting average being rounded to 0 or 1 to determine the value to be assigned to center pixel 123 .
  • FIG. 13 shows the coalesced image, with pixel 123 remaining black.
  • FIG. 12 shows a subsequent position for sliding window 122 centered on the next pixel 124 in the same row. Since the majority of pixels bounded by this new position of sliding window 122 are black, pixel 124 remains black in the coalesced image of FIG. 13 .
  • a pixel 125 is evaluated, and in the example shown the majority value continues to be black. Therefore, pixel 125 switches to a value of 0 (i.e., white) in FIG. 13 .
  • the filtering results in some minor adjustment of the actual borders of a potential target region.
  • FIG. 13 shows a coalesced image in which a more continuous target region based on the use of a sliding window to set all pixels to white whenever the value of the pixels within the window fall on average within the predetermined temperature range.
  • the sliding window is comprised of a square array of pixels having a size adapted to provide the best performance for removing extraneous noise while preserving the borders of target regions.
  • An array size of 20 ⁇ 20 pixels has been found to be effective. Since the sliding window cannot be centered on a range of pixels along the outer edges of the thermographic image, the corresponding pixels may be disregarded in forming the temperature map (or extra pixels with a zero value can be appended around the original image to facilitate placement of the sliding window.
  • an optional determination of seat occupancy is made in step 103 in the event that there are air outlets capable of being allocated between different seating locations and depending upon the presence or absence of occupants in the corresponding locations.
  • Step 103 can be skipped if the steerable outlet(s) are only capable of being aimed at one particular seat location.
  • the determination of seat occupancy can assist in determining how many air outlets will be aimed at each particular seating location, but such determination can alternatively be a fixed relationship or may be determined by other measures, such as by manual configuration using the HVAC HMI.
  • coalesced regions are ranked by area. If there is only one steerable air outlet then the ranking merely needs to identify the largest coalesced region. Where there are multiple steerable outlets that are going to be used to provide airflow to a particular occupant, then the ranking identifies the corresponding number of the largest coalesced regions in order to assign each respective steerable outlet to a selected area. For example, in a vehicle with two steerable air outlets for serving the front seat passengers and with only two front seating positions (i.e., driver and passenger), then if no passenger is present the two largest coalesced regions in the driver's seating location would be identified and targeted. On the other hand, if a is passenger is present then the largest coalesced region for each of the seating locations are identified and the respective steerable outlets are aimed accordingly.
  • Ranking the regions by area involves summing the number of white pixels in the region.
  • the Matlab demonstration uses a function called bwboundary in summing the areas as follows.
  • step 105 the centroids for the largest ranked region(s) to be targeted are determined. Then the outlets are aimed at the centroids in step 106 .
  • a preferred method for locating centroids is illustrated in FIG. 14 .
  • a coalesced image 130 a coalesced region 131 has been ranked and identified as a target area (i.e., it corresponds to the occupant's skin surface).
  • a centroid 132 of region 131 may preferably be determined by calculating an average of the orthogonal coordinates of the pixels within the region 131 .
  • orthogonal coordinates x and y correspond to the columns and rows of image 130 .
  • the coordinates for two of the included pixels are shown as (x 1 ,y 1 ) and (x 2 ,y 2 ).
  • the x and y values for all the pixels within region 131 are averaged in order to determine the average coordinate for centroid 132 (with the average value being rounded off).

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Air-Conditioning For Vehicles (AREA)
  • Air Conditioning Control Device (AREA)

Abstract

A heating, ventilating, and air conditioning (HVAC) system has a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle. A thermographic imager is configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located. The HVAC control circuit is configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
Not Applicable.
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH
Not Applicable.
BACKGROUND OF THE INVENTION
The present invention relates in general to automotive HVAC systems, and, more specifically, to automatic adjustment of steerable air outlets to direct treated air to optimize passenger comfort and reduce energy usage.
Heating, ventilating, and air conditioning (HVAC) systems control the climate in transportation vehicles such as automobiles in order to maintain thermal comfort of the vehicle occupants. Typically, a blower passes air through heat exchangers and delivers conditioned air to various points within the passenger cabin. Warm air may be provided by a heater core obtaining heat from coolant flowing in a combustion engine, for example. Cool air may be obtained using a compressor mechanically-driven by the engine. Electrified vehicles such as hybrid electric vehicles (HEVs) and battery electric vehicles (BEVs) may instead use electrically powered devices such as PTC resistance heaters and electric air conditioning compressors.
The simplest climate control systems in motor vehicles provide the occupant with direct control of the intensity of heating or cooling, the operating speed of the blower, and the relative amount of air flow going to different registers. This requires the user to continually monitor and adjust the climate control settings in order to remain comfortable. The vehicle occupants, however, may not understand how to best control the HVAC system to optimize efficiency. They may turn the control knobs to a maximum output while aiming the blower vanes upward or downward away from their bodies, sending the conditioned air tumbling onto less important surfaces and requiring more energy to make the occupants comfortable. This also results in greater blower fan noise than is really necessary to achieve the desired thermal comfort.
Electronic automatic temperature control (EATC) systems have also been introduced wherein a feedback control system monitors ambient air temperature within the passenger compartment and automatically adjusts blower speed and heater core or air conditioning operation to maintain a desired temperature setting. In some vehicles, multiple zones have been implemented with separate automatic temperature control with individual target temperature settings being made for each zone.
Traditional HVAC systems only indirectly control the actual skin temperature of an occupant. Because skin temperature is a better indicator of actual occupant comfort, systems have been investigated for regulating HVAC system operation using infrared (IR) sensors to determine the skin temperature of the vehicle occupants and then adjusting a temperature setpoint of the HVAC system in the direction required to achieve a target skin temperature. However, the thermodynamic environment in a vehicle interior is complex, as are the relationships between various HVAC control settings and the resulting effect on skin temperature of different occupants. Therefore, previous systems have been relatively complex and not cost effective.
In order to reduce energy consumption and to provide optimal comfort, various systems have also been proposed which automatically adjust the pattern of air flow delivered into the passenger compartment based upon seat occupancy (e.g., turning off vents where a seat is unoccupied). However, no known system has provided sufficient accuracy or performance to truly optimize directional adjustment of treated air over a sufficiently wide range of thermal conditions.
SUMMARY OF THE INVENTION
The present invention uses thermographic image processing to identify occupants' skin surfaces which can be targeted with a treated air stream using electronically-controlled vents which have two-axis directional control, and optionally have a nozzle control for focusing the air stream. Based on detected seat occupancy, airflow from multiple vents may be targeted at detected skin targets according to which seats are occupied. Thermographic images can be taken successively in order to update air stream direction and flow rate under changing conditions.
In one aspect of the invention, a vehicle apparatus includes a heating, ventilating, and air conditioning (HVAC) system having a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle. A thermographic imager is configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located. The HVAC control circuit is configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a perspective view of an automotive passenger compartment including an HVAC system with multiple, steerable air outlets or vents for providing climate control for occupants of the vehicle.
FIG. 2 is a block diagram showing one preferred embodiment of a vehicle apparatus of the invention.
FIGS. 3 and 4 are side views of steerable air outlets.
FIG. 5 shows a sequence of image data used in a preferred embodiment for aiming a steerable air outlet toward an occupant.
FIG. 6 is a flowchart of one preferred embodiment of a method for aiming a steerable air outlet.
FIG. 7 is a flowchart of one preferred embodiment for determining target areas.
FIGS. 8 and 9 are representative plots showing predetermined temperature ranges for identifying an occupant in a thermographic image.
FIG. 10 shows an array of pixels for a portion of a thermographic image after conversion to a bi-valued temperature map.
FIGS. 11 and 12 illustrate a sliding window at successive positions during filtering of a temperature map to coalesce regions within the bi-valued temperature map.
FIG. 13 illustrates an array of pixels after coalescing the regions.
FIG. 14 illustrates one preferred technique for locating a centroid within a coalesced region.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
FIG. 1 shows a passenger compartment 10 of an automotive vehicle with various seating locations such as a front seat 11 and rear seats 12. A vehicle HVAC system includes a plurality of air outlets or vents 13-17 for directing respective streams of treated air into passenger compartment 10. One or more of vents 13-17 has a steerable outlet so that the direction and/or focus (i.e., spread) are automatically adjustable by the HVAC system.
FIG. 2 shows an HVAC system 20 with various components interconnected by an electrical system 21 preferably including an electrical wiring harness and a multiplex communication system as commonly used in the industry. An HVAC control circuit 22 may preferably be comprised of a typical electronic module including customized circuits and/or one or more programmable microcontrollers with appropriate software and/or firmware as commonly deployed in automotive vehicles.
A thermographic imager, preferably taking the form of an infrared camera 23, is disposed at a forward location in the passenger compartment in order to capture thermographic images covering a fixed region in and around front seating areas 25 and 26. Occupant seating area 26 may be provided for a driver, for example. HVAC controller may be configured to always assume that a driver is present. On the other hand, occupant seating 25 may represent a passenger seat in which an occupant is potentially located but may also be unoccupied. Another infrared camera 24 may be disposed in a rearward location in order to capture thermographic images covering a rear seat area in the passenger compartment including occupant areas 27 and 28.
In the front seat area, blowers 30 and 37 for right and left sides of the passenger compartment may be provided which are separately controllable with a variable speed determined by HVAC controller 22. Blower 30 provides a stream of treated air to controlled register vents 31, 33, and 35. Vent 31 is dash-mounted on a left, outer side of the dashboard near occupant seat 25 for providing an air stream 32. Vent 33 is dash-mounted at a left, inside location to supplying an airstream 34, and vent 35 is a left floor vent for providing an airstream 36. At least one of vents 31, 33, and 35 is automatically steerable to direct an airstream at a desired target within occupant area 25. Similarly, variable-speed blower 37 is coupled to dash-mounted front, inner, right vent 38 supplying an airstream 39, front, outer, right vent 40 supplying airstream 41, and right floor vent 42 supplying airstream 43 to occupant area 26. In the present invention, any combination of steerable and fixed vents can be employed. Moreover, a particular controlled vent can also be configured to direct an air stream alternately at different ones of the occupant areas.
A blower 44 also controlled by HVAC controller 22 supplies treated air streams to rear vents 45, 47, and 49 directing airstreams 46, 48, and 50 to occupant areas 27 and 28 as shown.
HVAC controller 22 is connected to or may include a lookup table 51 for purposes described in detail below. In addition, HVAC controller 22 is connected to various sensors including an ambient outside air temperature sensor 52, a cabin internal air temperature sensor 53, and seat occupancy sensors 55. HVAC controller 22 is connected to a cabin-mounted human machine interface (HMI) 54 as known in the art. The controlled vents include actuators that are activated by HVAC controller 22 based on signals from HMI 54, sensors 52, 53, and 55, and IR cameras 23 and/or 24 in order to direct treated air to obtain passenger comfort at an optimized energy usage.
FIG. 3 shows one example of a steerable air outlet vent 60 installed in an instrument panel or dashboard 61. An air duct 62 receiving treated air from a blower supplies the air to a movable outer vent shell 63 retained upon a cup-shaped base 64. A gimbal mounting 65 that can be rotated along one or more axes by a motor 66 under control of the HVAC controller is connected to shell 63. By manipulating gimbal mount 65, an air stream exits an opening in shell 63 to move in a desired direction. Internal flaps or gates, such as a flap 67, may be disposed within shell 63 and coupled with an actuator motor 68 in order to shape (i.e., throttle) the edges of an exiting air stream in order to provide a desired focus of the outlet airstream.
FIG. 4 shows an alternative embodiment for steering an outlet airstream with a vent having controllable vanes 70 and 71. Although two vanes are shown, a greater number of vanes would normally be employed. Each vane 70 and 71 has end pivot points 72 rotatably mounted to a vent housing (not shown). The vanes are all interconnected by a linking rod 73 to maintain a parallel spacing. The up and down motion of rod 73 rotates vanes 70 and 71 in concert in order to direct an outlet air stream along a controllable direction. Rod 73 may be connected to an actuator motor (not shown) which is driven by the HVAC controller.
FIG. 5 depicts an overall process of the present invention for using a thermographic image to identify a target location for aiming an outlet air stream. A thermographic image 75 is captured according to a fixed field of view using an infrared camera to return to multi-valued image with pixels having a color or intensity representing respective temperature values. Based on a predetermined temperature range selected to include an expected temperature of exposed skin taking into consideration the ambient temperature conditions, the multi-valued thermographic image is compressed to a bi-valued image 76 such that pixels falling within the predetermined range are colored white and all other pixels are colored black, for example. Thus, image 76 comprises a temperature map in which regions of white pixels correspond to exposed areas of skin of a vehicle occupant. In the example shown, a head region 81 and arm/ hands regions 82 and 83 are discernible in temperature map 76. However, imaging noise causes regions 81 to 83 to contain scattered black pixels making the region harder to detect automatically by the controller.
Image 77 comprises a further processed image in which regions of the pixels falling within the predetermined temperature range have been coalesced so that the regions become substantially continuous with well defined borders and no scattering of black pixels within the regions. As described below, coalescing may be performed by filtering using a sliding window to successively re-assign each pixel value to match a majority of the respective surrounding pixels.
Since the number of identified regions may exceed the number of steerable air outlets, the detected regions may be ranked according to size to allow the largest to be selected for targeting as shown in image 78. In an image 79, a centroid 88 of each selected continuous region is located in order to provide a precise target for steering the corresponding air outlet.
A preferred method of the invention is shown in FIG. 6 wherein outside ambient temperature and internal cabin temperature are measured in step 90. Preferably, performance of the method may be initiated by unlocking or opening a door to indicate that a driving cycle of the vehicle is about to begin. In step 91, an initial thermographic image is captured, e.g., prior to any occupant being seated inside the passenger cabin. The initial image allows any particularly prominent infrared “hotspots” to be recorded and identified. In step 92, the HVAC system is activated in response to initial conditions as identified by the temperature measurements from step 90 and the initial IR image from step 91. In addition, the initial activation of the HVAC system may be based on historical HVAC settings for a temperature setpoint and blower speed that were set by the driver for similar conditions on previous trips, or according to default control values designed by the manufacturer. The time for activating the HVAC may be determined in the conventional manner, such as when a vehicle engine is remotely started via a wireless controller or when the driver enters the vehicle and starts the engine or other power plant using an ignition key, for example.
In response to a key-on, a thermographic image is captured in step 93 with the driver seating in the corresponding position. The image in step 93 may potentially contain additional occupants who will be present for the impending drive cycle. Using the captured thermographic image, target areas are determined in step 94. The direction and/or focus of various HVAC air stream outlets are adjusted in step 95. Optionally, the outlet temperature of the HVAC system and the blower speed or intensity may also be adjusted. After a predetermined period of time Δt, a new thermographic image may be captured in step 96. Since the HVAC system is actively affecting the temperature environment when subsequent thermographic images are captured, the desired skin features may be masked in the image by the appearance of the air stream. This effect is especially present when the blower is operating at higher speeds. In order to reduce the presence of a temperature signature of the treated air in the image, a check is performed in step 97 to determine whether the blower fan speed is above a threshold. If not, then target areas are determined in the subsequent image in step 94 and then the HVAC outputs are adjusted in step 95. If the fan speed is above the threshold, then the subsequent thermographic image can be filtered in step 98 to remove the effects of the treated air flow in the image. Filtering can be performed based on the turbulent nature of an airflow as seen in a typical thermographic image (e.g., image regions with a certain texture can be deleted from the image). Alternatively, the fan speed can be temporarily reduced or turned off completely during the capturing of the thermographic image.
FIG. 7 shows a preferred method for determining target areas in greater detail. In step 100, the measured internal and external ambient temperatures are used to select the predetermined temperature range for identifying regions in the image showing an occupant's skin. The external temperature indicates whether the occupant's skin is being raised or lowered from a normal body temperature by external conditions. The internal cabin temperature helps identify the expected temperatures of interior surfaces within the vehicle (e.g., headrests). The predetermined temperature range is determined empirically in order to include expected skin temperatures while excluding as many of the interior vehicle surfaces as possible. Preferably, values for the predetermined ranges are stored in a lookup table within or accessible to the HVAC control circuit.
The lookup may be organized according to index values for the internal and external temperatures. FIG. 8 shows one example for specifying a temperature range corresponding to one particular external temperature and showing the changing range for varying internal temperature. The predetermined range has a maximum value defined by a curve 107 and a minimum value defined by a curve 108. For an internal temperature 112 at the low end of curves 107 and 108, a predetermined range 110 is defined by the respective values of curves 17 and 108. For other values of internal temperature (at the same external temperature), a different predetermined range may be obtained such as range 111 at a higher internal temperature indicated at 113. FIG. 8 is representative of curves that are obtained for high external ambient temperatures (i.e., in situations calling for HVAC cooling). During hot external conditions, the interior of the vehicle is typically heated significantly, thereby making it easier to distinguish skin temperatures. Therefore, the predetermined range may be wider at range 111 than at range 110. At more moderate temperatures, it may be more difficult to distinguish skin temperature from body structures, therefore requiring a narrower range at 110.
FIG. 9 is representative of colder external temperatures (i.e., a situation calling for heating of the passenger compartment) with curves 114 and 115 defining the maximum and minimum temperatures of the predetermined temperature range, respectively. Once again, at more extreme (colder) temperatures it may be easier to distinguish the occupant's skin in the image, so a wider predetermined range is specified. At more moderate temperatures it again becomes harder to distinguish the occupants skin and the predetermined range is narrower.
Returning to FIG. 7, using the predetermined range the thermographic image is compressed (i.e., converted) to a temperature map which assigns a first pixel value (e.g., a binary “1” for white) to each pixel falling within the predetermined temperature range and assigning a second pixel value (e.g., a binary “0” for black) if it corresponds to a temperature outside the predetermined range. A portion of the bi-valued temperature map is shown in FIG. 10. Shaded squares 120 correspond to black pixels in the temperature map outside the predetermined temperature range and unshaded squares 121 correspond to white pixels in the thermographic image falling within the predetermined range which indicate a potential target.
The following code written for Matlab demonstrates the compression of a thermograph image into a black and white temperature map and displaying the resulting image.
%Find target areas:
tol = 90;
div = 30;
r=252;
g=243;
b=102;
img2a = img(:,:,1);
img2b = img(:,:,2);
img2c = img(:,:,3);
idx1 = find(img2a>max(0,r−tol) & img2a<min(255,r+tol));
idx2 = find(img2b>max(0,g−tol) & img2b<min(255,g+tol));
idx3 = find(img2c>max(0,b−tol) & img2c<min(255,b+tol));
idx = intersect(idx1,intersect(idx2,idx3));
img2a = zeros(size(img2a));
img2b = zeros(size(img2b));
img2c = zeros(size(img2c));
img2a(idx) = 255;
img2b(idx) = 255;
img2c(idx) = 255;
img2 = (img2a*0.2989 + img2b*0.5870 + img2c*0.1140);
ax(2)=subplot(1,5,2);
imshow(img2/255)
%-------------
In step 102 of FIG. 7, potential target regions are coalesced by filtering with a sliding window. As shown in FIG. 11, the sliding window is preferably comprised of a pixel array 122 centered on a pixel 123. During the filtering process, window 122 is scanned over the thermographic image at each potential center pixel, with the value for each center pixel being reassigned a new value in a coalesced image such that its new value matches a majority value for the pixels of the temperature map within the sliding window at that position. At the position shown in FIG. 11, for example, center pixel 123 would be assigned a binary value of 0 since most pixels within window 122 are black. Stated in an equivalent manner, the average value for all the pixels within window 122 is determined (e.g., counting the white pixels and dividing by the number of pixels covered by the window), with the resulting average being rounded to 0 or 1 to determine the value to be assigned to center pixel 123. FIG. 13 shows the coalesced image, with pixel 123 remaining black.
FIG. 12 shows a subsequent position for sliding window 122 centered on the next pixel 124 in the same row. Since the majority of pixels bounded by this new position of sliding window 122 are black, pixel 124 remains black in the coalesced image of FIG. 13. When sliding window 122 moves to the next position in the same role, a pixel 125 is evaluated, and in the example shown the majority value continues to be black. Therefore, pixel 125 switches to a value of 0 (i.e., white) in FIG. 13. Thus, the filtering results in some minor adjustment of the actual borders of a potential target region. On the other hand, when it comes to isolated black pixels within a target region such as pixels 126 and 127, the filtering by sliding window 122 reassigns them to a value of 1 based upon the majority of pixels in the temperature map around them being white. Thus, FIG. 13 shows a coalesced image in which a more continuous target region based on the use of a sliding window to set all pixels to white whenever the value of the pixels within the window fall on average within the predetermined temperature range.
The following Matlab code continues the example to demonstrate the sliding window filtering to coalesce the target regions.
%Coalesce patches to simplify:
sq=20; %pad img2 w/ zeros around border
img3=img2;
img3=[zeros(sq,size(img3,2)); img3; zeros(sq,size(img3,2))];
img3=[zeros(size(img3,1),sq) img3 zeros(size(img3,1),sq)];
for i = sq+1 : size(img3,1)−sq
for j = sq+1 : size(img3,2)−sq
img3(i,j) = mean(mean(img3(i−sq:i+sq,j−sq:j+sq)));
%  img3(i,j) = 200;
end
disp(i)
end
img3 = img3(sq:end−sq−1,sq:end−sq−1); %remove padding
img3(img3>100)=255;
img3(img3<=100)=0;
ax(3)=subplot(1,5,3);
imshow(img3/255)
%-------------
The sliding window is comprised of a square array of pixels having a size adapted to provide the best performance for removing extraneous noise while preserving the borders of target regions. An array size of 20×20 pixels has been found to be effective. Since the sliding window cannot be centered on a range of pixels along the outer edges of the thermographic image, the corresponding pixels may be disregarded in forming the temperature map (or extra pixels with a zero value can be appended around the original image to facilitate placement of the sliding window.
Returning to FIG. 7, an optional determination of seat occupancy is made in step 103 in the event that there are air outlets capable of being allocated between different seating locations and depending upon the presence or absence of occupants in the corresponding locations. Step 103 can be skipped if the steerable outlet(s) are only capable of being aimed at one particular seat location. The determination of seat occupancy can assist in determining how many air outlets will be aimed at each particular seating location, but such determination can alternatively be a fixed relationship or may be determined by other measures, such as by manual configuration using the HVAC HMI.
In step 104, coalesced regions are ranked by area. If there is only one steerable air outlet then the ranking merely needs to identify the largest coalesced region. Where there are multiple steerable outlets that are going to be used to provide airflow to a particular occupant, then the ranking identifies the corresponding number of the largest coalesced regions in order to assign each respective steerable outlet to a selected area. For example, in a vehicle with two steerable air outlets for serving the front seat passengers and with only two front seating positions (i.e., driver and passenger), then if no passenger is present the two largest coalesced regions in the driver's seating location would be identified and targeted. On the other hand, if a is passenger is present then the largest coalesced region for each of the seating locations are identified and the respective steerable outlets are aimed accordingly.
Ranking the regions by area involves summing the number of white pixels in the region. The Matlab demonstration uses a function called bwboundary in summing the areas as follows.
%Rank area by size:
[B,L] = bwboundaries(img3,‘noholes’);
for k = 1:length(B)
area(k,1) = polyarea(B{k}(:,1),B{k}(:,2));
end
area_sort = flipud(sortrows([area [1:length(B)]′],1));
ax(4)=subplot(1,5,4);
which_areas = [1 ]; %specify ranks 1-to-N to target
for i=which_areas
L_temp = L;
L_temp(L_temp~=int16(area_sort(i,2))) = 0;
L_ranked(:,:,i) = L_temp;
end
img4 = label2rgb(sum(L_ranked,3), @spring, [0.0 0.0 0.0]);
imshow(img4)
%-------------
In step 105, the centroids for the largest ranked region(s) to be targeted are determined. Then the outlets are aimed at the centroids in step 106. A preferred method for locating centroids is illustrated in FIG. 14. In a coalesced image 130, a coalesced region 131 has been ranked and identified as a target area (i.e., it corresponds to the occupant's skin surface). A centroid 132 of region 131 may preferably be determined by calculating an average of the orthogonal coordinates of the pixels within the region 131. Thus, orthogonal coordinates x and y correspond to the columns and rows of image 130. The coordinates for two of the included pixels are shown as (x1,y1) and (x2,y2). The x and y values for all the pixels within region 131 are averaged in order to determine the average coordinate for centroid 132 (with the average value being rounded off).
Continuing the Matlab example, locating the centroid is demonstrated as follows.
%Find centroids of target area(s):
for i=which_areas
[row,col] = find(L_ranked(:,:,i)>0);
L_ranked_cent(i,:) = [round(mean(col)) round(mean(row))];
end
ax(5)=subplot(1,5,5);
imshow(img4)
hold on
plot(L_ranked_cent(:,1),L_ranked_cent(:,2),‘w.’,‘markersize’,40)
plot(L_ranked_cent(:,1),L_ranked_cent(:,2),‘r.’,‘markersize’,35)
plot(L_ranked_cent(:,1),L_ranked_cent(:,2),‘w+’,‘markersize’,10)
linkaxes(ax,‘x’)
% hold on
% for k = 1:length(B)
% boundary = B{k};
% plot(boundary(:,2), boundary(:,1), ‘w’, ‘LineWidth’, 2)
% end

Claims (14)

What is claimed is:
1. Vehicle apparatus comprising:
a heating, ventilating, and air conditioning (HVAC) system having a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle;
a thermographic imager configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located; and
an HVAC control circuit configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid.
2. The vehicle apparatus of claim 1 further comprising:
an ambient temperature sensor measuring an external temperature outside the vehicle; and
a cabin temperature sensor measuring an internal temperature inside the passenger compartment;
wherein the HVAC control circuit selects the predetermined temperature range in response to the external and internal temperatures.
3. The vehicle apparatus of claim 2 wherein the HVAC control circuit includes a lookup table defining a minimum temperature and a maximum temperature of the predetermined range according to the measured internal and external temperatures.
4. The vehicle apparatus of claim 1 wherein the steerable outlet has a variable focus controllable by the HVAC control circuit in response to a magnitude of the largest area.
5. The vehicle apparatus of claim 1 wherein the steerable outlet has a variable flow rate controllable by the HVAC control circuit in response to the internal temperature.
6. The vehicle apparatus of claim 1 wherein the temperature map is comprised of pixels each having either a first value indicating a temperature within the predetermined range or a second value indicating a temperature outside the predetermined range.
7. The vehicle apparatus of claim 6 wherein the sliding window is comprised of a square array of pixels successively scanning the temperature map, wherein a pixel at successive centers of the square array is assigned a value matching a majority value for the pixels of the temperature map within the square array at each successive position.
8. The vehicle apparatus of claim 1 wherein the area for each continuous region is quantified in response to summing a number of pixels within the region.
9. The vehicle apparatus of claim 1 wherein the centroid of the region is located in response to an average of orthogonal coordinates of the pixels of the region.
10. Vehicle apparatus comprising:
a heating, ventilating, and air conditioning (HVAC) system having a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle;
a thermographic imager configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located; and
an HVAC control circuit configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid;
wherein the HVAC system includes a plurality of steerable outlets serving an occupant, and wherein the HVAC control circuit ranks a plurality of continuous regions according to their respective quantified areas and aims each respective steerable outlet to a respective centroid of a different one of the ranked regions.
11. Vehicle apparatus comprising:
a heating, ventilating, and air conditioning (HVAC) system having a steerable outlet for directing a stream of treated air into a passenger compartment of a vehicle;
a thermographic imager configured to capture thermographic images covering a fixed region within the passenger compartment in which an occupant is potentially located; and
an HVAC control circuit configured to a) compress a thermographic image to a temperature map representing pixels of the thermographic image falling within a predetermined temperature range corresponding to the occupant, b) filter the temperature map according to a sliding window to coalesce continuous regions of pixels on average falling within the predetermined temperature range, c) quantify an area for each continuous region, d) locate a centroid of a continuous region having a largest area, and e) aim the steerable outlet toward the centroid;
wherein the HVAC control circuit periodically re-aims the steerable outlet in response to updated thermographic images.
12. The vehicle apparatus of claim 10 further comprising;
a seat occupancy detector providing an indication whether each one of a plurality of seating positions within the passenger compartment are occupied;
wherein one of the steerable outlets is primarily dedicated to a first one of the seating positions and is steered to a second one of the seating positions when the seat occupancy detector indicates that the first one of the seating positions is unoccupied.
13. The vehicle apparatus of claim 11 wherein the HVAC system includes a variable speed blower, and wherein an operating speed of the blower is reduced during capturing of an updated thermographic image.
14. The vehicle apparatus of claim 11 wherein the HVAC control circuit filters an updated thermographic image to reduce imaging of the stream of treated air.
US14/492,637 2014-09-22 2014-09-22 Directional climate control system with infrared targeting Active 2036-05-01 US9862247B2 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
US14/492,637 US9862247B2 (en) 2014-09-22 2014-09-22 Directional climate control system with infrared targeting
DE102015115066.2A DE102015115066A1 (en) 2014-09-22 2015-09-08 Directed climate control system with infrared target search
RU2015139328A RU2681972C2 (en) 2014-09-22 2015-09-15 Vehicle layout, device and method for controlling heating, ventilation and air conditioning system
CN201510586762.9A CN105437906B (en) 2014-09-22 2015-09-15 Orientation atmosphere control system with IR pointer
BR102015024242-5A BR102015024242A2 (en) 2014-09-22 2015-09-21 CLIMATE CONTROL SYSTEM WITH INFRARED SELECTION.
TR2015/11752A TR201511752A2 (en) 2014-09-22 2015-09-21 INFRARED TARGETED GUIDED AIR CONDITIONING CONTROL SYSTEM
MX2015013491A MX364869B (en) 2014-09-22 2015-09-22 Directional climate control system with infrared targeting.
US15/831,487 US10179499B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting
US15/831,486 US10369865B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/492,637 US9862247B2 (en) 2014-09-22 2014-09-22 Directional climate control system with infrared targeting

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/831,487 Division US10179499B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting
US15/831,486 Division US10369865B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting

Publications (2)

Publication Number Publication Date
US20160082808A1 US20160082808A1 (en) 2016-03-24
US9862247B2 true US9862247B2 (en) 2018-01-09

Family

ID=55444906

Family Applications (3)

Application Number Title Priority Date Filing Date
US14/492,637 Active 2036-05-01 US9862247B2 (en) 2014-09-22 2014-09-22 Directional climate control system with infrared targeting
US15/831,487 Active US10179499B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting
US15/831,486 Active 2034-12-20 US10369865B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting

Family Applications After (2)

Application Number Title Priority Date Filing Date
US15/831,487 Active US10179499B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting
US15/831,486 Active 2034-12-20 US10369865B2 (en) 2014-09-22 2017-12-05 Directional climate control system with infrared targeting

Country Status (7)

Country Link
US (3) US9862247B2 (en)
CN (1) CN105437906B (en)
BR (1) BR102015024242A2 (en)
DE (1) DE102015115066A1 (en)
MX (1) MX364869B (en)
RU (1) RU2681972C2 (en)
TR (1) TR201511752A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170028811A1 (en) * 2015-02-27 2017-02-02 Braeburn Inc. Vehicle Extreme Temperature Safety Systems
US11161389B2 (en) 2017-07-07 2021-11-02 Nissan Motor Co., Ltd. Vehicle air-conditioning method and vehicle air-conditioning device
US20220185063A1 (en) * 2020-12-11 2022-06-16 Ford Global Technologies, Llc Vehicle air vent system
US20220196269A1 (en) * 2020-12-21 2022-06-23 Microjet Technology Co., Ltd. Method of filtering indoor air pollution
US11772461B2 (en) 2020-12-21 2023-10-03 Microjet Technology Co., Ltd. Method of air pollution filtration in vehicle
US11912108B2 (en) 2020-12-11 2024-02-27 Ford Global Technologies, Llc Vehicle air vent system

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9862247B2 (en) * 2014-09-22 2018-01-09 Ford Global Technologies, Llc Directional climate control system with infrared targeting
DE102014219408A1 (en) * 2014-09-25 2016-04-14 Volkswagen Aktiengesellschaft Method and device for setting a thermal comfort state
US10946716B2 (en) * 2016-02-21 2021-03-16 Eric Ireri Vehicle temperature sensor systems
DE102016116115A1 (en) * 2016-08-30 2018-03-01 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Ventilation system and ventilation method for a motor vehicle
US10239381B2 (en) * 2017-01-23 2019-03-26 TSI Products, Inc. Vehicle roof fan
US10272742B2 (en) * 2017-01-26 2019-04-30 GM Global Technology Operations LLC HVAC systems and methods for controlling zoned interior temperatures of a vehicle including display of thermographic anthropomorphic figures
US10183546B2 (en) 2017-02-27 2019-01-22 Ford Global Technologies, Llc Infrared sensor arrays for monitoring vehicle occupants and windows
DE102017003550B4 (en) 2017-04-12 2023-08-31 Mercedes-Benz Group AG Method for operating a heating, ventilation and/or air conditioning system and heating, ventilation and/or air conditioning system
US10323854B2 (en) * 2017-04-21 2019-06-18 Cisco Technology, Inc. Dynamic control of cooling device based on thermographic image analytics of cooling targets
US20180370431A1 (en) * 2017-06-23 2018-12-27 Aamp Of Florida, Inc. Unattented occupant protection system (uops) safety system
DE102017115767B3 (en) * 2017-07-13 2018-06-21 Dr. Schneider Kunststoffwerke Gmbh Method for measuring and operating an exhaust system and exhaust system
US10603980B2 (en) * 2017-09-14 2020-03-31 Lin Yu Vehicle interior environment control
US11465631B2 (en) * 2017-12-08 2022-10-11 Tesla, Inc. Personalization system and method for a vehicle based on spatial locations of occupants' body portions
US11015832B2 (en) 2018-01-12 2021-05-25 Carrier Corporation Thermographic sensing of human thermal conditions to improve thermal comfort
IT201800005553A1 (en) * 2018-05-21 2019-11-21 METHOD FOR DETECTION OF THE INTERNAL TEMPERATURE OF A REMOTE AIRCRAFT CABIN BY MEANS OF A THERMAL CAMERA AND MEANS FOR ITS IMPLEMENTATION
EP3666564B1 (en) * 2018-12-12 2023-10-11 Ningbo Geely Automobile Research & Development Co., Ltd. A system and method for estimating climate needs
CN109720167B (en) * 2018-12-29 2022-01-18 曼德电子电器有限公司 Vehicle air conditioner control system and method
JP7500920B2 (en) * 2019-01-23 2024-06-18 株式会社デンソー Radiation information calculation device and temperature information calculation device
EP3872597B1 (en) * 2020-02-28 2023-05-24 Ningbo Geely Automobile Research & Development Co., Ltd. Object temperature regulator system
EP3871910B1 (en) * 2020-02-28 2023-07-26 Ningbo Geely Automobile Research & Development Co. Ltd. Regulation of vehicle interior climate
DE102020109353A1 (en) 2020-04-03 2021-10-07 Esg Mobility Gmbh Device and method for adaptive control of an air flow of an air conditioning system in a vehicle
US20210394912A1 (en) * 2020-06-18 2021-12-23 B/E Aerospace, Inc. Software controlled air flow management
CN111731074B (en) * 2020-06-30 2022-03-04 东风汽车有限公司 Automobile air port adjusting method and electronic equipment
CN113022254B (en) * 2021-03-30 2022-05-20 东风柳州汽车有限公司 Air output adjusting method, device and equipment of vehicle-mounted air conditioner and storage medium
CN113370745A (en) * 2021-06-23 2021-09-10 曼德电子电器有限公司 Air conditioner control method and device, storage medium and electronic equipment
CN113887474B (en) * 2021-10-15 2022-09-23 深圳市商汤科技有限公司 Respiration rate detection method and device, electronic device and storage medium
US11919361B2 (en) 2022-03-21 2024-03-05 Ford Global Technologies, Llc Vehicle floor panel
US12030409B2 (en) 2022-03-21 2024-07-09 Ford Global Technologies, Llc Seating assembly with swivel capability

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5187943A (en) * 1990-08-24 1993-02-23 Kabushiki Kaisha Toyota Chuo Kenkyosho Control apparatus for air-conditioner
JPH06106952A (en) 1992-09-25 1994-04-19 Matsushita Electric Works Ltd Air conditioning temperature control system for vehicle
US5518176A (en) * 1995-02-02 1996-05-21 Delco Electronics Corporation Automotive climate control with infra-red sensing
US5531377A (en) * 1995-02-01 1996-07-02 Delco Electronics Corporation Method and apparatus for calibration of comfort control IR sensor
US5579994A (en) * 1995-07-26 1996-12-03 Ford Motor Company Method and control system for adaptively controlling an automotive HVAC system
US20020110178A1 (en) * 2000-05-15 2002-08-15 Delphi Technologies, Inc. Infrared temperature sensor
US20030157881A1 (en) * 2002-02-19 2003-08-21 Goupil Gerald M. Motor vehicle air filter apparatus with an easily removable air filter
US6659360B1 (en) * 2002-11-26 2003-12-09 Ford Global Technologies, Llc Method and system for a two-second key hold convention for climate control
US7246656B2 (en) * 2002-10-30 2007-07-24 Denso Corporation Vehicle air conditioner
US20080105754A1 (en) * 2004-01-15 2008-05-08 Behr Gmbh & Co. Kg Heating, Ventilating or Air-Conditioning System
US7578341B2 (en) * 2004-04-19 2009-08-25 Denso Corporation Air conditioning system for motor vehicle
US20120142264A1 (en) * 2010-12-07 2012-06-07 Denso Corporation Air conditioner for vehicle
US8280584B2 (en) * 2010-05-10 2012-10-02 Toyota Motor Engineering & Manufacturing North America, Inc. Climate control system
US20130255930A1 (en) * 2012-03-27 2013-10-03 Ford Global Technologies, Llc Driver personalized climate conditioning
US20140120819A1 (en) * 2012-10-31 2014-05-01 Honeywell International Inc. Controlling a fume hood airflow using an image of a fume hood opening
US20150094914A1 (en) * 2004-02-26 2015-04-02 Geelux Holding, Ltd. Method and apparatus for biological evaluation
US9074785B2 (en) * 2012-07-26 2015-07-07 Honeywell International Inc. Operation of a thermal comfort system
US9189897B1 (en) * 2014-07-28 2015-11-17 Here Global B.V. Personalized driving ranking and alerting
US20160082808A1 (en) * 2014-09-22 2016-03-24 Ford Global Technologies, Llc Directional climate control system with infrared targeting
US20160195856A1 (en) * 2014-01-08 2016-07-07 Yechezkal Evan Spero Integrated Docking System for Intelligent Devices
US9417638B2 (en) * 2012-12-20 2016-08-16 Automotive Research & Testing Center Intelligent thermostatic control method and device for an air conditioner blowing cold and hot air
US20160363340A1 (en) * 2015-06-10 2016-12-15 Panasonic Corporation Air conditioner, sensor system, and thermal sensation estimation method
US9628565B2 (en) * 2014-07-23 2017-04-18 Here Global B.V. Highly assisted driving platform
US9623725B2 (en) * 2009-10-27 2017-04-18 Mahle International Gmbh Air vent

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU21462U1 (en) * 2001-06-29 2002-01-20 Федеральный научно-производственный центр закрытое акционерное общество "Научно-производственный концерн (объединение) "ЭНЕРГИЯ" CLIMATE CONTROL SYSTEM OF THE CAR
JP4353053B2 (en) * 2004-10-04 2009-10-28 株式会社デンソー Air conditioner for vehicles
JP2007001464A (en) * 2005-06-24 2007-01-11 Nissan Motor Co Ltd Air conditioner controller and controlling method for vehicle
JP2007283918A (en) * 2006-04-18 2007-11-01 Calsonic Kansei Corp Air conditioner for vehicle
US9150132B2 (en) 2011-06-13 2015-10-06 Ford Global Technologies, Llc Vehicle comfort system with efficient coordination of complementary thermal units
JP6106952B2 (en) * 2012-05-29 2017-04-05 栗田工業株式会社 Radioactive material adsorbent, and adsorption vessel, adsorption tower, and water treatment apparatus using the same
US9323725B2 (en) 2014-01-24 2016-04-26 E-Image Data Corporation Multi-mode image capture systems and methods

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5187943A (en) * 1990-08-24 1993-02-23 Kabushiki Kaisha Toyota Chuo Kenkyosho Control apparatus for air-conditioner
JPH06106952A (en) 1992-09-25 1994-04-19 Matsushita Electric Works Ltd Air conditioning temperature control system for vehicle
US5531377A (en) * 1995-02-01 1996-07-02 Delco Electronics Corporation Method and apparatus for calibration of comfort control IR sensor
US5518176A (en) * 1995-02-02 1996-05-21 Delco Electronics Corporation Automotive climate control with infra-red sensing
US5579994A (en) * 1995-07-26 1996-12-03 Ford Motor Company Method and control system for adaptively controlling an automotive HVAC system
US20020110178A1 (en) * 2000-05-15 2002-08-15 Delphi Technologies, Inc. Infrared temperature sensor
US20030157881A1 (en) * 2002-02-19 2003-08-21 Goupil Gerald M. Motor vehicle air filter apparatus with an easily removable air filter
US7246656B2 (en) * 2002-10-30 2007-07-24 Denso Corporation Vehicle air conditioner
US6659360B1 (en) * 2002-11-26 2003-12-09 Ford Global Technologies, Llc Method and system for a two-second key hold convention for climate control
US20080105754A1 (en) * 2004-01-15 2008-05-08 Behr Gmbh & Co. Kg Heating, Ventilating or Air-Conditioning System
US20150094914A1 (en) * 2004-02-26 2015-04-02 Geelux Holding, Ltd. Method and apparatus for biological evaluation
US7578341B2 (en) * 2004-04-19 2009-08-25 Denso Corporation Air conditioning system for motor vehicle
US9623725B2 (en) * 2009-10-27 2017-04-18 Mahle International Gmbh Air vent
US8280584B2 (en) * 2010-05-10 2012-10-02 Toyota Motor Engineering & Manufacturing North America, Inc. Climate control system
US20120142264A1 (en) * 2010-12-07 2012-06-07 Denso Corporation Air conditioner for vehicle
US20130255930A1 (en) * 2012-03-27 2013-10-03 Ford Global Technologies, Llc Driver personalized climate conditioning
US9074785B2 (en) * 2012-07-26 2015-07-07 Honeywell International Inc. Operation of a thermal comfort system
US20140120819A1 (en) * 2012-10-31 2014-05-01 Honeywell International Inc. Controlling a fume hood airflow using an image of a fume hood opening
US9417638B2 (en) * 2012-12-20 2016-08-16 Automotive Research & Testing Center Intelligent thermostatic control method and device for an air conditioner blowing cold and hot air
US20160195856A1 (en) * 2014-01-08 2016-07-07 Yechezkal Evan Spero Integrated Docking System for Intelligent Devices
US9628565B2 (en) * 2014-07-23 2017-04-18 Here Global B.V. Highly assisted driving platform
US9189897B1 (en) * 2014-07-28 2015-11-17 Here Global B.V. Personalized driving ranking and alerting
US20160082808A1 (en) * 2014-09-22 2016-03-24 Ford Global Technologies, Llc Directional climate control system with infrared targeting
US20160363340A1 (en) * 2015-06-10 2016-12-15 Panasonic Corporation Air conditioner, sensor system, and thermal sensation estimation method

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170028811A1 (en) * 2015-02-27 2017-02-02 Braeburn Inc. Vehicle Extreme Temperature Safety Systems
US10457113B2 (en) * 2015-02-27 2019-10-29 Braeburn Inc. Vehicle extreme temperature safety systems and methods
US11161389B2 (en) 2017-07-07 2021-11-02 Nissan Motor Co., Ltd. Vehicle air-conditioning method and vehicle air-conditioning device
US20220185063A1 (en) * 2020-12-11 2022-06-16 Ford Global Technologies, Llc Vehicle air vent system
US11865896B2 (en) * 2020-12-11 2024-01-09 Ford Global Technologies, Llc Vehicle air vent system
US11912108B2 (en) 2020-12-11 2024-02-27 Ford Global Technologies, Llc Vehicle air vent system
US20220196269A1 (en) * 2020-12-21 2022-06-23 Microjet Technology Co., Ltd. Method of filtering indoor air pollution
US11772461B2 (en) 2020-12-21 2023-10-03 Microjet Technology Co., Ltd. Method of air pollution filtration in vehicle
US12013151B2 (en) * 2020-12-21 2024-06-18 Microjet Technology Co., Ltd. Method of filtering indoor air pollution

Also Published As

Publication number Publication date
DE102015115066A1 (en) 2016-03-24
US20160082808A1 (en) 2016-03-24
MX364869B (en) 2019-05-08
CN105437906A (en) 2016-03-30
RU2681972C2 (en) 2019-03-14
US10369865B2 (en) 2019-08-06
RU2015139328A (en) 2017-03-21
CN105437906B (en) 2019-08-20
US20180093546A1 (en) 2018-04-05
US20180093547A1 (en) 2018-04-05
RU2015139328A3 (en) 2018-10-26
BR102015024242A2 (en) 2017-12-05
TR201511752A2 (en) 2017-04-21
MX2015013491A (en) 2016-05-31
US10179499B2 (en) 2019-01-15

Similar Documents

Publication Publication Date Title
US10369865B2 (en) Directional climate control system with infrared targeting
CN105383444B (en) Windshield defogging system and method
US20190184788A1 (en) Method and system of controlling climate controlled zones in a vehicle based on occupant presence
CN105818638A (en) Adaptive vehicle climate control system and method
US20160137028A1 (en) Intelligent climate control system for a motor vehicle
US11014428B2 (en) Controlling climate in vehicle cabins
CN104329768A (en) Methods and apparatus for automatic climate control in a vehicle based on clothing insulative factor
JP6269413B2 (en) Humidifier for vehicle
JPH1067218A (en) Air conditioner of running vehicle provided with air guide device which can be adjusted in relation to solar radiation
US20190054798A1 (en) Air diffusion system and method for vehicle passenger compartment
US10377208B2 (en) Use of discharge air sensors to control recirculation door during heat request
US20110166747A1 (en) System And Method For Controlling Temperature In An Automotive Vehicle
US11479078B2 (en) Multi-zone air conditioner system for large vehicles and control method thereof
JP2020172218A (en) Air-conditioning control system and air-conditioning control method
CN106882009B (en) Method and device for starting an air exchange operation
DE102020122355A1 (en) STEERING WHEEL PRE-AIR CONDITIONING
JP4010282B2 (en) Air conditioner for vehicles
JP3938138B2 (en) Air conditioner for vehicles
CN111959231B (en) Control method of vehicle air conditioner, vehicle-mounted terminal and vehicle
US12103361B2 (en) Ventilation system and air condition apparatus
JP2005349935A (en) Air conditioner for vehicle
DE102022133684A1 (en) ADAPTIVE VEHICLE HVAC SYSTEM DEPENDING ON OPERATOR POSITION RELATIVE TO VEHICLE
GB2619993A (en) Climate controller and climate control method
CN114714858A (en) Air conditioning system for vehicle, control method thereof and vehicle
WO2024064706A1 (en) Environmental preconditioning

Legal Events

Date Code Title Description
AS Assignment

Owner name: FORD GLOBAL TECHNOLOGIES, LLC, MICHIGAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PERKINS, WILLIAM PAUL;REEL/FRAME:033788/0393

Effective date: 20140909

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4