CN103707781B - Based on the driver's seat position automatic adjustment system of range image - Google Patents
Based on the driver's seat position automatic adjustment system of range image Download PDFInfo
- Publication number
- CN103707781B CN103707781B CN201310731553.XA CN201310731553A CN103707781B CN 103707781 B CN103707781 B CN 103707781B CN 201310731553 A CN201310731553 A CN 201310731553A CN 103707781 B CN103707781 B CN 103707781B
- Authority
- CN
- China
- Prior art keywords
- image
- chaufeur
- seat
- driver
- range image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims abstract description 37
- 230000001105 regulatory effect Effects 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims description 24
- 238000001514 detection method Methods 0.000 claims description 16
- 230000001815 facial effect Effects 0.000 claims description 16
- 230000004927 fusion Effects 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000013523 data management Methods 0.000 claims description 5
- 238000013500 data storage Methods 0.000 claims description 4
- 230000000153 supplemental effect Effects 0.000 claims description 4
- 230000008569 process Effects 0.000 description 5
- 238000012549 training Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 210000002414 leg Anatomy 0.000 description 4
- 238000000513 principal component analysis Methods 0.000 description 4
- 238000009423 ventilation Methods 0.000 description 4
- 238000005286 illumination Methods 0.000 description 3
- 238000010191 image analysis Methods 0.000 description 3
- 230000037396 body weight Effects 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006386 memory function Effects 0.000 description 2
- 238000005057 refrigeration Methods 0.000 description 2
- 210000004243 sweat Anatomy 0.000 description 2
- 210000000689 upper leg Anatomy 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000010339 dilation Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003628 erosive effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a kind of driver's seat position automatic adjustment system based on range image, comprise image collecting device, image processing apparatus and chair regulating device, it is characterized in that described image collecting device, at least comprise 1 range image sensor, 1 CMOS camera and 2 infrared cameras, for intensity image and the range image of Real-time Collection chaufeur, and the intensity image of collection and range image are transferred to image processing apparatus; Described image processing apparatus is used for processing the intensity image of chaufeur gathered and range image, obtain the location information of chaufeur, and the parameters of adjusting seat position is formed according to the location information of chaufeur, according to driver command, the parameters of chaufeur adjusting seat position is transferred to seat adjustment device; Described seat adjustment device is according to the instruction of chaufeur, and the configuration information according to the chaufeur adjusting seat position received is optimized adjustment to vehicle driver's seat.This systems axiol-ogy chaufeur position of human eye, realizes the Automatic Optimal adjustment of driver's seat position, solves the problem regulating driver's seat position manually in conjunction with vehicle parameter.
Description
Technical field
The invention belongs to technical field of intelligent traffic, be specifically related to a kind of driver's seat position automatic adjustment system based on range image.
Background technology
Seat in automobile is that the critical facility with ride comfort degree is driven in impact, and the safety, Sitting comfort, the visual field, operation convenience etc. of driver's seat position on chaufeur all have important impact.Be applicable to driver's seat and the seat position of driver's operation, can reduce the degree of fatigue of chaufeur, the incidence of reduction accident, the whether suitable of driver chair of automobile position is directly connected to ride quality.
In existing driver's seat position optimizing device, although the multi-faceted adjustment of driver's seat can be realized, but be all almost regulated manually by chaufeur, when same vehicle changes driver, again the seat position that manual regulation is suitable again, makes troubles to driver behavior.The present invention therefore.
Summary of the invention
The invention provides a kind of driver's seat position automatic adjustment system based on range image, system solves the problem the multi-faceted adjustment of driver's seat in prior art is all manual regulation, control process complexity, inadequate hommization; The not equal technical matters of the degree that different chaufeurs regulates.
In order to solve these problems of the prior art, technical scheme provided by the invention is:
A kind of driver's seat position automatic adjustment system based on range image, comprise image collecting device, image processing apparatus and chair regulating device, it is characterized in that described image collecting device, at least comprise 1 range image sensor, 1 CMOS camera and 2 infrared cameras, for intensity image and the range image of Real-time Collection chaufeur, and the intensity image of collection and range image are transferred to image processing apparatus; Described image processing apparatus is used for carrying out fusion treatment to the intensity image of chaufeur gathered and range image, obtain the location information of chaufeur, and the parameters of adjusting seat position is formed according to the location information of chaufeur, according to driver command, the parameters of chaufeur adjusting seat position is transferred to seat adjustment device; Described seat adjustment device is according to the instruction of chaufeur, and the configuration information according to the chaufeur adjusting seat position received is optimized adjustment to vehicle driver's seat.
Preferred technical scheme is: range image sensor, CMOS camera are connected with the input end of image processing apparatus with the mouth of infrared camera.
Preferred technical scheme is: described image processing apparatus is DSP disposal system, and the mouth of DSP disposal system is connected with the input end of seat adjustment device.
Preferred technical scheme is: described system also comprises data storage apparatus, described data storage apparatus and image processing apparatus, receive the reading of image processing apparatus or store instruction, for reading or the intensity image of memory of driving person and the parameters of range image and adjusting seat position.
Preferred technical scheme is: described system also comprises the input/output unit be connected with image processing apparatus, user instruction is passed to image processing apparatus according to the input operation of user by described input/output unit, image processing apparatus carries out seat adjustment according to user instruction, and relevant information is exported prompting user.
Another object of the present invention is to provide a kind of driver's seat position automatic adjusting method based on range image, it is characterized in that said method comprising the steps of:
(1) receive the automatic adjustment seat instruction of chaufeur, start the range image and the intensity image that gather chaufeur;
(2) fusion treatment is carried out to the intensity image of chaufeur gathered and range image, obtain the location information of chaufeur, and form the parameters of adjusting seat position according to the location information of chaufeur;
(3) according to the configuration information of the chaufeur adjusting seat position received, adjustment is optimized to vehicle driver's seat.
Preferred technical scheme is: described method step (2) specifically comprises the following steps:
1) range image of the chaufeur collected is carried out edge extracting, determine the center of face; Face classification device is utilized to carry out Face datection the intensity image of the chaufeur collected; Face location and size is accurately determined according to the intensity image that analysis and the synchronization of range image obtain;
2) facial image detected is followed the tracks of, the facial image of location detects position of human eye, obtain position of human eye and distance in image;
3) obtain the vehicle parameter of chaufeur human parameters and driving according to user instruction, position of human eye and distance in combining image, form the seat position parameters being applicable to this chaufeur.
Preferred technical scheme is: after receiving the automatic adjustment seat instruction of chaufeur in described method step (1), and described method also comprises the step carrying out judging whether the automatic adjustment seat instruction performing chaufeur according to following condition, and described condition is:
I) whether the kinematic velocity of current steering vehicle is zero;
Ii) whether current steering vehicle have employed brake measure;
Iii) whether the pilot harness of current steering vehicle is in the state fastened;
When three kinds of conditions that and if only if all meet, just perform the automatic adjustment seat instruction of chaufeur.
The range image that the present invention utilizes range image sensor and infrared camera to obtain combines with intensity image, detect chaufeur position of human eye, realize the Automatic Optimal of driver's seat position in conjunction with vehicle parameter, solve the problem needing manual mode to regulate driver's seat position.The memory function of seat position can be added in addition, when chaufeur in the past drives same vehicle again, only need record be regulated to carry out Automatic Optimal by the seat position transferred according to the face recognition result stored in the past.
In order to describe content of the present invention easily, image of first adjusting the distance defines.
Range image, i.e. depth image.In three dimensional computer graphics, depth image refers to look from observation visual angle, a kind of image that the information that image comprises is relevant to object scene surface distance or an image channel.Like this, suppose that the change direction (i.e. pick up camera shooting direction) of image depth values is identical with direction, the visual field Z-direction of the three-dimensional scenic of required description, so just can describe whole three-dimensional scenic easily.Therefore, depth image is also referred to as range image.Compared with coloured image, the three-dimensional feature of the direct reflection surface of depth image energy, and not by the impact of the factors such as illumination, shade and colourity.In the present invention, the image-forming principle utilizing range image sensor, 2 infrared cameras to obtain range images is time-of-flight method: send light pulse continuously by giving target, then receive the light returned from object with sensor, obtained the distance of object by the turnaround time calculating light pulse.
In range image, black represents infinite distance, and white represents infinitely near, and the gray areas between black and white corresponds to the physical distance of object to range image sensor.No matter under any illuminating ray, it can collect the information of each point in the visual field, and is generated a range image in order to represent environmental information.Each point on range image, all has one from the numerical value between 0 to 255, and different numerical value represents the distance of this point to infrared camera.Therefore, according to the data value of each point on range image, can learn that they arrive the distance of range image sensor.Time flight method is a kind of method of measurement, its high speed light wave of being released by laser or microwave and millimeter wave radar or sound wave, can very fast being reflected back when these ripples run into object, can be calculated the position of obstacle or target by this reflection.
Broadly, image is exactly all pictures with visual effect, and it comprises: on paper medium, egative film or photo, on TV, projector or computer screen, can be divided into analog image and digital image according to different recording mode.The power change that analog image can pass through certain physical quantity (as optical, electrical etc.) comes document image monochrome information, such as simulated television image; Digital image is then carry out the monochrome information of each point on document image by the data of Computer Storage.Intensity image of the present invention narrowly refers to the digital image for image procossing obtained by visible image capturing head, and it is two dimensional image, by array or matrix representation, describes arbitrarily pixel, intensity and color by numeral.Image storage format conventional in a computer has BMP, TIFF, EPS, JPEG, GIF, PSD, PDF etc.
The driver's seat position automatic adjustment system that the present invention is based on range image analysis comprises image collecting device, image processing apparatus and chair regulating device.
Wherein image capture module can be arranged on the top of meter panel of motor vehicle, with front face image when can photograph right ahead faced by steerman for benchmark, after vehicle launch, camera is adopted to obtain range image sequence and intensity image sequence, with the status information near Real-time Obtaining driver head and head.Described image collecting device at least comprises range image sensor, 2 infrared cameras, 1 CMOS camera, and range image sensor and 2 infrared cameras combine for obtaining range image sequence; CMOS camera, for obtaining intensity image sequence.
Image processing apparatus adopts DSP disposal system, and DSP disposal system carries out Treatment Analysis to the range image sequence collected and intensity image sequence.Wherein input/output unit can also be comprised, wherein output unit is read out instrument, information displaying and setting can be carried out, for showing the date of the adjusting seat position data of Pilot Name and correspondence, and by choosing Pilot Name and regulating the date to be directly optimized seat position.
Image processing apparatus has image capture module, range image sensor application module, face detection module, face tracking module, human eye detection module, supplemental characteristic library module, data management module, and the driver's seat position Automatic Optimal being used for carrying out analyzing based on range image adjusts.Wherein image capture module, for sending instruction to image collecting device, the range image sequence collected by range image sensor, infrared camera and CMOS camera gather intensity image sequence.Range image sensor application module, studies and the range image information got is combined with the intensity image information of same time, be accurately identified the method for driver eye positions; Face detection module, fusion distance image and intensity image information, detect position and the size (border) of people face part in intensity image; Face tracking module, follows the tracks of the facial image detected, to reduce loss and false drop rate; Human eye detection module, the facial image of location detects position of human eye; Supplemental characteristic library module, comprises chaufeur human parameters as the data such as height, body weight, and vehicle parameter is as data such as automobile model, the adjustable amplitude peak of seat position, headstock height; Data management module, for the seat position data message being applicable to this chaufeur of memory of driving person's face recognition result and correspondence; Seat adjusting module, for reading seat adjustment parameter, and generates seat adjustment instruction according to the parameter of seat adjustment and sends to chair regulating device.
Chair regulating device can adopt existing electric seat of car control system, after image processing apparatus sends the parameter after adjustment instruction and concrete adjustment to chair regulating device, chair regulating device automatically adjusts according to the destination locations state provided in current position state and parameter.Adjustment as low in seat height, in order to make occupant can find suitable driving sitting position or comfortable Ride Style, by electric device adjusting seat height.As seat temperature regulates, have the devices such as electro heat, refrigeration and ventilation when seat configurations after, seat temperature can be heated up or cooling by the demand of occupant, ventilation function then effectively can improve the air circulation of human body and seat contact portion, make contact surface dry and comfortable comfortable, not easily produce sweat.As leg support of seat regulates, by seat front end cushion length or angle, the good contact between thigh can be kept, provide the support of leg more multiple location, to meet the requirement of passenger to traveling comfort.As regulated before and after seat, by the front and back position of adjusting seat, to meet the requirement of passenger to vehicular drive.
Relative to scheme of the prior art, advantage of the present invention is:
The invention provides a kind of driver's seat position Automatic Optimal system analyzed based on range image, the range image utilizing range image sensor and infrared camera to obtain combines with intensity image, detect chaufeur position of human eye, the Automatic Optimal of driver's seat position is realized in conjunction with vehicle parameter, solve the problem regulating driver's seat position manually, also add the memory function of seat position in addition, when chaufeur in the past drives same vehicle again, only need record be regulated to carry out Automatic Optimal adjustment by the seat position transferred according to the face recognition result stored in the past.
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the invention will be further described:
Fig. 1 is the structured flowchart based on the driver's seat position automatic adjustment system of range image in the present invention;
Fig. 2 is the software architecture figure based on the driver's seat position automatic adjustment system image processing system of range image in the present invention;
Fig. 3 is the workflow schematic diagram based on the driver's seat position automatic adjustment system of range image in the present invention.
Fig. 4 is the processing flow chart based on the driver's seat position automatic adjustment system range image of range image in the present invention;
Fig. 5 (a) certain width range image for collecting, in (b), white portion is the contours extract result that this range image is corresponding.
Detailed description of the invention
Below in conjunction with specific embodiment, such scheme is described further.Should be understood that these embodiments are not limited to for illustration of the present invention limit the scope of the invention.The implementation condition adopted in embodiment can do further adjustment according to the condition of concrete producer, and not marked implementation condition is generally the condition in normal experiment.
Embodiment
As shown in Figure 1, image collecting device, image processing apparatus and chair regulating device should be comprised based on the driver's seat position automatic adjustment system of range image analysis.
Wherein image collecting device can be arranged on the top of meter panel of motor vehicle, with front face image when can photograph right ahead faced by steerman for benchmark, after vehicle launch, camera is adopted to obtain range image sequence and intensity image sequence, with the status information near Real-time Obtaining driver head and head.Described image collecting device at least comprises range image sensor, 2 infrared cameras, 1 CMOS camera, and range image sensor and 2 infrared cameras combine for obtaining range image sequence; CMOS camera, for obtaining intensity image sequence.
Image processing apparatus adopts DSP disposal system, and DSP disposal system carries out Treatment Analysis to the range image sequence collected and intensity image sequence.Wherein input/output unit can also be comprised, wherein output unit is read out instrument, information displaying and setting can be carried out, for showing the date of the adjusting seat position data of Pilot Name and correspondence, and by choosing Pilot Name and regulating the date to be directly optimized seat position.
Image processing apparatus comprises the modules such as image acquisition, range image sensor application, Face datection, face tracking, human eye detection, parameter database, data management, and the driver's seat position Automatic Optimal being used for carrying out analyzing based on range image adjusts.Wherein image capture module, for sending instruction to image collecting device, the range image sequence collected by range image sensor, infrared camera and CMOS camera gather intensity image sequence.Range image sensor application module, studies and the range image information got is combined with the intensity image information of same time, be accurately identified the method for driver eye positions; Face detection module, fusion distance image and intensity image information, detect position and the size (border) of people face part in intensity image; Face tracking module, follows the tracks of the facial image detected, to reduce loss and false drop rate; Human eye detection module, the facial image of location detects position of human eye; Supplemental characteristic library module, comprises chaufeur human parameters as the data such as height, body weight, and vehicle parameter is as data such as automobile model, the adjustable amplitude peak of seat position, headstock height; Data management module, for the seat position data message being applicable to this chaufeur of memory of driving person's face recognition result and correspondence; Seat adjusting module, for reading seat adjustment parameter, and generates seat adjustment instruction according to the parameter of seat adjustment and sends to chair regulating device.
Chair regulating device can adopt existing electric seat of car control system, after image processing apparatus sends the parameter after adjustment instruction and concrete adjustment to chair regulating device, chair regulating device automatically adjusts according to the destination locations state provided in current position state and parameter.Adjustment as low in seat height, in order to make occupant can find suitable driving sitting position or comfortable Ride Style, by electric device adjusting seat height.As seat temperature regulates, have the devices such as electro heat, refrigeration and ventilation when seat configurations after, seat temperature can be heated up or cooling by the demand of occupant, ventilation function then effectively can improve the air circulation of human body and seat contact portion, make contact surface dry and comfortable comfortable, not easily produce sweat.As leg support of seat regulates, by seat front end cushion length or angle, the good contact between thigh can be kept, provide the support of leg more multiple location, to meet the requirement of passenger to traveling comfort.As regulated before and after seat, by the front and back position of adjusting seat, to meet the requirement of passenger to vehicular drive.
As shown in Figure 3, the invention will be further described, and the driver's seat position self-align workflow analyzed based on range image is as follows:
1, after vehicle launch, the driver's seat position automatic adjustment system based on range image analysis is started working.
Camera is adopted to obtain range image sequence and intensity image sequence, with the status information near Real-time Obtaining driver head and head.Range image sensor and 2 infrared cameras combine for obtaining range image sequence; CMOS camera, for obtaining intensity image sequence.
2, the treating process of range image
Rang sensor and 2 infrared cameras are according to the range image sequence of environment near time-of-flight acquisition chaufeur face and face, on every width range image, the gray value of every bit represents the physical distance that camera waited until by chaufeur and seat, as shown in Figure 5, be the range image that a pair collects.
As shown in Figure 4, for range image, tentatively determine the position of chaufeur people face part through the following steps: the range image collected is coloured image, first gray processing process is carried out to it, then bianry image is converted to, and use prewitt operator to carry out edge extracting, more level and smooth for making ensuing exterior contour extract result, first carry out morphological dilations and erosion operation, then contours extract is carried out, finally carry out width projection, and according to width drop shadow curve, find out the maximum value of first time appearance from the summit (i.e. the top of the head) of profilograph and the location of pixels of minimal value difference correspondence, the position of facial image can be calculated.
If the pixel coordinate in the image upper left corner is (0, 0), as shown in Figure 5, (a) certain width range image for collecting, b in (), white portion is the contours extract result that this range image is corresponding, P point is summit and the top of the head of chaufeur human body contour outline curve, M1, M2 is corresponding to P point first width maximum point down, N1, N2 is corresponding to P point first width minimum point down, according to P, M1, M2, N1, the picture element position information at N2 place, the driver head position EFGH in human body contour outline curve can be extracted, when being reduced to former range image, in order to ensure the accuracy of location information, the present embodiment is taked the method for EFGH to the distance of external expansion 20 pixels, so just obtain the face location information of chaufeur in range image.
3, the treating process of intensity image
(1) Face datection segregator is trained
Through test of many times, obtaining a large amount of facial image, for making training sample variation, improving the accuracy of segregator, choose the facial image (intensity image) in multiple expression, multi-angle, many illumination variation situation, carry out pretreatment and be normalized to the positive sample of 24 × 24 sizes; Do not contain the image of face any part intercept different background, different light situation of change from video sequence under, carry out pretreatment and be normalized to 24 × 24 sizes as negative sample; Then extract the Harr feature of samples pictures, in order to greatly simplify calculating complexity, improve detection speed, the present embodiment adopts the harr feature of 6 kinds of forms such as conventional edge, linear, diagonal line, and utilizes " integrogram " to carry out fast computing features value; Finally based on Adaboost method training Face datection segregator.
(2) human eye detection segregator is trained
The step of training human eye detection segregator is identical with the step of training Face datection segregator, only training sample need be changed: gather the eye image (intensity image) of different chaufeur in different light, situation of whether wearing glasses and do not contain the image (intensity image) of human eye any part, carry out pretreatment and after being normalized to the human eye sample of 24 × 12 sizes, the method adopting conventional harr feature to combine with Adaboost trains human eye detection segregator.
(3) for the intensity image of up-to-date acquisition, following steps are adopted to process:
To the intensity image obtained by CMOS camera, first carry out the Image semantic classification such as gray processing, illumination compensation, then use the Face datection segregator trained to carry out Face datection, obtain position and the size (border) of the image of people face part.
4, the fusion of intensity image and range image information
Through above-mentioned steps, on the range image I1 collected at synchronization and intensity image I2, tentatively obtain position and the size (border) of human face region respectively, and represent by the pixel coordinate in the human face region upper left corner and the width of human face region and length, be designated as J (x1 respectively, y1), w1, h1 and Q (x2, y2), w2, h2.
Range image I1 is identical with intensity image I2 size, at synchronization, the relative position of human face region on two width images also roughly overlaps, when all detecting human face region on two width images, and the position of human face region corresponding with size time, accurate human face region information can be obtained, as Face datection result by following formula, be designated as F (x, y), w, h:
5., in order to reduce the undetected and flase drop situation of chaufeur face, intensity image is followed the tracks of the facial image detected.Wherein, track algorithm structure is following three steps: prediction, tracking and target update, the region first utilizing the kinematic parameter of target and may occur for moving target in the ad hoc rules prediction next frame of native system; Then for the change of moving target between consecutive frame, utilize eigenwert calculation cost functional value, obtain the succeeding target that in present frame, moving target is corresponding in the next frame, set up corresponding relation; Finally the object chain of tracked moving target, target position information and target signature amount are upgraded.
6. according to the detection and tracking result to facial image, carry out chaufeur face location location, obtain location of pixels and the size information of human face region, then utilize principal component analysis (PCA) (PrincipalComponentAnalysis, PCA) method carry out recognition of face and store recognition result.
7. on the facial image of location, use the human eye detection segregator trained to carry out eye image detection.
If 8. just in time can see that headstock position is as the criterion with chaufeur, after position of human eye being detected, in conjunction with the data in chaufeur human parameters data bank and vehicle parameter data bank, determine that driver's seat the distance of movement should carry out Automatic Optimal and the information such as date, chaufeur face recognition result, seat position stored.
9. when the same vehicle of different driver, first system carries out recognition of face to chaufeur, if recognition result is not present in memory system, just through above-mentioned same step, the information such as date, new chaufeur face recognition result, face recognition result, seat position that fresh driver is corresponding are stored.
10. when chaufeur in the past drives same vehicle again, equally first system carries out recognition of face to chaufeur, if find the face recognition result that can mate within the storage system, only need find out the numbering of the chaufeur corresponding with this face recognition result, then transfer corresponding seat position and regulate record to carry out the Automatic Optimal of seat position.
Above-mentioned example, only for technical conceive of the present invention and feature are described, its object is to person skilled in the art can be understood content of the present invention and implement according to this, can not limit the scope of the invention with this.All equivalent transformations of doing according to Spirit Essence of the present invention or modification, all should be encompassed within protection scope of the present invention.
Claims (7)
1.
a kind of driver's seat position automatic adjustment system based on range image, comprise image collecting device, image processing apparatus and chair regulating device, it is characterized in that described image collecting device, at least comprise 1 range image sensor, 1 CMOS camera and 2 infrared cameras, for intensity image and the range image of Real-time Collection chaufeur, and the intensity image of collection and range image are transferred to image processing apparatus; Described image processing apparatus is used for carrying out fusion treatment to the intensity image of chaufeur gathered and range image, obtain the position of human eye information of chaufeur, after position of human eye being detected, form the parameters of adjusting seat position in conjunction with the data in chaufeur human parameters data bank and vehicle parameter data bank, according to driver command, the parameters of chaufeur adjusting seat position is transferred to seat adjustment device; Described seat adjustment device is according to the instruction of chaufeur, and the configuration information according to the chaufeur adjusting seat position received is optimized adjustment to vehicle driver's seat;
described image processing apparatus comprises:
image capture module, for sending instruction to image collecting device, the range image sequence that acquisition range image sensor, infrared camera collect and CMOS camera gather intensity image sequence;
range image sensor application module, combines the range image information got with the intensity image information of same time, identifies driver eye positions region;
face detection module, according to fusion distance image and intensity image information, detects position and the size of people face part in intensity image;
face tracking module, follows the tracks of the facial image detected;
human eye detection module, the facial image of location detects position of human eye;
supplemental characteristic library module, comprises chaufeur human parameters and vehicle parameter;
data management module, for the seat position data message being applicable to this chaufeur of memory of driving person's face recognition result and correspondence.
2.
driver's seat position automatic adjustment system based on range image according to claim 1, is characterized in that range image sensor, CMOS camera are connected with the input end of image processing apparatus with the mouth of infrared camera.
3.
driver's seat position automatic adjustment system based on range image according to claim 1, it is characterized in that described image processing apparatus is DSP disposal system, the mouth of DSP disposal system is connected with the input end of seat adjustment device.
4.
driver's seat position automatic adjustment system based on range image according to claim 1, it is characterized in that described system also comprises data storage apparatus, described data storage apparatus is connected with image processing apparatus, receive the reading of image processing apparatus or store instruction, for reading or the intensity image of memory of driving person and the parameters of range image and adjusting seat position.
5.
driver's seat position automatic adjustment system based on range image according to claim 1, it is characterized in that described system also comprises the input/output unit be connected with image processing apparatus, user instruction is passed to image processing apparatus according to the input operation of user by described input/output unit, image processing apparatus carries out Treatment Analysis according to user instruction, and relevant information is exported prompting user.
6.
based on a driver's seat position automatic adjusting method for range image, it is characterized in that said method comprising the steps of:
(1) receive the automatic adjustment seat instruction of chaufeur, start the range image and the intensity image that gather chaufeur;
(2) fusion treatment is carried out to the intensity image of chaufeur gathered and range image, obtain the position of human eye information of chaufeur, and form the parameters of adjusting seat position according to the position of human eye information of chaufeur;
(3) according to the configuration information of the chaufeur adjusting seat position received, adjustment is optimized to vehicle driver's seat; Described method step (2) specifically comprises the following steps:
1) range image of the chaufeur collected is carried out edge extracting, determine the center of face; Face classification device is utilized to carry out Face datection the intensity image of the chaufeur collected; Face location and size is accurately determined according to the intensity image that analysis and the synchronization of range image obtain;
2) facial image detected is followed the tracks of, the facial image of location detects position of human eye, obtain position of human eye and distance in image;
3) obtain the vehicle parameter of chaufeur human parameters and driving according to user instruction, position of human eye and distance in combining image, form the seat position parameters being applicable to this chaufeur.
7.
driver's seat position according to claim 6 automatic adjusting method, after it is characterized in that the automatic adjustment seat instruction of reception chaufeur in described method step (1), described method also comprises the step carrying out judging whether the automatic adjustment seat instruction performing chaufeur according to following condition, and described condition is:
i) whether the kinematic velocity of current steering vehicle is zero;
ii) whether current steering vehicle have employed brake measure;
iii) whether the pilot harness of current steering vehicle is in the state fastened;
when three kinds of conditions that and if only if all meet, just perform the automatic adjustment seat instruction of chaufeur.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310731553.XA CN103707781B (en) | 2013-12-26 | 2013-12-26 | Based on the driver's seat position automatic adjustment system of range image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310731553.XA CN103707781B (en) | 2013-12-26 | 2013-12-26 | Based on the driver's seat position automatic adjustment system of range image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103707781A CN103707781A (en) | 2014-04-09 |
| CN103707781B true CN103707781B (en) | 2016-02-24 |
Family
ID=50401266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310731553.XA Active CN103707781B (en) | 2013-12-26 | 2013-12-26 | Based on the driver's seat position automatic adjustment system of range image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103707781B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3798048A4 (en) * | 2018-10-19 | 2021-08-04 | Shanghai Sensetime Intelligent Technology Co., Ltd. | Method and device for intelligent adjustment of vehicle seat, and vehicle, electronic device, and medium |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104290613A (en) * | 2014-10-31 | 2015-01-21 | 成都众易通科技有限公司 | Automatic adjusting system of driver seat |
| CN104503476B (en) * | 2014-11-27 | 2017-01-04 | 南京福图信息科技有限公司 | A kind of seat adjuster system based on 3D TV viewing ratio and method |
| CN105109365A (en) * | 2015-09-18 | 2015-12-02 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for regulating parameters of vehicle seat |
| CN105235615B (en) * | 2015-10-27 | 2018-01-23 | 浙江吉利控股集团有限公司 | A kind of vehicle control system based on recognition of face |
| WO2017164835A1 (en) | 2016-03-21 | 2017-09-28 | Ford Global Technologies, Llc | Virtual vehicle occupant rendering |
| US9707912B1 (en) * | 2016-03-22 | 2017-07-18 | Ford Global Technologies, Llc | Human scanning for interior preferences setup |
| US9908531B1 (en) * | 2016-09-08 | 2018-03-06 | GM Global Technology Operations LLC | Method and apparatus for detecting size of person prior to entering a space |
| CN106335408A (en) * | 2016-10-25 | 2017-01-18 | 辽宁工程技术大学 | Adaptive Adjusting System for Automobile Driver Seat |
| CN106778615B (en) * | 2016-12-16 | 2019-10-18 | 中新智擎科技有限公司 | A kind of method, apparatus and service for infrastructure robot identifying user identity |
| US10591586B2 (en) | 2017-07-07 | 2020-03-17 | Infineon Technologies Ag | System and method for identifying a target using radar sensors |
| DE102017214296B3 (en) | 2017-08-16 | 2018-07-26 | Audi Ag | A method of operating an occupant protection system of a vehicle and occupant protection system for a vehicle |
| CN108263250A (en) * | 2017-12-28 | 2018-07-10 | 江西爱驰亿维实业有限公司 | Vehicle-mounted memory seat method of adjustment, system and terminal based on recognition of face |
| CN108962348A (en) * | 2018-04-27 | 2018-12-07 | 阜南县藤之府家居工艺品有限公司 | A kind of massage armchair intelligence parameter setting system |
| CN109435883B (en) * | 2018-11-19 | 2024-07-19 | 李震成 | Automobile self-adaptive human body intelligent entering system and method |
| JP7192570B2 (en) * | 2019-02-27 | 2022-12-20 | 株式会社Ｊｖｃケンウッド | Recording/playback device, recording/playback method and program |
| CN110148092B (en) * | 2019-04-16 | 2022-12-13 | 无锡海鸿信息技术有限公司 | Method for analyzing sitting posture and emotional state of teenager based on machine vision |
| CN110316030B (en) * | 2019-05-24 | 2021-10-15 | 深圳市元征科技股份有限公司 | Adjusting method and adjusting device for vehicle seat |
| EP3796209A1 (en) * | 2019-09-17 | 2021-03-24 | Aptiv Technologies Limited | Method and system for determining an activity of an occupant of a vehicle |
| CN111267681B (en) * | 2020-03-25 | 2024-05-24 | 吉林大学 | Shared automobile intelligent seat adjusting method based on ergonomics |
| WO2021243693A1 (en) * | 2020-06-05 | 2021-12-09 | 华为技术有限公司 | Method and apparatus for collecting image of driver |
| CN111890871A (en) * | 2020-07-21 | 2020-11-06 | 宁波奥克斯电气股份有限公司 | Bluetooth headset for automobile control, automobile control system and control method |
| CN112036468A (en) * | 2020-08-27 | 2020-12-04 | 安徽江淮汽车集团股份有限公司 | Driving operation system adjusting method, vehicle and storage medium |
| CN112477707B (en) * | 2020-12-15 | 2022-05-10 | 四川长虹电器股份有限公司 | Automatic-adjustment automobile seat control system and method based on tof |
| CN112659990B (en) * | 2020-12-28 | 2022-07-05 | 浙江合众新能源汽车有限公司 | Driver seat adjusting system |
| CN114475371B (en) * | 2022-02-23 | 2023-02-28 | 东风汽车集团股份有限公司 | Intelligent adjusting system for front and rear seats of off-road vehicle and control method |
| CN115284976B (en) * | 2022-08-10 | 2023-09-12 | 东风柳州汽车有限公司 | Automatic adjustment method, device and equipment for vehicle seat and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1618654A (en) * | 2003-11-22 | 2005-05-25 | 格拉默股份公司 | Vehicle seat with automatic height adjustment and method therefore |
| CN101073996A (en) * | 2006-05-16 | 2007-11-21 | 格拉默股份公司 | Height adjusting device for vehicle seat and vehicle seat with the same device |
| CN202685999U (en) * | 2012-06-19 | 2013-01-23 | 浙江吉利汽车研究院有限公司杭州分公司 | Automatic adjustment system of driving seat |
| CN103029599A (en) * | 2011-10-06 | 2013-04-10 | 宝马股份公司 | Adjustment device for ergonomically setting a vehicle seat with several adjustable seat components |
| DE102012208644A1 (en) * | 2011-11-23 | 2013-05-23 | Johnson Controls Gmbh | Device and method for adjusting a seating position |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102004061139B4 (en) * | 2004-06-22 | 2014-03-06 | C. Rob. Hammerstein Gmbh & Co. Kg | Retractable vehicle seat, especially for 2-door vehicles |
-
2013
- 2013-12-26 CN CN201310731553.XA patent/CN103707781B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1618654A (en) * | 2003-11-22 | 2005-05-25 | 格拉默股份公司 | Vehicle seat with automatic height adjustment and method therefore |
| CN101073996A (en) * | 2006-05-16 | 2007-11-21 | 格拉默股份公司 | Height adjusting device for vehicle seat and vehicle seat with the same device |
| CN103029599A (en) * | 2011-10-06 | 2013-04-10 | 宝马股份公司 | Adjustment device for ergonomically setting a vehicle seat with several adjustable seat components |
| DE102012208644A1 (en) * | 2011-11-23 | 2013-05-23 | Johnson Controls Gmbh | Device and method for adjusting a seating position |
| CN202685999U (en) * | 2012-06-19 | 2013-01-23 | 浙江吉利汽车研究院有限公司杭州分公司 | Automatic adjustment system of driving seat |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3798048A4 (en) * | 2018-10-19 | 2021-08-04 | Shanghai Sensetime Intelligent Technology Co., Ltd. | Method and device for intelligent adjustment of vehicle seat, and vehicle, electronic device, and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103707781A (en) | 2014-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103707781B (en) | Based on the driver's seat position automatic adjustment system of range image | |
| CN103714321B (en) | Driver's Face detection system based on range image and intensity image | |
| CN107909061B (en) | Head posture tracking device and method based on incomplete features | |
| CN112026686B (en) | Method and device for automatically adjusting position of vehicle seat | |
| CN109188932A (en) | A kind of multi-cam assemblage on-orbit test method and system towards intelligent driving | |
| CN111161160B (en) | Foggy weather obstacle detection method and device, electronic equipment and storage medium | |
| CN106127137A (en) | A kind of target detection recognizer based on 3D trajectory analysis | |
| EP4058984A1 (en) | Geometry-aware instance segmentation in stereo image capture processes | |
| CN102855476A (en) | Self-adaptive binocular iris synchronous collection system of single image sensor | |
| US20180208201A1 (en) | System and method for a full lane change aid system with augmented reality technology | |
| CN106934380A (en) | A kind of indoor pedestrian detection and tracking based on HOG and MeanShift algorithms | |
| CN110378210A (en) | A kind of vehicle and car plate detection based on lightweight YOLOv3 and long short focus merge distance measuring method | |
| CN109934108A (en) | The vehicle detection and range-measurement system and implementation method of a kind of multiple target multiple types | |
| CN106291520A (en) | A kind of DAS (Driver Assistant System) based on coded laser light and binocular vision and method | |
| CN116758117B (en) | Target tracking method and system under visible light and infrared images | |
| CN104574993A (en) | Road monitoring method and device | |
| Huang et al. | Measuring the absolute distance of a front vehicle from an in-car camera based on monocular vision and instance segmentation | |
| CN115134537B (en) | Image processing method and device and vehicle | |
| CN202196428U (en) | Single image sensor self-adaptive binocular iris synchronous acquisition system | |
| CN113609942B (en) | Road intelligent monitoring system based on multi-view and multi-spectral fusion | |
| CN116543266A (en) | Automatic driving intelligent model training method and device guided by gazing behavior knowledge | |
| CN114332187A (en) | Monocular target ranging method and device | |
| CN109960034B (en) | System and method for adjusting brightness of head-up display | |
| Farag et al. | Finding and Tracking Automobiles on Roads for Self-Driving Car Systems | |
| Xu et al. | Speed bump recognition for autonomous vehicles based on semantic segmentation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20240705 Granted publication date: 20160224 |
|
| PP01 | Preservation of patent right |