CN201837782U - Visual auxiliary device for virtual image projection imaging of car window - Google Patents

Visual auxiliary device for virtual image projection imaging of car window Download PDF

Info

Publication number
CN201837782U
CN201837782U CN2010205081337U CN201020508133U CN201837782U CN 201837782 U CN201837782 U CN 201837782U CN 2010205081337 U CN2010205081337 U CN 2010205081337U CN 201020508133 U CN201020508133 U CN 201020508133U CN 201837782 U CN201837782 U CN 201837782U
Authority
CN
China
Prior art keywords
coordinate
virtual image
driver
vehicle window
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010205081337U
Other languages
Chinese (zh)
Inventor
郭凯
丁欧南
刘振英
罗斌
董前琨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nankai University
Original Assignee
Nankai University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nankai University filed Critical Nankai University
Priority to CN2010205081337U priority Critical patent/CN201837782U/en
Application granted granted Critical
Publication of CN201837782U publication Critical patent/CN201837782U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)
  • Traffic Control Systems (AREA)

Abstract

The utility model relates to a device for improving sight of a driver. In order to provide the device which can improve the sight of the driver under poorer visual condition, the technical scheme adopted by the utility model is as follows: a visual auxiliary device for virtual image projection imaging of a car window comprises an infrared image acquisition device, image processing equipment, a processing unit and LED (light-emitting diode) projection equipment, wherein the image processing equipment is used for acquiring a pixel file from a video file acquired by the infrared image acquisition device; the processing unit is used for recognizing the boundary of the pixel file by a target extraction algorithm, projecting the coordinate of the boundary into a coordinate system taking human eyes and car window glass as substrates, and finally outputting the coordinate to a control interface of the LED projection equipment; and the LED projection equipment is used for leading a diode at the position corresponding to the LED projection equipment to emit light and generating a virtual image at the position corresponding to the car window, and a plurality of virtual image points form the profile of an object so as to enclose the real image of the target object seen directly by the driver and realize the auxiliary improvement of the sight. The device is mainly applied in improving and developing the sight of the driver.

Description

The visual aid of vehicle window virtual image projection imaging
Technical field
The utility model relates to raising, improves the device of pilot's line of vision, specifically relates to the visual aid of vehicle window virtual image projection imaging.
Background technology
Along with improving constantly of living standards of the people, automobile is universal day by day, and the driver becomes the problem that the public is concerned about in the condition down train safety of low visibility such as night, greasy weather, rainy day, sandstorm.The frost that the water vapor that the water smoke that rainy day causes, people breathe out is formed all can seriously be disturbed driver's sight line.To this, prior art rarely has the way of solution.
Summary of the invention
For overcoming the deficiencies in the prior art, providing a kind of can improve, improve the device of pilot's line of vision under the relatively poor situation of visual condition, and the technical scheme that the utility model is taked is that the visual aid of vehicle window virtual image projection imaging comprises:
The infrared image acquisition device;
Image processing equipment is used for video file that the infrared image acquisition device is collected, adopts the library of increasing income to carry out analyzing and processing, obtains the pixel file;
Processing unit, be used for using the target extraction algorithm to identify the border pixel file, again with the coordinate projection on border to being in the coordinate system of substrate with human eye and glass for vehicle window, will project to human eye and glass for vehicle window at last is the control interface that coordinate information in the coordinate system of substrate outputs to the LED device for projecting;
The LED device for projecting, being used for according to projecting to human eye and glass for vehicle window is the coordinate information of the coordinate system of substrate, the led lighting of LED device for projecting relevant position also produces a virtual image at the vehicle window correspondence position, some virtual image points are formed the profile of object, the target object real image that the driver is directly seen surrounds, and realizes the auxiliary sight line that improves.
Described processing unit is used for using the target extraction algorithm to identify the border pixel file, is a rational threshold value by measuring, and makes that the target object in the binary image is clear; Described coordinate projection with the border is to establish to being in the coordinate system of substrate with human eye and glass for vehicle window: the long Width of screen, and wide Height,
The long resW of the output of video frequency collection card, wide resH,
The relative near infrared ray photographic apparatus coordinate offset component under driver's eye coordinates system:
Figure BDA0000025185620000011
Then transformation matrix is: the row main sequence:
Width resW 0 0 - V x 0 Height resH 0 - V y 0 0 1 - V z 0 0 0 1
Wherein, V x, V y, V zBe the pairing x of offset component, y, z axle component all is a scalar.
Described processing unit also is used for by measurement target object minimum area on infrared image pickup device, judges whether this pixel region is noise or useless interfere information.
Its characteristics of the utility model are:
1,, the observed naturally image of projects images and human eye is overlapped as far as possible as a kind of driver's vision-aided system.Both play the effect of accessorial visual, and can not influence driver's normal observation again.
With glass for vehicle window as showing carrier, the driver needn't check the display device on next door, can reduce unnecessary accident to a great extent and take place.Image on the display device and real scene are unified, have avoided the eyes focal length constantly to adjust and the delay and discomfort of generation.
3. need not to change the structure of vehicle window, thereby also need not to change the automobile production streamline, reduce the renewal cost of streamline.This project can also be assembled existing vehicle as annex simultaneously, need not to reequip on a large scale, and reusability is good.
4. the work of this project not only can improve driver's handling safety, improves visual condition.And on other non-demonstration purposes materials, potential application is arranged.
Description of drawings
The normal comparison diagram of observing with auxiliary mode of observing of Fig. 1.
Fig. 2 the utility model principle and design sketch.
Fig. 3 the utility model intermodule structural drawing.
Embodiment
The utility model principle is set forth: under the relatively poor situation of visual condition, the driver is seeing when front window is driven can only see a fuzzy image, simultaneously, vision-aided system can be handled the place ahead barrier situation the back and shows intuitively in that car windscreen is on glass in the mode of projection.The driver both can discern barriers such as the interior people of the place ahead certain distance, animal in time, can avoid again watching display screen to cause danger because of bowing.Needn't change the driving visual angle and just can observe, reach the purpose of safety traffic.The work of this project not only can improve driver's handling safety, improves visual condition.And on other non-demonstration purposes materials, potential application is arranged.
Further describe the utility model below in conjunction with drawings and Examples.
(1) gathers infrared image
With the traffic information under the collaborative device collection severe weather conditions of infrared thermography, infrared camera, radio radar or end user's bulk wave section infrared filter and photoresistance.
Collecting device is connected to image processing equipment, obtains the video input.Use video format (mpeg, avi etc.) here, and use library (OpenCV etc.) the analysis video file of increasing income, obtain the pixel file based on international standard.
(2) processing unit
A. general introduction:
Front end in the project implementation uses the traffic information under the near infrared ray photographic apparatus collection severe weather conditions, then imports video information into processing unit, and processing unit uses the target extraction algorithm to identify the border.Again with the coordinate projection on border to being in the coordinate system of substrate with human eye and glass for vehicle window.These coordinate informations are outputed to based on the LED virtual image device for projecting at last.
The utility model uses dsp chip to carry out data acquisition, uses mpeg format, uses OpenCV to carry out Flame Image Process.
B. detailed technology details:
1. the video stream data that the near infrared ray photographic apparatus is photographed carries out the target extraction.By experiment, measure a rational threshold value, make that the target object in the binary image is clear.
2. from the screen coordinate substrate of near infrared ray photographic apparatus conversion to the substrate of driver's eye coordinates
This project is used simplified model, promptly supposes following rule:
A. the near infrared ray photographic apparatus is installed in the driver top, and is parallel with pilot's line of vision
B. be as world's world coordinates initial point with driver's eye coordinates
C. glass for vehicle window is a planar rectangular
By supposition A, can think and to be rotated video pictures.So coordinate transform only relates to convergent-divergent (being used to be transformed into the substrate of vehicle window coordinate) and translation (being used for being transformed into the substrate of driver's eye coordinates from the substrate of near infrared ray photographic apparatus screen coordinate)
If: the long Width of screen, wide Height
The long resW of the output of video frequency collection card, wide resH
The relative near infrared ray photographic apparatus coordinate offset component under driver's eye coordinates system:
Figure BDA0000025185620000031
Then transformation matrix is: (row main sequence)
Figure BDA0000025185620000032
Wherein, V x, V y, V zBe the pairing x of offset component, y, z axle component all is a scalar.
In a word, the utility model carries out binary conversion treatment to the image that collects, and the application boundary recognizer extracts the target object border. object boundary is sampled, obtain the coordinate points of series of discrete. and use transformation matrix premultiplication coordinate points, just can obtain the subpoint of object on vehicle window.
3. in the related practical context of this project, the object on the road surface, the place ahead only can concentrate on the vehicle window central region.
Therefore, comprehensive above 2 points in the actual experiment process, by measurement target object means such as minimum area on infrared image pickup device, judge whether this pixel region is noise or useless interfere information.
(3) projection shows
With the coordinate information of processing unit output,, be input to the control interface of device for projecting such as LED by handling.
According to the profile coordinate control information that obtains, in light path design, guarantee that allocation is corresponding one by one really on pixel and the glass for vehicle window.When transmission of coordinate is input on the device for projecting through interface, the led lighting of relevant position also produces a virtual image at the vehicle window correspondence position.Some virtual image points are formed the profile of object, and the target object real image that the driver is directly seen surrounds, thereby is issued to auxiliary purpose in the situation that does not influence normal observation.

Claims (1)

1. the visual aid of a vehicle window virtual image projection imaging is characterized in that, comprising:
The infrared image acquisition device;
Image processing equipment is used for video file that the infrared image acquisition device is collected, adopts the library of increasing income to carry out analyzing and processing, obtains the pixel file;
Processing unit, be used for using the target extraction algorithm to identify the border pixel file, again with the coordinate projection on border to being in the coordinate system of substrate with human eye and glass for vehicle window, will project to human eye and glass for vehicle window at last is the control interface that coordinate information in the coordinate system of substrate outputs to the LED device for projecting;
The LED device for projecting, being used for according to projecting to human eye and glass for vehicle window is the coordinate information of the coordinate system of substrate, the led lighting of LED device for projecting relevant position also produces a virtual image at the vehicle window correspondence position, some virtual image points are formed the profile of object, the target object real image that the driver is directly seen surrounds, and realizes the auxiliary sight line that improves.
CN2010205081337U 2010-08-27 2010-08-27 Visual auxiliary device for virtual image projection imaging of car window Expired - Fee Related CN201837782U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010205081337U CN201837782U (en) 2010-08-27 2010-08-27 Visual auxiliary device for virtual image projection imaging of car window

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010205081337U CN201837782U (en) 2010-08-27 2010-08-27 Visual auxiliary device for virtual image projection imaging of car window

Publications (1)

Publication Number Publication Date
CN201837782U true CN201837782U (en) 2011-05-18

Family

ID=44007889

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010205081337U Expired - Fee Related CN201837782U (en) 2010-08-27 2010-08-27 Visual auxiliary device for virtual image projection imaging of car window

Country Status (1)

Country Link
CN (1) CN201837782U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9317106B2 (en) 2012-12-11 2016-04-19 Automotive Research & Test Center Automatic correction device of vehicle display system and method thereof
CN107054219A (en) * 2015-11-24 2017-08-18 奥特润株式会社 The coordinate matching devices and methods therefor of head-up display
CN109070800A (en) * 2016-04-18 2018-12-21 索尼公司 Image display and method for vehicle
CN111443490A (en) * 2020-04-15 2020-07-24 诸暨市华鲟电子科技有限公司 Virtual image display area adjusting method of AR HUD

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9317106B2 (en) 2012-12-11 2016-04-19 Automotive Research & Test Center Automatic correction device of vehicle display system and method thereof
CN107054219A (en) * 2015-11-24 2017-08-18 奥特润株式会社 The coordinate matching devices and methods therefor of head-up display
US10539790B2 (en) 2015-11-24 2020-01-21 Hyundai Autron Co., Ltd. Coordinate matching apparatus for head-up display
CN109070800A (en) * 2016-04-18 2018-12-21 索尼公司 Image display and method for vehicle
CN111443490A (en) * 2020-04-15 2020-07-24 诸暨市华鲟电子科技有限公司 Virtual image display area adjusting method of AR HUD

Similar Documents

Publication Publication Date Title
CN104601953A (en) Video image fusion-processing system
CN201837782U (en) Visual auxiliary device for virtual image projection imaging of car window
CN104442924A (en) All-weather high speed railway vehicle-mounted obstacle detection system and method
CN201402413Y (en) Vehicle control assistant device
CN104076514A (en) Car information displaying method and device
CN103802727A (en) Low-visibility guiding system
CN204836349U (en) Seamless non - concatenation formula panorama realtime graphic imaging device
CN103946066A (en) Vehicle surroundings monitoring apparatus and vehicle surroundings monitoring method
CN105374221A (en) Reminder system and reminder method of states of traffic lights
CN111137236A (en) Non-transparent liquid crystal display method and system based on automobile front windshield
CN109963144A (en) A kind of vehicle-mounted identifying system based on AR-HUD
CN103909875A (en) System for visualization of field outside vehicle shielding objects
CN109541804A (en) Adjust method, HUD projection arrangement and the vehicle of the projected position of HUD projection arrangement
CN103149603B (en) Road weather detection method based on video
CN113609942B (en) Road intelligent monitoring system based on multi-view and multi-spectral fusion
CN105216715A (en) A kind of motorist vision assists enhancing system
CN102779412B (en) Integrated video traffic information detection method and system
CN202541437U (en) Vehicle-mounted infrared night view driving device
CN110332929A (en) Vehicle-mounted pedestrian positioning system and method
CN101941398A (en) Visual compensating mirror for automobile
CN106248635A (en) Visibility detecting method based on digital camera
CN113343849A (en) Fusion sensing equipment based on radar and video
CN111273134A (en) Ultraviolet and short wave infrared band fused corona monitoring device
CN102722724B (en) Vehicle-mounted night view system having target identification function and target identification method thereof
CN205749947U (en) The infrared active safety of railway locomotive visits instrument

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110518

Termination date: 20130827