CN101995239A - System and method for determining obstacle by using aerial view images - Google Patents
System and method for determining obstacle by using aerial view images Download PDFInfo
- Publication number
- CN101995239A CN101995239A CN2009101617455A CN200910161745A CN101995239A CN 101995239 A CN101995239 A CN 101995239A CN 2009101617455 A CN2009101617455 A CN 2009101617455A CN 200910161745 A CN200910161745 A CN 200910161745A CN 101995239 A CN101995239 A CN 101995239A
- Authority
- CN
- China
- Prior art keywords
- image
- bird
- eye view
- vehicle
- barrier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention provides a system and a method for determining an obstacle by using aerial view images, relates to technology for determining the obstacle around a vehicle by aerial view image technology. A plurality of image acquisition devices which are arranged at different positions are used for acquiring a plurality of images around a vehicle body respectively, and the plurality of images are at least provided with an overlapping region; an image processor performs independent aerial view image conversion on the images; and an obstacle calculating unit compares the correlation of repeat regions of two independent aerial view images and judges whether the obstacle exists or not according to the size of the correlation. In addition, a mapping table of a group of space conversion data is constructed and comprises driving state data such as the steering wheel angle, gear or speed of the vehicle, and the like, so when the driving state is changed, a panoramic aerial view image at an appropriate viewing angle is quickly converted through the mapping table, and the position of the obstacle measured by the obstacle calculating unit is marked on the panoramic aerial view image; therefore, the safe driving of a user is facilitated.
Description
Technical field
The relevant obstacle detection system of the present invention, especially a kind of employed obstacle detection system when being applied to steering vehicle.
Background technology
The cost of video camera day by day descends, and photographic goods now have been widely used in vehicle driving and have assisted, and the right only simple mostly passive image that vehicle periphery is provided is avoided the generation of accident with the driver assistance person.Because the driver is difficult to monitor simultaneously a plurality of photographic pictures, and the visual dead angle that the conventional planar image is applied to stop when auxiliary is still big, therefore also having at present the dealer to develop can be through being placed in vehicle body a plurality of video cameras on every side, its obtained a plurality of images are integrated and change its visual angle and become a virtual ring field of overlooking by roof and get a bird's eye view image system, the technological means that this comparatively meets the human eye vision custom and also can further overcome visual dead angle.
But, generally system is got a bird's eye view when the conversion plane image is got a bird's eye view image for the ring field in the ring field, because of compound many images of need while, therefore if when image overlap area occurs having the object of height, then can can't show that this barrier that height is arranged is on a ring image because of the dead angle of image stitching, so a known ring image technology still has it must improve part.
In view of this, for the barrier and the assistant that can detect the image suture remind the driver assistance person that there is barrier at this place with picture caution or sound caution, then conventional art uses radar or ultrasonic unit to detect barrier to combine with photographic image more more, gets a bird's eye view the disappearance of image technology to supply known ring field.Such as applying for a patent of patent publication No. JP2007041791 (A) announcement, the system and method for image is got a bird's eye view in a kind of demonstration, it is earlier with the image around a plurality of video camera collection vehicle, its image is stitched into a ring field gets a bird's eye view image, whether there is barrier near learning the vehicle front, rear, left and right with image, and be to overcome at the image suture to be difficult to show the problem with height barrier, this patent then detects this dead angle area with four ultrasonic units and solves.Though but this kind mode can overcome the problems referred to above, can increase the cost of ultrasonic unit relatively.
Moreover, two dimension gets a bird's eye view that ring image system is many to be set in the vehicle top with virtual view in the known techniques, yet, advance, retreat at vehicle or turn when mobile, the imagery zone visual field size of the required moving direction of driver is also from different, but known techniques is only used the picture of getting a bird's eye view at a fixing virtual visual angle, is difficult to meet driver's demand.
Therefore, the present invention proposes a kind of utilization and gets a bird's eye view image disturbance in judgement thing system and method, can effectively solve the shortcoming of prior art.
Summary of the invention
Fundamental purpose of the present invention is got a bird's eye view the system and method for image disturbance in judgement thing for proposing a kind of utilization, and its collection has two of repeat region and gets a bird's eye view image, and relatively the correlativity of its repeat region image the position occurs with the barrier of judging the tool height.
Another object of the present invention is got a bird's eye view the system and method for image disturbance in judgement thing for proposing a kind of utilization, to get a bird's eye view the direct disturbance in judgement object location of image, need not increase other detection of obstacles instruments of radar or ultrasound wave, can reduce production/assembly cost.
A further object of the present invention is got a bird's eye view the system and method for image disturbance in judgement thing for proposing a kind of utilization, is used for reaching quick conversion with saving system operation time by making of mapping table when signal of video signal import.
Another purpose of the present invention is got a bird's eye view the system and method for image disturbance in judgement thing for proposing a kind of utilization, it is by the arrange in pairs or groups mapping table of one group of corresponding steering wheel angle and virtual camera depression angle of traveling state of vehicle, get a bird's eye view image and export different ring fields, get a bird's eye view image to the driver with what different visual angles were provided.
A further object of the present invention is got a bird's eye view the system and method for image disturbance in judgement thing for proposing a kind of utilization, its ring field in conjunction with convertible visual angle gets a bird's eye view image and image disturbance in judgement thing technology is got a bird's eye view in utilization, and then can have more flexible detection of obstacles zone and get a bird's eye view the visual field to driver's reference turning or provide during reversing.
Disclose the system that image disturbance in judgement thing is got a bird's eye view in a kind of utilization for reaching above-mentioned purpose the present invention, comprise:
A plurality of image collection devices, it is located on the vehicle, and these image collection devices are obtained the image of a plurality of these vehicle peripheries;
One image processor converts these images to a plurality of images of independently getting a bird's eye view respectively, and wherein two adjacent these are independently got a bird's eye view image and comprised a repeat region; And
One barrier computing unit, relatively two adjacent these are independently got a bird's eye view the correlativity of this repeat region of image, have judged whether barrier by this correlativity.
Gather image by a plurality of image collection devices that are set up on the vehicle, and to see through image processor be a plurality of images of independently getting a bird's eye view with these video conversion, calculate the two adjacent repeat regions of independently getting a bird's eye view image to obtain the related coefficient of repeat region by barrier computing unit comparison again, judged whether this zone has barrier to occur; Image processor is that image is got a bird's eye view in a vehicle ring field in conjunction with these a plurality of images of getting a bird's eye view simultaneously, when the photography zone detects barrier, obstruction marking is got a bird's eye view on the image in this ring field, uses and reminds the driver.
In addition, the present invention also discloses the method that image disturbance in judgement thing is got a bird's eye view in a kind of utilization, comprise the vehicle body signal of gathering a vehicle, and select pairing mapping table, and gather near this vehicle a plurality of images, set up a ring field according to this mapping table and get a bird's eye view image, wherein two these adjacent images comprise a repeat region;
With these video conversion respectively a plurality of images of independently getting a bird's eye view;
Judge that adjacent this independently get a bird's eye view the correlativity of this repeat region of image;
Judge whether this repeat region has barrier; And
If this barrier is arranged, this obstruction marking is got a bird's eye view in the image in this ring field.
It gathers earlier a plurality of images around vehicle body signal and the vehicle body, and wherein adjacent image comprises a repeat region, and picks out the mapping table of relevant space conversion information according to the steering wheel angle signal, encircles the field and gets a bird's eye view video conversion; Again these images are converted to respectively and independently get a bird's eye view image; Continue, judge that adjacent this independently get a bird's eye view the correlativity of the repeat region of image; Judge according to this correlativity size whether this repeat region has barrier to exist; At last, if repeat region was then got a bird's eye view this obstruction marking in the image in Huan Chang when having barrier, get a bird's eye view the image visual angle to change the detection of obstacles scope in the adjustment of foundation steering wheel angle signal simultaneously.
Beneficial effect of the present invention is, improve the shortcoming that barrier takes place can't show because of the image dead angle at the image suture known techniques, utilize the characteristic of when there is the image overlap place in barrier, encircling the distortion that to be distorted after video conversion is got a bird's eye view in the field, further be converted into the means of disturbance in judgement object location, two raw videos that will have overlap, be converted to individually and get a bird's eye view striograph, in two correlativitys of getting a bird's eye view its repeat region of image of comparison, the little person of correlativity then has barrier, and the subregion of analyzing thin portion is accurately concluded this barrier position.
Thus, the present invention saves other checkout equipments such as ultrasound wave or radar are installed, and utilizes image technology can record the barrier minimum distance purely.In addition, drive a vehicle and turn or sensing range when retreating in order to strengthen the driver, in the video conversion technology, the present invention encircles the field with a plurality of mapping tables and gets a bird's eye view video conversion, wherein each mapping table comprises the space conversion information under each driving states, so getting a bird's eye view the virtual visual angle of image, ring of the present invention field can change according to the driving situation, and native system shows that the detection of obstacles scope also changes because of the change at virtual visual angle, be more humane driving servicing unit, therefore the driver is when using technological means of the present invention, can obtain to keep straight on, turn, image is got a bird's eye view in the ring field that different visual angles under the situation such as retreats, thereby can more safely drive and set out on a journey.
Beneath by the appended graphic explanation in detail of specific embodiment cooperation, when the effect that is easier to understand purpose of the present invention, technology contents, characteristics and is reached.
Description of drawings
Fig. 1 is the system schematic of one embodiment of the invention;
Fig. 2 (a) is the synoptic diagram of image camera coverage of the present invention to Fig. 2 (e);
Fig. 3 is the synoptic diagram of the related coefficient of calculating repeat region;
Fig. 4 is got a bird's eye view the synoptic diagram of image for the present invention judges the ring field of clear;
Fig. 5 is got a bird's eye view the synoptic diagram of image for the present invention judges the ring field that barrier is arranged;
Fig. 6 is got a bird's eye view the image synoptic diagram for the ring field at the convertible virtual visual angle of the present invention;
Fig. 7 is the flow chart of steps of one embodiment of the invention.
Description of reference numerals: 10-image collection device; 12-vehicle body signal picker; The 14-image processor; The 141-mapping table; The 16-display; 18-barrier computing unit; The 20-alarming device; 211～216-repeat region; Image is got a bird's eye view in 22-ring field; The 24-vehicle body; 28-related coefficient γ is less than 0.5 zone; The 30-lane line; 32-is got a bird's eye view the image suture line; 34, the 36-raw video; 38,40-is independently got a bird's eye view image; 381, the 401-repeat region; 42, the 44-vehicle; 46-cylinder type barrier; 48, the 50-raw video; 52,54-is independently got a bird's eye view image; 521, the 541-repeat region; The 60-vehicle body; Image capturing range is got a bird's eye view in 62-ring field; The virtual visual angle of 64-; The 66-barrier.
Embodiment
The video conversion that major technology means of the present invention are gathered different video camera is two independently to get a bird's eye view image, again this two repeat region of independently getting a bird's eye view image is done the correlativity comparison, comparison result is if the high person of its correlativity judges that then there is not the barrier of tool height in this zone; Otherwise, if the low person of correlativity then judges the barrier that has the tool height.Accurately judge whether to have barrier and its position and distance with the method.
At first please refer to Fig. 1, system architecture diagram for one embodiment of the invention, in the present embodiment, gather vehicle body image on every side with six image collection devices of being located on the car 10, all there is partly overlapping the same area image in the image that wherein every adjacent image collection device 10 is gathered, unitedly call under this area image to be repeat region, and image collection device 10 is charge coupled cell (CCD) video camera or complementary metal oxide semiconductor (CMOS) video camera.Present embodiment also is combined with vehicle body signal picker 12 to obtain the driving situation, and the vehicle body signal comprises steering wheel angle angle, vehicle speed signal or gear signal, again the data that is provided by image processor 14 reception raw videos and vehicle body signal.Mainly judge the turn inside diameter situation in the present embodiment with the steering wheel angle signal, therefore according to the steering wheel angle signal of vehicle body, image processor 14 selects correct suitable mapping table 141 to carry out the image space conversion, wherein mapping table 141 establishes the space conversion information of relevant camera position and steering wheel angle angle earlier before present embodiment is carried out, mapping table 141 is also noted down simultaneously skew control, have an X-rayed information such as conversion and image stitching, is to get a bird's eye view image with raw video through the ring field that mapping table can be converted into multiple visual angle fast.And image processor 14 is inserted in raw video in the mapping table 141 and export the ring field general view at suitable virtual visual angle, it is output in a display 16 again, and this display 16 shows the driving boost line or the parking boost line of this vehicle periphery.
Detect in order to carry out the vehicle body peripheral obstacle, image processor 14 of the present invention is except changing a holistic ring general view, six raw videos must be converted to individually independently to get a bird's eye view image and then obtain six and independently get a bird's eye view behind the image and compare its repeat region and judge that again two independently get a bird's eye view the correction of image of the repeat region of image, with this as the means that detect barrier.If wherein the correlativity height represents that there is not the barrier of tool height in repeat region; Otherwise,, represent that then there is the barrier of tool height in repeat region if correlativity is low.And present embodiment shows that with measured barrier its position gets a bird's eye view on the image in Huan Chang, further can install alarming device 20 additional, and it can be light-emittingdiode, hummer or loudspeaker, reminds driver's attention deficit disorder thing to send alarm signal.
Continue, further describe the present invention and how independently to get a bird's eye view the repeat region of image to judge the technological means of barrier by comparison two.Known techniques obtains at least four raw videos of vehicle's surroundings earlier, can get a ring field of overlooking after synthesizing via image processing again and get a bird's eye view image, but in the image calculation processes, need ground is considered as a flat surfaces, also promptly the object of tool height can only be considered as planar object and carry out image processing.So the object of the tool height phenomenon that will be distorted when getting a bird's eye view video conversion causes obtaining effectively ring and gets a bird's eye view image, this is the shortcoming of known techniques.The present invention then uses gets a bird's eye view the unique point that image is distorted, and implements the technology that the present invention detects barrier.
The present invention gathers the vehicle body image in six zones on every side by six image collection devices 10, is converted to a ring field through image processor 14 again and gets a bird's eye view image 22, and wherein this image collection device 10 is a video camera.Please refer to Fig. 2 (a), the present invention gathers forward and backward a-quadrant of vehicle body and B zone respectively by first video camera and second video camera that are placed on the vehicle 24; The 3rd video camera and four cameras are gathered vehicle body 24 left and right C zone and D zone respectively, shown in Fig. 2 (b); And the 5th video camera and the 6th video camera gather vehicle body 24 left and right E zone and F zone respectively, shown in Fig. 2 (c).The image of wherein above-mentioned per two adjacent areas all has a repeat region, promptly shown in the hatched example areas among Fig. 2 (d) 211,212,213,214,215,216, this also is the zone of detection of obstacles, ring field image capturing range after those repeat regions are sewed up through image processing then is vehicle body 24 near zones 22, promptly shown in Fig. 2 (e).
Continue, image processor 14 is converted to the raw video in above-mentioned A, B, C, D, E, six zones of F separately and compares two adjacent repeat regions of getting a bird's eye view image respectively by barrier computing unit 18 again after independently getting a bird's eye view image, and judges its correlativity.Again with the a-quadrant among Fig. 2 (a) independently get a bird's eye view image with Fig. 2 (c) in the image of independently getting a bird's eye view in E zone be example, this a-quadrant and E zone can comprise the identical repeat region 212 shown in Fig. 2 (e).Please continue with reference to figure 3, f (s among the figure, t) represent the repeat region GTG value of a-quadrant, w (s, t) represent the repeat region GTG value in E zone, image processor 14 is cut into nine sub regions with repeat region, calculate the related coefficient γ of the relative subregion GTG value in two zones, and the computing formula of related coefficient is
Wherein
With
Average GTG value for a-quadrant and E zone repeat region image.The meaning of this formula is got a bird's eye view image with each single-point difference in zone and the difference value of accumulating every single-point for calculating two, and then obtains two related coefficient γ of getting a bird's eye view image.If two images of getting a bird's eye view repeat region between image are identical, then related coefficient is 1; If the image in two repetition zones is uncorrelated fully, its related coefficient then is 0.With the threshold value setting of disturbance in judgement thing related coefficient is 0.5 to be example, if on behalf of this subregion, related coefficient less than this threshold values, have barrier.As the zone among Fig. 3 28, because of related coefficient γ less than 0.5, be that this zone 28 of decidable has barrier to exist with this.Be with, getting a bird's eye view image during for flat surfaces when repeat region can distortion distortion, and the related coefficient γ of gained represents then that greater than threshold values 0.5 repeat region does not have barrier to exist.
Please continue and consult Fig. 4, judge the synoptic diagram of clear in order to explanation the present invention.As shown in the figure, vehicle periphery does not have barrier to exist among the figure, and vehicle 42 sides are two to have four and get a bird's eye view image suture line 32 in the lane line 30 on ground and figure.When beginning to judge when clear is arranged, be positioned at video camera elder generation collection vehicle 42 the place ahead raw videos 36 of vehicle front side, and the video camera collection vehicle 42 right side raw videos 34 on right side, be not converted to through 14 of image processors again and independently get a bird's eye view image 38,40, the repeat region of getting a bird's eye view image 381 in Fig. 4 after visible the place ahead and the right side conversion, 401, and judge the correlativity size of the repeat region get a bird's eye view image herein via the barrier computing unit, because this routine repeat region 381,401 is smooth road surface, therefore judged result is that correlativity is big, and then representing herein, clear exists.
Fig. 5 then judges the synoptic diagram that barrier is arranged for the present invention, be example with vehicle 44 the place ahead images and side image equally, when a cylinder type barrier 46 appears in vehicle 44 right fronts, the raw video 48,50 that image collection device 10 is gathered be converted to two independently get a bird's eye view image 52,54 after, because this cylinder type barrier 46 has height, therefore carrying out video conversion for after getting a bird's eye view image, cylinder type barrier 46 bodies meeting distortion distortion, cause the correlativity of two repeat regions 521,541 of getting a bird's eye view image 52 and 54 low, can distinguish that to this this zone has barrier and exists.
So via above-mentioned image processing process, the present invention can be set in repeat region driver's visual dead angle place, see through the present invention and judge whether the result of repeat region promptly exists barrier as can be known.
In addition, the present invention also can utilize the related coefficient of repeat region to change to come the disturbance in judgement object location.With the above embodiment of the present invention is example, calculates earlier the related coefficient of nine sub regions in two repeat regions of getting a bird's eye view image respectively, if if there is a barrier to be arranged in the parton zone of this repeat region, its related coefficient can present little value; Otherwise other that barrier does not fall in this repeat region are subregion partly, and its related coefficient then presents big value.In other words, the subregion of the clear in this repeat region and the subregion intersection that barrier is arranged, its related coefficient die-offs because barrier occurs, and then utilizes the present invention of this characteristic can calculate this barrier of acquisition from the nearest distance of vehicle body.More than for principal character technology of the present invention, at the dead angle of video camera and the shortcoming of picture distortion after getting a bird's eye view video conversion, the present invention compares the correlativity after image is got a bird's eye view in conversion, with acquired disturbance object location accurately.Compared to known techniques, the present invention more can strengthen the effect of getting a bird's eye view the relevant detection of obstacles of image technology.In addition, to get a bird's eye view image output and more press close to human nature in order to make, the present invention also proposes a new improvement to the disposal route that image is got a bird's eye view in the ring field.
The technology that connecting needle is got a bird's eye view image to ring of the present invention field further specifies, the invention is characterized in and increased one group of mapping table, in this embodiment, mapping table for the total system device set up finish after, set each camera post earlier in the spatial information of car body, and set up each every steering wheel angle (5 degree, 10 degree, 15 degree ...) the coordinate transitional information of pairing virtual view conversion, so mapping table has write down the transfer process that a unit point of raw video corresponds to another unit point of getting a bird's eye view image.Therefore, when image collection device 10 collects image, can cooperate steering wheel angle signal at that time and then select pairing mapping table, to obtain again image be inserted in this mapping table can be with the signal of video signal fast processing, wherein the present invention is got a bird's eye view the video conversion computing method and is utilized video camera coordinate transition matrix, virtual view coordinate transition matrix, perspective conversion formula and anti-perspective conversion to carry out video conversion, and then obtains a two-dimentional vehicle ring field general view.
Below lift example explanation: when the driver controls vehicle and bends to right, as shown in Figure 6, image processor receives vehicle body 60 signals, image is seen through the mapping table conversion that has in advance configured, image capturing range 62 is got a bird's eye view to the driver in ring field with the right front maximum region of headstock that virtual visual angle 64 is presented that the inclined left rear is provided, and detects being present in this barrier of getting a bird's eye view image capturing range 66.Above-mentioned is an advantage of the present invention, be because the barrier of vehicle periphery is not all can threaten to vehicle completely, and barrier computing unit of the present invention does not need the four corner of monitoring round of vehicle yet, the direction that the present invention can be only advances at vehicle and adjust the detection of obstacles zone makes detection of obstacles scope and method more be wisdom.
Please refer to Fig. 7 for flow chart of steps of the present invention and simultaneously with reference to figure 1.At first, step S10 is that vehicle body signal picker 12 is gathered the vehicle body signal earlier, wherein this vehicle body signal can be steering wheel for vehicle angular signal, gear signal or vehicle speed signal, and step S12 is by six raw videos that are arranged on around image collection device 10 collection vehicle on the vehicle, and the image that wherein adjacent image collection device 10 is gathered has at least one overlapping region; After obtaining image and vehicle body signal, as step S14, image processor 14 is selected pairing mapping table 141 according to the vehicle body signal, and the mapping table of wherein selecting carries out skew control, perspective conversion to image and sew up image getting a bird's eye view image to produce a ring field; Obtain this ring field and get a bird's eye view image, as step S20; Image is got a bird's eye view in this rings field of display 16 outputs, as step S22; Continue, image processor 14 is converted to six raw videos respectively else independently gets a bird's eye view image, as step S24; Shown in step S26, barrier computing unit 18 is judged the two adjacent correlativitys of independently getting a bird's eye view its repeat region of image, and present embodiment is cut into a plurality of subregions with repeat region earlier, and the related coefficient that calculates subregion wherein the formula of related coefficient be
Wherein, f (s, t) with w (s t) is respectively two adjacent these and independently gets a bird's eye view this subregion GTG value of this repeat region of image,
With
Be respectively two adjacent these and independently get a bird's eye view the average GTG value of this subregion of this repeat region of image; Whether whether come the disturbance in judgement thing to exist less than threshold values according to related coefficient, wherein on behalf of clear, related coefficient then occur greater than threshold values, related coefficient represents that then barrier exists, as step S28 less than threshold values; If there is barrier to exist, then gets a bird's eye view sign barrier position in the image, and see through alarming device 20 alarm and reminding drivers, as step S30 in this ring field; Exist as clear, then this flow process finishes operation.
Via above-mentioned explanation, as seen the present invention improves the shortcoming that barrier takes place can't show because of the image dead angle at the image suture known techniques, utilization of the present invention encircles the characteristic of the distortion that must be distorted after video conversion is got a bird's eye view in the field when there is the image overlap place in barrier, further be converted into the means of disturbance in judgement object location, two raw videos that will have overlap, be converted to individually and get a bird's eye view striograph, in two correlativitys of getting a bird's eye view its repeat region of image of comparison, the little person of correlativity then has barrier, and the subregion of analyzing thin portion is accurately concluded this barrier position, thus, the present invention saves other checkout equipments such as ultrasound wave or radar are installed, and utilizes image technology can record the barrier minimum distance purely.In addition, drive a vehicle and turn or sensing range when retreating in order to strengthen the driver, in the video conversion technology, the present invention encircles the field with a plurality of mapping tables and gets a bird's eye view video conversion, wherein each mapping table comprises the space conversion information under each driving states, so getting a bird's eye view the virtual visual angle of image, ring of the present invention field can change according to the driving situation, and native system shows that the detection of obstacles scope also changes because of the change at virtual visual angle, be more humane driving servicing unit, therefore the driver is when using technological means of the present invention, can obtain to keep straight on, turn, image is got a bird's eye view in the ring field that different visual angles under the situation such as retreats, thereby can more safely drive and set out on a journey.
The above description of this invention is illustrative, and nonrestrictive, and those skilled in the art is understood, and can carry out many modifications, variation or equivalence to it within spirit that claim limits and scope, but they will fall within the scope of protection of the present invention all.
Claims (10)
1. the system of image disturbance in judgement thing is got a bird's eye view in a utilization, it is characterized in that, comprises:
A plurality of image collection devices, it is located on the vehicle, and these image collection devices are obtained the image of a plurality of these vehicle peripheries;
One image processor converts these images to a plurality of images of independently getting a bird's eye view respectively, and wherein two adjacent these are independently got a bird's eye view image and comprised a repeat region; And
One barrier computing unit, relatively two adjacent these are independently got a bird's eye view the correlativity of this repeat region of image, have judged whether barrier by this correlativity.
2. the system of image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 1, it is characterized in that, more comprise the vehicle body signal picker, it gathers steering wheel angle signal, vehicle speed signal or the gear signal of this vehicle, the signal that this image processor is gathered according to this vehicle body signal picker, change out a ring field and get a bird's eye view image, the steering wheel angle signal transformation of the virtual visual angle of image along with this vehicle is got a bird's eye view in this ring field.
3. the system of image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 2, it is characterized in that, this image processor more comprises a plurality of mapping tables, it is the space conversion information about the position of the steering wheel angle angle of this vehicle and these image collection devices, and this mapping table carries out image distortion correction, the conversion of image perspective and image with this image to be sewed up, and gets a bird's eye view image and be converted to this ring field.
4. the system of image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 2, it is characterized in that, more comprise a display, electrically connect this image processor, this display is exported this ring field and is got a bird's eye view image, and the position display of this barrier is got a bird's eye view in the image in this ring field, and this display shows the driving boost line or the parking boost line of this vehicle periphery.
5. the system of image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 1, it is characterized in that, this barrier computing unit cuts into a plurality of subregions respectively with two these adjacent these repeat regions of independently getting a bird's eye view image, and calculate the two the related coefficient of this subregion that two adjacent these are independently got a bird's eye view this repeat region of image, and the formula of this related coefficient is
F (s, t) with w (s t) is respectively two adjacent these and independently gets a bird's eye view this subregion GTG value of image,
With
Be respectively two adjacent these and independently get a bird's eye view the average GTG value of this subregion of image, judge with this related coefficient whether this subregion has this barrier, and then obtain the distance of this vehicle and this barrier.
6. the method for image disturbance in judgement thing is got a bird's eye view in a utilization, it is characterized in that described method comprises step:
Gather the vehicle body signal of a vehicle, and select pairing mapping table, and gather near a plurality of images of this vehicle, set up a ring field according to this mapping table and get a bird's eye view image, wherein two these adjacent images comprise a repeat region;
With these video conversion respectively a plurality of images of independently getting a bird's eye view;
Judge that adjacent this independently get a bird's eye view the correlativity of this repeat region of image;
Judge whether this repeat region has barrier; And
If this barrier is arranged, this obstruction marking is got a bird's eye view in the image in this ring field.
7. the method for image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 6, it is characterized in that, the virtual view of image is got a bird's eye view according to this steering wheel angle signal transformation in this ring field.
8. the method for image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 6, it is characterized in that, judge that two adjacent these independently get a bird's eye view the step of this correlativity of this repeat region of image, more comprise two these adjacent these repeat regions of independently getting a bird's eye view image are cut into a plurality of subregions respectively, and calculating the two the related coefficient of this subregion that two adjacent these are independently got a bird's eye view this repeat region of image, the formula of this related coefficient is
F (s, t) with w (s t) is respectively two adjacent these and independently gets a bird's eye view this subregion GTG value of this repeat region of image,
With
Be respectively two adjacent these and independently get a bird's eye view the average GTG value of this subregion of this repeat region of image, judge with this related coefficient whether this subregion has this barrier, and then obtain the distance of this vehicle and this barrier.
9. the method for image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 6, it is characterized in that the space conversion information of this mapping table for setting up according to this vehicle body signal and these image collection device positions.
10. the method for image disturbance in judgement thing is got a bird's eye view in utilization as claimed in claim 6, it is characterized in that, this vehicle body signal comprises steering wheel angle signal, gear signal or vehicle speed signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101617455A CN101995239B (en) | 2009-08-11 | 2009-08-11 | System and method for determining obstacle by using aerial view images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101617455A CN101995239B (en) | 2009-08-11 | 2009-08-11 | System and method for determining obstacle by using aerial view images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101995239A true CN101995239A (en) | 2011-03-30 |
| CN101995239B CN101995239B (en) | 2012-05-23 |
Family
ID=43785707
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101617455A Active CN101995239B (en) | 2009-08-11 | 2009-08-11 | System and method for determining obstacle by using aerial view images |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101995239B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102774324A (en) * | 2012-07-06 | 2012-11-14 | 广东好帮手电子科技股份有限公司 | Panoramic parking assist system and implementation method thereof |
| CN102970460A (en) * | 2011-08-31 | 2013-03-13 | 帷丰科技有限公司 | Method and system for adjusting vehicle imaging device |
| US20140118550A1 (en) * | 2012-10-30 | 2014-05-01 | Hyundai Motor Company | Apparatus and method for detecting obstacle for around view monitoring system |
| CN103987582A (en) * | 2011-12-15 | 2014-08-13 | 松下电器产业株式会社 | Drive assistance device |
| CN104185010A (en) * | 2013-05-23 | 2014-12-03 | 通用汽车环球科技运作有限责任公司 | Enhanced perspective view generation in a front curb viewing system |
| CN104185009A (en) * | 2013-05-23 | 2014-12-03 | 通用汽车环球科技运作有限责任公司 | enhanced top-down view generation in a front curb viewing system |
| CN104735403A (en) * | 2013-12-18 | 2015-06-24 | 欧特明电子股份有限公司 | vehicle obstacle detection display system |
| CN104760537A (en) * | 2015-04-21 | 2015-07-08 | 重庆大学 | Novel vehicle-mounted safe driving assistance system |
| CN104811663A (en) * | 2015-04-17 | 2015-07-29 | 浙江吉利汽车研究院有限公司 | Vehicle image processing method and processing device |
| CN106926794A (en) * | 2015-12-31 | 2017-07-07 | 合盈光电科技股份有限公司 | Vehicle monitoring system and method thereof |
| CN107336669A (en) * | 2016-04-28 | 2017-11-10 | 合盈光电科技股份有限公司 | Vehicle safety protection system and method thereof |
| CN108370433A (en) * | 2015-12-18 | 2018-08-03 | 株式会社电装 | Display control unit and display control method |
| TWI650018B (en) * | 2017-07-18 | 2019-02-01 | 晶睿通訊股份有限公司 | Method for providing user interface for scene stitching of scene and electronic device thereof |
| CN110406472A (en) * | 2018-04-27 | 2019-11-05 | 华创车电技术中心股份有限公司 | Parking assistance system and parking assistance method |
| CN110525360A (en) * | 2019-08-26 | 2019-12-03 | 广汽蔚来新能源汽车科技有限公司 | Auxiliary driving method, device, system and storage medium based on car-mounted terminal |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4907883B2 (en) * | 2005-03-09 | 2012-04-04 | 株式会社東芝 | Vehicle periphery image display device and vehicle periphery image display method |
| JP4899367B2 (en) * | 2005-07-27 | 2012-03-21 | 日産自動車株式会社 | Overhead image display system and overhead image display method |
| CN101442618A (en) * | 2008-12-31 | 2009-05-27 | 葛晨阳 | Method for synthesizing 360 DEG ring-shaped video of vehicle assistant drive |
-
2009
- 2009-08-11 CN CN2009101617455A patent/CN101995239B/en active Active
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102970460A (en) * | 2011-08-31 | 2013-03-13 | 帷丰科技有限公司 | Method and system for adjusting vehicle imaging device |
| CN102970460B (en) * | 2011-08-31 | 2015-08-26 | 帷享科技有限公司台中分公司 | The method of adjustment vehicle image device and system thereof |
| CN103987582A (en) * | 2011-12-15 | 2014-08-13 | 松下电器产业株式会社 | Drive assistance device |
| US9697735B2 (en) | 2011-12-15 | 2017-07-04 | Panasonic Intellectual Property Management Co., Ltd. | Drive assistance device |
| CN102774324A (en) * | 2012-07-06 | 2012-11-14 | 广东好帮手电子科技股份有限公司 | Panoramic parking assist system and implementation method thereof |
| CN102774324B (en) * | 2012-07-06 | 2014-12-10 | 广东好帮手电子科技股份有限公司 | Panoramic parking assist system and implementation method thereof |
| US9104920B2 (en) * | 2012-10-30 | 2015-08-11 | Hyundai Motor Company | Apparatus and method for detecting obstacle for around view monitoring system |
| US20140118550A1 (en) * | 2012-10-30 | 2014-05-01 | Hyundai Motor Company | Apparatus and method for detecting obstacle for around view monitoring system |
| CN103793684A (en) * | 2012-10-30 | 2014-05-14 | 现代自动车株式会社 | Apparatus and method for detecting obstacle for around view monitoring system |
| CN103793684B (en) * | 2012-10-30 | 2018-11-16 | 现代自动车株式会社 | The device and method of detection barrier for panoramic view monitoring system |
| CN104185009A (en) * | 2013-05-23 | 2014-12-03 | 通用汽车环球科技运作有限责任公司 | enhanced top-down view generation in a front curb viewing system |
| CN104185010A (en) * | 2013-05-23 | 2014-12-03 | 通用汽车环球科技运作有限责任公司 | Enhanced perspective view generation in a front curb viewing system |
| CN104185009B (en) * | 2013-05-23 | 2017-04-12 | 通用汽车环球科技运作有限责任公司 | enhanced top-down view generation in a front curb viewing system |
| CN104185010B (en) * | 2013-05-23 | 2017-06-09 | 通用汽车环球科技运作有限责任公司 | Enhanced three-dimensional view generation in the curb observing system of front |
| CN104735403A (en) * | 2013-12-18 | 2015-06-24 | 欧特明电子股份有限公司 | vehicle obstacle detection display system |
| CN104811663B (en) * | 2015-04-17 | 2018-09-04 | 浙江吉利汽车研究院有限公司 | The image processing method and processing unit of vehicle |
| CN104811663A (en) * | 2015-04-17 | 2015-07-29 | 浙江吉利汽车研究院有限公司 | Vehicle image processing method and processing device |
| CN104760537A (en) * | 2015-04-21 | 2015-07-08 | 重庆大学 | Novel vehicle-mounted safe driving assistance system |
| CN108370433A (en) * | 2015-12-18 | 2018-08-03 | 株式会社电装 | Display control unit and display control method |
| CN108370433B (en) * | 2015-12-18 | 2020-05-26 | 株式会社电装 | Display control device and display control method |
| CN106926794A (en) * | 2015-12-31 | 2017-07-07 | 合盈光电科技股份有限公司 | Vehicle monitoring system and method thereof |
| CN106926794B (en) * | 2015-12-31 | 2019-12-31 | 合盈光电科技股份有限公司 | Vehicle monitoring system and method thereof |
| CN107336669A (en) * | 2016-04-28 | 2017-11-10 | 合盈光电科技股份有限公司 | Vehicle safety protection system and method thereof |
| TWI650018B (en) * | 2017-07-18 | 2019-02-01 | 晶睿通訊股份有限公司 | Method for providing user interface for scene stitching of scene and electronic device thereof |
| CN110406472A (en) * | 2018-04-27 | 2019-11-05 | 华创车电技术中心股份有限公司 | Parking assistance system and parking assistance method |
| CN110525360A (en) * | 2019-08-26 | 2019-12-03 | 广汽蔚来新能源汽车科技有限公司 | Auxiliary driving method, device, system and storage medium based on car-mounted terminal |
| CN110525360B (en) * | 2019-08-26 | 2022-04-26 | 合创汽车科技有限公司 | Vehicle-mounted terminal-based driving assisting method, device and system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101995239B (en) | 2012-05-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101995239B (en) | System and method for determining obstacle by using aerial view images | |
| US8315433B2 (en) | Obstacle determination system and method implemented through utilizing bird's-eye-view images | |
| JP7342197B2 (en) | Imaging device and method of controlling the imaging device | |
| US20230014401A1 (en) | 2d mimo vehicular radar sensing system | |
| US11417116B2 (en) | Vehicular trailer angle detection system | |
| KR101327736B1 (en) | AVM Top View Based Parking Support System | |
| CN102745138B (en) | Dual view-field dynamic-trajectory reverse image system | |
| US20180059236A1 (en) | Vehicle sensor with integrated radar and image sensors | |
| EP1895766B1 (en) | Camera with two or more angles of view | |
| US20110157361A1 (en) | Method and system for generating surrounding seamless bird-view image with distance interface | |
| CN107627957A (en) | Operation Van | |
| US20130208118A1 (en) | Vehicular infrared night assistant driving system | |
| WO2014054753A1 (en) | Image processing device and device for monitoring area in front of vehicle | |
| GB2554427B (en) | Method and device for detecting a trailer | |
| CN105015418B (en) | Vehicle-carrying display screen video switching method | |
| US20210034903A1 (en) | Trailer hitching assist system with trailer coupler detection | |
| JP5951785B2 (en) | Image processing apparatus and vehicle forward monitoring apparatus | |
| JP3960153B2 (en) | Vehicle periphery monitoring device | |
| CN104670089A (en) | Panoramic driving monitoring and alarming system | |
| CN107176100A (en) | Car-mounted terminal and its distance-finding method with distance measurement function | |
| CN111856606A (en) | Forward-looking intelligent driving auxiliary device and method based on infrared thermal imaging | |
| CN111753741B (en) | Special vehicle driving assisting method and device based on deep learning and storage medium | |
| WO2021132227A1 (en) | Information processing device, sensing device, moving body, and information processing method | |
| CN217598448U (en) | Visual monitored control system of vehicle blind area and car | |
| CN218839315U (en) | On-vehicle image blind area detecting system of many functional safety |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |