US20150170520A1 - Parking guide line device and displaying method - Google Patents

Parking guide line device and displaying method Download PDF

Info

Publication number
US20150170520A1
US20150170520A1 US14/552,544 US201414552544A US2015170520A1 US 20150170520 A1 US20150170520 A1 US 20150170520A1 US 201414552544 A US201414552544 A US 201414552544A US 2015170520 A1 US2015170520 A1 US 2015170520A1
Authority
US
United States
Prior art keywords
rear view
view camera
image
angle
measurer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US14/552,544
Other versions
US9978281B2 (en
Inventor
Sung Kyung HWANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Mobis Co Ltd
Original Assignee
Hyundai Mobis Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Mobis Co Ltd filed Critical Hyundai Mobis Co Ltd
Assigned to HYUNDAI MOBIS CO., LTD. reassignment HYUNDAI MOBIS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HWANG, SUNG KYUNG
Publication of US20150170520A1 publication Critical patent/US20150170520A1/en
Application granted granted Critical
Publication of US9978281B2 publication Critical patent/US9978281B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/168Driving aids for parking, e.g. acoustic or visual feedback on parking space
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/06Automatic manoeuvring for parking
    • G06K9/00798
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B60R2300/305Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/806Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30264Parking

Definitions

  • the present invention relates to a device for assisting rear parking of a vehicle and a method of displaying a guide line, and more particularly, to a device for assisting rear parking of a vehicle which can creates a parking guide line even if the angle of a rear view camera changes, because the rear view camera can obtain the angle information, and a method of displaying a guide line.
  • vehicles for example, equipped with a navigation device for guidance, an automotive black box for recording driving situations, and an automotive monitoring camera for compensating a blind spot of a driver have been generalized.
  • automotive monitoring camera a rear view camera showing the area behind a vehicle that a drive has difficulty in checking is generally used, and as for navigations or black boxes, they have the function of a rear view camera or a function cooperating with a rear view camera in some cases.
  • Such an automotive rear view camera ensures the view for the area behind a vehicle that a driver cannot see, so that it can not only simply help parking, but prevent a danger of an accident when a driver fails to see children or animals behind his/her vehicle and drives the vehicle backward. Accordingly, the rear view camera is recently considered as necessary equipment for a driver.
  • the present invention has been made in an effort to provide a device for assisting rear parking of a vehicle which can create a parking guide line, using information about the position and the angle of a rear view camera.
  • An aspect of the present invention provides a device for assisting rear parking of a vehicle which includes: a rear view camera that is mounted on the rear of a vehicle; a display unit that displays an image taken by the rear view camera; a height measurer that measures the position of the rear view camera from the ground; an angle measurer that measures the inclination of the rear view camera from the ground; and an image processor that creates a parking guide line in the image taken by the rear view camera on the basis of information obtained by the height measurer and the angle measurer and outputs the parking guide line through the display unit.
  • Another aspect of the present invention provides a method of displaying a parking guide line of a device for assisting rear parking of a vehicle which includes: measuring the height and angle of a rear view camera on the rear of a vehicle from the ground; taking an image of a predetermined area behind a vehicle through the rear view camera; mapping points in the image on a lens of the rear view camera; mapping the image mapped on the lens of the rear view camera on an image sensor of the rear view camera; and creating a parking guide line corresponding to the points mapped on the image sensor and outputting the parking guide line through a display unit.
  • the points in the image are changed into pixels and a parking guide line is created by connecting the pixels.
  • the device for assisting rear parking of a vehicle and the method of displaying a guide line since a height measurer and an angle measurer are disposed in a camera, the position and the angle of the camera are measured by the height measurer and the angle measurer, and then a parking guide line is created, it is possible to receive accurate information for a parking guide line, even if a rear view camera is mounted at any position at any angle on the rear of a vehicle.
  • FIG. 1 is a block diagram showing a device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 2 is a flowchart showing the operation of the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 3 is a diagram showing the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 4 illustrates diagrams showing mapping according to the angle of the rear view camera shown in FIG. 3 .
  • FIG. 1 is a block diagram showing a device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • a device 100 for assisting rear parking of a vehicle includes: a rear view camera 110 taking an image of the area behind a vehicle; a height measurer 120 measuring the position of the rear view camera; an angle measurer 130 measuring the angle of the rear view camera; an image processor 140 providing an image for a driver by processing image information from the rear view camera 110 and information from the height measurer 120 and angle measurer 130 ; and a display unit 150 displaying the image produced by the image processor 140 .
  • the rear view camera 110 may be mounted at any position on the bumper of a vehicle and various types of cameras may be used, depending on the configuration and the design cost of the device, as long as they satisfy image quality or resolution that do not make a driver difficult to recognize an image of the area behind a vehicle.
  • the rear view camera 110 includes an image sensor 160 , the height measurer 120 , and the angle measurer 130 .
  • the image sensor 160 may be mounted on the case of the height measurer 120 and the angle measurer 130 , but may be provided separately from the rear view camera.
  • the height measurer 120 is disposed in the rear view camera 110 and measures the height of the rear view camera 110 on a vehicle from the ground.
  • the height measurer 120 may be one of an ultrasonic sensor, an infrared sensor, a laser pointer, and a detector.
  • the angle measurer 130 is disposed in the rear view camera 110 and measures the angle of the rear view camera 110 .
  • the angle measurer 130 measures the angle of the rear view camera 110 from the ground and measures angles of all points in a predetermined rear area photographed by the rear view camera 110 .
  • the angle measurer 130 may be a gyro sensor.
  • the rear view camera 110 takes an image of a predetermined rear area on the basis of information from the height measurer 120 and the angle measurer 130 .
  • the image processor 140 creates an accurate parking guide line, using the image of the rear area taken by the rear view camera 110 and the data obtained by the height measurer 120 and the angle measurer 130 , and the parking guide line is displayed by the display unit 150 .
  • the display unit 150 a display device, outputs an image of a rear area taken by the rear view camera 110 .
  • an individual display unit for taking an image of a rear area may be used, and in some cases, a navigation device or a portable TV in a vehicle may be used.
  • FIG. 2 is a flowchart showing the operation of the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • the rear view camera 110 on the rear of the vehicle takes an image of a predetermine rear area.
  • the height measurer 120 in the rear view camera 110 measures the height of the rear view camera 110 on a vehicle from the ground. Further, the angle measurer 130 measures angles of all points in the rear area (S 210 ).
  • the measured height h and the angle Ar of a point dr are described below with reference to FIGS. 4 .
  • the image processor 140 maps the point dr on a rear view camera lens 170 on the basis of the height h of the rear view camera 110 measured by the height measurer 120 and the angle Ar of the point dr measured by the angle measurer 130 (S 220 ).
  • rear images are mapped on the lens 170 of the rear view camera 110 , for a point calculated from the height h of the rear view camera measured by the height measurer 120 and the angles of the areas photographed by the rear view camera 110 .
  • Rear images are mapped on the image sensor in accordance with the angle of the camera measured by the angle measurer 130 and the distance from the rear view camera lens to the image sensor.
  • FIG. 3 is a diagram showing the device for assisting rear parking of a vehicle according to an embodiment of the present invention and FIG. 4 illustrates diagrams showing mapping according to the angle of the rear view camera shown in FIG. 3 .
  • a rear view camera 110 is mounted on the rear of a vehicle.
  • the rear view camera 110 includes an image sensor 160 , and as described above, includes a height measurer 120 and an angle measurer 130 .
  • the angle Ar from the rear view camera 110 to the point dr is calculated on the basis of the height h measured by the height measurer 120 .
  • the image processor 140 maps the point dr on a rear view camera lens on the basis of the height h of the rear view camera 110 measured by the height measurer 120 and the angle Ar of the point dr measured by the angle measurer 130 .
  • rear images are mapped on the image sensor 160 on the basis of the angle A of the camera measured by the angle measurer 130 and the distance h′ from the rear view camera to the image sensor 160 .
  • the distance h′ between the rear view camera and the image sensor 160 depends on the specification of the rear view camera lens, that is, may be different in accordance with the specification of the rear view camera lens.
  • the position of the point dr in the rear image which is mapped on the image sensor 160 through the rear view camera lens depends on the angle A of the rear view camera 110 .
  • the angle A of the rear view camera 110 should be measured by the angle measurer 130 .
  • the image processor 140 changes the rear points mapped on the image sensor 150 into pixels and creates a parking guide line by connecting the pixels, and the parking guide line is displayed on the display unit 150 .
  • a height measurer and an angle measurer are disposed in a camera, the position and the angle of the camera are measured by the height measurer and the angle measurer, and then a parking guide line is created, it is possible to receive accurate information about a parking guide line, even if a rear view camera is mounted at any position at any angle on the rear of a vehicle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)

Abstract

A device for assisting rear parking of a vehicle including a rear view camera that is mounted on the rear of a vehicle; a display unit that displays an image taken by the rear view camera; a height measurer that measures the position of the rear view camera from the ground; an angle measurer that measures the inclination of the rear view camera from the ground; and an image processor that creates a parking guide line in the image taken by the rear view camera on the basis of information obtained by the height measurer and the angle measurer and outputs the parking guide line through the display unit.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims the priority benefit of Korean Patent Application No. 10-2013-0146718, filed on Nov. 29, 2013 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
  • BACKGROUND
  • The present invention relates to a device for assisting rear parking of a vehicle and a method of displaying a guide line, and more particularly, to a device for assisting rear parking of a vehicle which can creates a parking guide line even if the angle of a rear view camera changes, because the rear view camera can obtain the angle information, and a method of displaying a guide line.
  • Recently, as vehicles are generally used, the number of vehicles has greatly increased over the ratio of one vehicle per family. Further, with the development of automotive technologies, recently, various high-tech electronic devices are mounted on vehicle or vehicles equipped with those electronic devices are released.
  • That is, vehicles, for example, equipped with a navigation device for guidance, an automotive black box for recording driving situations, and an automotive monitoring camera for compensating a blind spot of a driver have been generalized. As for automotive monitoring camera, a rear view camera showing the area behind a vehicle that a drive has difficulty in checking is generally used, and as for navigations or black boxes, they have the function of a rear view camera or a function cooperating with a rear view camera in some cases.
  • Such an automotive rear view camera ensures the view for the area behind a vehicle that a driver cannot see, so that it can not only simply help parking, but prevent a danger of an accident when a driver fails to see children or animals behind his/her vehicle and drives the vehicle backward. Accordingly, the rear view camera is recently considered as necessary equipment for a driver.
  • However, in the related art, although a rear distance guide line is displayed with the rear image taken by a rear view camera for the convenience of a driver, a parking guide line is fixed, so when the position or the angle of the camera changes, the accuracy for the actual parking guide line decreases.
  • SUMMARY
  • The present invention has been made in an effort to provide a device for assisting rear parking of a vehicle which can create a parking guide line, using information about the position and the angle of a rear view camera.
  • An aspect of the present invention provides a device for assisting rear parking of a vehicle which includes: a rear view camera that is mounted on the rear of a vehicle; a display unit that displays an image taken by the rear view camera; a height measurer that measures the position of the rear view camera from the ground; an angle measurer that measures the inclination of the rear view camera from the ground; and an image processor that creates a parking guide line in the image taken by the rear view camera on the basis of information obtained by the height measurer and the angle measurer and outputs the parking guide line through the display unit.
  • Another aspect of the present invention provides a method of displaying a parking guide line of a device for assisting rear parking of a vehicle which includes: measuring the height and angle of a rear view camera on the rear of a vehicle from the ground; taking an image of a predetermined area behind a vehicle through the rear view camera; mapping points in the image on a lens of the rear view camera; mapping the image mapped on the lens of the rear view camera on an image sensor of the rear view camera; and creating a parking guide line corresponding to the points mapped on the image sensor and outputting the parking guide line through a display unit.
  • The points in the image are changed into pixels and a parking guide line is created by connecting the pixels.
  • According to the device for assisting rear parking of a vehicle and the method of displaying a guide line, since a height measurer and an angle measurer are disposed in a camera, the position and the angle of the camera are measured by the height measurer and the angle measurer, and then a parking guide line is created, it is possible to receive accurate information for a parking guide line, even if a rear view camera is mounted at any position at any angle on the rear of a vehicle.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram showing a device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 2 is a flowchart showing the operation of the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 3 is a diagram showing the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • FIG. 4 illustrates diagrams showing mapping according to the angle of the rear view camera shown in FIG. 3.
  • DETAILED DESCRIPTION
  • Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings and the following description. However, the present invention is not limited to the embodiments described herein and may be achieved in other ways. On the contrary, the embodiments described herein are provided so that the present invention can be more clearly and fully understood and those skilled in the art can fully understand the spirit of the present invention. Like reference numerals are given to like components throughout the specification.
  • FIG. 1 is a block diagram showing a device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • As shown in FIG. 1, a device 100 for assisting rear parking of a vehicle includes: a rear view camera 110 taking an image of the area behind a vehicle; a height measurer 120 measuring the position of the rear view camera; an angle measurer 130 measuring the angle of the rear view camera; an image processor 140 providing an image for a driver by processing image information from the rear view camera 110 and information from the height measurer 120 and angle measurer 130; and a display unit 150 displaying the image produced by the image processor 140.
  • The rear view camera 110 may be mounted at any position on the bumper of a vehicle and various types of cameras may be used, depending on the configuration and the design cost of the device, as long as they satisfy image quality or resolution that do not make a driver difficult to recognize an image of the area behind a vehicle.
  • The rear view camera 110 includes an image sensor 160, the height measurer 120, and the angle measurer 130. The image sensor 160 may be mounted on the case of the height measurer 120 and the angle measurer 130, but may be provided separately from the rear view camera.
  • The height measurer 120 is disposed in the rear view camera 110 and measures the height of the rear view camera 110 on a vehicle from the ground.
  • Further, the height measurer 120 may be one of an ultrasonic sensor, an infrared sensor, a laser pointer, and a detector.
  • The angle measurer 130 is disposed in the rear view camera 110 and measures the angle of the rear view camera 110. The angle measurer 130 measures the angle of the rear view camera 110 from the ground and measures angles of all points in a predetermined rear area photographed by the rear view camera 110.
  • The angle measurer 130 may be a gyro sensor.
  • The rear view camera 110 takes an image of a predetermined rear area on the basis of information from the height measurer 120 and the angle measurer 130.
  • The image processor 140 creates an accurate parking guide line, using the image of the rear area taken by the rear view camera 110 and the data obtained by the height measurer 120 and the angle measurer 130, and the parking guide line is displayed by the display unit 150.
  • The display unit 150, a display device, outputs an image of a rear area taken by the rear view camera 110.
  • For the display unit 150, an individual display unit for taking an image of a rear area may be used, and in some cases, a navigation device or a portable TV in a vehicle may be used.
  • FIG. 2 is a flowchart showing the operation of the device for assisting rear parking of a vehicle according to an embodiment of the present invention.
  • When a user drives a vehicle backward, the rear view camera 110 on the rear of the vehicle takes an image of a predetermine rear area.
  • The height measurer 120 in the rear view camera 110 measures the height of the rear view camera 110 on a vehicle from the ground. Further, the angle measurer 130 measures angles of all points in the rear area (S210).
  • The measured height h and the angle Ar of a point dr are described below with reference to FIGS. 4.
  • The image processor 140 maps the point dr on a rear view camera lens 170 on the basis of the height h of the rear view camera 110 measured by the height measurer 120 and the angle Ar of the point dr measured by the angle measurer 130 (S220).
  • That is, it is possible to locate the point by reversely tracing position of the point mapped on the lens 170.
  • In the image of a predetermined rear area taken by the rear view camera 110, rear images are mapped on the lens 170 of the rear view camera 110, for a point calculated from the height h of the rear view camera measured by the height measurer 120 and the angles of the areas photographed by the rear view camera 110.
  • Thereafter, the rear image mapped on the lens 170 of the rear view camera 110 is mapped on the image sensor 160 in the rear view camera 110 (S230).
  • Rear images are mapped on the image sensor in accordance with the angle of the camera measured by the angle measurer 130 and the distance from the rear view camera lens to the image sensor.
  • Accordingly, the image processor 140 creates a guide line for the rear image which corresponds to the measured height and angle of the camera (S240). FIG. 3 is a diagram showing the device for assisting rear parking of a vehicle according to an embodiment of the present invention and FIG. 4 illustrates diagrams showing mapping according to the angle of the rear view camera shown in FIG. 3.
  • As shown in FIG. 3, a rear view camera 110 is mounted on the rear of a vehicle.
  • The rear view camera 110 includes an image sensor 160, and as described above, includes a height measurer 120 and an angle measurer 130.
  • Assuming that a point in a rear area is the point dr, the angle Ar from the rear view camera 110 to the point dr is calculated on the basis of the height h measured by the height measurer 120.
  • The image processor 140 maps the point dr on a rear view camera lens on the basis of the height h of the rear view camera 110 measured by the height measurer 120 and the angle Ar of the point dr measured by the angle measurer 130.
  • As shown in (A) of FIG. 4, rear images are mapped on the image sensor 160 on the basis of the angle A of the camera measured by the angle measurer 130 and the distance h′ from the rear view camera to the image sensor 160.
  • The distance h′ between the rear view camera and the image sensor 160 depends on the specification of the rear view camera lens, that is, may be different in accordance with the specification of the rear view camera lens.
  • Further, as shown in (B) of FIG. 4, the position of the point dr in the rear image which is mapped on the image sensor 160 through the rear view camera lens depends on the angle A of the rear view camera 110.
  • Accordingly, when rear points are mapped on the image sensor 160 through the rear view camera lens, the angle A of the rear view camera 110 should be measured by the angle measurer 130.
  • Finally, the image processor 140 changes the rear points mapped on the image sensor 150 into pixels and creates a parking guide line by connecting the pixels, and the parking guide line is displayed on the display unit 150.
  • Accordingly, since a height measurer and an angle measurer are disposed in a camera, the position and the angle of the camera are measured by the height measurer and the angle measurer, and then a parking guide line is created, it is possible to receive accurate information about a parking guide line, even if a rear view camera is mounted at any position at any angle on the rear of a vehicle.
  • Although a device for assisting rear parking of a vehicle of the present invention was described with reference to an embodiment, it is apparent to those skilled in the art that the present invention may be change and modified in various ways without departing from the scope of the present invention.

Claims (10)

What is claimed is:
1. A device for assisting rear parking of a vehicle, comprising:
a rear view camera that is mounted on the rear of a vehicle;
a display unit that displays an image taken by the rear view camera;
a height measurer that measures the position of the rear view camera from the ground;
an angle measurer that measures the inclination of the rear view camera from the ground; and
an image processor that creates a parking guide line in the image taken by the rear view camera on the basis of information obtained by the height measurer and the angle measurer and outputs the parking guide line through the display unit.
2. The device of claim 1, wherein the image processor maps a point in the image on a rear view camera lens on the basis of the height of the rear view camera measured by the height measurer and the angle to the point in the image measured by the angle measurer.
3. The device of claim 2, wherein the image processor maps the image mapped on the rear view camera lens on an image sensor in the rear view camera, on the basis of the angle of the rear view camera measured by the angle measurer and the distance from the rear view camera lens to the image sensor.
4. The device of claim 3, wherein the image processor divides the point mapped on the image senor into a pixel and creates a parking guide line by connecting a plurality of pixels.
5. The device of claim 1, wherein the height measurer is mounted on the rear view camera and is any one of an ultrasonic sensor, an infrared sensor, a laser pointer, and a detector.
6. The device of claim 1, wherein the angle measurer is mounted on the rear view camera and is a gyro sensor.
7. A method of displaying a parking guide line of a device for assisting rear parking of a vehicle, the method comprising:
measuring the height and angle of a rear view camera on the rear of a vehicle from the ground;
taking an image of a predetermined area behind a vehicle through the rear view camera;
mapping points in the image on a lens of the rear view camera;
mapping the image mapped on the lens of the rear view camera onto an image sensor of the rear view camera; and
creating a parking guide line corresponding to the points mapped on the image sensor and outputting the parking guide line through a display unit.
8. The method of claim 7, wherein the image is mapped on the lens on the basis of the height of the rear view camera measured by the height measurer and the angle of a point in the image.
9. The method of claim 8, wherein the image is mapped on the image sensor on the basis of the angle of the rear view camera and the distance between the rear view camera and the image sensor.
10. The method of claim 7, wherein after the image is mapped on the image sensor, the points in the image are changed into pixels, and a parking guide line is created by connecting the pixels.
US14/552,544 2013-11-29 2014-11-25 Parking guide line device and displaying method Active 2035-11-19 US9978281B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2013-0146718 2013-11-29
KR1020130146718A KR102175961B1 (en) 2013-11-29 2013-11-29 Parking guinde line device

Publications (2)

Publication Number Publication Date
US20150170520A1 true US20150170520A1 (en) 2015-06-18
US9978281B2 US9978281B2 (en) 2018-05-22

Family

ID=53369165

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/552,544 Active 2035-11-19 US9978281B2 (en) 2013-11-29 2014-11-25 Parking guide line device and displaying method

Country Status (2)

Country Link
US (1) US9978281B2 (en)
KR (1) KR102175961B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019223839A1 (en) * 2018-05-24 2019-11-28 Conti Temic Microelectronic Gmbh Optical detection system, arranged on a tailgate of a vehicle

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020005779A1 (en) * 2000-04-05 2002-01-17 Hirofumi Ishii Driving operation assisting method and system
US6611744B1 (en) * 1999-08-12 2003-08-26 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Steering assist apparatus for traveling in reverse
US20030165255A1 (en) * 2001-06-13 2003-09-04 Hirohiko Yanagawa Peripheral image processor of vehicle and recording medium
US6985171B1 (en) * 1999-09-30 2006-01-10 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Image conversion device for vehicle rearward-monitoring device
US20060255969A1 (en) * 2005-04-21 2006-11-16 Aisin Aw Co., Ltd. Parking assist systems, methods, and programs
US7307655B1 (en) * 1998-07-31 2007-12-11 Matsushita Electric Industrial Co., Ltd. Method and apparatus for displaying a synthesized image viewed from a virtual point of view
US20080024607A1 (en) * 2006-07-26 2008-01-31 Toyota Jidosha Kabushiki Kaisha Image display apparatus and method
US20080136912A1 (en) * 2006-09-26 2008-06-12 Hirotaka Iwano Image generating apparatus and image generating method
US20100114434A1 (en) * 2007-03-08 2010-05-06 Toyota Jidosha Kabushiki Kaisha Parking assist apparatus
US20100292886A1 (en) * 2009-05-18 2010-11-18 Gm Global Technology Operations, Inc. Turn by turn graphical navigation on full windshield head-up display
US20110273310A1 (en) * 2009-02-25 2011-11-10 Aisin Seiki Kabushiki Kaisha Parking assist apparatus
US20120007985A1 (en) * 2009-03-31 2012-01-12 Aisin Seiki Kabushiki Kaisha Calibration device, method, and program for on-board camera
US20120182426A1 (en) * 2009-09-30 2012-07-19 Panasonic Corporation Vehicle-surroundings monitoring device
US20130010119A1 (en) * 2010-05-14 2013-01-10 Mitsubishi Electric Corporation Parking assistance apparatus, parking assistance system, and parking assistance camera unit
US20150227806A1 (en) * 2012-09-24 2015-08-13 Nec Corporation Object information extraction apparatus, object information extraction program, and object information extraction method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5405809B2 (en) * 2008-12-04 2014-02-05 アルパイン株式会社 Vehicle periphery monitoring device and camera position / posture determination method

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7307655B1 (en) * 1998-07-31 2007-12-11 Matsushita Electric Industrial Co., Ltd. Method and apparatus for displaying a synthesized image viewed from a virtual point of view
US6611744B1 (en) * 1999-08-12 2003-08-26 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Steering assist apparatus for traveling in reverse
US6985171B1 (en) * 1999-09-30 2006-01-10 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Image conversion device for vehicle rearward-monitoring device
US20020005779A1 (en) * 2000-04-05 2002-01-17 Hirofumi Ishii Driving operation assisting method and system
US20030165255A1 (en) * 2001-06-13 2003-09-04 Hirohiko Yanagawa Peripheral image processor of vehicle and recording medium
US20060255969A1 (en) * 2005-04-21 2006-11-16 Aisin Aw Co., Ltd. Parking assist systems, methods, and programs
US20080024607A1 (en) * 2006-07-26 2008-01-31 Toyota Jidosha Kabushiki Kaisha Image display apparatus and method
US20080136912A1 (en) * 2006-09-26 2008-06-12 Hirotaka Iwano Image generating apparatus and image generating method
US20100114434A1 (en) * 2007-03-08 2010-05-06 Toyota Jidosha Kabushiki Kaisha Parking assist apparatus
US20110273310A1 (en) * 2009-02-25 2011-11-10 Aisin Seiki Kabushiki Kaisha Parking assist apparatus
US20120007985A1 (en) * 2009-03-31 2012-01-12 Aisin Seiki Kabushiki Kaisha Calibration device, method, and program for on-board camera
US20100292886A1 (en) * 2009-05-18 2010-11-18 Gm Global Technology Operations, Inc. Turn by turn graphical navigation on full windshield head-up display
US20120182426A1 (en) * 2009-09-30 2012-07-19 Panasonic Corporation Vehicle-surroundings monitoring device
US20130010119A1 (en) * 2010-05-14 2013-01-10 Mitsubishi Electric Corporation Parking assistance apparatus, parking assistance system, and parking assistance camera unit
US20150227806A1 (en) * 2012-09-24 2015-08-13 Nec Corporation Object information extraction apparatus, object information extraction program, and object information extraction method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019223839A1 (en) * 2018-05-24 2019-11-28 Conti Temic Microelectronic Gmbh Optical detection system, arranged on a tailgate of a vehicle

Also Published As

Publication number Publication date
KR20150062270A (en) 2015-06-08
US9978281B2 (en) 2018-05-22
KR102175961B1 (en) 2020-11-09

Similar Documents

Publication Publication Date Title
US10529083B2 (en) Methods and systems for estimating distance of an object from a moving vehicle
US9802540B2 (en) Process for representing vehicle surroundings information of a motor vehicle
JP6552729B2 (en) System and method for fusing the outputs of sensors having different resolutions
JP6458439B2 (en) On-vehicle camera calibration device, image generation device, on-vehicle camera calibration method, and image generation method
US10347130B2 (en) Vehicle and control method thereof
TWI600558B (en) Dynamic lane detection system and method
TWI431250B (en) Navigation device for integrated traffic image recording and navigation information
US20170032195A1 (en) Image display system
US20160098604A1 (en) Trailer track estimation system and method by image recognition
US20090179916A1 (en) Method and apparatus for calibrating a video display overlay
US10488658B2 (en) Dynamic information system capable of providing reference information according to driving scenarios in real time
US20120236287A1 (en) External environment visualization apparatus and method
CN101044390B (en) Sight distance measuring device and uses
CN103502876A (en) Method and device for calibrating a projection device of a vehicle
US10495458B2 (en) Image processing system for vehicle
CN111243029A (en) Calibration method and device of vision sensor
JP6375633B2 (en) Vehicle periphery image display device and vehicle periphery image display method
US11145112B2 (en) Method and vehicle control system for producing images of a surroundings model, and corresponding vehicle
JP2007181129A (en) Vehicle-mounted movable body detection instrument
US9978281B2 (en) Parking guide line device and displaying method
EP3795952A1 (en) Estimation device, estimation method, and computer program product
US20100134265A1 (en) Method for determining the angular magnitude of imaging acquiring apparatus and vehicle collision warning system using thereof
WO2019119358A1 (en) Method, device and system for displaying augmented reality poi information
TWI583200B (en) Driving recorder with scenic guide function
KR102641118B1 (en) Method and apparatus for providing ar object to user

Legal Events

Date Code Title Description
AS Assignment

Owner name: HYUNDAI MOBIS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HWANG, SUNG KYUNG;REEL/FRAME:034258/0332

Effective date: 20141124

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4