CN108995592B - Automobile image system - Google Patents

Automobile image system Download PDF

Info

Publication number
CN108995592B
CN108995592B CN201810870455.7A CN201810870455A CN108995592B CN 108995592 B CN108995592 B CN 108995592B CN 201810870455 A CN201810870455 A CN 201810870455A CN 108995592 B CN108995592 B CN 108995592B
Authority
CN
China
Prior art keywords
image
automobile
brightness
internal
external
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810870455.7A
Other languages
Chinese (zh)
Other versions
CN108995592A (en
Inventor
张士文
廖振延
Original Assignee
张士文
廖振延
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 张士文, 廖振延 filed Critical 张士文
Priority to CN201810870455.7A priority Critical patent/CN108995592B/en
Publication of CN108995592A publication Critical patent/CN108995592A/en
Application granted granted Critical
Publication of CN108995592B publication Critical patent/CN108995592B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/006Geometric correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/108Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Abstract

The invention discloses an automobile image system, which comprises an ultra-wide-angle lens, an image processing module and a behavior identification processing unit. The ultra-wide-angle lens is arranged in a front cabin of an automobile and is used for shooting an internal image and an external image of the automobile; the image processing module is connected with the ultra-wide-angle lens and used for processing the internal image and the external image of the automobile and adjusting the brightness of the internal image and the external image of the automobile to enable the brightness of the internal image and the brightness of the external image to be consistent; and the behavior identification processing unit is connected with the image processing module and is used for sensing the action of the automobile owner so as to start displaying an external image in the automobile.

Description

Automobile image system
Technical Field
The present invention relates to an automobile image system, and more particularly to an automobile image system capable of simultaneously capturing an external image and an internal image of an automobile.
Background
The traditional automobile blind spot image projection system aims at shooting an image of an actual environment outside an automobile through a photographic lens and projecting the image back to the automobile for driving, for example, the projection can be on a specific area of a front windshield, but the projection does not need to be full-time projection, the full-time projection can influence the driving sight and cause distraction, and the projection is performed when the driving needs. For example, when backing up and backing up (R) gear is required, the driver needs to see the rear image, so the R gear can be triggered at a time point of image projection.
Therefore, it is necessary to further determine the timing point of the required start, which can be manually started by passive means, such as pressing a button. The best mode is to realize active starting, and the starting is carried out in an automatic judgment mode, so that the mode of sensing and judging when the driving needs is realized is a mode of realizing, therefore, the lens can not only capture images outside a vehicle, but also judge images inside the vehicle through the behavior identification processing unit to judge the driving needs, and the traditional equipment can be realized only by two lenses. However, the cost of the two lenses is high, and the two lenses need to have corresponding processing chips to process the images of the two lenses, which is too complicated.
Therefore, there is a need to improve the conventional automotive blind spot image projection system using two lenses, and the purpose of triggering image projection can be achieved.
Disclosure of Invention
In view of the above, the present invention is directed to a car imaging system, which can solve the problem of high cost of the conventional car imaging system using two lenses.
According to the above object, the present invention provides an automobile image system, comprising: the ultra-wide-angle lens is arranged in a front cabin of an automobile and is used for shooting an internal image and an external image of the automobile; the image processing module is connected with the ultra-wide-angle lens and used for processing the internal image and the external image of the automobile and adjusting the brightness of the internal image and the external image of the automobile to enable the brightness of the internal image and the brightness of the external image to be consistent; the behavior identification processing unit is connected with the image processing module and used for sensing the behavior of the automobile owner so as to start displaying the external image in the automobile; the image processing module gives a plurality of equal parts to the internal image and the external image, calculates a brightness value of each equal part, gives a brightness weight to each equal part, and adjusts the brightness of the internal image and the external image according to the brightness value and the brightness weight.
The automobile image system, wherein, super wide angle camera lens is spherical lens.
The automobile image system, wherein the image processing module restores and compensates for distortion of the internal image and the external image.
The image processing module processes distortion, curves, color levels, contrast or colors of the internal image and the external image.
The image processing module is used for restoring the distorted image.
The car image system, wherein the behavior recognition processing unit is a three-dimensional (3D) sensor, a laser sensor or a motion detector.
The car image system, wherein, when the behavior recognition processing unit is the three-dimensional (3D) sensor, the eyeball movement of the car owner can be sensed.
The car image system, wherein, when the action discernment processing unit is the detector is felt to the body, can detect owner's limbs action.
The automobile image system, wherein, the super wide-angle lens sets up between a car steering wheel and a front windshield.
The automobile image system is characterized in that the behavior recognition processing unit starts to display the external image in a visible range of the automobile owner in the automobile.
The invention has the advantages that one lens is used for simultaneously shooting the internal image and the external image of the automobile, thereby not only reducing the cost, but also improving the problem that the images are not synchronous when two lenses are used.
Drawings
FIG. 1 is a block diagram of an automotive imaging system according to the present invention;
FIG. 2 is a schematic diagram of the setting position of the ultra-wide angle lens according to the present invention;
FIG. 3 is a schematic representation of image warping; and
FIG. 4 is a schematic diagram of the image processing module for calculating the brightness of the image according to the present invention.
Reference numerals:
automobile image system 10
Ultra wide angle lens 101
Image processing module 102
Behavior recognition processing unit 103
Steering wheel 201
Front windshield 202
Image 301
Screen 401
Equal division 402
Detailed Description
Reference will now be made in detail to the present embodiments of the invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals or characters refer to the same elements or concepts throughout the different views. The description of the embodiments of the present invention will be made with reference to the accompanying drawings.
Fig. 1 is a block diagram of an automotive imaging system 10 according to the present invention, as shown in fig. 1, the automotive imaging system includes an ultra-wide-angle lens 101, an image processing module 102 and a behavior recognition processing unit 103.
In the embodiment of the present invention, the ultra-wide-angle lens 101 is preferably disposed in a front compartment of the vehicle and located between a steering wheel 201 and a front windshield 202 of the vehicle, so that the ultra-wide-angle lens 101 can simultaneously capture an external real image and an internal image (e.g., an image of a vehicle owner) of the vehicle, as shown in fig. 2. The super wide-angle lens 101 may be a spherical lens, but is not limited thereto, and the super wide-angle lens 101 may perform a 180-degree panoramic photography or a 360-degree panoramic photography, and simultaneously capture a real image or an internal image of the exterior of the automobile, for example, the external image is particularly directed to a blind spot of a sight blocked by an a pillar of the automobile, and the internal image is captured in a direction of a face of a driver.
The image processing module 102 is connected to the ultra-wide-angle lens 101, and the image processing module 102 receives an internal image and an external image of the automobile, which are captured by the ultra-wide-angle lens 101, and is used for performing image processing on the external image and the internal image. For example, when the super-wide-angle lens 101 is a spherical lens, however, the image captured by the spherical lens is not a general plane image, and in order to make the visible range wider, the four corners of the image may have severe distortion (as shown in fig. 3), the image processing module 102 can process the distorted image 301 to compensate and restore the distorted image, and convert the distorted image into an un-distorted flat image. How to adjust the distorted image 301 to a normal image can be performed by using an algorithm of a third-order polynomial distortion correction model to restore the distorted image to the normal image, and these image 301 correction techniques are well known to those skilled in the art and will not be described herein again.
In addition, the image processing module 102 of the present invention can further perform a correction restoration of the internal image and the external image, for example, process distortion, curves, color levels, contrast or colors of the images, so that the car owner can see clear images.
In addition, when the ultra-wide-angle lens 101 captures an internal image and an external image simultaneously, the car image system determines which part belongs to the internal image and which part belongs to the external image. For example, the place where the human face (owner) is detected is an internal image, or the internal images are images of internal parts or instruments of the automobile, the image of the internal part or instrument is judged to be taken as the internal image, or even the internal image and the external image can be judged according to the brightness, when the brightness of part of the image is much darker than that of other parts of the image, the image can be considered as the internal image, at the moment, the automobile image system will cut the image into the inside and the outside, and when the image needs to be displayed, only the image with the external blind area is displayed.
In an embodiment of the invention, the image processing module 102 may be further configured to adjust the brightness of the image frame. Because the brightness difference between the internal image and the external image of the automobile shot by the ultra-wide-angle lens 101 is large, the external image is very bright, and the internal image is very dark, if the internal image and the external image are simultaneously obtained by using one lens, an exposure imaging problem is generated, and a balance point cannot be obtained in the brightness. For example, in the case of photometric imaging with the dark portion standard of the internal image, the captured external image is over-exposed; the light imaging is measured by the bright part standard of the external image, and the captured internal image is underexposed to cause too dark brightness. Moreover, the image processed by the image processing module 102 still has a problem of different brightness, so the brightness of each block of the internal image and the external image is analyzed simultaneously by the image processing module 102, and then the brightness of each block is adjusted to be the same.
For example, as shown in fig. 4, the image (internal image and external image) of a frame 401 is divided into nine equal parts 402, and the image processing module 102 calculates the brightness value of each equal part 402 and gives a brightness weight to each equal part 402. For example, if the brightness of some of the equal parts 402 is low, the weight will be high (as X6 in the figure), and if the brightness of some of the equal parts 402 is high, the weight will be low (as X1 in the figure), so the multiplication of the weight and the brightness of each equal part 402 will tend to a certain value, and the brightness will be adjusted according to the weight, so that the brightness of the whole picture will tend to be balanced. In addition, the brightness adjustment method is only to illustrate how to adjust the brightness, but not limited to dividing the image of the frame 401 into nine parts, in different embodiments, the image of the frame 401 may be divided into twelve parts, twenty parts, or any N × M parts (where N and M are positive integers), and the like, and the weight of the brightness adjustment may be adjusted up or down according to the needs of the owner. In addition, it should be noted that the image processing module 102 of the present invention can be software or a program, and the software or the program is burned into a firmware or a microprocessor, and how to input the image processing module 102 into the firmware or the microprocessor is well known to those skilled in the art, and will not be described herein again.
The behavior recognition processing unit 103 is connected to the image processing module 102, and the behavior recognition processing unit 103 receives the body actions, head or face behavior actions of the vehicle owner transmitted from the image processing module 102, and directly performs recognition and operation in the behavior recognition processing unit 103. The behavior recognition processing unit 103 can determine when the blind area image needs to be seen by the vehicle owner through the gaze point, gaze time or body movement of the human eye (e.g. face angle change). The behavior recognition processing unit 103 may be a three-dimensional (3D) sensor, a laser sensor, or a motion detector, or even a computer image processing firmware disposed in the car image system 10, but not limited thereto, any device capable of detecting the body movement or the eye movement of the car owner and further determining the time for starting the projection of the exterior real-scene image may be the behavior recognition processing unit 103 of the present invention. For example, the behavior recognition processing unit 103 detects the position of the face of the owner, when the face of the owner moves to an angle, the behavior recognition processing unit 103 determines whether the owner needs to turn or watch the coming car behind, and the car image system starts the projection of the real image outside the car. Alternatively, the behavior recognition processing unit 103 detects the position of the eyeball of the vehicle owner, and when the eyeball of the vehicle owner moves left and right, the vehicle image system starts the projection of the outdoor live-action image. When the behavior recognition processing unit 103 detects a specific motion of the vehicle owner, it immediately starts to display an image within a visible range of the vehicle owner (e.g., projecting on a front windshield of the vehicle), or projecting the image at a position accessible by a driving sight line in a stereo projection manner, so that the vehicle owner can view the surrounding conditions of the vehicle (e.g., a blind spot area of the vehicle) through the assistance of the projected image.
In addition, in the preferred embodiment of the present invention, the behavior recognition processing unit 103 can further recognize that the head of the vehicle owner is moving downward or the eyeball position is not detected in the image (it may be that the vehicle owner is dozing off for a short time and closes his eyes or starts nodding off his eyes), then the behavior recognition processing unit 103 determines that the vehicle is dozing off, and then sends a signal back to the vehicle imaging system 10, and the vehicle imaging system 10 sends out a warning sound. Alternatively, the behavior recognition processing unit 103 recognizes the dozing of the vehicle owner and detects the speed reduction of the vehicle ahead, and also sends a signal to the vehicle imaging system 10, so that the vehicle imaging system 10 sends a warning sound to remind the vehicle owner, or actively intervenes in the vehicle control, such as deceleration.
Through the automobile image system, only one ultra-wide-angle lens is used, so that the problem that the cost of two lenses is too high in the traditional application is solved, the problem that the two lenses are difficult to synchronize is caused, and the problem that the two visual angle pictures shot by one lens are the same picture but cannot be synchronized is solved. In addition, the problem that brightness is different between the interior and the exterior of the vehicle due to the fact that one lens is used better is solved.
Although the present invention has been described with reference to the preferred embodiments, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. An automotive imaging system, comprising:
the ultra-wide-angle lens is arranged in a front cabin of an automobile and is used for shooting an internal image and an external image of the automobile;
the image processing module is connected with the ultra-wide-angle lens and used for processing the internal image and the external image of the automobile and adjusting the brightness of the internal image and the external image of the automobile to enable the brightness of the internal image and the brightness of the external image to be consistent; and
the behavior identification processing unit is connected with the image processing module and used for sensing the body actions of the automobile owner so as to start displaying the external image in the automobile;
the image processing module is configured to give a plurality of equal parts to the internal image and the external image, calculate a brightness value of each equal part, give a brightness weight to each equal part, and adjust the brightness of the internal image and the external image according to the brightness value and the brightness weight.
2. The automotive imaging system of claim 1, wherein the super-wide angle lens is a spherical lens.
3. The car image system of claim 1, wherein the image processing module restores and compensates for distortion of the internal image and the external image.
4. The car image system of claim 1, wherein the image processing module processes distortion, curve, tone scale, contrast or color of the internal image and the external image.
5. The car image system of claim 1, wherein the image processing module is configured to restore a distorted image.
6. The car image system of claim 1, wherein the behavior recognition processing unit is a three-dimensional (3D) sensor, a laser sensor, or a motion detector.
7. The vehicle imaging system of claim 6, wherein the behavior recognition processing unit is configured to sense the movement of the owner's eyes when the behavior recognition processing unit is the three-dimensional (3D) sensor.
8. The car image system of claim 6, wherein the behavior recognition processing unit is the motion detector, and is capable of detecting the body movement of the car owner.
9. The vehicle imaging system of claim 1, wherein the ultra-wide angle lens is disposed between a vehicle steering wheel and a front windshield.
10. The vehicle image system of claim 1, wherein the behavior recognition processing unit initiates displaying the external image within a visual range of the vehicle owner inside the vehicle.
CN201810870455.7A 2018-08-02 2018-08-02 Automobile image system Active CN108995592B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810870455.7A CN108995592B (en) 2018-08-02 2018-08-02 Automobile image system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810870455.7A CN108995592B (en) 2018-08-02 2018-08-02 Automobile image system

Publications (2)

Publication Number Publication Date
CN108995592A CN108995592A (en) 2018-12-14
CN108995592B true CN108995592B (en) 2021-06-15

Family

ID=64595002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810870455.7A Active CN108995592B (en) 2018-08-02 2018-08-02 Automobile image system

Country Status (1)

Country Link
CN (1) CN108995592B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202183818U (en) * 2011-08-18 2012-04-04 新谊整合科技股份有限公司 Ultra-wide angle camera with intelligent identification function
CN204129798U (en) * 2014-01-15 2015-01-28 柳州华航电器有限公司 A kind of full-view image monitoring and vehicle-running recording system
CN105814886A (en) * 2013-12-16 2016-07-27 索尼公司 Image processing apparatus, image processing method, and program
US9538077B1 (en) * 2013-07-26 2017-01-03 Ambarella, Inc. Surround camera to generate a parking video signal and a recorder video signal from a single sensor
CN206606122U (en) * 2017-02-28 2017-11-03 项益群 Automobile A-column blind area servicing unit
CN107472135A (en) * 2016-06-07 2017-12-15 松下知识产权经营株式会社 Video generation device, image generating method and program
CN107833252A (en) * 2016-09-09 2018-03-23 现代摩比斯株式会社 System and method for the error of correcting camera
CN108216032A (en) * 2016-12-09 2018-06-29 Lg电子株式会社 Vehicle is with looking around monitoring device, vehicle operating control device and vehicle
KR20180083762A (en) * 2017-01-13 2018-07-23 엘지이노텍 주식회사 Apparatus of providing an around view, method thereof and vehicle having the same
CN208842331U (en) * 2018-08-02 2019-05-10 张士文 Vehicle imaging system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2455885B (en) * 2007-12-20 2010-03-17 Ming-Hsiu Wu Rear mirror with automobile driving image record
CN205395941U (en) * 2016-02-24 2016-07-27 深圳市绿地蓝海科技有限公司 Rear -view mirror
KR101949358B1 (en) * 2016-04-04 2019-02-18 엘지전자 주식회사 Apparatus for providing around view and Vehicle including the same

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202183818U (en) * 2011-08-18 2012-04-04 新谊整合科技股份有限公司 Ultra-wide angle camera with intelligent identification function
US9538077B1 (en) * 2013-07-26 2017-01-03 Ambarella, Inc. Surround camera to generate a parking video signal and a recorder video signal from a single sensor
CN105814886A (en) * 2013-12-16 2016-07-27 索尼公司 Image processing apparatus, image processing method, and program
CN204129798U (en) * 2014-01-15 2015-01-28 柳州华航电器有限公司 A kind of full-view image monitoring and vehicle-running recording system
CN107472135A (en) * 2016-06-07 2017-12-15 松下知识产权经营株式会社 Video generation device, image generating method and program
CN107833252A (en) * 2016-09-09 2018-03-23 现代摩比斯株式会社 System and method for the error of correcting camera
CN108216032A (en) * 2016-12-09 2018-06-29 Lg电子株式会社 Vehicle is with looking around monitoring device, vehicle operating control device and vehicle
KR20180083762A (en) * 2017-01-13 2018-07-23 엘지이노텍 주식회사 Apparatus of providing an around view, method thereof and vehicle having the same
CN206606122U (en) * 2017-02-28 2017-11-03 项益群 Automobile A-column blind area servicing unit
CN208842331U (en) * 2018-08-02 2019-05-10 张士文 Vehicle imaging system

Also Published As

Publication number Publication date
CN108995592A (en) 2018-12-14

Similar Documents

Publication Publication Date Title
JP4853389B2 (en) Face image capturing device
KR20170139521A (en) Image processing apparatus and image processing system
JP6537602B2 (en) Head mounted display and head up display
JP4622740B2 (en) Display control device for vehicle
JP2013005234A (en) On-vehicle camera device
JP4552636B2 (en) Driver monitor system and processing method thereof
US10567674B2 (en) Systems and methods for detecting objects in imaging systems
JP2013005234A5 (en)
JP4779780B2 (en) Image display device
JP2016170052A (en) Eye detector and vehicle display system
CN208842331U (en) Vehicle imaging system
CN108995592B (en) Automobile image system
JP2018093427A (en) On-vehicle projection apparatus
JP6857695B2 (en) Rear display device, rear display method, and program
US10455159B2 (en) Imaging setting changing apparatus, imaging system, and imaging setting changing method
US20200027201A1 (en) Augmented reality system and color compensation method thereof
WO2018220993A1 (en) Signal processing device, signal processing method and computer program
TWI622297B (en) Display method capable of simultaneously displaying rear panorama and turning picture when the vehicle turns
US20190100156A1 (en) System and method for controlling a display
WO2017175492A1 (en) Image processing device, image processing method, computer program and electronic apparatus
JP2018101904A (en) Video system for vehicle
JP2018125585A (en) Peripheral situation understanding supporting system
CN110798655A (en) Driving image system for eliminating pillar A blind area of mobile carrier and image processing method thereof
JP2009262881A (en) Display device for vehicle
JP6717330B2 (en) Eye-gaze detecting device, control method of the eye-gaze detecting device, method of detecting corneal reflection image position, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant