CN113645395A - Vehicle-mounted 360-degree panoramic visual camera and application thereof - Google Patents

Vehicle-mounted 360-degree panoramic visual camera and application thereof Download PDF

Info

Publication number
CN113645395A
CN113645395A CN202111212631.6A CN202111212631A CN113645395A CN 113645395 A CN113645395 A CN 113645395A CN 202111212631 A CN202111212631 A CN 202111212631A CN 113645395 A CN113645395 A CN 113645395A
Authority
CN
China
Prior art keywords
camera
vehicle
shell
image
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111212631.6A
Other languages
Chinese (zh)
Inventor
陆鹏
是蓉珠
王宇锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Riying Electronics Co ltd
Original Assignee
Jiangsu Riying Electronics Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Riying Electronics Co ltd filed Critical Jiangsu Riying Electronics Co ltd
Priority to CN202111212631.6A priority Critical patent/CN113645395A/en
Publication of CN113645395A publication Critical patent/CN113645395A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/18Optical objectives specially designed for the purposes specified below with lenses having one or more non-spherical faces, e.g. for reducing geometrical aberration
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B30/00Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • G07C5/0866Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to a vehicle-mounted 360-degree panoramic visible camera and application thereof, wherein the vehicle-mounted 360-degree panoramic visible camera comprises a shell, a double-layer PCB (printed circuit board), a wide-angle optical lens and a rear cover radio frequency coaxial connector; the double-layer PCB is positioned in the shell through a fastener; the shell comprises a front camera shell and a rear camera shell; a sealing ring is arranged between the front camera shell and the rear camera shell, and a wide-angle optical lens electrically connected with the double-layer PCB is mounted on the front camera shell; the rear shell of the camera is connected with a rear cover radio frequency coaxial connector electrically connected with the double-layer PCB; a waterproof sealing ring and a water absorption expansion joint are arranged between the rear cover radio frequency coaxial connector and the camera rear shell; the center of the wide-angle optical lens coincides with the center of an image sensor installed on the double-layer PCB, and the wide-angle optical lens is connected with the front camera shell in a sealing mode. The waterproof effect is good, and the phenomenon that the double-layer PCB cannot shift to influence the use of the camera under the condition of long-term unfixed frequency vibration in a vehicle-mounted environment can be avoided.

Description

Vehicle-mounted 360-degree panoramic visual camera and application thereof
Technical Field
The invention relates to the technical field of auto parts cameras, in particular to a vehicle-mounted 360-degree panoramic visual camera and application thereof.
Background
Along with the development of the society, the living standard of people is improved, the automobile becomes a basic consumer product, and meanwhile, the automobile is developed towards the direction of intellectualization, safety and individualization, wherein in the realization process of the safety, the vehicle-mounted camera and the automobile are more and more closely combined, the video image and the sound of the whole automobile driving process can be recorded at any time, more scientific video and audio basis is provided for traffic accidents and positioning, and guarantee is provided for property and life safety.
At present, most automobiles are provided with a vehicle-mounted recorder, the most important part of the vehicle-mounted recorder is a vehicle-mounted camera, and the factors such as the definition of an image, the irradiation angle range and the like are mainly considered when people select the vehicle-mounted camera. The existing vehicle-mounted camera generally adopts a 120-degree visual angle, the range of an irradiation angle is small, and partial visual field blind areas of the running automobile cannot be shot. The 360-degree panoramic camera is used for monitoring and shooting without blind spots, and is mainly composed of 4 high-sensitivity cameras which are distributed front, back, left and right and are monitored without blind spots in all directions, so that a driver can visually see the position of a vehicle and obstacles around the vehicle when sitting in the vehicle, and can easily control the vehicle to park in the place or pass through a complex road surface, and the occurrence of accidents such as scraping, collision, sinking and the like is effectively reduced.
However, in actual use, it is found that after a vehicle-mounted camera mounted on a vehicle runs on the vehicle for a period of time, the image is jittered, blurred, inclined or has no image, so that a driver cannot look over a blind area through the camera or cannot use the camera to take pictures. After the inventor conducts a plurality of tests, the reason is found to be caused by that the wide-angle optical lens of the camera and the focusing of the image sensor are deviated due to vibration generated in the process of long-time running of a vehicle, and the reason for causing the deviation is caused by that when the camera is assembled, a certain gap exists between an internal circuit board and a shell, so that the circuit board and the shell are loosened and deviated in the process of vibration or shaking in field time. In addition, in the camera assembly process, because the internal circuit board structure is single, too high assembly error often appears, and then influences camera quality.
In addition, 360 degree panoramic camera generally constitutes sealed casing by preceding shell and backshell built-up connection, and preceding shell front end installation wide angle optical lens sets up the camera circuit board in the sealed casing, and the wide angle optical lens rear end stretches into in the sealed casing and is connected with the camera circuit board electricity, and the pencil adopts the screw thread precession mode to be connected at the backshell rear end, and sealed then adopts pencil and the inside mode of beating glue of backshell to realize sealed effect mode. This kind of mode pencil need be screwed into the backshell, and work load is big, and production efficiency is low to sealed adopting glue to seal, the problem that glue is ageing, sealed inefficacy appears easily for a long time, thereby leads to the inside water intake of camera, damages circuit board and camera.
Disclosure of Invention
The invention aims to overcome the defects in the prior art and provides a vehicle-mounted 360-degree panoramic visual camera which is simple to assemble, good in waterproofness, capable of expanding the visual field and reducing the splicing calculation amount and application thereof.
The technical scheme for realizing the purpose of the invention is as follows: a vehicle-mounted 360-degree panoramic visual camera comprises a shell, a double-layer PCB, a wide-angle optical lens and a rear cover radio frequency coaxial connector; the double-layer PCB is positioned in the shell through a fastener; the shell comprises a front camera shell and a rear camera shell; a sealing ring is arranged between the front camera shell and the rear camera shell, and a wide-angle optical lens electrically connected with the double-layer PCB is mounted on the front camera shell; the camera rear shell is connected with a rear cover radio frequency coaxial connector electrically connected with the double-layer PCB; a waterproof sealing ring and a water absorption expansion joint are arranged between the rear cover radio frequency coaxial connector and the camera rear shell; the center of wide angle optical lens coincides with the center of installing the image sensor on the double-deck PCB board, and wide angle optical lens and camera procapsid sealing connection.
In the technical scheme, the wide-angle optical lens is connected with an image signal processing system; the image signal processing system is connected with the rear cover radio frequency coaxial connector through an interface circuit, and the image signal processing system is connected with the interface circuit through a serial bus.
The image signal processing system in the technical scheme comprises a 2.4MHz crystal oscillator circuit and a memory chip which are in communication connection with an image sensor; the memory chip is connected with the image sensor through a full-duplex synchronous serial bus.
The wide-angle optical lens comprises a lens barrel and N lenses which are arranged in the lens barrel and coaxially arranged in sequence along an optical axis; the front N-1 lenses are arranged at a fine interval from each other, and the rear surface of the N-1 lens and the front surface of the N lens are glued with each other.
In the technical scheme, the lens comprises 6 lenses, the first lens has positive refractive index, the object side surface of the first lens is a convex surface, and the image side surface of the first lens is a concave surface; the second lens element with negative refractive index has a convex object-side surface and a concave image-side surface; the third lens element with positive refractive index and concave image-side surface; the fourth lens element with negative refractive index has a concave object-side surface and a convex image-side surface; the fifth lens element with positive refractive index has a convex object-side surface and a concave image-side surface; the sixth lens element with negative refractive index has a convex object-side surface and a concave image-side surface, and one of the surfaces is aspheric; gaps are arranged between every two adjacent lenses; the field of view FOV of the optical lens system satisfies the following conditional expression: 45 < FOV < 50.
The application waveband range of the optical lens group in the technical scheme is 800nm to 1000 nm.
The dispersion coefficient of the lens in the technical scheme meets the following requirements: v1+ V2+ V6 is less than or equal to 120.000; EFL Fno/D11t22 is not less than 11.500, wherein V1 is an abbe number of the first lens element, V2 is an abbe number of the second lens element, V6 is an abbe number of the sixth lens element, EFL is an effective focal length of the optical lens assembly, Fno is an aperture value of the optical lens assembly, and D11t22 is a distance from an object side surface of the first lens element to an image side surface of the second lens element on the optical axis.
The effective focal length of each lens in the above technical scheme is that EFL/BFL is greater than or equal to 3.800, where EFL is the effective focal length of the optical lens group, and BFL is the distance from the image side surface of the optical axis position of the sixth lens to the imaging surface.
According to the technical scheme, the connecting position of the front camera shell and the rear camera shell is matched with the groove through the convex ring or the connecting position of the front camera shell and the rear camera shell after splicing forms the groove for placing the waterproof ring.
According to the technical scheme, the inner cavities of the camera rear shell and the camera front shell are used for positioning the double-layer PCB through the stand column and the elastic piece, and the rubber pad is sleeved on the fastener connected with the double-layer PCB.
According to the technical scheme, the rear cover radio frequency coaxial connector comprises a socket and a plug which are elastically inserted with each other; the plug has a metal shell, a dielectric tube and a center contact; the dielectric tube is inserted in the metal shell, and a central contact element is arranged on the central axis of the dielectric tube; the socket includes a center probe, a dielectric, an outer conductor, and an insulating sheath; a dielectric layer is arranged between the central probe and the outer conductor, and the central probe is connected with the end contact spring of the central contact element; the insulating sheath is wrapped over the outer conductor.
According to the technical scheme, the circumferential surface of the central contact element is coated with a conductive metal plate; the conductive metal plate is arranged in a cylindrical shape, and an opening is formed in the joint of the conductive metal plate.
Above-mentioned technical scheme the sealing washer is arranged in the camera procapsid and the camera after the casing cavity that the amalgamation formed between the two, and have on the sealing washer with camera after the breach assorted joint spare on the casing.
An automobile comprises the vehicle-mounted 360-degree panoramic visible camera; the vehicle-mounted 360-degree panoramic visual camera is provided with four cameras, and is respectively arranged on the front reflector, the rear reflector, the left reflector and the right reflector of the automobile, and the vehicle-mounted 360-degree panoramic visual camera is in communication connection with a panoramic image processing system arranged in the automobile through an LVDS serializer; the panoramic image processing system is connected to the panoramic video display host through the video input interface.
A method for splicing three-dimensional panoramic images based on the vehicle-mounted 360-degree panoramic visual camera comprises the following steps:
lens correction, namely determining the assembly position of a camera, detecting whether the camera is assembled in place or not, and acquiring the view data of the lens and data related to the calibration of the whole camera on the tail surface of the vehicle; performing data simulation on the acquired data to determine the assembly position of the camera and confirm the image display proportion;
the aerial view conversion is carried out, a plurality of images at the current moment collected by the vehicle-mounted 360-degree panoramic visual camera are obtained, virtual light is projected to the edge of a semantically segmented ground truth value BEV image from the installation position of the virtual light, then a neural network is constructed, a transformation matrix is obtained through learning, all pixels along the rays are processed, and meanwhile, the shielding state is judged for shielding processing; then projection preprocessing is carried out, and a binary area corresponding to each all-round looking camera is projected to a vehicle coordinate system to obtain a 360-degree aerial view around the vehicle;
four-side image stitching, namely four-way video stitching and stitching based on a unified coordinate system and a high-performance nonlinear mapping interpolation algorithm;
correcting the brightness contrast, acquiring brightness parameters of the images to be spliced, and adjusting the brightness if the brightness difference value of each image exceeds a preset threshold value so that the brightness difference value of each image is not greater than the preset threshold value; generating a brightness mapping table through the adjusted brightness parameter value and the mixing factor;
and finally, carrying out projection transformation on the coordinates to generate a real-time automobile top view.
A method for calibrating and pre-displaying a trajectory line of an automobile comprises the following steps:
acquiring an image of obstacles around the automobile;
generating a vehicle kinematic steering model by calculating a corner, a wheelbase, a wheel base, a vehicle length and a vehicle width;
determining a corresponding turning radius according to a rotation angle of a steering wheel driving a steering column, which is detected by an angle sensor, sending steering wheel turning angle information acquired from a bus into the model, and drawing a overlooking predicted track; the angle sensor is connected with the panoramic image processing system;
the overlooking predicted trajectory is transformed through perspective projection to generate a final front and back vision parking trajectory;
and superposing the front-back view parking track and the obstacle image to obtain a pre-driving image.
After the technical scheme is adopted, the invention has the following positive effects:
(1) the waterproof effect of the invention is better, in the using process, the camera is not easy to enter water, the assembly is simple, the production efficiency is improved, and meanwhile, the phenomenon that the double-layer PCB can not shift to influence the use of the camera under the condition of long-term unfixed frequency vibration in the vehicle-mounted environment can be avoided.
(2) When the invention is arranged on a vehicle, when the vehicle runs in a narrow lane with obstacles on the left and right sides in front or a parking lot with a narrow parking space, the invention can quickly and accurately find the situation that the nearby vehicle is difficult to be observed, thereby realizing accurate driving control, and particularly improving the driving safety and reducing unnecessary scraping for a new driver.
(3) The invention has the optical characteristics of small size, short total length of the lens and high resolution, greatly reduces the distortion of wide-angle images, can effectively correct aberration, has wide application range and realizes light weight.
Drawings
In order that the present disclosure may be more readily and clearly understood, reference is now made to the following detailed description of the present disclosure taken in conjunction with the accompanying drawings, in which
FIG. 1 is a schematic structural diagram of a vehicle-mounted 360-degree panoramic visual camera of the invention;
FIG. 2 is an exploded schematic view of the vehicle-mounted 360 panoramic visual camera of the present invention;
FIG. 3 is a schematic view of a rear cover radio frequency coaxial connector of the vehicle-mounted 360 panoramic visual camera of the present invention;
FIG. 4 is a schematic block diagram of a vehicle-mounted 360 panoramic visual camera of the present invention;
FIG. 5 is a schematic block diagram of embodiment 2 of the present invention;
FIG. 6 is an installation diagram of embodiment 2 of the present invention;
FIG. 7 is a schematic view of embodiment 4 of the present invention;
FIG. 8 is a schematic view of example 3 of the present invention;
FIG. 9 is a schematic view of a back cover RF coaxial connector of the present invention;
FIG. 10 is a perspective view of the RF coaxial connector of the back cover of the present invention;
fig. 11 is a partial cross-sectional view of a back cover rf coaxial connector of the present invention.
Detailed Description
(example 1)
Referring to fig. 1 to 4, a vehicle-mounted 360-degree panoramic visual camera comprises a shell, a double-layer PCB (printed circuit board) 1, a wide-angle optical lens 2 and a rear cover radio frequency coaxial connector 3; the double-layer PCB board 1 is positioned in the shell through a fastener; the shell comprises a front camera shell 4 and a rear camera shell 5; a sealing ring 6 is arranged between the front camera shell 4 and the rear camera shell 5, and the front camera shell 4 is provided with a wide-angle optical lens 2 electrically connected with the double-layer PCB 1; the camera rear shell 5 is connected with a rear cover radio frequency coaxial connector 3 electrically connected with the double-layer PCB 1; a waterproof sealing ring 7 and a water absorption expansion joint 8 are arranged between the rear cover radio frequency coaxial connector 3 and the camera rear shell 5; the center of the wide-angle optical lens 2 coincides with the center of an image sensor mounted on the double-layer PCB 1, and the wide-angle optical lens 2 is hermetically connected with the front camera shell 4. Wherein, sealing washer 6 is arranged in the cavity of amalgamation formation between 5 two behind camera procapsid 4 and the camera, and have on the sealing washer 6 with behind the camera breach assorted joint spare on the casing 5.
The wide-angle optical lens 2 is connected with an image signal processing system; the image signal processing system is connected with the rear cover radio frequency coaxial connector 3 through an interface circuit, and the image signal processing system is connected with the interface circuit through a serial bus.
The image signal processing system comprises a 2.4MHz crystal oscillator circuit and a memory chip which are in communication connection with the image sensor; the memory chip is connected with the image sensor through a full-duplex synchronous serial bus.
The wide-angle optical lens 2 comprises a lens barrel and 6 lenses which are arranged in the lens barrel and coaxially arranged in sequence along an optical axis; the front 5 lenses are arranged at a micro-distance from each other, and the rear surface of the 5 th lens and the front surface of the 6 th lens are glued with each other; the first lens element with positive refractive index has a convex object-side surface and a concave image-side surface; the second lens element with negative refractive index has a convex object-side surface and a concave image-side surface; the third lens element with positive refractive index and concave image-side surface; the fourth lens element with negative refractive index has a concave object-side surface and a convex image-side surface; the fifth lens element with positive refractive index has a convex object-side surface and a concave image-side surface; the sixth lens element with negative refractive index has a convex object-side surface and a concave image-side surface, and one of the surfaces is aspheric; the field of view FOV of the optical lens system satisfies the following conditional expression: 45 < FOV < 50. The use wave band range of the optical lens group is 800nm to 1000 nm.
The dispersion coefficient of the lens satisfies: v1+ V2+ V6 is less than or equal to 120.000; EFL Fno/D11t22 is not less than 11.500, wherein V1 is an abbe number of the first lens element, V2 is an abbe number of the second lens element, V6 is an abbe number of the sixth lens element, EFL is an effective focal length of the optical lens assembly, Fno is an aperture value of the optical lens assembly, and D11t22 is a distance from an object side surface of the first lens element to an image side surface of the second lens element on the optical axis. The effective focal length of each lens is equal to or greater than 3.800, where EFL is the effective focal length of the optical lens group, and BFL is the distance from the image side surface to the image plane at the optical axis position of the sixth lens.
The hookup location of casing 5 behind camera procapsid 4 and the camera forms a recess of placing the waterproof ring through bulge loop and groove cooperation or the hookup location behind 5 amalgamations of casing behind camera procapsid 4 and the camera.
The inner cavities of the camera rear shell 5 and the camera front shell 4 are positioned on the double-layer PCB 1 through the stand column and the elastic piece, and the rubber mat is sleeved on the fastener connected with the double-layer PCB 1.
Referring to fig. 9, 10 and 11, the rear cover rf coaxial connector 3 includes a receptacle 3-1 and a plug 3-2 elastically plugged to each other; the plug 3-2 has a metal shell 3-5, a dielectric tube 3-3 and a center contact 3-4; the dielectric tube 3-3 is inserted in the metal shell 3-5, and the central axis of the dielectric tube 3-3 is provided with a central contact element 3-4; the socket 3-1 comprises a center probe 3-6, a dielectric 3-7, an outer conductor 3-9 and an insulating sheath; a dielectric medium 3-7 is arranged between the center probe 3-6 and the outer conductor, and the center probe 3-6 is connected with the end contact spring 3-8 of the center contact piece 3-4; the insulating sheath is coated on the outer conductors 3-9; the circumferential surface of the central contact element 3-4 is coated with a conductive metal plate; the conductive metal plate is arranged in a cylindrical shape, and the joint of the conductive metal plate is provided with an opening, so that the center contact piece 3-4 is shielded from the outside, and the entry of useless radiation and noise can be prevented.
(example 2)
Referring to fig. 5 and 6, an automobile comprises the vehicle-mounted 360 ° panoramic visual camera; the vehicle-mounted 360-degree panoramic visual camera is provided with four cameras, and is respectively arranged on the front reflector, the rear reflector, the left reflector and the right reflector of the automobile, and the vehicle-mounted 360-degree panoramic visual camera is in communication connection with a panoramic image processing system arranged in the automobile through an LVDS (Low Voltage differential signaling) serializer; the panoramic image processing system is connected to the panoramic video display host through the video input interface.
(example 3)
Referring to fig. 8, a method for stitching a stereoscopic panoramic image based on the vehicle-mounted 360 ° panoramic visual camera includes:
lens correction, namely determining the assembly position of a camera, detecting whether the camera is assembled in place or not, and acquiring the view data of the lens and data related to the calibration of the whole camera on the tail surface of the vehicle; performing data simulation on the acquired data to determine the assembly position of the camera and confirm the image display proportion;
the method comprises the steps of aerial view conversion, obtaining images of a plurality of vehicle-mounted 360-degree panoramic visual cameras at the current moment, projecting virtual light rays to the edge of a semantically segmented ground truth-value BEV image from the mounting position of the images, then constructing a neural network, learning to obtain a transformation matrix, processing all pixels along rays, and judging the shielding state to perform shielding processing; then projection preprocessing is carried out, and a binary area corresponding to each all-round looking camera is projected to a vehicle coordinate system to obtain a 360-degree aerial view around the vehicle;
stitching four-side images, namely stitching and stitching images D1, D2, D3 and D4 of four paths of videos based on a unified coordinate system and a high-performance nonlinear mapping interpolation algorithm;
correcting the brightness contrast, acquiring brightness parameters of the images to be spliced, and adjusting the brightness if the brightness difference value of each image exceeds a preset threshold value so that the brightness difference value of each image is not greater than the preset threshold value; generating a brightness mapping table through the adjusted brightness parameter value and the mixing factor;
and finally, carrying out projection transformation on the coordinates to generate a real-time automobile top view.
(example 4)
Referring to fig. 7, a method for calibrating and pre-displaying a trajectory line of an automobile includes the following steps:
acquiring an image of obstacles around the automobile;
generating a vehicle kinematic steering model by calculating a corner, a wheelbase, a wheel base, a vehicle length and a vehicle width;
determining a corresponding turning radius according to a rotation angle of a steering wheel driving a steering column, which is detected by an angle sensor, sending steering wheel turning angle information acquired from a bus into the model, and drawing a overlooking predicted track; the angle sensor is connected with the panoramic image processing system;
the overlooking predicted trajectory is transformed through perspective projection to generate a final front and back vision parking trajectory;
and superposing the front-back view parking track and the obstacle image to obtain a pre-driving image.
The vertical reference exemplified in the figure forms a virtual line road which covers the real road behind the vehicle and assists in planning a reversing route; the area formed by the horizontal limiting reference, the horizontal reference and the two vertical references is a safety area for driving the automobile; the dynamic reference is two backing curves which rotate along with the rotation of the steering wheel, and the backing track can be accurately traced; an area formed by the distance reference, the horizontal reference and the two vertical references is a warning area; the distance between the vehicle rear wheel and the warning line of the reversing image is I, the distance between the vehicle rear wheel and the horizontal datum line is II, the distance between the vehicle rear wheel and the horizontal limiting datum is III, the vertical distance between the vehicle body and the vertical datum is IV, namely the visual field distance, the safety distance is V, the rotation angle is VI, and the distance between two reversing curves is VII.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (16)

1. A vehicle-mounted 360-degree panoramic visual camera comprises a shell, a double-layer PCB, a wide-angle optical lens and a rear cover radio frequency coaxial connector; the double-layer PCB is positioned in the shell through a fastener; the shell comprises a front camera shell and a rear camera shell; a sealing ring is arranged between the front camera shell and the rear camera shell, and a wide-angle optical lens electrically connected with the double-layer PCB is mounted on the front camera shell; the camera rear shell is connected with a rear cover radio frequency coaxial connector electrically connected with the double-layer PCB; the method is characterized in that: a waterproof sealing ring and a water absorption expansion joint are arranged between the rear cover radio frequency coaxial connector and the camera rear shell; the center of wide angle optical lens coincides with the center of installing the image sensor on the double-deck PCB board, and wide angle optical lens and camera procapsid sealing connection.
2. The vehicle-mounted 360-degree panoramic visual camera according to claim 1, characterized in that: the wide-angle optical lens is connected with the image signal processing system; the image signal processing system is connected with the rear cover radio frequency coaxial connector through an interface circuit, and the image signal processing system is connected with the interface circuit through a serial bus.
3. The vehicle-mounted 360-degree panoramic visual camera according to claim 2, characterized in that: the image signal processing system comprises a 2.4MHz crystal oscillator circuit and a storage chip which are in communication connection with the image sensor; the memory chip is connected with the image sensor through a full-duplex synchronous serial bus.
4. The vehicle-mounted 360-degree panoramic visual camera according to claim 2, characterized in that: the wide-angle optical lens comprises a lens barrel and N lenses which are arranged in the lens barrel and coaxially arranged in sequence along an optical axis; the front N-1 lenses are arranged at a fine interval from each other, and the rear surface of the N-1 lens and the front surface of the N lens are glued with each other.
5. The vehicle-mounted 360-degree panoramic visual camera according to claim 4, characterized in that: the lens comprises 6 lenses, the first lens has positive refractive index, the object side surface of the first lens is a convex surface, and the image side surface of the first lens is a concave surface; the second lens element with negative refractive index has a convex object-side surface and a concave image-side surface; the third lens element with positive refractive index and concave image-side surface; the fourth lens element with negative refractive index has a concave object-side surface and a convex image-side surface; the fifth lens element with positive refractive index has a convex object-side surface and a concave image-side surface; the sixth lens element with negative refractive index has a convex object-side surface and a concave image-side surface, and one of the surfaces is aspheric; the field of view FOV of the optical lens system satisfies the following conditional expression: 45 < FOV < 50.
6. The vehicle-mounted 360-degree panoramic visual camera according to claim 5, characterized in that: the use wave band range of the optical lens group is 800nm to 1000 nm.
7. The vehicle-mounted 360-degree panoramic visual camera according to claim 5, characterized in that: the dispersion coefficient of the lens satisfies: v1+ V2+ V6 is less than or equal to 120.000; EFL Fno/D11t22 is not less than 11.500, wherein V1 is an abbe number of the first lens element, V2 is an abbe number of the second lens element, V6 is an abbe number of the sixth lens element, EFL is an effective focal length of the optical lens assembly, Fno is an aperture value of the optical lens assembly, and D11t22 is a distance from an object side surface of the first lens element to an image side surface of the second lens element on the optical axis.
8. The vehicle-mounted 360-degree panoramic visual camera according to claim 5, characterized in that: the effective focal length of each lens is equal to or greater than 3.800, where EFL is the effective focal length of the optical lens group, and BFL is the distance from the image side surface to the image plane at the optical axis position of the sixth lens.
9. The vehicle-mounted 360-degree panoramic visible camera according to claim 1, 2 or 3, characterized in that: the connecting position of the camera front shell and the camera rear shell is matched with the groove through a convex ring or the connecting position of the camera front shell and the camera rear shell after splicing forms a groove for placing a waterproof ring.
10. The vehicle-mounted 360-degree panoramic visual camera according to claim 6, characterized in that: the camera back shell and the camera front shell inner cavity are positioned on the double-layer PCB through the stand column and the elastic piece, and the rubber mat is sleeved on the fastener connected with the double-layer PCB.
11. The vehicle-mounted 360-degree panoramic visual camera according to claim 6, characterized in that: the rear cover radio frequency coaxial connector comprises a socket and a plug which are elastically inserted with each other; the plug has a metal shell, a dielectric tube and a center contact; the dielectric tube is inserted in the metal shell, and a central contact element is arranged on the central axis of the dielectric tube; the socket includes a center probe, a dielectric, an outer conductor, and an insulating sheath; a dielectric layer is arranged between the central probe and the outer conductor, and the central probe is connected with the end contact spring of the central contact element; the insulating sheath is wrapped over the outer conductor.
12. The vehicle-mounted 360 ° panoramic visual camera according to claim 11, characterized in that: the circumferential surface of the central contact element is coated with a conductive metal plate; the conductive metal plate is arranged in a cylindrical shape, and an opening is formed in the joint of the conductive metal plate.
13. The vehicle-mounted 360-degree panoramic visible camera according to claim 1, 2, 3 or 4, characterized in that: the sealing washer is arranged in the camera procapsid and the camera after the casing in the cavity that the amalgamation formed between the two, and have on the sealing washer with camera after the breach assorted joint spare on the casing.
14. An automobile, characterized in that: comprising an onboard 360 ° panoramic visual camera according to claims 1-13; the vehicle-mounted 360-degree panoramic visual camera is provided with four cameras, and is respectively arranged on the front reflector, the rear reflector, the left reflector and the right reflector of the automobile, and the vehicle-mounted 360-degree panoramic visual camera is in communication connection with a panoramic image processing system arranged in the automobile through an LVDS serializer; the panoramic image processing system is connected to the panoramic video display host through the video input interface.
15. The method for splicing the stereoscopic panoramic images of the vehicle-mounted 360-degree panoramic visual camera based on the claims 1 to 13 is characterized by comprising the following steps:
lens correction, namely determining the assembly position of a camera, detecting whether the camera is assembled in place or not, and acquiring the view data of the lens and data related to the calibration of the whole camera on the tail surface of the vehicle; performing data simulation on the acquired data to determine the assembly position of the camera and confirm the image display proportion;
the aerial view conversion is carried out, a plurality of images at the current moment collected by the vehicle-mounted 360-degree panoramic visual camera are obtained, virtual light is projected to the edge of a semantically segmented ground truth value BEV image from the installation position of the virtual light, then a neural network is constructed, a transformation matrix is obtained through learning, all pixels along the rays are processed, and meanwhile, the shielding state is judged for shielding processing; then projection preprocessing is carried out, and a binary area corresponding to each all-round looking camera is projected to a vehicle coordinate system to obtain a 360-degree aerial view around the vehicle;
four-side image stitching, namely four-way video stitching and stitching based on a unified coordinate system and a high-performance nonlinear mapping interpolation algorithm;
correcting the brightness contrast, acquiring brightness parameters of the images to be spliced, and adjusting the brightness if the brightness difference value of each image exceeds a preset threshold value so that the brightness difference value of each image is not greater than the preset threshold value; generating a brightness mapping table through the adjusted brightness parameter value and the mixing factor;
and finally, carrying out projection transformation on the coordinates to generate a real-time automobile top view.
16. A trace line calibration pre-display method for an automobile according to claim 14, characterized in that: the method comprises the following steps:
acquiring an image of obstacles around the automobile;
generating a vehicle kinematic steering model by calculating a corner, a wheelbase, a wheel base, a vehicle length and a vehicle width;
determining a corresponding turning radius according to a rotation angle of a steering wheel driving a steering column, which is detected by an angle sensor, sending steering wheel turning angle information acquired from a bus into the model, and drawing a overlooking predicted track; the angle sensor is connected with the panoramic image processing system;
the overlooking predicted trajectory is transformed through perspective projection to generate a final front and back vision parking trajectory;
and superposing the front-back view parking track and the obstacle image to obtain a pre-driving image.
CN202111212631.6A 2021-10-19 2021-10-19 Vehicle-mounted 360-degree panoramic visual camera and application thereof Pending CN113645395A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111212631.6A CN113645395A (en) 2021-10-19 2021-10-19 Vehicle-mounted 360-degree panoramic visual camera and application thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111212631.6A CN113645395A (en) 2021-10-19 2021-10-19 Vehicle-mounted 360-degree panoramic visual camera and application thereof

Publications (1)

Publication Number Publication Date
CN113645395A true CN113645395A (en) 2021-11-12

Family

ID=78427342

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111212631.6A Pending CN113645395A (en) 2021-10-19 2021-10-19 Vehicle-mounted 360-degree panoramic visual camera and application thereof

Country Status (1)

Country Link
CN (1) CN113645395A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598822A (en) * 2022-03-02 2022-06-07 上海赫千电子科技有限公司 Vehicle-mounted Ethernet all-around system with ESD interference resistance

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101316010A (en) * 2008-05-30 2008-12-03 雷科通技术(杭州)有限公司 Communication appliance connector and connecting device
CN102903086A (en) * 2012-10-17 2013-01-30 北京经纬恒润科技有限公司 Brightness adjustment method and device of image to be spliced
CN103185543A (en) * 2011-12-31 2013-07-03 上海汽车集团股份有限公司 Calibration method and system of vehicle-mounted camera
CN103810686A (en) * 2014-02-27 2014-05-21 苏州大学 Seamless splicing panorama assisting driving system and method
CN106654691A (en) * 2015-10-28 2017-05-10 电连技术股份有限公司 Connection device and cable assembly thereof
CN206212128U (en) * 2016-11-09 2017-05-31 比亚迪股份有限公司 Vehicle-mounted digital high-definition camera
US20180191954A1 (en) * 2017-01-04 2018-07-05 Texas Instruments Incorporated Rear-Stitched View Panorama for Rear-View Visualization
CN108621948A (en) * 2018-06-26 2018-10-09 杭州车厘子智能科技有限公司 Vehicle panoramic viewing system and panoramic looking-around image generating method
CN108701948A (en) * 2016-02-01 2018-10-23 德尔福技术有限公司 Right angle coaxial electric coupler and verify its assembling whether appropriate method
CN109246416A (en) * 2018-09-21 2019-01-18 福州大学 The panorama mosaic method of vehicle-mounted six road camera
KR20190070389A (en) * 2017-12-12 2019-06-21 (주)토핀스 Day and Night Imaging System with Panoramic Imaging Equipment
CN210274240U (en) * 2019-09-09 2020-04-07 浙江沃得尔科技股份有限公司 Vehicle-mounted camera module structure
CN112083555A (en) * 2020-09-24 2020-12-15 玉晶光电(厦门)有限公司 Optical lens group

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101316010A (en) * 2008-05-30 2008-12-03 雷科通技术(杭州)有限公司 Communication appliance connector and connecting device
CN103185543A (en) * 2011-12-31 2013-07-03 上海汽车集团股份有限公司 Calibration method and system of vehicle-mounted camera
CN102903086A (en) * 2012-10-17 2013-01-30 北京经纬恒润科技有限公司 Brightness adjustment method and device of image to be spliced
CN103810686A (en) * 2014-02-27 2014-05-21 苏州大学 Seamless splicing panorama assisting driving system and method
CN106654691A (en) * 2015-10-28 2017-05-10 电连技术股份有限公司 Connection device and cable assembly thereof
CN108701948A (en) * 2016-02-01 2018-10-23 德尔福技术有限公司 Right angle coaxial electric coupler and verify its assembling whether appropriate method
CN206212128U (en) * 2016-11-09 2017-05-31 比亚迪股份有限公司 Vehicle-mounted digital high-definition camera
US20180191954A1 (en) * 2017-01-04 2018-07-05 Texas Instruments Incorporated Rear-Stitched View Panorama for Rear-View Visualization
KR20190070389A (en) * 2017-12-12 2019-06-21 (주)토핀스 Day and Night Imaging System with Panoramic Imaging Equipment
CN108621948A (en) * 2018-06-26 2018-10-09 杭州车厘子智能科技有限公司 Vehicle panoramic viewing system and panoramic looking-around image generating method
CN109246416A (en) * 2018-09-21 2019-01-18 福州大学 The panorama mosaic method of vehicle-mounted six road camera
CN210274240U (en) * 2019-09-09 2020-04-07 浙江沃得尔科技股份有限公司 Vehicle-mounted camera module structure
CN112083555A (en) * 2020-09-24 2020-12-15 玉晶光电(厦门)有限公司 Optical lens group

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
刘冬等: "3D车载环视全景生成方法", 《计算机科学》 *
行者有其道: "《https://blog.csdn.net/weixin_55366265/article/details/120663102》", 7 October 2021 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598822A (en) * 2022-03-02 2022-06-07 上海赫千电子科技有限公司 Vehicle-mounted Ethernet all-around system with ESD interference resistance
CN114598822B (en) * 2022-03-02 2024-05-31 上海赫千电子科技有限公司 On-vehicle ethernet system of looking around with anti ESD interferes with

Similar Documents

Publication Publication Date Title
US11726292B2 (en) Optical system
CN101088027B (en) Stereo camera for a motor vehicle
CN110853185A (en) Vehicle panoramic all-round looking recording system and method
CN109993060A (en) The vehicle omnidirectional obstacle detection method of depth camera
CN210234807U (en) Trailer 360-degree all-round looking system
CN110363085B (en) Method for realizing looking around of heavy articulated vehicle based on articulation angle compensation
US11789454B2 (en) Movable carrier auxiliary system and parking controlling method thereof
CN113645395A (en) Vehicle-mounted 360-degree panoramic visual camera and application thereof
US20230159022A1 (en) Movable carrier auxiliary system and parking auxiliarymethod thereof
CN116778448A (en) Vehicle safe driving assistance method, device, system, equipment and storage medium
CN113491106B (en) Camera module installation method and mobile platform
CN219574949U (en) Intelligent traffic perception integrated device based on binocular depth fusion of thunder and sound
CN116215520A (en) Vehicle collision early warning and processing method and device based on ultrasonic waves and 3D looking around
CN206336204U (en) Automobile infrared viewing device
CN111861891A (en) Method for realizing panoramic image system picture splicing display based on checkerboard calibration
CN113436134A (en) Visibility measuring method of panoramic camera and panoramic camera applying same
CN111824019B (en) Vehicle-mounted 3D panoramic all-around viewing system
CN114598822B (en) On-vehicle ethernet system of looking around with anti ESD interferes with
CN112308987A (en) Vehicle-mounted image splicing method, system and device
CN210670271U (en) Wifi visual image device
CN211656267U (en) Three proofings detector with infrared light filling function
CN210070960U (en) Vehicle with a steering wheel
CN219039781U (en) Vehicle-mounted panoramic double-spectrum vision enhancement system
CN221351838U (en) Vehicle-mounted front view lens for safe driving recording function
CN108111726A (en) For the medium and long distance on-vehicle lens device and control system of vehicle target identification

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20211112