CN112261309A - Shooting method and system based on IMS camera and DMS camera - Google Patents
Shooting method and system based on IMS camera and DMS camera Download PDFInfo
- Publication number
- CN112261309A CN112261309A CN202011139626.2A CN202011139626A CN112261309A CN 112261309 A CN112261309 A CN 112261309A CN 202011139626 A CN202011139626 A CN 202011139626A CN 112261309 A CN112261309 A CN 112261309A
- Authority
- CN
- China
- Prior art keywords
- camera
- ims
- dms
- shooting
- exposure time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/72—Combination of two or more compensation controls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a shooting method and a shooting system based on an IMS camera and a DMS camera, wherein the IMS camera is a rolling shutter, the DMS camera comprises an infrared light supplement lamp, the infrared light supplement lamp is used for supplementing light to a shooting area of the DMS camera, the shooting area of the IMS camera and the shooting area of the DMS camera partially coincide with each other, and the shooting method comprises the following steps: setting the IMS camera and the DMS camera to be at the same shooting frame rate; and exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, wherein the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the blank invalid line exposure time of the IMS camera comprise overlapping time. The images shot by the IMS camera and the DMS camera are more fidelity, the service life of the equipment is long, and the maintenance cost is low.
Description
Technical Field
The invention relates to a shooting method and a shooting system based on an IMS camera and a DMS camera.
Background
At present, the network car reservation market is rising, and the service quality and the driving safety become core competitiveness. The safety problem is always the most concerned problem of the network car reservation, in order to ensure the safety of passengers, a vehicle satellite positioning device and an emergency alarm device with a driving recording function are installed on the network car reservation, and the technical performance of the vehicle meets the relevant standard requirements of operation safety. Meanwhile, a plurality of provisions are also put forward on the information security protection. The automobile data recorder can record the conditions inside and outside the automobile during driving, and can protect the automobile owner or passengers in the automobile while recording road conditions. Compared with the conventional multi-camera automobile data recorder on the market, the multi-camera automobile data recorder has the advantages that mutual imaging is not influenced, the image quality is clear, and the algorithm recognition degree is high.
When an automobile engine is started, the automobile data recorder is started, the cameras on all paths are started to work, and the two shooting areas are overlapped due to the installation angles of the IMS camera and the DMS camera. The DMS is a fatigue driving camera, a shooting area is a driver mainly driving, and the driver cannot be supplemented with light by a common lamp during night driving, so that the normal driving sight of the driver is influenced, and therefore infrared lamps are adopted in the market for supplementing light. Due to the limitation of the installation position and angle, the infrared light supplement lamp will certainly interfere with the normal imaging of some 650nm cameras.
The existing shooting system based on the IMS camera and the DMS camera has the following defects:
due to the limitation of the installation position and the angle, the shooting areas of the two lenses are overlapped. The infrared lamp of the DMS camera is normally on, so that when the IMS camera produces a color image, the phenomena of color cast distortion and purple color stripes appear, and the color of a scene cannot be normally restored. The precaution reminding is not in place, so that the safety information of a driver and passengers cannot be normally and effectively identified, and the follow-up safety accidents cannot be effectively proved.
In addition, the DMS camera is basically normally on, overheating can be caused after long-time operation, light attenuation of an infrared lamp is large, and the service life can be greatly reduced.
Disclosure of Invention
The invention aims to overcome the defects that an IMS camera and a DMS camera based shooting system in the prior art are distorted in an IMS shooting image and short in service life and high in maintenance cost of the DMS camera, and provides an IMS camera and DMS camera based shooting method and system which are more fidelity in image, long in service life of equipment and low in maintenance cost.
The invention solves the technical problems through the following technical scheme:
a shooting method based on an IMS camera and a DMS camera is used for a shooting system, the shooting system comprises the IMS camera and the DMS camera, and the shooting method is characterized in that the IMS camera is a rolling shutter, the DMS camera is a global shutter, the DMS camera comprises an infrared light supplement lamp, the infrared light supplement lamp is used for supplementing light for a shooting area of the DMS camera, the shooting area of the IMS camera and the shooting area of the DMS camera partially coincide, and the shooting method comprises the following steps:
setting the IMS camera and the DMS camera to be at the same shooting frame rate;
and exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, wherein the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the exposure time of the blank invalid line of the IMS camera comprise overlapping time.
The IMS camera is used for monitoring in the vehicle, has a wide angle and monitors the condition of the rear row in the vehicle; the DMS fatigue driving early warning system only aims at detection of drivers, fatigue driving, smoking, making calls and playing mobile phones, and some bad driving habits and identity recognition. The two areas overlap
Preferably, the photographing method includes:
respectively adjusting firmware parameters of the IMS camera and the DMS camera to enable the IMS camera and the DMS camera to be set to be at the same shooting frame rate;
and adjusting the IMS camera to reduce the single-line exposure time of an image sensor of the IMS camera and increase the frame length of the IMS camera.
Preferably, the photographing method includes:
and acquiring the effective line exposure time of the IMS camera and the exposure time of the DMS camera according to the difference value of the single line exposure time lengths before and after adjustment and the period.
Preferably, the photographing method includes:
and acquiring the exposure time of the DMS camera in one period according to the exposure time of the effective row and the exposure time of the DMS camera.
Preferably, the image sensor of the IMS camera includes a first signal pin, the image sensor of the DMS camera includes a second signal pin and a third signal pin, and the photographing method includes:
the IMS camera transmits a frame synchronization signal to the second signal pin through the first signal pin;
the image sensor of the DMS camera generates a control signal according to the received frame synchronization signal;
and the DMS camera sends the control signal to the infrared light supplement lamp through a third signal pin so as to synchronize the light supplement of the infrared light supplement lamp with the exposure of the DMS camera.
Preferably, the first signal pin is a VSYNC pin, the second signal pin is an ILPWM pin, the third signal pin is a STORBE pin, the shooting system comprises a first level conversion circuit and a second level conversion circuit, the first level shift circuit comprises a first resistor, a second resistor and a first MOS transistor, the second level shift circuit comprises a third resistor, a fourth resistor and a second MOS transistor, the G pole of the first MOS tube is connected with the first signal pin through a first resistor, the S pole is grounded, the D pole is respectively connected with a second resistor and an output pin, the output pin transmits the frame synchronization signal to an input pin of an image sensor of the DMS camera through a wire, and the G pole of the second MOS tube is connected with the input pin through a third resistor, the S pole of the second MOS tube is grounded, and the D pole of the second MOS tube is respectively connected with a fourth resistor and a second signal pin.
Preferably, the IMS camera includes a light sensor, and the photographing method includes:
the light intensity of the shooting system is collected through the light sensor, and when the light intensity is larger than a preset value, the IMS camera collects images and outputs color images.
Preferably, the photographing method includes:
judging whether the current light intensity is greater than a preset value, if so, exposing the IMS camera and the DMS camera on a calibration plate according to a preset rule in one period of the shooting frame rate;
identifying a frame of image acquired by an IMS camera, and identifying the bottom of the image;
judging whether an image with a preset color exists at the bottom, if so, acquiring the line number of an image sensor for shooting the image according to the height of the image;
and calculating the frame length of the IMS camera according to the line number, thereby adjusting the single-line exposure time of the image sensor of the IMS camera.
The invention also provides a shooting system based on the IMS camera and the DMS camera, which is characterized in that the shooting system is used for executing the shooting method.
Preferably, the photographing system comprises an IMS camera and a DMS camera, the IMS camera is a rolling shutter, the DMS camera comprises an infrared fill-in light lamp for filling in light to a photographing region of the DMS camera, the photographing region of the IMS camera and the photographing region of the DMS camera partially overlap each other, the photographing system comprises a setting module and a control module,
the setting module is used for setting the IMS camera and the DMS camera to be at the same shooting frame rate;
the control module is used for exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the exposure time of the blank invalid line of the IMS camera comprise overlapping time.
On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows:
the invention can solve the problem of integral color cast distortion caused by the fact that an IMS camera emits a color picture in the daytime due to black and white pictures and the fact that an infrared lamp is always on for supplementing light when the DMS camera records normally, and the normal picture of a person in a vehicle is purple.
The invention can solve the problem that when the DMS camera and the IMS camera are normally recorded in the daytime, due to asynchronous exposure time, partial light supplement of the DMS camera is carried out, and infrared light supplement is acquired by the exposure of the IMS camera, so that a rolling transverse width purple scanning stripe can exist on a picture shot by the IMS camera.
The invention can solve the problems of large light attenuation and quick service life attenuation caused by the fact that the infrared lamp of the DMS camera works and is overheated for a long time.
Drawings
Fig. 1 is a schematic structural diagram of a photographing system according to embodiment 1 of the present invention.
Fig. 2 is another schematic structural diagram of the photographing system according to embodiment 1 of the present invention.
Fig. 3 is a flowchart of a photographing method according to embodiment 1 of the present invention.
Detailed Description
The invention is further illustrated by the following examples, which are not intended to limit the scope of the invention.
Example 1
Referring to fig. 1, the present embodiment provides a camera setup system based on an IMS camera and a DMS camera.
The shooting system comprises an IMS camera, a DMS camera and a main device, wherein the main device can be a vehicle-mounted terminal.
The IMS camera is a rolling shutter, and the IMS camera 11 further includes an infrared light supplement circuit 111, an image sensor 112, and an image processor 113.
The DMS camera is a global shutter, the DMS camera 12 includes an infrared fill-in light lamp 121, an image sensor 122, and an image processor 123, and the infrared fill-in light lamp is used to fill in light to a shooting area of the DMS camera.
And the IMS camera and the DMS camera transmit an AHD signal to a decoding chip of the main equipment through the image processor.
The shooting area of the IMS camera and the shooting area of the DMS camera partially coincide with each other, and the shooting system comprises a setting module and a control module.
The setting module is used for setting the IMS camera and the DMS camera to be at the same shooting frame rate.
The control module is used for exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the exposure time of the blank invalid line of the IMS camera comprise overlapping time.
Further, the setting module is used for adjusting firmware parameters of the IMS camera and the DMS camera respectively so as to enable the IMS camera and the DMS camera to be set to the same shooting frame rate;
the control module is used for adjusting the IMS camera to reduce the single-line exposure time of an image sensor of the IMS camera and increase the frame length of the IMS camera.
Specifically, the control module is configured to obtain the effective line exposure time of the IMS camera and the exposure time of the DMS camera according to the difference between the single line exposure durations before and after adjustment and the period.
Firstly, setting firmware parameters of a camera, and under the condition that a Tframe rate, namely a frame rate of 25FPS is kept unchanged, reducing the time of Tline (exposure time of each line), and increasing the VTS (how many lines are exposed in one frame), so as to increase the time of dummy line (invalid line), wherein the VTS in the embodiment is increased from 750 to 1500; thereby reducing rolling Time of the active pixel and reducing the Time difference Δ T.
Before modification: t1-720/750/25-38.4 ms
After the change: t2-720/1500/25-19.2 ms
Then T1-T2 is 19.2ms
Secondly, to ensure that the exposure of the IMS camera and the DMS camera is completed within 40ms (frame rate 25FPS) in one period, rolling Time should be completely avoided. The maximum effective row exposure time of the IMS camera is T3, and the maximum exposure time of the DMS camera is T4, then
T3+T4＝40ms-△T＝40ms-19.2ms＝20.8ms
Then, the maximum exposure time T3 of the IMS camera is set to 15.8ms according to actual conditions, and the maximum exposure time T4 of the DMS camera is set to 5ms, and the IMS camera and the DMS camera are configured by corresponding register addresses.
Further, the image sensor of the IMS camera comprises a first signal pin, the image sensor of the DMS camera comprises a second signal pin and a third signal pin,
the IMS camera is used for transmitting a frame synchronization signal to the second signal pin through the first signal pin;
the image sensor of the DMS camera is used for generating a control signal according to the received frame synchronization signal;
the DMS camera is used for sending the control signal to the infrared light supplement lamp through the third signal pin so that light supplement of the infrared light supplement lamp is synchronous with exposure of the DMS camera.
Referring to fig. 2, the first signal pin is a VSYNC pin 31, the second signal pin is an ILPWM pin, the third signal pin is a STORBE pin, the photographing system includes a first level shifter and a second level shifter, the first level shifter includes a first resistor 32, a second resistor 33, and a first MOS transistor 34, the second level shifter includes a third resistor 41, a fourth resistor 42, and a second MOS transistor 43, a G-pole 36 of the first MOS transistor is connected to the first signal pin through the first resistor, an S-pole 37 is grounded, a D-pole 38 of the first MOS transistor is connected to the second resistor and an output pin 35, the output pin transmits the frame synchronization signal to an input pin 44 of an image sensor of the DMS camera through a wire, a G-pole 45 of the second MOS transistor 43 is connected to the input pin through the third resistor, and a third MOS transistor 34 is connected to the second signal pin through the second resistor 41 and the output pin 38, and the output pin is connected to the image sensor of the DMS camera through a wire, The S pole 46 is grounded and the D pole 47 is connected to the fourth resistor and the second signal pin, respectively.
The image sensor of the IMS camera is H66, and the image sensor of the DMS camera is OV 9281.
The C4VSYNC pin 31 of the sensor H66 of the IMS camera may be configured as a frame sync signal. The synchronous signal of 3.3V is converted to the connector interface through a level conversion circuit composed of a first resistor 32, a second resistor 33 and a mos tube 34 and is fed to the DMS camera through a wire. The level conversion circuit mainly has the following functions: on one hand, the signal level is improved, and the interference is reduced; and on the other hand, the interface is isolated, so that the sensor is prevented from being damaged in the reverse direction.
VSYNC signals from an IMS camera image sensor reach the input end of a DMS camera through wires, are converted into frame synchronization signals with duty ratio less than 5% of 1.8V 25HZ through a level conversion circuit composed of a third resistor, a fourth resistor and a mos tube, are sent to an A6 pin ILPWM of a sensor OV9281, and output infrared lamp IC control signals with duty ratio less than 5% of 25HZ 1.8V through a B6 pin STORBE through software configuration.
Sensor OV9281 controls the switch that is driven IC by U110 infrared lamp through the pin of control LED _ EN, realizes the switch of infrared lamp light filling from the beginning, makes the infrared lamp light filling of its DMS camera follow the exposure synchronization of Sensor OV9281, and maximum duration is 5ms, staggers the exposure time of IMS camera.
Specifically, the IMS camera comprises a light sensor,
the IMS camera is used for acquiring the light intensity of the shooting system through the light sensor, and outputting a color image after acquiring the image when the light intensity is larger than a preset value.
When the light is higher than a certain value, the circuit will output a high level to the sensor H66, and the software logic judges that the light is in a color chart. (if the light is dark, the picture is colored, the picture noise is serious, the picture cannot be restored normally, the normal driving is influenced by using 650nm or ordinary light for light supplement, and the method is similar to that of driving by a person with a high beam or driving by a strong beam in a vehicle)
When the light is lower than a certain value, the circuit will output a low level to the sensor H66, and the software logic judges that the light is black and white. (the principle is that the light is supplemented by an infrared lamp with 940nm, which is invisible to naked eyes and cannot interfere normal driving of people, etc.)
Furthermore, the shooting system also comprises a judging module and an identifying module.
The judging module is used for judging whether the current light intensity is greater than a preset value or not, if so, exposing the IMS camera and the DMS camera on a calibration plate according to a preset rule in one period of the shooting frame rate;
the identification module is used for identifying a frame of image acquired by the IMS camera and identifying the bottom of the image;
the judging module is also used for judging whether an image with a preset color exists at the bottom, and if so, the line number of an image sensor for shooting the image is obtained according to the height of the image;
the control module is used for calculating the frame length of the IMS camera according to the line number, so that the single-line exposure time of the image sensor of the IMS camera is adjusted.
Referring to fig. 3, with the above shooting system, the present embodiment further provides a shooting method, including:
Specifically, step 100 is:
respectively adjusting firmware parameters of the IMS camera and the DMS camera to enable the IMS camera and the DMS camera to be set to be at the same shooting frame rate;
step 101 includes adjusting the IMS camera to reduce the single-line exposure time of the image sensor of the IMS camera, and increasing the frame length of the IMS camera.
Step 101 further comprises:
and acquiring the effective line exposure time of the IMS camera and the exposure time of the DMS camera according to the difference value of the single line exposure time lengths before and after adjustment and the period.
Further, the photographing method includes:
and acquiring the exposure time of the DMS camera in one period according to the exposure time of the effective row and the exposure time of the DMS camera.
Specifically, the image sensor of the IMS camera includes a first signal pin, the image sensor of the DMS camera includes a second signal pin and a third signal pin, and the photographing method includes:
the IMS camera transmits a frame synchronization signal to the second signal pin through the first signal pin;
the image sensor of the DMS camera generates a control signal according to the received frame synchronization signal;
and the DMS camera sends the control signal to the infrared light supplement lamp through a third signal pin so as to synchronize the light supplement of the infrared light supplement lamp with the exposure of the DMS camera.
The first signal pin is a VSYNC pin, the second signal pin is an ILPWM pin, the third signal pin is a STORBE pin, the shooting system comprises a first level conversion circuit and a second level conversion circuit, the first level shift circuit comprises a first resistor, a second resistor and a first MOS transistor, the second level shift circuit comprises a third resistor, a fourth resistor and a second MOS transistor, the G pole of the first MOS tube is connected with the first signal pin through a first resistor, the S pole is grounded, the D pole is respectively connected with a second resistor and an output pin, the output pin transmits the frame synchronization signal to an input pin of an image sensor of the DMS camera through a wire, and the G pole of the second MOS tube is connected with the input pin through a third resistor, the S pole of the second MOS tube is grounded, and the D pole of the second MOS tube is respectively connected with a fourth resistor and a second signal pin.
The IMS camera comprises a light sensor, and the shooting method comprises the following steps:
the method comprises the following steps of before step 100:
the light intensity of the shooting system is collected through the light sensor, and when the light intensity is larger than a preset value, the IMS camera collects color image signals.
Specifically, the following steps may be performed to calibrate the exposure time, so as to avoid interference caused by signal transmission delay, and the photographing method includes:
judging whether the current light intensity is greater than a preset value, if so, exposing the IMS camera and the DMS camera on a calibration plate according to a preset rule in one period of the shooting frame rate;
identifying a frame of image acquired by an IMS camera, and identifying the bottom of the image;
judging whether an image with a preset color exists at the bottom, if so, acquiring the line number of an image sensor for shooting the image according to the height of the image;
and calculating the frame length of the IMS camera according to the line number, thereby adjusting the single-line exposure time of the image sensor of the IMS camera.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (10)
1. A shooting method based on an IMS camera and a DMS camera is used for a shooting system, the shooting system comprises the IMS camera and the DMS camera, and the shooting method is characterized in that the IMS camera is a rolling shutter, the DMS camera is a global shutter, the DMS camera comprises an infrared fill-in lamp, the infrared fill-in lamp is used for filling in light for a shooting area of the DMS camera, the shooting area of the IMS camera and the shooting area of the DMS camera partially coincide, and the shooting method comprises the following steps:
setting the IMS camera and the DMS camera to be at the same shooting frame rate;
and exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, wherein the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the exposure time of the blank invalid line of the IMS camera comprise overlapping time.
2. The photographing method according to claim 1, wherein the photographing method includes:
respectively adjusting firmware parameters of the IMS camera and the DMS camera to enable the IMS camera and the DMS camera to be set to be at the same shooting frame rate;
and adjusting the IMS camera to reduce the single-line exposure time of an image sensor of the IMS camera and increase the frame length of the IMS camera.
3. The photographing method according to claim 2, wherein the photographing method includes:
and acquiring the effective line exposure time of the IMS camera and the exposure time of the DMS camera according to the difference value of the single line exposure time lengths before and after adjustment and the period.
4. The photographing method according to claim 3, wherein the photographing method includes:
and acquiring the exposure time of the DMS camera in one period according to the exposure time of the effective row and the exposure time of the DMS camera.
5. The photographing method of claim 1, wherein the image sensor of the IMS camera includes a first signal pin, and the image sensor of the DMS camera includes a second signal pin and a third signal pin, the photographing method comprising:
the IMS camera transmits a frame synchronization signal to the second signal pin through the first signal pin;
the image sensor of the DMS camera generates a control signal according to the received frame synchronization signal;
and the DMS camera sends the control signal to the infrared light supplement lamp through a third signal pin so as to synchronize the light supplement of the infrared light supplement lamp with the exposure of the DMS camera.
6. The photographing method of claim 5, wherein the first signal pin is a VSYNC pin, the second signal pin is an ILPWM pin, the third signal pin is a STORBE pin, the photographing system includes a first level shifter circuit including a first resistor, a second resistor, and a first MOS transistor, and a second level shifter circuit including a third resistor, a fourth resistor, and a second MOS transistor, a G-pole of the first MOS transistor is connected to the first signal pin through the first resistor, an S-pole is grounded, D-poles are connected to the second resistor and an output pin, respectively, the output pin transmits the frame synchronization signal to an input pin of an image sensor of the DMS camera through a wire, and a G-pole of the second MOS transistor is connected to the input pin through the third resistor, And the S pole is grounded, and the D pole is respectively connected with the fourth resistor and the second signal pin.
7. The method of claim 1, wherein the IMS camera includes a light sensor, the method comprising:
the light intensity of the shooting system is collected through the light sensor, and when the light intensity is larger than a preset value, the IMS camera collects images and outputs color images.
8. The photographing method according to claim 7, wherein the photographing method includes:
judging whether the current light intensity is greater than a preset value, if so, exposing the IMS camera and the DMS camera on a calibration plate according to a preset rule in one period of the shooting frame rate;
identifying a frame of image acquired by an IMS camera, and identifying the bottom of the image;
judging whether an image with a preset color exists at the bottom, if so, acquiring the line number of an image sensor for shooting the image according to the height of the image;
and calculating the frame length of the IMS camera according to the line number, thereby adjusting the single-line exposure time of the image sensor of the IMS camera.
9. A photographing system based on an IMS camera and a DMS camera, wherein the photographing system is configured to perform the photographing method according to any one of claims 1 to 8.
10. The photographing system of claim 9, wherein the photographing system comprises an IMS camera and a DMS camera, the IMS camera is a rolling shutter, the DMS camera comprises an infrared fill-in lamp for filling in a photographing region of the DMS camera, the photographing region of the IMS camera and the photographing region of the DMS camera comprise a portion overlapping, the photographing system comprises a setting module and a control module,
the setting module is used for setting the IMS camera and the DMS camera to be at the same shooting frame rate;
the control module is used for exposing the IMS camera and the DMS camera in one period of the shooting frame rate according to a preset rule, the preset rule is that the exposure of the DMS camera is synchronous with the light supplement of the infrared light supplement lamp, and the exposure time of the DMS camera and the exposure time of the blank invalid line of the IMS camera comprise overlapping time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011139626.2A CN112261309B (en) | 2020-10-22 | 2020-10-22 | Shooting method and system based on IMS camera and DMS camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011139626.2A CN112261309B (en) | 2020-10-22 | 2020-10-22 | Shooting method and system based on IMS camera and DMS camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112261309A true CN112261309A (en) | 2021-01-22 |
| CN112261309B CN112261309B (en) | 2022-04-08 |
Family
ID=74264143
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011139626.2A Active CN112261309B (en) | 2020-10-22 | 2020-10-22 | Shooting method and system based on IMS camera and DMS camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112261309B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113438424A (en) * | 2021-06-04 | 2021-09-24 | 杭州海康威视数字技术股份有限公司 | Synchronous exposure processing method, device, system and equipment |
| CN113691776A (en) * | 2021-08-18 | 2021-11-23 | 南京领行科技股份有限公司 | In-vehicle camera system and light supplementing method |
| CN114584711A (en) * | 2022-03-01 | 2022-06-03 | 上海富瀚微电子股份有限公司 | Monitoring system is device in coordination in car |
| CN114827403A (en) * | 2022-04-07 | 2022-07-29 | 安徽蔚来智驾科技有限公司 | Vehicle-mounted image acquisition system, control method, vehicle and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180041681A1 (en) * | 2016-08-02 | 2018-02-08 | Cree, Inc. | Solid state lighting fixtures and image capture systems |
| CN110771153A (en) * | 2017-06-21 | 2020-02-07 | 康蒂-特米克微电子有限公司 | Camera system with different shutter modes |
| CN111107247A (en) * | 2020-02-26 | 2020-05-05 | 上海富瀚微电子股份有限公司 | Exposure method, image system and method for cooperative work of image system |
| CN111416924A (en) * | 2020-03-19 | 2020-07-14 | 广汽蔚来新能源汽车科技有限公司 | Light filling control circuit, DMS camera, fatigue driving monitoring system and automobile |
| US10742858B1 (en) * | 2019-03-28 | 2020-08-11 | Karl Storz Imaging, Inc. | System and method for prioritizing the synchronization of a light source with image sensor |
| CN111541873A (en) * | 2020-05-08 | 2020-08-14 | 北京嘀嘀无限科技发展有限公司 | Control method and system for vehicle monitoring and computer readable storage medium |
| CN111710061A (en) * | 2020-06-28 | 2020-09-25 | 北京嘀嘀无限科技发展有限公司 | Image acquisition system, method, device and storage medium |
-
2020
- 2020-10-22 CN CN202011139626.2A patent/CN112261309B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180041681A1 (en) * | 2016-08-02 | 2018-02-08 | Cree, Inc. | Solid state lighting fixtures and image capture systems |
| CN110771153A (en) * | 2017-06-21 | 2020-02-07 | 康蒂-特米克微电子有限公司 | Camera system with different shutter modes |
| US10742858B1 (en) * | 2019-03-28 | 2020-08-11 | Karl Storz Imaging, Inc. | System and method for prioritizing the synchronization of a light source with image sensor |
| CN111107247A (en) * | 2020-02-26 | 2020-05-05 | 上海富瀚微电子股份有限公司 | Exposure method, image system and method for cooperative work of image system |
| CN111416924A (en) * | 2020-03-19 | 2020-07-14 | 广汽蔚来新能源汽车科技有限公司 | Light filling control circuit, DMS camera, fatigue driving monitoring system and automobile |
| CN111541873A (en) * | 2020-05-08 | 2020-08-14 | 北京嘀嘀无限科技发展有限公司 | Control method and system for vehicle monitoring and computer readable storage medium |
| CN111710061A (en) * | 2020-06-28 | 2020-09-25 | 北京嘀嘀无限科技发展有限公司 | Image acquisition system, method, device and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113438424A (en) * | 2021-06-04 | 2021-09-24 | 杭州海康威视数字技术股份有限公司 | Synchronous exposure processing method, device, system and equipment |
| CN113438424B (en) * | 2021-06-04 | 2022-07-08 | 杭州海康威视数字技术股份有限公司 | Synchronous exposure processing method, device, system and equipment |
| CN113691776A (en) * | 2021-08-18 | 2021-11-23 | 南京领行科技股份有限公司 | In-vehicle camera system and light supplementing method |
| CN113691776B (en) * | 2021-08-18 | 2024-02-09 | 南京领行科技股份有限公司 | In-vehicle camera system and light supplementing method |
| CN114584711A (en) * | 2022-03-01 | 2022-06-03 | 上海富瀚微电子股份有限公司 | Monitoring system is device in coordination in car |
| CN114827403A (en) * | 2022-04-07 | 2022-07-29 | 安徽蔚来智驾科技有限公司 | Vehicle-mounted image acquisition system, control method, vehicle and storage medium |
| CN114827403B (en) * | 2022-04-07 | 2024-03-05 | 安徽蔚来智驾科技有限公司 | Vehicle-mounted image acquisition system, control method, vehicle and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112261309B (en) | 2022-04-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112261309B (en) | Shooting method and system based on IMS camera and DMS camera | |
| US9626570B2 (en) | Vehicle control system and image sensor | |
| CN110738751B (en) | Imaging system, event recording system, and event recording method | |
| JP4738778B2 (en) | Image processing device, driving support device, and driving support system | |
| KR101789984B1 (en) | Side Mirror Camera System For Vehicle | |
| KR101367637B1 (en) | Monitoring apparatus | |
| CN105960355B (en) | For operating method, rear-camera head system and the motor vehicles of motor vehicles rear-camera head system after detection car light flash of light | |
| JP5071198B2 (en) | Signal recognition device, signal recognition method, and signal recognition program | |
| CN110557574A (en) | Detection of visible light communication sources over high dynamic range | |
| TW202101959A (en) | Image recognition device and image recognition method | |
| WO2020195610A1 (en) | Image processing device, imaging device, mobile unit, and image processing method | |
| JP2012086677A (en) | Monitoring system | |
| US10063827B2 (en) | Image processing apparatus, imaging apparatus, image processing program, and image processing method | |
| JP2002099999A (en) | Vehicular traffice lane detecting device | |
| JP4795813B2 (en) | Vehicle perimeter monitoring device | |
| JP4513013B2 (en) | Image processing system | |
| CN114097216A (en) | Image processing apparatus and image processing program | |
| JP7231092B2 (en) | event recording system | |
| US11794635B2 (en) | Lamp controller interlocking system of camera built-in headlamp and method thereof | |
| CN218888598U (en) | Image processing apparatus and in-vehicle system | |
| WO2022074700A1 (en) | Information processing device, information processing system, and information processing method | |
| CN211196040U (en) | Streaming media rearview mirror system and automobile | |
| US11678079B2 (en) | Solid-state imaging element, imaging apparatus, and method of controlling solid-state imaging element | |
| CN116193250A (en) | Automatic switching method for camera shooting mode of automobile data recorder | |
| CN115476767A (en) | Display method and device of electronic exterior rearview mirror |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210730 Address after: Building 34, yard 8, Dongbei Wangxi Road, Haidian District, Beijing 100193 Applicant after: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT Co.,Ltd. Address before: Room f, 2 / F, building 12, No.80, Lane 1505, Zuchongzhi Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai, 201203 Applicant before: SHANGHAI REACHENG COMMUNICATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |