CN108765469B - Road monitoring random motion blurred image fast restoration simulation system - Google Patents

Road monitoring random motion blurred image fast restoration simulation system Download PDF

Info

Publication number
CN108765469B
CN108765469B CN201810539837.1A CN201810539837A CN108765469B CN 108765469 B CN108765469 B CN 108765469B CN 201810539837 A CN201810539837 A CN 201810539837A CN 108765469 B CN108765469 B CN 108765469B
Authority
CN
China
Prior art keywords
target
simulation module
background
horizontal support
monitoring camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810539837.1A
Other languages
Chinese (zh)
Other versions
CN108765469A (en
Inventor
刘赫
邓昊
石万
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin University of Science and Technology
Original Assignee
Harbin University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin University of Science and Technology filed Critical Harbin University of Science and Technology
Priority to CN201810539837.1A priority Critical patent/CN108765469B/en
Publication of CN108765469A publication Critical patent/CN108765469A/en
Application granted granted Critical
Publication of CN108765469B publication Critical patent/CN108765469B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/73—Deblurring; Sharpening
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/277—Analysis of motion involving stochastic approaches, e.g. using Kalman filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20201—Motion blur correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30236—Traffic on road, railway or crossing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a rapid restoration simulation system for a road monitoring random motion blurred image, belonging to the technical field of image processing; the simulation system includes: a target simulation module: the road surface simulation method comprises the following steps that the road surface simulation method is composed of a time-invariant scene for simulating a road surface image and a time-variant scene for simulating a priori target, wherein the time-invariant scene comprises a uniform background and a target which is different from the background and is surrounded by the background; the monitoring camera simulation module: a camera, CCD, CMOS or camera; cantilever beam emulation module: the device comprises two upright posts, a horizontal support end and a spring connecting end, wherein the two upright posts, the horizontal support end and the spring connecting end are symmetrically arranged, the upper part of the horizontal support end is fixedly connected with a monitoring camera simulation module, the two sides of the horizontal support end are connected with the middle upper part of each upright post through the spring connecting end, and the horizontal support end performs translation in three directions and rotation in one direction under the action of the spring connecting end; the invention can directly correspond to a road monitoring fuzzy image fast recovery method based on prior knowledge, and fast recover road monitoring random motion fuzzy images.

Description

Road monitoring random motion blurred image fast restoration simulation system
Technical Field
The invention discloses a rapid restoration simulation system for a road monitoring random motion blurred image, and belongs to the technical field of image processing.
Background
The road monitoring system is a powerful guarantee for informatization and intellectualization of a road network. The traffic violation, the traffic accident, the traffic jam and other emergencies can be judged at the first time, and then the control parameters are adjusted to make a scheduling strategy. Two requirements for realizing the above functions are: clear imaging and real-time imaging.
At present, the road monitoring system mostly adopts a structure that a monitoring camera is mounted on a cantilever beam, as shown in fig. 1. The structure has the advantages of simple structure and low installation and maintenance cost, but has the defects that the camera can randomly swing under the influence of vibration and air flow to cause image blurring, so that a road monitoring system cannot meet the clear imaging condition, and the informatization and the intellectualization of a road network are not facilitated.
Aiming at the problem of image blur caused by swinging of a road monitoring camera and considering two technical requirements of clear imaging and real-time imaging of a road monitoring system, a random motion blurred image fast restoration method is studied by a university student innovation and venture training plan project (project number 201510214056) based on priori knowledge, and the method is based on the principle that a random motion blurred image fast restoration method is firstly established by a random motion Dynamic Optical Transfer Function (DOTF) model, then the DOTF is quickly extracted from a motion blurred image by the aid of the priori knowledge, and finally the DOTF is combined with a linear restoration algorithm to realize the random motion blurred image fast restoration. The method can quickly recover the random motion blurred image formed by the swinging of the camera on the premise of not changing the installation mode of the existing camera, and plays a promoting role in realizing the informatization and intellectualization of the road network.
In the process of project implementation, a road monitoring random motion blurred image fast restoration simulation system needs to be built to verify the project implementation method, however, no existing system suitable for the project implementation method can be found for reference.
Disclosure of Invention
In order to solve the problems, the invention designs a rapid restoration simulation system for the road monitoring random motion blurred image, which can directly correspond to the method proposed by the project and rapidly restore the road monitoring random motion blurred image.
The purpose of the invention is realized as follows:
road monitoring random motion blurred image fast restoration simulation system includes:
a target simulation module: the road surface simulation method comprises the following steps that the road surface simulation method is composed of a time-invariant scene for simulating a road surface image and a time-variant scene for simulating a priori target, wherein the time-invariant scene comprises a uniform background and a target which is different from the background and is surrounded by the background;
the monitoring camera simulation module: a camera, CCD, CMOS or camera;
cantilever beam emulation module: the device comprises two upright posts, a horizontal support end and a spring connecting end, wherein the two upright posts, the horizontal support end and the spring connecting end are symmetrically arranged, the upper part of the horizontal support end is fixedly connected with a monitoring camera simulation module, the two sides of the horizontal support end are connected with the middle upper part of each upright post through the spring connecting end, and the horizontal support end performs translation in three directions and rotation in one direction under the action of the spring connecting end;
the target simulation module is a display, one part of an image displayed by the display has a time-varying characteristic, the other part of the image has a time-invariant characteristic, and the part with the time-invariant characteristic comprises a uniform background and a target which is different from the background and is surrounded by the background;
the direction of the optical axis is taken as a starting point, the width of the target is a, the width of the background is b, the distance from the target simulation module to the monitoring camera simulation module is l, the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha, and the following conditions are met:
a＜l·tanα＜b
the rotation angle of the monitoring camera in the x direction meets the following conditions:
the rotation angle along the x direction does not exceed arctan (b/l) -alpha;
the rotation angle against the x direction does not exceed alpha-arctan (a/l).
The x direction is distributed in a plane perpendicular to the optical axis;
taking the direction of the optical axis as a starting point,
in the x direction perpendicular to the optical axis, the width of the target is a1The width of the background is b1The distance from the target simulation module to the monitoring camera simulation module is l, and the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha1And satisfies:
a1＜l·tanα1＜b1
the width of the target is a in the-x direction perpendicular to the optical axis2The width of the background is b2The distance from the target simulation module to the monitoring camera simulation module is l, and the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha2And satisfies:
a2＜l·tanα2＜b2
the rotation angle of the monitoring camera in the x direction meets the following conditions:
rotation angle in x direction not exceeding min [ arctan (b)1/l)-α1,α2-arctan(a2/l)]；
The rotation angle along the-x direction does not exceed min alpha1-arctan(a1/l),arctan(b2/l)-α2]。
Has the advantages that:
firstly, because the target simulation module, the monitoring camera simulation module and the cantilever beam simulation module are arranged, the monitoring camera is mounted on the cantilever beam structure which is directly corresponding to the road monitoring system, so that the method is suitable for simulating the road monitoring system and can be used for rapidly restoring the road monitoring random motion blurred image;
secondly, the target simulation module consists of a time-invariant scene for simulating a road surface image and a time-variant scene for simulating a priori target, and the time-invariant scene comprises a uniform background and a target which is different from the background and surrounded by the background, so that the time-invariant scene can be used as priori knowledge, and then the time-invariant scene directly corresponds to an image fast restoration method (DOTF is quickly extracted from a motion blurred image by using the priori knowledge, and finally the DOTF is combined with a linear restoration algorithm to realize the fast restoration of the random motion blurred image), and a road monitoring random motion blurred image fast restoration simulation system is provided.
Drawings
Figure 1 is a road surveillance camera mounted on a cantilever beam structure.
Fig. 2 is a schematic view of a connection structure of the cantilever beam simulation module and the monitoring camera simulation module.
Fig. 3 is a diagram illustrating the relationship between the angles in the third embodiment.
Detailed Description
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings.
Detailed description of the preferred embodiment
The road monitoring random motion blurred image fast restoration simulation system of the embodiment comprises:
a target simulation module: the road surface simulation method comprises the following steps that the road surface simulation method is composed of a time-invariant scene for simulating a road surface image and a time-variant scene for simulating a priori target, wherein the time-invariant scene comprises a uniform background and a target which is different from the background and is surrounded by the background;
the monitoring camera simulation module: a camera, CCD, CMOS or camera;
cantilever beam emulation module: the device comprises two stand columns, a horizontal support end and a spring connecting end, wherein the stand columns, the horizontal support end and the spring connecting end are symmetrically arranged, the upper part of the horizontal support end is fixedly connected with a monitoring camera simulation module, the two sides of the horizontal support end are connected with the middle upper part of each stand column through the spring connecting end, and the horizontal support end performs translation in three directions and rotation in one direction under the action of the spring connecting end.
A schematic diagram of a connection structure of the cantilever beam simulation module and the monitoring camera simulation module is shown in fig. 2.
Detailed description of the invention
The road monitoring random motion blurred image fast restoration simulation system of the embodiment further defines the target simulation module as a display on the basis of the specific embodiment one, wherein a part of an image displayed by the display has a time-varying characteristic, a part of the image has a time-invariant characteristic, and the part having the time-invariant characteristic comprises a uniform background and a target which is different from the background and is surrounded by the background.
Detailed description of the preferred embodiment
On the basis of the first specific embodiment or the second specific embodiment, the road monitoring random motion blurred image fast restoration simulation system further defines that the direction of the optical axis is taken as a starting point, the x direction perpendicular to the optical axis is taken, the width of the target is a, the width of the background is b, the distance from the target simulation module to the monitoring camera simulation module is l, the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha, and the following conditions are met:
a＜l·tanα＜b
the rotation angle of the monitoring camera in the x direction meets the following conditions:
the rotation angle along the x direction does not exceed arctan (b/l) -alpha;
the rotation angle against the x direction does not exceed alpha-arctan (a/l).
The relationship between the various angles is shown in fig. 3.
In this embodiment, the x-direction is distributed in a plane perpendicular to the optical axis.
Detailed description of the invention
The road monitoring random motion blurred image fast restoration simulation system of the embodiment further defines the following contents on the basis of the third specific embodiment:
taking the direction of the optical axis as a starting point,
in the x direction perpendicular to the optical axis, the width of the target is a1The width of the background is b1The distance from the target simulation module to the monitoring camera simulation module is l, and the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha1And satisfies:
a1＜l·tanα1＜b1
the width of the target is a in the-x direction perpendicular to the optical axis2The width of the background is b2The distance from the target simulation module to the monitoring camera simulation module is l, and the field angle of the constant scene during monitoring of the monitoring camera simulation module is alpha2And satisfies:
a2＜l·tanα2＜b2
the rotation angle of the monitoring camera in the x direction meets the following conditions:
rotation angle in x direction not exceeding min [ arctan (b)1/l)-α1,α2-arctan(a2/l)]；
The rotation angle along the-x direction does not exceed min alpha1-arctan(a1/l),arctan(b2/l)-α2]。
In the embodiment, considering that the x direction is distributed in a plane perpendicular to the optical axis, in the plane including the optical axis, simultaneous limitation of the x direction and the-x direction exists, and a result obtained by integrating the limitation of the two directions is given.

Claims (1)

1. Road monitoring random motion blurred image fast restoration simulation system includes:
a target simulation module: the road surface simulation method comprises the following steps that the road surface simulation method is composed of a time-invariant scene for simulating a road surface image and a time-variant scene for simulating a priori target, wherein the time-invariant scene comprises a uniform background and a target which is different from the background and is surrounded by the background;
the monitoring camera simulation module: a camera, CCD, CMOS or camera;
cantilever beam emulation module: the device comprises two upright posts, a horizontal support end and a spring connecting end, wherein the two upright posts, the horizontal support end and the spring connecting end are symmetrically arranged, the upper part of the horizontal support end is fixedly connected with a monitoring camera simulation module, the two sides of the horizontal support end are connected with the middle upper part of each upright post through the spring connecting end, and the horizontal support end performs translation in three directions and rotation in one direction under the action of the spring connecting end;
the target simulation module is a display, one part of an image displayed by the display has a time-varying characteristic, the other part of the image has a time-invariant characteristic, and the part with the time-invariant characteristic comprises a uniform background and a target which is different from the background and is surrounded by the background;
it is characterized in that the preparation method is characterized in that,
taking the direction of the optical axis as a starting point,
to a direction perpendicular to the optical axisxDirection, width of the targeta 1The width of the background isb 1The distance from the target simulation module to the monitoring camera simulation module islThe angle of view of the scene is constant when the monitoring camera simulation module monitorsα 1And satisfies:
a 1＜l·tanα 1＜b 1
toward perpendicular optical axisxDirection, width of the targeta 2The width of the background isb 2The distance from the target simulation module to the monitoring camera simulation module islThe angle of view of the scene is constant when the monitoring camera simulation module monitorsα 2And satisfies:
a 2＜l·tanα 2＜b 2
the monitoring camera is arrangedxThe rotation angle of the direction and the plane of the optical axis satisfies the following conditions:
is alongxThe rotation angle of the direction and the optical axis in the half plane is not more than min [ arctan: (b 1/l)-α 1,α 2-arctan(a 2/l)]；
Along-xThe rotation angle in the direction and the optical axis in the half plane is not more than minα 1-arctan(a 1/l),arctan(b 2/l)-α 2]；
The above-mentionedxThe directions are distributed in a plane perpendicular to the optical axis.
CN201810539837.1A 2016-06-16 2016-06-16 Road monitoring random motion blurred image fast restoration simulation system Active CN108765469B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810539837.1A CN108765469B (en) 2016-06-16 2016-06-16 Road monitoring random motion blurred image fast restoration simulation system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810539837.1A CN108765469B (en) 2016-06-16 2016-06-16 Road monitoring random motion blurred image fast restoration simulation system
CN201610429164.5A CN106127699B (en) 2016-06-16 2016-06-16 A kind of road monitoring random motion blurred picture Fast Restoration analogue system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201610429164.5A Division CN106127699B (en) 2016-06-16 2016-06-16 A kind of road monitoring random motion blurred picture Fast Restoration analogue system

Publications (2)

Publication Number Publication Date
CN108765469A CN108765469A (en) 2018-11-06
CN108765469B true CN108765469B (en) 2022-02-08

Family

ID=57469649

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810539837.1A Active CN108765469B (en) 2016-06-16 2016-06-16 Road monitoring random motion blurred image fast restoration simulation system
CN201610429164.5A Active CN106127699B (en) 2016-06-16 2016-06-16 A kind of road monitoring random motion blurred picture Fast Restoration analogue system

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610429164.5A Active CN106127699B (en) 2016-06-16 2016-06-16 A kind of road monitoring random motion blurred picture Fast Restoration analogue system

Country Status (1)

Country Link
CN (2) CN108765469B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902972A (en) * 2014-03-21 2014-07-02 哈尔滨工程大学 Water surface moving platform visual system image analyzing and processing method
CN105163032A (en) * 2015-09-22 2015-12-16 哈尔滨理工大学 Road monitoring camera anti-shake device and method based on two-dimensional motion compensation
CN204948209U (en) * 2015-09-22 2016-01-06 哈尔滨理工大学 Based on the road monitoring camera anti-shake apparatus of two dimensional motion compensation
CN205880921U (en) * 2016-06-16 2017-01-11 哈尔滨理工大学 Road monitoring random motion blurred image recovers simulation system fast

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5624258B2 (en) * 2007-04-26 2014-11-12 株式会社東芝 Ultrasonic diagnostic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing program
CN103679652B (en) * 2013-11-29 2017-04-19 北京空间机电研究所 Image restoration system capable of improving imaging quality greatly
CN104899843A (en) * 2015-06-30 2015-09-09 西南石油大学 Real-time haze-eliminating displayer and haze-eliminating display method thereof
CN204906537U (en) * 2015-09-22 2015-12-23 哈尔滨理工大学 A road monitoring camera anti -shake device for compensating cantilever beam sways
CN105163031B (en) * 2015-09-22 2018-03-09 哈尔滨理工大学 For compensating road monitoring camera anti-shake apparatus and the method that cantilever beam waves
CN105389794B (en) * 2015-10-08 2018-03-06 西安电子科技大学 SAR target detection false-alarm minimizing technologies based on priori scene knowledge

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902972A (en) * 2014-03-21 2014-07-02 哈尔滨工程大学 Water surface moving platform visual system image analyzing and processing method
CN105163032A (en) * 2015-09-22 2015-12-16 哈尔滨理工大学 Road monitoring camera anti-shake device and method based on two-dimensional motion compensation
CN204948209U (en) * 2015-09-22 2016-01-06 哈尔滨理工大学 Based on the road monitoring camera anti-shake apparatus of two dimensional motion compensation
CN205880921U (en) * 2016-06-16 2017-01-11 哈尔滨理工大学 Road monitoring random motion blurred image recovers simulation system fast

Also Published As

Publication number Publication date
CN108765469A (en) 2018-11-06
CN106127699A (en) 2016-11-16
CN106127699B (en) 2018-10-19

Similar Documents

Publication Publication Date Title
CN102510474B (en) 360-degree panorama monitoring system
US9628705B2 (en) Navigation device
CN105678693A (en) Panorama video browsing-playing method
US20120242782A1 (en) Image capture device and image processing method
JP6636163B2 (en) Image display method, method of generating shaped sledge curtain, and head mounted display device
Gupta et al. On controlling light transport in poor visibility environments
CN102984453A (en) Method and system of real-time generating hemisphere panoramic video images through single camera
CN106915303B (en) Automobile A-column blind area perspective method based on depth data and fish eye images
CN111770326B (en) Indoor three-dimensional monitoring method for panoramic video projection
CN102682442A (en) Motion target super-resolution image reconstruction method based on optical flow field
CN104899843A (en) Real-time haze-eliminating displayer and haze-eliminating display method thereof
CN107145825A (en) Ground level fitting, camera calibration method and system, car-mounted terminal
CN205051781U (en) Twin -lens optics camera system
CN108765469B (en) Road monitoring random motion blurred image fast restoration simulation system
US9817239B2 (en) Three-dimensional display device having lens-switching function
CN103607543B (en) Video concentration method, system and video frequency monitoring method and system
CN104363421B (en) The method and apparatus for realizing Multi-angle camera monitoring effect
CN104590115A (en) Driving safety auxiliary system and method
CN108520496A (en) A kind of sea and sky background monitor video image split-joint method based on optical flow method
CN205880921U (en) Road monitoring random motion blurred image recovers simulation system fast
CN104363412B (en) The big visual field supervisory systems and monitoring and managing method of elongated zones
CN103325110B (en) A kind of panoramic picture correction method based on panorama clipping the ball all-in-one
CN103096107A (en) Three-dimensional display system and control method thereof
CN102346986B (en) Display screen adjusting system and method as well as advertisement board with adjusting system
CN209086996U (en) A kind of device for the calibration of car panorama

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant