CN100593334C - Video frequency monitoring system - Google Patents

Video frequency monitoring system Download PDF

Info

Publication number
CN100593334C
CN100593334C CN200610113524A CN200610113524A CN100593334C CN 100593334 C CN100593334 C CN 100593334C CN 200610113524 A CN200610113524 A CN 200610113524A CN 200610113524 A CN200610113524 A CN 200610113524A CN 100593334 C CN100593334 C CN 100593334C
Authority
CN
China
Prior art keywords
eye images
fish eye
control module
rectangular block
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200610113524A
Other languages
Chinese (zh)
Other versions
CN1933598A (en
Inventor
王耀辉
俞青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanxi Vimicro Technology Co Ltd
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN200610113524A priority Critical patent/CN100593334C/en
Publication of CN1933598A publication Critical patent/CN1933598A/en
Application granted granted Critical
Publication of CN100593334C publication Critical patent/CN100593334C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A video monitoring system comprises fisheye shooting tube, mode control module, network interface, storage module, control module, calibration module and realization module. It is featured as obtaining fisheye image by wide-angle shooting tube then sending it to network interface after it is processed by mode control module, sending processed fisheye image to control module by network interface for storing said image in control module, utilizing calibration module to calibrate processed fisheye image to be planar image being displayed by display module.

Description

A kind of video monitoring system
Technical field
The present invention relates to field of video monitoring, particularly relate to the picked-up and the transmission plan of the video data in the video monitoring process.
Technical background
Along with the raising and the science and technology development of living standards of the people, safety monitoring system should be used more and more.Such as for the safety of company, the safety of public institution, the safety of family and the safety in other places that need monitor, all need safety monitoring system be installed in these places.In order effectively guarded region to be carried out security monitoring, often need to install a plurality of cameras zone is separately monitored, thereby reach the effect of integral monitoring.Yet numerous cameras has not only increased the production cost of supervisory control system, has also improved the maintenance difficulties of system.
Along with the development of camera lens and sensor technology, the wide-angle imaging head with big visual field is developed.The visible angle of these wide-angle imaging heads even can surpass 180 degree, they are also referred to as fish-eye camera, when surpassing 180 degree, the visual angle can take down camera all scenes on every side, Fig. 1 shows the captured image that goes out of wide-angle imaging head, such image can be called omni-directional image, also can be called as fish eye images, at this moment, the wide-angle imaging head is placed in the corner of office and has aimed at ceiling.Advantages such as the visual field is big though the wide-angle imaging head has, the image information of picked-up is many, but compare with the image of common camera picked-up, the fish eye images that the wide-angle imaging head is absorbed can produce serious deformation, and it looked like and entire image was mapped on the hemisphere and then this hemisphere is flattened this moment.Therefore, need carry out Nonlinear Processing to the fish eye images of gross distortion, reconstructing the easily plane picture of identification of people according to this fish eye images, be exactly to rebuild in the parts of images from Fig. 1 such as Fig. 2.If as for specifically fish eye images being corrected Nonlinear Processing to obtain plane picture, belong to the known content of those of ordinary skill in the described technical field.
Along with the develop rapidly of internet, thereby can utilize existing internet to come the view data of transmission of video monitoring fully, and needn't build proprietary video network again.For existing monitor network, not only monitoring camera is numerous, and transmits a kind of especially great challenge of a large amount of images that these cameras are taken.And under some specific application, such as family's monitoring, and the bandwidth of family online network present can not be supported a plurality of cameras.
Therefore, need badly a kind of brand-new can be by the video monitoring system of broader applications.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of video monitoring scheme, it has single system framework, lower construction and maintenance cost.
In order to achieve the above object, a kind of video monitoring system of the present invention, it comprises monitor camera device and a monitor terminal, and described monitor camera device comprises that the fish eye images that is used for catching the wide-angle imaging head of fish eye images in real time and is used for obtaining transfers to the network interface on the Internet; Described monitor terminal comprises and being used for by inserting the network interface and the rectification module that is used for the fish eye images that receives is corrected into plane picture that the Internet receives the next fish eye images of described monitor camera device transmission.
Described monitor camera device includes and is used for the transmission mode control module of selected fish eye images transmission mode as required.
Comprise a direct transport module in the described transmission mode control module, the fish eye images that obtains is not handled directly that when this module is activated it is transferred to the Internet by network interface.
Comprise the motion detection transmission control module in the described transmission mode control module, when this module is activated, the fish eye images that obtains is carried out motion detection, when having motion to produce in the described fish eye images, just the fish eye images that obtains is transferred to the Internet by network interface.
Comprise the motion detection transmission control module in the described transmission mode control module, when this module is activated, described fish eye images from the wide-angle imaging head has been divided into some rectangular blocks, each rectangular block image-region all can be endowed a threshold value and set reference frame flake image, movable information in the corresponding rectangular block in present frame fish eye images and the reference frame fish eye images is compared, if during greater than the threshold value of giving for this rectangular block, then thinking, both differences are necessary this rectangular block area image is upgraded and this rectangular block view data is transferred to the Internet by network interface; Otherwise, then think to there is no need this rectangular block area image is upgraded and do not transmit this rectangular block view data.
Described motion detection transmission control module regularly forces to upgrade all rectangular block images, for each rectangular block preset threshold size identical or different.
Comprise in the described transmission mode control module that a chessboard cuts apart transmission control module, it is used for when this module is activated, the fish eye images that obtains is carried out chessboard be divided into some rectangular blocks and grouping, a group with image transfers to the Internet by network interface at every turn.
Comprise the priority level initializing transmission control module in the described transmission mode control module, it is used for when this module is activated, described fish eye images from the wide-angle imaging head some rectangular blocks have been divided into, for each little rectangular block regulation priority, preferentially preferential high rectangular block image is transferred to the Internet by network interface.
Have overlapping between each rectangular block and the adjacent rectangular block mutually.
Described monitor terminal also comprises the memory module that is used for the display module that the plane picture after correcting is shown and is used for the fish eye images storage that receives is got off.
Described monitor terminal also comprises control module, and it is used for controlling described rectification module is the flake video image of selecting to correct in real time from monitor camera device, still selects the flake video image that is stored in the memory module is corrected.
Described monitor terminal also comprises control module, is used for controlling the selected fish eye images transmission mode of described transmission mode control module.
The present invention adopts the fish-eye camera technology, thereby thereby by the drift angle in a space fish-eye camera being set has replaced a plurality of positions and has placed the cost that the method for a plurality of common cameras reduce to be built and safeguarded; Owing to only fish eye images is handled, make and want the image transmitted data to reduce greatly, save a lot of bandwidth costs, thereby improved the possibility that obtains required picture under the situation of unstable networks greatly.
Description of drawings
Fig. 1 is the captured width of cloth fish eye images of wide-angle imaging head;
Fig. 2 is the image after part fish eye images shown in Figure 1 is corrected;
The structured flowchart of an embodiment of Fig. 3 a kind of video monitoring system provided by the invention;
Fig. 4 is the schematic diagram that original fish eye images is divided into rectangular block;
Fig. 5 is that fish eye images shown in Figure 4 is corrected and is the schematic diagram behind the plane picture; And
Fig. 6 is the checkerboard type distribution schematic diagram of the rectangular block of fish eye images shown in Figure 4.
Embodiment
Video monitoring system 100 provided by the invention is based on the wide-angle imaging head and several data transmission preference pattern is provided, thereby simplied system structure, improves the system applies scope.Please referring to shown in Figure 3, in one embodiment, video monitoring system 100 provided by the invention comprises one or more monitor camera devices 200 and monitor terminal 300.Described monitor camera device 200 includes the wide-angle imaging head 202 that is used for acquisition monitoring ground point video image, is used for determining the mode control module 204 of vedio data transmission mode and being used to insert the network interface 206 that the Internet comes the transmitted image data.The memory module 303 that described monitor terminal 300 includes the network interface 302 that is used to insert the Internet and receives view data, be used for the vedio data that network interface 302 receives is stored, the rectification module 304 that is used for the flake vedio data is advanced to correct, be used for display module 306 and control module 308 that the image after correcting is play.
The video image that described wide-angle imaging head 202 is gathered is the fish eye images that deforms, that is to say, the more common camera in zone that this wide-angle imaging head 202 is monitored is a lot of greatly, can reduce the setting of camera so as much as possible, such as long as just can monitor whole room and not need a plurality of common cameras of configuration in the room, can reduce cost effectively and maintenance cost by configuration wide-angle imaging head at a wide-angle imaging head of a drift angle installing in room.
Described mode control module 204 includes direct transmission control module 210, motion detection transmission control module 212, chessboard and cuts apart transmission control module 214 and priority level initializing transport module 216.Described mode control module 204 can select the combination of any transmission control module wherein or several transmission control modules to decide the load mode of video image.When directly transmission control module 210 is controlled image data transmission in elected, the flake video image that wide-angle imaging head 202 is gathered will be that unit directly is sent to the Internet by network interface 206 with the frame.When other three transmission control modules are controlled image data transmission in elected, every frame fish eye images from the wide-angle imaging head can be divided into several rectangular blocks according to pre-defined rule, be divided into 25 rectangular blocks that wait size such as fish eye images shown in Figure 4, size, the quantity of rectangular block can be according to user's requirements set in other embodiments certainly.
In elected during motion detection transmission control module 212, each rectangular block image-region from the fish eye images of wide-angle imaging head all can be endowed a threshold value, the movable information in each rectangular block in the acquisition present frame fish eye images and the movable information of the corresponding rectangular block in the reference frame fish eye images, movable information in the corresponding rectangular block in present frame fish eye images and the reference frame fish eye images is compared, if both differences are during greater than the threshold value of this rectangular block, then think and be necessary this rectangular block area image is upgraded and this rectangular block view data is sent to the Internet by network interface 206, otherwise, then think to there is no need this rectangular block area image is upgraded and do not transmit this rectangular block view data.In a special embodiment, in order to keep the real-time of monitoring image, if there is not the rectangular block image to be considered to be necessary upgrade in long-time, this is to need to force regular all rectangular block images of renewal.It should be noted that, described is that each rectangular block preset threshold can be identical, also can be different, in a special embodiment, can set less threshold value for responsive guarded region, such as the doorway of monitoring the room, important item put area etc., and set bigger threshold value for non-sensitive guarded region, can save bandwidth effectively like this.About the concrete how concrete setting threshold and the movable information of the corresponding rectangular block in the movable information in the rectangular block in the present frame omni-directional image and the reference frame omni-directional image how relatively, these all belong to the known content of ordinary skill those of skill in the art, do not give unnecessary details in this appearance.
When chessboard is cut apart transmission control module 214 and is controlled image data transmission in elected, the divided rectangular block of described fish eye images will be divided into two groups, they are represented with dark and light color respectively in Fig. 6 for the ease of understanding, making each dark grid all is light grid on every side, around each light grid all is dark grid, as the chess chessboard.In current once transmission, all dark colors or light rectangular block image are sent to the Internet by network interface 206, the rectangular block image of all another colors is sent to the Internet by network interface 206 in transmission next time, and so circulation repeatedly.Certainly, among other the embodiment, the divided rectangular block of described fish eye images also can be divided into three groups, four groups or more groups, when being divided into three groups, once transmit one group of rectangular block image and all be sent to the Internet, and then repeat to send the next frame omni-directional image by network interface 206 up to a whole frame fish eye images.Can save bandwidth effectively like this, equally.
When selected priority level initializing transmission control module 216 is controlled image data transmission, the user can be that the divided rectangular block of described fish eye images is set priority as required, rectangular block image prioritised transmission when limited bandwidth that priority is high, higher priority is set in the zone that the user just can be higher with susceptibility like this, such as the doorway of monitoring the room, important item put area etc., and set lower priority for non-sensitive guarded region, can save bandwidth effectively like this.
Which transmission control module is described mode control module 204 can determine to select come the transmission of control chart picture according to man-machine interaction, also can receive by network interface 206 and determine from the control signal of monitor terminal 300.
The network interface 302 of described monitor terminal 300 receives the flake video image of monitor camera device 200 by the Internet, described rectification module 304 can carry out real-time rectification to the fish eye images from monitor camera device 200, also can correct the fish eye images that is stored in the memory module 303, here the correction process of saying is exactly that described rectification module 304 need carry out Nonlinear Processing to the fish eye images of distortion, to reconstruct people's plane picture of identification easily according to this fish eye images.Need to prove, described rectification module 304 can be that unit is corrected fish eye images with the frame, such as when being that the unit transmission time can be that unit is corrected fish eye images with the frame with the frame, also can be that unit is corrected the rectangular block image with the rectangular block, such as when being that the unit transmission time can rectangular block be that unit is corrected the rectangular block image with the rectangular block, specifically, each rectangular block fish eye images A1, B1, C1, D1, the E1 among Fig. 4 will be corrected as each rectangular block plane picture A, B, C, D, E among Fig. 5.In one embodiment, because fish eye images is out of shape, the rectangular block image of fish eye images rectangle certainly not after overcorrection so, but irregular figure can be got the output rectangular block plane picture of a rectangle of maximum area wherein as rectification module 304 so.It is exactly to have given up the information at a part of original image edge that yet a shortcoming is arranged like this, in order to remedy such shortcoming, in a special embodiment, before fish eye images is transmitted, can be when fish eye images be divided into rectangular block, can allow the part that overlaps each other between the rectangular block, such as the rectangular block B4 among Fig. 6 can with all overlapping sub-fraction of rectangular block B1, B2, B6, B7, A2, A4, A5, A7 on every side, can guarantee like this at each rectangular block behind process rectification module 304, to lose try one's best few image information or even loss.The rectangular block plane picture of the synchronization after the rectification can be pieced together the described display module 306 that coexists, and also can independently show at described display module 306.
It is flake video images of selecting to correct in real time from monitor camera device 200 that the user can control described rectification module 304 by described control module 308, still select the flake video image that is stored in the memory module 303 is corrected, in addition, the user also can control described mode control module 204 selected suitable transmission control modules by described control module 308, thereby has realized far-end control.
Described monitor camera device 200 can insert the Internet by any medium with the network interface of monitor terminal 300, such as get online without being tethered to a cable, the cable online, as long as it is just passable to be connected into the Internet.
The present invention handles the fish eye images that obtains by diverse ways according to different demands.Make and want the image transmitted data to reduce greatly, saved a lot of bandwidth costs, thereby improved the possibility that obtains required picture under the situation of unstable networks greatly.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement etc., all should be included within protection scope of the present invention.

Claims (10)

1. video monitoring system, it comprises monitor camera device and a monitor terminal, it is characterized in that described monitor camera device comprises that the fish eye images that is used for catching the wide-angle imaging head of fish eye images in real time and is used for obtaining transfers to the network interface on the Internet; Described monitor terminal comprises and being used for by inserting the network interface and the rectification module that is used for the fish eye images that receives is corrected into plane picture that the Internet receives the next fish eye images of described monitor camera device transmission, described monitor camera device includes and is used for the transmission mode control module of selected fish eye images transmission mode as required, wherein
Described transmission mode control module includes direct transmission control module, motion detection transmission control module, chessboard and cuts apart transmission control module and priority level initializing transport module, described mode control module can select the combination of any transmission control module wherein or several transmission control modules to decide the load mode of video image
Described monitor terminal also comprises control module, is used for controlling the selected fish eye images transmission mode of described transmission mode control module.
2. system according to claim 1 is characterized in that, the fish eye images that obtains is not handled directly that when described direct transport module is activated it is transferred to the Internet by network interface.
3. system according to claim 1, it is characterized in that, when described motion detection transmission control module is activated, the fish eye images that obtains is carried out motion detection, when having motion to produce in the described fish eye images, just the fish eye images that obtains is transferred to the Internet by network interface.
4. system according to claim 1, it is characterized in that, when described motion detection transmission control is activated, described fish eye images from the wide-angle imaging head has been divided into some rectangular blocks, each rectangular block image-region all can be endowed a threshold value and set reference frame flake image, movable information in the corresponding rectangular block in present frame fish eye images and the reference frame fish eye images is compared, if during greater than the threshold value of giving for this rectangular block, then thinking, both differences are necessary this rectangular block area image is upgraded and this rectangular block view data is transferred to the Internet by network interface; Otherwise, then think to there is no need this rectangular block area image is upgraded and do not transmit this rectangular block view data.
5. system according to claim 4 is characterized in that, described motion detection transmission control module regularly forces to upgrade all rectangular block images, for each rectangular block preset threshold size identical or different.
6. system according to claim 1, it is characterized in that, when described chessboard is cut apart transmission control module and is activated, the fish eye images that obtains is carried out chessboard be divided into some rectangular blocks and grouping, a group with image transfers to the Internet by network interface at every turn.
7. system according to claim 1, it is characterized in that, when described priority level initializing transmission control module is activated, described fish eye images from the wide-angle imaging head some rectangular blocks have been divided into, for each little rectangular block regulation priority, preferentially preferential high rectangular block image is transferred to the Internet by network interface.
8. according to claim 4, one of 6 or 7 described systems, it is characterized in that having overlapping between each rectangular block and the adjacent rectangular block mutually.
9. system according to claim 1 is characterized in that, described monitor terminal also comprises the memory module that is used for the display module that the plane picture after correcting is shown and is used for the fish eye images storage that receives is got off.
10. system according to claim 9, it is characterized in that, described monitor terminal also comprises control module, it is used for controlling described rectification module is the flake video image of selecting to correct in real time from monitor camera device, still selects the flake video image that is stored in the memory module is corrected.
CN200610113524A 2006-09-29 2006-09-29 Video frequency monitoring system Active CN100593334C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200610113524A CN100593334C (en) 2006-09-29 2006-09-29 Video frequency monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200610113524A CN100593334C (en) 2006-09-29 2006-09-29 Video frequency monitoring system

Publications (2)

Publication Number Publication Date
CN1933598A CN1933598A (en) 2007-03-21
CN100593334C true CN100593334C (en) 2010-03-03

Family

ID=37879179

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200610113524A Active CN100593334C (en) 2006-09-29 2006-09-29 Video frequency monitoring system

Country Status (1)

Country Link
CN (1) CN100593334C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577002B (en) * 2009-06-16 2011-12-28 天津理工大学 Calibration method of fish-eye lens imaging system applied to target detection
CN102148962A (en) * 2011-03-16 2011-08-10 中山爱科数字科技有限公司 Dual-digital signal processing (DSP) visual tracking remote monitoring system
CN104360599B (en) * 2014-11-10 2018-10-26 生迪光电科技股份有限公司 Wired home control method, equipment and system based on LED light device
CN106101639A (en) * 2016-07-18 2016-11-09 北京奇虎科技有限公司 The method for processing video frequency of a kind of cradle head camera and device
CN106534650A (en) * 2016-12-21 2017-03-22 北京疯景科技有限公司 System and method for photographing panoramic image
CN111405150A (en) * 2019-02-27 2020-07-10 深圳启萌星科技有限公司 Interactive system and method based on image segmentation

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于棋盘分割插值的多描述视频编码. 范晨,崔慧娟,唐昆.中国科学(E辑),第33卷第10期. 2003
基于棋盘分割插值的多描述视频编码. 范晨,崔慧娟,唐昆.中国科学(E辑),第33卷第10期. 2003 *

Also Published As

Publication number Publication date
CN1933598A (en) 2007-03-21

Similar Documents

Publication Publication Date Title
CN100593334C (en) Video frequency monitoring system
US8754941B1 (en) Multi-imager video camera with frame-by-frame view switching
CN102510474B (en) 360-degree panorama monitoring system
CN107113391B (en) Information processing apparatus and method
CN107659774A (en) A kind of video imaging system and method for processing video frequency based on multiple dimensioned camera array
CN103716527B (en) Method and equipment for determining working mode of camera equipment
MX2011009681A (en) Intelligent monitoring camera apparatus and image monitoring system implementing same.
US20130235149A1 (en) Image capturing apparatus
US20070109407A1 (en) Surveillance device
WO2003067517B1 (en) Apparatus and method for providing electronic image manipulation in video conferencing applications
JP2005517331A5 (en)
EP2338274A2 (en) A monitor having integral camera and method of operating the same
CN102714711A (en) Tracking and monitoring camera device and remote monitoring system using same
US20240007741A1 (en) Method and system for correcting image
CA2828933C (en) Video processing apparatus, video processing system, and video processing method
CN105516596A (en) Method, device, and system for processing panoramic photography
EP3846462A1 (en) Image sensor, method for acquiring image data from image sensor, and camera device
CN202872936U (en) 360-degree non-blind area panorama video shooting device based on regular polyhedron
CN102868853A (en) 360-degree non-blind area panorama video shooting device based on regular polyhedron
CN113271447B (en) Laser projection apparatus and image correction system
CN103002249A (en) Image splicing based SDI (serial digital interface) panorama pickup system
US9438808B2 (en) Image capture control apparatus, method of limiting control range of image capture direction, and storage medium
US9214486B2 (en) Imaging device and imaging apparatus generating image information for each of plural pixels from received light
CN204408486U (en) 176 ° of super wide viewing angle video cameras
CN102780871A (en) Panorama-spreading system for analog video monitor and panorama-spreading methods

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: SHANXI ZHONGTIANXIN TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: BEIJING VIMICRO ELECTRONICS CO., LTD.

Effective date: 20121211

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100083 HAIDIAN, BEIJING TO: 030032 TAIYUAN, SHAANXI PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20121211

Address after: 105, room 3, building 6, Kaiyuan street, Taiyuan economic and Technological Development Zone, Shanxi 030032, China

Patentee after: SHANXI VIMICRO TECHNOLOGY CO., LTD.

Address before: 100083, Haidian District, Xueyuan Road, Beijing No. 35, Nanjing Ning building, 15 Floor

Patentee before: Beijing Vimicro Corporation