CN102082957B - Method and device for checking synchronism of multi-visual-angle acquisition system - Google Patents

Method and device for checking synchronism of multi-visual-angle acquisition system Download PDF

Info

Publication number
CN102082957B
CN102082957B CN2011100014439A CN201110001443A CN102082957B CN 102082957 B CN102082957 B CN 102082957B CN 2011100014439 A CN2011100014439 A CN 2011100014439A CN 201110001443 A CN201110001443 A CN 201110001443A CN 102082957 B CN102082957 B CN 102082957B
Authority
CN
China
Prior art keywords
acquisition system
visual angles
various visual
angles acquisition
visual angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2011100014439A
Other languages
Chinese (zh)
Other versions
CN102082957A (en
Inventor
戴琼海
林星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN2011100014439A priority Critical patent/CN102082957B/en
Publication of CN102082957A publication Critical patent/CN102082957A/en
Application granted granted Critical
Publication of CN102082957B publication Critical patent/CN102082957B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a method and device for checking synchronism of a multi-visual-angle acquisition system, wherein the method comprises the following steps of: acquiring a state of an object of the same image sequences through each visual angle camera of a multi-visual angle acquisition system; and judging whether the multi-visual angle acquisition system is synchronous according to the state of the object of the same image sequences, acquired by each visual angle camera. The method provided by the invention can be used for checking the accuracy of the system synchronisms of different grades according to the demands, thereby ensuring that the nonsynchronous error of the multi-visual angle acquisition system is controlled within different accuracy ranges, and ensuring that the result calculated according to the image acquired by the multi-visual-angle acquisition system is right.

Description

The method and the device of the synchronism of check various visual angles acquisition system
Technical field
The present invention relates to communication technical field, particularly a kind of method and device of checking the synchronism of various visual angles acquisition system.
Background technology
Catch and the modeling technique of realization dynamic scene is one of core technology of the following visual media revolution of promotion.For a long time, obtaining of real world information is mainly derived from catching of single camera and based on the virtual generation technique of the graph image of graphics.But; Along with the development of related discipline and the driving of new technology demand; Traditional single camera acquisition geometry can not bring human eye depth perception, third dimension and to the omnibearing understanding of object; And the virtually drawing technology that traditional graph is learned receives the limitation of complexity, the sense of reality, can't obtain and show the information of complicacy nature world medium effectively.For this reason; Obtaining in real time and reconstruction technique based on the various visual angles of video camera array proposed; It not only can capturing scenes and geometry information, texture information and the movable information of object, and the reflecting attribute and the surround lighting that can also obtain scene and subject surface change.Each visual angle camera of the various visual angles acquisition system of usually, being built needs synchronous acquisition to guarantee the accuracy of arithmetic result.
The realization of the synchronism of various visual angles acquisition system mainly contains dual mode, and a kind of is to utilize the application interface program of using camera, uses software to realize synchronously; Another kind is an external trigger function of utilizing programmable camera, utilizes hardware to produce the external trigger signal and realizes synchronously.The method that the latter uses hardware to produce the external trigger signal can produce synchronizing signal more accurately; But; Since the influence of uncertainty, transfer of data for example in enormous quantities, camera response time, image frame losing etc., and the synchronism between the final resultant multi-view image can't be guaranteed.Therefore, need a kind of synchronism of method check various visual angles acquisition system, thereby guarantee the accuracy of arithmetic result.
Summary of the invention
The object of the invention is intended to solve at least one of above-mentioned technological deficiency, particularly proposes a kind of method and apparatus of checking the synchronism of various visual angles acquisition system.
For achieving the above object, one aspect of the present invention proposes a kind of method of checking the synchronism of various visual angles acquisition system, may further comprise the steps: the state of gathering the object of same image sequence through each visual angle camera of various visual angles acquisition system; And the state of the object of the same image sequence that collects according to said each visual angle camera, judge whether said various visual angles acquisition system is synchronous.
In one embodiment of the invention; Be not more than the synchronization accuracy of said various visual angles acquisition system the blanking time between the different conditions of the object of said same image sequence, the time for exposure of each visual angle camera of said various visual angles acquisition system is not more than the blanking time between the different conditions of object of said same image sequence.
In one embodiment of the invention; The state of the object of the said same image sequence that collects according to said each visual angle camera judges whether said various visual angles acquisition system is synchronous; Further comprise:, judge that then said various visual angles acquisition system is synchronous if the state of the object of the same image sequence that said each visual angle camera collects is all identical; And if the state of the object of the same image sequence that collects of said each visual angle camera is different, judges that then said various visual angles acquisition system is asynchronous.
Another aspect of the present invention also proposes a kind of device of checking the synchronism of various visual angles acquisition system, comprising: counter and judging unit.Wherein, said counter is used for counting at interval according to predefined gate time, and gathers the counting of said counter through each visual angle camera synchronization of said various visual angles acquisition system; Said judging unit is used for the count value of the said counter that each visual angle camera according to said various visual angles acquisition system collects, and judges whether said various visual angles acquisition system is synchronous.
In one embodiment of the invention, said counter comprises the Multi-bit LED lamp, and said Multi-bit LED is used to show the binary counting value of said counter.
In one embodiment of the invention; Said predefined gate time is not more than the synchronization accuracy of said various visual angles acquisition system at interval; Just, the light on and off time interval of the lowest order of said Multi-bit LED lamp is not more than the synchronization accuracy of said various visual angles acquisition system.The time for exposure of said various visual angles acquisition system is not more than the light on and off time interval of the lowest order of said Multi-bit LED lamp.
The short exposure of the present invention through each visual angle camera of various visual angles acquisition system is provided with to gather the high-speed counting instrument and judge that the state of gathering the resulting object of same image sequence is whether consistent judges the synchronism of acquisition system from various visual angles; Adopt this mode can verify the precision of the system synchronization property of different stage as required; Thereby the asynchronous ERROR CONTROL that guarantees the various visual angles acquisition system guarantees that the result calculated that the image according to the collection of various visual angles acquisition system carries out is correct in different accuracy ratings.
Aspect that the present invention adds and advantage part in the following description provide, and part will become obviously from the following description, or recognize through practice of the present invention.
Description of drawings
Above-mentioned and/or additional aspect of the present invention and advantage are from obviously with easily understanding becoming the description of embodiment below in conjunction with accompanying drawing, wherein:
Fig. 1 is the flow chart of method of synchronism of the check various visual angles acquisition system of the embodiment of the invention;
Fig. 2 is the time for exposure sequential chart identical with the light on and off time interval of the lowest order of Multi-bit LED lamp of each visual angle camera of various visual angles acquisition system;
Fig. 3 is the sequential chart of the time for exposure of each visual angle camera of acquisition system from various visual angles less than the light on and off time interval of the lowest order of Multi-bit LED lamp;
Fig. 4 is the sequential chart of the time for exposure of each visual angle camera of acquisition system from various visual angles greater than the light on and off time interval of the lowest order of Multi-bit LED lamp;
Fig. 5 a is the state diagram of 16 LED lamps of the initial time in a sampling period of camera at the visual angle according to an embodiment of the invention;
Fig. 5 b is the state diagram of 16 LED lamps of the finish time in a sampling period of camera at the visual angle according to an embodiment of the invention; And
Fig. 6 is the structural representation of device of synchronism of the check various visual angles acquisition system of the embodiment of the invention.
Embodiment
Describe embodiments of the invention below in detail, the example of said embodiment is shown in the drawings, and wherein identical from start to finish or similar label is represented identical or similar elements or the element with identical or similar functions.Be exemplary through the embodiment that is described with reference to the drawings below, only be used to explain the present invention, and can not be interpreted as limitation of the present invention.
Be illustrated in figure 1 as the flow chart of method of synchronism of the check various visual angles acquisition system of the embodiment of the invention, this method may further comprise the steps:
Step S101 gathers the state of the object of same image sequence through each visual angle camera synchronization of various visual angles acquisition system.
Because the LED light fixture has characteristics such as high brightness, response speed be fast, in one embodiment of the invention, the synchronism of utilizing the mode of LED lamp binary counting to come verification system.Utilize the light on and off of high low level arrangement of LED lamp and single-chip microcomputer counting/timing controlled lamp to simulate binary stopwatch; Each visual angle camera synchronization is gathered the Multi-bit LED lamp of high-speed counting; Comprise specific binary counting value in the image that finally obtains, just, for each image has been stamped timestamp.
It should be noted, the light on and off time interval of the lowest order of Multi-bit LED lamp should be not more than the synchronization accuracy of the various visual angles acquisition system that will check.In addition, in order to verify synchronism, the high speed light on and off that each visual angle camera need select the rational time for exposure to catch the LED lamp change.The concrete discussion as follows:
Be illustrated in figure 2 as the time for exposure sequential chart identical of each visual angle camera of various visual angles acquisition system with the light on and off time interval of the lowest order of Multi-bit LED lamp.Can know by Fig. 2, when the lowest order duration of time for exposure of each visual angle camera and Multi-bit LED lamp on/off is identical, in the time, the lamp of same light yellow only can occur at single exposure.Though brightness possibly not be the corresponding situation of full integration, can not appear at single exposure bright twice situation in the most accurate site in the time, therefore, the time for exposure of each visual angle camera can equal the light on and off time interval of the lowest order of Multi-bit LED lamp.
The time for exposure of each visual angle camera that is illustrated in figure 3 as the various visual angles acquisition system is less than the sequential chart in the light on and off time interval of the lowest order of Multi-bit LED lamp.Can know by Fig. 3; As long as the time for exposure is less than the lowest order duration of Multi-bit LED lamp on/off, though the multiterminal that are provided with of time for exposure, at single exposure in the time; Always may sample " 1 " and " 0 " two states, can judge the synchronism of various visual angles acquisition system according to the state that collects.Therefore, the time for exposure of each visual angle camera can be less than the light on and off time interval of the lowest order of Multi-bit LED lamp.
The time for exposure of each visual angle camera that is illustrated in figure 4 as the various visual angles acquisition system is greater than the sequential chart in the light on and off time interval of the lowest order of Multi-bit LED lamp.Can know by Fig. 4,, sample two " 1 " again in the time for exposure, so just can't judge the synchronism of various visual angles acquisition system according to the state that collects when time for exposure during greater than the lowest order duration of Multi-bit LED lamp on/off.Therefore, the time for exposure of each visual angle camera cannot be greater than the light on and off time interval of the lowest order of Multi-bit LED lamp.
In sum; In order to verify the synchronism of various visual angles acquisition system; The time for exposure of each visual angle camera of various visual angles acquisition system should be not more than the lowest order duration of Multi-bit LED lamp; Just, time for exposure of each visual angle camera of various visual angles acquisition system should be not more than the blanking time between the different conditions of object of same image sequence.
Step S102, the state of the object of the same image sequence that collects according to each visual angle camera judges whether the various visual angles acquisition system is synchronous.
Particularly, if the state of the object of the same image sequence that each visual angle collects is all identical, judge that then the various visual angles acquisition system is synchronous; If the state of the object of the same image sequence that each visual angle collects is all not identical, judge that then the various visual angles acquisition system is asynchronous.
According to one embodiment of present invention, the synchronization accuracy of the various visual angles acquisition system of supposing to verify is 1ms, and the lowest order duration of Multi-bit LED lamp is set to 1ms, and the time for exposure of each visual angle camera is set to 1ms.So; The binary counting value of the LED lamp in the same sequence of pictures that each visual angle camera of comparison collects; If the LED binary counting value of all visual angle cameras in same sequence is all identical; The synchronization accuracy that then shows the various visual angles acquisition system can reach 1ms, otherwise, show that the synchronization accuracy of system can't reach 1ms.
In another embodiment of the present invention, also can be according to the frame per second of the state verification camera of the image sequence that collects.Shown in Fig. 5 a and Fig. 5 b, be respectively the initial time in a sampling period of camera and the state diagram of 16 LED lamps of the finish time at the visual angle according to an embodiment of the invention, wherein, the black indication lamp is bright.In Fig. 5 a and Fig. 5 b, the sampling period is 50ms, and the time for exposure of visual angle camera is 0.4ms; The light on and off cycle of LED lamp is 0.4ms, only looks down on eight, is 18 in the count value of the initial time in sampling period; Count value in finish time in sampling period is 143, and therefore, the sampling period that test obtains is 0.4ms * (143-18)=50ms; Identical with settings, show that camera is can operate as normal under the 20pfs in frame per second.
For realizing the foregoing description, the present invention also proposes a kind of device of checking the synchronism of various visual angles acquisition system.Be illustrated in figure 6 as the structural representation of device of synchronism of the check various visual angles system of the embodiment of the invention, this device comprises counter 10 and judging unit 20.
Counter 10 is used for counting at interval according to predefined gate time, and gathers the counting of counter through each visual angle camera synchronization of various visual angles acquisition system 30.Judging unit 20 is used for the count value of the counter 10 that each visual angle camera according to various visual angles acquisition system 30 collects, and judges whether institute's various visual angles acquisition system 30 is synchronous.
In one embodiment of the invention, counter 10 can comprise Multi-bit LED lamp (not shown), with the count value of the mode display counter of LED binary counting.The predefined gate time of counter 10 is not more than the synchronization accuracy of various visual angles acquisition system 30 at interval, and just, the light on and off time interval of the lowest order of Multi-bit LED lamp is not more than the synchronization accuracy of various visual angles acquisition system 30.In addition, the time for exposure of each visual angle camera of various visual angles acquisition system 30 is not more than the light on and off time interval of the lowest order of Multi-bit LED lamp.
If the binary counting value of the Multi-bit LED lamp in the same sequence of pictures that 30 each visual angle cameras of various visual angles acquisition system collect is all identical, judge that then various visual angles acquisition system 30 is synchronous; If the binary counting value of the Multi-bit LED lamp in the same sequence of pictures that each visual angle camera of various visual angles acquisition system 30 collects is all not identical, judge that then various visual angles acquisition system 30 is asynchronous.
The short exposure of the present invention through each visual angle camera of various visual angles acquisition system is provided with to gather the high-speed counting instrument and judge that the state of gathering the resulting object of same image sequence is whether consistent judges the synchronism of acquisition system from various visual angles; Adopt this mode can verify the precision of the system synchronization property of different stage as required; Thereby the asynchronous ERROR CONTROL that guarantees the various visual angles acquisition system guarantees that the result calculated that the image according to the collection of various visual angles acquisition system carries out is correct in different accuracy ratings.
Although illustrated and described embodiments of the invention; For those of ordinary skill in the art; Be appreciated that under the situation that does not break away from principle of the present invention and spirit and can carry out multiple variation, modification, replacement and modification that scope of the present invention is accompanying claims and be equal to and limit to these embodiment.

Claims (1)

1. a device of checking the synchronism of various visual angles acquisition system is characterized in that, comprises counter and judging unit,
Said counter is used for counting at interval according to predefined gate time, and the count value of gathering said counter through each visual angle camera synchronization of said various visual angles acquisition system; And
Said judging unit is used for the count value of the said counter that each visual angle camera according to said various visual angles acquisition system collects, and judges whether said various visual angles acquisition system is synchronous,
Wherein, Said counter comprises the Multi-bit LED lamp; Said Multi-bit LED lamp is used to show the binary counting value of said counter, and said predefined gate time is not more than the synchronization accuracy of said various visual angles acquisition system at interval, and the light on and off time interval of the lowest order of said Multi-bit LED lamp is not more than the synchronization accuracy of said various visual angles acquisition system; And the time for exposure of said various visual angles acquisition system is not more than the light on and off time interval of the lowest order of said Multi-bit LED lamp
Said judging unit judges according to the count value of the said counter that each visual angle camera of said various visual angles acquisition system collects whether said various visual angles acquisition system is synchronous, further comprises:
If the binary counting value of the Multi-bit LED lamp in the same sequence of pictures that each visual angle camera of said various visual angles acquisition system collects is all identical, judge that then said various visual angles acquisition system is synchronous;
If the binary counting value of the Multi-bit LED lamp in the same sequence of pictures that each visual angle camera of said various visual angles acquisition system collects is all not identical, judge that then said various visual angles acquisition system is asynchronous.
CN2011100014439A 2011-01-05 2011-01-05 Method and device for checking synchronism of multi-visual-angle acquisition system Expired - Fee Related CN102082957B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100014439A CN102082957B (en) 2011-01-05 2011-01-05 Method and device for checking synchronism of multi-visual-angle acquisition system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100014439A CN102082957B (en) 2011-01-05 2011-01-05 Method and device for checking synchronism of multi-visual-angle acquisition system

Publications (2)

Publication Number Publication Date
CN102082957A CN102082957A (en) 2011-06-01
CN102082957B true CN102082957B (en) 2012-08-22

Family

ID=44088682

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100014439A Expired - Fee Related CN102082957B (en) 2011-01-05 2011-01-05 Method and device for checking synchronism of multi-visual-angle acquisition system

Country Status (1)

Country Link
CN (1) CN102082957B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108366254A (en) * 2018-01-22 2018-08-03 浙江舜宇智能光学技术有限公司 Multi-path camera audio video synchronization evaluating system and method
CN110740251B (en) * 2018-07-20 2021-09-24 杭州海康机器人技术有限公司 Multi-camera synchronous stream taking method, device and system
CN110913206B (en) * 2019-11-28 2021-06-15 西安航光仪器厂 Device and method for detecting exposure synchronism of camera of multi-view aerial camera
CN111556225B (en) * 2020-05-20 2022-11-22 杭州海康威视数字技术股份有限公司 Image acquisition device and image acquisition control method
CN112055196B (en) * 2020-08-26 2023-03-24 哈尔滨工业大学 Synchronous acquisition time interval measuring method for two cameras based on light flicker

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995140A (en) * 1995-08-28 1999-11-30 Ultrak, Inc. System and method for synchronization of multiple video cameras
GB2371161A (en) * 2001-01-12 2002-07-17 Primary Image Synchronising a plurality of independent video signal generators
CN1525748A (en) * 2003-02-28 2004-09-01 ��ʽ���絺���������� Photographic apparatus and synchronous photography timing controller
CN101014136A (en) * 2007-02-05 2007-08-08 北京大学 Time synchronizing method and system for multi-view video collection
CN101431603A (en) * 2008-12-17 2009-05-13 广东威创视讯科技股份有限公司 Method for multi-camera sync photography and its detection apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995140A (en) * 1995-08-28 1999-11-30 Ultrak, Inc. System and method for synchronization of multiple video cameras
GB2371161A (en) * 2001-01-12 2002-07-17 Primary Image Synchronising a plurality of independent video signal generators
CN1525748A (en) * 2003-02-28 2004-09-01 ��ʽ���絺���������� Photographic apparatus and synchronous photography timing controller
CN101014136A (en) * 2007-02-05 2007-08-08 北京大学 Time synchronizing method and system for multi-view video collection
CN101431603A (en) * 2008-12-17 2009-05-13 广东威创视讯科技股份有限公司 Method for multi-camera sync photography and its detection apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
田雁 等.高速摄像测量系统同步控制.《电子技术》.2005,(第4期),第51-53页. *
谭树人 等.多传感器同步图像采集系统的设计.《电视技术》.2006,(第9期),第84-87页. *

Also Published As

Publication number Publication date
CN102082957A (en) 2011-06-01

Similar Documents

Publication Publication Date Title
CN102082957B (en) Method and device for checking synchronism of multi-visual-angle acquisition system
US10404969B2 (en) Method and apparatus for multiple technology depth map acquisition and fusion
CN109104259A (en) A kind of multisensor clock synchronization synchronization system and method
CN111741185B (en) Light supplement control method, device, system and equipment and storage medium
CN109218619A (en) Image acquiring method, device and system
CN102706290B (en) Structured light projector meeting variation ranges of high speed and high brightness
CN103856764B (en) A kind of device utilizing double-shutter to be monitored
CN107948515A (en) A kind of camera synchronous method and device, binocular camera
CN108028887A (en) Focusing method of taking pictures, device and the equipment of a kind of terminal
CN103712576B (en) Programming-controlled grating projection device
CN106576159A (en) Photographing device and method for acquiring depth information
CN107948463A (en) A kind of camera synchronous method, apparatus and system
CN202393715U (en) Automatic detecting device for grey cloth defect spot
CN104969507B (en) Dither circuit for serial data transmission
CN104202541A (en) Image synthesizer
CN110191266A (en) Data processing method, device, electronic equipment and computer readable storage medium
CN112004077B (en) Calibration method and device for off-screen camera, storage medium and electronic equipment
CN111682918B (en) Synchronous control method, device and system of sensor and storage medium
CN102184711B (en) Backlight driving method and backlight driving device
JP2011182374A (en) Method for measuring total delay time of real-time video transmission using timer making still display of photographic time
CN102780840B (en) Imaging apparatus
CN114205581A (en) Time sequence design method for improving calibration precision of silicon-based OLED micro-display assembly
CN106370296A (en) Detection method and system for the environment light by mobile terminal light sensor
CN104159102B (en) Grey menu detection method and checkout gear
CN109889803A (en) A kind of structure light image acquisition methods and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120822