CN114697466B - Video frame acquisition synchronization control - Google Patents
Video frame acquisition synchronization control Download PDFInfo
- Publication number
- CN114697466B CN114697466B CN202210263854.3A CN202210263854A CN114697466B CN 114697466 B CN114697466 B CN 114697466B CN 202210263854 A CN202210263854 A CN 202210263854A CN 114697466 B CN114697466 B CN 114697466B
- Authority
- CN
- China
- Prior art keywords
- shooting
- time
- period
- shooting time
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the application provides a video frame acquisition synchronous control method, a video frame acquisition synchronous control device, a video camera, a video system and a storage medium, wherein the system time of the video camera is calibrated according to a received clock synchronous signal of a master clock device according to a preset clock synchronous period; according to a preset shooting calibration period, calibrating shooting time by taking the system time of the camera as a clock source to obtain calibrated shooting time; taking the system time of the camera as a clock source, and shooting video frames according to the calibrated shooting time; each camera in the synchronous shooting system is in clock synchronization with the master clock device, the system time of each camera is the same, each camera calibrates the shooting time by taking the system time of each camera as a clock source, and the same shooting time of each camera is ensured, so that the synchronous control of video frame acquisition of multiple cameras is realized.
Description
Technical Field
The application relates to the technical field of image processing, in particular to a video frame acquisition synchronous control method and device.
Background
The cameras in the monitoring field generally work independently, video acquisition signals among different cameras do not have corresponding synchronization mechanisms, and in some scenes of multi-camera collaborative shooting, for example, multi-angle collaborative shooting of the same object or splicing collaborative shooting of scenes with a larger range, synchronous shooting of video frames among the plurality of cameras is needed, so that in the monitoring field, how to realize synchronous control of video frame acquisition of the plurality of cameras becomes a technical problem to be solved urgently.
Disclosure of Invention
The embodiment of the application aims to provide a video frame acquisition synchronous control method and device so as to realize the video frame acquisition synchronous control of multiple cameras. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for synchronously controlling video frame acquisition, which is applied to a camera in a synchronous shooting system, where the synchronous shooting system includes a plurality of cameras, and the method includes:
according to a preset clock synchronization period, calibrating the system time of the camera according to a received clock synchronization signal of the master clock device;
according to a preset shooting calibration period, taking the system time of the camera as a clock source, and acquiring shooting time deviation of a video frame and period duration of a single synchronous shooting period;
determining a target adjusting mode of shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing shooting intervals and reducing the shooting intervals;
determining an adjusting step length according to the current synchronous shooting period, a target period to be calibrated and the shooting time deviation;
calibrating shooting time based on the adjusting step length according to the target adjusting mode to obtain calibrated shooting time;
taking the system time of the camera as a clock source, and shooting video frames according to the calibrated shooting time.
In one possible implementation manner, the acquiring, according to a preset shooting calibration period, a shooting time deviation of a video frame and a period duration of a single synchronous shooting period with a system time of the camera as a clock source includes:
acquiring the system time of the camera to obtain a first moment when a field synchronous signal is detected after starting shooting time calibration according to a preset shooting calibration period;
acquiring the period duration of a single synchronous shooting period;
and performing remainder operation on the first moment by using the period duration to obtain shooting moment deviation of the video frame.
In one possible implementation manner, the determining an adjustment step according to a current synchronous shooting period, a target period to be calibrated and the shooting time deviation includes:
determining a time length to be adjusted according to the shooting time deviation, and acquiring a second time for determining the time length to be adjusted, wherein the time length to be adjusted is a difference value between the period time length and the shooting time deviation when half of the period time length is smaller than the shooting time deviation; when half of the period duration is not less than the shooting time deviation, the duration to be adjusted is the shooting time deviation;
and calculating to obtain an adjusting step length according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated and the shooting time of the current synchronous shooting period.
In one possible implementation manner, the calculating to obtain the adjustment step size according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated, and the shooting time of the current synchronous shooting period includes:
the adjustment step is calculated according to the following formula:
t1 is the shooting time of the current synchronous shooting period, T2 is the shooting time of the target period, N1 is the frame interval from the second time to the adjustment step calculation time, N2 is the frame interval from the adjustment step calculation time to the shooting time of the target period, N x For the preset smooth frame number, δt is the duration to be adjusted.
In one possible implementation manner, the determining the target adjustment manner of the shooting time according to the shooting time deviation and the period duration includes:
under the condition that half of the period duration is smaller than the shooting time deviation, judging to adjust shooting time in a mode of increasing shooting intervals;
and in the case that half of the period duration is not less than the shooting time deviation, judging that the shooting time is adjusted by adopting a mode of reducing the shooting interval.
In one possible implementation manner, the calibrating the shooting time based on the adjustment step according to the target adjustment manner, to obtain the calibrated shooting time includes:
according to the target regulation mode and the regulation step length, regulating a field synchronous signal regulation parameter;
and calibrating the shooting time according to the adjusted field synchronous signal adjustment parameters to obtain the calibrated shooting time.
In one possible embodiment, the method further comprises:
and adjusting the exposure parameters of the camera according to the adjusted field synchronous signal adjustment parameters.
In a second aspect, an embodiment of the present application provides a video frame acquisition synchronization control apparatus applied to a camera in a synchronization shooting system, where the synchronization shooting system includes a plurality of cameras, the apparatus includes:
the system time calibration module is used for calibrating the system time of the camera according to a preset clock synchronization period and the received clock synchronization signal of the master clock device;
the data acquisition module is used for acquiring the shooting time deviation of the video frame and the period duration of a single synchronous shooting period by taking the system time of the camera as a clock source according to a preset shooting calibration period;
the adjusting mode determining module is used for determining a target adjusting mode of the shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing the shooting interval and reducing the shooting interval;
the adjusting step length determining module is used for determining an adjusting step length according to the current synchronous shooting period, the target period to be calibrated and the shooting time deviation;
the shooting time calibration module is used for calibrating the shooting time based on the adjustment step length according to the target adjustment mode to obtain calibrated shooting time;
and the video frame acquisition synchronous control module is used for taking the system time of the camera as a clock source and shooting the video frames according to the calibrated shooting time.
In a possible implementation manner, the data acquisition module is specifically configured to: acquiring the system time of the camera to obtain a first moment when a field synchronous signal is detected after starting shooting time calibration according to a preset shooting calibration period; acquiring a preset shooting time of a designated synchronous shooting period and a period duration of a single synchronous shooting period; calculating a difference value between the first moment and the preset shooting moment; and performing residual operation on the difference value and the period duration to obtain shooting moment deviation of the video frame.
In a possible embodiment, the adjustment step size determining module is specifically configured to: determining a time length to be adjusted according to the shooting time deviation, and acquiring a second time for determining the time length to be adjusted, wherein the time length to be adjusted is a difference value between the period time length and the shooting time deviation when half of the period time length is smaller than the shooting time deviation; when half of the period duration is not less than the shooting time deviation, the duration to be adjusted is the shooting time deviation; and calculating to obtain an adjusting step length according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated and the shooting time of the current synchronous shooting period.
In a possible embodiment, the adjustment step size determining module is specifically configured to:
the adjustment step is calculated according to the following formula:
t1 is the shooting time of the current synchronous shooting period, T2 is the shooting time of the target period, N1 is the frame interval from the second time to the adjustment step length calculation time, and N2 is the shooting time from the adjustment step length calculation time to the target periodFrame interval, N x For the preset smooth frame number, δt is the duration to be adjusted.
In one possible implementation manner, the adjustment mode determining module is specifically configured to: under the condition that half of the period duration is smaller than the shooting time deviation, judging to adjust shooting time in a mode of increasing shooting intervals; and in the case that half of the period duration is not less than the shooting time deviation, judging that the shooting time is adjusted by adopting a mode of reducing the shooting interval.
In one possible implementation manner, the shooting time calibration module is specifically configured to: according to the target regulation mode and the regulation step length, regulating a field synchronous signal regulation parameter; and calibrating the shooting time according to the adjusted field synchronous signal adjustment parameters to obtain the calibrated shooting time.
The embodiment of the application has the beneficial effects that:
the video frame acquisition synchronous control method, the video frame acquisition synchronous control device, the video camera, the video frame acquisition synchronous control system and the storage medium calibrate the system time of the video camera according to the received clock synchronous signal of the master clock device according to the preset clock synchronous period; according to a preset shooting calibration period, taking the system time of a camera as a clock source, and acquiring shooting time deviation of a video frame and period duration of a single synchronous shooting period; determining a target adjusting mode of shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing shooting intervals and reducing the shooting intervals; determining an adjusting step length according to the current synchronous shooting period, a target period to be calibrated and shooting time deviation; calibrating shooting time based on the adjustment step length according to the target adjustment mode to obtain calibrated shooting time; taking the system time of the camera as a clock source, and shooting video frames according to the calibrated shooting time. Each camera in the synchronous shooting system is in clock synchronization with the master clock device, the system time of each camera is the same, each camera calibrates the shooting time by taking the system time of each camera as a clock source, and the same shooting time of each camera is ensured, so that the synchronous control of video frame acquisition of multiple cameras is realized. Of course, it is not necessary for any one product or method of practicing the application to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings for a person having ordinary skill in the art.
FIG. 1 is a schematic diagram of a method for synchronously controlling video frame acquisition according to an embodiment of the present application;
FIG. 2 is a schematic diagram of one possible implementation of step S102 according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a possible implementation of step S104 according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a synchronous control device for video frame acquisition according to an embodiment of the present application;
fig. 5 is a schematic diagram of a camera according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by the person skilled in the art based on the present application are included in the scope of protection of the present application.
First, terms in the present application will be explained:
and (3) system timing: refers to the operation that the time of the camera is consistent with the time of a timing system such as an NTP (Network Time Protocol ) server or a GPS (Global Positioning System, global positioning system) module, so as to achieve the purpose of keeping the system time consistent between cameras.
VD signal (Vertical Drive Signal, field sync signal): the sensor is a field synchronizing signal acquired by a sensor video, namely an initial signal of each frame of video is acquired, when the sensor works in a main mode, a VD signal is spontaneously generated by the sensor according to the configuration of a register; when the sensor works in the slave mode, the VD signal is provided by the master control chip and is generally consistent with the video frame rate value.
In order to realize synchronous control of video frame acquisition of multiple cameras, an embodiment of the present application provides a method for synchronous control of video frame acquisition, which is applied to cameras in a synchronous shooting system, wherein the synchronous shooting system comprises a plurality of cameras, and referring to fig. 1, the method comprises:
s101, calibrating the system time of the camera according to a preset clock synchronization period and the received clock synchronization signal of the master clock device.
The video frame acquisition synchronous control method of the embodiment of the application is applied to the camera, so that the video frame acquisition synchronous control method can be realized through the camera.
The camera may select different system time calibration schemes according to practical situations, for example, the master clock device may be an NTP server, or the master clock device may be a GPS signal transmitting device (e.g., a GPS satellite), or the like. The precision of the NTP server is mainly influenced by the network environment, can reach the precision within milliseconds under the condition of a local area network, and is suitable for indoor scene application; the timing precision of the system based on the GPS signals is higher, can reach the timing precision of less than microsecond level, and a camera is required to be provided with a GPS module for cooperation use, so that the system is suitable for outdoor scenes.
The core of the camera system time calibration is that based on the unified system time, the synchronization of the video signal acquisition of the camera is realized by adjusting an external VD signal (a sensor works in a slave mode) or a frame rate control register of the camera (the sensor works in a master mode), each camera is provided with an independent high-precision crystal as a sensor to provide an input clock, and the camera can realize time calibration through an NTP server or a GPS module.
S102, acquiring shooting time deviation of a video frame and cycle duration of a single synchronous shooting cycle by taking the system time of the video camera as a clock source according to a preset shooting calibration cycle.
The preset clock synchronization period and the preset shooting calibration period can be set in a self-defined mode according to actual conditions, and the preset clock synchronization period and the preset shooting calibration period can be the same or different. In an actual scene, the camera can acquire images according to a set synchronous shooting period. The image capturing time deviation represents: time difference between actual shooting time of image and set shooting time.
S103, determining a target adjusting mode of the shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing the shooting interval and reducing the shooting interval.
The adjusting mode of the shooting time comprises the steps of increasing the shooting interval and reducing the shooting interval, and whether the shooting interval is increased or decreased is determined by comparing the shooting time deviation with the period duration, namely the target adjusting mode.
In one possible implementation manner, the determining the target adjustment manner of the shooting time according to the shooting time deviation and the period duration includes: under the condition that half of the period duration is smaller than the shooting time deviation, judging to adjust shooting time in a mode of increasing shooting intervals; and in the case that half of the period duration is not less than the shooting time deviation, judging that the shooting time is adjusted by adopting a mode of reducing the shooting interval.
S104, determining an adjusting step length according to the current synchronous shooting period, the target period to be calibrated and the shooting time deviation.
The target period is a synchronous shooting period which needs to be adjusted, namely, the actual shooting time of the camera is expected to be the same as the designed shooting time when the target period is. The shooting time deviation is the deviation to be adjusted, and according to the current synchronous shooting period, the target period to be calibrated and the shooting time deviation, the time length to be adjusted of each synchronous shooting period, namely the adjustment step length, can be calculated.
S105, calibrating the shooting time based on the adjustment step length according to the target adjustment mode, and obtaining the calibrated shooting time.
When the target adjustment mode is to increase the shooting interval, the adjustment step length is increased in each synchronous shooting period from the current synchronous shooting period to the target period, so that the shooting time is calibrated. When the target adjustment mode is to reduce the shooting interval, the adjustment step length is reduced in each synchronous shooting period from the current synchronous shooting period to the target period, so that the shooting time is calibrated.
S106, taking the system time of the camera as a clock source, and shooting video frames according to the calibrated shooting time.
In the embodiment of the application, each camera in the synchronous shooting system is in clock synchronization with the master clock device, the system time of each camera is the same, each camera calibrates the shooting time based on the adjusting step length in a target adjusting mode by taking the system time of each camera as a clock source, the shooting time of the camera is calibrated, the shooting time of each camera is ensured to be the same, and thus the synchronous control of the video frame acquisition of multiple cameras is realized.
In a possible implementation manner, referring to fig. 2, the acquiring, according to a preset shooting calibration period, a shooting time deviation of a video frame and a period duration of a single synchronous shooting period with a system time of the camera as a clock source includes:
s1021, according to a preset shooting calibration period, after shooting time calibration is started, when a field synchronizing signal is detected, acquiring the system time of the camera to obtain a first moment.
S1022, acquiring preset shooting time of the designated synchronous shooting period and period duration of a single synchronous shooting period.
S1023, calculating the difference value between the first moment and the preset shooting moment.
And S1024, performing remainder operation on the difference value and the period duration to obtain the shooting moment deviation of the video frame.
After starting the shooting time calibration, when the camera detects the VD signal (field sync signal), it immediately acquires its own system time at this time as the first time, and then calculates the difference between the first time and the shooting time (preset shooting time) of the designed designated synchronous shooting period from its own system time. In one example, the period duration of a single synchronization shooting period may be determined according to the Sensor output frame rate in the camera; for example, the Sensor output frame rate is denoted as FRate, and the period duration of a single synchronization shooting period:
T＝1000/FRate
where T is in ms (milliseconds), and the difference between the first moment and the preset shooting moment is denoted as time, the shooting moment deviation M of the video frame image may be denoted as time% T, where% represents the remainder operation.
The designated synchronous shooting period may be set by user-defined according to actual conditions, and for example, a synchronous shooting period in which the shooting time is 0 minutes 0 seconds or less may be set as the designated synchronous shooting period. The step of acquiring the shooting time deviation of the video frame and the period duration of a single synchronous shooting period by taking the system time of the camera as a clock source according to a preset shooting calibration period comprises the following steps:
step one, according to a preset shooting calibration period, after shooting time calibration is started, when a field synchronous signal is detected, acquiring the system time of the camera to obtain a first moment.
And step two, acquiring the period duration of a single synchronous shooting period.
And thirdly, performing remainder operation on the first moment by using the period duration to obtain shooting moment deviation of the video frame.
In some scenarios, the moment when the camera captures the first frame of video frame is considered to be 0 point, 0 minutes and 0 seconds, in which case the capturing moment deviation M of the video frame may be represented as m=t% T, where T represents the first moment.
In one possible implementation manner, referring to fig. 3, the determining an adjustment step according to a current synchronous shooting period, a target period to be calibrated, and the shooting time deviation includes:
s1041, determining a time length to be adjusted according to the shooting time deviation, and acquiring a second time for determining the time length to be adjusted, wherein the time length to be adjusted is a difference value between the period time length and the shooting time deviation when half of the period time length is smaller than the shooting time deviation; and when half of the period duration is not less than the shooting time deviation, the duration to be adjusted is the shooting time deviation.
Marking the time length to be adjusted as delta t, and under the condition that half of the period time length is not less than the shooting time deviation, marking the time length to be adjusted as the shooting time deviation:
δt＝time％T (time％T≤T/2)
when half of the period duration is smaller than the shooting time deviation, the duration to be adjusted is the difference between the period duration and the shooting time deviation:
δt＝(T-time％T) (time％T＞T/2)
in practical application, a certain error exists in the shooting time, whether to calibrate the shooting time can be judged according to a preset precision threshold, and when δt is greater than the precision threshold, the shooting time is calibrated; otherwise, the calibration of the shooting time is not performed.
S1042, calculating to obtain an adjustment step according to the time length to be adjusted, the second time, the shooting time of the target period to be calibrated, and the shooting time of the current synchronous shooting period.
In one possible implementation manner, the calculating to obtain the adjustment step size according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated, and the shooting time of the current synchronous shooting period includes:
the adjustment step is calculated according to the following formula:
t1 is the shooting time of the current synchronous shooting period, T2 is the shooting time of the target period, N1 is the frame interval from the second time to the adjustment step length calculation time, and N2 is the shooting time from the adjustment step length calculation time to the target periodFrame interval of shooting time, N x For the preset smooth frame number, δt is the duration to be adjusted.
In one possible implementation manner, the calibrating the shooting time based on the adjustment step according to the target adjustment manner, to obtain the calibrated shooting time includes:
step one, according to the target adjusting mode and the adjusting step length, adjusting the field synchronous signal adjusting parameters.
And under the condition that the target adjustment mode is to increase the shooting interval, overlapping the adjustment step length and the predetermined field synchronizing signal adjustment parameter to obtain the adjusted field synchronizing signal adjustment parameter. And when the target adjustment mode is to reduce the shooting interval, reducing the shooting interval on the predetermined field synchronous signal adjustment parameter to obtain the adjusted field synchronous signal adjustment parameter. The predetermined field synchronization signal adjustment parameter is a field synchronization signal adjustment parameter calculated according to a designed synchronous shooting period, and a specific calculation manner of the predetermined field synchronization signal adjustment parameter can be seen in the prior art.
And step two, calibrating the shooting time according to the adjusted field synchronous signal adjustment parameters to obtain the calibrated shooting time.
And calibrating the shooting time according to the adjusted field synchronous signal adjustment parameter in each synchronous shooting period from the current synchronous shooting period to the target period to obtain the calibrated shooting time.
In one possible embodiment, the method further comprises:
and adjusting the exposure parameters of the camera according to the adjusted field synchronous signal adjustment parameters.
In order to ensure stable brightness of the image, the exposure parameters of the camera need to be arranged in a linkage manner. Assuming that the current exposure time is T (t.ltoreq.T1) in the case of one exposure stabilization, then:
h1 is the line exposure time of the current synchronization shooting period, H2 is the line exposure time of the new synchronization shooting period, V1 is the maximum exposure line number of the current synchronization shooting period, V2 is the maximum exposure line number of the new synchronization shooting period, n1 is the exposure line number of the current synchronization shooting period, and n2 is the effective exposure line number of the new synchronization shooting period, that is, the value to be configured into the sensor. In calculating the equivalent exposure, it is necessary to pay attention to that n2 is less than or equal to V2 and cannot exceed.
The configuration of n2 needs to be synchronized with the adjusted field synchronizing signal adjusting parameters, otherwise, the situation of uncoordinated exposure occurs.
The embodiment of the application also provides a video frame acquisition synchronous control device which is applied to the video camera, and referring to fig. 4, the device comprises:
the system time calibration module 401 is configured to calibrate the system time of the camera according to a clock synchronization signal of the master clock device according to a preset clock synchronization period;
the data acquisition module 402 is configured to acquire, according to a preset shooting calibration period, a shooting time deviation of a video frame and a period duration of a single synchronous shooting period by using a system time of the camera as a clock source;
an adjustment mode determining module 403, configured to determine a target adjustment mode of a shooting time according to the shooting time deviation and the period duration, where the adjustment mode of the shooting time includes increasing a shooting interval and decreasing the shooting interval;
an adjustment step length determining module 404, configured to determine an adjustment step length according to a current synchronous shooting period, a target period to be calibrated, and the shooting time deviation;
the shooting time calibration module 405 is configured to calibrate the shooting time according to the target adjustment mode based on the adjustment step length, so as to obtain a calibrated shooting time;
and the video frame acquisition synchronous control module 406 is configured to take the system time of the camera as a clock source, and shoot a video frame according to the calibrated shooting time.
In a possible implementation manner, the data acquisition module is specifically configured to: acquiring the system time of the camera to obtain a first moment when a field synchronous signal is detected after starting shooting time calibration according to a preset shooting calibration period; acquiring a preset shooting time of a designated synchronous shooting period and a period duration of a single synchronous shooting period; calculating a difference value between the first moment and the preset shooting moment; and performing residual operation on the difference value and the period duration to obtain shooting moment deviation of the video frame.
In a possible embodiment, the adjustment step size determining module is specifically configured to: determining a time length to be adjusted according to the shooting time deviation, and acquiring a second time for determining the time length to be adjusted, wherein the time length to be adjusted is a difference value between the period time length and the shooting time deviation when half of the period time length is smaller than the shooting time deviation; when half of the period duration is not less than the shooting time deviation, the duration to be adjusted is the shooting time deviation; and calculating to obtain an adjusting step length according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated and the shooting time of the current synchronous shooting period.
In a possible embodiment, the adjustment step size determining module is specifically configured to:
the adjustment step is calculated according to the following formula:
t1 is the shooting time of the current synchronous shooting period, T2 is the shooting time of the target period, N1 is the frame interval from the second time to the adjustment step calculation time, N2 is the frame interval from the adjustment step calculation time to the shooting time of the target period, N x For the preset smooth frame number, δt is the duration to be adjusted.
In one possible implementation manner, the adjustment mode determining module is specifically configured to: under the condition that half of the period duration is smaller than the shooting time deviation, judging to adjust shooting time in a mode of increasing shooting intervals; and in the case that half of the period duration is not less than the shooting time deviation, judging that the shooting time is adjusted by adopting a mode of reducing the shooting interval.
In one possible implementation manner, the shooting time calibration module is specifically configured to: according to the target regulation mode and the regulation step length, regulating a field synchronous signal regulation parameter; and calibrating the shooting time according to the adjusted field synchronous signal adjustment parameters to obtain the calibrated shooting time.
In a possible implementation manner, the device further comprises an exposure parameter adjustment module, configured to: and adjusting the exposure parameters of the camera according to the adjusted field synchronous signal adjustment parameters.
The embodiment of the application also provides a camera, which comprises:
the memory is used for storing a computer program;
the processor is used for realizing any video frame acquisition synchronous control method when executing the program stored in the memory.
In a possible implementation, referring to fig. 5, the camera according to the embodiment of the present application further includes a communication interface 502 and a communication bus 504, where the processor 501, the communication interface 502, and the memory 503 perform communication with each other through the communication bus 504.
The communication bus mentioned by the above-mentioned camera may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the camera and other devices.
The Memory may include RAM (Random Access Memory ) or NVM (Non-Volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processing, digital signal processor), ASIC (Application Specific Integrated Circuit ), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
The embodiment of the application also provides a synchronous shooting system, which comprises: a plurality of cameras according to any of the present application. In one possible implementation, the synchronized shooting system further includes an NTP server. Each camera can execute the video frame acquisition synchronous control method, and the system time among the cameras can be checked through an NTP server or a GPS module, so that the consistency is kept.
The embodiment of the application also provides a computer readable storage medium, wherein a computer program is stored in the computer readable storage medium, and the computer program realizes the video frame acquisition synchronous control method according to any one of the application when being executed by a processor.
In yet another embodiment of the present application, a computer program product containing instructions that, when run on a computer, cause the computer to perform the video frame acquisition synchronization control method of any of the present application is also provided.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It should be noted that, in this document, the technical features in each alternative may be combined to form a solution, so long as they are not contradictory, and all such solutions are within the scope of the disclosure of the present application. Relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for embodiments of the apparatus, camera, computer program product and storage medium, the description is relatively simple, as it is substantially similar to the method embodiments, as relevant see also part of the description of the method embodiments.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.
Claims (8)
1. A video frame acquisition synchronization control method, applied to a camera in a synchronization shooting system including a plurality of cameras, the method comprising:
according to a preset clock synchronization period, calibrating the system time of the camera according to a received clock synchronization signal of the master clock device;
according to a preset shooting calibration period, taking the system time of the camera as a clock source, and acquiring shooting time deviation of a video frame and period duration of a single synchronous shooting period;
determining a target adjusting mode of shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing shooting intervals and reducing the shooting intervals;
determining an adjusting step length according to the current synchronous shooting period, a target period to be calibrated and the shooting time deviation;
calibrating shooting time based on the adjusting step length according to the target adjusting mode to obtain calibrated shooting time;
taking the system time of the camera as a clock source, and shooting video frames according to the calibrated shooting time.
2. The method according to claim 1, wherein the acquiring, according to the preset shooting calibration period, the shooting time deviation of the video frame and the period duration of the single synchronous shooting period with the system time of the camera as a clock source includes:
acquiring the system time of the camera to obtain a first moment when a field synchronous signal is detected after starting shooting time calibration according to a preset shooting calibration period;
acquiring the period duration of a single synchronous shooting period;
and performing remainder operation on the first moment by using the period duration to obtain shooting moment deviation of the video frame.
3. The method of claim 2, wherein determining the adjustment step size based on the current synchronized shooting period, the target period to be calibrated, and the shooting time offset comprises:
determining a time length to be adjusted according to the shooting time deviation, and acquiring a second time for determining the time length to be adjusted, wherein the time length to be adjusted is a difference value between the period time length and the shooting time deviation when half of the period time length is smaller than the shooting time deviation; when half of the period duration is not less than the shooting time deviation, the duration to be adjusted is the shooting time deviation;
and calculating to obtain an adjusting step length according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated and the shooting time of the current synchronous shooting period.
4. A method according to claim 3, wherein the calculating an adjustment step according to the duration to be adjusted, the second time, the shooting time of the target period to be calibrated, and the shooting time of the current synchronous shooting period includes:
the adjustment step is calculated according to the following formula:
T 1 for the shooting time of the current synchronous shooting period, T 2 N is the shooting time of the target period 1 Calculating a frame interval of time for the second time to the adjustment step, N 2 To adjust the frame interval from the step calculation time to the shooting time of the target period, N x For the preset smooth frame number, δt is the duration to be adjusted, and T is the period duration of a single synchronous shooting period.
5. The method according to claim 1, wherein the determining the target adjustment mode of the shooting time according to the shooting time deviation and the period duration includes:
under the condition that half of the period duration is smaller than the shooting time deviation, judging to adjust shooting time in a mode of increasing shooting intervals;
and in the case that half of the period duration is not less than the shooting time deviation, judging that the shooting time is adjusted by adopting a mode of reducing the shooting interval.
6. The method of claim 1, wherein calibrating the photographing time based on the adjustment step according to the target adjustment mode to obtain the calibrated photographing time comprises:
according to the target regulation mode and the regulation step length, regulating a field synchronous signal regulation parameter;
and calibrating the shooting time according to the adjusted field synchronous signal adjustment parameters to obtain the calibrated shooting time.
7. The method of claim 6, wherein the method further comprises:
and adjusting the exposure parameters of the camera according to the adjusted field synchronous signal adjustment parameters.
8. A video frame acquisition synchronization control apparatus for use with a camera in a synchronized capture system, the synchronized capture system including a plurality of cameras, the apparatus comprising:
the system time calibration module is used for calibrating the system time of the camera according to a preset clock synchronization period and the received clock synchronization signal of the master clock device;
the data acquisition module is used for acquiring the shooting time deviation of the video frame and the period duration of a single synchronous shooting period by taking the system time of the camera as a clock source according to a preset shooting calibration period;
the adjusting mode determining module is used for determining a target adjusting mode of the shooting time according to the shooting time deviation and the period duration, wherein the adjusting mode of the shooting time comprises the steps of increasing the shooting interval and reducing the shooting interval;
the adjusting step length determining module is used for determining an adjusting step length according to the current synchronous shooting period, the target period to be calibrated and the shooting time deviation;
the shooting time calibration module is used for calibrating the shooting time based on the adjustment step length according to the target adjustment mode to obtain calibrated shooting time;
and the video frame acquisition synchronous control module is used for taking the system time of the camera as a clock source and shooting the video frames according to the calibrated shooting time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210263854.3A CN114697466B (en) | 2022-03-17 | 2022-03-17 | Video frame acquisition synchronization control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210263854.3A CN114697466B (en) | 2022-03-17 | 2022-03-17 | Video frame acquisition synchronization control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114697466A CN114697466A (en) | 2022-07-01 |
| CN114697466B true CN114697466B (en) | 2023-10-13 |
Family
ID=82139749
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210263854.3A Active CN114697466B (en) | 2022-03-17 | 2022-03-17 | Video frame acquisition synchronization control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114697466B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003078864A (en) * | 2001-08-30 | 2003-03-14 | Nec Corp | System for providing camera image and time correction method for camera image |
| CN103442216A (en) * | 2013-08-22 | 2013-12-11 | 中国电子科技集团第三十八研究所 | Monitoring video time calibration device and calibration method thereof |
| WO2016002130A1 (en) * | 2014-06-30 | 2016-01-07 | パナソニックＩｐマネジメント株式会社 | Image pickup method, image pickup system, terminal device and server |
| CN106161870A (en) * | 2015-04-10 | 2016-11-23 | 杭州海康威视数字技术股份有限公司 | A kind of multi-screen controls equipment and the system of synchronization |
| CN207638767U (en) * | 2017-10-12 | 2018-07-20 | 北京工业职业技术学院 | Image temporal calibration system |
| WO2019033956A1 (en) * | 2017-08-14 | 2019-02-21 | 杭州海康威视数字技术股份有限公司 | Monitoring video synchronization method and video camera |
| WO2020043181A1 (en) * | 2018-08-31 | 2020-03-05 | 中兴通讯股份有限公司 | Clock synchronization method and apparatus, system, storage medium, and electronic device |
| JP2020174248A (en) * | 2019-04-09 | 2020-10-22 | 株式会社デンソーテン | Image reproduction device and image reproduction method |
| WO2020248705A1 (en) * | 2019-06-12 | 2020-12-17 | 杭州萤石软件有限公司 | Camera and camera starting method and device |
| CN112217985A (en) * | 2020-08-28 | 2021-01-12 | 新奥特（北京）视频技术有限公司 | Information acquisition method, device and system |
| CN113873345A (en) * | 2021-09-27 | 2021-12-31 | 中国电子科技集团公司第二十八研究所 | Distributed ultrahigh-definition video synchronous processing method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005076375A (en) * | 2003-09-02 | 2005-03-24 | Denso Corp | Communication device |
| JP2013040796A (en) * | 2011-08-11 | 2013-02-28 | Sony Corp | Electronic apparatus, method of time synchronization, and program |
| JP2019114914A (en) * | 2017-12-22 | 2019-07-11 | キヤノン株式会社 | Imaging apparatus, control method of the same, program, and imaging system |
| CN109218562B (en) * | 2018-09-07 | 2021-04-27 | 百度在线网络技术（北京）有限公司 | Clock synchronization method, device, equipment, storage medium and vehicle |
-
2022
- 2022-03-17 CN CN202210263854.3A patent/CN114697466B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003078864A (en) * | 2001-08-30 | 2003-03-14 | Nec Corp | System for providing camera image and time correction method for camera image |
| CN103442216A (en) * | 2013-08-22 | 2013-12-11 | 中国电子科技集团第三十八研究所 | Monitoring video time calibration device and calibration method thereof |
| WO2016002130A1 (en) * | 2014-06-30 | 2016-01-07 | パナソニックＩｐマネジメント株式会社 | Image pickup method, image pickup system, terminal device and server |
| CN106161870A (en) * | 2015-04-10 | 2016-11-23 | 杭州海康威视数字技术股份有限公司 | A kind of multi-screen controls equipment and the system of synchronization |
| WO2019033956A1 (en) * | 2017-08-14 | 2019-02-21 | 杭州海康威视数字技术股份有限公司 | Monitoring video synchronization method and video camera |
| CN207638767U (en) * | 2017-10-12 | 2018-07-20 | 北京工业职业技术学院 | Image temporal calibration system |
| WO2020043181A1 (en) * | 2018-08-31 | 2020-03-05 | 中兴通讯股份有限公司 | Clock synchronization method and apparatus, system, storage medium, and electronic device |
| JP2020174248A (en) * | 2019-04-09 | 2020-10-22 | 株式会社デンソーテン | Image reproduction device and image reproduction method |
| WO2020248705A1 (en) * | 2019-06-12 | 2020-12-17 | 杭州萤石软件有限公司 | Camera and camera starting method and device |
| CN112217985A (en) * | 2020-08-28 | 2021-01-12 | 新奥特（北京）视频技术有限公司 | Information acquisition method, device and system |
| CN113873345A (en) * | 2021-09-27 | 2021-12-31 | 中国电子科技集团公司第二十八研究所 | Distributed ultrahigh-definition video synchronous processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114697466A (en) | 2022-07-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9654672B1 (en) | Synchronized capture of image and non-image sensor data | |
| US9813783B2 (en) | Multi-camera dataset assembly and management with high precision timestamp requirements | |
| KR20160078893A (en) | Semiconductor device, electronic device module and network system | |
| US10645305B2 (en) | Imaging apparatus, client device, imaging system, control method of imaging apparatus, control method of client device, and control method of imaging system | |
| CN109391799B (en) | Monitoring video synchronization method and device and video acquisition equipment | |
| EP1784008A2 (en) | Image-pickup device, image-pickup method, and program | |
| US9661191B2 (en) | Image capture apparatus having function of generating frame synchronization signal at constant cycle | |
| KR20140001740A (en) | Image pickup apparatus, image pickup system, image pickup method and computer readable non-transitory recording medium | |
| CN111757015B (en) | Exposure control method and device and electronic equipment | |
| CN110505466B (en) | Image processing method, device, electronic equipment, storage medium and system | |
| US11032477B2 (en) | Motion stabilized image sensor, camera module and apparatus comprising same | |
| US7903146B2 (en) | Image capturing apparatus with image signal and object luminance detection for exposure control | |
| EP2763396A1 (en) | Automatic exposure bracketing | |
| US11949767B2 (en) | Communication apparatus, method of controlling communication apparatus, and storage medium | |
| CN114697466B (en) | Video frame acquisition synchronization control | |
| US20180084189A1 (en) | Lens module system, image sensor, and method of controlling lens module | |
| WO2020248705A1 (en) | Camera and camera starting method and device | |
| CN110971818A (en) | Time calibration method and device, auxiliary slave equipment and auxiliary master equipment | |
| US11184590B2 (en) | Image processing apparatus and method | |
| US20210274161A1 (en) | Video signal identification method and apparatus, electronic device and readable storage medium | |
| CN113438473B (en) | Method and device for testing camera shutter lag time and terminal equipment | |
| US20200358949A1 (en) | Image capturing apparatus and control method therefor | |
| US10212357B2 (en) | Imaging apparatus and control method to realize accurate exposure | |
| EP4272424A1 (en) | A system for wireless synchronized capturing, and a smart device | |
| US20230199303A1 (en) | Imaging apparatus and control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |