CN113824902A - Method, device, system, equipment and medium for determining time delay of infrared camera system - Google Patents

Method, device, system, equipment and medium for determining time delay of infrared camera system Download PDF

Info

Publication number
CN113824902A
CN113824902A CN202111159533.0A CN202111159533A CN113824902A CN 113824902 A CN113824902 A CN 113824902A CN 202111159533 A CN202111159533 A CN 202111159533A CN 113824902 A CN113824902 A CN 113824902A
Authority
CN
China
Prior art keywords
time
image
camera
stopwatch
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111159533.0A
Other languages
Chinese (zh)
Inventor
徐杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Haikang Auto Software Co ltd
Original Assignee
Hangzhou Haikang Auto Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Haikang Auto Software Co ltd filed Critical Hangzhou Haikang Auto Software Co ltd
Priority to CN202111159533.0A priority Critical patent/CN113824902A/en
Publication of CN113824902A publication Critical patent/CN113824902A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Abstract

The embodiment of the application discloses a method, a device, a system, equipment and a medium for determining time delay of an infrared camera system, and belongs to the field of data processing. The method comprises the following steps: acquiring a first image, wherein the first image is obtained by shooting at least a stopwatch by a first camera under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera; determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, the first stopwatch time being a display time of a stopwatch determined based on the first image and captured by the first camera, the second stopwatch time being a display time of the stopwatch captured by the infrared camera; determining the time delay of the graph of the display device; and determining the system time delay of the infrared camera based on the first time difference and the graph time delay of the display equipment. The method and the device solve the problem that the time delay of the infrared camera system cannot be accurately determined.

Description

Method, device, system, equipment and medium for determining time delay of infrared camera system
Technical Field
The embodiment of the application relates to the field of data processing, in particular to a method, a device, a system, equipment and a medium for determining time delay of an infrared camera system.
Background
The system delay of the camera refers to the time required for the camera to take a picture until an image is output. The camera comprises a visible light camera and an infrared camera, the visible light camera is a device which converts visible light of the visible light into distinguishable image signals by sensing the visible light reflected by an object, and the infrared camera is a device which converts infrared light of the infrared camera into distinguishable image signals by sensing the infrared light reflected by the object.
The related art proposes a method for determining the system delay of a visible light camera, which is to determine the system delay of the visible light camera through a visible light source. However, for the infrared camera, no matter the visible light source is in the on state or the off state, the video signal output by the infrared camera has no obvious change, and thus the method is not suitable for the infrared camera. Therefore, a method for determining the system delay of an infrared camera is needed.
Disclosure of Invention
The embodiment of the application provides a method, a device, a system, equipment and a medium for determining system time delay of an infrared camera, and at least can solve the problem that the system time delay of the infrared camera cannot be determined in the related technology. The technical scheme is as follows:
in one aspect, a method for determining time delay of an infrared camera system is provided, where the method includes:
acquiring a first image, wherein the first image is obtained by shooting at least a stopwatch by a first camera under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, the first stopwatch time being a display time of the stopwatch determined based on the first image and captured by the first camera, the second stopwatch time being a display time of the stopwatch captured by the infrared camera;
determining an image delay of the display device, wherein the image delay is the time delay from receiving an image to displaying the image by the display device;
and determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, an apparatus for determining time delay of an infrared camera system is provided, the apparatus comprising:
the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first image, the first image is obtained by shooting at least a stopwatch by a first camera under the condition that a second image is displayed on the display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
a first determining module, configured to determine an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, where the first stopwatch time is a display time of the stopwatch that is determined based on the first image and is captured by the first camera, and the second stopwatch time is a display time of the stopwatch that is captured by the infrared camera;
the second determination module is used for determining the time delay of the image of the display device, wherein the time delay of the image is the time delay from the receiving of the image to the displaying of the image by the display device;
and the third determining module is used for determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, there is provided an infrared camera system delay determination system, the system comprising: the system comprises a computer device, an infrared camera, a first camera, a stopwatch and a display device;
the infrared camera is used for shooting the stopwatch to obtain a second image;
the display device is used for displaying the second image;
the first camera is used for shooting at least the stopwatch to obtain a first image under the condition that the second image is displayed on the display equipment;
the computer device is used for acquiring the first image, determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, wherein the first stopwatch time is a display time of the stopwatch shot by the first camera and determined based on the first image, and the second stopwatch time is a display time of the stopwatch shot by the infrared camera; determining an image delay of the display device, wherein the image delay is the time delay from receiving an image to displaying the image by the display device; and determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, a computer device is provided, which includes a memory for storing a computer program and a processor for executing the computer program stored in the memory to implement the steps of the method for determining time delay of an infrared camera system.
In another aspect, a computer-readable storage medium is provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the method for determining time delay of an infrared camera system described above.
In another aspect, a computer program product is provided, which comprises instructions that, when executed on a computer, cause the computer to perform the steps of the above-mentioned method for determining the time delay of an infrared camera system.
The technical scheme provided by the embodiment of the application can at least bring the following beneficial effects:
according to the embodiment of the application, the stopwatch is shot through the infrared camera, and a second image obtained through shooting is displayed in the display device. In this way, in the case where the second image is displayed on the display device, the first stopwatch time can be specified from the first image after the first camera has captured at least the stopwatch. Because the second stopwatch time is the display time of the stopwatch shot by the infrared camera, and the time difference between the first stopwatch time and the second stopwatch time comprises the time delay of the infrared camera system and the time delay of the image of the display device, the time delay of the infrared camera system can be accurately determined after the time delay of the image of the display device is determined, and the problem that the time delay of the infrared camera system cannot be accurately determined is solved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a system architecture diagram for determining system delay of an infrared camera according to an embodiment of the present disclosure;
fig. 2 is an architecture diagram for determining a graph time delay of a display device according to an embodiment of the present application;
fig. 3 is an architecture diagram for determining a system latency of a first camera according to an embodiment of the present disclosure;
fig. 4 is a flowchart of a method for determining a time delay of an infrared camera system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a delay determining apparatus of an infrared camera system according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a structural diagram of a delay determining system of an infrared camera system according to an embodiment of the present disclosure. The system comprises: computer equipment, infrared camera, first camera, stopwatch and display device. The infrared camera is used for shooting the stopwatch to obtain a second image. The display device is used for displaying the second image. The first camera is used for shooting at least the stopwatch to obtain a first image under the condition that the second image is displayed on the display device. The computer device is used for acquiring a first image, determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain the first time difference, the first stopwatch time is the display time of the stopwatch shot by the first camera based on the first image determination, the second stopwatch time is the display time of the stopwatch shot by the infrared camera, and determining the time delay of the picture of the display device, the time delay of the picture is the time delay from the image receiving to the image display of the display device, and the system time delay of the infrared camera is determined based on the first time difference and the time delay of the picture of the display device. In the embodiments of the present application, the system latency of the camera refers to the time required by the camera from capturing an image to outputting the image (e.g., sending to a display device for display).
That is, after the infrared camera captures the second image of the stopwatch, the infrared camera needs to transmit the second image to the display device, and the display device displays the second image. In this way, when the second image is displayed on the display device, the first camera captures at least the stopwatch to obtain the first image. At this time, the first image includes a first stopwatch time, which is a display time of the stopwatch photographed by the first camera.
Since the first stopwatch time is the display time of the stopwatch shot by the first camera, the second stopwatch time is the display time of the stopwatch shot by the infrared camera, and the time from the second stopwatch time to the time when the infrared camera outputs the second image is the system delay of the infrared camera, the infrared camera sends the second image to the display device, and the time taken by the display device to receive the second image and display the second image is the time delay (or display delay) of the display device. Therefore, the first time difference determined based on the first and second stopwatch times includes not only the system time delay of the infrared camera but also the time delay of the map of the display device. Thus, after the time delay of the image of the display device is determined, the system time delay of the infrared camera can be determined based on the first time difference and the time delay of the image of the display device.
The first camera can shoot at least the stopwatch to obtain the first image at any time when the second image is displayed by the display device. For example, the first camera may capture at least the stopwatch to obtain the first image when the display device starts displaying the second image, or may capture at least the stopwatch to obtain the first image at any time after the display device starts displaying the second image. That is, the first stopwatch time may be equal to or later than the time at which the display device starts displaying the second image.
In the case that the first stopwatch time is equal to the time when the display device starts to display the second image, the first time difference is the sum of the infrared camera system time delay and the image time delay of the display device, and at this time, the computer device may directly determine the absolute value of the time difference between the first time difference and the image time delay of the display device as the infrared camera system time delay.
In the case that the first stopwatch time is later than the time when the display device starts to display the second image, the first time difference is the sum of the infrared camera system time delay, the image-showing time delay of the display device and a first time delay, and the first time delay is the time delay (i.e. time delay) from the time when the display device starts to display the second image to the first stopwatch time. At this time, the computer device may determine an absolute value of a time difference between the first time difference and the time delay of the image displayed on the display device to obtain a third time difference, and further determine an absolute value of a time difference between the third time difference and the first time delay to obtain the time delay of the infrared camera system.
In the embodiment of the application, the infrared camera can shoot the stopwatch to obtain one image, and the image is transmitted to the display device as the second image. Of course, the infrared camera may also continuously take a picture of the stopwatch to obtain a video stream, and transmit the video stream to the display device in real time, where the second image is a video frame in the video stream. That is, the second image may be an image captured by the infrared camera, or may be a video frame in a video stream captured by the infrared camera. In the following, these two cases will be separately described.
The second image is an image shot by the infrared camera
In the case where the first stopwatch time is equal to the time at which the display device starts displaying the second image, it indicates that the first stopwatch time is the same as the time at which the display device starts displaying the second image. In order to ensure that the first camera just shoots the stopwatch when the display device starts displaying the second image, the first camera needs to be controlled. In some embodiments, the display device sends a control signal to the first camera when it starts displaying the second image, so that the first camera can take a picture of the stopwatch, thereby obtaining the first image. Alternatively, the display device transmits the time at which the display of the second image is started to the first camera, and the stopwatch is photographed by the first camera based on the time, thereby obtaining the first image.
In the case where the first stopwatch time is later than the time at which the display device starts displaying the second image, at this time, the first time delay needs to be accurately determined. The first time delay may be determined in any manner, for example, when the display device starts to display the second image, a control signal is sent to the first camera, so that the first camera waits for a first preset time period to capture the image after receiving the control signal. At this time, the first preset duration is the first time delay.
It should be noted that, in the case where the display device displays the second image, the first camera may capture only the stop watch to obtain the first image. The first camera may also take a picture of the stopwatch and the display device simultaneously to obtain the first image. That is, the first image may include only the stopwatch captured by the first camera, and the first image may also include the stopwatch captured by the first camera and the display device on which the second image is displayed.
In the case where the first camera only captures the stopwatch, the computer device may identify the display time of the stopwatch directly from the first image to obtain the first stopwatch time and directly from the second image to obtain the second stopwatch time.
In the case where the first camera simultaneously photographs the stop watch and the display device, the first image includes not only the display time of the stop watch photographed by the first camera but also the display time of the stop watch photographed by the infrared camera, that is, the first stop watch time and the second stop watch time. In this case, the computer device may acquire the first stopwatch time and the second stopwatch time directly from the first image, or may acquire the first stopwatch time from the first image and the second stopwatch time from the second image.
In the case where the first camera simultaneously photographs the stopwatch and the display apparatus, the first camera may be controlled in other ways in addition to being controlled in the above-described manner. For example, in the case where the first stop watch time is equal to the time when the display device starts displaying the second image, the first camera may perform shooting simultaneously with the infrared camera and perform continuous shooting by the first camera, so that an image which is shot for the first time until the display device displays the second image may be determined from a plurality of images continuously shot by the first camera, and the image may be determined as the first image, thereby obtaining the first stop watch time.
The second image is a video frame in the video stream shot by the infrared camera
Based on the above description, the infrared camera continuously photographs the stopwatch and transmits the photographed video stream to the display device in real time. In this case, the display time of the stopwatch in the video stream is varied, i.e. the display time of the stopwatch is different in different video frames, while the display time of the stopwatch is varied, so that, in case the first stopwatch time is equal to the display time of the second image, the first camera can simultaneously take a picture of the stopwatch and the display device at any time the display device displays the video stream to obtain the first image. At this time, one video frame displayed by the display device in the first image is the second image. However, in the case where the first stopwatch time is later than the time at which the display device starts displaying the second image, the first camera may capture the stopwatch and the display device simultaneously at any two times at which the display device displays the video stream to obtain the first image and the fifth image, the capture time of the first image being later than the capture time of the fifth image. At this time, one video frame displayed by the display device in the fifth image is the second image.
In the case where the first stopwatch time is equal to the display time of the second image, the first image includes not only the display time of the stopwatch photographed by the first camera but also the display time of the stopwatch photographed by the infrared camera, that is, the first stopwatch time and the second stopwatch time. In this case, the computer device may acquire the first stopwatch time and the second stopwatch time directly from the first image, or may acquire the first stopwatch time from the first image and the second stopwatch time from the second image.
In the case where the first stopwatch time is later than the display time of the second image, the first image includes the display time of the stopwatch photographed by the first camera, and the video frame displayed by the display device in the fifth image includes the display time of the stopwatch photographed by the infrared camera, that is, the second image includes the display time of the stopwatch photographed by the infrared camera. At this point, the computer device may obtain a first stopwatch time from the first image and a second stopwatch time from the second image.
It should be noted that the stopwatch in the embodiment of the present application is always in the timekeeping state. The first video camera may be any device having a camera function, such as a smart phone, a digital camera, a pan-tilt monitoring device, and the like. The display device is any device with a display function, such as a mobile phone, a computer, a television, and the like. The computer device is any device with an operation function, such as a mobile phone, a computer, a television and the like.
Referring to fig. 2, the system further includes a second camera. In this way, the first camera is also used to take a second picture of the stop watch. The display device is further configured to display a fourth image. The second camera is used for shooting at least the stopwatch to obtain a third image when the fourth image is displayed on the display device. The computer device is further configured to acquire a third image, determine an absolute value of a time difference between a third stopwatch time, which is a display time of a stopwatch captured for the second camera based on the third image determination, and a fourth stopwatch time, which is a display time of a stopwatch captured if the fourth image was captured by the first camera, to obtain the second time difference. A system time delay of the first camera is determined. And determining the graph delay of the display equipment based on the second time difference and the system delay of the first camera.
That is, after the first camera captures the stopwatch to obtain the fourth image, the first camera needs to transmit the fourth image to the display device, and the display device displays the fourth image. In this way, when the fourth image is displayed on the display device, the second camera captures at least the stopwatch to obtain the third image. At this time, the third image includes a third stopwatch time, which is a display time of the stopwatch photographed by the second camera.
Since the third stopwatch time is the display time of the stopwatch photographed by the second camera, the fourth stopwatch time is the display time of the stopwatch photographed by the first camera, and the time from the fourth stopwatch time to the time when the fourth image is output by the first camera is the system delay of the first camera, the first camera transmits the fourth image to the display device, and the time taken by the display device to receive the fourth image until the fourth image is displayed is the graph delay of the display device. Therefore, the second time difference determined based on the third and fourth stopwatch times includes not only the system time delay of the first camera but also the plot time delay of the display device. In this way, after the system latency of the first camera is determined, the graph latency of the display device may be determined based on the second time difference and the system latency of the first camera.
The second camera can shoot at least the stopwatch to obtain a third image at any time when the fourth image is displayed by the display device. For example, the second camera may capture at least the stopwatch to obtain the third image when the display device starts displaying the fourth image, or may capture at least the stopwatch to obtain the third image at any time after the display device starts displaying the fourth image. That is, the third stopwatch time may be equal to or later than the time at which the display device starts displaying the fourth image.
In a case where the third stopwatch time is equal to the time when the display device starts displaying the fourth image, the second time difference is the sum of the system delay of the first camera and the time delay of the image displayed by the display device, and at this time, the computer device may directly determine the absolute value of the time difference between the second time difference and the system delay of the first camera as the time delay of the image displayed by the display device.
And under the condition that the third stopwatch time is later than the time when the display device starts to display the fourth image, the second time difference is the sum of the system time delay of the first camera, the graph time delay of the display device and a second time delay, and the second time delay is the time delay from the time when the display device starts to display the fourth image to the third stopwatch time. At this time, the computer device may determine an absolute value of a time difference between the second time difference and the system time delay of the first camera to obtain a fourth time difference, and further determine an absolute value of a time difference between the fourth time difference and the second time delay to obtain an image time delay of the display device.
In the embodiment of the present application, the first camera may capture the stopwatch to obtain an image, and transmit the image to the display device as the fourth image. Of course, the first camera may also continuously take a picture of the stopwatch to obtain a video stream, and transmit the video stream to the display device in real time, where the fourth image is a video frame in the video stream. That is, the fourth image may be one image captured by the first camera, or may be one video frame in a video stream captured by the first camera. In the following, these two cases will be separately described.
The fourth image is an image shot by the first camera
In the case where the third stopwatch time is equal to the time at which the display device starts displaying the fourth image, it indicates that the third stopwatch time is the same as the time at which the display device starts displaying the fourth image. In order to ensure that the second camera just shoots the stopwatch when the display device starts displaying the fourth image, the second camera needs to be controlled. In some embodiments, the display device sends a control signal to the second camera when it starts displaying the fourth image, so that the second camera can take a picture of the stopwatch, thereby obtaining the third image. Alternatively, the display device transmits the time at which the display of the fourth image is started to the second camera, and the second camera photographs the stopwatch based on the time, thereby obtaining the third image.
In the case where the third stopwatch time is later than the time at which the display device starts displaying the fourth image, at this time, the second time delay needs to be accurately determined. The second time delay may be determined in any manner, for example, when the display device starts to display the fourth image, a control signal is sent to the second camera, so that the second camera waits for a second preset time period to capture the image after receiving the control signal. At this time, the second preset duration is the second time delay.
It should be noted that, in the case where the display device displays the fourth image, the second camera may capture only the stop watch to obtain the third image. The second camera may also take a picture of the stopwatch and the display device simultaneously to obtain a third image. That is, the third image may include only the stopwatch captured by the second camera, and the third image may also include the stopwatch captured by the second camera and the display device on which the fourth image is displayed.
In the case where the second camera only captures the stopwatch, the computer device may identify the display time of the stopwatch directly from the third image to obtain a third stopwatch time and directly from the fourth image to obtain a fourth stopwatch time.
In the case where the second camera simultaneously captures the stopwatch and the display device, the third image includes not only the display time of the stopwatch captured by the second camera but also the display time of the stopwatch captured by the first camera, that is, the third stopwatch time and the fourth stopwatch time. At this time, the computer device may acquire the third stopwatch time and the fourth stopwatch time directly from the third image, or may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
In the case where the second camera simultaneously photographs the stopwatch and the display apparatus, the second camera may be controlled in other ways in addition to being controlled in the above-described manner. For example, in the case where the third stopwatch time is equal to the time when the display device starts to display the fourth image, the second camera may perform shooting simultaneously with the first camera and perform continuous shooting by the second camera, so that an image which is shot first until the display device displays the fourth image may be determined from a plurality of images continuously shot by the second camera, and the image may be determined as the third image, thereby obtaining the third stopwatch time.
The fourth image is a video frame in the video stream shot by the first camera
Based on the above description, the first camera continuously photographs the stopwatch and transmits the photographed video stream to the display device in real time. In this case, the display time of the stopwatch in the video stream is varied, i.e. the display time of the stopwatch is different in different video frames, while the display time of the stopwatch is varied, so that, in the case where the third stopwatch time is equal to the display time of the fourth image, the second camera can simultaneously take a picture of the stopwatch and the display device at any time the display device displays the video stream to obtain the third image. At this time, one video frame displayed by the display device in the third image is the fourth image. However, in the case where the third stopwatch time is later than the time at which the display device starts displaying the fourth image, the second camera may capture the stopwatch and the display device simultaneously at any two times at which the display device displays the video stream to obtain the third image and the sixth image, the capture time of the third image being later than the capture time of the sixth image. At this time, one video frame displayed by the display device in the sixth image is the fourth image.
In the case where the third stopwatch time is equal to the display time of the fourth image, the third image includes not only the display time of the stopwatch photographed by the second camera but also the display time of the stopwatch photographed by the first camera, that is, the third stopwatch time and the fourth stopwatch time. At this time, the computer device may acquire the third stopwatch time and the fourth stopwatch time directly from the third image, or may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
In the case where the third stopwatch time is later than the display time of the fourth image, the third image includes the display time of the stopwatch photographed by the second camera, and the video frame displayed by the display device in the sixth image includes the display time of the stopwatch photographed by the first camera, that is, the fourth image includes the display time of the stopwatch photographed by the first camera. At this point, the computer device may obtain a third stopwatch time from the third image and a fourth stopwatch time from the fourth image.
It should be noted that the second video camera may be any device having a video shooting function, such as a smart phone, a digital camera, a pan-tilt monitoring device, and the like. The second camera may be the same type of camera as the first camera, or may be a different type of camera. The second preset duration may be equal to or different from the first preset duration.
Referring to fig. 3, the system further includes: a photoresistor, a light source and an oscilloscope. The first camera and the photoresistor are positioned on the light-emitting side of the light source, the first camera is connected with a first signal channel of the oscilloscope, and the photoresistor is connected with a second signal channel of the oscilloscope. The first camera is further used for transmitting a first analog signal to the oscilloscope through the first signal channel, the first analog signal is a video signal shot by the first camera, and the light source is switched between the off state and the on state in the process of obtaining the first analog signal. The photoresistor is used for transmitting a second analog signal to the oscilloscope through the second signal channel, the second analog signal is a signal output by the photoresistor, and the light source is switched between the off state and the on state in the process of obtaining the second analog signal. The computer device is further configured to acquire the first analog signal and the second analog signal, and determine a system time delay of the first camera based on the first analog signal and the second analog signal.
When the illumination intensity is different, the video signals shot by the first camera are different, and the signals output by the photoresistor are also different, so that the switching time can be embodied in the first analog signal shot by the first camera through the switching of the light source between the off state and the on state in the process of shooting the video signals by the first camera, and the switching time can be embodied in the second analog signal output by the photoresistor. Therefore, the first analog signal and the second analog signal are displayed on the oscilloscope, and the system time delay of the first camera can be determined according to the time when the signal in the first analog signal changes and the time when the signal in the second analog signal changes.
And if the difference of the ambient brightness of the environment where the first camera and the photoresistor are located is large at two moments before and after the light source is turned on, the accuracy of the system time delay of the first camera determined by the method is high. Thus, the ambient brightness of the light source in the on state is greater than the ambient brightness of the light source in the off state. Alternatively, in some cases, the system time delay of the first camera may be determined in a darkroom, as described above. That is, the darkroom is used as a test environment for determining the time delay of the first camera system, so that the influence of stray light on the test accuracy can be effectively avoided.
As an example, in a darkroom environment, the light source is first in an off state, and at this time, the first camera captures a video signal to obtain a first analog signal, and transmits the first analog signal to the oscilloscope through the first signal channel, and the oscilloscope displays the first analog signal. Meanwhile, the photoresistor can also output a second analog signal, and the second analog signal is transmitted to the oscilloscope through the second signal channel, and the oscilloscope displays the second analog signal. When the light source is switched from the off state to the on state, the first analog signal output by the first camera is continuously transmitted to the oscilloscope through the first signal channel, and the second analog signal output by the photoresistor is also continuously transmitted to the oscilloscope through the second signal channel. The system delay of the first camera may then be determined by the time at which the signal in the first analog signal changes and the time at which the signal in the second analog signal changes.
As another example, in a darkroom environment, the light source is first turned on, and at this time, the first camera captures a video signal to obtain a first analog signal, and transmits the first analog signal to the oscilloscope through the first signal channel, and the oscilloscope displays the first analog signal. Meanwhile, the photoresistor can also output a second analog signal, and the second analog signal is transmitted to the oscilloscope through the second signal channel, and the oscilloscope displays the second analog signal. When the light source is switched from the on state to the off state, the first analog signal output by the first camera is continuously transmitted to the oscilloscope through the first signal channel, and the second analog signal output by the photoresistor is also continuously transmitted to the oscilloscope through the second signal channel. The system delay of the first camera may then be determined by the time at which the signal in the first analog signal changes and the time at which the signal in the second analog signal changes.
In general, there is a system delay in the first camera, and the delay of the photoresistor is negligible to the system delay of the first camera, so that the time when the signal changes and is closest to the state switching time of the light source in the first analog signal can be determined to obtain the first signal time, and the state switching time of the light source is the time when the light source switches between the on state and the off state. And determining the time which is closest to the state switching time of the light source and the time when the signal changes in the second analog signal so as to obtain a second signal time. The absolute value of the time difference between the first signal time and the second signal time is determined as the system time delay of the first camera.
Compared with the off state, when the light source is in the on state, the waveform amplitudes of the first analog signal and the second analog signal are larger, so that when the light source is switched from the off state to the on state, the time which is closest to the state switching time of the light source and the waveform amplitude changes from small to large can be determined from the first analog signal to obtain the first signal time. And determining the time which is closest to the state switching time of the light source and the waveform amplitude changes from small to large from the second analog signal to obtain a second signal time.
In general, in a darkroom environment, the level of the second analog signal is low if the light source is in an off state, and is high if the light source is in an on state. So for the second analog signal, the time that is closest to the state switching time of the light source and the level changes from the low level to the high level can be determined from the second analog signal to obtain the second signal time.
The Light source may be an LED (Light Emitting Diode) Light source, or may be another Light source. The first camera is capable of sensing light from the light source, for example, when the light source is a visible light source, the first camera is a visible light camera. When the light source is an infrared light source, the first camera is an infrared light camera, and certainly, when the light source is another light source, the first camera is another camera capable of sensing light emitted by the light source.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, and the time delay of photo resistance can be ignored to the system time delay of first camera moreover, so, through the switching of light source between open mode and closed state, utilize the response of photo resistance to illumination intensity, can accurately determine the system time delay of first camera, and then can accurately determine display device's the time delay of graphing. After the system time delay of the first camera and the picture delay of the display device are determined, the infrared camera and the first camera are used for shooting the stopwatch, so that the system time delay of the infrared camera can be accurately determined, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
Fig. 4 is a flowchart of a method for determining a time delay of an infrared camera system, which is applied to a computer device according to an embodiment of the present application. Referring to fig. 4, the method includes the following steps.
Step 401: and acquiring a first image, wherein the first image is obtained by shooting at least the stopwatch by the first camera under the condition that the second image is displayed by the display device, and the second image is obtained by shooting the stopwatch by the infrared camera.
After the first camera captures the first image, the first camera may transmit the first image to the computer device.
Based on the above description, the first camera may capture only the stopwatch to obtain the first image when the display device displays the second image, or may capture both the stopwatch and the display device displaying the second image to obtain the first image.
Step 402: an absolute value of a time difference between a first stopwatch time, which is a display time of the stopwatch photographed by the first camera, and a second stopwatch time, which is a display time of the stopwatch photographed by the infrared camera, is determined to obtain the first time difference.
Based on the above description, the first image may include only the display time of the stopwatch photographed by the first camera, i.e., the first stopwatch time. It is also possible to include both the display time of the stop watch photographed by the first camera and the display time of the stop watch photographed by the infrared camera, i.e. the first stop watch time and the second stop watch time. In this way, after the computer device acquires the first image, the first stopwatch time and the second stopwatch time may be acquired from the first image. Of course, in the case where the first image includes only the first stopwatch time, the infrared camera may also transmit the second image to the computer device, so that the computer device may acquire the first stopwatch time from the first image and the second stopwatch time from the second image. Alternatively, in the case where the first image includes the first stopwatch time and the second stopwatch time, the computer device may acquire the first stopwatch time from the first image and the second stopwatch time from the second image.
Step 403: and determining the graph delay of the display device, wherein the graph delay is the time delay from the receiving of the image to the displaying of the image by the display device.
In some embodiments, a third image may be acquired, the third image being captured of at least the stopwatch by the second camera with a fourth image being displayed by the display device, the fourth image being captured of the stopwatch by the first camera. The absolute value of the time difference between the third stop watch time, which is the display time of the stop watch determined on the basis of the third image and taken by the second camera, and the fourth stop watch time, which is the display time of the stop watch taken with the fourth image taken by the first camera, is determined to obtain the second time difference. A system time delay of the first camera is determined. And determining the graph delay of the display equipment based on the second time difference and the system delay of the first camera.
Wherein, after the second camera captures the third image, the second camera can transmit the third image to the computer device. Also, based on the above description, the third image may include only the display time of the stopwatch photographed by the second camera, i.e., the third stopwatch time. It is also possible to include in the third image both the display time of the stop watch shot by the second camera and the display time of the stop watch shot by the first camera, i.e. the third and fourth stop watch times. In this way, the third stopwatch time and the fourth stopwatch time may be acquired from the third image after the computer device acquires the third image. Of course, in the case where the third image includes only the third stopwatch time, the first camera may also transmit the fourth image to the computer device, so that the computer device may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image. Alternatively, in a case where the third image includes the third stopwatch time and the fourth stopwatch time, the computer device may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
Based on the above description, the third stopwatch time may be equal to or later than the time when the display device starts displaying the fourth image. In the case that the third stopwatch time is equal to the time when the display device starts to display the fourth image, the implementation process for determining the graph time delay of the display device based on the second time difference and the system time delay of the first camera comprises the following steps: and determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay of the display device. In the case that the time of the third stopwatch is later than the time when the display device starts to display the fourth image, reference may be made to the foregoing description for determining the relevant content of the graph delay of the display device, and details are not described here again.
In some embodiments, determining the system latency of the first camera comprises: and acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by the photoresistor. The first camera and the photoresistor are located in the same environment with the light source, the light source is switched between the off state and the on state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is larger than that of the environment, and the first camera can sense light rays emitted by the light source. A system time delay of the first camera is determined based on the first analog signal and the second analog signal.
The implementation process for determining the system time delay of the first camera based on the first analog signal and the second analog signal includes: and determining the time which is closest to the state switching time of the light source and the time when the signal changes in the first analog signal to obtain the first signal time, wherein the state switching time is the time when the light source is switched between the on state and the off state. And determining the time which is closest to the state switching time of the light source and the time when the signal changes in the second analog signal so as to obtain a second signal time. The absolute value of the time difference between the first signal time and the second signal time is determined as the system time delay of the first camera.
After the oscilloscope acquires the first analog signal and the second analog signal, the oscilloscope can transmit the first analog signal and the second analog signal to the computer device, so that the computer device can determine the system time delay of the first camera based on the first analog signal and the second analog signal. Of course, after the oscilloscope displays the first analog signal and the second analog signal, a technician may determine the first signal time from the first analog signal displayed by the oscilloscope and determine the second signal time from the second analog signal, and then input the first signal time and the second signal time to the computer device, and the computer device determines the system time delay of the first camera. Of course, other implementations are possible.
Optionally, the environment in which the photo-resistor and the first camera are located is a darkroom.
Step 404: and determining the system time delay of the infrared camera based on the first time difference and the graph time delay of the display equipment.
Based on the above description, the first stopwatch time may be equal to or later than the time when the display device starts displaying the second image. In the case that the first stopwatch time is equal to the time when the display device starts to display the second image, the implementation process for determining the system time delay of the infrared camera based on the first time difference and the graph time delay of the display device comprises the following steps: and determining the absolute value of the time difference between the first time difference and the graph time delay of the display equipment as the time delay of the infrared camera system. In the case that the first stopwatch time is later than the time when the display device starts to display the second image, reference may be made to the foregoing description to determine the relevant content of the system delay of the infrared camera, which is not described herein again.
It should be noted that the method for determining time delay of an infrared camera system provided in the embodiment of the present application and the embodiment of the system for determining time delay of an infrared camera system belong to the same concept, and specific implementation processes thereof are detailed in the embodiment of the system and are not described herein again.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, and the time delay of photo resistance can be ignored to the system time delay of first camera moreover, so, through the switching of light source between open mode and closed state, utilize the response of photo resistance to illumination intensity, can accurately determine the system time delay of first camera, and then can accurately determine display device's the time delay of graphing. After the system time delay of the first camera and the picture delay of the display device are determined, the system time delay of the infrared camera can be accurately determined through shooting of the stopwatch by the infrared camera and the first camera, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
Fig. 5 is a schematic structural diagram of an infrared camera system delay determining apparatus provided in an embodiment of the present application, where the infrared camera system delay determining apparatus may be implemented by software, hardware, or a combination of the two as part or all of a computer device, and the computer device may be the computer device shown in fig. 1. Referring to fig. 5, the apparatus includes: an acquisition module 501, a first determination module 502, a second determination module 503, and a third determination module 504.
The acquiring module 501 is configured to acquire a first image, where the first image is obtained by shooting at least the stopwatch by the first camera when a second image is displayed on the display device, and the second image is obtained by shooting the stopwatch by the infrared camera.
A first determining module 502 for determining an absolute value of a time difference between a first stopwatch time, which is a display time of the stopwatch photographed by the first camera and determined based on the first image, and a second stopwatch time, which is a display time of the stopwatch photographed by the infrared camera, to obtain a first time difference.
A second determining module 503, configured to determine an image delay of the display device, where the image delay is a delay from receiving an image to displaying the image by the display device.
A third determining module 504, configured to determine a system delay of the infrared camera based on the first time difference and the graph delay.
Optionally, the first stopwatch time is equal to a time when the display device starts displaying the second image;
the third determining module 504 is specifically configured to:
and determining the absolute value of the time difference between the first time difference and the graph time delay as the system time delay of the infrared camera.
Optionally, the second determining module 503 includes:
the acquisition sub-module is used for acquiring a third image, the third image is obtained by shooting at least the stopwatch by the second camera under the condition that a fourth image is displayed on the display equipment, and the fourth image is obtained by shooting the stopwatch by the first camera;
a first determination submodule for determining an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time to obtain a second time difference, the third stopwatch time being a display time of a stopwatch shot by the second camera and determined based on the third image, the fourth stopwatch time being a display time of a stopwatch shot when the fourth image is obtained by the first camera;
the second determining submodule is used for determining the system time delay of the first camera;
and the third determining submodule is used for determining the graph delay based on the second time difference and the system delay of the first camera.
Optionally, the third stopwatch time is equal to a time when the display device starts displaying the fourth image;
the third determination submodule is specifically configured to:
and determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay.
Optionally, the second determining sub-module includes:
the acquisition unit is used for acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by the photoresistor;
the first camera and the photoresistor are in the same environment with the light source, the light source is switched between a closed state and an open state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is greater than that of the environment, and the first camera can sense light rays emitted by the light source;
a determining unit for determining a system time delay of the first camera based on the first analog signal and the second analog signal.
Optionally, the determining unit is specifically configured to:
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the first analog signal so as to obtain first signal time, wherein the state switching time is the time when the light source is switched between an open state and a closed state;
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the second analog signal so as to obtain second signal time;
the absolute value of the time difference between the first signal time and the second signal time is determined as the system time delay of the first camera.
Optionally, the environment is a darkroom.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, and the time delay of photo resistance can be ignored to the system time delay of first camera moreover, so, through the switching of light source between open mode and closed state, utilize the response of photo resistance to illumination intensity, can accurately determine the system time delay of first camera, and then can accurately determine display device's the time delay of graphing. After the system time delay of the first camera and the picture delay of the display device are determined, the system time delay of the infrared camera can be accurately determined through shooting of the stopwatch by the infrared camera and the first camera, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
It should be noted that: the infrared camera system delay determining apparatus provided in the foregoing embodiment, when determining the system delay of the infrared camera, is only illustrated by the division of the functional modules, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus may be divided into different functional modules, so as to complete all or part of the functions described above. In addition, the time delay determining apparatus of the infrared camera system and the time delay determining method of the infrared camera system provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
Fig. 6 is a block diagram of a computer device 600 according to an embodiment of the present disclosure. The computer device 600 may be a portable mobile terminal, such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Computer device 600 may also be referred to by other names such as user equipment, portable terminals, laptop computer devices, desktop computer devices, and the like.
Generally, the computer device 600 includes: a processor 601 and a memory 602.
The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 601 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 601 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 602 is used to store at least one instruction for execution by processor 601 to implement the infrared camera system latency determination methods provided by the method embodiments herein.
In some embodiments, the computer device 600 may further optionally include: a peripheral interface 603 and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 603 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 604, a touch screen display 605, a camera 606, an audio circuit 607, a positioning component 608, and a power supply 609.
The peripheral interface 603 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 601 and the memory 602. In some embodiments, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 601, the memory 602, and the peripheral interface 603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 604 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 604 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 604 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 604 may communicate with other computer devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: the world wide web, metropolitan area networks, intranets, generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 604 may further include a circuit related to NFC (Near Field Communication), which is not limited in this application.
The display 605 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 605 is a touch display screen, the display screen 605 also has the ability to capture touch signals on or over the surface of the display screen 605. The touch signal may be input to the processor 601 as a control signal for processing. At this point, the display 605 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 605 may be one, providing the front panel of the computer device 600; in other embodiments, the display 605 may be at least two, respectively disposed on different surfaces of the computer device 600 or in a folded design; in still other embodiments, the display 605 may be a flexible display disposed on a curved surface or on a folded surface of the computer device 600. Even more, the display 605 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 605 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.
The camera assembly 606 is used to capture images or video. Optionally, camera assembly 606 includes a front camera and a rear camera. Generally, a front camera is disposed on a front panel of a computer apparatus, and a rear camera is disposed on a rear surface of the computer apparatus. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 606 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
Audio circuitry 607 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 601 for processing or inputting the electric signals to the radio frequency circuit 604 to realize voice communication. For stereo capture or noise reduction purposes, the microphones may be multiple and located at different locations on the computer device 600. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 601 or the radio frequency circuit 604 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 607 may also include a headphone jack.
The Location component 608 is used to locate the current geographic Location of the computer device 600 to implement navigation or LBS (Location Based Service). The Positioning component 608 can be a Positioning component based on the Global Positioning System (GPS) in the united states, the beidou System in china, or the galileo System in russia.
The power supply 609 is used to supply power to the various components in the computer device 600. The power supply 609 may be ac, dc, disposable or rechargeable. When the power supply 609 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the computer device 600 also includes one or more sensors 610. The one or more sensors 610 include, but are not limited to: acceleration sensor 611, gyro sensor 612, pressure sensor 613, fingerprint sensor 614, optical sensor 615, and proximity sensor 616.
The acceleration sensor 611 may detect the magnitude of acceleration in three coordinate axes of a coordinate system established with the computer apparatus 600. For example, the acceleration sensor 611 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 601 may control the touch screen display 605 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 611. The acceleration sensor 611 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 612 may detect a body direction and a rotation angle of the computer apparatus 600, and the gyro sensor 612 may cooperate with the acceleration sensor 611 to acquire a 3D motion of the user on the computer apparatus 600. The processor 601 may implement the following functions according to the data collected by the gyro sensor 612: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
The pressure sensors 613 may be disposed on the side bezel of the computer device 600 and/or underneath the touch display screen 605. When the pressure sensor 613 is disposed on the side frame of the computer device 600, the holding signal of the user to the computer device 600 can be detected, and the processor 601 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 613. When the pressure sensor 613 is disposed at the lower layer of the touch display screen 605, the processor 601 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 605. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 614 is used for collecting a fingerprint of a user, and the processor 601 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the identity of the user according to the collected fingerprint. Upon identifying that the user's identity is a trusted identity, the processor 601 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 614 may be provided on the front, back, or side of the computer device 600. When a physical key or vendor Logo is provided on the computer device 600, the fingerprint sensor 614 may be integrated with the physical key or vendor Logo.
The optical sensor 615 is used to collect the ambient light intensity. In one embodiment, processor 601 may control the display brightness of touch display 605 based on the ambient light intensity collected by optical sensor 615. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 605 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 605 is turned down. In another embodiment, the processor 601 may also dynamically adjust the shooting parameters of the camera assembly 606 according to the ambient light intensity collected by the optical sensor 615.
The proximity sensor 616, also known as a distance sensor, is typically disposed on the front panel of the computer device 600. The proximity sensor 616 is used to capture the distance between the user and the front of the computer device 600. In one embodiment, the processor 601 controls the touch display screen 605 to switch from the bright screen state to the rest screen state when the proximity sensor 616 detects that the distance between the user and the front face of the computer device 600 is gradually decreased; when the proximity sensor 616 detects that the distance between the user and the front of the computer device 600 is gradually increasing, the touch display screen 605 is controlled by the processor 601 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in FIG. 6 does not constitute a limitation of the computer device 600, and may include more or fewer components than those shown, or combine certain components, or employ a different arrangement of components.
In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the method for determining time delay of an infrared camera system in the above embodiments. For example, the computer readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is noted that the computer-readable storage medium referred to in the embodiments of the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.
It should be understood that all or part of the steps for implementing the above embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
That is, in some embodiments, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the infrared camera system latency determination method described above.
It is to be understood that reference herein to "at least one" means one or more and "a plurality" means two or more. In addition, in order to facilitate clear description of technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
The above-mentioned embodiments are provided not to limit the present application, and any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (14)

1. A method for determining time delay of an infrared camera system, the method comprising:
acquiring a first image, wherein the first image is obtained by shooting at least a stopwatch by a first camera under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, the first stopwatch time being a display time of the stopwatch determined based on the first image and captured by the first camera, the second stopwatch time being a display time of the stopwatch captured by the infrared camera;
determining an image delay of the display device, wherein the image delay is the time delay from receiving an image to displaying the image by the display device;
and determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
2. The method of claim 1, wherein the first stopwatch time is equal to a time at which the display device begins displaying the second image;
the determining the system time delay of the infrared camera based on the first time difference and the graph time delay comprises:
and determining the absolute value of the time difference between the first time difference and the graph time delay as the infrared camera system time delay.
3. The method of claim 1, wherein the determining the graph time delay of the display device comprises:
acquiring a third image, wherein the third image is obtained by shooting at least the stopwatch by a second camera under the condition that a fourth image is displayed on the display device, and the fourth image is obtained by shooting the stopwatch by the first camera;
determining an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time to obtain a second time difference, the third stopwatch time being a display time of the stopwatch determined based on the third image and captured by the second camera, the fourth stopwatch time being a display time of the stopwatch captured with the fourth image captured by the first camera;
determining a system time delay of the first camera;
determining the graph time delay based on the second time difference and a system time delay of the first camera.
4. The method of claim 3, wherein the third stopwatch time is equal to a time at which the display device begins displaying the fourth image;
the determining the graph time delay based on the second time difference and the system time delay of the first camera comprises:
and determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay.
5. The method of claim 3, wherein said determining a system time delay for the first camera comprises:
acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by the photoresistor;
the first camera and the photoresistor are in the same environment with a light source, in the process of obtaining the first analog signal and the second analog signal, the light source is switched between a closed state and an open state, the brightness of the light source is greater than that of the environment, and the first camera can sense light rays emitted by the light source;
determining a system time delay of the first camera based on the first analog signal and the second analog signal.
6. The method of claim 5, wherein determining the system time delay of the first camera based on the first analog signal and the second analog signal comprises:
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the first analog signal to obtain first signal time, wherein the state switching time is the time when the light source is switched between an on state and an off state;
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the second analog signal so as to obtain second signal time;
determining an absolute value of a time difference between the first signal time and the second signal time as a system time delay of the first camera.
7. The method of claim 5 or 6, wherein the environment is a darkroom.
8. An infrared camera system time delay determining apparatus, the apparatus comprising:
the device comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first image, the first image is obtained by shooting at least a stopwatch by a first camera under the condition that a second image is displayed on the display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
a first determining module, configured to determine an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, where the first stopwatch time is a display time of the stopwatch that is determined based on the first image and is captured by the first camera, and the second stopwatch time is a display time of the stopwatch that is captured by the infrared camera;
the second determination module is used for determining the time delay of the image of the display device, wherein the time delay of the image is the time delay from the receiving of the image to the displaying of the image by the display device;
and the third determining module is used for determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
9. The apparatus of claim 8, wherein the first stopwatch time is equal to a time at which the display device begins displaying the second image;
the third determining module is specifically configured to:
determining the absolute value of the time difference between the first time difference and the graph time delay as the system time delay of the infrared camera;
wherein the second determining module comprises:
the acquisition sub-module is used for acquiring a third image, the third image is obtained by shooting at least the stopwatch by a second camera under the condition that a fourth image is displayed on the display equipment, and the fourth image is obtained by shooting the stopwatch by the first camera;
a first determination submodule configured to determine an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time to obtain a second time difference, the third stopwatch time being a display time of the stopwatch captured by the second camera based on the third image determination, the fourth stopwatch time being a display time of the stopwatch captured when the fourth image is obtained by the first camera;
the second determining submodule is used for determining the system time delay of the first camera;
a third determining submodule, configured to determine the graph time delay based on the second time difference and the system time delay of the first camera;
wherein the third stopwatch time is equal to a time at which the display device begins displaying the fourth image;
the third determining submodule is specifically configured to:
determining an absolute value of a time difference between the second time difference and a system time delay of the first camera as the graph time delay;
wherein the second determination submodule includes:
the acquisition unit is used for acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by the photoresistor;
the first camera and the photoresistor are in the same environment with a light source, in the process of obtaining the first analog signal and the second analog signal, the light source is switched between a closed state and an open state, the brightness of the light source is greater than that of the environment, and the first camera can sense light rays emitted by the light source;
a determining unit, configured to determine a system time delay of the first camera based on the first analog signal and the second analog signal;
wherein the determining unit is specifically configured to:
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the first analog signal to obtain first signal time, wherein the state switching time is the time when the light source is switched between an on state and an off state;
determining the time which is closest to the state switching time of the light source and the time when the signal changes in the second analog signal so as to obtain second signal time;
determining an absolute value of a time difference between the first signal time and the second signal time as a system time delay of the first camera;
wherein the environment is a darkroom.
10. An infrared camera system delay determination system, the system comprising: the system comprises a computer device, an infrared camera, a first camera, a stopwatch and a display device;
the infrared camera is used for shooting the stopwatch to obtain a second image;
the display device is used for displaying the second image;
the first camera is used for shooting at least the stopwatch to obtain a first image under the condition that the second image is displayed on the display equipment;
the computer device is used for acquiring the first image, determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, wherein the first stopwatch time is a display time of the stopwatch shot by the first camera and determined based on the first image, and the second stopwatch time is a display time of the stopwatch shot by the infrared camera; determining an image delay of the display device, wherein the image delay is the time delay from receiving an image to displaying the image by the display device; and determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
11. The system of claim 10, wherein the system further comprises a second camera;
the first camera is further used for shooting the stopwatch to obtain a fourth image;
the display device is further configured to display the fourth image;
the second camera is used for shooting at least the stopwatch to obtain a third image under the condition that the fourth image is displayed on the display equipment;
the computer device is further configured to acquire the third image, determine an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time to obtain a second time difference, the third stopwatch time being a display time of the stopwatch determined based on the third image and captured by the second camera, the fourth stopwatch time being a display time of the stopwatch captured with the fourth image captured by the first camera; determining a system time delay of the first camera; determining the graph time delay based on the second time difference and a system time delay of the first camera.
12. The system of claim 10 or 11, wherein the system further comprises: a photoresistor, a light source and an oscilloscope; the first camera and the photoresistor are positioned on the light emergent side of the light source, the first camera is connected with a first signal channel of the oscilloscope, and the photoresistor is connected with a second signal channel of the oscilloscope;
the first camera is further configured to transmit a first analog signal to the oscilloscope through the first signal channel, the first analog signal is a video signal captured by the first camera, and the light source is switched between a closed state and an open state in a process of obtaining the first analog signal;
the photoresistor is used for transmitting a second analog signal to the oscilloscope through the second signal channel, the second analog signal is a signal output by the photoresistor, and the light source is switched between a closed state and an open state in the process of obtaining the second analog signal;
the computer device is further configured to acquire the first analog signal and the second analog signal, and determine a system time delay of the first camera based on the first analog signal and the second analog signal.
13. A computer device, characterized in that the computer device comprises a memory for storing a computer program and a processor for executing the computer program stored in the memory to implement the steps of the method according to any of the claims 1-7.
14. A computer-readable storage medium, characterized in that a computer program is stored in the storage medium, which computer program, when being executed by a processor, carries out the steps of the method of one of the claims 1 to 7.
CN202111159533.0A 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system Pending CN113824902A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111159533.0A CN113824902A (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111159533.0A CN113824902A (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Publications (1)

Publication Number Publication Date
CN113824902A true CN113824902A (en) 2021-12-21

Family

ID=78919810

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111159533.0A Pending CN113824902A (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Country Status (1)

Country Link
CN (1) CN113824902A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422777A (en) * 2022-03-28 2022-04-29 珠海视熙科技有限公司 Image recognition-based time delay testing method and device and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0357822A1 (en) * 1988-09-08 1990-03-14 Helmut K. Pinsch GmbH & Co. Method and apparatus for measuring the time difference between pulses
CN102169664A (en) * 2011-01-28 2011-08-31 北京视博云科技有限公司 Time delay detecting method and device of display device
EP2711915A1 (en) * 2012-09-25 2014-03-26 The Boeing Company Latency measurement system and method
JP2014138277A (en) * 2013-01-17 2014-07-28 Canon Inc Imaging apparatus, remote operation terminal, camera system, method and program for controlling the imaging apparatus, and method and program for controlling the remote operation terminal
WO2016041188A1 (en) * 2014-09-19 2016-03-24 华为技术有限公司 Method and device for determining photographing delay time and photographing apparatus
CN106441810A (en) * 2016-12-16 2017-02-22 捷开通讯(深圳)有限公司 Device and method for detecting delay time of VR (virtual reality) equipment
CN107094249A (en) * 2017-03-31 2017-08-25 腾讯科技(上海)有限公司 A kind of method and device for testing camera delay
JP2018056652A (en) * 2016-09-26 2018-04-05 キヤノン株式会社 Imaging device and control method for imaging device
US20180376086A1 (en) * 2017-06-27 2018-12-27 Canon Kabushiki Kaisha Image capturing apparatus, control method, and storage medium
WO2019169840A1 (en) * 2018-03-09 2019-09-12 深圳市道通智能航空技术有限公司 Photographing method, photographing apparatus and photographing system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0357822A1 (en) * 1988-09-08 1990-03-14 Helmut K. Pinsch GmbH & Co. Method and apparatus for measuring the time difference between pulses
CN102169664A (en) * 2011-01-28 2011-08-31 北京视博云科技有限公司 Time delay detecting method and device of display device
EP2711915A1 (en) * 2012-09-25 2014-03-26 The Boeing Company Latency measurement system and method
JP2014138277A (en) * 2013-01-17 2014-07-28 Canon Inc Imaging apparatus, remote operation terminal, camera system, method and program for controlling the imaging apparatus, and method and program for controlling the remote operation terminal
WO2016041188A1 (en) * 2014-09-19 2016-03-24 华为技术有限公司 Method and device for determining photographing delay time and photographing apparatus
JP2018056652A (en) * 2016-09-26 2018-04-05 キヤノン株式会社 Imaging device and control method for imaging device
CN106441810A (en) * 2016-12-16 2017-02-22 捷开通讯(深圳)有限公司 Device and method for detecting delay time of VR (virtual reality) equipment
CN107094249A (en) * 2017-03-31 2017-08-25 腾讯科技(上海)有限公司 A kind of method and device for testing camera delay
US20180376086A1 (en) * 2017-06-27 2018-12-27 Canon Kabushiki Kaisha Image capturing apparatus, control method, and storage medium
WO2019169840A1 (en) * 2018-03-09 2019-09-12 深圳市道通智能航空技术有限公司 Photographing method, photographing apparatus and photographing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王一拙, 石峰: "基于自动镜头分割的视频压缩编码算法", 计算机辅助设计与图形学学报, no. 07 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422777A (en) * 2022-03-28 2022-04-29 珠海视熙科技有限公司 Image recognition-based time delay testing method and device and storage medium

Similar Documents

Publication Publication Date Title
CN111372126B (en) Video playing method, device and storage medium
CN109348247B (en) Method and device for determining audio and video playing time stamp and storage medium
CN110308956B (en) Application interface display method and device and mobile terminal
CN109688461B (en) Video playing method and device
CN108965922B (en) Video cover generation method and device and storage medium
CN109922356B (en) Video recommendation method and device and computer-readable storage medium
CN110839128B (en) Photographing behavior detection method and device and storage medium
CN108616691B (en) Photographing method and device based on automatic white balance, server and storage medium
CN113573122B (en) Audio and video playing method and device
CN112929654B (en) Method, device and equipment for detecting sound and picture synchronization and storage medium
CN109451248B (en) Video data processing method and device, terminal and storage medium
CN111083526B (en) Video transition method and device, computer equipment and storage medium
CN113076051A (en) Slave control terminal synchronization method, device, terminal and storage medium
CN109783176B (en) Page switching method and device
CN111385525B (en) Video monitoring method, device, terminal and system
CN110769120A (en) Method, device, equipment and storage medium for message reminding
CN112396076A (en) License plate image generation method and device and computer storage medium
CN110868642B (en) Video playing method, device and storage medium
CN113824902A (en) Method, device, system, equipment and medium for determining time delay of infrared camera system
CN111860064A (en) Target detection method, device and equipment based on video and storage medium
CN111711841B (en) Image frame playing method, device, terminal and storage medium
CN114594885A (en) Application icon management method, device and equipment and computer readable storage medium
CN111369434B (en) Method, device, equipment and storage medium for generating spliced video covers
CN108881715B (en) Starting method and device of shooting mode, terminal and storage medium
CN110263695B (en) Face position acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination