CN113824902B - Method, device, system, equipment and medium for determining time delay of infrared camera system - Google Patents

Method, device, system, equipment and medium for determining time delay of infrared camera system Download PDF

Info

Publication number
CN113824902B
CN113824902B CN202111159533.0A CN202111159533A CN113824902B CN 113824902 B CN113824902 B CN 113824902B CN 202111159533 A CN202111159533 A CN 202111159533A CN 113824902 B CN113824902 B CN 113824902B
Authority
CN
China
Prior art keywords
time
camera
stopwatch
image
delay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111159533.0A
Other languages
Chinese (zh)
Other versions
CN113824902A (en
Inventor
徐杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Haikang Auto Software Co ltd
Original Assignee
Hangzhou Haikang Auto Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Haikang Auto Software Co ltd filed Critical Hangzhou Haikang Auto Software Co ltd
Priority to CN202111159533.0A priority Critical patent/CN113824902B/en
Publication of CN113824902A publication Critical patent/CN113824902A/en
Application granted granted Critical
Publication of CN113824902B publication Critical patent/CN113824902B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Measurement Of Unknown Time Intervals (AREA)

Abstract

The embodiment of the application discloses a method, a device, a system, equipment and a medium for determining time delay of an infrared camera system, and belongs to the field of data processing. The method comprises the following steps: acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera; determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain a first time difference, wherein the first stopwatch time is determined based on a first image and is a display time of a stopwatch shot by a first camera, and the second stopwatch time is a display time of a stopwatch shot by an infrared camera; determining the graph time delay of the display equipment; based on the first time difference and the plot delay of the display device, a system delay of the infrared camera is determined. The method and the device solve the problem that the time delay of the infrared camera system cannot be accurately determined.

Description

Method, device, system, equipment and medium for determining time delay of infrared camera system
Technical Field
The embodiment of the application relates to the field of data processing, in particular to a method, a device, a system, equipment and a medium for determining the time delay of an infrared camera system.
Background
The system delay of the camera refers to the time required for the camera to take a picture to output an image. The camera comprises a visible light camera and an infrared camera, wherein the visible light camera is a device for converting visible light reflected by an object into a distinguishable image signal through sensing the visible light reflected by the object, and the infrared camera is a device for converting infrared light reflected by the object into a distinguishable image signal through sensing the infrared light reflected by the object.
The related art proposes a method of determining a system delay of a visible light camera by a visible light source. However, for the infrared camera, the visible light source is not applicable to the infrared camera, and the video signal output by the infrared camera is not changed obviously whether the visible light source is in an on state or an off state. Thus, there is a need for a method that can determine the system delay of an infrared camera.
Disclosure of Invention
The embodiment of the application provides a method, a device, a system, equipment and a medium for determining the system time delay of an infrared camera, which at least can solve the problem that the system time delay of the infrared camera cannot be determined in the related art. The technical scheme is as follows:
in one aspect, a method for determining a time delay of an infrared camera system is provided, the method comprising:
acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
Determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, wherein the first stopwatch time is determined based on the first image and is a display time of the stopwatch shot by the first camera, and the second stopwatch time is a display time of the stopwatch shot by the infrared camera;
determining the graph time delay of the display equipment, wherein the graph time delay is the time delay from the receiving of an image to the displaying of the image by the display equipment;
And determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, there is provided an infrared camera system delay determination apparatus, the apparatus comprising:
The acquisition module is used for acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least under the condition that a second image is displayed on display equipment, and the second image is obtained by shooting the stopwatch by an infrared camera;
A first determining module, configured to determine an absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, where the first stopwatch time is determined based on the first image and is a display time of the stopwatch captured by the first camera, and the second stopwatch time is a display time of the stopwatch captured by the infrared camera;
A second determining module, configured to determine a graph time delay of the display device, where the graph time delay is a time delay between receiving an image and displaying the image by the display device;
And the third determining module is used for determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, there is provided an infrared camera system delay determination system, the system comprising: computer device, infrared camera, first camera, stopwatch and display device;
the infrared camera is used for shooting the stopwatch so as to obtain a second image;
the display device is used for displaying the second image;
The first camera is used for shooting at least the stopwatch to obtain a first image under the condition that the second image is displayed on the display device;
The computer device is used for acquiring the first image, determining the absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, wherein the first stopwatch time is determined based on the first image and is the display time of the stopwatch shot by the first camera, and the second stopwatch time is the display time of the stopwatch shot by the infrared camera; determining the graph time delay of the display equipment, wherein the graph time delay is the time delay from the receiving of an image to the displaying of the image by the display equipment; and determining the system time delay of the infrared camera based on the first time difference and the graph time delay.
In another aspect, a computer device is provided, the computer device including a memory for storing a computer program and a processor for executing the computer program stored on the memory to implement the steps of the method for determining an infrared camera system delay.
In another aspect, a computer readable storage medium is provided, in which a computer program is stored, which when executed by a processor, implements the steps of the method for determining a time delay of an infrared camera system described above.
In another aspect, a computer program product is provided comprising instructions which, when run on a computer, cause the computer to perform the steps of the above-described method for determining the time delay of an infrared camera system.
The technical scheme provided by the embodiment of the application at least has the following beneficial effects:
According to the embodiment of the application, the stopwatch is shot through the infrared camera, and the shot second image is displayed in the display device. In this way, when the second image is displayed on the display device, the first camera can determine the first stopwatch time from the first image after at least photographing the stopwatch. The second stopwatch time is the display time of the stopwatch shot by the infrared camera, and the time difference between the first stopwatch time and the second stopwatch time comprises the infrared camera system time delay and the drawing time delay of the display equipment, so that the infrared camera system time delay can be accurately determined after the drawing time delay of the display equipment is determined, and the problem that the infrared camera system time delay cannot be accurately determined is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a system architecture diagram for determining a system delay of an infrared camera according to an embodiment of the present application;
fig. 2 is a schematic diagram of determining a graph delay of a display device according to an embodiment of the present application;
FIG. 3 is a block diagram of determining a system delay of a first camera according to an embodiment of the present application;
FIG. 4 is a flowchart of a method for determining a time delay of an infrared camera system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an infrared camera system delay determining device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the following detailed description of the embodiments of the present application will be given with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic diagram of an infrared camera system delay determining system according to an embodiment of the present application. The system comprises: computer device, infrared camera, first camera, stopwatch and display device. The infrared camera is used for shooting a stopwatch so as to obtain a second image. The display device is used for displaying the second image. The first camera is used for shooting at least the stopwatch under the condition that the second image is displayed on the display device so as to obtain the first image. The computer device is used for acquiring a first image, determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time to obtain the first time difference, wherein the first stopwatch time is determined based on the first image and is a display time of a stopwatch shot by the first camera, the second stopwatch time is a display time of the stopwatch shot by the infrared camera, the graph time delay of the display device is determined, the graph time delay is a time delay from the image receiving to the image displaying of the display device, and the system time delay of the infrared camera is determined based on the first time difference and the graph time delay of the display device. In embodiments of the present application, the system delay of a camera refers to the time required for the camera to take an image to output an image (e.g., send to a display device for display).
That is, after the second image is captured by the infrared camera on the stopwatch, the infrared camera also needs to send the second image to the display device, and the display device displays the second image. Thus, when the second image is displayed on the display device, the first camera photographs at least the stopwatch, thereby obtaining the first image. At this time, the first image includes the display time of the stopwatch photographed by the first camera, that is, the first stopwatch time.
Since the first stopwatch time is the display time of the stopwatch shot by the first camera, the second stopwatch time is the display time of the stopwatch shot by the infrared camera, and the time from the second stopwatch time to the output of the second image by the infrared camera is the system delay of the infrared camera, the infrared camera sends the second image to the display device, and the time taken from the receiving of the second image by the display device to the display of the second image is the graph delay (or called the display delay time) of the display device. Therefore, the first time difference determined based on the first stopwatch time and the second stopwatch time includes not only the system time delay of the infrared camera but also the map time delay of the display device. Thus, after the graph time delay of the display device is determined, the system time delay of the infrared camera can be determined based on the first time difference and the graph time delay of the display device.
The first camera can shoot at least the stopwatch at any time when the display device displays the second image to obtain the first image. For example, the first camera may take at least a second image of the stopwatch when the display device starts displaying the second image, or may take at least a second image of the stopwatch at any time after the display device starts displaying the second image. That is, the first stopwatch time may be equal to or later than the time at which the display device starts displaying the second image.
When the first stopwatch time is equal to the time when the display device starts to display the second image, the first time difference is the sum of the system time delay of the infrared camera and the figure time delay of the display device, and at the moment, the computer device can directly determine the absolute value of the time difference between the first time difference and the figure time delay of the display device as the system time delay of the infrared camera.
In the case that the first stopwatch time is later than the time when the display device starts to display the second image, the first time difference is the sum of the time delay of the infrared camera system, the drawing time delay of the display device and the first time delay, and the first time delay is the time delay (i.e. the time delay) between the time when the display device starts to display the second image and the first stopwatch time. At this time, the computer device may determine an absolute value of a time difference between the first time difference and the graph time delay of the display device to obtain a third time difference, and further determine an absolute value of a time difference between the third time difference and the first time delay to obtain the infrared camera system time delay.
In the embodiment of the application, the infrared camera can shoot the stopwatch to obtain one image, and the image is transmitted to the display device as a second image. Of course, the infrared camera may continuously shoot the stopwatch to obtain a video stream, and transmit the video stream to the display device in real time, where the second image is a video frame in the video stream. That is, the second image may be one image captured by the infrared camera, or may be one video frame in a video stream captured by the infrared camera. The following will describe the two cases respectively.
The second image is an image shot by the infrared camera
In the case where the first stopwatch time is equal to the time at which the display device starts displaying the second image, it is indicated that the first stopwatch time is the same as the time at which the display device starts displaying the second image. In order to ensure that the first camera just shoots the stopwatch when the display device starts displaying the second image, the first camera needs to be controlled. In some embodiments, when the display device begins to display the second image, a control signal is sent to the first camera so that the first camera can take a picture of the stopwatch to obtain the first image. Or the display device transmits the time at which the second image starts to be displayed to the first camera, and the first camera shoots the stopwatch based on the time, thereby obtaining the first image.
In the case where the first stopwatch time is later than the time at which the display device starts displaying the second image, at this time, it is necessary to accurately determine the first delay. The first delay may be determined by any manner, for example, when the display device starts to display the second image, a control signal is sent to the first camera, so that after the first camera receives the control signal, the first camera waits for a first preset period of time and then shoots. At this time, the first preset duration is the first time delay.
In addition, in the case where the second image is displayed on the display device, the first camera may only shoot the stopwatch to obtain the first image. The first camera may also take a picture of the stopwatch and the display device simultaneously to obtain the first image. That is, the first image may include only the stopwatch photographed by the first camera, and the first image may also include the stopwatch photographed by the first camera, and the display device displaying the second image.
In the case where the first camera only shoots the stopwatch, the computer device may directly identify the display time of the stopwatch from the first image to obtain a first stopwatch time, and directly identify the display time of the stopwatch from the second image to obtain a second stopwatch time.
In the case where the first camera photographs the stopwatch and the display device simultaneously, the first image includes not only the display time of the stopwatch photographed by the first camera but also the display time of the stopwatch photographed by the infrared camera, that is, the first stopwatch time and the second stopwatch time. At this time, the computer device may acquire the first stopwatch time and the second stopwatch time directly from the first image, or may acquire the first stopwatch time from the first image and the second stopwatch time from the second image.
In the case where the first camera photographs the stopwatch and the display device at the same time, the first camera may be controlled in other ways than the first camera is controlled in the above-described manner. For example, in the case where the first stopwatch time is equal to the time when the display device starts displaying the second image, the first camera may take the images simultaneously with the infrared camera, and the first camera performs continuous shooting, so that an image in which the second image is displayed on the display device for the first time can be determined from a plurality of images obtained by the continuous shooting of the first camera, and the image is determined as the first image, thereby obtaining the first stopwatch time.
The second image is a video frame in the video stream shot by the infrared camera
Based on the above description, the infrared camera is continuously shooting the stopwatch, and the shot video stream is transmitted to the display device in real time. In this case, the display time of the stopwatch in the video stream is changed, that is, the display time of the stopwatch is different in different video frames, and at the same time, the display time of the stopwatch is also changed, so that in the case where the first stopwatch time is equal to the display time of the second image, the first camera can shoot the stopwatch and the display device at the same time at any time when the display device displays the video stream, so as to obtain the first image. At this time, one video frame displayed by the display device in the first image is the second image. However, in the case where the first stopwatch time is later than the time at which the display device starts displaying the second image, the first camera may simultaneously photograph the stopwatch and the display device at any two times at which the display device displays the video stream to obtain the first image and the fifth image, and the photographing time of the first image is later than the photographing time of the fifth image. At this time, one video frame displayed by the display device in the fifth image is the second image.
In the case where the first stopwatch time is equal to the display time of the second image, the first image includes not only the display time of the stopwatch photographed by the first camera but also the display time of the stopwatch photographed by the infrared camera, that is, the first stopwatch time and the second stopwatch time. At this time, the computer device may acquire the first stopwatch time and the second stopwatch time directly from the first image, or may acquire the first stopwatch time from the first image and the second stopwatch time from the second image.
In the case that the first stopwatch time is later than the display time of the second image, the first image includes the display time of the stopwatch shot by the first camera, and the fifth image includes the display time of the stopwatch shot by the infrared camera in the video frame displayed by the display device, that is, the second image includes the display time of the stopwatch shot by the infrared camera. At this point, the computer device may acquire a first stopwatch time from the first image and a second stopwatch time from the second image.
It should be noted that, in the embodiment of the present application, the stopwatch is always in a timing state. The first camera may be any device having a camera function, such as a smart phone, a digital camera, a cradle head monitoring device, and the like. The display device is any device having a display function, such as a mobile phone, a computer, a television, and the like. The computer device is any device having an operation function, such as a mobile phone, a computer, a television, and the like.
Referring to fig. 2, the system further includes a second camera. Thus, the first camera is also used to take a second shot of the stopwatch to obtain a fourth image. The display device is also for displaying a fourth image. The second camera is used for shooting at least the stopwatch to obtain a third image under the condition that the fourth image is displayed on the display device. The computer device is further configured to acquire a third image, determine an absolute value of a time difference between a third stopwatch time determined based on the third image and taken by the second camera and a fourth stopwatch time taken by the first camera and taken by the fourth camera, to obtain a second time difference. A system delay of the first camera is determined. And determining the graph time delay of the display device based on the second time difference and the system time delay of the first camera.
That is, after the first camera captures the stopwatch to obtain the fourth image, the first camera also needs to send the fourth image to the display device, and the display device displays the fourth image. Thus, when the fourth image is displayed on the display device, the second camera photographs at least the stopwatch, and a third image is obtained. At this time, the third image includes the display time of the stopwatch photographed by the second camera, that is, the third stopwatch time.
Since the third stopwatch time is the display time of the stopwatch shot by the second camera, the fourth stopwatch time is the display time of the stopwatch shot by the first camera, the time from the fourth stopwatch time to the time when the first camera outputs the fourth image is the system time delay of the first camera, the first camera sends the fourth image to the display device, and the time taken from the display device to the time when the fourth image is received by the display device to the time when the fourth image is displayed is the graph time delay of the display device. Therefore, the second time difference determined based on the third stopwatch time and the fourth stopwatch time includes not only the system time delay of the first camera but also the map time delay of the display device. Thus, after determining the system time delay of the first camera, the graph time delay of the display device can be determined based on the second time difference and the system time delay of the first camera.
The second camera can shoot at least the stopwatch at any time when the display device displays the fourth image to obtain a third image. For example, the second camera may take at least a second image of the stopwatch when the display device starts displaying the fourth image, or may take at least a second image of the stopwatch at any time after the display device starts displaying the fourth image. That is, the third stopwatch time may be equal to or later than the time at which the display device starts displaying the fourth image.
When the third stopwatch time is equal to the time when the display device starts displaying the fourth image, the second time difference is the sum of the system time delay of the first camera and the graph time delay of the display device, and at this time, the computer device can directly determine the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay of the display device.
And under the condition that the third stopwatch time is later than the time when the display equipment starts to display the fourth image, the second time difference is the sum of the system time delay of the first camera, the drawing time delay of the display equipment and the second time delay, and the second time delay is the time delay between the time when the display equipment starts to display the fourth image and the third stopwatch time. At this time, the computer device may determine an absolute value of a time difference between the second time difference and the system time delay of the first camera to obtain a fourth time difference, and further determine an absolute value of a time difference between the fourth time difference and the second time delay to obtain a graph time delay of the display device.
In the embodiment of the application, the first camera can shoot the stopwatch to obtain an image, and the image is transmitted to the display device as a fourth image. Of course, the first camera may continuously shoot the stopwatch to obtain a video stream, and transmit the video stream to the display device in real time, where the fourth image is one video frame in the video stream. That is, the fourth image may be one image captured by the first camera, or may be one video frame in the video stream captured by the first camera. The following will describe the two cases respectively.
The fourth image is an image shot by the first camera
In the case where the third stopwatch time is equal to the time at which the display device starts displaying the fourth image, it is indicated that the third stopwatch time is the same as the time at which the display device starts displaying the fourth image. In order to ensure that the second camera just shoots the stopwatch when the display device starts displaying the fourth image, the second camera needs to be controlled. In some embodiments, when the display device begins to display the fourth image, a control signal is sent to the second camera so that the second camera can take a picture of the stopwatch to obtain the third image. Or the display device transmits the time at which the fourth image starts to be displayed to the second camera, and the second camera photographs the stopwatch based on the time, thereby obtaining the third image.
In the case where the third stopwatch time is later than the time at which the display device starts displaying the fourth image, at this time, it is necessary to accurately determine the second delay. The second delay may be determined by any method, for example, when the display device starts to display the fourth image, a control signal is sent to the second camera, so that after the second camera receives the control signal, the second camera waits for a second preset period of time to perform shooting. At this time, the second preset duration is the second time delay.
In addition, in the case where the display device displays the fourth image, the second camera may only photograph the stopwatch to obtain the third image. The second camera may also take a picture of the stopwatch and the display device simultaneously to obtain a third image. That is, the third image may include only the stopwatch photographed by the second camera, and the third image may also include the stopwatch photographed by the second camera, and the display device displaying the fourth image.
In the case where the second camera only shoots the stopwatch, the computer device may directly identify the display time of the stopwatch from the third image to obtain a third stopwatch time, and directly identify the display time of the stopwatch from the fourth image to obtain a fourth stopwatch time.
In the case where the second camera photographs the stopwatch and the display device simultaneously, the third image includes not only the display time of the stopwatch photographed by the second camera but also the display time of the stopwatch photographed by the first camera, that is, the third stopwatch time and the fourth stopwatch time. At this time, the computer device may acquire the third stopwatch time and the fourth stopwatch time directly from the third image, or may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
In the case where the second camera photographs the stopwatch and the display device at the same time, the second camera may be controlled in other ways than the second camera is controlled in the above-described manner. For example, in the case where the third stopwatch time is equal to the time when the display device starts displaying the fourth image, the second camera may take the images simultaneously with the first camera and the second camera performs continuous shooting, so that an image in which the fourth image is displayed on the display device for the first time can be determined from a plurality of images obtained by the continuous shooting of the second camera, the image is determined as the third image, and the third stopwatch time is obtained.
The fourth image is one video frame in the video stream shot by the first camera
Based on the above description, the first camera is continuously shooting the stopwatch and transmitting the shot video stream to the display device in real time. In this case, the display time of the stopwatch in the video stream is changed, that is, the display time of the stopwatch is different in different video frames, and at the same time, the display time of the stopwatch is also changed, so that in the case where the third stopwatch time is equal to the display time of the fourth image, the second camera can shoot the stopwatch and the display device at the same time at any time when the display device displays the video stream, so as to obtain the third image. At this time, one video frame displayed by the display device in the third image is the fourth image. But in case the third stopwatch time is later than the time when the display device starts to display the fourth image, the second camera may shoot the stopwatch and the display device at the same time at any two times when the display device displays the video stream to obtain a third image and a sixth image, the shooting time of the third image being later than the shooting time of the sixth image. At this time, one video frame displayed by the display device in the sixth image is the fourth image.
In the case where the third stopwatch time is equal to the display time of the fourth image, the third image includes not only the display time of the stopwatch photographed by the second camera but also the display time of the stopwatch photographed by the first camera, that is, the third stopwatch time and the fourth stopwatch time. At this time, the computer device may acquire the third stopwatch time and the fourth stopwatch time directly from the third image, or may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
In the case that the third stopwatch time is later than the display time of the fourth image, the third image includes the display time of the stopwatch shot by the second camera, and the video frame displayed by the display device in the sixth image includes the display time of the stopwatch shot by the first camera, that is, the fourth image includes the display time of the stopwatch shot by the first camera. At this point, the computer device may acquire a third stopwatch time from the third image and a fourth stopwatch time from the fourth image.
It should be noted that the second camera may be any device having a camera function, such as a smart phone, a digital camera, a cradle head monitoring device, and the like. The second camera and the first camera may be the same type of camera or different types of cameras. The second preset duration may be equal to or different from the first preset duration.
Referring to fig. 3, the system further includes: a photoresistor, a light source and an oscilloscope. The first camera and the photoresistor are positioned on the light emitting side of the light source, the first camera is connected with a first signal channel of the oscilloscope, and the photoresistor is connected with a second signal channel of the oscilloscope. The first camera is further used for transmitting a first analog signal to the oscilloscope through the first signal channel, the first analog signal is a video signal shot by the first camera, and in the process of obtaining the first analog signal, the light source is switched between the closed state and the open state. The photoresistor is used for transmitting a second analog signal to the oscilloscope through a second signal channel, the second analog signal is a signal output by the photoresistor, and in the process of obtaining the second analog signal, the light source is switched between an off state and an on state. The computer device is further configured to obtain a first analog signal and a second analog signal, and determine a system delay of the first camera based on the first analog signal and the second analog signal.
When the illumination intensity is different, the video signals shot by the first camera are different, and the signals output by the photoresistors are also different, so that the switching time is shown in the first analog signals shot by the first camera through the switching of the light source between the closed state and the open state in the process of shooting the video signals by the first camera, and the switching time is also shown in the second analog signals output by the photoresistors. Therefore, the first analog signal and the second analog signal are displayed on the oscilloscope, and the system time delay of the first camera can be determined through the time when the signal in the first analog signal changes and the time when the signal in the second analog signal changes.
And if the difference of the ambient brightness of the environments where the first camera and the photoresistor are positioned is larger at two moments before and after the light source is turned on, the accuracy of the system time delay of the first camera determined by the method is higher. Therefore, the ambient brightness of the light source in the on state is greater than the ambient brightness of the light source in the off state. Alternatively, in some cases, the system delay of the first camera may be determined in the darkroom as described above. That is, the darkroom is used as a testing environment for determining the time delay of the first camera system, so that the influence of stray light on the testing accuracy can be effectively avoided.
As an example, in a darkroom environment, the light source is first turned off, at this time, the first camera captures a video signal to obtain a first analog signal, and the first analog signal is transmitted to the oscilloscope through the first signal channel, and the oscilloscope displays the first analog signal. Meanwhile, the photoresistor also outputs a second analog signal, and the second analog signal is transmitted to the oscilloscope through the second signal channel, and the oscilloscope displays the second analog signal. When the light source is switched from the off state to the on state, the first analog signal output by the first camera is continuously transmitted to the oscilloscope through the first signal channel, and the second analog signal output by the photoresistor is also continuously transmitted to the oscilloscope through the second signal channel. And then, determining the system time delay of the first camera through the time when the signal in the first analog signal changes and the time when the signal in the second analog signal changes.
As another example, in a darkroom environment, the light source is first in an on state, at this time, the first camera shoots a video signal to obtain a first analog signal, and the first analog signal is transmitted to the oscilloscope through the first signal channel, and the oscilloscope displays the first analog signal. Meanwhile, the photoresistor also outputs a second analog signal, and the second analog signal is transmitted to the oscilloscope through the second signal channel, and the oscilloscope displays the second analog signal. When the light source is switched from the on state to the off state, the first analog signal output by the first camera is continuously transmitted to the oscilloscope through the first signal channel, and the second analog signal output by the photoresistor is also continuously transmitted to the oscilloscope through the second signal channel. And then, determining the system time delay of the first camera through the time when the signal in the first analog signal changes and the time when the signal in the second analog signal changes.
In general, the first camera has a system delay, and the delay of the photoresistor is negligible for the system delay of the first camera, so that the time that the state switching time of the light source is closest to and the signal changes in the first analog signal can be determined, so as to obtain the first signal time, where the state switching time of the light source is the time when the light source is switched between an on state and an off state. And determining the time which is closest to the state switching time of the light source and changes the signal in the second analog signal to obtain the second signal time. The absolute value of the time difference between the first signal time and the second signal time is determined as the system delay of the first camera.
When the light source is in the on state, the waveform amplitude of the first analog signal and the second analog signal is larger than that in the off state, and therefore, when the light source is switched from the off state to the on state, the time closest to the state switching time of the light source and the waveform amplitude of which changes from small to large can be determined from the first analog signal to obtain the first signal time. And determining the time closest to the state switching time of the light source and the waveform amplitude changing from small to large from the second analog signal to obtain the second signal time.
Normally, in a darkroom environment, if the light source is in an off state, the level of the second analog signal is low, and if the light source is in an on state, the level of the second analog signal is high. It is possible for the second analog signal to determine from the second analog signal the time closest to the state switching time of the light source and the level changes from low level to high level to obtain the second signal time.
The light source may be an LED (LIGHT EMITTING Diode) light source, but may be other light sources. The first camera is capable of sensing light emitted by the light source, for example, when the light source is a visible light source, the first camera is a visible light camera. When the light source is an infrared light source, the first camera is an infrared light camera, and when the light source is other light sources, the first camera is other cameras capable of sensing light emitted by the light source.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, the time delay of photo resistance is negligible to the system time delay of first camera moreover, so, through the switching of light source between open state and closed state, utilize photo resistance to illumination intensity's response, can accurately confirm the system time delay of first camera, and then can accurately confirm the drawing time delay of display device. After the system time delay of the first camera and the drawing time delay of the display equipment are determined, the system time delay of the infrared camera can be accurately determined through shooting of the infrared camera and the first camera on the stopwatch, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
Fig. 4 is a flowchart of a method for determining a time delay of an infrared camera system according to an embodiment of the present application, where the method is applied to a computer device. Referring to fig. 4, the method includes the following steps.
Step 401: and acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least when a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera.
After the first camera shoots the first image, the first camera can transmit the first image to the computer device.
Based on the above description, the first camera may take only the stopwatch to obtain the first image in the case where the second image is displayed on the display device, or may take the stopwatch and the display device on which the second image is displayed at the same time to obtain the first image.
Step 402: determining an absolute value of a time difference between a first stopwatch time, which is determined based on the first image and is a display time of a stopwatch photographed by the first camera, and a second stopwatch time, which is a display time of a stopwatch photographed by the infrared camera, to obtain the first time difference.
Based on the above description, the first image may include only the display time of the stopwatch photographed by the first camera, i.e., the first stopwatch time. It is also possible to include both the display time of the stopwatch taken by the first camera and the display time of the stopwatch taken by the infrared camera, i.e. the first stopwatch time and the second stopwatch time. Thus, after the first image is acquired by the computer device, a first stopwatch time and a second stopwatch time may be acquired from the first image. Of course, in the case where only the first stopwatch time is included in the first image, the infrared camera may also transmit the second image to the computer device, so that the computer device may acquire the first stopwatch time from the first image and the second stopwatch time from the second image. Or in the case that the first image includes a first stopwatch time and a second stopwatch time, the computer apparatus may acquire the first stopwatch time from the first image and acquire the second stopwatch time from the second image.
Step 403: and determining the graph time delay of the display device, wherein the graph time delay is the time delay between the receiving image and the displaying image of the display device.
In some embodiments, a third image may be acquired, where the second camera captures at least the stopwatch when the display device displays a fourth image, where the fourth image captures the stopwatch for the first camera. Determining an absolute value of a time difference between a third stopwatch time, which is determined based on the third image and is a display time of a stopwatch photographed by the second camera, and a fourth stopwatch time, which is a display time of a stopwatch photographed by the first camera when the fourth image is obtained, to obtain the second time difference. A system delay of the first camera is determined. And determining the graph time delay of the display device based on the second time difference and the system time delay of the first camera.
Wherein after the second camera captures a third image, the second camera may transmit the third image to the computer device. Furthermore, based on the above description, only the display time of the stopwatch photographed by the second camera, that is, the third stopwatch time may be included in the third image. It is also possible to include in the third image both the display time of the stopwatch taken by the second camera and the display time of the stopwatch taken by the first camera, i.e. the third stopwatch time and the fourth stopwatch time. Thus, after the computer device acquires the third image, a third stopwatch time and a fourth stopwatch time may be acquired from the third image. Of course, in the case where only the third stopwatch time is included in the third image, the first camera may also transmit the fourth image to the computer device, so that the computer device may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image. Or in the case that the third image includes the third stopwatch time and the fourth stopwatch time, the computer apparatus may acquire the third stopwatch time from the third image and the fourth stopwatch time from the fourth image.
Based on the above description, the third stopwatch time may be equal to or later than the time at which the display device starts displaying the fourth image. In the case that the third stopwatch time is equal to the time when the display device starts displaying the fourth image, determining the graph time delay of the display device based on the second time difference and the system time delay of the first camera includes: and determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay of the display equipment. In the case that the third stopwatch time is later than the time when the display device starts displaying the fourth image, the relevant content for determining the graph time delay of the display device may be referred to as the foregoing, and will not be described herein.
In some embodiments, determining the system delay of the first camera includes: and acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by a first camera, and the second analog signal is a signal output by a photoresistor. The first camera and the photoresistor are in the same environment with the light source, the light source is switched between the off state and the on state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is larger than that of the environment, and the first camera can sense light rays emitted by the light source. A system delay of the first camera is determined based on the first analog signal and the second analog signal.
The implementation process for determining the system time delay of the first camera based on the first analog signal and the second analog signal comprises the following steps: and determining the time which is closest to the state switching time of the light source and changes the signal in the first analog signal to obtain the first signal time, wherein the state switching time is the time for switching the light source between an on state and an off state. And determining the time which is closest to the state switching time of the light source and changes the signal in the second analog signal to obtain the second signal time. The absolute value of the time difference between the first signal time and the second signal time is determined as the system delay of the first camera.
After the oscilloscope acquires the first analog signal and the second analog signal, the oscilloscope can transmit the first analog signal and the second analog signal to the computer equipment, so that the computer equipment can determine the system time delay of the first camera based on the first analog signal and the second analog signal. Of course, after the oscilloscope displays the first analog signal and the second analog signal, the technician may determine the first signal time from the first analog signal displayed by the oscilloscope and determine the second signal time from the second analog signal, so that the first signal time and the second signal time are input to the computer device, and the computer device determines the system delay of the first camera. Of course, it is also possible to implement it in other ways.
Optionally, the photoresistor and the first camera are in an environment of a darkroom.
Step 404: based on the first time difference and the plot delay of the display device, a system delay of the infrared camera is determined.
Based on the above description, the first stopwatch time may be equal to or later than the time at which the display device starts displaying the second image. In the case that the first stopwatch time is equal to the time when the display device starts displaying the second image, determining the system delay of the infrared camera based on the first time difference and the graph delay of the display device includes: and determining the absolute value of the time difference between the first time difference and the graph time delay of the display equipment as the infrared camera system time delay. In the case that the first stopwatch time is later than the time when the display device starts displaying the second image, the relevant content for determining the system delay of the infrared camera may be referred to as the foregoing, and will not be described herein.
It should be noted that, the method for determining the time delay of the infrared camera system provided by the embodiment of the present application and the embodiment of the time delay determining system of the infrared camera system belong to the same concept, and detailed implementation processes of the method are shown in the embodiment of the system, which is not repeated here.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, the time delay of photo resistance is negligible to the system time delay of first camera moreover, so, through the switching of light source between open state and closed state, utilize photo resistance to illumination intensity's response, can accurately confirm the system time delay of first camera, and then can accurately confirm the drawing time delay of display device. After the system time delay of the first camera and the drawing time delay of the display device are determined, the system time delay of the infrared camera can be accurately determined through shooting of the infrared camera and the first camera on the stopwatch, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
Fig. 5 is a schematic structural diagram of an infrared camera system delay determining device according to an embodiment of the present application, where the infrared camera system delay determining device may be implemented by software, hardware, or a combination of both as part or all of a computer device, and the computer device may be the computer device shown in fig. 1. Referring to fig. 5, the apparatus includes: an acquisition module 501, a first determination module 502, a second determination module 503, and a third determination module 504.
The obtaining module 501 is configured to obtain a first image, where the first image is obtained by photographing at least a stopwatch with a first camera when a second image is displayed on a display device, and the second image is obtained by photographing the stopwatch with an infrared camera.
A first determining module 502, configured to determine an absolute value of a time difference between a first stopwatch time and a second stopwatch time, where the first stopwatch time is determined based on the first image and is a display time of a stopwatch captured by the first camera, so as to obtain a first time difference, and the second stopwatch time is a display time of a stopwatch captured by the infrared camera.
A second determining module 503, configured to determine a graph time delay of the display device, where the graph time delay is a time delay between receiving an image and displaying the image by the display device.
A third determining module 504 is configured to determine a system delay of the infrared camera based on the first time difference and the graph delay.
Optionally, the first stopwatch time is equal to the time at which the display device starts displaying the second image;
the third determining module 504 is specifically configured to:
and determining the absolute value of the time difference between the first time difference and the graph time delay as the system time delay of the infrared camera.
Optionally, the second determining module 503 includes:
The acquisition sub-module is used for acquiring a third image, wherein the third image is obtained by shooting a stopwatch by the second camera at least under the condition that the display equipment displays a fourth image, and the fourth image is obtained by shooting the stopwatch by the first camera;
A first determining submodule for determining an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time to obtain a second time difference, the third stopwatch time being a display time of a stopwatch which is determined based on a third image and is taken by the second camera, the fourth stopwatch time being a display time of a stopwatch which is taken when the first camera obtains a fourth image;
the second determining submodule is used for determining the system time delay of the first camera;
and the third determining submodule is used for determining the graph time delay based on the second time difference and the system time delay of the first camera.
Optionally, the third stopwatch time is equal to the time at which the display device starts displaying the fourth image;
The third determination submodule is specifically configured to:
And determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay.
Optionally, the second determining submodule includes:
The acquisition unit is used for acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by the photoresistor;
The first camera and the photoresistor are in the same environment with the light source, the light source is switched between a closed state and an open state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is larger than that of the environment, and the first camera can sense light rays emitted by the light source;
And the determining unit is used for determining the system time delay of the first camera based on the first analog signal and the second analog signal.
Optionally, the determining unit is specifically configured to:
Determining the time which is closest to the state switching time of the light source and changes the signal in the first analog signal to obtain first signal time, wherein the state switching time is the time for switching the light source between an on state and an off state;
Determining the time which is closest to the state switching time of the light source and changes in the signal in the second analog signal to obtain second signal time;
The absolute value of the time difference between the first signal time and the second signal time is determined as the system delay of the first camera.
Optionally, the environment is a darkroom.
Because the video signal that first camera gathered can be different along with illumination intensity's difference, the time delay of photo resistance is negligible to the system time delay of first camera moreover, so, through the switching of light source between open state and closed state, utilize photo resistance to illumination intensity's response, can accurately confirm the system time delay of first camera, and then can accurately confirm the drawing time delay of display device. After the system time delay of the first camera and the drawing time delay of the display device are determined, the system time delay of the infrared camera can be accurately determined through shooting of the infrared camera and the first camera on the stopwatch, and the problem that the system time delay of the infrared camera cannot be accurately determined is solved.
It should be noted that: the delay determining device for the infrared camera system provided in the above embodiment only uses the division of the above functional modules to illustrate the delay when determining the system of the infrared camera, in practical application, the above functional allocation may be completed by different functional modules according to the need, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device for determining the time delay of the infrared camera system provided in the above embodiment and the method embodiment for determining the time delay of the infrared camera system belong to the same concept, and detailed implementation processes of the device are shown in the method embodiment, and are not described herein.
Fig. 6 is a block diagram of a computer device 600 according to an embodiment of the present application. The computer device 600 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. The computer device 600 may also be referred to by other names of user devices, portable terminals, laptop computer devices, desktop computer devices, and the like.
In general, the computer device 600 includes: a processor 601 and a memory 602.
Processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 601 may be implemented in at least one hardware form of DSP (DIGITAL SIGNAL Processing), FPGA (Field-Programmable gate array), PLA (Programmable Logic Array ). Processor 601 may also include a main processor, which is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 601 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen. In some embodiments, the processor 601 may also include an AI (ARTIFICIAL INTELLIGENCE ) processor for processing computing operations related to machine learning.
The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 602 is used to store at least one instruction for execution by processor 601 to implement the infrared camera system latency determination method provided by the method embodiments of the present application.
In some embodiments, the computer device 600 may further optionally include: a peripheral interface 603, and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by a bus or signal line. The individual peripheral devices may be connected to the peripheral device interface 603 via buses, signal lines or a circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 604, a touch display 605, a camera 606, audio circuitry 607, a positioning component 608, and a power supply 609.
Peripheral interface 603 may be used to connect at least one Input/Output (I/O) related peripheral to processor 601 and memory 602. In some embodiments, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 601, memory 602, and peripheral interface 603 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.
The Radio Frequency circuit 604 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 604 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 604 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuitry 604 may communicate with other computer devices via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the world wide web, metropolitan area networks, intranets, generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (WIRELESS FIDELITY ) networks. In some embodiments, the radio frequency circuit 604 may further include NFC (NEAR FIELD Communication) related circuits, which embodiments of the present application are not limited in this respect.
The display screen 605 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 605 is a touch display, the display 605 also has the ability to collect touch signals at or above the surface of the display 605. The touch signal may be input as a control signal to the processor 601 for processing. At this point, the display 605 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, the display 605 may be one, providing a front panel of the computer device 600; in other embodiments, the display 605 may be at least two, respectively disposed on different surfaces of the computer device 600 or in a folded design; in still other embodiments, the display 605 may be a flexible display disposed on a curved surface or a folded surface of the computer device 600. Even more, the display 605 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The display 605 may be made of LCD (Liquid CRYSTAL DISPLAY), OLED (Organic Light-Emitting Diode), or other materials.
The camera assembly 606 is used to capture images or video. Optionally, the camera assembly 606 includes a front camera and a rear camera. Typically, the front camera is disposed on a front panel of the computer device and the rear camera is disposed on a rear surface of the computer device. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, camera assembly 606 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.
The audio circuit 607 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and environments, converting the sound waves into electric signals, and inputting the electric signals to the processor 601 for processing, or inputting the electric signals to the radio frequency circuit 604 for voice communication. The microphone may be provided in a plurality of different locations of the computer device 600 for stereo acquisition or noise reduction purposes. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 601 or the radio frequency circuit 604 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, the audio circuit 607 may also include a headphone jack.
The location component 608 is used to locate the current geographic location of the computer device 600 to enable navigation or LBS (Location Based Service, location-based services). The positioning component 608 may be a positioning component based on the United states GPS (Global Positioning System ), the Beidou system of China, or the Galileo system of Russia.
The power supply 609 is used to power the various components in the computer device 600. The power source 609 may be alternating current, direct current, disposable battery or rechargeable battery. When the power source 609 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the computer device 600 further includes one or more sensors 610. The one or more sensors 610 include, but are not limited to: acceleration sensor 611, gyroscope sensor 612, pressure sensor 613, fingerprint sensor 614, optical sensor 615, and proximity sensor 616.
The acceleration sensor 611 can detect the magnitudes of accelerations on three coordinate axes of the coordinate system established with the computer device 600. For example, the acceleration sensor 611 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 601 may control the touch display screen 605 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal acquired by the acceleration sensor 611. The acceleration sensor 611 may also be used for the acquisition of motion data of a game or a user.
The gyro sensor 612 may detect the body direction and the rotation angle of the computer device 600, and the gyro sensor 612 may collect the 3D motion of the user on the computer device 600 in cooperation with the acceleration sensor 611. The processor 601 may implement the following functions based on the data collected by the gyro sensor 612: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.
Pressure sensor 613 may be disposed on a side frame of computer device 600 and/or on an underlying layer of touch screen 605. When the pressure sensor 613 is disposed at a side frame of the computer apparatus 600, a grip signal of the computer apparatus 600 by a user may be detected, and the processor 601 performs a left-right hand recognition or a quick operation according to the grip signal collected by the pressure sensor 613. When the pressure sensor 613 is disposed at the lower layer of the touch display screen 605, the processor 601 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 605. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
The fingerprint sensor 614 is used to collect a fingerprint of a user, and the processor 601 identifies the identity of the user based on the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the identity of the user based on the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 601 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 614 may be provided on the front, back, or side of the computer device 600. When a physical key or vendor Logo is provided on the computer device 600, the fingerprint sensor 614 may be integrated with the physical key or vendor Logo.
The optical sensor 615 is used to collect ambient light intensity. In one embodiment, processor 601 may control the display brightness of touch display 605 based on the intensity of ambient light collected by optical sensor 615. Specifically, when the intensity of the ambient light is high, the display brightness of the touch display screen 605 is turned up; when the ambient light intensity is low, the display brightness of the touch display screen 605 is turned down. In another embodiment, the processor 601 may also dynamically adjust the shooting parameters of the camera assembly 606 based on the ambient light intensity collected by the optical sensor 615.
A proximity sensor 616, also referred to as a distance sensor, is typically provided on the front panel of the computer device 600. The proximity sensor 616 is used to capture the distance between the user and the front of the computer device 600. In one embodiment, when the proximity sensor 616 detects a gradual decrease in the distance between the user and the front of the computer device 600, the processor 601 controls the touch display 605 to switch from the bright screen state to the off screen state; when the proximity sensor 616 detects that the distance between the user and the front of the computer device 600 gradually increases, the touch display screen 605 is controlled by the processor 601 to switch from the off-screen state to the on-screen state.
Those skilled in the art will appreciate that the architecture shown in fig. 6 is not limiting as to the computer device 600, and may include more or fewer components than shown, or may combine certain components, or employ a different arrangement of components.
In some embodiments, there is also provided a computer readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of the method for determining the time delay of an infrared camera system of the above embodiments. For example, the computer readable storage medium may be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
It is noted that the computer readable storage medium mentioned in the embodiments of the present application may be a non-volatile storage medium, in other words, may be a non-transitory storage medium.
It should be understood that all or part of the steps to implement the above-described embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the computer-readable storage medium described above.
That is, in some embodiments, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps of the infrared camera system delay determination method described above.
It should be understood that references herein to "at least one" mean one or more, and "a plurality" means two or more. In addition, in order to facilitate the clear description of the technical solution of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. are used to distinguish the same item or similar items having substantially the same function and effect. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.
The above embodiments are not intended to limit the present application, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present application should be included in the scope of the present application.

Claims (12)

1. A method for determining a time delay of an infrared camera system, the method comprising:
acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least under the condition that a second image is displayed on a display device, and the second image is obtained by shooting the stopwatch by an infrared camera;
Determining an absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, wherein the first stopwatch time is determined based on the first image and is a display time of the stopwatch shot by the first camera, and the second stopwatch time is a display time of the stopwatch shot by the infrared camera;
determining the graph time delay of the display equipment, wherein the graph time delay is the time delay from the receiving of an image to the displaying of the image by the display equipment;
determining a system delay of the infrared camera based on the first time difference and the map delay;
wherein the determining the graph time delay of the display device includes:
Acquiring a third image, wherein the third image is obtained by shooting the stopwatch by a second camera at least when a fourth image is displayed on the display device, and the fourth image is obtained by shooting the stopwatch by the first camera;
Determining an absolute value of a time difference between a third stopwatch time, which is determined based on the third image and is a display time of the stopwatch photographed by the second camera, and a fourth stopwatch time, which is a display time of the stopwatch photographed in a case where the fourth image is obtained by the first camera, to obtain a second time difference;
Determining a system time delay of the first camera;
and determining the graph time delay based on the second time difference and the system time delay of the first camera.
2. The method of claim 1, wherein the first stopwatch time is equal to a time when the display device begins to display the second image;
The determining the system delay of the infrared camera based on the first time difference and the map delay includes:
And determining the absolute value of the time difference between the first time difference and the graph time delay as the infrared camera system time delay.
3. The method of claim 1, wherein the third stopwatch time is equal to a time when the display device begins to display the fourth image;
the determining the graph time delay based on the second time difference and the system time delay of the first camera includes:
And determining the absolute value of the time difference between the second time difference and the system time delay of the first camera as the graph time delay.
4. The method of claim 1, wherein the determining the system delay of the first camera comprises:
acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by a photoresistor;
the first camera and the photoresistor are in the same environment with a light source, the light source is switched between a closed state and an open state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is larger than that of the environment, and the first camera can sense light rays emitted by the light source;
A system delay of the first camera is determined based on the first analog signal and the second analog signal.
5. The method of claim 4, wherein the determining the system delay of the first camera based on the first analog signal and the second analog signal comprises:
Determining the time which is closest to the state switching time of the light source and changes in the signal in the first analog signal to obtain first signal time, wherein the state switching time is the time for switching the light source between an on state and an off state;
determining the time which is closest to the state switching time of the light source and changes in the signal in the second analog signal to obtain second signal time;
and determining the absolute value of the time difference between the first signal time and the second signal time as the system time delay of the first camera.
6. The method of claim 4 or 5, wherein the environment is a darkroom.
7. An infrared camera system delay determination apparatus, the apparatus comprising:
The acquisition module is used for acquiring a first image, wherein the first image is obtained by shooting a stopwatch by a first camera at least under the condition that a second image is displayed on display equipment, and the second image is obtained by shooting the stopwatch by an infrared camera;
A first determining module, configured to determine an absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, where the first stopwatch time is determined based on the first image and is a display time of the stopwatch captured by the first camera, and the second stopwatch time is a display time of the stopwatch captured by the infrared camera;
A second determining module, configured to determine a graph time delay of the display device, where the graph time delay is a time delay between receiving an image and displaying the image by the display device;
a third determining module, configured to determine a system delay of the infrared camera based on the first time difference and the map delay;
Wherein the second determining module includes:
The second camera is used for shooting the stopwatch, and the fourth image is obtained by shooting the stopwatch through the first camera;
A first determining submodule configured to determine an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time, to obtain a second time difference, the third stopwatch time being a display time of the stopwatch determined based on the third image and captured by the second camera, the fourth stopwatch time being a display time of the stopwatch captured in a case where the fourth image is obtained by the first camera;
A second determining submodule for determining a system delay of the first camera;
And a third determining submodule, configured to determine the graph time delay based on the second time difference and the system time delay of the first camera.
8. The apparatus of claim 7, wherein the first stopwatch time is equal to a time when the display device begins to display the second image;
the third determining module is specifically configured to:
Determining an absolute value of a time difference between the first time difference and the map time delay as the infrared camera system time delay;
wherein the third stopwatch time is equal to the time at which the display device starts displaying the fourth image;
the third determination submodule is specifically configured to:
Determining an absolute value of a time difference between the second time difference and a system time delay of the first camera as the map time delay;
Wherein the second determining submodule includes:
The acquisition unit is used for acquiring a first analog signal and a second analog signal, wherein the first analog signal is a video signal shot by the first camera, and the second analog signal is a signal output by a photoresistor;
the first camera and the photoresistor are in the same environment with a light source, the light source is switched between a closed state and an open state in the process of obtaining the first analog signal and the second analog signal, the brightness of the light source is larger than that of the environment, and the first camera can sense light rays emitted by the light source;
A determining unit configured to determine a system delay of the first camera based on the first analog signal and the second analog signal;
Wherein, the determining unit is specifically configured to:
Determining the time which is closest to the state switching time of the light source and changes in the signal in the first analog signal to obtain first signal time, wherein the state switching time is the time for switching the light source between an on state and an off state;
determining the time which is closest to the state switching time of the light source and changes in the signal in the second analog signal to obtain second signal time;
determining an absolute value of a time difference between the first signal time and the second signal time as a system delay of the first camera;
Wherein the environment is a darkroom.
9. An infrared camera system delay determination system, the system comprising: computer device, infrared camera, first camera, second camera, stopwatch and display device;
The infrared camera is used for shooting the stopwatch so as to obtain a second image; the display device is used for displaying the second image; the first camera is used for shooting at least the stopwatch to obtain a first image under the condition that the second image is displayed on the display device;
The computer device is used for acquiring the first image, determining the absolute value of a time difference between a first stopwatch time and a second stopwatch time, so as to obtain a first time difference, wherein the first stopwatch time is determined based on the first image and is the display time of the stopwatch shot by the first camera, and the second stopwatch time is the display time of the stopwatch shot by the infrared camera; determining the graph time delay of the display equipment, wherein the graph time delay is the time delay from the receiving of an image to the displaying of the image by the display equipment; determining a system delay of the infrared camera based on the first time difference and the map delay;
The first camera is further used for shooting the stopwatch so as to obtain a fourth image; the display device is further configured to display the fourth image; the second camera is used for shooting at least the stopwatch to obtain a third image under the condition that the fourth image is displayed on the display device; the computer device is further configured to acquire the third image, determine an absolute value of a time difference between a third stopwatch time and a fourth stopwatch time, and obtain a second time difference, where the third stopwatch time is determined based on the third image and is a display time of the stopwatch captured by the second camera, and the fourth stopwatch time is a display time of the stopwatch captured by the first camera when the fourth image is obtained by the first camera; determining a system time delay of the first camera; and determining the graph time delay based on the second time difference and the system time delay of the first camera.
10. The system of claim 9, wherein the system further comprises: the light-sensitive resistor, the light source and the oscilloscope; the first camera and the photoresistor are positioned on the light emitting side of the light source, the first camera is connected with a first signal channel of the oscilloscope, and the photoresistor is connected with a second signal channel of the oscilloscope;
The first camera is further configured to transmit a first analog signal to the oscilloscope through the first signal channel, where the first analog signal is a video signal captured by the first camera, and the light source is switched between an off state and an on state in a process of obtaining the first analog signal;
The photoresistor is used for transmitting a second analog signal to the oscilloscope through the second signal channel, the second analog signal is a signal output by the photoresistor, and the light source is switched between a closed state and an open state in the process of obtaining the second analog signal;
The computer device is further configured to obtain the first analog signal and the second analog signal, and determine a system delay of the first camera based on the first analog signal and the second analog signal.
11. A computer device, characterized in that it comprises a memory for storing a computer program and a processor for executing the computer program stored on the memory for carrying out the steps of the method according to any of the preceding claims 1-6.
12. A computer-readable storage medium, characterized in that the storage medium has stored therein a computer program which, when executed by a processor, implements the steps of the method of any of claims 1-6.
CN202111159533.0A 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system Active CN113824902B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111159533.0A CN113824902B (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111159533.0A CN113824902B (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Publications (2)

Publication Number Publication Date
CN113824902A CN113824902A (en) 2021-12-21
CN113824902B true CN113824902B (en) 2024-06-18

Family

ID=78919810

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111159533.0A Active CN113824902B (en) 2021-09-30 2021-09-30 Method, device, system, equipment and medium for determining time delay of infrared camera system

Country Status (1)

Country Link
CN (1) CN113824902B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422777A (en) * 2022-03-28 2022-04-29 珠海视熙科技有限公司 Image recognition-based time delay testing method and device and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107094249A (en) * 2017-03-31 2017-08-25 腾讯科技(上海)有限公司 A kind of method and device for testing camera delay

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0357822A1 (en) * 1988-09-08 1990-03-14 Helmut K. Pinsch GmbH & Co. Method and apparatus for measuring the time difference between pulses
JP2008245126A (en) * 2007-03-28 2008-10-09 Fujifilm Corp Imaging apparatus
CN102169664B (en) * 2011-01-28 2013-08-21 北京视博云科技有限公司 Time delay detecting method and device of display device
US9514664B2 (en) * 2012-09-25 2016-12-06 The Boeing Company Measuring latency in a test system using captured images
JP6198397B2 (en) * 2013-01-17 2017-09-20 キヤノン株式会社 IMAGING DEVICE, REMOTE OPERATION TERMINAL, CAMERA SYSTEM, IMAGING DEVICE CONTROL METHOD, REMOTE OPERATION TERMINAL CONTROL METHOD
WO2016041188A1 (en) * 2014-09-19 2016-03-24 华为技术有限公司 Method and device for determining photographing delay time and photographing apparatus
JP6728010B2 (en) * 2016-09-26 2020-07-22 キヤノン株式会社 Imaging device and method for controlling imaging device
CN106441810B (en) * 2016-12-16 2019-07-26 捷开通讯(深圳)有限公司 The detection device and detection method of the delay time of VR equipment
JP6725454B2 (en) * 2017-06-02 2020-07-22 株式会社日立ビルシステム Video monitoring system and video monitoring device
JP6917803B2 (en) * 2017-06-27 2021-08-11 キヤノン株式会社 Imaging equipment, control methods, and programs
CN108322656B (en) * 2018-03-09 2022-02-15 深圳市道通智能航空技术股份有限公司 Shooting method, shooting device and shooting system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107094249A (en) * 2017-03-31 2017-08-25 腾讯科技(上海)有限公司 A kind of method and device for testing camera delay

Also Published As

Publication number Publication date
CN113824902A (en) 2021-12-21

Similar Documents

Publication Publication Date Title
CN111464749B (en) Method, device, equipment and storage medium for image synthesis
CN110333834B (en) Frame frequency adjusting method and device, display device and computer readable storage medium
CN108965922B (en) Video cover generation method and device and storage medium
CN109922356B (en) Video recommendation method and device and computer-readable storage medium
CN108616691B (en) Photographing method and device based on automatic white balance, server and storage medium
CN109558837B (en) Face key point detection method, device and storage medium
CN109166150B (en) Pose acquisition method and device storage medium
CN111127509B (en) Target tracking method, apparatus and computer readable storage medium
CN113573122B (en) Audio and video playing method and device
CN109886208B (en) Object detection method and device, computer equipment and storage medium
CN109635133B (en) Visual audio playing method and device, electronic equipment and storage medium
CN111754386B (en) Image area shielding method, device, equipment and storage medium
CN113627413B (en) Data labeling method, image comparison method and device
CN110349527B (en) Virtual reality display method, device and system and storage medium
CN111857793B (en) Training method, device, equipment and storage medium of network model
CN111385525B (en) Video monitoring method, device, terminal and system
CN108401194B (en) Time stamp determination method, apparatus and computer-readable storage medium
CN113824902B (en) Method, device, system, equipment and medium for determining time delay of infrared camera system
CN112241987B (en) System, method, device and storage medium for determining defense area
CN111860064B (en) Video-based target detection method, device, equipment and storage medium
CN113592874B (en) Image display method, device and computer equipment
CN111369434B (en) Method, device, equipment and storage medium for generating spliced video covers
CN111464829B (en) Method, device and equipment for switching media data and storage medium
CN112184802B (en) Calibration frame adjusting method, device and storage medium
CN112243083B (en) Snapshot method and device and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant