CN113728654A - Image freezing method, chip, shooting device and storage device - Google Patents

Image freezing method, chip, shooting device and storage device Download PDF

Info

Publication number
CN113728654A
CN113728654A CN202080025859.1A CN202080025859A CN113728654A CN 113728654 A CN113728654 A CN 113728654A CN 202080025859 A CN202080025859 A CN 202080025859A CN 113728654 A CN113728654 A CN 113728654A
Authority
CN
China
Prior art keywords
image
processing chip
frozen
chip
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080025859.1A
Other languages
Chinese (zh)
Inventor
陈星�
张青涛
庹伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN113728654A publication Critical patent/CN113728654A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The method comprises the steps of receiving an image freezing instruction, reading stored image data of a frozen image from the off-chip storage device into an internal memory of the processing chip, and when receiving image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted. The application solves the problem of data transmission delay. The application also provides a chip, a shooting device and a storage device.

Description

Image freezing method, chip, shooting device and storage device Technical Field
The present disclosure relates to the field of image freezing, and in particular, to an image freezing method, a chip, a camera, and a storage device.
Background
Image freeze refers to causing the device to display a frozen picture on the display interface continuously, and the frozen picture is called a frozen image. Generally, the image freezing function of a device is realized by storing a frozen image in a memory of a certain processing chip of the device and continuously outputting and displaying the frozen image after an event of triggering image freezing, but the process of storing the frozen image in the memory and outputting the frozen image from the memory causes the problem of image data transmission delay.
Disclosure of Invention
The embodiment of the application provides an image freezing method, a chip, a shooting device and a storage device.
In a first aspect, an embodiment of the present application provides an image freezing method, which is used for a processing chip that transmits image data at a predetermined time interval in a device, where the processing chip is connected to an off-chip storage device, and the method includes:
receiving an image freezing instruction;
reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
In a second aspect, an embodiment of the present application provides a processing chip, configured to transmit image data at a specified time interval in a device in which the processing chip is installed, where an off-chip storage device is connected to the processing chip, the processing chip includes an internal memory, and the processing chip is configured to:
receiving an image freezing instruction;
reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
In a third aspect, an embodiment of the present application provides a shooting device, on which a processing chip for transmitting image data at a prescribed time interval is mounted, the processing chip being connected with an off-chip storage device, the processing chip being configured to:
receiving an image freezing instruction;
reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
In a fourth aspect, an embodiment of the present application provides a storage device, connected to a processing chip, where the processing chip is configured to transmit image data at a specified time interval in a device in which the processing chip is installed, and the processing chip includes an internal memory, and the storage device is configured to store the image data of a frozen image, so that the processing chip implements the method according to any one of the foregoing embodiments.
According to the processing chip needing to transmit the image data at the specified time interval, the frozen image is not stored in the memory of the processing chip in real time when the freezing instruction is received, the stored image data of the frozen image is read from the connected off-chip storage device to the internal memory of the processing chip in advance, the image data of the frozen image can be directly obtained from the memory when the freezing instruction is executed, and the delay of executing data transmission is avoided.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a schematic diagram of image transfer timings of a processing chip at the time of non-image freezing and at the time of performing image freezing, respectively.
Fig. 2 is a flow chart illustrating a method for image freezing according to an exemplary embodiment of the present application.
Fig. 3 is a schematic diagram of image transmission timings of a processing chip when the method of fig. 2 is applied, respectively, at a time of non-image freezing and at a time of performing image freezing.
FIG. 4 illustrates a processing chip according to an exemplary embodiment of the present application.
Fig. 5 is a diagram illustrating a camera according to an exemplary embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Whether the data is transmitted between devices or inside devices, different chips generally need to follow a certain transmission protocol, and the transmission protocol can specify the timing requirement that the transmitted data needs to meet, for example, a sender needs to transmit data to a receiver according to a certain time rule, so that the receiver receives the data at regular time, otherwise, the receiver may not receive the data.
For example, when some image capturing devices capture images and output the images, when the image capturing devices capture video streams, an internal processing chip acquires image data of each frame of image, and transmits the image data of each frame of image to other receivers after processing the image data of each frame of image, or directly transmits the acquired image data of each frame of image to other receivers. The processing chip usually stores image data of one frame of image in the internal memory after acquiring the image data, and reads the image data from the internal memory for transmission. The receiver of the image data can be other processing chips in the device or other devices, and the receiver can perform further processing after receiving the image data and can also perform display output.
Because a certain shooting frame rate is usually set for shooting video, the time interval for the processing chip to acquire image data each time is about the inter-frame time interval of video shooting, and in order to avoid too high video output delay and guarantee that video can be continuously output without pause, the processing chip is usually required to transmit image data according to a specified blanking area. The blanking area refers to image data of one frame of image transmitted by both the sender and the receiver in real time according to the shooting frame rate, which requires that the data transmission between the sender and the receiver needs to meet the requirement of the blanking area, otherwise, the receiver cannot be ensured to receive the data on time.
When the image capturing device executes image freezing, the frozen image needs to be written into the off-chip storage of the processing chip so as to continuously read the frozen image from the off-chip storage for display and output, and specifically, when the image capturing device starts to execute image freezing, or the processing chip directly reads the image data of the frozen image from the off-chip storage into the internal memory and continuously transmits the image data of the frozen image; or the processing chip stores the image data of the currently acquired and received frame of image into the internal memory, reads and transmits the image data from the internal memory, and simultaneously stores the frame of image into the off-chip memory of the processing chip as a frozen image, and then when the processing chip in the camera device receives the image data of the frame of image, the processing chip discards the image data of the frame of image, replaces the image data of the frozen image read from the off-chip memory into the internal memory, and continuously transmits the image data of the frozen image. The image freezing is realized by freezing the image into the image displaying the frozen image, so that the image pickup device does not transmit and display the acquired frame images any more, but replaces the acquired image with the frozen image, and transmits the acquired image according to the transmission time sequence requirement of the originally acquired frame images, namely, the transmission of the image data of the frozen image also needs to meet the requirement of the originally blank area. However, since the processing chip needs to perform the replacement transmission of the image data of the frozen image from the off-chip storage, and the processing chip needs to consume extra time for reading the data from the off-chip storage to the internal storage, the processing chip cannot actually transmit the image data of the frozen image at the original transmission time, but starts to read the image data of the frozen image to be transmitted after the original transmission time, which causes the transmission delay, that is, the blanking area is lengthened.
Fig. 1 is a schematic diagram showing an image data transfer timing in a normal case (non-image freezing time) and an image transfer timing in image freezing time of one processing chip. Under a normal condition, the processing chip stores the first frame image into the internal memory when acquiring the first frame image, reads and transmits the frame image from the internal memory, and acquires and transmits the second frame image after passing through the first blanking area because a certain inter-frame time interval exists in video shooting. Under the condition of executing image freezing, the processing chip writes the acquired first frame image into the off-chip storage as a frozen image while transmitting the frame image, and acquires a second frame image after passing through the first blanking area, at this time, because of executing image freezing, the processing chip needs to transmit the frozen image, namely the first frame image written into the off-chip storage, but does not transmit the second frame image any more, so that the frozen image needs to be read from the off-chip storage to replace the second frame image and transmit the second frame image, because reading consumes a certain time, transmission is delayed, at this time, the blanking area is actually changed into the second blanking area, and the second blanking area is larger than the first blanking area, the receiver at the rear end cannot receive the data on time, the transmission interface needs to be debugged again to receive the data, and the receiver at the rear end may have a plurality of receivers, debugging one by one can cause great inconvenience to technicians.
In order to solve the problem, an embodiment of the present application provides an image freezing method, which is used for a processing chip with a timing requirement for data transmission inside a device, so as to ensure that the processing chip can still transmit image data of a frozen image on time when image freezing is performed, avoid the need of debugging a transmission interface of a rear-end receiver again when the image is frozen, and reduce cumbersome operations.
The device mentioned in the embodiments of the present application may be an image capturing device with an image capturing function, such as a visible light camera and a non-visible light camera, where the visible light camera may be a digital camera, and the non-visible light camera may be an infrared camera, and it is understood that any image capturing device with an image freezing function and a processing chip inside which needs to transmit image data at a specified time interval may be applicable to the method of the embodiments of the present application. The Processing chip mentioned in the embodiment of the present Application may be an ASIC (Application Specific Integrated Circuit), a DSP (Digital signal Processing), an FPGA (Field Programmable Gate Array), or the like. The off-chip memory device connected to the processing chip may be a DDR (Double Data Rate), a GDDR (Graphics Double Data Rate, Double Data Rate for Graphics), and the like, and the present application does not limit the types of the processing chip and the off-chip memory device.
Fig. 2 is a flowchart of an image freezing method according to an exemplary embodiment of the present application, which is applicable to a processing chip within a device for transmitting image data at a predetermined time interval, where the processing chip is connected to an off-chip storage device, as shown in fig. 2, and includes the following steps:
s201, receiving an image freezing instruction;
s202, reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
s203, when the image data to be transmitted is received, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
By the method, when image freezing is executed, the image data of the frozen image to be transmitted is read from the off-chip storage device to the internal memory of the processing chip in advance, and when the image data of one frame of image to be transmitted which is originally required to be received arrives, the processing chip reads the image data of the frozen image from the internal memory in real time to replace the image data of the frame of image and transmits the image data, so that the original blanking area requirement can be met when the processing chip transmits the image data of the frozen image, and the problem of data transmission delay is avoided.
Fig. 3 is a schematic diagram showing an image data transmission timing of the processing chip in a normal case and an image transmission timing when the image freezing is performed, when the above-described method of image freezing is used, wherein the image data transmission in the normal case is identical to the image data transmission in the normal case in fig. 1, and a description thereof will not be repeated. In the case of performing image freezing, the processing chip writes the acquired first frame image into the off-chip memory as a frozen image while transferring the frame image, and reads the stored image data of the frozen image, which may be the image data of the entire first frame or a partial image data of the first frame, for example, the pixel data of lines 1 to 3, from the off-chip memory device into the internal memory of the processing chip when the transfer is completed, which may be adjusted according to the parameter data of the internal memory, in particular, the memory space. When the second frame image is acquired after passing through the first blanking area, the image data of the frozen image is read from the internal memory to replace the image data of the second frame image and transmitted, and as can be seen from fig. 3, because the frozen image is pre-read, the problem of data transmission delay does not occur when image freezing is executed. Of course, when the image data of the frozen image is the image data of the entire frame of the first frame, the image data of the frozen image may be read from the internal memory in place of the image data of the image of the second frame and transmitted; and when the image data of the frozen image is partial image data of the first frame, other image data of the first frame can be read from the off-chip storage and transmitted while or after the partial image data is read.
The process of the processing chip reading the stored image data of the frozen image from the off-chip storage device to the internal Memory may be implemented by a Direct Memory Access (DMA) inside the processing chip, and specifically, the DMA inside the processing chip may be responsible for transferring the image data of the frozen image in the external storage device to the internal Memory of the processing chip. Since an image is usually in the form of pixel data of several lines at the time of transfer and storage, the pixel data of each line of a frozen image in the external storage device can be carried to the internal memory of the processing chip by the DMA on a line-by-line basis. However, in some cases, the internal memory capacity of the processing chip may be insufficient, all the line pixel data of the frozen image may not be stored, and all the line pixel data of the frozen image may not be transferred to the internal memory by pre-reading. In this case, it is considered that, within the capacity range of the internal memory, several lines of pixel data ahead of each line of pixel data constituting the frozen image, which are sequentially arranged in the external storage device, are first transferred to the internal memory by the DMA, and the remaining lines of pixel data to be transferred may be transferred from the external storage device to the internal memory while the processing chip transfers each line of pixel data existing in the internal memory. Of course, it is also possible to designate that, in the pre-reading of the frozen image, any row of pixel data among all rows of pixel data constituting the frozen image is to be transferred in advance, instead of selecting row pixel data in which the transfer order is earlier in accordance with the arrangement order of all rows of pixel data constituting the frozen image.
In one embodiment, the processing chip may be another processing chip for transmitting the image data of the frozen image to the inside of the device, which may be called a post-processing chip, and the image data is transmitted between the two processing chips according to a specified time interval, in which case it is understood that the image data transmission between the two processing chips follows a certain inter-chip protocol, and the inter-chip protocol is used for specifying a time interval for transmitting the image data between the two processing chips, and the time interval can be set by a person skilled in the art according to actual needs.
For the frozen image in the off-chip storage device, it may be an image stored in real time when the image freezing instruction is received, for example, during the process of capturing an image by the apparatus, if the image freezing instruction is received, a frame of the captured image is stored as a frozen image in the off-chip storage device in real time. The frozen image may be stored in the off-chip storage device in advance, and the user may freely select an image to be stored as a frozen image, in this case, the user may store more than one image in advance, but may select a plurality of images to be stored as frozen images in the off-chip storage device, so that when image freezing is performed, one image may be randomly read by the processing chip as a transmitted frozen image, or the processing chip may be configured to read a fixed image as a transmitted frozen image each time image freezing is performed, or may read the pre-stored images in order, for example, when image freezing is performed each time, one image is read as a transmitted frozen image in order, and when image freezing is performed next time, the next image of the image is read as a transmitted frozen image, therefore, the repeated frozen images cannot be displayed when the images are frozen every time, and the displayed frozen images are richer.
For the received image freeze instruction in S101, it may be a time for instructing to start performing image freeze, for example, when an image freezing instruction is received, the internal processing chip of the equipment acquires the time for starting to execute image freezing, at the moment, the equipment can output and display a countdown prompt, the countdown prompt is used to indicate the time remaining until image freeze is initiated, which corresponds to the start time at which the user can schedule image freeze, for example, it may be set to start freezing the image after 3 seconds, or start freezing the image after 10 seconds, and further, during the countdown period, the images acquired during this period may all be written to the off-chip storage device, meanwhile, factors such as whether the stored images are clear or not and whether ghost images occur or not can be comprehensively considered, and the images with good quality are selected through calculation and serve as the frozen images to be transmitted when image freezing is executed. Or, the image freezing instruction may be an execution duration for instructing image freezing, for example, the execution duration for image freezing may be set by a user, and when the processing chip receives the image freezing instruction, after the execution duration for image freezing is known, the time for ending image freezing may be correspondingly determined, so that the image freezing can be automatically ended without manual control by the user.
One application scenario of the image freezing method provided in the embodiment of the present application may be display of a startup sign picture when the image capturing apparatus is started up. When the camera device is started, the startup mark picture needs to be displayed and output, and at the moment, the display picture of the device needs to be frozen into the startup mark picture, specifically, when the device is started, an image freezing instruction is triggered, the processing chip writes image data of the frozen image into the off-chip storage device, pre-reads the image data of the frozen image into the internal memory, and when the image is transmitted according to a specified time interval, when each frame of image to be transmitted acquired by the camera is input, the processing chip reads the image data of the frozen image from the internal memory to replace the image data to be transmitted, and performs transmission and output display.
Another application scenario of the method for image freezing proposed in the embodiment of the present application may also be a case where the thermal infrared imager performs image freezing. The thermal infrared imager is generally used for detecting the temperature of an object in the environment, and actually, on the basis of the known corresponding relationship between infrared radiation and temperature, the infrared imager converts invisible infrared radiation emitted by the received object into visible thermal images to be displayed. Or in some cases, the response of the photosensitive unit of the image sensor inside the thermal infrared imager is not strictly consistent, which may cause calibration, and at this time, the thermal infrared imager may be calibrated by flat field calibration, specifically, an image frame acquired when the shutter is closed is used as a reference gray scale image, and the reference gray scale image is stored in, for example, a DDR memory for processing, and then a flat field frame for calibration is output, and the flat field frame is used for flat field calibration of the infrared sensor. Image freezing is also required because erroneous thermographic output is to be avoided during calibration. The process of performing image freezing is the same as the process of performing image freezing when the image pickup apparatus is turned on, and the description is not repeated here. At this time, the starting time, the ending time, the number of the frozen frames or the frame rate of the image freezing can be determined according to the calibration process, the image of the previous frame or the frames before the shutter calibration is used as the frozen image, and particularly, the thermal image of the frame or the frames with the correct temperature value can be selected to carry out the whole replacement or the partial replacement of the wrong thermal image generated during the shutter calibration, so as to improve the transmission precision of the data and the viewing experience of the user.
An embodiment of the present application further provides a processing chip, as shown in fig. 4, fig. 4 is a processing chip 40 shown in an exemplary embodiment of the present application, configured to transmit image data at regular time intervals in a device in which the processing chip is installed, where the processing chip 40 may be connected to an off-chip storage device, and the processing chip 40 includes an internal memory 401, where the processing chip 40 is configured to:
receiving an image freezing instruction;
reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
In one embodiment, the frozen image is a pre-stored image or a real-time stored image.
In one embodiment, the device is a thermal infrared imager.
In one embodiment, the image freeze instruction is an instruction triggered during calibration of the thermal infrared imager.
In one embodiment, the thermal infrared imager includes a shutter for calibrating the thermal infrared imager.
In one embodiment, the calibration comprises a flat field calibration.
In one embodiment, the image freezing instruction is an instruction triggered when the device is turned on.
In one embodiment, the frozen image is a pre-loaded power-on logo picture when the device is powered on.
In one embodiment, the image freeze instruction is used for indicating the moment when image freeze is started to be executed; and/or the duration of the execution of the image freeze.
In one embodiment, the image data read into the internal memory is a subset of all pixel data of the frozen image.
In one embodiment, the subset includes at least any one row of pixel data that makes up the frozen image.
In one embodiment, the processing chip is further configured to transmit image data of the frozen image to another processing chip; the prescribed time interval is a blanking region determined based on a specified inter-slice protocol.
In one embodiment, the processing chip is an application specific integrated chip and the off-chip memory device is a double data rate synchronous dynamic random access memory (DDR) memory.
An embodiment of the present application further provides a shooting device, as shown in fig. 5, fig. 5 is a shooting device 50 shown in an exemplary embodiment of the present application, wherein a processing chip 501 for transmitting image data at a specified time interval is installed on the shooting device 50, the processing chip 501 is connected to an off-chip storage device 502, and the processing chip is configured to:
receiving an image freezing instruction;
reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
In one embodiment, the frozen image is a pre-stored image or a real-time stored image.
In one embodiment, the camera is a thermal infrared imager.
In one embodiment, the image freeze instruction is an instruction triggered during calibration of the thermal infrared imager.
In one embodiment, the thermal infrared imager includes a shutter for calibrating the thermal infrared imager.
In one embodiment, the calibration comprises a flat field calibration.
In one embodiment, the image freeze instruction is an instruction triggered when the device is powered on.
In one embodiment, the frozen image is a pre-loaded power-on logo picture when the device is powered on.
In one embodiment, the image freeze instruction is used for indicating the moment when image freeze is started to be executed; and/or the duration of the execution of the image freeze.
In one embodiment, the image data read into the internal memory is a subset of all pixel data of the frozen image.
In one embodiment, the subset includes at least any one row of pixel data that makes up the frozen image.
In one embodiment, the shooting device further comprises a post-processing chip, wherein the post-processing chip is used for receiving the image data of the frozen image transmitted by the processing chip;
the prescribed time interval is a blanking region determined based on a specified inter-slice protocol.
In one embodiment, the post-processing chip is further configured to:
and fusing the image data of the frozen image transmitted by the processing chip and EXIF information of the exchangeable image file of the frozen image, wherein the EXIF information records attribute information and shooting data of the frozen image, such as shooting time, resolution, exposure time and the like. Of course, when the image is not frozen, the image data of any frame of image transmitted by the processing chip and the EXIF information thereof may be subjected to fusion processing.
In one embodiment, the camera may simultaneously capture an infrared thermal image and a visible light image, and when the processing chip is configured to transmit the infrared thermal image to the post-processing chip, the post-processing chip is further configured to:
and when receiving the infrared thermal image transmitted by the processing chip, carrying out fusion processing on the infrared thermal image and the visible light image synchronized with the infrared thermal image.
In one embodiment, the processing chip is an application specific integrated chip and the off-chip memory device is a double data rate synchronous dynamic random access memory (DDR) memory.
The embodiment of the present application further provides a storage device, connected to a processing chip, where the processing chip is configured to transmit image data at a predetermined time interval in a device in which the processing chip is installed, and the processing chip includes an internal memory, where the storage device is configured to store image data of a frozen image, so that the processing chip implements the method according to any of the above embodiments.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The method and apparatus provided by the embodiments of the present application are described in detail above, and the principle and the embodiments of the present application are explained herein by applying specific examples, and the description of the embodiments above is only used to help understand the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (42)

  1. A method for image freezing in a processing chip for transferring image data at predetermined time intervals within a device, said processing chip being connected to an off-chip storage device, comprising the steps of:
    receiving an image freezing instruction;
    reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
    and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
  2. The method of claim 1, wherein the frozen image is a pre-stored image or a real-time stored image.
  3. The method of claim 1, wherein the device is a thermal infrared imager.
  4. The method of claim 3, wherein the image freeze command is a command triggered during thermal infrared imager calibration.
  5. The method of claim 4, wherein the thermal infrared imager comprises a shutter for calibrating the thermal infrared imager.
  6. The method of claim 4, wherein the calibration comprises a flat field calibration.
  7. The method of claim 1, wherein the image freeze instruction is an instruction triggered when the device is powered on.
  8. The method of claim 7, wherein the frozen image is a power-on picture that is preloaded when the device is powered on.
  9. The method of claim 1, wherein the image freeze instruction is used to indicate a time at which image freeze begins to be performed; and/or the duration of the execution of the image freeze.
  10. The method of claim 1, wherein the image data read into the internal memory is a subset of all pixel data of the frozen image.
  11. The method of claim 10, wherein the subset includes at least any row of pixel data that makes up the frozen image.
  12. The method of claim 1,
    the method further comprises the following steps:
    transmitting the image data of the frozen image to another processing chip; the prescribed time interval is a blanking region determined based on a specified inter-slice protocol.
  13. The method of claim 1, wherein the processing chip is an application specific integrated chip and the off-chip memory device is a double data rate synchronous dynamic random access DDR memory.
  14. A processing chip for transmitting image data at prescribed time intervals in a device in which the processing chip is installed, the processing chip being connected with an off-chip storage device, the processing chip including an internal memory, characterized in that the processing chip is configured to:
    receiving an image freezing instruction;
    reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
    and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
  15. The processing chip of claim 14, wherein the frozen image is a pre-stored image or a real-time stored image.
  16. The processing chip of claim 14, wherein the device is a thermal infrared imager.
  17. The processing chip of claim 16, wherein the image freeze command is a command triggered during thermal infrared imager calibration.
  18. The processing chip of claim 17, wherein the thermal infrared imager comprises a shutter for calibrating the thermal infrared imager.
  19. The processing chip of claim 18, wherein the calibration comprises a flat field calibration.
  20. The processing chip of claim 14, wherein the image freeze instruction is an instruction triggered when the device is powered on.
  21. The processing chip of claim 20, wherein the frozen image is a power-on picture preloaded when the device is powered on.
  22. The processing chip of claim 14, wherein the image freeze instruction is configured to instruct a time to start performing image freeze; and/or the duration of the execution of the image freeze.
  23. The processing chip of claim 14, wherein the image data read into the internal memory is a subset of all pixel data of the frozen image.
  24. The processing chip of claim 23, wherein the subset comprises at least any row of pixel data that makes up the frozen image.
  25. The processing chip of claim 14,
    the processing chip is further configured to:
    transmitting the image data of the frozen image to another processing chip; the prescribed time interval is a blanking region determined based on a specified inter-slice protocol.
  26. The processing chip of claim 14, wherein the processing chip is an application specific integrated chip and the off-chip memory device is a double data rate synchronous dynamic random access DDR memory.
  27. A photographing apparatus having mounted thereon a processing chip for transmitting image data at prescribed time intervals, the processing chip being connected with an off-chip storage device, characterized in that the processing chip is configured to:
    receiving an image freezing instruction;
    reading the stored image data of the frozen image from the off-chip storage device into an internal memory of the processing chip;
    and when receiving the image data to be transmitted, reading the image data of the frozen image from the internal memory to replace the image data to be transmitted.
  28. The camera of claim 27, wherein the frozen image is a pre-stored image or a real-time stored image.
  29. The camera of claim 27, wherein the camera is a thermal infrared imager.
  30. The camera of claim 29, wherein the image freeze command is a command triggered during thermal infrared imager calibration.
  31. The camera of claim 30, wherein the thermal infrared imager comprises a shutter for calibrating the thermal infrared imager.
  32. The camera of claim 31, wherein said calibration comprises a flat field calibration.
  33. The camera of claim 27, wherein the image freeze command is a command triggered when the device is powered on.
  34. The camera of claim 33, wherein the frozen image is a pre-loaded power-on logo picture when the device is powered on.
  35. The photographing apparatus according to claim 27, wherein the image freeze instruction is for instructing a timing to start performing image freeze; and/or the duration of the execution of the image freeze.
  36. The image capturing apparatus according to claim 27, wherein the image data read into the internal memory is a subset of all pixel data of the frozen image.
  37. The camera of claim 36, wherein the subset comprises at least any one row of pixel data that makes up the frozen image.
  38. The camera of claim 27,
    the shooting device further comprises a post-processing chip, and the post-processing chip is used for receiving the image data of the frozen image transmitted by the processing chip;
    the prescribed time interval is a blanking region determined based on a specified inter-slice protocol.
  39. The camera of claim 38, wherein the post-processing chip is further configured to:
    and fusing the image data of the frozen image transmitted by the processing chip and the exchangeable image file EXIF information of the frozen image.
  40. The camera of claim 38, wherein the processing chip is configured to transmit an infrared thermal image to the post-processing chip, the post-processing chip further configured to:
    and when receiving the infrared thermal image transmitted by the processing chip, carrying out fusion processing on the infrared thermal image and the visible light image synchronized with the infrared thermal image.
  41. The camera of claim 27, wherein the processing chip is an application specific integrated chip and the off-chip memory device is a double data rate synchronous dynamic random access DDR memory.
  42. A storage means connected to a processing chip for transferring image data at regular time intervals within a device in which the chip is installed, the processing chip comprising an internal memory, characterized in that the storage means is configured to store image data of a frozen image to cause the processing chip to implement the method of any one of claims 1-13.
CN202080025859.1A 2020-04-27 2020-04-27 Image freezing method, chip, shooting device and storage device Pending CN113728654A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/087214 WO2021217333A1 (en) 2020-04-27 2020-04-27 Image freezing method, chip, photographing apparatus, and storage apparatus

Publications (1)

Publication Number Publication Date
CN113728654A true CN113728654A (en) 2021-11-30

Family

ID=78373865

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080025859.1A Pending CN113728654A (en) 2020-04-27 2020-04-27 Image freezing method, chip, shooting device and storage device

Country Status (2)

Country Link
CN (1) CN113728654A (en)
WO (1) WO2021217333A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5317399A (en) * 1990-05-09 1994-05-31 Canon Kabushiki Kaisha Image reproducing apparatus capable of freezing a displayed image
CN105957469A (en) * 2016-04-27 2016-09-21 南京巨鲨显示科技有限公司 Display system and method with image freezing function
CN106973188A (en) * 2017-04-11 2017-07-21 北京图森未来科技有限公司 A kind of image transmission and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2578251B2 (en) * 1990-11-09 1997-02-05 シャープ株式会社 Image display device
CN102215359A (en) * 2011-06-09 2011-10-12 冠捷显示科技（厦门）有限公司 Method for customizing starting pictures of broadcast television through memory medium
CN103674253A (en) * 2012-09-21 2014-03-26 杭州美盛红外光电技术有限公司 Thermal image display control device and thermal image display control method
CN109862259B (en) * 2018-12-29 2021-08-17 成都国科微电子有限公司 Image sensor synchronous configuration method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5317399A (en) * 1990-05-09 1994-05-31 Canon Kabushiki Kaisha Image reproducing apparatus capable of freezing a displayed image
CN105957469A (en) * 2016-04-27 2016-09-21 南京巨鲨显示科技有限公司 Display system and method with image freezing function
CN106973188A (en) * 2017-04-11 2017-07-21 北京图森未来科技有限公司 A kind of image transmission and method

Also Published As

Publication number Publication date
WO2021217333A1 (en) 2021-11-04

Similar Documents

Publication Publication Date Title
JP5925812B2 (en) Real-time image acquisition and display
US20080266406A1 (en) Image sensors
US20100259664A1 (en) Electronic camera
US7996603B2 (en) DRAM controller that forces a refresh after a failed refresh request
WO2018076354A1 (en) Image data frame synchronization method, image signal processing device and terminal
US20140240542A1 (en) Image capturing apparatus and method for controlling the same
WO2020170729A1 (en) Image-capturing element, image-capturing device, image-capturing element operation method, and program
US8531537B2 (en) Imaging apparatus for processing still picture signals and live view signals output from an image sensor
US20140118596A1 (en) Imaging device and imaging method
WO2020170728A1 (en) Imaging element, imaging device, imaging element operation method, and program
US10771681B2 (en) Imaging pickup apparatus of which display start timing and display quality are selectable, method of controlling the same
JP2002027326A (en) Digital camera
CN113728654A (en) Image freezing method, chip, shooting device and storage device
JP5410158B2 (en) Imaging system and electronic information device
US20040100564A1 (en) Filtering still image data from a multimode stream
US20140168472A1 (en) Image pickup device
US11356603B2 (en) Image capturing apparatus and control method therefor
JP7319873B2 (en) Imaging device and its control method
CN110870301A (en) Image display method and device and image processing equipment
JP7538188B2 (en) Image pickup device, image pickup device operation method, and program
US20230345119A1 (en) Image capturing apparatus, control method thereof, and storage medium
JP7110007B2 (en) IMAGE PROCESSING DEVICE, IMAGING DEVICE, CONTROL METHOD FOR IMAGE PROCESSING DEVICE, PROGRAM AND STORAGE MEDIUM
JP4525382B2 (en) Display device and imaging device
JP4211572B2 (en) Imaging device
JP6470594B2 (en) Imaging device, control method thereof, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20211130