WO2022142952A1

WO2022142952A1 - Image data storage method and device, storage medium, chip, and module device

Info

Publication number: WO2022142952A1
Application number: PCT/CN2021/134214
Authority: WO
Inventors: 李振中; 李倩茹; 胡均浩; 葛维
Original assignee: 紫光展锐(重庆)科技有限公司
Priority date: 2020-12-31
Filing date: 2021-11-30
Publication date: 2022-07-07
Also published as: CN112804526B; CN112804526A

Abstract

The embodiments of the present application disclose an image data storage method and device, a storage medium, a chip, and a module device. Said method comprises: acquiring a first-type first pixel data set corresponding to a reference image, and acquiring a first-type second pixel data set corresponding to a current image, the reference image and the current image being used for determining an image to be frame-interpolated which is located between the reference image and the current image; determining reference phase information of the image to be frame-interpolated, the reference phase information being used for indicating an interval between the image to be frame-interpolated and the reference image and an interval between the image to be frame-interpolated and the current image; determining a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and according to the reference phase information, determining, from the target pixel data set, a pixel data set to be stored; and storing pixel data in the pixel data set to be stored. By using the image data storage method in the embodiments of the present application, the data storage amount can be reduced while the frame interpolation effect is ensured.

Description

Image data storage method, device and storage medium, chip, module device

technical field

The invention relates to the field of data storage, in particular to an image data storage method, device, storage medium, chip and module device.

Background technique

Image insertion technology refers to a technology that improves video fluency and enhances user viewing experience by inserting a frame of image between two adjacent frames of images. Usually, when the image frame interpolation technology is used, it is necessary to store all the original image data of two adjacent frames, which results in a large space for storing the image data, resulting in a shortage of space resources. Therefore, how to reduce the storage space of image data during image interpolation processing is a hot research topic at present.

SUMMARY OF THE INVENTION

The embodiments of the present application provide an image data storage method, a device, a storage medium, a chip, and a module device, which can reduce the amount of data storage and reduce the storage space while ensuring the effect of frame insertion.

In order to solve the above technical problems, in a first aspect, an embodiment of the present application provides an image data storage method, including: acquiring a first type of first pixel data set corresponding to a reference image, and acquiring a first type of pixel data set corresponding to a current image a second set of pixel data, the reference image and the current image are used to determine the frame image to be inserted between the reference image and the current image;

determining the reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

A target pixel data set is determined from the first pixel data set and the second pixel data set according to the reference phase information, and a to-be-stored pixel data set is determined from the target pixel data set according to the reference phase information ;

Pixel data in the set of pixel data to be stored is stored.

In a second aspect, an embodiment of the present application further provides an image data storage device, the device includes: an acquisition module configured to acquire a first pixel data set of a first type corresponding to a reference image, and acquire a first pixel data set corresponding to a current image A type of second pixel data set, the reference image and the current image are used to determine the frame image to be inserted between the reference image and the current image;

a determining module, configured to determine reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

a processing module, configured to determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and determine from the target pixel data set according to the reference phase information The set of pixel data to be stored;

The processing module is further configured to store pixel data in the set of pixel data to be stored.

In a third aspect, embodiments of the present application further provide an image data storage device, including a processor and a memory, wherein the memory is used to store a computer program, and the computer program includes program instructions, and the processor is configured to use in calling the program instructions to execute the method described in the first aspect

In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium, including: the computer-readable storage medium stores one or more instructions, and the one or more instructions are suitable for being loaded by a processor and storing The method as described in the first aspect is performed.

In a fifth aspect, the present application provides a chip for receiving a first pixel data set of a first type corresponding to a reference image, and receiving a second pixel data set of the first type corresponding to a current image, where The reference image and the current image are used to determine the frame image to be inserted between the reference image and the current image;

The chip is further configured to determine reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

The chip is further configured to determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and from the target pixel data set according to the reference phase information Determine the set of pixel data to be stored in ;

The chip is further configured to output pixel data in the set of pixel data to be stored, so as to store the pixel data in the set of pixel data to be stored.

In a sixth aspect, the application provides a chip module, the module device includes a communication module, a power module, a storage module and a chip module, wherein:

The power module is used to provide power for the module device;

The storage module is used to store data and instructions;

The communication module is used for internal communication of the module device, or for the module device to communicate with an external device;

The chip module is used for:

The first pixel data set of the first type corresponding to the reference image is obtained through the communication module, and the second pixel data set of the first type corresponding to the current image is obtained, and the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

Pixel data in the to-be-stored pixel data set is stored in the storage module.

Implementing the embodiments of the present application has the following beneficial effects: obtaining the first pixel data set of the first type corresponding to the reference image, and obtaining the second pixel data set of the first type corresponding to the current image; then, determining the frame size of the image to be inserted With reference to the phase information, the target pixel data set is determined from the first pixel data set and the second pixel data set according to the phase information, and the storage pixel data set is determined from the target pixel data set according to the reference phase information; finally, the pixel data to be stored The pixel data in the collection is stored. It can be seen that the embodiments of the present application can reduce the amount of data storage, and reduce the storage space while ensuring the effect of frame insertion.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a schematic flowchart of a first image data storage method provided by an exemplary embodiment of the present application;

2a is a schematic diagram of a first pixel data set provided by an exemplary embodiment of the present application;

FIG. 2b is a schematic diagram of motion estimation provided by an exemplary embodiment of the present application;

2c is a schematic diagram of reflecting reference phase information in a reference image and a current image provided by an exemplary embodiment of the present application;

3 is a schematic flowchart of a second image data storage method provided by an exemplary embodiment of the present application;

4a is another schematic diagram of reflecting reference phase information in a reference image and a current image provided by an exemplary embodiment of the present application;

4b is a schematic diagram of determining an image area to be stored in a reference image provided by an exemplary embodiment of the present application;

5 is a schematic flowchart of a third image data storage method provided by an exemplary embodiment of the present application;

Fig. 6a is a schematic diagram of a third pixel data set provided by an exemplary embodiment of the present application;

6b is a schematic diagram of determining a first image area to be stored and a second image area to be stored provided by an exemplary embodiment of the present application;

7 is a schematic structural diagram of an image data storage device provided by an exemplary embodiment of the present application;

FIG. 8 is a schematic structural diagram of another image data storage device provided by an exemplary embodiment of the present application;

FIG. 9 is a schematic structural diagram of a modular device provided by an exemplary embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts all belong to the protection scope of the present invention.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The embodiments of the present application relate to overlapping block motion compensation technology, which is an advanced block motion compensation technology that reduces discontinuity at block boundaries. accuracy and reduce the distortion (blocking, etc.) caused by blocking. Specifically, the overlapping block motion compensation algorithm considers that the motion vector of a certain block also affects adjacent blocks, that is, the prediction of a block depends not only on the motion vector of the current block, but also by a series of motions of adjacent blocks. Therefore, the overlapping block motion compensation algorithm reduces the prediction error of the block boundary pixels with the constraint of smoothing the block boundaries as much as possible.

The embodiment of the present application applies the overlapping block motion compensation technology to the calculation of image frame insertion. In order to reduce the storage amount in the frame insertion process, while ensuring the frame insertion effect, the storage space is reduced, and an example of an image is provided. A data storage method, as shown in FIG. 1, is a first image data storage method provided by an exemplary embodiment of the present application. The method can be performed by an image data storage device, and the device Mobile devices with storage functions such as PDAs, Personal Digital Assistants (PDAs), Portable Media Players (PMPs), navigation devices, wearable devices, smart bracelets, and pedometers, and Fixed devices with storage functions such as digital TVs, desktop computers, etc., the method includes:

S101. Obtain a first pixel data set of a first type corresponding to a reference image, and obtain a second pixel data set of a first type corresponding to a current image, where the reference image and the current image are used to determine a pixel data set between the reference image and the current image. Image to be inserted.

In this embodiment of the present application, the reference image may be a previous frame image and/or a next frame image of the current image, and the frame image to be inserted is a frame image located between the current image and the reference image. The first pixel data set of the first type corresponding to the reference image may be a processed high-frequency data information set related to the reference image. Specifically, the acquiring the first pixel data set of the first type corresponding to the reference image may be: Including: acquiring a reference image, and splitting multiple rows of pixel points in the reference image into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1; For each group of pixel rows, determine the pixel value difference of M pixels in the same column among M rows of pixel points included in a group of pixel rows; determine the first type corresponding to the reference image according to the pixel value difference The first pixel data set of . In the embodiment of the present application, multiple groups of pixel rows refer to grouping multiple rows of pixel points in the reference image, and each group includes M rows of pixel points, thereby obtaining multiple groups of pixel rows in the reference image. In the process of specifically determining the first pixel data set of the first type corresponding to the reference image, the pixel value of each pixel in the reference image is determined, and then it is determined that the M rows of pixels included in each group of pixel rows are in the same column The pixel value difference of the M pixel points, and then the first pixel data set of the first type corresponding to the reference image is determined according to the difference value. For example, as shown in Fig. 2a, the reference image is an image with a size of 6*6 pixels, and 6 rows of pixel points in the reference image are divided into 3 groups of pixel rows, and each group of pixel rows includes adjacent 2 rows of pixels. Point, for each group of pixel rows, determine the pixel value difference of 2 pixel points in the same column in the 2 rows of pixel points included in a group of pixel rows, thereby obtaining the first type of the first type of 6*3 pixel size. A collection of pixel data. It can be understood that the multiple rows of pixel points in the reference image in the embodiments of the present application may be the pixel points of all rows in the entire reference image, or may be the pixel points of some rows in the reference image; When a group of pixel rows includes more than two rows of pixel rows, when calculating the difference value, the difference value of multiple pixel values in the same column can be calculated from each other. For example, a group of pixel rows includes three rows of pixel rows, which are the first row, the second row and the In the third row, when calculating the pixel value difference, the difference between the pixel value of the pixel point in the first row and the pixel value of the pixel point in the second row in the same column, the pixel value of the second pixel point is the same as the pixel value of the pixel point in the third row. The pixel value is the difference, and the pixel value of the pixel point in the first row is different from the pixel value of the pixel point in the third row.

In an optional implementation manner, the acquiring the second set of pixel data of the first type corresponding to the current image may include: acquiring the current image, and dividing multiple rows of pixel points in the current image into multiple A group of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, where M is a positive integer greater than 1; for each group of pixel rows, it is determined that the M rows of pixel points included in a group of pixel rows are in the same column The pixel value difference of the M pixel points; the second pixel data set of the first type corresponding to the current image is determined according to the pixel value difference. In this embodiment of the present application, the second pixel data set of the first type corresponding to the current image may be a processed high-frequency data information set related to the current image. Specifically, in the process of determining the second pixel data set of the first type corresponding to the current image, the pixel value of each pixel point in the current image is determined, and then it is determined that the pixel points in the M rows included in each group of pixel rows are located in the current image. The pixel value difference of the M pixel points in the same column, and then the second pixel data set of the first type corresponding to the current image is determined according to the difference.

S102. Determine the reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image.

In this embodiment of the present application, the reference phase information may be used to indicate the time interval between the image to be inserted and the reference image and the current image. For example, the reference image is a frame of image at 0.1s, and the current image is a frame of image at 0.5s. To insert the frame image to be inserted at 0.2s, the reference phase information refers to the difference between the frame to be inserted and the reference image. The time interval is 0.1s, and the time interval between the frame image to be inserted and the current image is 0.3s.

S103. Determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and determine a to-be-stored pixel data set from the target pixel data set according to the reference phase information.

In this embodiment of the present application, after the reference phase information is determined, the target pixel data set is determined, that is, the first pixel data set is determined as the target pixel data set according to the reference phase information, or the second pixel data set is determined as the target pixel data set, Or determine the first pixel data set and the second pixel data set as the target pixel data set. In an optional implementation manner, the determining a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information may include: if the reference phase information Indicate that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, then the second pixel data set is determined as the target pixel data set; if The reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, then the first pixel data set is determined as the target A collection of pixel data. In an optional implementation manner, the determining a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information may further include: if the reference phase information information indicates that the interval between the frame image to be inserted and the reference image is equal to the interval between the frame image to be inserted and the current image, then the first pixel data set and the second pixel data The set is determined to be the target pixel data set. In the embodiment of the present application, the final target pixel data set is determined according to the interval between the image to be inserted and the reference image indicated by the reference phase information is greater than, less than or equal to the interval between the image to be inserted and the current image.

At the same time, the set of pixel data to be stored is determined from the target pixel data according to the reference phase information. As shown in Figure 2b, the A block in the reference image matches the C block in the current image (there is a relative displacement between the A block and the C block). ), the reference phase information indicates that the interval between the frame image to be inserted and the reference image is less than the interval between the frame image to be inserted and the current image, so the second pixel data set is determined as the target pixel data set, as shown in Figure 2b, As shown in Figure 2c, according to the A block, the C block and the reference phase information, it is determined that the boundary position of the uppermost row of pixel data in the multi-line pixel data of the image area where the C block is located in the second pixel data set corresponding to the current image to the position D The pixel data between is the set of data to be stored, wherein the position D is the border position of the bottom row of pixel data in the multi-line pixel data of the image area where the B block in the frame image to be inserted corresponds to the same position in the current image. location D.

S104. Store the pixel data in the pixel data set to be stored.

In the embodiment of the present application, the first pixel data set of the first type corresponding to the reference image is obtained, and the second pixel data set of the first type corresponding to the current image is obtained; then, the reference phase information of the frame image to be inserted is determined, The target pixel data set is determined from the first pixel data set and the second pixel data set according to the phase information, and the storage pixel data set is determined from the target pixel data set according to the reference phase information; data is stored. It can be seen that the embodiments of the present application can reduce the amount of data storage, and reduce the storage space while ensuring the effect of frame insertion.

Please refer to FIG. 3. FIG. 3 is a second image data storage method provided by an exemplary embodiment of the present application. The method can be executed by an image data storage device, and the device can include, for example, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, Personal Digital Assistant (PDA), Portable Media Player (PMP), navigation device, wearable device, smart bracelet, pedometer and other mobile devices with storage function, as well as digital TV , desktop computers and other fixed devices with storage functions, the method includes:

S301. Obtain a first pixel data set of a first type corresponding to a reference image, and obtain a second pixel data set of a first type corresponding to a current image, where the reference image and the current image are used to determine the pixel data set between the reference image and the current image. Image to be inserted.

S302. Determine the reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image.

It should be noted that, for details of steps S301-S302 in this embodiment of the present application, reference may be made to steps S101-S103 in the foregoing embodiment, and details are not repeated in this embodiment of the present application.

S303. Determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information.

In this embodiment of the present application, according to the interval between the image to be inserted and the reference image indicated by the reference phase information is greater than, less than or equal to the interval between the image to be inserted and the current image, the first pixel data set, the second The pixel data set or the first pixel data set and the second pixel data set are used as the target pixel data set.

S304. Determine motion vector information between the reference image and the current image.

In the embodiment of the present application, the current image of the image sequence is divided into many non-overlapping macroblocks, and it is considered that the displacements of all pixels in the macroblock are the same, and then a given specific search range from each macroblock to the reference image is determined. According to certain matching criteria, find the block that is most similar to the current block, that is, the matching block, and the relative displacement between the matching block and the current block is the motion vector, that is, to determine the motion vector information between the reference image and the current image is Determine the relative displacement information of the matching block in the reference image and the current block in the current image.

In an optional implementation manner, after the determining the motion vector information between the reference image and the current image, may include: according to the reference phase information, the relationship between the reference image and the current image The pixel data set to be stored is determined from the target pixel data set according to the motion vector information between them; wherein, the pixel data set to be stored includes part of the pixel data in the target pixel data set.

S305: Determine the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information and the motion vector information between the reference image and the current image.

In the embodiment of the present application, for example, as shown in FIG. 4a and FIG. 4b, the reference phase information indicates that the interval between the frame to be inserted and the reference image is greater than the interval between the frame to be inserted and the current image. Therefore, refer to The first pixel data set of the first type corresponding to the image is used as the target pixel data set, according to the determined relative displacement of the M block in the reference image and the Q block in the current image, based on the reference phase information, the position information of the M block and the Q block. The position information of the block can determine that the image area to be stored in the image corresponding to the first pixel data set is the uppermost row of pixels in the multiple rows of pixels in the image area where the M blocks are located in the first pixel data set corresponding to the reference image. The boundary position of the point, to the boundary position of the pixel point of the bottom row in the multi-line pixel data of the image area where the P block is located in the frame to be inserted corresponds to the image area between the same position N in the reference image.

S306: Determine the pixel data set to be stored according to the pixel data corresponding to the image area to be stored in the target pixel data set.

In the embodiment of the present application, the pixel data set to be stored is determined according to the target pixel data set and the pixel data corresponding to the image area to be stored. is the area between the boundary position of the uppermost row of pixel data and the position N in the multi-line pixel data of the image area where the M blocks are located, and then determines the multi-line pixel data between the areas, and the multi-line pixel data is determined as The pixel data in the pixel data set to be stored.

S307. Store the pixel data in the pixel data set to be stored.

In the embodiment of the present application, the first pixel data set of the first type corresponding to the reference image is obtained, and the second pixel data set of the first type corresponding to the current image is obtained; then, the reference phase information of the frame image to be inserted is determined, Determine the target pixel data set from the first pixel data set and the second pixel data set according to the phase information, and determine the motion vector information between the reference image and the current image; then, according to the reference phase information, the reference image and all The motion vector information between the current images determines the pixel data set to be stored from the target pixel data set. It can be seen that in the embodiment of the present application, the pixel data in the pixel data set to be stored can be dynamically adjusted according to the position of the frame to be inserted, and the pixel data in the pixel data set to be stored can be accurately determined, the storage quantity can be reduced, and the amount of storage can be reduced. Frame effects while reducing storage space.

Please refer to FIG. 5. FIG. 5 is a third image data storage method provided by an exemplary embodiment of the present application. The method can be executed by an image data storage device, and the device may include, for example, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, Personal Digital Assistant (PDA), Portable Media Player (PMP), navigation device, wearable device, smart bracelet, pedometer and other mobile devices with storage function, as well as digital TV , desktop computers and other fixed devices with storage functions, the method includes:

S501. Obtain a first pixel data set of a first type corresponding to a reference image, and obtain a second pixel data set of a first type corresponding to a current image, where the reference image and the current image are used to determine the pixel data set between the reference image and the current image. Image to be inserted.

S502. Determine the reference phase information of the image to be inserted, where the reference phase information is used to indicate the interval between the image to be inserted and the reference image and the current image.

S503. Determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and determine a to-be-stored pixel data set from the target pixel data set according to the reference phase information.

S504. Store the pixel data in the pixel data set to be stored.

It should be noted that, for details of S501-S504 in this embodiment of the present application, reference may be made to steps S101-S104 in the foregoing embodiment, which will not be repeated in this embodiment of the present application. The execution order of steps S501-S504 and steps S505-S507 in this application can be sorted arbitrarily. S504, of course, can also be executed at the same time. It can be understood that, each of the steps in steps S501-S507 does not represent a fixed execution step, and the execution of each step may be in any order.

S505. Acquire a third pixel data set of the second type corresponding to the reference image, and acquire a fourth pixel data set of the second type corresponding to the current image.

In this embodiment of the present application, the third pixel data set of the second type corresponding to the reference image may be a processed low-frequency data information set related to the reference image. Specifically, the acquiring the third pixel data set of the second type corresponding to the reference image The pixel data set may include: acquiring a reference image, and dividing multiple rows of pixel points in the reference image into multiple groups of pixel rows, each group of pixel rows including adjacent M rows of pixel points, where M is greater than A positive integer of 1; for each group of pixel rows, determine the average value of the pixel values of M pixel points in the same column among the M rows of pixel points included in a group of pixel rows; determine the corresponding value of the reference image according to the average value. A third set of pixel data of the second type. In the embodiment of the present application, in the process of specifically determining the third pixel data set of the second type corresponding to the reference image, the pixel value of each pixel in the reference image is determined, and then the M rows included in each group of pixel rows are determined. The average value of the pixel values of the M pixel points in the same column in the pixel points, and then the third pixel data set of the second type corresponding to the reference image is determined according to the average value. For example, as shown in Figure 6a, the reference image is an image with a size of 9*9 pixels, and 9 rows of pixel points in the reference image are divided into 3 groups of pixel rows, and each group of pixel rows includes adjacent 3 rows of pixels. For each group of pixel rows, determine the average value of the pixel values of the 3 pixel points in the same column in the 3 rows of pixel points included in the group of pixel rows, thereby obtaining the second type of 9*3 pixel size. A collection of pixel data.

In an optional implementation manner, the obtaining the fourth pixel data set of the second type corresponding to the current image may include: obtaining the current image, and dividing the multiple rows of pixel points in the current image into multiple pixel data sets. A group of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, where M is a positive integer greater than 1; for each group of pixel rows, it is determined that the M rows of pixel points included in a group of pixel rows are in the same column The average value of the pixel values of the M pixel points; the fourth pixel data set of the second type corresponding to the current image is determined according to the average value. In the embodiment of the present application, in the process of specifically determining the fourth pixel data set of the second type corresponding to the current image, the pixel value of each pixel in the current image is determined, and then the M rows included in each group of pixel rows are determined. The average value of the pixel values of the M pixel points in the same column in the pixel points, and then the fourth pixel data set of the second type corresponding to the current image is determined according to the average value.

S506. Determine the first image area to be stored in the reference image, and determine the second image area to be stored in the current image.

In this embodiment of the present application, based on the motion vector information between the reference image and the current image, that is, based on the relative displacement information of the matching block in the reference image and the current block in the current image, and then based on the reference phase information of the image to be inserted The first image area to be stored in the reference image is determined, and the second image area to be stored in the current image area is determined. As shown in Figure 6b, the image area between ef is the first image area to be stored in the reference image, and the image area between dg is the second image area to be stored in the current image.

In an optional implementation manner, the determining of the first image area to be stored in the reference image and the determination of the second image area to be stored in the current image may include: determining area boundary information of the image area to be stored; A first image area to be stored in the reference image is determined according to the area boundary information, and a second image area to be stored in the current image is determined according to the area boundary information; wherein the area boundary information indicates The boundary position in the first direction is a preset designated position, and the boundary position in the second direction indicated by the region boundary information is determined according to the motion vector information between the reference image and the current image. .

In this embodiment of the present application, as shown in FIG. 6b , the boundary position in the first direction indicated by the region boundary information is a preset designated position, that is, the reference image in the moving direction of the matching block a relative to the current block c A specified position m that is farthest from the image area where the matching block a is located (position m is the area boundary position where the first row of pixels in the reference image is located) or a specified position n (position n is where the matching block a in the reference image is located. The boundary position of any row of pixel area between the multi-line pixel area to the position m), the position g can also be specifically determined according to the image area where the current block c is located (the position g is the multi-line where the current block c in the current image is located. The boundary position of the uppermost row of pixel regions in the pixel region). The boundary position in the second direction indicated by the region boundary information may be the boundary position f of the lowermost row of pixel point regions in the multi-line pixel point regions where the matching block a is located in the reference image. When specifically determining the boundary position in the second direction indicated by the region boundary, according to the motion vector information between the reference image and the current image, that is, according to the relative relationship between the matching block a in the reference image and the current block c in the current image The displacement information is used to determine the final boundary position (the boundary position f of the pixel point region of the bottom row in the multi-line pixel point region where the matching block a is located). It can be understood that, the boundary position in the second direction indicated by the region boundary information can also be more accurately determined according to the motion vector information and phase information between the reference image and the current image.

S507. Store the pixel data corresponding to the first image area to be stored in the third pixel data set and the pixel data corresponding to the second image area to be stored in the fourth pixel data set.

In the embodiment of the present application, as shown in FIG. 6b, the first image area to be stored ef and the second image area to be stored dg have been determined, and then the pixels corresponding to the first image area to be stored are searched in the third pixel data set data, and searching for pixel data corresponding to the second to-be-stored area in the fourth pixel data set, and storing the found pixel data.

In the embodiment of the present application, the first pixel data set of the first type corresponding to the reference image is obtained, and the second pixel data set of the first type corresponding to the current image is obtained, and the target is determined according to the reference phase information of the frame image to be inserted. pixel set, and determine the set of pixel data to be stored; obtain the third pixel data set of the second type corresponding to the reference image, and obtain the fourth pixel data set of the second type corresponding to the current image, according to the first pixel data set in the reference image The image area to be stored, and the second image area to be stored in the current image, determine the pixel data corresponding to the first image area to be stored and the second image area to be stored; The pixel data corresponding to the first image area to be stored in the set and the pixel data corresponding to the second image area to be stored in the fourth pixel data set are stored, thereby reducing the amount of data storage while ensuring the effect of frame insertion, and further improving The image data storage space is dynamically allocated through the reference phase information of the image to be inserted, so as to maximize the utilization of the existing storage space.

7 is a schematic structural diagram of an image data storage device provided by an exemplary embodiment of the present application. The device may be mounted on the image data storage device in the above method embodiment, and the image data storage device may specifically be a server. Of course, in some embodiments, it can also be mounted on a terminal device. The image data storage device shown in FIG. 7 can be used to perform some or all of the functions in the method embodiments described in the above-mentioned FIGS. 1 , 3 and 5 . Among them, the detailed description of each part is as follows:

The obtaining module 701 is configured to obtain the first pixel data set of the first type corresponding to the reference image, and obtain the second pixel data set of the first type corresponding to the current image, and the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

A determination module 702, configured to determine reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

A processing module 703, configured to determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and from the target pixel data set according to the reference phase information Determine the set of pixel data to be stored;

The processing module 703 is further configured to store pixel data in the set of pixel data to be stored.

In an optional implementation manner, the processing module 703 determines a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, which may specifically include: if the reference The phase information indicates that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, then the second pixel data set is determined as the target pixel data set ; If the reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, then the first pixel data set is determined is the target pixel data set.

In an optional implementation manner, the processing module 703 determines the pixel data set to be stored from the reference pixel data set according to the reference phase information, which may specifically include: determining the distance between the reference image and the current image the motion vector information; determine the pixel data set to be stored from the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; wherein, the pixel data to be stored The set includes a portion of pixel data in the target set of pixel data.

In an optional implementation manner, the processing module 703 determines a set of pixel data to be stored from the reference pixel data set according to the reference phase information, the motion vector information between the reference image and the current image, Specifically, it may include: determining the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; according to the target pixel data set The pixel data corresponding to the to-be-stored image area described in , determine the to-be-stored pixel data set.

In an optional implementation manner, the obtaining module 701 is further configured to obtain a third pixel data set of the second type corresponding to the reference image, and obtain a fourth pixel data set of the second type corresponding to the current image;

The determining module 702 is further configured to determine the first image area to be stored in the reference image, and determine the second image area to be stored in the current image;

The processing module 703 is further configured to analyze the pixel data corresponding to the first image area to be stored in the third pixel data set and the pixel data corresponding to the second image area to be stored in the fourth pixel data set. Pixel data is stored.

In an optional implementation manner, the determining module 702 determines a first image area to be stored in the reference image, and determines a second image area to be stored in the current image, specifically including: determining an image area to be stored the region boundary information; determine the first image region to be stored in the reference image according to the region boundary information, and determine the second image region to be stored in the current image according to the region boundary information; wherein, the The boundary position in the first direction indicated by the area boundary information is a preset designated position, and the boundary position in the second direction indicated by the area boundary information is based on the motion between the reference image and the current image determined by the vector information.

In an optional implementation manner, the obtaining module 701 obtains the first pixel data set of the first type corresponding to the reference image, which specifically includes: obtaining the reference image, and splitting multiple rows of pixel points in the reference image into Multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1; for each group of pixel rows, it is determined that the M rows of pixel points included in a group of pixel rows are in the same row. pixel value difference values of the M pixel points in the column; determining the first pixel data set of the first type corresponding to the reference image according to the pixel value difference values.

Each module in the image data storage device shown in FIG. 7 may be combined into one or several other modules, respectively or all, or some module(s) may be further divided into multiple modules with smaller functions. It is composed of several units, which can realize the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In practical applications, the function of one module may also be implemented by multiple modules, or the functions of multiple modules may be implemented by one module. In other embodiments of the present application, the storage device may also include other modules, and in practical applications, these functions may also be implemented with the assistance of other modules, and may be implemented by cooperation of multiple modules.

Based on the same inventive concept, the principles and beneficial effects of the image data storage device provided in the embodiments of the present application for solving problems are similar to the principles and beneficial effects of the image data storage methods for solving the problems in the method embodiments of the present application. For details, please refer to the principle of method implementation. and beneficial effects, for the sake of brevity, they will not be repeated here.

Referring to FIG. 8, FIG. 8 is a schematic structural diagram of another image data storage device provided by an exemplary embodiment of the present application. The device includes a processor 801 and a memory 802, the processor 801 and the memory 802 are connected by one or more communication buses, and the processor 801 is configured to support the terminal device to perform the corresponding functions in the methods of FIGS. 1, 3 and 5 . The processor 801 may be a central processing unit (central processing unit, CPU), a network processor (network processor, NP), a hardware chip or any combination thereof.

The memory 802 is used to store program codes and the like. Memory 802 may include volatile memory (volatile memory), such as random-access memory (RAM); memory 802 may also include non-volatile memory (non-volatile memory), such as read-only memory (read only memory) -only memory, ROM), flash memory (flash memory), hard disk drive (HDD) or solid-state drive (solid-state drive, SSD); the memory 802 may also include a combination of the above-mentioned types of memory.

In this embodiment of the present application, the processor 801 may call program codes stored in the memory 802 to perform the following operations:

Obtain a first pixel data set of the first type corresponding to the reference image, and obtain a second pixel data set of the first type corresponding to the current image, the reference image and the current image are used to determine the location between the reference image and the the frame images to be inserted between the current images;

Pixel data in the set of pixel data to be stored is stored.

In an optional implementation manner, the processor 801 determines a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, specifically including: if the reference phase information The information indicates that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, then the second pixel data set is determined as the target pixel data set; If the reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, the first pixel data set is determined as The target pixel data collection.

In an optional implementation manner, the processor 801 determines the pixel data set to be stored from the reference pixel data set according to the reference phase information, which may specifically include: determining the distance between the reference image and the current image the motion vector information; determine the pixel data set to be stored from the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; wherein, the pixel data to be stored The set includes a portion of pixel data in the target set of pixel data.

In an optional implementation manner, the processor 801 determines a set of pixel data to be stored from the reference pixel data set according to the reference phase information and the motion vector information between the reference image and the current image, Specifically, it may include: determining the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; according to the target pixel data set The pixel data corresponding to the to-be-stored image area described in , determine the to-be-stored pixel data set.

In an optional implementation manner, the processor 801 obtains a third pixel data set of the second type corresponding to the reference image, and obtains a fourth pixel data set of the second type corresponding to the current image;

The processor 801 determines a first image area to be stored in the reference image, and determines a second image area to be stored in the current image;

The processor 801 stores the pixel data corresponding to the first image area to be stored in the third pixel data set and the pixel data corresponding to the second image area to be stored in the fourth pixel data set .

In an optional implementation manner, the processor 801 determines a first image area to be stored in the reference image, and determines a second image area to be stored in the current image, specifically including: determining an image area to be stored the region boundary information; determine the first image region to be stored in the reference image according to the region boundary information, and determine the second image region to be stored in the current image according to the region boundary information; wherein, the The boundary position in the first direction indicated by the area boundary information is a preset designated position, and the boundary position in the second direction indicated by the area boundary information is based on the motion between the reference image and the current image determined by the vector information.

In an optional implementation manner, the processor 801 acquires the first pixel data set of the first type corresponding to the reference image, which specifically includes: acquiring the reference image, and dividing multiple rows of pixel points in the reference image into Multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1; for each group of pixel rows, it is determined that the M rows of pixel points included in a group of pixel rows are in the same row. pixel value difference values of the M pixel points in the column; determining the first pixel data set of the first type corresponding to the reference image according to the pixel value difference values.

It should be noted that the image data storage device may execute the relevant steps of the terminal device in the foregoing method embodiments. For details, reference may be made to the implementation manners provided by the foregoing steps, which will not be repeated here.

For each device and product applied to or integrated in computer equipment, each module contained therein may be implemented in hardware such as circuits, and different modules may be located in the same component (eg, chip, circuit module, etc.) or different components in the terminal Alternatively, at least some of the modules can be implemented by means of a software program that runs on a processor integrated inside the terminal, and the remaining (if any) partial modules can be implemented by means of hardware such as circuits.

Embodiments of the present application further provide a computer-readable storage medium, which can be used to store computer program instructions for implementing the image data storage method in the embodiments shown in FIG. 1 , FIG. 3 , and FIG. 5 . The computer-readable storage medium includes but does not Limited to flash memory, hard drives, solid state drives.

In an optional implementation manner, an embodiment of the present application provides a chip, which is used for:

Receiving a first pixel data set of a first type corresponding to a reference image, and receiving a second pixel data set of a first type corresponding to a current image, the reference image and the current image are used to determine the location between the reference image and the the frame images to be inserted between the current images;

Outputting pixel data in the set of pixel data to be stored, so as to store the pixel data in the set of pixel data to be stored.

In an optional implementation manner, when the chip determines the target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, the chip is specifically configured to: if the The reference phase information indicates that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, then the second pixel data set is determined as target pixel data collection; if the reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, then the first pixel data collection Determined as the target pixel data set.

In an optional implementation manner, when the chip determines the pixel data set to be stored from the reference pixel data set according to the reference phase information, the chip is specifically configured to: determine the difference between the reference image and the current image. motion vector information between the two; determine the pixel data set to be stored from the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; wherein, the pixel data set to be stored The data set includes part of pixel data in the target pixel data set.

In an optional implementation manner, when the chip determines the pixel data set to be stored from the reference pixel data set according to the reference phase information, the motion vector information between the reference image and the current image , which is specifically used for: determining the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; according to the target pixel data The pixel data corresponding to the to-be-stored image area in the set is determined to determine the to-be-stored pixel data set.

In an optional embodiment, the chip is also used for:

Receive a third pixel data set of a second type corresponding to a reference image, and receive a fourth pixel data set of a second type corresponding to a current image; determine a first image area to be stored in the reference image, and determine the current image area the second image area to be stored in the image; for the pixel data corresponding to the first image area to be stored in the third pixel data set, and the second image area to be stored in the fourth pixel data set The corresponding pixel data is stored.

In an optional implementation manner, when the chip determines the first image area to be stored in the reference image and the second image area to be stored in the current image, it is specifically used for: determining the image area to be stored Area boundary information of the image area; determining the first image area to be stored in the reference image according to the area boundary information, and determining the second image area to be stored in the current image according to the area boundary information; wherein, The boundary position in the first direction indicated by the area boundary information is a preset designated position, and the boundary position in the second direction indicated by the area boundary information is based on the difference between the reference image and the current image. determined by the motion vector information.

In an optional implementation manner, when the chip receives the first pixel data set of the first type corresponding to the reference image, it is specifically configured to: receive the reference image, and split pixels in multiple rows in the reference image Divided into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1; for each group of pixel rows, determine the M rows of pixel points included in a group of pixel rows. pixel value difference values of M pixel points in the same column; determining a first pixel data set of a first type corresponding to the reference image according to the pixel value difference value.

It should be noted that the chip can execute the relevant steps of the terminal device in the foregoing method embodiments. For details, reference may be made to the implementation manners provided by the foregoing steps, which will not be repeated here.

In one embodiment, the chip includes at least one processor, at least one first memory, and at least one second memory; wherein, the at least one first memory and the at least one processor are interconnected through lines, and the first memory stores There are instructions; the at least one second memory and the at least one processor are interconnected through lines, and the second memory stores the data that needs to be stored in the foregoing method embodiments.

For each device or product applied to or integrated in the chip, each module contained therein may be implemented by hardware such as circuits, or at least some of the modules may be implemented by a software program that runs on the integrated circuit inside the chip. The processor and the remaining (if any) modules can be implemented in hardware such as circuits.

As shown in FIG. 9 , FIG. 9 is a schematic structural diagram of a module device provided by an embodiment of the present application. The module device includes: a communication module 901 , a power module 902 , a storage module 903 , and a chip module 904 .

Wherein, the power module 902 is used to provide power for the module device; the storage module 903 is used to store data and instructions; the communication module 901 is used to perform internal communication of the module device, or to The module device communicates with external devices; the chip module 904 is used for:

The first pixel data set of the first type corresponding to the reference image is obtained through the communication module 901, and the second pixel data set of the first type corresponding to the current image is obtained, and the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

Pixel data in the to-be-stored pixel data set is stored in the storage module.

In an optional implementation manner, when the chip module 904 determines the target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, it is specifically configured to: If the reference phase information indicates that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, the second pixel data set is determined as Target pixel data set; if the reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, the first The pixel data set is determined as the target pixel data set.

In an optional implementation manner, when the chip module 904 determines the set of pixel data to be stored from the set of reference pixel data according to the reference phase information, it is specifically configured to: determine the reference image and the set of pixel data to be stored. motion vector information between current images; determining a set of pixel data to be stored from the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; wherein the The pixel data set to be stored includes part of the pixel data in the target pixel data set.

In an optional implementation manner, the chip module 904 determines the pixels to be stored from the reference pixel data set according to the reference phase information, the motion vector information between the reference image and the current image When the data set is used, it is specifically used to: determine the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; The pixel data corresponding to the to-be-stored image area in the target pixel data set determines the to-be-stored pixel data set.

In an optional implementation manner, the chip module 904 is further configured to: obtain, through the communication module 901, a third pixel data set of a second type corresponding to the reference image, and obtain a second pixel data set corresponding to the current image type of the fourth pixel data set; determine the first image area to be stored in the reference image, and determine the second image area to be stored in the current image; The pixel data corresponding to the image area to be stored and the pixel data corresponding to the second image area to be stored in the fourth pixel data set are stored.

In an optional implementation manner, when the chip module 904 determines the first image area to be stored in the reference image and the second image area to be stored in the current image, it is specifically used for: Determine the area boundary information of the image area to be stored; determine the first image area to be stored in the reference image according to the area boundary information, and determine the second image area to be stored in the current image according to the area boundary information ; wherein, the boundary position in the first direction indicated by the area boundary information is a preset designated position, and the boundary position in the second direction indicated by the area boundary information is based on the reference image and the current Determined by motion vector information between images.

In an optional implementation manner, when the chip module 904 obtains the first pixel data set of the first type corresponding to the reference image through the communication module 901, it is specifically used for: through the communication module 901 Acquire a reference image, and split multiple rows of pixel points in the reference image into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, where M is a positive integer greater than 1; for each pixel row For a group of pixel rows, determine the pixel value difference of M pixels in the same column among M rows of pixels included in a group of pixel rows; determine the first type of the first type corresponding to the reference image according to the pixel value difference. A collection of pixel data.

It should be noted that the module device may perform the steps related to the terminal device in the foregoing method embodiments, and for details, reference may be made to the implementation manners provided by the foregoing steps, which will not be repeated here.

Each device and product described in the above embodiments includes modules/units, which may be software modules/units or hardware modules/units, or may be partly software modules/units and partly hardware modules/units. For example, for each device or product of an application or integrated chip, each module/unit included in the product may be implemented by hardware such as circuits, or at least some modules/units may be implemented by software programs, which run on the integrated processing inside the chip. The remaining part of the modules/units can be realized by hardware such as circuits; for each device and product applied to or integrated in the chip module, each module included can be realized by hardware such as circuits, and different modules can be It is located in the same component (such as chip, circuit module, etc.) or different components of the chip module, or, at least part of the modules can be implemented by a software program that runs on the processor integrated inside the chip module, and the rest ( If any) some modules can be implemented by hardware such as circuits.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted over a computer-readable storage medium. Computer instructions may be sent from one website site, computer, server, or data center to another website site, computer, via wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) , server or data center for transmission. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), and the like.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, and should cover within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A method for storing image data, comprising:

Obtain a first pixel data set of the first type corresponding to the reference image, and obtain a second pixel data set of the first type corresponding to the current image, the reference image and the current image are used to determine the location between the reference image and the the frame images to be inserted between the current images;

determining the reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

A target pixel data set is determined from the first pixel data set and the second pixel data set according to the reference phase information, and a to-be-stored pixel data set is determined from the target pixel data set according to the reference phase information ;

Pixel data in the set of pixel data to be stored is stored.
The method according to claim 1, wherein the determining a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information comprises:

If the reference phase information indicates that the interval between the frame image to be inserted and the reference image is smaller than the interval between the frame image to be inserted and the current image, the second pixel data set is determined as target pixel data set;

If the reference phase information indicates that the interval between the frame image to be inserted and the reference image is greater than the interval between the frame image to be inserted and the current image, the first pixel data set is determined as The target pixel data collection.
The method according to claim 2, wherein the determining a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information further comprises:

If the reference phase information indicates that the interval between the image to be inserted and the reference image is greater than the interval between the image to be inserted and the current image, the first pixel data set and the The second pixel data set is determined as the target pixel data set.
The method according to any one of claims 1-3, wherein the determining the pixel data set to be stored from the reference pixel data set according to the reference phase information comprises:

determining motion vector information between the reference image and the current image;

A set of pixel data to be stored is determined from the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image; wherein the pixel data set to be stored includes the target pixel data set Part of the pixel data in the pixel data set.
The method according to claim 4, wherein the determining the motion vector information between the reference image and the current image comprises:

determining the relative displacement information of the matching block in the reference image and the current block in the current image;

The running vector information is determined according to the relative displacement information.
The method according to claim 4, wherein the pixel data to be stored is determined from the reference pixel data set according to the reference phase information, the motion vector information between the reference image and the current image Collection, including:

Determine the image area to be stored from the image corresponding to the target pixel data set according to the reference phase information, the motion vector information between the reference image and the current image;

A set of pixel data to be stored is determined according to pixel data corresponding to the to-be-stored image area in the target pixel data set.
The method according to claim 1, wherein the method further comprises:

Obtaining the second type of third pixel data set corresponding to the reference image, and obtaining the second type of the fourth pixel data set corresponding to the current image;

determining a first image area to be stored in the reference image, and determining a second image area to be stored in the current image;

Pixel data corresponding to the first image area to be stored in the third pixel data set and pixel data corresponding to the second image area to be stored in the fourth pixel data set are stored.
The method according to claim 7, wherein the determining of the first image area to be stored in the reference image and the determination of the second image area to be stored in the current image include:

Determine the area boundary information of the image area to be stored;

Determine a first image area to be stored in the reference image according to the area boundary information, and determine a second image area to be stored in the current image according to the area boundary information;

The boundary position in the first direction indicated by the area boundary information is a preset designated position, and the boundary position in the second direction indicated by the area boundary information is based on the reference image and the current image. determined by the motion vector information between.
The method according to claim 7 or 8, wherein the third pixel data set of the second type corresponding to the reference image comprises a processed low-frequency data information set related to the reference image.
The method according to claim 9, wherein the acquiring the third pixel data set of the second type corresponding to the reference image comprises:

Acquiring a reference image, and dividing the multiple rows of pixel points in the reference image into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1;

For each group of pixel rows, determine the average value of the pixel values of M pixel points in the same column in the M rows of pixel points included in a group of pixel rows;

A third pixel data set of the second type corresponding to the reference image is determined according to the average value.
The method according to claim 9, wherein the acquiring the fourth pixel data set of the second type corresponding to the current image comprises:

Acquire the current image, and split the multiple rows of pixel points in the current image into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and the M is a positive integer greater than 1;

For each group of pixel rows, determine the average value of the pixel values of M pixel points in the same column in the M rows of pixel points included in a group of pixel rows;

A fourth pixel data set of the second type corresponding to the current image is determined according to the average value.
The method according to claim 1, wherein the acquiring the first pixel data set of the first type corresponding to the reference image comprises:

Obtaining a reference image, and splitting the multiple rows of pixel points in the reference image into multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, and M is a positive integer greater than 1;

For each group of pixel rows, determine the pixel value difference of M pixel points in the same column in M rows of pixel points included in a group of pixel rows;

A first pixel data set of a first type corresponding to the reference image is determined according to the pixel value difference.
The method according to claim 1, wherein the acquiring the second pixel data set of the first type corresponding to the current image comprises: acquiring the current image and splitting multiple rows of pixel points in the current image In multiple groups of pixel rows, each group of pixel rows includes adjacent M rows of pixel points, where M is a positive integer greater than 1;

For each group of pixel rows, determine the pixel value difference of M pixel points in the same column in M rows of pixel points included in a group of pixel rows;

A second pixel data set of the first type corresponding to the current image is determined according to the pixel value difference.
The method according to claim 1, wherein the reference image comprises a previous frame image and/or a next frame image of the current image.
The method according to claim 1, wherein the first pixel data set of the first type corresponding to the reference image comprises a processed high-frequency data information set related to the reference image.
An image data storage device, characterized in that the device comprises:

The acquiring module is used for acquiring the first pixel data set of the first type corresponding to the reference image, and acquiring the second pixel data set of the first type corresponding to the current image, the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

a determining module, configured to determine reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

a processing module, configured to determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and determine from the target pixel data set according to the reference phase information The set of pixel data to be stored;

The processing module is further configured to store pixel data in the set of pixel data to be stored.
An image data storage device, comprising: a processor and a memory, wherein the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to invoke the program instructions , performing the method of any one of claims 1 to 15.
A computer-readable storage medium, comprising: the computer-readable storage medium stores one or more instructions, and the one or more instructions are suitable for being loaded by a processor and executing as claimed in claims 1 to 15 The method of any of the above.
A chip, characterized in that:

The chip is configured to receive the first pixel data set of the first type corresponding to the reference image, and receive the second pixel data set of the first type corresponding to the current image, where the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

The chip is further configured to determine reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

The chip is further configured to determine a target pixel data set from the first pixel data set and the second pixel data set according to the reference phase information, and from the target pixel data set according to the reference phase information Determine the set of pixel data to be stored in ;

The chip is further configured to output pixel data in the set of pixel data to be stored, so as to store the pixel data in the set of pixel data to be stored.
A modular device, characterized in that the modular device includes a communication module, a power module, a storage module and a chip module, wherein:

The power module is used to provide power for the module device;

The storage module is used to store data and instructions;

The communication module is used for internal communication of the module device, or for the module device to communicate with an external device;

The chip module is used for:

The first pixel data set of the first type corresponding to the reference image is obtained through the communication module, and the second pixel data set of the first type corresponding to the current image is obtained, and the reference image and the current image are used to determine an image to be inserted between the reference image and the current image;

determining the reference phase information of the frame image to be inserted, where the reference phase information is used to indicate the interval between the frame image to be inserted and the reference image and the current image;

A target pixel data set is determined from the first pixel data set and the second pixel data set according to the reference phase information, and a to-be-stored pixel data set is determined from the target pixel data set according to the reference phase information ;

Pixel data in the to-be-stored pixel data set is stored in the storage module.