CN114007073A - Large scene based picture storage system and use method thereof - Google Patents
Large scene based picture storage system and use method thereof Download PDFInfo
- Publication number
- CN114007073A CN114007073A CN202111297793.4A CN202111297793A CN114007073A CN 114007073 A CN114007073 A CN 114007073A CN 202111297793 A CN202111297793 A CN 202111297793A CN 114007073 A CN114007073 A CN 114007073A
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- images
- storage unit
- extracted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
- H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
- H04N19/428—Recompression, e.g. by spatial or temporal decimation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention relates to a large scene-based picture storage system and a using method thereof, comprising a main storage unit, an auxiliary storage unit and an image processing unit which are connected through a data bus, wherein the image processing unit is used for performing frame extraction processing on image frames in a video file; the main storage unit is used for storing the video file after frame extraction processing, and the auxiliary storage unit is used for storing the image frame extracted from the original file; after image frames in the video are compared, the image frames which are not greatly different from the previous image frames and the next image frames are extracted from the original file, so that the whole occupied volume of the file is reduced, and meanwhile, the extracted image frames are communicated with corresponding key information and stored in an auxiliary memory, so that the video file can be stored separately, and the requirement on the capacity of the memory is reduced; meanwhile, when the video playing device is used, frames are sequentially inserted according to playing time, and when the video in front of the time axis is played, the background processes the video behind the time axis, so that the waiting time for use is reduced.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a large scene based picture storage system and a using method thereof.
Background
Image video files of some large scenes are often huge in size, and occupy a large amount of space during storage; the requirement is put on the storage space of the memory, and when the file is large in volume, the file can only be stored in the memory with the storage space larger than the volume of the file; also, because such files are bulky, a processor is required to spend a lot of time preprocessing when they are used. .
Disclosure of Invention
In view of the above, an object of the present invention is to provide a large scene storage system and a method for using the same, which can reduce the size of a video image of a large scene, perform distributed storage in two memories, and process a file faster and with less latency in use.
The invention relates to a large scene-based picture storage system and a using method thereof, which comprises a main storage unit, an auxiliary storage unit and an image processing unit which are connected through a data bus, wherein the image processing unit is used for performing frame extraction processing on image frames in a video file; the main storage unit is used for storing the video file after frame extraction processing, and the auxiliary storage unit is used for storing the image frame extracted from the original file.
The invention also provides a large scene based picture using method, which comprises the following steps:
s1, decoding each frame of image in the video file on a time axis, and labeling each frame of image according to a time sequence;
s2, scanning the files on the time axis frame by frame, and performing frame extraction processing on the image Xn according to the features, which specifically includes:
s201, converting all images Xn on a time axis into gray-scale images, and establishing a coordinate system by taking the lower left corner of the images Xn as a coordinate origin;
s202, taking the image Xn as a reference image, extracting a plurality of pixels Xn (i) and Xn-1(i) corresponding to coordinates from adjacent images Xn and Xn-1, and calculating the difference value between the image Xn and the image Xn-1
S203, when the difference value H is smaller than the threshold value alpha, performing frame extraction on the image Xn, and extracting key information in the image Xn, wherein the key information comprises the coordinates of the contrast pixels Xn (i) and the difference value X of the corresponding contrast pixel Xn-1(i) in the reserved image Xnn-1(i) -Xn (i) and the original number of the image Xn;
s204, recalculating the difference value H of the adjacent image after frame extraction until the difference value H is larger than a threshold value alpha, reserving the corresponding adjacent image Xm, and performing frame extraction calculation by taking Xm as a reference image;
s205, repeating the steps S202-S205 until all the images are judged and subjected to frame extraction processing;
s3, restoring the reserved images and storing the images in a main storage unit, reserving the images subjected to frame extraction and corresponding key information in an auxiliary storage unit, and restoring all the images to RGB images according to the gray values;
s4, when in use, the video file in the main storage unit is decoded to the time axis, the blank frame is inserted in the position of the extracted frame, and the image frame is restored through the key information according to the playing time sequence.
Further, in the step S202, the proportion of the extracted pixels to the total pixels is at least 30%.
Further, in the step S4, during the restoration, the extracted image frame is inserted into the corresponding position, and then is verified by using the key information; when the extracted image frame and the key information are lost, calculation restoration is carried out according to the reserved image frame, and the method specifically comprises the following steps:
s401, acquiring unit distances K1 and K2 of the current position image frame and two end reserved frames X1 and X2 on a time axis;
s402, assigning values to the pixels of the blank image frame according to the pixel values of the two reserved image frames, wherein the assignment formula is as follows:
x (i) is a pixel value of a blank image frame, and X1(i) and X2(i) are pixel values corresponding to reserved image frames X1 and X2.
The invention has the beneficial effects that: according to the large scene picture storage system and the using method thereof, after image frames in a video are compared, the image frames which are not greatly different from the previous image frames and the next image frames are extracted out of an original file, so that the whole occupied volume of the file is reduced, and meanwhile, the extracted image frames are communicated with corresponding key information and stored in an auxiliary memory, so that the video file can be stored separately, and the requirement on the capacity of the memory is reduced; meanwhile, when the video playing device is used, frames are sequentially inserted according to playing time, and when the video in front of the time axis is played, the background processes the video behind the time axis, so that the waiting time for use is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that for a person skilled in the art, other relevant drawings can be obtained from the drawings without inventive effort:
FIG. 1 is a flow chart of a method of the present invention;
FIG. 2 is a flowchart of the method of step 2 of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1-2: the large scene picture storage-based system comprises a main storage unit, an auxiliary storage unit and an image processing unit which are connected through a data bus, wherein the image processing unit is used for performing frame extraction processing on image frames in a video file; the main storage unit is used for storing the video file after frame extraction processing, and the auxiliary storage unit is used for storing the image frame extracted from the original file; the image processing unit can adopt a DSP digital image processor, or a CPU of a PC, etc.;
the invention also provides a large scene based picture using method, which comprises the following steps:
s1, decoding each frame of image in the video file on a time axis, and labeling each frame of image according to a time sequence;
s2, scanning the files on the time axis frame by frame, and performing frame extraction processing on the image Xn according to the features, which specifically includes:
s201, converting all images Xn on a time axis into gray-scale images, and converting the original RGB images into the gray-scale images according to a formula of gray-scale image R0.3 + G0.59 + B0.11;
establishing a coordinate system by taking the lower left corner of the image Xn as a coordinate origin, wherein each pixel point in the image corresponds to a two-dimensional coordinate value according to the coordinate system;
s202, taking the image Xn as a reference image, extracting a plurality of pixels Xn (i) and Xn-1(i) corresponding to coordinates from adjacent images Xn and Xn-1, and calculating the difference value between the image Xn and the image Xn-1
S203, when the difference value H is smaller than the threshold value alpha, performing frame extraction processing on the image Xn, and extracting key information in the image Xn, including comparisonCoordinates of pixel Xn (i), difference X from corresponding contrast pixel Xn-1(i) in retained image Xnn-1(i) -Xn (i) and the original number of the image Xn; the proportion of the reserved image frame can be adjusted by adjusting the size of the threshold value alpha, so that the size of the file after frame extraction is controlled;
s204, recalculating the difference value H of the adjacent image after frame extraction until the difference value H is larger than a threshold value alpha, reserving the corresponding adjacent image Xm, and performing frame extraction calculation by taking Xm as a reference image;
s205, repeating the steps S202-S205 until all the images are judged and subjected to frame extraction processing;
s3, restoring the reserved images and storing the images in a main storage unit, reserving the images subjected to frame extraction and corresponding key information in an auxiliary storage unit, and restoring all the images to RGB images according to the gray values;
s4, when in use, the video file in the main storage unit is decoded to the time axis, the blank frame is inserted in the position of the extracted frame, and the image frame is restored through the key information according to the playing time sequence.
During reduction, the extracted image frames are inserted into corresponding positions, and then verification is performed by using key information; when the extracted image frame and the key information are lost, calculation restoration is carried out according to the reserved image frame, and the method specifically comprises the following steps:
s401, acquiring unit distances K1 and K2 of the current position image frame and two end reserved frames X1 and X2 on a time axis;
s402, assigning values to the pixels of the blank image frame according to the pixel values of the two reserved image frames, wherein the assignment formula is as follows:
x (i) is a pixel value of a blank image frame, and X1(i) and X2(i) are pixel values corresponding to reserved image frames X1 and X2.
Specifically, in this embodiment, in step S202, the proportion of the extracted pixels to the total pixels is at least 30%.
In summary, according to the large scene picture storage system and the using method thereof of the present invention, after comparing the image frames in the video, the image frames that are not much different from the previous image frame and the next image frame are extracted from the original file, so as to reduce the overall occupied volume of the file, and meanwhile, the extracted image frames are connected with the corresponding key information and stored in the auxiliary memory, so that the video file can be stored separately, and the requirement on the capacity of the memory is reduced; meanwhile, when the video playing device is used, frames are sequentially inserted according to playing time, and when the video in front of the time axis is played, the background processes the video behind the time axis, so that the waiting time for use is reduced.
Finally, the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all of them should be covered in the claims of the present invention.
Claims (4)
1. A large scene based picture storage system, characterized by: the video file processing device comprises a main storage unit, an auxiliary storage unit and an image processing unit which are connected through a data bus, wherein the image processing unit is used for performing frame extraction processing on image frames in a video file; the main storage unit is used for storing the video file after frame extraction processing, and the auxiliary storage unit is used for storing the image frame extracted from the original file.
2. A large scene based picture using method is characterized in that: the method comprises the following steps:
s1, decoding each frame of image in the video file on a time axis, and labeling each frame of image according to a time sequence;
s2, scanning the files on the time axis frame by frame, and performing frame extraction processing on the image Xn according to the features, which specifically includes:
s201, converting all images Xn on a time axis into gray-scale images, and establishing a coordinate system by taking the lower left corner of the images Xn as a coordinate origin;
s202, taking the image Xn as a reference image, extracting a plurality of pixels Xn (i) and Xn-1(i) corresponding to coordinates from adjacent images Xn and Xn-1, and calculating the difference value between the image Xn and the image Xn-1
S203, when the difference value H is smaller than the threshold value alpha, performing frame extraction on the image Xn, and extracting key information in the image Xn, wherein the key information comprises the coordinates of the contrast pixels Xn (i) and the difference value X of the corresponding contrast pixel Xn-1(i) in the reserved image Xnn-1(i) -Xn (i) and the original number of the image Xn;
s204, recalculating the difference value H of the adjacent image after frame extraction until the difference value H is larger than a threshold value alpha, reserving the corresponding adjacent image Xm, and performing frame extraction calculation by taking Xm as a reference image;
s205, repeating the steps S202-S205 until all the images are judged and subjected to frame extraction processing;
s3, restoring the reserved images and storing the images in a main storage unit, reserving the images subjected to frame extraction and corresponding key information in an auxiliary storage unit, and restoring all the images to RGB images according to the gray values;
s4, when in use, the video file in the main storage unit is decoded to the time axis, the blank frame is inserted in the position of the extracted frame, and the image frame is restored through the key information according to the playing time sequence.
3. The large scene picture using method according to claim 2, wherein: in step S202, the proportion of the extracted pixels to all the pixels is at least 30%.
4. The large scene picture using method according to claim 2, wherein: in the step S4, during restoration, the extracted image frames are inserted into the corresponding positions, and then verified by using the key information; when the extracted image frame and the key information are lost, calculation restoration is carried out according to the reserved image frame, and the method specifically comprises the following steps:
s401, acquiring unit distances K1 and K2 of the current position image frame and two end reserved frames X1 and X2 on a time axis;
s402, assigning values to the pixels of the blank image frame according to the pixel values of the two reserved image frames, wherein the assignment formula is as follows:
x (i) is a pixel value of a blank image frame, and X1(i) and X2(i) are pixel values corresponding to reserved image frames X1 and X2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111297793.4A CN114007073A (en) | 2021-11-04 | 2021-11-04 | Large scene based picture storage system and use method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111297793.4A CN114007073A (en) | 2021-11-04 | 2021-11-04 | Large scene based picture storage system and use method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114007073A true CN114007073A (en) | 2022-02-01 |
Family
ID=79927022
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111297793.4A Withdrawn CN114007073A (en) | 2021-11-04 | 2021-11-04 | Large scene based picture storage system and use method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114007073A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114866801A (en) * | 2022-04-13 | 2022-08-05 | 中央广播电视总台 | Video data processing method, device and equipment and computer readable storage medium |
-
2021
- 2021-11-04 CN CN202111297793.4A patent/CN114007073A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114866801A (en) * | 2022-04-13 | 2022-08-05 | 中央广播电视总台 | Video data processing method, device and equipment and computer readable storage medium |
| CN114866801B (en) * | 2022-04-13 | 2023-10-27 | 中央广播电视总台 | Video data processing method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11501507B2 (en) | Motion compensation of geometry information | |
| US20200005518A1 (en) | Point cloud mapping | |
| US9374449B2 (en) | Method and apparatus for generating and playing animated message | |
| CN108734653B (en) | Image style conversion method and device | |
| CN109035257B (en) | Portrait segmentation method, device and equipment | |
| CN110008997B (en) | Image texture similarity recognition method, device and computer readable storage medium | |
| TW200803521A (en) | Randomly sub-sampled partition voting (RSPV) algorithm for scene change detection | |
| CN111107370B (en) | Video watermark embedding processing method and device, electronic equipment and storage medium | |
| CN111836118B (en) | Video processing method, device, server and storage medium | |
| CN115022670B (en) | Video file storage method, video file restoration device, video file storage equipment and storage medium | |
| CN114494775A (en) | Video segmentation method, device, equipment and storage medium | |
| CN114531598A (en) | Image compression method and device, intelligent terminal and computer readable storage medium | |
| CN110910326B (en) | Image processing method and device, processor, electronic equipment and storage medium | |
| CN113888431A (en) | Training method and device of image restoration model, computer equipment and storage medium | |
| CN112601068A (en) | Video data augmentation method, device and computer readable medium | |
| CN114007073A (en) | Large scene based picture storage system and use method thereof | |
| US11605184B2 (en) | Point cloud global tetris packing | |
| CN110619670A (en) | Face interchange method and device, computer equipment and storage medium | |
| CN110572713B (en) | Transcoding method and processing terminal for adaptive video bandwidth ratio | |
| CN112650881A (en) | Monitoring data processing method and device and storage medium | |
| CN109859090B (en) | Reversible watermarking method and device based on human visual system | |
| CN108668169B (en) | Image information processing method and device, and storage medium | |
| CN111862343A (en) | Three-dimensional reconstruction method, device and equipment and computer readable storage medium | |
| CN115620321A (en) | Table identification method and device, electronic equipment and storage medium | |
| US9794580B2 (en) | Cache management device, and motion picture system and method using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220201 |
|
| WW01 | Invention patent application withdrawn after publication |