CN115209079B - Method and equipment suitable for long-time data storage of high-speed camera - Google Patents
Method and equipment suitable for long-time data storage of high-speed camera Download PDFInfo
- Publication number
- CN115209079B CN115209079B CN202210164433.5A CN202210164433A CN115209079B CN 115209079 B CN115209079 B CN 115209079B CN 202210164433 A CN202210164433 A CN 202210164433A CN 115209079 B CN115209079 B CN 115209079B
- Authority
- CN
- China
- Prior art keywords
- grid
- data
- picture
- grid data
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000013500 data storage Methods 0.000 title abstract description 6
- 238000012545 processing Methods 0.000 claims abstract description 68
- 238000000605 extraction Methods 0.000 claims abstract description 4
- 238000007906 compression Methods 0.000 claims description 28
- 230000006835 compression Effects 0.000 claims description 20
- 230000011218 segmentation Effects 0.000 claims description 2
- 230000007774 longterm Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 230000015654 memory Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 230000001976 improved effect Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
- H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a method and equipment suitable for long-time data storage of a high-speed camera, and belongs to the technical field of image processing. The method comprises the following steps: s1: acquiring video data acquired by a high-speed camera; s2: acquiring each frame of picture of video data; s3: gridding each frame of picture to obtain a plurality of grid data; s4: encoding and compressing each piece of grid data; s5: and storing the encoded and compressed grid data to an external storage medium. The device comprises a video picture frame extraction module, a video encoder processing capacity acquisition module, a picture gridding processing module, a grid data distribution module, an external storage medium and a decoding and playing module. The technical scheme of the invention can effectively store the high-frame-rate image data acquired by the high-speed camera for a long time without configuring special storage and processing equipment, thereby reducing hardware cost.
Description
Technical Field
The invention belongs to the technical field of image processing, and particularly relates to a method and equipment suitable for long-time data storage of a high-speed camera, computer equipment for realizing the method and a storage medium.
Background
A high-speed camera is a device that captures continuous images at an extremely high frame rate, which results in a much higher amount of data generated per unit time than a normal camera.
On the other hand, if the original video data is not compressed, the data amount is very large, for example, for a 4K video camera, the resolution of capturing one frame of picture is 3840x2160. If the image is stored in the original RGB format, each pixel corresponds to 3 bytes of data, the data amount corresponding to one frame is 3840x 2160x3= 24883200 bytes, about 23.73MB, the number of frames shot per second by a common camera is 25 frames, the data amount per second is 23.73 x25≡593MB, and if a 500GB hard disk is used to store uncompressed video, only about 14 minutes can be stored. In addition, the I/O speed of a common hard disk is far less than 593MB/s, so that the video is usually stored after being compressed and encoded. Taking the common H264 encoder as an example, 4K video can be compressed to about 2MB/s, so that the requirement on the I/O speed of a hard disk is reduced, and video data can be stored for a longer time.
For a high-speed camera, the shooting frame rate can reach 1000 frames/second or higher, and the data generation speed of the high-speed camera is more than 40 times that of a common camera under the same resolution. If the data is not encoded and compressed, the data output speed can reach 23.73GB, which is not achieved by commercial memories at present. Therefore, a common storage mode adopted by the high-speed camera is to use a computer memory for storage. There are two problems with this approach:
1. the memory space of the memory is far smaller than that of the hard disk, and the data cannot be stored for a long time. Taking the above camera as an example, 256GB of memory can only hold 10.78 seconds of data.
2. The data storage device cannot be powered down, and the power-down data is lost.
Aiming at the problems, the technical effect of the proposal proposed by the prior art is poor.
Disclosure of Invention
In order to solve the technical problems, the invention provides a method and equipment suitable for long-time data storage of a high-speed camera, and computer equipment and a storage medium for realizing the method.
In a first aspect of the invention, a method for storing data for a long time for a high speed camera is proposed, said method comprising the steps S1-S5 of:
s1: acquiring video data acquired by a high-speed camera;
s2: acquiring each frame of picture of the video data;
s3: gridding each frame of picture to obtain a plurality of grid data;
s4: encoding and compressing each piece of grid data;
s5: and storing the encoded and compressed grid data to an external storage medium.
Wherein, as an implementation manner of gridding, the step S3 specifically includes:
for each frame of video picture, the video picture is divided into m×n grid pictures on average, wherein each grid contains no more data than the real-time processing capability of the video encoder per unit time, and M, N is a positive integer greater than 2.
Wherein, as a specific implementation manner of the encoding compression process, the step S4 specifically includes:
transmitting each grid data to at least one video encoder for encoding compression processing;
the number of video encoders is not less than the number of grids.
In order to realize that the subsequent decoding and playing are normal, the step S3 further includes:
obtaining a plurality of grid pictures aiming at video pictures of the same frame, and inserting a time stamp into each grid picture, wherein the precision of the time stamp is in millisecond, subtle or nanosecond level;
the step S4 further includes:
each time-stamp inserted mesh picture data is transmitted to at least one video encoder for encoding compression processing.
As a further improvement of the gridding method, the invention can also adopt other non-average gridding methods, and other methods need to be adopted to determine the grid size and the grid number.
As a specific implementation manner, the following steps may be performed after the step S2 and before the step S3:
s21: acquiring the real-time processing capacity of each video encoder existing currently;
s22: based on the real-time processing capability, determining a grid specification for gridding the current frame picture, wherein the grid specification comprises the number of grids to be segmented and the size of each grid;
it will be appreciated that in this step, the different grids may be the same size or different depending on the real-time processing capabilities of each video encoder already present.
In order to enable normal decoding and playing of the data of the high-speed camera after long-time transmission and storage, after the step S5, the method further includes: s6: and decoding and playing the stored grid data.
The decoding playing specifically comprises the following steps:
s601: reading each grid data after coding compression;
s602: decoding each piece of grid data to find grid data with the same time stamp;
s603: splicing the grid data with the same time stamp according to the positions of the grid data in the whole frame picture;
s604: and displaying the spliced pictures to a user.
To implement the method according to the first aspect, in a second aspect of the invention, a device for storing data for a long time for a high-speed camera is provided, said device being connected to a high-speed camera array.
In a specific construction, the apparatus comprises:
the video picture frame extraction module is used for extracting picture frames in video data shot by each high-speed camera;
the video encoder processing capacity acquisition module is used for acquiring the existing real-time processing capacity information of each video encoder;
the picture gridding processing module is used for determining grid specifications based on the real-time processing capacity information of each video encoder acquired by the video encoder processing capacity acquisition module and gridding the current picture frame based on the grid specifications to acquire a plurality of grid data;
the grid data distribution module is used for distributing each grid data to a corresponding video encoder for encoding compression processing;
an external storage medium for storing each of the mesh data after the encoding compression process;
and the decoding and playing module is used for decoding and playing the stored grid data.
The picture meshing processing module also comprises a timestamp generating sub-module corresponding to decoding and playing;
the time stamp generating sub-module generates a time stamp for each piece of grid data, and inserts the time stamp into the grid data to obtain the plurality of pieces of grid data.
The decoding and playing module decodes and plays the stored grid data, and specifically comprises the following steps:
s901: reading each grid data after coding compression;
s902: decoding each piece of grid data to find grid data with the same time stamp;
s903: splicing the grid data with the same time stamp according to the positions of the grid data in the whole frame picture;
s904: and displaying the spliced pictures to a user.
As a further improvement, each of the video encoders has a unique encoding identifier in order to increase the efficiency of the encoding compression process and match with the subsequent decoding playback process;
the grid data distribution module distributes each grid data to a corresponding video encoder for encoding compression processing, and specifically comprises the following steps:
and the grid data distribution module is used for distributing each grid data to the corresponding video encoder for encoding compression processing after associating the position identifier of each grid data with the unique encoding identifier of the corresponding video encoder.
The technical scheme of the invention can be realized by computer equipment based on computer program instruction automation.
Accordingly, in a third aspect of the present invention, the present invention may be embodied as a computer medium having stored thereon computer program instructions which, by execution, implement a method for storing data for a long time for a high-speed camera as described in the first aspect.
Also, in the fourth aspect of the present invention, the present invention may also be expressed as a computer program product, which is loaded on a computer storage medium, and the program is executed by a processor, thereby implementing all or part of the steps of the method for storing data for a long time for a high-speed camera.
The technical scheme of the invention can effectively store the high-frame-rate image data acquired by the high-speed camera for a long time without configuring special storage and processing equipment, thereby reducing hardware cost. The concrete steps are as follows:
1-encoding, compressing and transmitting after framing grids of high-frame-rate video shot by a high-speed camera, so that common storage equipment can store the high-frame-rate video for a long time;
2-dynamically updating the grid specification used for each gridding based on the idle processing capacity of the existing encoder, so as to ensure that no delay and data blockage exist in each encoding compression process;
3-adding a time stamp to the grid data of the same frame before encoding and compressing, so that the picture which is probably decoded and played and spliced can be ensured to accurately correspond to the original video picture, and the hardware cost is reduced while the data processing efficiency is improved.
Further advantages of the invention will be further elaborated in the description section of the embodiments in connection with the drawings.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow diagram of a method for storing data for a long time in a high speed camera according to one embodiment of the present invention;
FIG. 2 is a flow diagram of a further preferred embodiment for implementing the method of FIG. 1;
FIG. 3 is a general flow chart for implementing high-speed video decoding playback by the video camera after performing the method of FIG. 1;
FIG. 4 is a schematic block diagram of an apparatus for storing data for a long time for a high speed camera implementing the method described in FIGS. 1-3;
fig. 5 is a schematic diagram of decoding playback after the device of fig. 4 has implemented high-speed camera video storage.
Detailed Description
The invention will be further described with reference to the drawings and detailed description.
Referring to fig. 1, fig. 1 is a main flow diagram of a method for storing data for a long time for a high-speed camera according to an embodiment of the present invention.
Steps S1-S5 of a method for storing data for a long time for a high-speed camera, as shown in fig. 1, are specifically implemented as follows:
s1: acquiring video data acquired by a high-speed camera;
s2: acquiring each frame of picture of the video data;
s3: gridding each frame of picture to obtain a plurality of grid data;
s4: encoding and compressing each piece of grid data;
s5: and storing the encoded and compressed grid data to an external storage medium.
In step S3 of this embodiment, each frame of picture is gridded to obtain a plurality of grid data, which first needs to determine gridded grid specifications, including how many sub-grids each frame of picture is divided into, and the size of each sub-grid.
As a general principle, the complete video picture is first gridded, the grid size being based on the data rate generated by each grid being processed by a video encoder.
As an implementation manner, an average splitting manner may be adopted, and this implementation manner is as follows:
for each frame of video picture, it is split into grid pictures of mxn (M, N is a positive integer greater than 2), wherein each grid contains an amount of data per unit time that does not exceed the real-time processing capability of the video encoder.
As a more specific example, existing commercial encoders are known that can encode video at a resolution of 4K in real time, 25 frames per second. That is to say that its real-time encoding capability is 3840x2160x25 = 207360000 pixels/second.
We can grid the video into 5x8 grids, each grid size 480x432.
For a camera of 1000 frames per second, each grid produces an amount of data of
480x432x1000 = 207360000 pixels/second, not exceeding the real-time processing capability of the encoder. For higher frame rate cameras, this approach can be implemented with small grid partitions or with higher processing power encoders.
The processing device includes therein not less than the number of encoders for encoding and compressing video data of one grid each. Calculated by the above example, the amount of data after each trellis encoding is about 2MB/s, the amount of data generated by all the trellis is about 80MB/s, and the I/O speed of many commercially available memory devices can fully meet this requirement.
As another implementation, other non-averaged meshing methods are used, at which point other methods need to be used to determine mesh size and number of meshes.
As a specific implementation manner, the following steps may be performed after the step S2 and before the step S3:
s21: acquiring the real-time processing capacity of each video encoder existing currently;
s22: based on the real-time processing capability, determining a grid specification for gridding the current frame picture, wherein the grid specification comprises the number of grids to be segmented and the size of each grid;
in particular, the different grids in this step may be the same or different in size, depending on the real-time processing capabilities of each video encoder.
It should be noted that the above steps are performed for each frame of the current picture, i.e. the slicing manner (grid specification) of each frame of the picture is not necessarily the same, but dynamically varies, because the real-time processing capability of each video encoder currently existing is changed, the previously idle video encoder may be busy at the next frame, and the previously busy video encoder may be idle at the next frame.
After the above-mentioned segmentation, the step S4 specifically includes: each grid data is sent to at least one video encoder for encoding compression processing.
Preferably, the number of video encoders is ensured not to be lower than the number of grids when slicing, so as to avoid waiting of data.
In order to enable normal decoding and playing of the data of the high-speed camera after long-time transmission and storage, after the step S5, the method further includes: s6: and decoding and playing the stored grid data.
Based on the above description, a further embodiment of the method of fig. 2 can be obtained as follows:
s1: acquiring video data acquired by a high-speed camera;
s2: acquiring each frame of picture of the video data;
s21: acquiring the real-time processing capacity of each video encoder existing currently;
s22: determining a current grid specification for gridding the current frame picture based on the real-time processing capability;
s3: gridding each frame of picture based on the current grid specification to obtain a plurality of grid data;
s4: encoding and compressing each piece of grid data;
s5: storing the encoded and compressed grid data to an external storage medium;
s6: and decoding and playing the stored grid data.
Further, in order to realize that the data of the high-speed camera can be normally decoded and played after being transmitted and stored for a long time, the step S3 further includes:
obtaining a plurality of grid pictures aiming at video pictures of the same frame, and inserting a time stamp into each grid picture, wherein the precision of the time stamp is in millisecond, subtle or nanosecond level;
specifically, in order to enable time alignment of mesh data belonging to the same frame, a frame of uncompressed image data input to the encoder by the mesh is added with time information of the frame (the accuracy of the time stamp needs to be in the order of milliseconds, microseconds, or nanoseconds depending on the frame rate).
The step S4 further includes:
each time-stamp inserted mesh picture data is transmitted to at least one video encoder for encoding compression processing.
In the step S5, the video encoded by these encoders is provided with grid coordinate information and time stamp information of each frame, and then stored on an external storage medium (e.g., a hard disk).
The video data of each grid can be stored in different files or stored in one file according to a certain format. If a single file storage mode is employed, a custom format may be employed, or a file format supporting multi-track video storage, such as MP4 format, MPEG-TS format.
The whole process of processing and playing each frame of the video can be referred to the training judgment flow described in fig. 3, the flow is implemented in the form of computer program instructions, and the pseudo code flow language is as follows:
acquiring video data acquired by a high-speed camera;
acquiring a current frame picture of video data;
acquiring the real-time processing capacity of each video encoder existing currently;
determining a current grid specification for gridding a current frame picture;
gridding the current frame picture based on the determined current grid specification to obtain a plurality of current grid picture data;
inserting a time stamp into each current grid picture data;
transmitting each current grid picture data to a video encoder for encoding compression processing;
storing the current grid picture data after coding compression to an external storage medium;
judging whether a next frame exists, if not, entering a decoding and playing processing step;
otherwise, the next frame picture is taken as the current frame picture, and the step of acquiring the current frame picture of the video data is returned.
In the above method, the decoding and playing processing steps can be summarized as follows:
1. the video data of each grid after encoding is read out from the storage medium.
2. These trellis videos are decoded to find the same time stamped trellis frame pictures.
3. These grid frames are stitched together according to their respective positions in the overall frame.
4. And displaying the spliced pictures to a user.
Based on the above flow, it can be clearly seen that each time the slicing grid is performed for each frame of the current picture, the grid specification is dynamically changed, because the real-time processing capability of each currently existing video encoder is changed, the previously idle video encoder may be busy at the next frame, and the previously busy video encoder may be idle at the next frame.
FIG. 4 is a schematic block diagram of an apparatus for storing data for a long time for a high speed camera implementing the method described in FIGS. 1-3;
the device is connected to a high speed camera array.
In a specific construction, the apparatus comprises:
the video picture frame extraction module is used for extracting picture frames in video data shot by each high-speed camera;
the video encoder processing capacity acquisition module is used for acquiring the existing real-time processing capacity information of each video encoder;
the picture gridding processing module is used for determining grid specifications based on the real-time processing capacity information of each video encoder acquired by the video encoder processing capacity acquisition module and gridding the current picture frame based on the grid specifications to acquire a plurality of grid data;
the grid data distribution module is used for distributing each grid data to a corresponding video encoder for encoding compression processing;
an external storage medium for storing each of the mesh data after the encoding compression process;
and the decoding and playing module is used for decoding and playing the stored grid data.
The picture meshing processing module also comprises a timestamp generating sub-module corresponding to decoding and playing;
the time stamp generating sub-module generates a time stamp for each piece of grid data, and inserts the time stamp into the grid data to obtain the plurality of pieces of grid data.
As a further improvement, each of the video encoders has a unique encoding identifier in order to increase the efficiency of the encoding compression process and match with the subsequent decoding playback process;
the grid data distribution module distributes each grid data to a corresponding video encoder for encoding compression processing, and specifically comprises the following steps:
and the grid data distribution module is used for distributing each grid data to the corresponding video encoder for encoding compression processing after associating the position identifier of each grid data with the unique encoding identifier of the corresponding video encoder.
Fig. 5 is a schematic diagram of decoding playback after the device of fig. 4 has implemented high-speed camera video storage.
After the storage frame data is obtained from the external storage medium, the decoding and playing module executes the following steps:
s901: reading each grid data after coding compression;
s902: decoding each piece of grid data to find grid data with the same time stamp;
s903: splicing the grid data with the same time stamp according to the positions of the grid data in the whole frame picture;
s904: and displaying the spliced pictures to a user.
According to the embodiment of the invention, the high-frame-rate video shot by the high-speed camera is encoded, compressed and transmitted after being subjected to framing grid, so that the common storage equipment can store the high-frame-rate video for a long time; dynamically updating the grid specification used for each gridding based on the idle processing capacity of the existing encoder, so as to ensure that no delay and data blockage exist in each encoding compression process; the time stamp is added for the grid data of the same frame before encoding and compression, so that the picture which is probably decoded and played and spliced can be ensured to accurately correspond to the original video picture, the data processing efficiency is improved, and the hardware cost is reduced.
It should be noted that, the present invention may solve the above problems or achieve corresponding technical effects, but it is not required that each embodiment of the present invention solves all technical problems or achieves all technical effects, and a certain embodiment that separately solves one or several technical problems and obtains one or more improved effects also constitutes a separate technical solution.
The technical scheme of the invention can be realized by computer equipment based on computer program instruction automation. The present invention can also be embodied in a computer program product, which is loaded on a computer storage medium, and the program is executed by a processor, so as to implement the above technical solution.
Further embodiments thus include a computer device comprising a memory storing a computer executable program and a processor configured to perform the steps of the above-described method.
Finally, it should be noted that: the above embodiments are only for illustrating the technical aspects of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the above embodiments, it should be understood by those of ordinary skill in the art that: modifications and equivalents may be made to the specific embodiments of the invention without departing from the spirit and scope of the invention, which is intended to be covered by the claims.
The present invention is not limited to the specific partial module structure described in the prior art. The prior art to which the invention relates in the preceding background section may be used as part of the invention for understanding the meaning of some technical features or parameters. The protection scope of the present invention is subject to what is actually described in the claims.
Claims (3)
1. A method for storing data for a long period of time for use in a high speed camera array, the method comprising the steps of:
s1: acquiring video data acquired by each high-speed camera;
s2: acquiring a current frame picture of the video data;
s3: gridding the current frame picture to obtain a plurality of grid data;
s4: encoding and compressing each piece of grid data;
characterized in that the method further comprises:
step S5: storing the encoded and compressed grid data to an external storage medium;
step S6: decoding and playing the stored grid data;
step S3 is to obtain a plurality of grid pictures aiming at video pictures of the same frame, and insert a time stamp into each grid picture, wherein the precision of the time stamp is in millisecond, subtle or nanosecond level;
after the step S2, before the step S3, the method further includes:
s21: acquiring the real-time processing capacity of each video encoder existing currently;
s22: based on the real-time processing capability, determining a grid specification for gridding the current frame picture;
the step S5 further includes: judging whether a next frame exists or not, and if not, entering a step S6; otherwise, the next frame picture is taken as the current frame picture, and the step S2 is returned;
the step S6 specifically includes:
reading each encoded and compressed grid data from the external storage medium; decoding each piece of grid data to find grid data with the same time stamp; splicing the grid data with the same time stamp according to the positions of the grid data in the whole frame picture; displaying the spliced pictures to a user;
and dynamically updating the grid specification used for each gridding based on the idle processing capacity of the existing encoder; the size of the grid used each time is determined by the real-time processing capacity of each existing video encoder;
the step S4 specifically includes:
transmitting each grid data to at least one video encoder for encoding compression processing;
the number of video encoders is not less than the number of grids.
2. A method for long term storage of data for a high speed camera array as defined in claim 1,
the step S3 specifically includes:
each frame of video picture is split into M x N grid pictures, wherein each grid contains no more data than the real-time processing capability of the video encoder per unit time.
3. An apparatus adapted for long-term storage of data by a high-speed camera, the apparatus being connected to a high-speed camera array, the apparatus comprising:
the video picture frame extraction module is used for extracting picture frames in video data shot by each high-speed camera; the video encoder processing capacity acquisition module is used for acquiring the existing real-time processing capacity information of each video encoder; each of the video encoders having a unique encoding identifier;
the picture gridding processing module is used for determining grid specifications based on the real-time processing capacity information of each video encoder acquired by the video encoder processing capacity acquisition module and gridding the current picture frame based on the grid specifications to acquire a plurality of grid data;
the grid data distribution module is used for distributing each grid data to the corresponding video encoder for encoding compression processing after associating the position identifier of each grid data with the unique encoding identifier of the corresponding video encoder;
an external storage medium for storing each of the mesh data after the encoding compression process;
the decoding and playing module is used for decoding and playing the stored grid data;
the picture meshing processing module further comprises a timestamp generation sub-module;
the time stamp generating sub-module generates a time stamp for each piece of grid data, and inserts the time stamp into the grid data to obtain a plurality of pieces of grid data;
the decoding and playing module decodes and plays the stored grid data, and specifically comprises the following steps:
s901: reading each grid data after coding compression;
s902: decoding each piece of grid data to find grid data with the same time stamp;
s903: splicing the grid data with the same time stamp according to the positions of the grid data in the whole frame picture;
s904: displaying the spliced pictures to a user;
the screen gridding processing module dynamically updates the grid specification used for each gridding based on the idle processing capacity of the existing encoder; the gridding segmentation mode of each frame of picture is dynamically changed;
transmitting each grid data to at least one video encoder for encoding compression processing;
the number of video encoders is not less than the number of grids.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164433.5A CN115209079B (en) | 2022-02-23 | 2022-02-23 | Method and equipment suitable for long-time data storage of high-speed camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164433.5A CN115209079B (en) | 2022-02-23 | 2022-02-23 | Method and equipment suitable for long-time data storage of high-speed camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115209079A CN115209079A (en) | 2022-10-18 |
| CN115209079B true CN115209079B (en) | 2023-05-02 |
Family
ID=83574257
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210164433.5A Active CN115209079B (en) | 2022-02-23 | 2022-02-23 | Method and equipment suitable for long-time data storage of high-speed camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115209079B (en) |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4090862B2 (en) * | 2002-04-26 | 2008-05-28 | 松下電器産業株式会社 | Variable length encoding method and variable length decoding method |
| CN101977313B (en) * | 2010-09-20 | 2012-11-21 | 中国科学院计算技术研究所 | Video signal coding device and method |
| US9307261B2 (en) * | 2012-08-13 | 2016-04-05 | Hulu, LLC | Splicing of video for parallel encoding |
| CN104159063A (en) * | 2013-05-14 | 2014-11-19 | 杭州海康威视数字技术股份有限公司 | Real-time transcoding method and apparatus, and real-time decoding method and apparatus |
| CN104602008B (en) * | 2015-01-14 | 2018-03-20 | 腾讯科技（深圳）有限公司 | Method for video coding, device and system |
| CN106060582B (en) * | 2016-05-24 | 2019-06-11 | 广州华多网络科技有限公司 | Video transmission system, method and device |
| CN107197295B (en) * | 2017-05-18 | 2019-11-29 | 北京数码视讯软件技术发展有限公司 | A kind of coded system and method |
| CN112346945B (en) * | 2020-10-23 | 2022-04-12 | 北京津发科技股份有限公司 | Man-machine interaction data analysis method and device |
| CN113949865A (en) * | 2021-10-15 | 2022-01-18 | 中航航空电子有限公司 | Image encoding method, image encoding device, computer apparatus, storage medium, and image decoding method |
| CN114079779B (en) * | 2022-01-12 | 2022-05-17 | 深圳传音控股股份有限公司 | Image processing method, intelligent terminal and storage medium |
-
2022
- 2022-02-23 CN CN202210164433.5A patent/CN115209079B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115209079A (en) | 2022-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190259123A1 (en) | System and method of data transfer in-band in video via optically encoded images | |
| US6332003B1 (en) | Moving image composing system | |
| WO2021082667A1 (en) | Video data encoding method and device, apparatus, and storage medium | |
| CN102026017B (en) | Efficient test method for video decoding | |
| CN111654720B (en) | Video encoding method, apparatus, device and readable storage medium | |
| CN105611309A (en) | Video transmission method and device | |
| CN112153082B (en) | Method and device for smoothly displaying real-time streaming video picture in android system | |
| EP3748972A1 (en) | Video recording method and system | |
| CN112272327B (en) | Data processing method, device, storage medium and equipment | |
| JP2010529804A (en) | System and method for generating and playing 3D video files based on 2D video media standards | |
| CN113051236B (en) | Method and device for auditing video and computer-readable storage medium | |
| CN108650460A (en) | Server, panoramic video store and transmit method and computer storage media | |
| US20200351507A1 (en) | Method and apparatus for decoding video bitstream, method and apparatus for generating video bitstream, storage medium, and electronic device | |
| CN110784757A (en) | Game live broadcast method and device in live broadcast client, medium and electronic equipment | |
| CN111263164A (en) | High frame frequency video parallel coding and recombination method | |
| CN110139128B (en) | Information processing method, interceptor, electronic equipment and storage medium | |
| CN114827663A (en) | Distributed live broadcast frame insertion system and method | |
| CN115209079B (en) | Method and equipment suitable for long-time data storage of high-speed camera | |
| CN117714700A (en) | Video coding method, device, equipment, readable storage medium and product | |
| RU2746344C2 (en) | Method and the device for encoding a signal representing the content of a light field | |
| CN109862385B (en) | Live broadcast method and device, computer readable storage medium and terminal equipment | |
| EP4294021A1 (en) | Data processing method and apparatus, computer device and storage medium | |
| CN107004018B (en) | Data processing method and device | |
| CN101521833B (en) | Processing method and processing device of transport stream for test | |
| CN115834906A (en) | Video encoding and decoding method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |