CN114095777A - Video processing system, method, electronic equipment and storage medium - Google Patents
Video processing system, method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114095777A CN114095777A CN202210067592.3A CN202210067592A CN114095777A CN 114095777 A CN114095777 A CN 114095777A CN 202210067592 A CN202210067592 A CN 202210067592A CN 114095777 A CN114095777 A CN 114095777A
- Authority
- CN
- China
- Prior art keywords
- data
- processing
- post
- video
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 54
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000012805 post-processing Methods 0.000 claims abstract description 119
- 238000007781 pre-processing Methods 0.000 claims abstract description 97
- 238000003672 processing method Methods 0.000 claims abstract description 11
- 238000004590 computer program Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 7
- 230000008901 benefit Effects 0.000 abstract description 4
- 230000003111 delayed effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000002073 fluorescence micrograph Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Systems (AREA)
Abstract
The application provides a video processing system, a video processing method, an electronic device and a storage medium, which relate to the field of image processing, and the technical scheme comprises the following key points: the method comprises the following steps: the system comprises a preprocessing module, a data processing module and a data processing module, wherein the preprocessing module receives video data through an input interface and preprocesses the video data to obtain preprocessed data; the memory module is used for receiving the preprocessed data and caching the preprocessed data; the post-processing module is used for reading the preprocessed data of the memory module and post-processing the preprocessed data to obtain post-processed data; the VTC module is used for acquiring an input time sequence and processing time for converting the video data into the post-processing data, and generating an output time sequence according to the input time sequence and the processing time so as to delay the output time sequence to be longer than the input time sequence; and the output interface receives the post-processing data and outputs the post-processing data according to the output time sequence. The video processing system, the video processing method, the electronic equipment and the storage medium have the advantage of low delay.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a video processing system, a video processing method, an electronic device, and a storage medium.
Background
In a medical endoscope system, an imaging system is the most important component thereof. However, if the computing power of the camera system is too poor, the real-time video processing algorithm cannot be performed, and some key details cannot be highlighted, if the delay of the camera system is too high, great inconvenience is brought to the operation, and if the delay of the camera system is too high, poor use experience is brought to a doctor; serious medical accidents may result. Particularly, the problem of large system delay exists in the current 4K high-resolution video processing process.
In view of the above problems, we propose a new solution.
Disclosure of Invention
The application aims to provide a video processing system, a video processing method, an electronic device and a storage medium, which have the advantage of low delay.
In a first aspect, the present application provides a video processing system, which has the following technical solutions:
the method comprises the following steps:
the system comprises a preprocessing module, a data processing module and a data processing module, wherein the preprocessing module receives video data through an input interface and preprocesses the video data to obtain preprocessed data;
the memory module is used for receiving the preprocessed data and caching the preprocessed data;
the post-processing module is used for reading the preprocessed data of the memory module and post-processing the preprocessed data to obtain post-processed data;
the VTC module is used for acquiring an input time sequence and processing time for converting the video data into the post-processing data, and generating an output time sequence according to the input time sequence and the processing time so as to delay the output time sequence to be longer than the input time sequence;
and the output interface receives the post-processing data and outputs the post-processing data according to the output time sequence.
The video data is directly input to the preprocessing module through the input interface, the preprocessing module performs preprocessing and then carries out caching, and then the post-processing module carries out post-processing on the cached preprocessing data.
Further, in the present application, the storage module further receives the post-processing data, and the coding and decoding module reads the post-processing data in the storage module, performs coding and decoding to obtain video data, and stores the video data in the storage module.
Further, in this application, the preprocessing module includes a plurality of preprocessing units, and the plurality of preprocessing units respectively perform preprocessing according to the type of the video data.
Further, in this application, the post-processing module includes a plurality of post-processing units, and the plurality of post-processing units correspondingly process the plurality of pre-processing data processed by the pre-processing units, and the plurality of data processed by the post-processing units are merged to form the post-processing data.
In a second aspect, the present application further provides a video processing method, including:
receiving directly input video data and preprocessing the video data to obtain preprocessed data;
caching the preprocessed data;
reading the cached preprocessing data, and performing post-processing to obtain post-processing data;
acquiring an input time sequence and processing time for converting the video data into the post-processing data, and generating an output time sequence according to the input time sequence and the processing time to delay the output time sequence to the input time sequence;
and outputting the post-processing data according to the output time sequence.
Further, in the present application, the step of receiving directly input video data and performing preprocessing to obtain preprocessed data includes:
acquiring the type of the video data;
and carrying out parallel preprocessing on the video data according to the type of the video data to obtain the preprocessed data.
Further, in this application, the step of reading the cached pre-processing data and performing post-processing to obtain post-processing data includes:
and correspondingly performing parallel post-processing on the preprocessed data obtained by the parallel preprocessing, and combining the post-processed data to form the post-processed data.
Further, in the present application, the method further includes:
caching the post-processing data;
reading the cached post-processing data and coding and decoding to obtain video data;
and caching the video data.
In a third aspect, the present application further provides an electronic device, which includes a processor and a memory, where the memory stores computer-readable instructions, and the computer-readable instructions, when executed by the processor, perform the steps of the above method.
In a fourth aspect, the present application also provides a storage medium having a computer program stored thereon, which, when executed by a processor, performs the steps of the above method.
In view of the above, the video processing system, method, electronic device and storage medium provided in the present application, the video data is directly input to the preprocessing module through the input interface, and is cached after being preprocessed by the preprocessing module, and then the post-processing module performs post-processing on the cached pre-processed data, compared with the traditional prior art, the times of data buffering can be reduced, thereby achieving the purpose of reducing delay, and meanwhile, the output time sequence is generated through the VTC module, the output timing is generated based on the input timing and the processing time for converting the video data into post-processed data, such that the output timing is delayed from the input timing, compared to conventional schemes, the output data and the input data can be kept in the same frame and still keep a certain delay, namely, the delay is reduced and the picture stability of the video image is ensured.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
Fig. 1 is a schematic diagram of a video processing system according to the present application.
Fig. 2 is a schematic structural diagram of a video processing system according to the present application.
Fig. 3 is a flowchart of a video processing method provided in the present application.
Fig. 4 is a schematic structural diagram of an electronic device provided in the present application.
In the figure: 100. an input interface; 200. a preprocessing module; 300. a memory module; 400. a post-processing module; 500. a VTC module; 600. an output interface; 700. a coding and decoding module; 210. a pre-processing unit; 410. a post-processing unit; 420. a synthesis unit; 910. a memory; 920. a processor.
Detailed Description
The technical solutions in the present application will be described clearly and completely with reference to the drawings in the present application, and it should be understood that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, a video processing system, the technical solution specifically includes:
the preprocessing module 200 receives video data through the input interface 100 and preprocesses the video data to obtain preprocessed data;
the memory module 300 receives the preprocessed data and caches the preprocessed data;
the post-processing module 400 reads the pre-processing data of the memory module 300, and performs post-processing on the pre-processing data to obtain post-processing data;
the VTC module 500 acquires an input timing sequence and a processing time for converting video data into post-processing data, and generates an output timing sequence according to the input timing sequence and the processing time to delay the output timing sequence from the input timing sequence;
the output interface 600 receives post-processing data and outputs the post-processing data according to an output timing sequence.
Wherein, the processing time may refer to a time from the start of the pre-processing to the last formation of the post-processing data.
The vtc (video Timing controller) module 500 is a video Timing generation module.
Through the technical scheme, video data are directly input into the preprocessing module 200 through the input interface 100, the video data are cached after being preprocessed through the preprocessing module 200, and then the cached preprocessed data are post-processed through the post-processing module 400, compared with the traditional scheme, the frequency of data caching can be reduced, so that the purpose of reducing delay is achieved. According to the scheme of the application, the preprocessing module 200 is arranged in front of the memory module 300, the video data are directly preprocessed through the preprocessing module 200, then the preprocessed data are cached in the memory module 300, and then the preprocessed data in the memory module 300 are read by the post-processing module 400 and are subjected to post-processing, so that the times of data entering and exiting the memory module 300 are effectively reduced, and the effect of reducing delay is achieved.
Moreover, the output time sequence is generated by the VTC module 500 according to the input time sequence and the processing time of converting the video data into the post-processing data, so that the output time sequence is delayed from the input time sequence. In the conventional scheme, in order to ensure the stability of the picture, the output data is usually one frame slower than the input data, that is, at 50HZ, the delay time is 20ms to 40ms, which causes the problem of too high delay, but the present application obtains the input timing sequence through the VTC module 500, and generates the offset timing sequence according to the phase of the input timing sequence, so that the input video data and the output post-processing data are kept in the same frame, thereby reducing the delay.
However, if only the input video data and the output post-processing data are kept in the same frame, the finally output video image has a problem of instability, that is, the output data is not completely processed, which results in a problem of a video image having a fault. Therefore, the output time sequence needs to be delayed from the input time sequence to ensure the stability of the picture, in contrast, the present application obtains the input time sequence and the time for processing the video data into the post-processing data by using the VTC module 500, and then generates the output time sequence, so that the time delay between the output and the input can be controlled, and thus the continuous stability of the video image can be ensured at the same time with the minimum time delay.
Specifically, the time for processing the video data into the post-processing data can be obtained by a test, which is usually 0 to 20ms, that is, the output of the post-processing data is controlled by the VTC module 500 to be delayed by 0 to 20ms compared with the input of the video data, so that the delay can be kept low, and the stability of the output picture can be ensured. Therefore, the scheme described in the application has a very good processing effect on high-resolution image data transmission such as 4k in the operation process.
When an operation is performed, the operation process usually needs to be recorded for case teaching or other purposes, an additional video recorder is usually needed for recording in the current operation video, the problem of high cost is caused when the additional video recorder is used for recording, the occupation of the operation space is also caused, and special personnel needs to be equipped for processing, so that the operation process is influenced. Therefore, how to find a new scheme for replacing the conventional video recorder to perform the surgery video recording is a problem which needs to be solved urgently at present.
To this end, in some embodiments, the memory module 300 further receives the post-processing data, and the codec module 700 reads the post-processing data in the memory module 300, performs codec to obtain video data, and stores the video data in the memory module 300.
Through the above technical solution, the post-processing data is directly output to an external display, and the post-processing data is also transmitted to the memory module 300 for buffering, the post-processing data buffered in the memory module 300 can be read by the codec module 700, the codec module 700 reads the post-processing data buffered in the memory module 300 according to a control instruction issued by the cpu, and then encodes and decodes the post-processing data, so as to convert the post-processing data into a video format that can be stored, such as an mp4 format. The coding and decoding comprise coding and decoding.
Specifically, the post-processing data may be directly cached in the memory module 300, or may be cached in the memory module 300 through the codec module 700.
Further, in some embodiments, the pre-processing module 200 includes a plurality of pre-processing units 210, and the plurality of pre-processing units 210 respectively perform pre-processing according to the video data types.
Through the technical scheme, different preprocessing can be performed on the video data through the plurality of preprocessing units 210, and the specific preprocessing is determined according to the actual video data type.
For example, when the fluorescence endoscope is used for probing, the video data transmitted by the fluorescence endoscope includes a white light image and a fluorescence image, and taking the white light image as an example, the preprocessing module 200 may include two preprocessing units 210, where one of the preprocessing units 210 is used for preprocessing of mean filtering and scaling, the other preprocessing unit 210 is used for preprocessing of auto-exposure, auto-focusing and color correction, the preprocessed data processed by the two preprocessing units 210 is buffered in the memory module 300, and waits for the post-processing module 400 to perform post-processing.
The number of the preprocessing units 210 can be set according to actual requirements, for example, the above-mentioned fluorescent image requires less preprocessing, so that only one preprocessing unit 210 can preprocess the fluorescent image, and the preprocessing speed of the video data can be increased by setting a plurality of preprocessing units 210. By arranging the plurality of preprocessing units 210 in advance and performing different preprocessing according to different preprocessing units 210, the preprocessing speed of the video data can be effectively increased, so that the video data can be directly received through the input interface 100, the video data does not need to be cached in the memory module 300, and the time delay caused by the fact that the data enters and exits the memory module 300 for multiple times is avoided.
Specifically, in some embodiments, the plurality of input interfaces 100 are configured to be compatible with different protocols and requirements, and may specifically include one or more of HDMI2.0, DP1.2, 12G-SDI, 4X3G-SDI, and DVI, where the plurality of input interfaces 100 are connected to the preprocessing module 200, and the preprocessing module 200 may include a plurality of preprocessing units 210, may transmit different types of video data through different input interfaces 100, and then perform corresponding preprocessing by different preprocessing units 210, or may transmit different types of video data through the same input interface 100, and then perform corresponding preprocessing by different preprocessing units 210.
Further, in some embodiments, the post-processing module 400 includes a plurality of post-processing units 410, the plurality of post-processing units 410 correspondingly process the pre-processing data processed by the plurality of pre-processing units 210, and the data processed by the plurality of post-processing units 410 are combined to form the post-processing data.
Specifically, the post-processing module 400 further includes a synthesizing unit 420, and the synthesizing unit 420 is configured to combine the data processed by the plurality of post-processing units 410 to form post-processing data.
Through the technical scheme, as the plurality of preprocessing units 210 are adopted to preprocess the video data, a plurality of preprocessed data subjected to different preprocessing can be obtained, and accordingly, the plurality of post-processing units 410 can be set in a targeted manner to respectively perform post-processing on the plurality of different preprocessed data, so that the post-processing efficiency is improved in a parallel processing manner, the time delay can be effectively reduced, and finally, the plurality of data processed by the different post-processing units 410 are combined to form the post-processed data.
Specifically, for the above embodiments as examples, if there is a preprocessing unit 210 for scaling the white light image, a post-processing unit 410 is correspondingly provided for scaling the preprocessed data, so as to restore the size of the original image, for example, if the preprocessing unit 210 performs a preprocessing for scaling the white light image ten times, the post-processing unit 410 is correspondingly provided for scaling the preprocessed data ten times. If another preprocessing unit 210 performs preprocessing such as automatic exposure, automatic focusing and color correction on the white light image, another post-processing unit 410 is correspondingly disposed to perform post-processing such as color enhancement and dark field enhancement on the preprocessed data. Finally, all the data processed by the post-processing unit 410 are merged to form post-processed data.
In a second aspect, the present application further provides a video processing method, including:
s810, receiving directly input video data and preprocessing the video data to obtain preprocessed data;
s820, caching the preprocessed data;
s830, reading the cached preprocessing data, and performing post-processing to obtain post-processing data;
s840, acquiring an input time sequence and processing time for converting the video data into post-processing data, and generating an output time sequence according to the input time sequence and the processing time to delay the output time sequence to the input time sequence;
and S850, outputting post-processing data according to the output time sequence.
Through the technical scheme, the video data are directly processed to obtain the preprocessed data, then the preprocessed data are cached, compared with the traditional technical scheme, the video data are cached firstly in the prior art, then the cached video data are read for preprocessing to obtain the preprocessed data, then the preprocessed data are cached, and then the cached preprocessed data are read for post-processing.
On the basis, the input time sequence and the processing time for converting the video data into the post-processing data are acquired, and then the output time sequence is generated according to the input time sequence and the processing time, so that the post-processing data are output according to the output time sequence, and the purpose is to reduce the time delay as much as possible and ensure the stability of an output video picture. In the prior art, an output video image is delayed by one frame compared with an input video image, the delay is 20ms to 40ms at 50HZ, the delay caused by delaying the image of one frame is too large, however, if the output video image and the input video image are completely aligned, the situation that the video is discontinuous in a fault occurs, therefore, in this situation, the output timing sequence is generated by acquiring the input timing sequence and the processing time, the output video image and the input video image can be ensured to be kept in the same frame, the output video image is slightly delayed from the input video image, and thus, the low delay can be ensured, and the stability of the video image can be ensured.
Specifically, the processing time can be obtained through a test in advance, or can be obtained in real time, and compared with the input video image, the delay of the video image output by the method can be as low as 0 to 20 ms.
Further, in some embodiments, the step of receiving directly input video data and performing pre-processing to obtain pre-processed data includes:
acquiring the type of video data;
and carrying out parallel preprocessing on the video data according to the type of the video data to obtain preprocessed data.
According to the technical scheme, different types of video data need to be preprocessed in different manners, some types of video data need to be preprocessed in a large number, some types of video data need to be preprocessed in a small number, when the video data need to be preprocessed in a large number, the video data need to be preprocessed in parallel, and the parallel preprocessing refers to the preprocessing of the video data in different manners, so that the preprocessing efficiency is improved.
Specifically, the video data transmitted by the fluorescence endoscope includes a fluorescence image and a white light image, where the white light image is a primary reference image and the fluorescence image is a secondary reference image, and therefore, the white light image needs to be preprocessed more, and when the video data type is identified as the white light image, the white light image is preprocessed in parallel to obtain preprocessed data.
Further, in some embodiments, the step of reading the cached pre-processing data and performing post-processing to obtain post-processing data includes:
and correspondingly performing parallel post-processing on the preprocessed data obtained by the parallel preprocessing, and combining the post-processed data to form post-processed data.
By the technical scheme, after parallel preprocessing is carried out, different preprocessed data are subjected to post-processing in a targeted manner, the data processing efficiency can be effectively improved, and the post-processed data are combined to form the post-processed data.
Further, in some of the embodiments, the method further comprises:
caching the post-processing data;
reading the cached post-processing data and coding and decoding to obtain video data;
and caching the video data.
Through the technical scheme, the post-processing data can be directly output to an external display, and can be buffered, and the buffered post-processing data can be used for reading, coding and decoding, so that the post-processing data can be converted into a video format which can be stored, such as an mp4 format.
In a third aspect, the present application further provides an electronic device, which includes a processor 920 and a memory 910, where the memory 910 stores computer-readable instructions, and when the computer-readable instructions are executed by the processor 920, the steps in the above method are executed.
By the above technical solution, the processor 920 and the memory 910 are interconnected and communicate with each other through a communication bus and/or other connection mechanism (not shown), and the memory 910 stores a computer program executable by the processor 920, and when the computing device runs, the processor 920 executes the computer program to execute the method in any optional implementation manner of the foregoing embodiment to implement the following functions: receiving directly input video data and preprocessing the video data to obtain preprocessed data; caching the preprocessed data; reading the cached preprocessing data, and performing post-processing to obtain post-processing data; acquiring an input time sequence and processing time for converting video data into post-processing data, and generating an output time sequence according to the input time sequence and the processing time to delay the output time sequence to the input time sequence; and outputting the post-processing data according to the output time sequence.
In a fourth aspect, the present application also provides a storage medium having a computer program stored thereon, where the computer program is executed by a processor to perform the steps of the method as described above.
Through the technical scheme, when being executed by a processor, the computer program executes the method in any optional implementation manner of the embodiment to realize the following functions: receiving directly input video data and preprocessing the video data to obtain preprocessed data; caching the preprocessed data; reading the cached preprocessing data, and performing post-processing to obtain post-processing data; acquiring an input time sequence and processing time for converting video data into post-processing data, and generating an output time sequence according to the input time sequence and the processing time to delay the output time sequence to the input time sequence; and outputting the post-processing data according to the output time sequence.
The storage medium may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A video processing system comprising an input interface (100), characterized in that it further comprises:
the preprocessing module (200) receives video data through the input interface (100) and preprocesses the video data to obtain preprocessed data;
the memory module (300) receives the preprocessed data and caches the preprocessed data;
the post-processing module (400) reads the preprocessed data of the memory module (300), and performs post-processing on the preprocessed data to obtain post-processed data;
a VTC module (500) for acquiring an input timing and a processing time for converting the video data into the post-processing data, and generating an output timing according to the input timing and the processing time to delay the output timing from the input timing;
and the output interface (600) is used for receiving the post-processing data and outputting the post-processing data according to the output time sequence.
2. The video processing system according to claim 1, further comprising a codec module (700), wherein the memory module (300) further receives the post-processing data, and the codec module (700) reads the post-processing data in the memory module (300), performs codec to obtain video data, and stores the video data in the memory module (300).
3. A video processing system according to claim 1, wherein said preprocessing module (200) comprises a plurality of preprocessing units (210), and a plurality of said preprocessing units (210) respectively perform preprocessing according to said video data types.
4. A video processing system according to claim 3, wherein said post-processing module (400) comprises a plurality of post-processing units (410), a plurality of said post-processing units (410) correspondingly process said pre-processed data processed by a plurality of said pre-processing units (210), and data processed by a plurality of said post-processing units (410) are combined to form said post-processed data.
5. A video processing method, comprising:
receiving directly input video data and preprocessing the video data to obtain preprocessed data;
caching the preprocessed data;
reading the cached preprocessing data, and performing post-processing to obtain post-processing data;
acquiring an input time sequence and processing time for converting the video data into the post-processing data, and generating an output time sequence according to the input time sequence and the processing time to delay the output time sequence to the input time sequence;
and outputting the post-processing data according to the output time sequence.
6. The video processing method according to claim 5, wherein the step of receiving directly inputted video data and performing pre-processing to obtain pre-processed data comprises:
acquiring the type of the video data;
and carrying out parallel preprocessing on the video data according to the type of the video data to obtain the preprocessed data.
7. The video processing method according to claim 6, wherein the step of reading the pre-processed data from the buffer and performing post-processing to obtain post-processed data comprises:
and correspondingly performing parallel post-processing on the preprocessed data obtained by the parallel preprocessing, and combining the post-processed data to form the post-processed data.
8. The video processing method according to claim 5, further comprising:
caching the post-processing data;
reading the cached post-processing data and coding and decoding to obtain video data;
and caching the video data.
9. An electronic device comprising a processor (920) and a memory (910), the memory (910) storing computer readable instructions, which when executed by the processor (920) perform the steps of the method according to any one of claims 5-8.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method according to any of claims 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210067592.3A CN114095777B (en) | 2022-01-20 | 2022-01-20 | Video processing system, method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210067592.3A CN114095777B (en) | 2022-01-20 | 2022-01-20 | Video processing system, method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114095777A true CN114095777A (en) | 2022-02-25 |
| CN114095777B CN114095777B (en) | 2022-05-17 |
Family
ID=80308957
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210067592.3A Active CN114095777B (en) | 2022-01-20 | 2022-01-20 | Video processing system, method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095777B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101882302A (en) * | 2010-06-02 | 2010-11-10 | 北京理工大学 | Motion blur image restoration system based on multi-core |
| CN105828041A (en) * | 2016-04-11 | 2016-08-03 | 上海大学 | Video acquisition system supporting parallel preprocessing |
| CN106341575A (en) * | 2015-12-16 | 2017-01-18 | 深圳艾科创新微电子有限公司 | Video signal real-time output processing system |
| CN110349102A (en) * | 2019-06-27 | 2019-10-18 | 腾讯科技（深圳）有限公司 | Processing method, the processing unit and electronic equipment of image beautification of image beautification |
| CN112261474A (en) * | 2020-10-26 | 2021-01-22 | 安徽众新电子科技有限公司 | Multimedia video image processing system and processing method |
| CN113038273A (en) * | 2021-05-24 | 2021-06-25 | 湖北芯擎科技有限公司 | Video frame processing method and device, storage medium and electronic equipment |
| WO2021143612A1 (en) * | 2020-01-16 | 2021-07-22 | 京东方科技集团股份有限公司 | Video signal transmission method and apparatus, and display device |
-
2022
- 2022-01-20 CN CN202210067592.3A patent/CN114095777B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101882302A (en) * | 2010-06-02 | 2010-11-10 | 北京理工大学 | Motion blur image restoration system based on multi-core |
| CN106341575A (en) * | 2015-12-16 | 2017-01-18 | 深圳艾科创新微电子有限公司 | Video signal real-time output processing system |
| CN105828041A (en) * | 2016-04-11 | 2016-08-03 | 上海大学 | Video acquisition system supporting parallel preprocessing |
| CN110349102A (en) * | 2019-06-27 | 2019-10-18 | 腾讯科技（深圳）有限公司 | Processing method, the processing unit and electronic equipment of image beautification of image beautification |
| WO2021143612A1 (en) * | 2020-01-16 | 2021-07-22 | 京东方科技集团股份有限公司 | Video signal transmission method and apparatus, and display device |
| CN112261474A (en) * | 2020-10-26 | 2021-01-22 | 安徽众新电子科技有限公司 | Multimedia video image processing system and processing method |
| CN113038273A (en) * | 2021-05-24 | 2021-06-25 | 湖北芯擎科技有限公司 | Video frame processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114095777B (en) | 2022-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108370405B (en) | A kind of picture signal conversion process method, device and terminal device | |
| EP2081375A2 (en) | Image processing system and camera including the same | |
| US10943115B2 (en) | Processing image data to perform object detection | |
| CN110889809B9 (en) | Image processing method and device, electronic equipment and storage medium | |
| JPH05207460A (en) | Multiplex transmitter and its system for picture signal | |
| US20060170762A1 (en) | Video composition apparatus, video composition method and video composition program | |
| CN111601019B (en) | Image data processing module and electronic equipment | |
| CN109194855A (en) | Imaging method, device and electronic equipment | |
| CN113096021A (en) | Image processing method, device, equipment and storage medium | |
| CN112533075A (en) | Video processing method, device and system | |
| CN114095777B (en) | Video processing system, method, electronic equipment and storage medium | |
| CN112565603B (en) | Image processing method and device and electronic equipment | |
| CN112261417B (en) | Video pushing method and system, equipment and readable storage medium | |
| CN113487524A (en) | Image format conversion method, device, equipment, storage medium and program product | |
| CN113450276B (en) | Video image enhancement method, model training method thereof and related equipment | |
| CN114330610A (en) | Two-dimensional code video-based efficient data transmission method | |
| CN113556500B (en) | Video overlapping method, device and system | |
| CN114650352A (en) | Image tracking and collecting device and image tracking and collecting system applied to CPCI computer | |
| CN115967784A (en) | Image transmission processing system and method based on MIPI CSI-PHY protocol | |
| US11528400B2 (en) | Image-processing microprocessor for supporting an application processor and multiple cameras | |
| CN115146664B (en) | Image acquisition method and device | |
| CN114422718B (en) | Video conversion method and device, electronic equipment and storage medium | |
| CN111835957B (en) | Video processing method, video processing device and video processing equipment | |
| CN112911186B (en) | Image storage method and device, electronic equipment and storage medium | |
| TWI812003B (en) | Method and system for previewing the image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 528253 Room 503, Floor 5, Building A, Jingu Zhichuang Industrial Community, No. 2, Yong'an North Road, Dawu Community, Guicheng Street, Nanhai District, Foshan City, Guangdong Province (residence declaration) Patentee after: Guangdong Oupu Mandi Technology Co.,Ltd. Address before: Room B, room 504-2, floor 5, block a, Jingu photoelectric community, No. 1, Yongan North Road, Pingzhou, Guicheng Street, Nanhai District, Foshan City, Guangdong Province, 528251 Patentee before: GUANGDONG OPTOMEDIC TECHNOLOGY CO.,LTD. |