CN112738612A - Video processing method and system - Google Patents
Video processing method and system Download PDFInfo
- Publication number
- CN112738612A CN112738612A CN202011576520.9A CN202011576520A CN112738612A CN 112738612 A CN112738612 A CN 112738612A CN 202011576520 A CN202011576520 A CN 202011576520A CN 112738612 A CN112738612 A CN 112738612A
- Authority
- CN
- China
- Prior art keywords
- video
- video signals
- resolution
- paths
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Abstract
A video processing method and system are used for solving the problem that the limited transmission bandwidth among different modules in a tiled display control system in the prior art influences the system performance. The method specifically comprises the following steps: the video acquisition end acquires N paths of video signals; the video acquisition end reduces the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N; the video acquisition end sends the N-M paths of video signals and the M paths of video signals with reduced resolution to the video output end; and the video output end displays the N-M paths of video signals and the M paths of video signals with reduced resolution through display equipment.
Description
Technical Field
The present invention relates to the field of video processing technologies, and in particular, to a video processing method and system.
Background
With the rapid development of liquid crystal display and small-spacing LED display technologies, large-sized spliced curtain walls are widely applied in life. The splicing display control system of most splicing curtain walls mainly comprises a video acquisition end and a video output end, wherein the video acquisition end is used for acquiring video signal sources with various interface types and various resolutions and carrying out certain processing; the video output end is used for further processing and then displaying the video signal of the video acquisition end. However, with the application scene of the large-scale tiled curtain wall becoming more and more complex, the number of input video signal sources becoming more and more, and the resolution of the input video signals becoming more and more, the limited transmission bandwidth between the video acquisition end and the video output end in the tiled display control system becomes a bottleneck that restricts the performance optimization of the tiled display control system. Therefore, how to save the transmission bandwidth between the video acquisition end and the video output end is a problem to be solved.
Disclosure of Invention
The embodiment of the invention provides a video processing method and a video processing system, which are used for saving transmission bandwidth between a video acquisition end and a video output end.
In a first aspect, an embodiment of the present invention provides a video processing method, which is applied to a video processing system, where the video processing system includes a video acquisition end and a video output end, and the video output end includes a display device, and the method includes:
the video acquisition end acquires N paths of video signals;
the video acquisition end reduces the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N;
the video acquisition end sends N-M paths of video signals and the M paths of video signals with reduced resolution to the video output end;
and the video output end displays the N-M paths of video signals and the M paths of video signals with reduced resolution through the display equipment.
Optionally, the reducing the resolution of the M video signals in the N video signals by the video capturing end includes:
the video acquisition end reduces the resolution of M paths of video signals with the resolution greater than the target resolution in the N paths of video signals; wherein the target resolution is a resolution of the display device.
Optionally, before the video output end displays the N-M channels of video signals and the M channels of video signals with reduced resolution through the display device, the method further includes:
the video output end amplifies the resolution of the L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
the video output end displays the N-M channels of video signals and the M channels of video signals with reduced resolution through the display device, including:
and the video output end displays the N-L paths of video signals and the L paths of video signals with amplified resolution ratio through the display equipment.
Optionally, before the video output terminal amplifies the resolution of the L video signals with the resolution lower than the target resolution in the N video signals, the method further includes:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an area which is not shielded by each window in the N windows;
the video output end amplifies the resolution of the L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals, and the method comprises the following steps:
the video output end determines L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
for a first video signal in the L channels of video signals, the video output end amplifies a resolution of a first part of the first video signal in the first channel of video signals; the first part of video signals are video signals displayed on an unobstructed area in a first window of the first path of video signals, and the first window is a window used for displaying the first path of video signals in the N windows; the first video signal is any one of the L video signals.
Optionally, before the video capturing end reduces the resolution of the M video signals with the resolution greater than the target resolution in the N video signals, the method further includes:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an occluded area of each window in the N windows;
the video acquisition end reduces the resolution of M paths of video signals with the resolution greater than the target resolution in the N paths of video signals, and the method comprises the following steps:
the video acquisition end determines M video signals with the resolution ratio greater than the target resolution ratio in the N video signals;
for a second path of video signals in the M paths of video signals, the video acquisition end reduces the resolution of a second part of video signals in the second path of video signals; the second part of video signals are video signals displayed on an area, which is blocked in a second window, of the second path of video signals, and the second window is a window used for displaying the second path of video signals in the N windows; wherein, the second path of video signal is any one path of video signal in the M paths of video signals.
Optionally, before the video capture end sends the N-M channels of video signals and the M channels of video signals with reduced resolution to the video output end, the method further includes:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an area which is not shielded by each window in the N windows;
the video acquisition end sends N-M video signals and the M video signals with reduced resolution to the video output end, and the method comprises the following steps:
for a third video signal of the N-M video signals and the M video signals with reduced resolution, the video acquisition end sends a third video signal of the third video signal to the video output end, where the third video signal is a video signal of the third video signal displayed in an area that is not blocked in a third window, and the third window is a window used for displaying the third video signal in the N windows; wherein the third video signal is any one of the N-M video signals and the M video signals with reduced resolution.
In a second aspect, an embodiment of the present invention provides a video processing system, including: the system comprises a video acquisition device and a video output device;
the video acquisition device comprises:
the device comprises an acquisition module, a processing module and a sending module, wherein the acquisition module is used for acquiring N paths of video signals;
the processing module is used for reducing the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N;
the sending module is used for sending the N-M paths of video signals and the M paths of video signals with reduced resolution to the video output module;
the video output apparatus includes: the device comprises a receiving module and a display module;
the receiving module is used for receiving the N-M paths of video signals and the M paths of video signals with reduced resolution;
and the display module is used for displaying the N-M paths of video signals and the M paths of video signals with reduced resolution through display equipment.
Optionally, when the processing module is configured to reduce the resolution of M video signals of the N video signals, the processing module is specifically configured to:
reducing the resolution of M video signals with the resolution higher than the target resolution in the N video signals; wherein the target resolution is a resolution of the display device.
Optionally, the video output apparatus further includes a processing module, and before the display module displays the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device, the processing module is configured to:
amplifying the resolution of L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
the display module displays the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device, and specifically includes:
and the display module displays the N-L paths of video signals and the L paths of video signals with amplified resolution ratio through the display equipment.
In a third aspect, an embodiment of the present invention provides a video processing system, including:
a memory for storing computer instructions;
a processor, coupled to the memory, for executing the computer instructions in the memory to perform the method as provided by the first aspect above when executing the computer instructions.
In a fourth aspect, embodiments of the present invention provide a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform the method as provided in the first aspect.
In a fifth aspect, embodiments of the present invention provide a computer program product, which when run on a computer causes the computer to perform the method as provided in the first aspect above.
The embodiment of the invention provides a video processing method, which is characterized in that the resolution ratio of part of video signals in a plurality of collected video signals is reduced through a video collecting end, and then the video signals processed by the video collecting end are sent to a video output end for further processing and output display, so that the transmission bandwidth between the video collecting end and the video output end is greatly saved, and the performance of a video processing system is improved.
Drawings
Fig. 1 is a schematic diagram of a video processing system corresponding to a video processing method in the prior art;
fig. 2 is a schematic view of a video processing system corresponding to a video processing method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of a video processing method according to an embodiment of the present invention;
FIG. 4 is a diagram of a window layout of a display device in an embodiment of the invention;
FIG. 5 is a diagram of a partitioned window layout of a display device in an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video processing system according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a video capture device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a video output apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of another video processing system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are some, not all embodiments of the solution of the invention. All other embodiments obtained by a person skilled in the art without any creative effort based on the embodiments described in the present document belong to the protection scope of the technical solution of the present invention.
In the prior art, large-scale spliced curtain walls are more and more widely applied, the types of video signals input into a spliced display control system of the spliced curtain walls are more and more complex, the resolution ratio of the video signals is more and more large, and the limited transmission bandwidth between a video acquisition end and a video output end in the spliced display control system becomes a bottleneck for restricting the performance optimization of the spliced display control system.
In view of this, the embodiment of the present invention provides a video processing method, in which a video acquisition end is used to reduce the resolution of a part of video signals in a plurality of collected video signals, and then the video signals processed by the video acquisition end are sent to a video output end for further processing and output display, so as to greatly save the transmission bandwidth between the video acquisition end and the video output end.
The technical scheme provided by the embodiment of the invention is described in the following with the accompanying drawings of the specification.
Fig. 1 is a schematic diagram of a video processing system corresponding to a video processing method in the prior art. The video processing system mainly comprises a video acquisition board 101, a transmission and exchange system 102, a video output board 103, a display device 104 and a control board 105. The video acquisition board 101 and the video output board 103 are connected with the switching system 102 through transmission; the display device 104 is connected with the video output board 103; the control board 105 is connected to the transmission and switching system 102 and is responsible for controlling and scheduling various parts of the system.
The video processing method in the prior art comprises the following steps: the video acquisition board 101 collects multiple paths of video signals, converts the multiple paths of video signals into a uniform interface form, and then the video acquisition board 101 sends the processed multiple paths of video signals to the video output board 103 through the transmission and switching system 102. The video output board 103 performs resolution reduction or amplification processing on the received multiple paths of video signals with various resolutions, so that the resolutions of the video signals finally become a uniform target resolution, and finally, the video output board 103 performs splicing processing on the video signals with uniform resolutions according to a final window layout to be displayed, and sends finally obtained video signals to the display device 104 for display.
The video processing method in the prior art at least has the following problems: when the resolution of the video signal acquired by the video acquisition board is high and the resolution of the video signal to be displayed in the display device is low, the video acquisition board needs to send the high-resolution video signal to the video output board first, and then the video output board performs resolution reduction processing on the high-resolution video signal. In this implementation, the resolution of the video signal displayed in the display device is small, and the resolution of the video signal transmitted from the video capture board to the video output board is large, thereby causing a waste of the transmission bandwidth between the video capture board and the video output board. In addition, in the prior art, the functions of reducing and amplifying the video signal are all arranged in the video output board, so that the load of the processor corresponding to the video output board is easily overlarge, and the load of the processor corresponding to the video acquisition board is small, so that the load of the video acquisition end and the load of the video output end are uneven.
In order to solve the above problems in the prior art, an embodiment of the present invention provides a video processing method.
Fig. 2 is a schematic view of a video processing system corresponding to a video processing method according to an embodiment of the present invention.
The system shown in fig. 2 includes a video capture terminal 201, a video output terminal 202, a transmission and switching system 203, and a control board 204, wherein the video capture terminal 201 includes a plurality of video capture boards 205 therein, and the video output terminal 202 includes a plurality of video output boards 206 and a display device 207 therein. The video acquisition board 205 is connected with the video output board 206 through the transmission and switching system 203, the video output board 206 is connected with the display device 207, and the control board 204 is connected with the transmission and switching system 203.
In fig. 2, after a plurality of video capture boards 205 in a video capture terminal 201 capture a plurality of channels of video signals, the captured plurality of channels of video signals are processed by interface conversion, so as to convert the video signals of different interface types into a uniform interface form; then, the video capture board 205 reduces the resolution of a part of the video signals in the multiple paths of video signals, and sends the processed entire video signals to the transmission and switching system 203. After receiving the multiple paths of video signals processed by the video acquisition board, the multiple video output boards 206 in the video output terminal 202 perform resolution amplification processing on part of the received video signals, and in addition, the video output boards are further configured to perform splicing processing on the processed video signals to output the processed video signals to a display device for video display. The transmission and switching system 203 in fig. 2 is mainly responsible for the transmission of video signals between the video capture terminal 201 and the video output terminal 202, and the exchange of control information between the control board 204 and other parts; the control board 204 sends control commands to the video capture boards and the video output boards through the transmission and switching system 203 to control and schedule the parts.
It should be noted that the above-mentioned video processing system is only shown for the convenience of understanding the spirit and principle of the present invention, and the present invention is not limited in any way in this respect. Rather, embodiments of the present invention may be applied to any video processing system where applicable.
Fig. 3 is a schematic flowchart of a video processing method according to an embodiment of the present invention. One video processing method shown in fig. 3 may be applied to the video processing system shown in fig. 2.
As shown in fig. 3, the video processing method in the embodiment of the present invention specifically includes the following steps:
step 301: the video acquisition end acquires N paths of video signals.
The N-channel video signals may be video signals of multiple video interface forms such as DVI, HDMI, SDI, VGA, etc., and the N-channel video signals may also be video signals of various resolutions. After the video acquisition end acquires N paths of video signals, the video signals in various video interface forms can be converted into a uniform video interface form.
For example, in the video processing system shown in fig. 2, a plurality of video capture boards capture a plurality of paths of video signals, where a first path of video signal is a DVI interface type signal, a second path of video signal is an SDI interface type signal, and a third path of video signal is a VGA interface type signal. If the interface form of the display device is HDMI, the three paths of video signals need to be converted into video signals in the form of HDMI interfaces in a unified manner.
Step 302: and the video acquisition end reduces the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N.
The method specifically comprises the following four conditions that the video acquisition end reduces the resolution of M paths of video signals in N paths of video signals:
in the first case:
and the video acquisition end reduces the resolution of any M video signals in the N video signals.
Taking fig. 2 as an example, N video acquisition boards in the video acquisition end acquire N channels of video signals, and then the first M or any M video acquisition boards in the N video acquisition boards are controlled by the control board to reduce the resolution of the corresponding M channels of video signals. Wherein, the value of M may be a default size, or may be set by the user through the control panel.
In the second case:
the video acquisition end reduces the resolution of M paths of video signals with the resolution greater than the target resolution in the N paths of video signals; wherein the target resolution is a resolution of the display device.
In a possible case, resolutions of the video signals acquired by the video acquisition end are different, and all the N paths of video signals need to be converted into a uniform target resolution, where the target resolution is a resolution of the display device.
For example, the video capture terminal shown in fig. 2 captures 3 paths of video signals, where the resolution of the first path of video signal is 1920x1080, the resolution of the second path of video signal is 1280x720, the resolution of the third path of video signal is 640x480, and the resolution corresponding to the screen of the display device is 960x 540. And if the corresponding processors in the video processing system judge that the resolutions of the first path of video signal and the second path of video signal are both greater than the target resolution, the control panel sends corresponding processing commands to the video acquisition boards corresponding to the first path of video signal and the second path of video signal through the transmission and exchange system, so that the corresponding video acquisition boards can reduce the resolutions of the first path of video signal and the second path of video signal to the target resolution.
Another possible situation is that the resolutions of the video signals collected by the video collection end are the same, the display device has a plurality of corresponding display windows, and the resolutions of the windows are different, so that the resolutions of the collected video signals need to be converted into the resolutions corresponding to the display windows.
For example, fig. 4 is a window layout diagram of a display device in an embodiment of the present invention, where the display device includes a window 401, a window 402, and a window 403, a resolution of the window 401 is 1920x1080, a resolution of the window 402 is 1280x720, and a resolution of the window 403 is 640x 480. The resolution of three video signals acquired by the video acquisition terminal is 960x540, wherein the first video signal needs to be displayed through the window 401, the second video signal needs to be displayed through the window 402, and the third video signal needs to be displayed through the window 403. The corresponding processor in the video processing system determines that the resolution of the third video signal is greater than the resolution of the window 403, and therefore the video capture board corresponding to the third video signal needs to reduce the resolution of the third video signal.
In the third case:
the display device corresponds to a plurality of display windows, wherein a part of some display windows in the plurality of display windows can be shielded by other display windows, and when the video acquisition end reduces the resolution of M paths of video signals with the resolution being greater than the target resolution in the N paths of video signals, only the resolution of the video signals corresponding to the partial windows which are not shielded is reduced.
Optionally, before the video acquisition end reduces the resolution of the corresponding video signal, N windows on the display device and the size and position of an unobstructed area of each of the N windows may also be determined; the N windows are used for displaying N paths of video signals, and the N windows are displayed in an overlapping mode; wherein the N windows correspond to the N paths of video signals one to one. The N windows on the display device may be that the user divides the interface of the display device into N windows through the control panel, or the display device displays N windows by default, which is not limited in the embodiment of the present invention.
After the video acquisition end confirms the size and the position of the N windows on the display device and the uncovered area of each window, for any one of the M paths of video signals (for example, the second path of video signals), the video acquisition end needs to reduce the resolution of the second part of video signals in the second path of video signals; the second part of video signals are video signals displayed by the second path of video signals in an unobstructed area in a second window, and the second window is a window used for displaying the second path of video signals in the N windows.
Taking fig. 5 as an example, the window layout finally displayed in the display device set by the user through the control panel is as shown in fig. 5, which includes three display windows, namely a window 501, a window 502 and a window 503. The resolution of the window 501 is 640x480, the resolution of the window 502 is 1280x720, and the resolution of the window 503 is 1920x 1080. The resolution of the three video signals collected by the video collection end is 1920x1080, wherein the first video signal needs to be displayed through a window 501, the second video signal needs to be displayed through a window 502, and the third video signal needs to be displayed through a window 503. The video processing system judges that the resolution of the obtained first path of video signal and the second path of video signal is greater than the resolution of the corresponding window, so that the video acquisition end needs to reduce the resolution of the first path of video signal and the second path of video signal. However, the window 501 and the window 502 are partially occluded by other windows, the portion of the window 501 that is not occluded includes the rectangular window 501A, the rectangular window 501B, and the rectangular window 501C, and the portion of the window 502 that is not occluded includes the rectangular window 502A and the rectangular window 502B. Therefore, when the resolution reduction processing is performed on the first path of video signal and the second path of video signal, only the resolution reduction processing needs to be performed on the unshielded portions of the corresponding window 501 and window 502, that is, only the resolution reduction processing needs to be performed on the rectangular window 501A, the rectangular window 501B, the rectangular window 501C, the rectangular window 502A, and the rectangular window 502B.
Since the blocked part of each window in fig. 5 is not displayed in the display device, the video signal corresponding to the blocked part of the window does not need to be processed, so that the computing resource of the processor corresponding to the video acquisition end can be saved, and the processing performance is improved.
In a fourth case:
the display device corresponds to a plurality of display windows, wherein one part of some display windows in the plurality of display windows can be shielded by other display windows, and when the video acquisition end reduces the resolution of M paths of video signals with the resolution higher than the target resolution in the N paths of video signals, only the resolution of the video signals corresponding to the shielded part of windows is reduced;
similar to the third case, before the video capture end reduces the resolution of the corresponding video signal, N windows on the display device and the size and position of the non-occluded area of each window in the N windows are also determined; the N windows are used for displaying N paths of video signals, and the N windows are displayed in an overlapping mode; wherein the N windows correspond to the N paths of video signals one by one;
after the video acquisition end confirms the size and the position of the N windows on the display device and the uncovered area of each window, for any one of the M paths of video signals (for example, the second path of video signals), the video acquisition end needs to reduce the resolution of the second part of video signals in the second path of video signals; the second part of video signals are video signals displayed on the blocked area of the second path of video signals in a second window, and the second window is a window used for displaying the second path of video signals in the N windows.
Continuing with fig. 5 as an example, the video capture end needs to reduce the resolutions of the first path of video signal and the second path of video signal, but both the window 501 and the window 502 are partially blocked by other windows, so when the resolution reduction processing is performed on the first path of video signal and the second path of video signal, only the blocked portions in the window 501 and the window 502 may be subjected to the resolution reduction processing.
Because the shielded part can not be displayed in the display equipment, the resolution of the video signal corresponding to the corresponding shielded part window can be reduced by a large extent, and the transmission bandwidth between the video acquisition end and the video output end can be saved to a certain extent.
Step 303: and the video acquisition end sends the N-M paths of video signals and the M paths of video signals with reduced resolution to the video output end.
In one possible way, corresponding to the above four cases, the video capture terminal sends M video signals (or partial video signals with reduced resolution in the M video signals) in the N video signals and other N-M video signals to the corresponding video output terminal through the transmission and switching system.
Another possible way is: and for the N-M video signals and the third video signal in the M video signals with reduced resolution, the video acquisition end sends the third part of the video signals in the third video signal to the video output end. The third part of video signals are video signals displayed by the third video signals on an unobstructed area in a third window, and the third window is a window used for displaying the third video signals in the N windows; wherein the third video signal is any one of the N-M video signals and the M video signals with reduced resolution.
Continuing with fig. 5 as an example, when the video capture terminal sends the first video signal, the second video signal, and the third video signal to the video output terminal, the video capture terminal may send the video signal corresponding to the unoccluded portion. That is, the video capture side may send only the rectangular window 501A, the rectangular window 501B, the rectangular window 501C, and the rectangular window 502A and the rectangular window 502B and the window 503 to the video output side. Only the video signal which can be displayed finally is transmitted, and the covered part is not transmitted, so that the transmission bandwidth between the video acquisition end and the video output end can be saved to a certain extent, and the overall performance of the video processing system is improved.
Step 304: and the video output end displays the N-M paths of video signals and the M paths of video signals with reduced resolution through display equipment.
The video output end is corresponding to the video acquisition end, and is required to amplify the resolution of the L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals before outputting the received video signals to the display equipment for display; the N channels of video signals herein refer to the N channels of video signals processed through the step 302. And then the video output end displays the N-L paths of video signals and the L paths of video signals with amplified resolution ratio through the display equipment.
One possible way is that before the video output terminal amplifies the resolution of the corresponding video signal, N windows on the display device and the size and position of the non-occluded area of each of the N windows need to be determined; the N windows are used for displaying N paths of video signals, and the N windows are displayed in an overlapping mode; wherein the N windows correspond to the N paths of video signals one to one.
After determining L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals at the video output end, for a first path of video signals in the L paths of video signals, the video output end amplifies the resolution of a first part of video signals in the first path of video signals; the first part of video signals are video signals displayed on an unobstructed area in a first window of the first path of video signals, and the first window is a window used for displaying the first path of video signals in the N windows; the first video signal is any one of the L video signals.
Specifically, taking fig. 5 as an example, the resolution of the window 501 is 640x480, the resolution of the window 502 is 1280x720, and the resolution of the window 503 is 1920x 1080. If the resolution of the first video signal received by the video output end is 640x480, the resolution of the second video signal is 640x480, and the resolution of the third video signal is 1920x1080, the three video signals are sequentially displayed through the three windows. It can be seen that the resolution of the second path of video signals is smaller than the resolution of the corresponding window 502, so that the resolution amplification processing needs to be performed on the corresponding second path of video signals. Since a part of the window 502 is covered by the window 503, and the parts that are not covered are the rectangular window 502A and the rectangular window 502B, when the resolution amplification processing is performed on the second path of video signal, only the parts that are not covered in the corresponding window 502 need to be subjected to the resolution amplification processing, that is, only the rectangular window 502A and the rectangular window 502B need to be subjected to the resolution amplification processing.
Based on the same inventive concept, the embodiment of the invention provides a video processing system, and the video processing system can realize the corresponding functions of the video processing method. The video processing system may be a hardware structure, a software module, or a hardware structure plus a software module. The video processing system can be realized by a chip system, and the chip system can be formed by a chip and can also comprise the chip and other discrete devices. Referring to fig. 6, the system includes a video capture device 601 and a video output device 602;
the video capture device 601 includes:
the device comprises a collecting module 603, a processing module 604 and a sending module 605, wherein the collecting module 603 is used for collecting N paths of video signals;
a processing module 604, configured to reduce resolutions of M video signals in the N video signals, where M is a positive integer less than or equal to N;
a sending module 605, configured to send the N-M channels of video signals and the M channels of video signals with reduced resolution to the video output end;
the video output apparatus 602 includes: a receiving module 606 and a display module 607;
the receiving module 606 is configured to receive the N-M channels of video signals and the M channels of video signals with reduced resolution;
the display module 607 is configured to display the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device.
Optionally, when the processing module 604 is configured to reduce the resolution of M video signals in the N video signals, the processing module is specifically configured to:
reducing the resolution of M video signals with the resolution higher than the target resolution in the N video signals; wherein the target resolution is a resolution of the display device.
Optionally, the video output apparatus 602 further includes a processing module, before the display module 607 displays the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device, the processing module is further configured to:
amplifying the resolution of L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
the display module 607 displays the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device, which specifically includes:
the display module 607 displays the N-L channels of video signals and the L channels of video signals with the amplified resolution through the display device.
All relevant contents of each step related to the embodiment of the video processing method may be referred to the functional description of the functional module corresponding to the video processing system in the embodiment of the present invention, and are not described herein again.
The division of the modules in the embodiments of the present invention is schematic, and only one logical function division is provided, and in actual implementation, there may be another division manner, and in addition, each functional module in each embodiment of the present invention may be integrated in one processor, or may exist alone physically, or two or more modules are integrated in one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
Based on the same invention concept, the embodiment of the invention provides a video acquisition device. Referring to fig. 7, the video capture apparatus includes: the functions of the modules in the video capture device are the same as those of the modules in the video capture device in the video processing system in fig. 6, and are not described herein again.
Based on the same inventive concept, the embodiment of the invention provides a video output device. Referring to fig. 8, the video output apparatus includes: the functions of the receiving module 801 and the display module 802 corresponding to the modules in the video capture device are the same as the functions of the modules corresponding to the video output device in the video processing system in fig. 6, and are not described herein again.
Referring to fig. 9, based on the same inventive concept, an embodiment of the present invention provides a video processing system, which includes at least one processor 901, where the processor 901 is configured to execute a computer program stored in a memory, and implement the steps of the video processing method shown in fig. 3 provided by the embodiment of the present invention.
Alternatively, the processor 901 may be a general-purpose processor, such as a Central Processing Unit (CPU), a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, which may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the video processing method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
Optionally, the video processing system may further include a memory 902 connected to the at least one processor 901, where the memory 902 stores instructions executable by the at least one processor 901, and the at least one processor 901 may execute the steps included in the foregoing video processing method by executing the instructions stored in the memory 902.
In this embodiment of the present invention, a specific connection medium between the processor 901 and the Memory 902 is not limited, and the Memory 902 may include at least one type of storage medium, for example, a flash Memory, a hard disk, a multimedia card, a card-type Memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Programmable Read Only Memory (PROM), a Read Only Memory (ROM), a charge Erasable Programmable Read-Only Memory (EEPROM), a magnetic Memory, a magnetic disk, an optical disk, and the like. The memory 902 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory 902 of embodiments of the present invention may also be circuitry or any other device capable of performing a storage function to store program instructions and/or data.
By programming the processor 901, codes corresponding to the video processing method described in the foregoing embodiment may be solidified in a chip, so that the chip can execute the steps of the video processing method when running, and how to program the processor 901 is a technology known by those skilled in the art, and will not be described herein again. The physical devices corresponding to the video capture device 601 and the video output device 602 may be the processor 901 described above. The video processing apparatus may be configured to perform the method provided by the embodiment shown in fig. 3. Therefore, regarding the functions that can be realized by each functional module in the device, reference may be made to the corresponding description in the embodiment shown in fig. 3, which is not repeated herein.
Based on the same inventive concept, embodiments of the present invention also provide a computer-readable storage medium storing computer instructions, which, when executed on a computer, cause the computer to perform the steps of the video processing method as described above.
In some possible embodiments, the aspects of the video processing method provided by the present invention may also be implemented in the form of a program product comprising program code for causing a detection device to perform the steps of the video processing method according to various exemplary embodiments of the present invention described above in this specification, when the program product is run on an electronic device. As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (11)
1. A video processing method is applied to a video processing system, the video processing system comprises a video acquisition end and a video output end, the video output end comprises a display device, and the method comprises the following steps:
the video acquisition end acquires N paths of video signals;
the video acquisition end reduces the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N;
the video acquisition end sends N-M paths of video signals and the M paths of video signals with reduced resolution to the video output end;
and the video output end displays the N-M paths of video signals and the M paths of video signals with reduced resolution through the display equipment.
2. The method as claimed in claim 1, wherein the video capturing end reduces the resolution of M video signals of the N video signals, comprising:
the video acquisition end reduces the resolution of M paths of video signals with the resolution greater than the target resolution in the N paths of video signals; wherein the target resolution is a resolution of the display device.
3. The method of claim 2, wherein before the video output terminal displays the N-M video signals and the M video signals with reduced resolution through the display device, the method further comprises:
the video output end amplifies the resolution of the L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
the video output end displays the N-M channels of video signals and the M channels of video signals with reduced resolution through the display device, including:
and the video output end displays the N-L paths of video signals and the L paths of video signals with amplified resolution ratio through the display equipment.
4. The method of claim 3, wherein before the video output amplifies a resolution of the L video signals of the N video signals having a resolution less than the target resolution, the method further comprises:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an area which is not shielded by each window in the N windows;
the video output end amplifies the resolution of the L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals, and the method comprises the following steps:
the video output end determines L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
for a first video signal in the L channels of video signals, the video output end amplifies a resolution of a first part of the first video signal in the first channel of video signals; the first part of video signals are video signals displayed on an unobstructed area in a first window of the first path of video signals, and the first window is a window used for displaying the first path of video signals in the N windows; the first video signal is any one of the L video signals.
5. The method as claimed in claim 2, wherein the video capturing end, before reducing the resolution of the M video signals with the resolution greater than the target resolution among the N video signals, further comprises:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an occluded area of each window in the N windows;
the video acquisition end reduces the resolution of M paths of video signals with the resolution greater than the target resolution in the N paths of video signals, and the method comprises the following steps:
the video acquisition end determines M video signals with the resolution ratio greater than the target resolution ratio in the N video signals;
for a second path of video signals in the M paths of video signals, the video acquisition end reduces the resolution of a second part of video signals in the second path of video signals; the second part of video signals are video signals displayed on an area, which is blocked in a second window, of the second path of video signals, and the second window is a window used for displaying the second path of video signals in the N windows; wherein, the second path of video signal is any one path of video signal in the M paths of video signals.
6. The method as claimed in claim 1, wherein before the video capture terminal sends the N-M video signals and the M video signals with reduced resolution to the video output terminal, the method further comprises:
determining N windows on the display device; the N windows are used for displaying the N paths of video signals; the N windows are displayed in an overlapping mode; the N windows correspond to the N paths of video signals one by one;
determining the size and the position of an area which is not shielded by each window in the N windows;
the video acquisition end sends N-M video signals and the M video signals with reduced resolution to the video output end, and the method comprises the following steps:
for a third video signal of the N-M video signals and the M video signals with reduced resolution, the video acquisition end sends a third video signal of the third video signal to the video output end, where the third video signal is a video signal of the third video signal displayed in an area that is not blocked in a third window, and the third window is a window used for displaying the third video signal in the N windows; wherein the third video signal is any one of the N-M video signals and the M video signals with reduced resolution.
7. A video processing system, comprising: the system comprises a video acquisition device and a video output device;
the video acquisition device comprises: the device comprises an acquisition module, a processing module and a sending module, wherein the acquisition module is used for acquiring N paths of video signals;
the processing module is used for reducing the resolution of M paths of video signals in the N paths of video signals, wherein M is a positive integer less than or equal to N;
the sending module is used for sending the N-M paths of video signals and the M paths of video signals with reduced resolution to the video output end;
the video output apparatus includes: the device comprises a receiving module and a display module;
the receiving module is used for receiving the N-M paths of video signals and the M paths of video signals with reduced resolution;
and the display module is used for displaying the N-M paths of video signals and the M paths of video signals with reduced resolution through display equipment.
8. The system according to claim 7, wherein the processing module, when configured to downscale the resolution of the M of the N video signals, is specifically configured to:
reducing the resolution of M video signals with the resolution higher than the target resolution in the N video signals; wherein the target resolution is a resolution of the display device.
9. The system of claim 8, wherein the video output apparatus further comprises a processing module, before the display module displays the N-M video signals and the M video signals with reduced resolution through a display device, the processing module is configured to:
amplifying the resolution of L paths of video signals with the resolution smaller than the target resolution in the N paths of video signals;
the display module displays the N-M channels of video signals and the M channels of video signals with reduced resolution through a display device, and specifically includes:
and the display module displays the N-L paths of video signals and the L paths of video signals with amplified resolution ratio through the display equipment.
10. A video processing system, comprising:
a memory for storing computer instructions;
a processor coupled to the memory for executing the computer instructions in the memory and when executing the computer instructions performing the method of any of claims 1 to 6.
11. A computer-readable storage medium storing computer instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011576520.9A CN112738612B (en) | 2020-12-28 | 2020-12-28 | Video processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011576520.9A CN112738612B (en) | 2020-12-28 | 2020-12-28 | Video processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112738612A true CN112738612A (en) | 2021-04-30 |
| CN112738612B CN112738612B (en) | 2023-04-11 |
Family
ID=75606248
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011576520.9A Active CN112738612B (en) | 2020-12-28 | 2020-12-28 | Video processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112738612B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101632090A (en) * | 2005-02-08 | 2010-01-20 | 国际商业机器公司 | The system and method that is used for selective image capture, transmission and reconstruct |
| CN102024446A (en) * | 2010-11-23 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Large-screen spliced wall display device and method |
| CN102710947A (en) * | 2011-03-28 | 2012-10-03 | 索尼公司 | Video signal processing apparatus and video signal processing method |
| US20140282652A1 (en) * | 2013-03-12 | 2014-09-18 | Comcast Cable Communications, Llc | Advertisement Tracking |
| CN104601935A (en) * | 2013-10-31 | 2015-05-06 | 深圳市朗驰欣创科技有限公司 | Frame splicing method and device |
| JP2016116081A (en) * | 2014-12-15 | 2016-06-23 | 株式会社東芝 | Electronic apparatus and display method |
| WO2017096825A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Method of displaying a plurality of videos in production studio and device |
| WO2017101787A1 (en) * | 2015-12-15 | 2017-06-22 | 腾讯科技（深圳）有限公司 | Method and device for processing floating window |
| CN106941617A (en) * | 2017-04-26 | 2017-07-11 | 西安诺瓦电子科技有限公司 | Video process apparatus and multi-window picture display methods |
| CN110769299A (en) * | 2018-07-27 | 2020-02-07 | 杭州海康威视数字技术股份有限公司 | Video frame writing method and device, electronic equipment and storage medium |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| CN111147770A (en) * | 2019-12-18 | 2020-05-12 | 广州市保伦电子有限公司 | Multi-channel video window overlapping display method, electronic equipment and storage medium |
| CN111541933A (en) * | 2020-05-09 | 2020-08-14 | 北京奇艺世纪科技有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN111901663A (en) * | 2020-08-13 | 2020-11-06 | 北京仁光科技有限公司 | Video transmission system, method and computer readable storage medium |
-
2020
- 2020-12-28 CN CN202011576520.9A patent/CN112738612B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101632090A (en) * | 2005-02-08 | 2010-01-20 | 国际商业机器公司 | The system and method that is used for selective image capture, transmission and reconstruct |
| CN102024446A (en) * | 2010-11-23 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Large-screen spliced wall display device and method |
| CN102710947A (en) * | 2011-03-28 | 2012-10-03 | 索尼公司 | Video signal processing apparatus and video signal processing method |
| US20140282652A1 (en) * | 2013-03-12 | 2014-09-18 | Comcast Cable Communications, Llc | Advertisement Tracking |
| CN104601935A (en) * | 2013-10-31 | 2015-05-06 | 深圳市朗驰欣创科技有限公司 | Frame splicing method and device |
| JP2016116081A (en) * | 2014-12-15 | 2016-06-23 | 株式会社東芝 | Electronic apparatus and display method |
| WO2017096825A1 (en) * | 2015-12-07 | 2017-06-15 | 乐视控股（北京）有限公司 | Method of displaying a plurality of videos in production studio and device |
| WO2017101787A1 (en) * | 2015-12-15 | 2017-06-22 | 腾讯科技（深圳）有限公司 | Method and device for processing floating window |
| CN106941617A (en) * | 2017-04-26 | 2017-07-11 | 西安诺瓦电子科技有限公司 | Video process apparatus and multi-window picture display methods |
| CN110769299A (en) * | 2018-07-27 | 2020-02-07 | 杭州海康威视数字技术股份有限公司 | Video frame writing method and device, electronic equipment and storage medium |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| CN111147770A (en) * | 2019-12-18 | 2020-05-12 | 广州市保伦电子有限公司 | Multi-channel video window overlapping display method, electronic equipment and storage medium |
| CN111541933A (en) * | 2020-05-09 | 2020-08-14 | 北京奇艺世纪科技有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN111901663A (en) * | 2020-08-13 | 2020-11-06 | 北京仁光科技有限公司 | Video transmission system, method and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112738612B (en) | 2023-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8611593B2 (en) | Foreground object detection system and method | |
| US10834424B2 (en) | Method and device for compressing image, and electronic device | |
| EP1746538A3 (en) | Multi-graphics processor system, graphics processor and rendering method | |
| EP2975846B1 (en) | Image frame transmission method, mobile terminal and smart television | |
| EP4246965A2 (en) | Method and device, equipment, and storage medium for data processing | |
| CN112738612B (en) | Video processing method and system | |
| CN109165372B (en) | Webpage loading method, device, equipment and storage medium | |
| US10819896B1 (en) | Computer readable recording medium can perform image sensing system control method and image sensing system | |
| CN111083366A (en) | Image processing method, device and system based on data segmentation | |
| CN103618868A (en) | Method and system for playing low-resolution video of mobile device | |
| CN115955557A (en) | Kadun analysis method and device thereof | |
| CN115617294A (en) | Screen display method, device and equipment and readable storage medium | |
| US20190108814A1 (en) | Method for improving system performance, device for improving system performance, and display apparatus | |
| CN114356568A (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN112822545A (en) | Image display method, device and system and video controller | |
| CN114549725A (en) | Image processing device, image fixing determination method and display system | |
| CN113873026A (en) | Dynamic timeout response method, device, terminal equipment and storage medium | |
| CN111447637A (en) | Spectrum data acquisition method, device, equipment and storage medium | |
| CN113868185A (en) | Multi-chip system, electronic device and data transmission method | |
| CN114092925A (en) | Video subtitle detection method and device, terminal equipment and storage medium | |
| CN114727051B (en) | Media resource transmission device, system and method | |
| CN105306836A (en) | Image displaying method and device | |
| CN115297273B (en) | Video processing method, device, system, electronic equipment and storage medium | |
| CN216057047U (en) | System, device and display equipment are carried to many screens of Micro LED | |
| CN115766677B (en) | Frame rate conversion method and device for video mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |