CN112672078A - Multimedia data processing method, device and system - Google Patents
Multimedia data processing method, device and system Download PDFInfo
- Publication number
- CN112672078A CN112672078A CN202011507917.2A CN202011507917A CN112672078A CN 112672078 A CN112672078 A CN 112672078A CN 202011507917 A CN202011507917 A CN 202011507917A CN 112672078 A CN112672078 A CN 112672078A
- Authority
- CN
- China
- Prior art keywords
- multimedia data
- resolution
- path
- merging
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000012544 monitoring process Methods 0.000 claims abstract description 14
- 230000006835 compression Effects 0.000 claims description 11
- 238000007906 compression Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000006798 recombination Effects 0.000 claims description 3
- 238000005215 recombination Methods 0.000 claims description 3
- 238000007599 discharging Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000005034 decoration Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Abstract
The invention discloses a multimedia data processing method, a device and a system. Wherein, the method comprises the following steps: combining the received multi-path multimedia data to obtain combined multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; and sending the data stream to the client. The invention solves the technical problem of high data processing pressure caused by the fact that a video splicer monitors multiple paths of input videos at the same time.
Description
Technical Field
The invention relates to the technical field of image display, in particular to a multimedia data processing method, device and system.
Background
The video display in the software of the video splicer device is an important part, and is a necessary function of the service for watching the real situation and content of each input signal. However, the input sources of the video splicer device are many, so that the pressure is very high during video transmission and playing.
Aiming at the problem of large data processing pressure caused by the fact that a video splicer monitors multiple paths of input videos at the same time, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a multimedia data processing method, a device and a system, which are used for at least solving the technical problem of high data processing pressure caused by the fact that a video splicer monitors multiple paths of input videos simultaneously.
According to an aspect of an embodiment of the present invention, there is provided a multimedia data processing method, including: combining the received multi-path multimedia data to obtain combined multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; and sending the data stream to the client.
Optionally, the merging the received multiple paths of multimedia data to obtain merged multimedia data includes: combining and splicing the multi-path multimedia data from a first type of resolution to obtain the multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution; and determining the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
Further, optionally, the compressing according to the multiple paths of multimedia data respectively, and obtaining the compressed multiple paths of multimedia data includes: determining a layout mode according to the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution; and respectively compressing the multi-path effective video sources according to the frame rate and the image quality according to the layout mode to obtain multi-path multimedia data with the resolution of a third type, wherein the third type of resolution is smaller than the second type of resolution, and the third type of resolution is larger than the first type of resolution.
Optionally, merging the compressed multiple paths of multimedia data to generate a data stream includes: merging the multi-path multimedia data with the resolution ratio of a third type of resolution ratio according to a preset merging rule to generate a data stream, wherein the preset merging rule comprises the following steps: a video total resolution rule, an input order rule, and an emission rule.
Further, optionally, the video total resolution rule includes: when the number of input sources in the multi-path multimedia data is less than or equal to a first preset value, determining the total video resolution as a first resolution; when the number of input sources in the multi-path multimedia data is greater than or equal to a second preset value and less than or equal to a third preset value, determining the total video resolution as a second resolution; when the number of input sources in the multi-path multimedia data is larger than a third preset value, determining the total resolution of the video to be a third resolution; the first preset value is smaller than the second preset value, and the third preset value is larger than the second preset value; the third category of resolutions includes: a first resolution, a second resolution, and a third resolution; the first resolution is less than the second resolution, and the second resolution is less than the third resolution; the input order rule includes: arranging the sequence of the multi-path multimedia data from left to right and from top to bottom according to the sequence of the sequence numbers of the multi-path multimedia data; the emission rules include: and calculating the number of rows and columns according to the number of input sources in the multi-path multimedia data, and arranging the multi-path multimedia data according to the number of rows and columns.
Optionally, the method further includes: receiving performance parameters returned by the client; and adjusting the frame rate and the image quality of the data stream according to the performance parameters to obtain the adjusted data stream.
According to another aspect of the embodiments of the present invention, there is also provided a multimedia data processing apparatus, including: the first merging module is used for merging the received multi-path multimedia data to obtain merged multimedia data; the compression module is used for splitting the combined multimedia data through the pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; the second merging module is used for merging the compressed multi-path multimedia data to generate a data stream; and the sending module is used for sending the data stream to the client.
Optionally, the first merging module includes: the first merging unit is used for merging and splicing the multi-path multimedia data from a first type of resolution to obtain the multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution; and the determining unit is used for determining the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
Further, optionally, the compression module comprises: the layout determining unit is used for determining a layout mode according to the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution; and the compression unit is used for respectively compressing the multi-path effective video sources according to the frame rate and the image quality according to the layout mode to obtain multi-path multimedia data with the resolution of a third type of resolution, wherein the third type of resolution is smaller than the second type of resolution, and the third type of resolution is larger than the first type of resolution.
According to another aspect of the embodiments of the present invention, there is also provided a video transmission system, including: the system comprises a video processor and a client, wherein the video processor is used for merging the received multi-path multimedia data to obtain merged multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; sending the data stream to a client; and the client is connected with the video processor and used for receiving the data stream, decoding the data stream, and performing recombination and cutting on the decoded data stream to obtain the multi-path multimedia data to be output.
In the embodiment of the invention, the received multi-path multimedia data are merged to obtain merged multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; the data stream is sent to the client, the purpose of realizing simultaneous transmission and display of multiple paths of videos is achieved, the technical effect that the video splicer monitors multiple paths of input videos simultaneously is achieved, and the technical problem that data processing pressure is large due to the fact that the video splicer monitors the multiple paths of input videos simultaneously is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart illustrating a multimedia data processing method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of the principle in a multimedia data processing method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating the number of inputs being arranged according to an arrangement rule in a multimedia data processing method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a multimedia data processing apparatus according to an embodiment of the present invention;
fig. 5 is a diagram illustrating merging of a frame of images in a video transmission system according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical terms related to the present application are:
video coding-video codec refers to a program or device that can compress or decompress digital video.
The video coding mode is a mode of converting a file in an original video format into a file in another video format by a compression technology. The most important codec standards in video streaming are h.261, h.263 and h.264 of the international union.
Example 1
In accordance with an embodiment of the present invention, there is provided a method embodiment of a multimedia data processing method, it should be noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than that presented herein.
Fig. 1 is a flow chart of a multimedia data processing method according to an embodiment of the present invention, as shown in fig. 1, the method is performed by a video processing device, wherein the video processing device is a device for performing video processing, such as a video splicer, a video switcher, or a video processor, and the method includes the following steps:
step S102, combining the received multi-path multimedia data to obtain combined multimedia data;
specifically, fig. 2 is a schematic diagram of a principle in a multimedia data processing method according to an embodiment of the present invention, and as shown in fig. 2, the multimedia data processing method provided in the embodiment of the present invention may be applied to a video splicer (it should be understood that, taking the video splicer as an example herein, the present solution may also be applied to other types of devices for video processing without contradiction), where the video splicer includes an AUX (Auxiliary output or Auxiliary output interface) and a pre-monitor card, and multiple input video images can be simultaneously monitored by the pre-monitor card, for example: 16. 40, 60 and 120 paths, it should be noted that, in the embodiment of the present application, it is preferable that 120 paths of video images can be simultaneously monitored by the pre-monitoring card; the pre-supervisor card may include: the embodiments of the present application are described only with reference to the above examples, and are not limited to the implementation of the multimedia data processing method provided in the embodiments of the present application.
As an alternative example, the step S102 may be performed by AUX.
The multimedia data in the embodiment of the present application may include: video input data or image input data.
As shown in fig. 2, the AUX receives at least one path of multimedia data, i.e., input1, input2, and input 3.
Optionally, the step S102 of combining the received multiple paths of multimedia data to obtain combined multimedia data includes: combining and splicing the multi-path multimedia data from a first type of resolution to obtain the multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution; and determining the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
Specifically, based on at least one path of received multimedia data, the FPGA in the pre-monitor card receives all daughter card video input data merged and spliced by the multimedia input port AUX through serdes, and the video input data sent by the AUX to the FPGA merges and splices each path of video input data into data with a second type of resolution at a first type of resolution, where in the embodiment of the present application, the first type of resolution may be 480X270 resolution; the second type of resolution may be 4K resolution.
Step S104, splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data;
specifically, based on the obtained merged multimedia data, the FPGA compresses the multiple paths of video signals according to the resolution respectively, and merges the multiple paths of images into one path of video, so as to obtain the compressed multiple paths of multimedia data.
Optionally, the compressing according to the multiple paths of multimedia data in step S104 respectively, and obtaining the compressed multiple paths of multimedia data includes: determining a layout mode according to the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution; and respectively compressing the multi-path effective video sources according to the frame rate and the image quality according to the layout mode to obtain multi-path multimedia data with the resolution of a third type, wherein the third type of resolution is smaller than the second type of resolution, and the third type of resolution is larger than the first type of resolution.
Specifically, the pre-monitor card determines an NxN layout mode according to the number of available video sources, and creates a new video buffer with a width of 480xN and a height of 270 xN. The effective input sources in the 4k original video are respectively cut out to be compactly recombined in a new video buffer.
Step S106, merging the compressed multi-path multimedia data to generate a data stream;
as shown in fig. 2, the FPGA of the pre-monitor card transmits the 4k original video to a Microprocessor (MPU) of the pre-monitor card through a bt1120, and the MPU performs frame rate and image quality processing on the merged multimedia data to generate a data stream. Dividing the video with the resolution of 4K into multiple paths of videos by means of compression and combination, compressing the multiple paths of videos respectively, and finally combining the compressed multiple paths of videos, so that the size of the data stream in the step S106 can be effectively reduced;
optionally, the step S106 of merging the compressed multiple paths of multimedia data to generate a data stream includes: merging the multi-path multimedia data with the resolution ratio of a third type of resolution ratio according to a preset merging rule to generate a data stream, wherein the preset merging rule comprises the following steps: a video total resolution rule, an input order rule, and an emission rule.
Wherein the video total resolution rule comprises: when the number of input sources in the multi-path multimedia data is less than or equal to a first preset value, determining the total video resolution as a first resolution; when the number of input sources in the multi-path multimedia data is greater than or equal to a second preset value and less than or equal to a third preset value, determining the total video resolution as a second resolution; when the number of input sources in the multi-path multimedia data is larger than a third preset value, determining the total resolution of the video to be a third resolution; the first preset value is smaller than the second preset value, and the third preset value is larger than the second preset value; the third category of resolutions includes: a first resolution, a second resolution, and a third resolution; the first resolution is less than the second resolution, and the second resolution is less than the third resolution;
specifically, the video total resolution rule includes: the total video resolution is controlled on two criteria, and when the number of Input sources (Input) is less than or equal to 64 (the first preset value in the embodiment of the present application), the total video resolution is fixed as follows: 1920 × 1080 (first resolution in the embodiment of the present application);
when 65 (the second preset value in the embodiment of the present application) ≦ the number of Input sources (Input) ≦ 128 (the third preset value in the embodiment of the present application), the total resolution of the video is fixed to: 1920 × 2160 (second resolution in the embodiment of the present application);
when the number of Input sources (Input) > 128, the total video resolution is fixed as: 1920 × N (third resolution in the embodiment of the present application);
the input order rule includes: arranging the sequence of the multi-path multimedia data from left to right and from top to bottom according to the sequence of the sequence numbers of the multi-path multimedia data;
specifically, the display units are arranged in the order of Input1, Input2, and Input3 … … from small to large, and are arranged in a left-to-right and top-to-bottom manner in the large-screen display.
The emission rules include: and calculating the number of rows and columns according to the number of input sources in the multi-path multimedia data, and arranging the multi-path multimedia data according to the number of rows and columns.
Specifically, the number of rows and columns is dynamically calculated according to the number of inputs (i.e., the number of inputs in the embodiment of the present application), so that each small graph (Input) can have a greater resolution; with a maximum of 8 per row.
Among these, the emission rules are exemplified as follows:
when the number of inputs is [1,4], a 2 × 2 manner is adopted, as shown in fig. 3, and fig. 3 is a schematic diagram of the number of inputs being arranged according to the arrangement rule in the multimedia data processing method according to the embodiment of the present invention:
similarly, the settings are as follows:
when the number of inputs is [5,16], adopting a 4 × 4 mode;
when the number of inputs is [17,25], adopting a 5 × 5 mode;
when the number of inputs is [26,36], adopting a 6 × 6 mode;
when the number of inputs is [37,49], adopting a 7 × 7 mode;
when the number of inputs is [50,64], an 8 × 8 mode is adopted;
when the number of inputs is [65,72], adopting a 9 × 8 mode;
when the number of inputs is [73,80], adopting a 10 × 8 mode;
when the number of inputs is [81,88], an 11 × 8 mode is adopted;
when the number of inputs is [89,96], adopting a 12 × 8 mode;
when the number of inputs is [97,104], adopting a 13 × 8 mode;
when the number of inputs is [105,112], adopting a 14 × 8 mode;
when the number of inputs is [113,120], adopting a 15 × 8 mode;
when the number of inputs is [121,128], a 16 × 8 approach is adopted.
And step S108, transmitting the data stream to the client.
Optionally, the multimedia data processing method provided in the embodiment of the present application further includes: receiving performance parameters returned by the client; and adjusting the frame rate and the image quality of the data stream according to the performance parameters to obtain the adjusted data stream.
And the FPGA transmits the merged video to an embedded program of the pre-monitoring card in the hardware. The embedded program acquires the performance parameters of the client according to the interaction with the client, processes the frame rate and image quality of the data stream according to the performance parameters of the client, and then packages the data stream into an RTSP stream (Real Time Streaming Protocol, which is specially used for entertainment and communication systems to control a Streaming media server for establishing and controlling a media session between terminals).
In the embodiment of the invention, the received multi-path multimedia data are merged to obtain merged multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; the data stream is sent to the client, the purpose of realizing simultaneous transmission and display of multiple paths of videos is achieved, the technical effect that the video splicer monitors multiple paths of input videos simultaneously is achieved, and the technical problem that data processing pressure is large due to the fact that the video splicer monitors the multiple paths of input videos simultaneously is solved.
Example 2
According to another aspect of the embodiments of the present invention, there is also provided a multimedia data processing apparatus, and fig. 4 is a schematic diagram of the multimedia data processing apparatus according to the embodiments of the present invention, as shown in fig. 4, including: a first merging module 42, configured to merge the received multiple paths of multimedia data to obtain merged multimedia data; the compression module 44 is configured to split the merged multimedia data through the pre-monitoring card to obtain multiple paths of multimedia data, and compress the multiple paths of multimedia data respectively to obtain compressed multiple paths of multimedia data; a second merging module 46, configured to merge the compressed multiple paths of multimedia data to generate a data stream; and a sending module 48, configured to send the data stream to the client.
Optionally, the first merging module 42 includes: the first merging unit is used for merging and splicing the multi-path multimedia data from a first type of resolution to obtain the multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution; and the determining unit is used for determining the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
Further, optionally, the compression module 44 includes: the layout determining unit is used for determining a layout mode according to the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution; and the compression unit is used for respectively compressing the multi-path effective video sources according to the frame rate and the image quality according to the layout mode to obtain multi-path multimedia data with the resolution of a third type of resolution, wherein the third type of resolution is smaller than the second type of resolution, and the third type of resolution is larger than the first type of resolution.
Optionally, the second merging module 46 includes: a second merging unit, configured to merge multiple paths of multimedia data with a resolution of a third type of resolution according to a preset merging rule, so as to generate a data stream, where the preset merging rule includes: a video total resolution rule, an input order rule, and an emission rule.
Further, optionally, the video total resolution rule includes: when the number of input sources in the multi-path multimedia data is less than or equal to a first preset value, determining the total video resolution as a first resolution; when the number of input sources in the multi-path multimedia data is greater than or equal to a second preset value and less than or equal to a third preset value, determining the total video resolution as a second resolution; when the number of input sources in the multi-path multimedia data is larger than a third preset value, determining the total resolution of the video to be a third resolution; the first preset value is smaller than the second preset value, and the third preset value is larger than the second preset value; the third category of resolutions includes: a first resolution, a second resolution, and a third resolution; the first resolution is less than the second resolution, and the second resolution is less than the third resolution; the input order rule includes: arranging the sequence of the multi-path multimedia data from left to right and from top to bottom according to the sequence of the sequence numbers of the multi-path multimedia data; the emission rules include: and calculating the number of rows and columns according to the number of input sources in the multi-path multimedia data, and arranging the multi-path multimedia data according to the number of rows and columns.
Optionally, the multimedia data processing apparatus provided in the embodiment of the present application further includes: the receiving module is used for receiving the performance parameters returned by the client; and the adjusting module is used for adjusting the frame rate and the image quality of the data stream according to the performance parameters to obtain the adjusted data stream.
Example 3
According to another aspect of the embodiments of the present invention, there is also provided a video transmission system, including: the system comprises a video processor and a client, wherein the video processor is used for merging the received multi-path multimedia data to obtain merged multimedia data; splitting the combined multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; sending the data stream to a client; and the client is connected with the video processor and used for receiving the data stream, decoding the data stream, and performing recombination and cutting on the decoded data stream to obtain the multi-path multimedia data to be output.
Specifically, the video transmission system in the embodiment of the present application may be as shown in fig. 2 in embodiment 1.
The client cuts the data stream according to a preset merging rule, and obtaining the multimedia data to be output by recombining the cut data stream specifically may include:
after receiving the video stream data, the client performs cutting according to the "resolution rule, sequence rule, and discharge rule" in embodiment 1. For example: when the client detects that there are currently 3 inputs, it knows that the resolution is 1920 × 1080 and the merging mode is one frame of image as shown in fig. 5, where fig. 5 is a schematic diagram of merging one frame of image in the video transmission system according to the embodiment of the present invention.
Based on fig. 5, coordinates and sizes of Input1, Input2, and Input3 in the large map can be calculated.
Input1：x＝0,y＝0,w＝1920/2＝960,h＝1080/2＝540
Input2：x＝Input1.w,y＝0,w＝1920/2＝960,h＝1080/2＝540
Input3：x＝0,y＝Input1.h,w＝1920/2＝960,h＝1080/2＝540
After the coordinates and the size of each Input are calculated, the video content corresponding to each Input can be cut out from the large graph.
Example 4
According to another aspect of the embodiments of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and where the apparatus in which the storage medium is located is controlled to execute the method in embodiment 1 above when the program runs.
Example 5
According to another aspect of the embodiments of the present invention, there is also provided a processor, where the processor is configured to execute a program, where the program executes the method in embodiment 1.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A method for processing multimedia data, comprising:
combining the received multi-path multimedia data to obtain combined multimedia data;
splitting the merged multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing according to the multi-path multimedia data to obtain compressed multi-path multimedia data;
merging the compressed multi-path multimedia data to generate a data stream;
and sending the data stream to a client.
2. The method of claim 1, wherein the combining the received multiple paths of multimedia data to obtain combined multimedia data comprises:
merging and splicing the multi-path multimedia data from a first type of resolution to obtain multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution;
and determining the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
3. The method of claim 2, wherein the compressing according to the plurality of multimedia data respectively to obtain compressed plurality of multimedia data comprises:
determining a layout mode according to the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution;
and respectively compressing the multiple effective video sources according to the frame rate and the image quality according to the layout mode to obtain multiple multimedia data with a third resolution, wherein the third resolution is smaller than the second resolution, and the third resolution is larger than the first resolution.
4. The method of claim 3, wherein the combining the compressed multiple multimedia data to generate a data stream comprises:
merging the multi-path multimedia data with the resolution of the third type of resolution according to a preset merging rule to generate the data stream, wherein the preset merging rule comprises: a video total resolution rule, an input order rule, and an emission rule.
5. The method of claim 4,
the video total resolution rule comprises: when the number of input sources in the multi-path multimedia data is less than or equal to a first preset value, determining the total video resolution as a first resolution; when the number of input sources in the multi-path multimedia data is greater than or equal to a second preset value and less than or equal to a third preset value, determining the total video resolution as a second resolution; when the number of the input sources in the multi-path multimedia data is larger than the third preset value, determining that the total video resolution is a third resolution; the first preset value is smaller than the second preset value, and the third preset value is larger than the second preset value; the third type of resolution includes: the first resolution, the second resolution, and the third resolution; the first resolution is less than the second resolution, the second resolution is less than the third resolution;
the input order rule includes: arranging the sequence of the multi-path multimedia data from left to right and from top to bottom according to the sequence of the sequence numbers of the multi-path multimedia data;
the emission rules include: and calculating the number of rows and columns according to the number of input sources in the multi-path multimedia data, and discharging the multi-path multimedia data according to the number of rows and columns.
6. The method according to any one of claims 1 to 5, further comprising:
receiving performance parameters returned by the client;
and adjusting the frame rate and the image quality of the data stream according to the performance parameters to obtain the adjusted data stream.
7. A multimedia data processing apparatus, comprising:
the first merging module is used for merging the received multi-path multimedia data to obtain merged multimedia data;
the compression module is used for splitting the merged multimedia data through the pre-monitoring card to obtain multi-path multimedia data, and respectively compressing the multi-path multimedia data according to the multi-path multimedia data to obtain compressed multi-path multimedia data;
the second merging module is used for merging the compressed multi-path multimedia data to generate a data stream;
and the sending module is used for sending the data stream to the client.
8. The apparatus of claim 7, wherein the first merging module comprises:
the first merging unit is used for merging and splicing the multi-path multimedia data from a first type of resolution to obtain multimedia data with a second type of resolution, wherein the first type of resolution is smaller than the second type of resolution;
a determining unit, configured to determine the multimedia data with the resolution of the second type of resolution as the merged multimedia data.
9. The apparatus of claim 8, wherein the compression module comprises:
a layout determining unit, configured to determine a layout pattern for the number of effective video sources in the multi-path multimedia data with the resolution of the second type of resolution;
and the compression unit is used for respectively compressing the multiple effective video sources according to the frame rate and the image quality according to the layout mode to obtain multiple paths of multimedia data with a third resolution, wherein the third resolution is smaller than the second resolution, and the third resolution is larger than the first resolution.
10. A video transmission system, comprising: a video processor and a client, wherein,
the video processor is used for merging the received multi-path multimedia data to obtain merged multimedia data; splitting the merged multimedia data through a pre-monitoring card to obtain multi-path multimedia data, and respectively compressing according to the multi-path multimedia data to obtain compressed multi-path multimedia data; merging the compressed multi-path multimedia data to generate a data stream; sending the data stream to a client;
and the client is connected with the video processor and used for receiving the data stream, decoding the data stream, and performing recombination and cutting on the decoded data stream to obtain multi-path multimedia data to be output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507917.2A CN112672078A (en) | 2020-12-18 | 2020-12-18 | Multimedia data processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507917.2A CN112672078A (en) | 2020-12-18 | 2020-12-18 | Multimedia data processing method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112672078A true CN112672078A (en) | 2021-04-16 |
Family
ID=75406869
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011507917.2A Pending CN112672078A (en) | 2020-12-18 | 2020-12-18 | Multimedia data processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112672078A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060059043A (en) * | 2004-11-26 | 2006-06-01 | 엘지전자 주식회사 | Methods and apparatus' of composition image signal with edition for mobile phone |
| CN103533300A (en) * | 2013-04-16 | 2014-01-22 | 北京淳中视讯科技有限公司 | Image pre-monitoring method, image pre-monitoring device and image pre-monitoring system |
| CN105635670A (en) * | 2015-12-25 | 2016-06-01 | 北京小鸟科技发展有限责任公司 | Video pre-monitoring method and system |
| CN208768196U (en) * | 2018-09-19 | 2019-04-19 | 深圳市唯奥视讯技术有限公司 | A kind of video process apparatus with video premonitoring function |
| CN110099224A (en) * | 2018-01-31 | 2019-08-06 | 杭州海康威视数字技术股份有限公司 | Premonitoring display methods, apparatus and system, computer equipment and storage medium |
-
2020
- 2020-12-18 CN CN202011507917.2A patent/CN112672078A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060059043A (en) * | 2004-11-26 | 2006-06-01 | 엘지전자 주식회사 | Methods and apparatus' of composition image signal with edition for mobile phone |
| CN103533300A (en) * | 2013-04-16 | 2014-01-22 | 北京淳中视讯科技有限公司 | Image pre-monitoring method, image pre-monitoring device and image pre-monitoring system |
| CN105635670A (en) * | 2015-12-25 | 2016-06-01 | 北京小鸟科技发展有限责任公司 | Video pre-monitoring method and system |
| CN110099224A (en) * | 2018-01-31 | 2019-08-06 | 杭州海康威视数字技术股份有限公司 | Premonitoring display methods, apparatus and system, computer equipment and storage medium |
| CN208768196U (en) * | 2018-09-19 | 2019-04-19 | 深圳市唯奥视讯技术有限公司 | A kind of video process apparatus with video premonitoring function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104394486B (en) | A kind of video stream processing method and device based on cloud desktop | |
| US10567463B2 (en) | Quality tagging in adaptive bitrate technologies | |
| CN112040233B (en) | Video encoding method, video decoding method, video encoding device, video decoding device, electronic device, and storage medium | |
| CN102625106A (en) | Scene self-adaptive screen encoding rate control method and system | |
| CN111901666B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| CN111404882B (en) | Media stream processing method and device | |
| CN110691260A (en) | IPTV multi-split screen coding playing control method and device | |
| RU2673102C2 (en) | Device and method of information processing and program | |
| CN107809647A (en) | Code check switching method, device and the storage medium of video playback | |
| CN112073543A (en) | Cloud video recording method and system and readable storage medium | |
| CN110740352B (en) | SPICE protocol-based difference image display method in video card transparent transmission environment | |
| CN111193936A (en) | Video streaming transmission method and device, electronic equipment and computer readable storage medium | |
| RU2668064C2 (en) | Information processing device, information processing method and program | |
| CN113099184A (en) | Image splicing method and device compatible with multiple video formats and electronic equipment | |
| CN112672078A (en) | Multimedia data processing method, device and system | |
| CN110392285B (en) | Media stream processing method and device | |
| US9271029B2 (en) | Method and input-output device for rendering at least one of audio, video and computer graphics content and servicing device for delivering at least one of pre-rendered audio, pre-rendered video and pre-rendered computer graphics content | |
| CN113141352B (en) | Multimedia data transmission method and device, computer equipment and storage medium | |
| CN114915797A (en) | Multi-channel video decoding method and device and related products | |
| CN111343475B (en) | Data processing method and device, live broadcast server and storage medium | |
| CN114827617A (en) | Video coding and decoding method and system based on perception model | |
| KR101754571B1 (en) | An apparatus for switching/routing image signals through bandwidth splitting and reduction and the method thereof | |
| CN114257771A (en) | Video playback method and device for multi-channel audio and video, storage medium and electronic equipment | |
| CN115708356A (en) | Video processing method, device, equipment and computer readable storage medium | |
| CN111294617A (en) | Video playing method and device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210416 |
|
| RJ01 | Rejection of invention patent application after publication |