CN107872683B - Video data processing method, device, equipment and storage medium - Google Patents
Video data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN107872683B CN107872683B CN201711165150.8A CN201711165150A CN107872683B CN 107872683 B CN107872683 B CN 107872683B CN 201711165150 A CN201711165150 A CN 201711165150A CN 107872683 B CN107872683 B CN 107872683B
- Authority
- CN
- China
- Prior art keywords
- video data
- client
- original video
- clients
- original
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 13
- 238000000034 method Methods 0.000 claims abstract description 24
- 230000006835 compression Effects 0.000 claims description 20
- 238000007906 compression Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012163 sequencing technique Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video data processing method, a video data processing device, video data processing equipment and a storage medium. The method comprises the following steps: acquiring original video data of at least two clients and the resolution of the original video; compressing at least two original video data according to client information; the technical scheme of the invention can improve the user experience in the remote video conference under lower bandwidth.
Description
Technical Field
The present invention relates to an intelligent terminal technology, and in particular, to a method, an apparatus, a device, and a storage medium for processing video data.
Background
The remote video conference system is a multimedia communication technology which enables people in different places to realize real-time, visual and interactive through a certain transmission medium. It can distribute various information of static and dynamic images, voice, characters, pictures and the like of people to the terminal equipment of each user through various existing electric communication transmission media, so that geographically dispersed users can be copolymerized at one place, and the information is communicated through various modes such as graphics, sound and the like, thereby increasing the comprehension capability of the two parties on the content and enabling the people to be as if personally attending a conference in the same meeting place.
Due to the service characteristics of the remote video conference service, the requirement for network bandwidth is high, and the optimization point of most methods at present is to reduce the video code rate or reduce the video frame rate. Lowering the video rate and lowering the video frame rate inevitably leads to a degradation of the user experience, especially in the case of large screen sizes at both ends of the meeting.
Disclosure of Invention
The embodiment of the invention provides a video data processing method, a video data processing device, video data processing equipment and a storage medium, which can improve user experience in a remote video conference under a lower bandwidth.
In a first aspect, an embodiment of the present invention provides a video data processing method, including:
acquiring original video data of at least two clients and the resolution of the original video;
compressing at least two original video data according to client information;
and splicing at least two compressed original video data into target video data with the same resolution as the original video.
Further, before obtaining the original video data of at least two clients and the resolution of the original video, the method further includes:
when at least two clients establish video connection, client information is obtained;
receiving video data sent by at least two clients, and analyzing original video data from the video data.
Further, after splicing at least two compressed original video data into a target video data with the same resolution as the original video, the method further includes:
and sending the target video data to a client corresponding to each original video data.
Further, the client information includes: client video ordering rules, client IP, and port number.
Further, compressing the at least two original video data according to the client information includes:
and compressing at least two original video data by preset times according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, and the client video sorting sequence is matched with the compression times of the original data corresponding to the client.
In a second aspect, an embodiment of the present invention further provides a video data processing apparatus, where the apparatus includes:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring original video data of at least two clients and the resolution of an original video;
the compression module is used for compressing at least two original video data according to the client information;
and the splicing module is used for splicing at least two pieces of compressed original video data into target video data with the same resolution as the original video.
Further, the method also comprises the following steps:
the second acquisition module is used for acquiring client information when the video connection is established between at least two clients;
the analysis module is used for receiving the video data sent by at least two clients and analyzing the original video data from the video data.
Further, the method also comprises the following steps:
the sending module is used for sending the target video data to a client corresponding to each original video data after splicing at least two pieces of compressed original video data into one piece of target video data with the same resolution as the original video.
Further, the client information includes: client video ordering rules, client IP, and port number.
Further, the compression module is specifically configured to:
and compressing at least two original video data by preset times according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, and the client video sorting sequence is matched with the compression times of the original data corresponding to the client.
In a third aspect, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the video data processing method according to any one of the embodiments of the present invention when executing the computer program.
In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the video data processing method according to any one of the embodiments of the present invention.
According to the embodiment of the invention, the original video data of at least two clients and the resolution of the original video data are obtained, the resolution of the at least two original video data is compressed according to the client information, and the at least two compressed original video data are spliced into the target video data with the same resolution as the original video data, so that the user experience in the remote video conference can be improved under the condition of lower bandwidth.
Drawings
Fig. 1 is a flowchart of a video data processing method according to a first embodiment of the present invention;
fig. 2A is a flowchart of a video data processing method according to a second embodiment of the invention;
FIG. 2B is a schematic diagram of a video data processing flow according to a second embodiment of the present invention;
FIG. 2C is a schematic diagram of video splicing according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a video data processing apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device in the fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a video data processing method in a first embodiment of the present invention, where the present embodiment is applicable to a video data processing situation, the method may be executed by a video data processing apparatus in the first embodiment of the present invention, and the apparatus may be implemented in a software and/or hardware manner, as shown in fig. 1, the method specifically includes the following steps:
s110, acquiring original video data of at least two clients and the resolution of the original video.
The number of the clients is more than one, for example, four clients join in the same video.
Specifically, under the condition of transmitting the video data, operations such as compression, encryption and the like can be performed on the original video data, the received video data is the original video data subjected to the encryption and compression operations, if further processing operation needs to be performed on the video data, the obtained video data needs to be analyzed to obtain the original video data, and the next operation is performed on the basis of the original video data.
The original video data of the client specifically refers to pixels of each frame of image constituting the original video.
The resolution of the original video is a parameter for measuring the amount of data in an image, and conventionally, the resolution refers to the high/wide pixel value of the image, and the resolution in a strict sense refers to the effective pixel value in a unit length. For example: the resolution of 320 × 180 means that the number of effective pixels thereof in the horizontal and vertical directions is 320 and 180, respectively.
Specifically, when at least two clients perform videos, the original video data sent by the at least two clients and the resolution of the original video are obtained. For example, 4 clients join in a video conference, the 4 clients simultaneously transmit video data to the control device, the control device receives the video data transmitted by the 4 clients, processes the video data to obtain original video data, and simultaneously obtains the resolution of the original video.
And S120, compressing at least two original video data according to the client information.
The client information is information which is acquired by the server and is related to the client when at least two clients are added into the same video.
Wherein compressing the at least two original video data compresses pixels of each frame image constituting the at least two original videos. For example, two clients are added into a video, the two clients simultaneously send video data 1 and video data 2 to the control device, the video data 1 and the video data 2 are analyzed to obtain original video data 1 and original video data 2, and the original video data 1 and the original video data 2 are compressed.
Optionally, the client information includes: client video ordering rules, client IP, and port number.
The client video sorting rule may be sorted according to a preset priority, or may be sorted according to an operation instruction input by a user, and the client video sorting rule may change in real time according to an operation instruction input by a user, for example, if the operation instruction input by the user is that the client 1 is prior to the client 2, and the client 2 is prior to the client 3, the client is sorted according to an operation instruction input by the user as: client 1, client 2 and client 3. If the new operation instruction input by the user is that the client 3 has priority over the client 1, and the client 1 has priority over the client 2, the client is ranked as follows according to the operation instruction input by the user: client 3, client 1 and client 2.
Specifically, at least two original video data are compressed according to a client video sorting rule. For example, if the client ranks as: the client 1, the client 2 and the client 3 compress the original video data corresponding to the client 1 into the original 1/2, compress the original video data corresponding to the client 2 into the original 1/3 and compress the original video data corresponding to the client 3 into the original 1/6.
Optionally, compressing at least two original video data according to the client information includes:
and compressing at least two original video data by preset times according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, and the client video sorting sequence is matched with the compression times of the original data corresponding to the client.
The preset multiple is related to a client video sequencing rule, the priority of the client can be determined according to the client video sequencing rule, if the priority of the client is higher than that of other clients, the corresponding preset multiple is also larger than that of other clients, and correspondingly, if the priority of the client is lower than that of other clients, the corresponding preset multiple is also smaller than that of other clients.
Wherein the client video ordering rule is used to determine compression multiples of at least two original video data, for example, the client ordering is: the compression factor of the original video data corresponding to the client 3 is 1/2, the compression factor of the original video data corresponding to the client 1 is 1/3, and the compression factor of the original video data corresponding to the client 2 is 1/6, respectively, for the client 3, the client 1, and the client 2.
S130, splicing at least two compressed original video data into target video data with the same resolution as the original video.
The target video data is video data which is spliced by at least two compressed original video data and has the same resolution as the original video.
The method for splicing at least two compressed original video data into a target video data with the same resolution as the original video may be to compress at least two original video data respectively, and store the compressed original video data into a preset storage area, where the storage area is a block of memory area.
Specifically, at least two original video data are compressed into lower resolution, and the original video data of at least two clients are pieced together into a complete video data which conforms to the resolution of the original video.
In a specific example, the original video data corresponding to the client 1 is compressed to 1/2, the original video data corresponding to the client 2 is compressed to 1/3, the original video data corresponding to the client 3 is compressed to 1/6, the compressed original video data corresponding to the client 1, the compressed original video data corresponding to the client 2 and the compressed original video data corresponding to the client 3 are stored in a memory area, and the compressed original video data corresponding to the client 1, the compressed original video data corresponding to the client 2 and the compressed original video data corresponding to the client 3 can be pieced into a video data with a complete loaded original video resolution.
According to the technical scheme of the embodiment, the original video data of at least two clients and the resolution of the original video data are obtained, the resolution of the at least two original video data is compressed according to the client information, the at least two compressed original video data are spliced into the target video data with the same resolution as the original video data, and the user experience in the remote video conference can be improved under the lower bandwidth.
Example two
Fig. 2A is a flowchart of a video data processing method according to a second embodiment of the present invention, where the present embodiment is optimized based on the first embodiment, and before acquiring original video data of at least two clients and resolutions of the original video data, the present embodiment further includes: when at least two clients establish video connection, client information is obtained; receiving video data sent by at least two clients, and analyzing original video data from the video data.
As shown in fig. 2A, the method of this embodiment specifically includes the following steps:
s210, when the video connection is established between at least two clients, the client information is obtained.
The at least two clients establish video connection, so that the at least two clients join in the video, for example, the client 1, the client 2, and the client 3 join in a video conference.
Specifically, when the video connection is established between the at least two clients, the teleconference signaling server transmits the client information of the at least two clients to the control device.
S220, receiving the video data sent by at least two clients, and analyzing the original video data from the video data.
The video data sent by the client is the video data after being compressed and encrypted.
The original video data is the video data obtained after the video data sent by the client is decompressed and decoded. For example, the video data sent by the client is a compressed packet Q, and the original video data is the video data obtained by decompressing and decoding the compressed packet Q.
Specifically, video data sent by at least two clients are received, the video data are decompressed and decoded, and original video data are analyzed from the video data.
S230, acquiring original video data of at least two clients and resolution of the original video.
And S240, compressing at least two original video data according to the client information.
And S250, splicing at least two compressed original video data into target video data with the same resolution as the original video.
In one specific example, step one: and starting the video conference system central control equipment and the remote conference signaling server. Step two: a plurality of clients are added into the video conference, and the remote conference signaling server transmits the information of the clients (client video sequencing rules, client IP and port numbers) to the central control equipment of the video conference system. Step three: and the plurality of clients simultaneously send video data to the central control equipment of the video conference system. Step four: the video conference system central control equipment receives video data sent by a plurality of clients, analyzes the sent video data according to the client video arrangement rule, compresses the data into lower resolution, and splices the video data of the plurality of clients into complete video data which accords with the original video resolution. Step five: and sending the spliced video data to a corresponding client.
Optionally, after splicing at least two compressed original video data into a target video data with the same resolution as the original video, the method further includes:
and sending the target video data to a client corresponding to each original video data.
Specifically, at least two compressed original video data are spliced into target video data with the same resolution as the original video data, and the target video data are sent to at least two clients establishing video connection.
In another specific example, as shown in fig. 2B, the video conference system center control device is configured to process and forward video data transmitted from a plurality of clients. The client 1, the client 2, the client 3 and the client 4 are added into a video conference, the client 1, the client 2, the client 3 and the client 4 send video data to a video conference system central control device, the video conference system central control device decompresses and decodes the video data to obtain original video data, the original video data corresponding to the client 1, the client 2, the client 3 and the client 4 are compressed into low resolution, as shown in fig. 2B, the video 1, the video 2, the video 3 and the video 4 are video data obtained by compressing the original video data corresponding to the client 1, the client 2, the client 3 and the client 4 into low resolution, the video 1, the video 2, the video 3 and the video 4 are pieced into a complete video data with original video resolution, and an effect displayed on a display interface of a client screen is shown in fig. 2C, the videos of client 1, client 2, client 3, and client 4 are presented in the locations shown in fig. 2C.
In the embodiment of the invention, after the multi-channel video data is pieced together by the central control equipment unit of the video conference system, one channel of video data is output, thereby greatly reducing the transmission quantity of the video data.
According to the technical scheme of the embodiment, when the video connection is established between at least two clients, client information is obtained; the method comprises the steps of receiving video data sent by at least two clients, analyzing original video data from the video data, obtaining the original video data of the at least two clients and the resolution ratio of the original video data, compressing the resolution ratio of the at least two original video data according to client information, splicing the at least two compressed original video data into target video data with the same resolution ratio as the original video data, reducing the downlink channel bandwidth requirement and the uplink channel bandwidth requirement of the clients, and improving user experience in a remote video conference under lower bandwidth.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a video data processing apparatus according to a third embodiment of the present invention. The present embodiment may be applicable to the case of video data processing, and the apparatus may be implemented in software and/or hardware, and may be integrated in any device that provides a video data processing function, as shown in fig. 3, where the video data processing apparatus specifically includes: a first acquisition module 310, a compression module 320, and a stitching module 330.
The first obtaining module 310 is configured to obtain original video data of at least two clients and a resolution of an original video;
a compression module 320, configured to compress at least two original video data according to client information;
and the splicing module 330 is configured to splice at least two compressed original video data into one target video data with the same resolution as the original video.
Optionally, the method further includes:
the second acquisition module is used for acquiring client information when the video connection is established between at least two clients;
the analysis module is used for receiving the video data sent by at least two clients and analyzing the original video data from the video data.
Optionally, the method further includes:
the sending module is used for sending the target video data to a client corresponding to each original video data after splicing at least two pieces of compressed original video data into one piece of target video data with the same resolution as the original video.
Optionally, the client information includes: client video ordering rules, client IP, and port number.
Optionally, the compressing module 320 is specifically configured to:
and compressing at least two original video data by preset times according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, and the client video sorting sequence is matched with the compression times of the original data corresponding to the client.
According to the technical scheme of the embodiment, the original video data of at least two clients and the resolution of the original video data are obtained, the resolution of the at least two original video data is compressed according to the client information, the at least two compressed original video data are spliced into the target video data with the same resolution as the original video data, and the user experience in the remote video conference can be improved under the lower bandwidth.
Example four
Fig. 4 is a schematic structural diagram of a computer device in the fourth embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in FIG. 4 is only one example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention.
As shown in FIG. 4, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least two program products having a set (e.g., at least two) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least two) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, implementing a video data processing method provided by an embodiment of the present invention: acquiring original video data of at least two clients and the resolution of the original video; compressing at least two original video data according to client information; and splicing at least two compressed original video data into target video data with the same resolution as the original video.
EXAMPLE five
Fifth embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the video data processing method provided in all the embodiments of the present invention: acquiring original video data of at least two clients and the resolution of the original video; compressing at least two original video data according to client information; and splicing at least two compressed original video data into target video data with the same resolution as the original video.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method of processing video data, comprising:
acquiring original video data of at least two clients and the resolution of the original video;
compressing at least two original video data according to client information, wherein the client information comprises a client video sequencing rule;
splicing at least two compressed original video data into target video data with the same resolution as the original video;
the compressing of the at least two original video data according to the client information includes:
and compressing at least two original video data by preset multiples according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, the client video sorting sequence is matched with the compression multiples of the original data corresponding to the client, the client video sorting rule is used for determining the priority of the client and determining the compression multiples of at least two original video data, if the priority of the client is higher than that of other clients, the corresponding preset multiples are greater than that of other clients, and correspondingly, if the priority of the client is lower than that of other clients, the corresponding preset multiples are less than that of other clients.
2. The method of claim 1, wherein prior to obtaining the original video data and the resolution of the original video for the at least two clients, further comprising:
when at least two clients establish video connection, client information is obtained;
receiving video data sent by at least two clients, and analyzing original video data from the video data.
3. The method of claim 1, further comprising, after splicing at least two compressed original video data into a target video data having a resolution equal to the original video resolution:
and sending the target video data to a client corresponding to each original video data.
4. The method of claim 1, wherein the client information comprises: client IP and port number.
5. A video data processing apparatus, comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring original video data of at least two clients and the resolution of an original video;
the compression module is used for compressing at least two original video data according to client information, wherein the client information comprises a client video sequencing rule;
the splicing module is used for splicing at least two pieces of compressed original video data into target video data with the same resolution as the original video;
the compression module is specifically configured to:
and compressing at least two original video data by preset multiples according to the client video sorting rule, wherein the client video sorting rule comprises a client video sorting sequence, the client video sorting sequence is matched with the compression multiples of the original data corresponding to the client, the client video sorting rule is used for determining the priority of the client and determining the compression multiples of at least two original video data, if the priority of the client is higher than that of other clients, the corresponding preset multiples are greater than that of other clients, and correspondingly, if the priority of the client is lower than that of other clients, the corresponding preset multiples are less than that of other clients.
6. The apparatus of claim 5, further comprising:
the second acquisition module is used for acquiring client information when the video connection is established between at least two clients;
the analysis module is used for receiving the video data sent by at least two clients and analyzing the original video data from the video data.
7. The apparatus of claim 5, further comprising:
the sending module is used for sending the target video data to a client corresponding to each original video data after splicing at least two pieces of compressed original video data into one piece of target video data with the same resolution as the original video.
8. The apparatus of claim 5, wherein the client information comprises: client IP and port number.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1-4 when executing the program.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711165150.8A CN107872683B (en) | 2017-11-21 | 2017-11-21 | Video data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711165150.8A CN107872683B (en) | 2017-11-21 | 2017-11-21 | Video data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107872683A CN107872683A (en) | 2018-04-03 |
| CN107872683B true CN107872683B (en) | 2021-04-20 |
Family
ID=61754358
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711165150.8A Active CN107872683B (en) | 2017-11-21 | 2017-11-21 | Video data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107872683B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111787269B (en) * | 2020-07-20 | 2021-10-26 | 南京百家云科技有限公司 | Multimedia information generation method and device, electronic equipment and storage medium |
| CN114547030B (en) * | 2022-01-20 | 2023-03-24 | 清华大学 | Multi-stage time sequence data compression method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101383951A (en) * | 2008-09-25 | 2009-03-11 | 杭州爱威芯科技有限公司 | Picture splitting device |
| CN102025973A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Video synthesizing method and video synthesizing system |
| CN103581609A (en) * | 2012-07-23 | 2014-02-12 | 中兴通讯股份有限公司 | Video processing method, device and system |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
| CN104822038A (en) * | 2015-04-30 | 2015-08-05 | 广州瀚唐电子科技有限公司 | Recording and broadcasting system and picture switching method thereof |
| WO2016147538A1 (en) * | 2015-03-17 | 2016-09-22 | パナソニックＩｐマネジメント株式会社 | Videoconference communication device |
| CN107333062A (en) * | 2017-07-05 | 2017-11-07 | 浙江华创视讯科技有限公司 | A kind of method, system and device of Computer Vision |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7113200B2 (en) * | 2004-05-21 | 2006-09-26 | Polycom, Inc. | Method and system for preparing video communication image for wide screen display |
| US7830409B2 (en) * | 2005-03-25 | 2010-11-09 | Cherng-Daw Hwang | Split screen video in a multimedia communication system |
| CN103051865B (en) * | 2012-12-28 | 2016-03-30 | 华为技术有限公司 | The method that picture controls and terminal, video conference device |
| CN103945208B (en) * | 2014-04-24 | 2015-10-28 | 西安交通大学 | A kind of parallel synchronous zooming engine for multiple views bore hole 3D display and method |
| CN104185033B (en) * | 2014-08-08 | 2018-05-29 | 天津三星电子有限公司 | A kind of processing method of multiple frames of television, apparatus and system |
| CN106713964A (en) * | 2016-12-05 | 2017-05-24 | 乐视控股（北京）有限公司 | Method of generating video abstract viewpoint graph and apparatus thereof |
-
2017
- 2017-11-21 CN CN201711165150.8A patent/CN107872683B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101383951A (en) * | 2008-09-25 | 2009-03-11 | 杭州爱威芯科技有限公司 | Picture splitting device |
| CN102025973A (en) * | 2010-12-17 | 2011-04-20 | 广东威创视讯科技股份有限公司 | Video synthesizing method and video synthesizing system |
| CN103581609A (en) * | 2012-07-23 | 2014-02-12 | 中兴通讯股份有限公司 | Video processing method, device and system |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
| WO2016147538A1 (en) * | 2015-03-17 | 2016-09-22 | パナソニックＩｐマネジメント株式会社 | Videoconference communication device |
| CN104822038A (en) * | 2015-04-30 | 2015-08-05 | 广州瀚唐电子科技有限公司 | Recording and broadcasting system and picture switching method thereof |
| CN107333062A (en) * | 2017-07-05 | 2017-11-07 | 浙江华创视讯科技有限公司 | A kind of method, system and device of Computer Vision |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107872683A (en) | 2018-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240045641A1 (en) | Screen sharing display method and apparatus, device, and storage medium | |
| WO2018024231A1 (en) | Method and apparatus for interconnecting spliced wall and mobile intelligent terminal | |
| CN110290398B (en) | Video issuing method and device, storage medium and electronic equipment | |
| CN112291502B (en) | Information interaction method, device and system and electronic equipment | |
| CN105874807B (en) | Methods, systems, and media for remote rendering of Web content on a television device | |
| CN110263276B (en) | Message distribution method, device, equipment and storage medium | |
| CN112532998B (en) | Method, device and equipment for extracting video frame and readable storage medium | |
| CN111343503B (en) | Video transcoding method and device, electronic equipment and storage medium | |
| CN107872683B (en) | Video data processing method, device, equipment and storage medium | |
| CN109547839A (en) | The dynamic previewing processing method and processing device of live content, medium, electronic equipment | |
| CN115767181A (en) | Live video stream rendering method, device, equipment, storage medium and product | |
| US8736622B2 (en) | System and method of leveraging GPU resources to enhance performance of an interact-able content browsing service | |
| CN112468763B (en) | Video transmission and display method, device and equipment for conference television and storage medium | |
| CN113259729B (en) | Data switching method, server, system and storage medium | |
| CN116248889A (en) | Image encoding and decoding method and device and electronic equipment | |
| WO2020011066A1 (en) | Terminal display method and device, terminal and readable medium | |
| CN114760309A (en) | Business interaction method, device, equipment and medium of terminal based on cloud service | |
| US20170039985A1 (en) | System and method of leveraging gpu resources to increase performance of an interact-able content browsing service | |
| EP3229478B1 (en) | Cloud streaming service system, image cloud streaming service method using application code, and device therefor | |
| CN110809166B (en) | Video data processing method and device and electronic equipment | |
| CN113573004A (en) | Video conference processing method and device, computer equipment and storage medium | |
| CN112612435A (en) | Information processing method, device, equipment and storage medium | |
| CN110365929B (en) | Information transmission method, device, equipment, system and storage medium | |
| CN105812922A (en) | Multimedia file data processing method, system, player and client | |
| CN113067997B (en) | Method and device for real-time video call |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |