CN117119264B - Video data processing system and method - Google Patents
Video data processing system and method Download PDFInfo
- Publication number
- CN117119264B CN117119264B CN202311349043.6A CN202311349043A CN117119264B CN 117119264 B CN117119264 B CN 117119264B CN 202311349043 A CN202311349043 A CN 202311349043A CN 117119264 B CN117119264 B CN 117119264B
- Authority
- CN
- China
- Prior art keywords
- control instruction
- rendering
- cloud server
- video data
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 111
- 238000000034 method Methods 0.000 title claims description 26
- 238000009877 rendering Methods 0.000 claims abstract description 114
- 230000011664 signaling Effects 0.000 claims abstract description 41
- 230000007704 transition Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 6
- 238000003672 processing method Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 244000007853 Sarothamnus scoparius Species 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000010408 sweeping Methods 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a video data processing system and a video data processing method, and relates to the technical field of multicast data processing. One embodiment of the video processing system includes: a control command corresponding to the video processing task is sent to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording a control instruction sent by a control end through a signaling service center, and rendering a video data by a cloud server according to the control instruction; and sending a new control instruction to the cloud server by the control terminal according to the control instruction recorded by the signaling service center and the rendering processing result. According to the embodiment, the control terminal enables the guide service to be in seamless connection after reconnection is disconnected, and the quality of the guide service is improved.
Description
Technical Field
The present invention relates to the field of multicast data processing technologies, and in particular, to a video data processing system and method.
Background
Currently, the rendering processing of video data by the lead-broadcast system is realized by a control end remotely controlling a processing end. Because the control end network or software and hardware faults and the like or the control end is manually exited, the control end is always disconnected with the processing end, the state of video data displayed by the control end is kept in the disconnected state after the disconnection, and the processing end continues to process the video data, so that after the fault is recovered, the states of the video data of the control end and the processing end are asynchronous, the control end cannot determine the processing progress of the current processing end, and the control end can only continue to conduct the guide control by experience, so that the guide service has poor connection degree and the quality of the guide service is influenced.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a video data processing system and method, where video data corresponding to a video processing task is collected by the video device; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result. Therefore, after reconnection is disconnected, the control end can accurately determine the progress of video data processing of the cloud server according to the recorded control instruction and rendering processing results, and the multicast control is continuously carried out according to the processing progress, so that the multicast service before and after disconnection is seamlessly connected, and the quality of the multicast service is improved.
A video data processing system according to an embodiment of the present invention includes: the system comprises video equipment, a signaling service center, a control end and a cloud server, wherein the video equipment is used for acquiring video data corresponding to a video processing task; the control end is used for sending a control instruction corresponding to the video processing task to the cloud server; the cloud server is used for rendering the video data according to the control instruction; the signaling service center is used for recording the control instruction sent by the control end and rendering processing results of the cloud server on the video data according to the control instruction; the control end is further configured to send a new control instruction to the cloud server according to the control instruction recorded by the signaling service center and the rendering result.
Optionally, the signaling service center is further configured to record a control instruction group including a plurality of control instructions and an execution start time corresponding to the control instruction group; the control end is further configured to read the control instruction set and the execution start time, calculate a current progress of the cloud server on the video data to execute the control instruction set according to the control instruction set and the execution start time, and send a new control instruction to the cloud server according to the current progress.
Optionally, the control end is further configured to read the control instruction and the rendering result recorded by the signaling service center, determine a current state of the video data according to the control instruction and the rendering result, and send a new control instruction to the cloud server according to the current state.
Optionally, the system further comprises a data pool, wherein the control instruction indicates a time node corresponding to the video data, and the data pool is used for storing the video data acquired by the video equipment; and the cloud server is further used for acquiring the video data after the time node from the data pool according to the control instruction.
Optionally, the video processing tasks are multiple, the control instruction further indicates the same video source corresponding to the video processing task, and the cloud server is further configured to obtain target data corresponding to the video source from the data pool according to the control instruction, and render the target data respectively.
Optionally, the control instruction indicates a rendering processing type and corresponding rendering parameters, the cloud server includes a plurality of rendering services, and the cloud server is further configured to determine a corresponding target rendering service from the plurality of rendering services according to the rendering processing type; and carrying out corresponding rendering processing on the video data according to the target rendering service and the rendering parameters.
Optionally, the rendering service is a containerized application deployed in the cloud server.
Optionally, the rendering service comprises a broom, a transition and a graphic packaging.
Optionally, the system further includes a target platform, wherein the data pool is further configured to store processed video data and provide the processed video data to the target platform.
To achieve the above object, according to one aspect of an embodiment of the present invention, there is provided a video data processing method.
The video data processing method of the embodiment of the invention comprises the following steps: collecting video data corresponding to a video processing task through the video equipment; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a server.
The server of the embodiment of the invention comprises: one or more processors; and the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are enabled to realize the video data processing method of the embodiment of the invention.
To achieve the above object, according to still another aspect of the embodiments of the present invention, there is provided a computer-readable storage medium.
A computer-readable storage medium of an embodiment of the present invention has stored thereon a computer program which, when executed by a processor, implements a video data processing method of an embodiment of the present invention.
One embodiment of the above invention has the following advantages or benefits: collecting video data corresponding to a video processing task through the video equipment; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result. Therefore, after reconnection is disconnected, the control end can accurately determine the progress of video data processing of the cloud server according to the recorded control instruction and rendering processing results, and the multicast control is continuously carried out according to the processing progress, so that the multicast service before and after disconnection is seamlessly connected, and the quality of the multicast service is improved.
Further effects of the above-described non-conventional alternatives are described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic diagram of the main modules of a video data processing system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the main modules of a video data processing system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the main modules of a video data processing system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the main steps of a video data processing method according to an embodiment of the present invention;
FIG. 5 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;
fig. 6 is a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments of the present invention and the technical features in the embodiments may be combined with each other without collision.
Fig. 1 is a schematic diagram of the main modules of a video data processing system 100 according to an embodiment of the present invention.
As shown in fig. 1, a video data processing system 100 of an embodiment of the present invention includes: video device 101, signaling service center 102, control terminal 103, and cloud server 104, wherein,
the video device 101 is configured to collect video data corresponding to a video processing task;
the control end 103 is configured to send a control instruction corresponding to the video processing task to the cloud server 104;
the cloud server 104 is configured to perform rendering processing on the video data according to the control instruction;
the signaling service center 102 is configured to record the control instruction sent by the control end 103 and a rendering result of the video data by the cloud server 104 according to the control instruction;
the control end 103 is further configured to send a new control instruction to the cloud server 104 according to the control instruction and the rendering result recorded by the signaling service center 102.
The video data processing system 100 provided by the embodiment of the invention can be applied to a video streaming service, wherein video processing tasks are streaming tasks. In order to implement the flexible expansion of the guided computing power, in an alternative embodiment of the present invention, the rendering service is a containerized application deployed in the cloud server 104, specifically, the rendering service, such as the scan, the transition, and the graphic packaging, is packaged as a mirror image, and is flexibly deployed in a containerized environment.
The picture scanning is to sequentially render a group of picture frames from different video sources into a video signal by using a JavaScript script, and the video source switching is realized in the process, and the specific realization method is as follows: and converting the sequence arrangement of the picture frames into a snowplow map, uploading the snowplow map material to a rendering service, and recording the number of the picture frames and the switching speed, wherein the size proportion of the picture frames is consistent with the size proportion of the video pictures presented later.
The transition refers to using JavaScript script to control the picture of each video source in the canvas container to move or deform according to action logic designed by the script, and the concrete implementation method is as follows: assuming that the current video source is A, the video source to be faded out and the video source to be faded in is B; gradually modifying the coordinates of the picture of A in the container to gradually move the picture of A out of the container, and gradually reducing the transparency of the picture of A to gradually make the picture of A gradually transparent; the picture of B is started to be outside the boundary of the container, the transparency of the picture of B is gradually improved, the coordinates of the picture of B are gradually modified, and the picture of B gradually enters the container and is gradually displayed; finally, the picture of B occupies the container main body, and the picture of A fades out of view.
The image-text packaging refers to that an image-text layer which can be dynamically rendered according to data is overlapped on an original video image layer by using a JavaScript script, and the specific implementation method (taking a score card as an example) comprises the following steps: designing a score board H5 template, and dynamically modifying data on the template by using a JavaScript script; displaying a score board, drawing a score board H5 template into a canvas container, and stacking images and texts on a video picture layer; the score data is modified, the script obtains the modified data, and score information in the template is modified; the template score information is changed, and the picture in the canvas container is synchronously modified; and the score-dividing picture is synchronously output along with PGM.
In an alternative embodiment of the present invention, the control end 103 sends a control instruction to the cloud server 104 according to a requirement of a video processing task, where the control instruction indicates a rendering processing type, such as transition, and a corresponding rendering parameter, such as transition from a video source a to a video source B, and the cloud server 104 includes a plurality of rendering services, such as a broom, a transition, and a graphics context wrapper, and the cloud server 104 is further configured to determine a corresponding target rendering service, that is, a transition service, from the plurality of rendering services according to the rendering processing type; and performing corresponding rendering processing on the video data according to the target rendering service and the rendering parameters, namely converting the video acquired by the video picture from the video source A to the video acquired by the video source B. Wherein the video device may be one or more video sources that collect video data and generate a video stream, different video sources corresponding to different video devices.
In an optional embodiment of the present invention, the control end 103 is remotely connected to the cloud server 104 through a network, and because the network failure or the software and hardware failures of the control end 103 can cause disconnection of the control end 103, or the control end is manually closed to disconnect the control end and the cloud server, in order to achieve seamless connection of the multicast service after disconnection, the video data processing system 100 in the embodiment of the present invention adopts the signaling service center 102 to record the control instruction sent by the control end 103 to the cloud server 104, and record the rendering processing result of the cloud server 104 on the video data; the control end 103 reads the control instruction recorded by the signaling service center 102 and the corresponding rendering result after reconnection is disconnected, determines the current state of video data rendering according to the control instruction and the corresponding rendering result, and sends a new control instruction to the cloud server 104 according to the current state of video rendering so as to continue the multicast control, thereby realizing seamless connection before and after disconnection of the multicast service.
In an alternative embodiment of the present invention, the signaling service center 102 is further configured to record a control instruction set including a plurality of control instructions and an execution start time corresponding to the control instruction set; the control end 103 is further configured to read the control instruction set and the execution start time, calculate a current progress of the cloud server 104 on executing the control instruction set on the video data according to the control instruction set and the execution start time, and send a new control instruction to the cloud server 104 according to the current progress.
The control end 103 may send a control instruction set corresponding to a single rendering service, and start time for executing the control instruction set, in addition to send a control instruction corresponding to a single rendering service to the cloud server 104, calculate, according to execution time and the start time corresponding to each rendering service, a current progress of execution of the control instruction set, determine, according to the current progress, a current state of video data, and continue to perform multicast control according to the current state, thereby implementing multicast control for seamless connection after disconnection and reconnection of the control end 103 according to control instructions in different forms recorded by the signaling service center 102.
Taking a video live broadcast scene as an example, a standby broadcast link exists before the formal live broadcast, the streaming guiding system also needs to be connected to the standby broadcast link, and the streaming guiding is not needed in the standby broadcast link, so that the streaming guiding control is not needed to be carried out at the moment, but if the streaming is pulled again when the formal live broadcast starts, a buffer time is needed to pull the video, which can lead to a blank picture which lasts for about the buffer time after the formal live broadcast starts, so that a video buffer area can be arranged, video data can be buffered to the video buffer area in advance, and the streaming guiding control is directly carried out from the video buffer area at the corresponding moment when the formal live broadcast starts. Thus, in an alternative embodiment of the present invention, the video data processing system 100 further includes a data pool 105, as shown in fig. 2, where the control instruction indicates a time node corresponding to the video data, and the data pool 105 is configured to store the video data collected by the video device 101; the cloud server 104 is further configured to obtain, according to the control instruction, video data after the time node from the data pool 105. The time node refers to a time point when the pilot control starts, that is, the video data after the time node is acquired and the pilot control is performed on the video data.
Yet another scenario in the multicast service is: the same guiding system serves a plurality of guiding tasks, task 1 and task 2, and the video sources corresponding to task 1 and task 2 have overlapping parts, such as task 1 corresponds to video source a, video source B and video source C, task 2 corresponds to video source B, video source C and video source D, the meaning of the data pool 105 is that the same video source corresponding to a plurality of guiding tasks (i.e. video sources B and C) can be pulled only once, video data generated by the same video source are cached in the data pool 105, when the same video source data is needed by the guiding tasks, the corresponding video data is directly obtained from the data pool 105, repeated pulling of the same video source is not needed by the guiding tasks, so that network load is reduced, and guiding service anomalies caused by overhigh network load are further reduced. Therefore, in an alternative embodiment of the present invention, the video processing tasks are multiple, the control instruction further indicates the same video source corresponding to the video processing task, and the cloud server 104 is further configured to obtain, according to the control instruction, target data corresponding to the video source from the data pool 105, and perform rendering processing on the target data respectively. According to the embodiment, the video data of the same video source can be pulled once, so that the video data can be used for guiding and broadcasting control of a plurality of guiding and broadcasting tasks, for example, task 1 performs image-text packaging on the video data of the video source B acquired from the data pool 105, and task 2 performs transition or picture sweeping on the video data of the video source B acquired from the data pool 105.
In an alternative embodiment of the present invention, the video data processing system 100 further includes a target platform 106, as shown in fig. 3, where the data pool 105 is further configured to store processed video data and provide the processed video data to the target platform 106. The target platform 106 may include one or more target platforms, that is, the video stream generated by the primary multicast is pushed to multiple platforms for the second time by buffering the video stream in the data pool 105, which greatly improves the efficiency of video data processing, i.e., multicast control.
According to the video data processing system provided by the embodiment of the invention, the video equipment is used for collecting video data corresponding to the video processing task; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result. Therefore, after reconnection is disconnected, the control end can accurately determine the progress of video data processing of the cloud server according to the recorded control instruction and rendering processing results, and the multicast control is continuously carried out according to the processing progress, so that the multicast service before and after disconnection is seamlessly connected, and the quality of the multicast service is improved.
Fig. 4 is a schematic diagram of main steps of a video data processing method according to an embodiment of the present invention.
As shown in fig. 4, the video data processing method according to the embodiment of the present invention includes: steps S401 to S405:
step S401: collecting video data corresponding to a video processing task through the video equipment 101;
step S402: sending a control instruction corresponding to the video processing task to the cloud server 104 through the control end 103;
step S403: rendering the video data by the cloud server 104 according to the control instruction;
step S404: recording the control instruction sent by the control end 103 and a rendering processing result of the cloud server 104 on the video data according to the control instruction by the signaling service center 102;
step S405: and sending a new control instruction to the cloud server 104 by the control end 103 according to the control instruction and the rendering result recorded by the signaling service center 102.
In an alternative embodiment of the present invention, the method further comprises: recording, by the signaling service center 102, a control instruction group including a plurality of control instructions, and an execution start time corresponding to the control instruction group;
the control end 103 is further configured to read the control instruction set and the execution start time, calculate a current progress of the cloud server 104 on executing the control instruction set on the video data according to the control instruction set and the execution start time, and send a new control instruction to the cloud server 104 according to the current progress.
In an alternative embodiment of the present invention, the method further comprises: the control end 103 is further configured to read the control instruction and the rendering result recorded by the signaling service center 102, determine a current state of the video data according to the control instruction and the rendering result, and send a new control instruction to the cloud server 104 according to the current state.
In an alternative embodiment of the present invention, the control instruction indicates a time node corresponding to the video data, and the method further includes: storing the video data acquired by the video device 101 by the data pool 105;
and acquiring the video data after the time node from the data pool 105 by the cloud server 104 according to the control instruction.
In an alternative embodiment of the present invention, the video processing task is multiple, the control instruction further indicates the same video source corresponding to the video processing task,
the method further comprises the steps of: and acquiring target data corresponding to the video source from the data pool 105 through the cloud server 104 according to the control instruction, and respectively rendering the target data.
In an alternative embodiment of the present invention, the control instructions indicate a rendering process type and corresponding rendering parameters, the cloud server 104 includes a plurality of rendering services,
the method further comprises the steps of: determining, by the cloud server 104, a corresponding target rendering service from the plurality of rendering services according to the rendering processing type; and carrying out corresponding rendering processing on the video data according to the target rendering service and the rendering parameters.
In an alternative embodiment of the invention, the rendering service is a containerized application deployed in the cloud server 104.
In an alternative embodiment of the invention, the rendering services include swipe, transition, and graphics packaging.
In an alternative embodiment of the present invention, the method further comprises: processed video data is stored by the data pool 105 and provided to the target platform 106.
According to the video data processing method, the video equipment is used for collecting video data corresponding to a video processing task; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result. Therefore, after reconnection is disconnected, the control end can accurately determine the progress of video data processing of the cloud server according to the recorded control instruction and rendering processing results, and the multicast control is continuously carried out according to the processing progress, so that the multicast service before and after disconnection is seamlessly connected, and the quality of the multicast service is improved.
Fig. 5 illustrates an exemplary system architecture 500 to which a video data processing system or video data processing method of an embodiment of the invention may be applied.
As shown in fig. 5, the system architecture 500 may include video devices 501, 502, 503, networks 504, 506, a cloud server 505, and control side devices 507, 508, 509. The networks 504, 506 are media used to provide communication links between the video devices 501, 502, 503, the cloud server 505 and the control side devices 507, 508, 509. The networks 504, 506 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The video devices 501, 502, 503, the control side devices 507, 508, 509 interact with the cloud server 505 through the networks 504, 506 to receive or send messages, etc. The video devices 501, 502, 503 are electronic devices that collect video data, the cloud server 505 acquires video data from the video devices 501, 502, 503, receives control instructions from the control end devices 507, 508, 509, and performs rendering processing on the video data acquired from the video devices 501, 502, 503 according to the control instructions.
The cloud server 505 may be a server that provides various services, such as a background management server where the cloud server 505 provides support for rendering video data acquired from the video devices 501, 502, 503. The background management server can analyze the acquired video data according to the control instruction, and the like, such as transition, picture sweeping, picture-text packaging and the like.
It should be noted that, the video data processing method provided by the embodiment of the present invention is generally executed by the cloud server 505, and accordingly, the video data processing system includes the cloud server 505.
It should be understood that the number of terminal devices, networks and servers in fig. 5 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 6, there is illustrated a schematic diagram of a computer system 600 suitable for use in implementing an embodiment of the present invention. The terminal device shown in fig. 6 is only an example, and should not impose any limitation on the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 6, the computer system 600 includes a Central Processing Unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, mouse, etc.; an output portion 607 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The drive 610 is also connected to the I/O interface 605 as needed. Removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on drive 610 so that a computer program read therefrom is installed as needed into storage section 608.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and/or installed from the removable medium 611. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 601.
The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor, for example, as: a processor includes a data acquisition module, a control module, a signaling synchronization module, and a rendering module. The names of these modules do not constitute a limitation on the module itself in some cases, and for example, a rendering module may also be described as "a module that performs rendering processing of the video data according to the control instruction".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include: collecting video data corresponding to a video processing task through the video equipment; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result.
According to the technical scheme of the embodiment of the invention, the video equipment is used for collecting video data corresponding to the video processing task; sending a control instruction corresponding to the video processing task to the cloud server through the control end; rendering the video data through the cloud server according to the control instruction; recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through the signaling service center; and sending a new control instruction to the cloud server through the control end according to the control instruction recorded by the signaling service center and the rendering result. Therefore, after reconnection is disconnected, the control end can accurately determine the progress of video data processing of the cloud server according to the recorded control instruction and rendering processing results, and the multicast control is continuously carried out according to the processing progress, so that the multicast service before and after disconnection is seamlessly connected, and the quality of the multicast service is improved.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. A video data processing system, comprising: video equipment, a signaling service center, a control end and a cloud server, wherein,
the video equipment is used for acquiring video data corresponding to the video processing task;
the control end is used for sending a control instruction corresponding to the video processing task to the cloud server;
the cloud server is used for rendering the video data according to the control instruction;
the signaling service center is used for recording the control instruction sent by the control end and rendering processing results of the cloud server on the video data according to the control instruction;
the control end is further used for sending a new control instruction to the cloud server according to the control instruction recorded by the signaling service center and the rendering result; the method is specifically used for reading the control instruction and the rendering result recorded by the signaling service center, determining the current state of the video data according to the control instruction and the rendering result, and sending a new control instruction to the cloud server according to the current state.
2. The system of claim 1, wherein the system further comprises a controller configured to control the controller,
the signaling service center is further used for recording a control instruction group comprising a plurality of control instructions and execution starting time corresponding to the control instruction group;
the control end is further configured to read the control instruction set and the execution start time, calculate a current progress of the cloud server on the video data to execute the control instruction set according to the control instruction set and the execution start time, and send a new control instruction to the cloud server according to the current progress.
3. The system of claim 1, further comprising a data pool, wherein the control instructions indicate a time node to which the video data corresponds,
the data pool is used for storing the video data acquired by the video equipment;
and the cloud server is further used for acquiring the video data after the time node from the data pool according to the control instruction.
4. The system of claim 3, wherein the video processing tasks are plural, the control instructions further indicate the same video source to which the video processing tasks correspond,
and the cloud server is further used for acquiring target data corresponding to the video source from the data pool according to the control instruction and respectively rendering the target data.
5. The system of claim 1, wherein the control instructions indicate a rendering process type and corresponding rendering parameters, wherein the cloud server comprises a plurality of rendering services,
the cloud server is further used for determining a corresponding target rendering service from the plurality of rendering services according to the rendering processing type; and carrying out corresponding rendering processing on the video data according to the target rendering service and the rendering parameters.
6. The system of claim 5, wherein the system further comprises a controller configured to control the controller,
the rendering service is a containerized application deployed in the cloud server;
and/or the number of the groups of groups,
the rendering service comprises picture scanning, transition and picture and text packaging.
7. The system of claim 1, further comprising a target platform, wherein,
and the data pool is also used for storing the processed video data and providing the processed video data for the target platform.
8. A method of video data processing, comprising:
collecting video data corresponding to a video processing task through video equipment;
a control command corresponding to the video processing task is sent to a cloud server through a control end;
rendering the video data through the cloud server according to the control instruction;
recording the control instruction sent by the control end and a rendering processing result of the cloud server on the video data according to the control instruction through a signaling service center;
sending a new control instruction to the cloud server through the control end according to the control instruction and the rendering result recorded by the signaling service center; the method comprises the steps of reading the control instruction and the rendering result recorded by the signaling service center, determining the current state of the video data according to the control instruction and the rendering result, and sending a new control instruction to the cloud server according to the current state.
9. A server, comprising:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of claim 8.
10. A computer readable medium on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311349043.6A CN117119264B (en) | 2023-10-18 | 2023-10-18 | Video data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311349043.6A CN117119264B (en) | 2023-10-18 | 2023-10-18 | Video data processing system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117119264A CN117119264A (en) | 2023-11-24 |
| CN117119264B true CN117119264B (en) | 2024-01-26 |
Family
ID=88796796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311349043.6A Active CN117119264B (en) | 2023-10-18 | 2023-10-18 | Video data processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117119264B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113453073A (en) * | 2021-06-29 | 2021-09-28 | 北京百度网讯科技有限公司 | Image rendering method and device, electronic equipment and storage medium |
| WO2022127890A1 (en) * | 2020-12-18 | 2022-06-23 | 华为云计算技术有限公司 | Rendering method based on cloud service, and related device therefor |
| CN114979688A (en) * | 2022-05-11 | 2022-08-30 | 北京大甜绵白糖科技有限公司 | Live broadcast data transmission system, method and device |
| CN116233488A (en) * | 2023-03-13 | 2023-06-06 | 深圳市元数边界文化有限公司 | Real-time rendering and screen throwing synthetic system for virtual live broadcast |
| CN116233209A (en) * | 2023-02-06 | 2023-06-06 | 深圳市赋风科技有限公司 | Remote management scheduling method for GPU cloud rendering service |
-
2023
- 2023-10-18 CN CN202311349043.6A patent/CN117119264B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022127890A1 (en) * | 2020-12-18 | 2022-06-23 | 华为云计算技术有限公司 | Rendering method based on cloud service, and related device therefor |
| CN113453073A (en) * | 2021-06-29 | 2021-09-28 | 北京百度网讯科技有限公司 | Image rendering method and device, electronic equipment and storage medium |
| CN114979688A (en) * | 2022-05-11 | 2022-08-30 | 北京大甜绵白糖科技有限公司 | Live broadcast data transmission system, method and device |
| CN116233209A (en) * | 2023-02-06 | 2023-06-06 | 深圳市赋风科技有限公司 | Remote management scheduling method for GPU cloud rendering service |
| CN116233488A (en) * | 2023-03-13 | 2023-06-06 | 深圳市元数边界文化有限公司 | Real-time rendering and screen throwing synthetic system for virtual live broadcast |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117119264A (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109600666B (en) | Video playing method, device, medium and electronic equipment in game scene | |
| CN111541913B (en) | Video playing method and device of spliced screen, computer equipment and medium | |
| CN108965907B (en) | Method, device and system for playing video | |
| CN108282677A (en) | Realize that content throws method, throwing screen device and the system of screen by client | |
| CN104954150B (en) | A kind of multi-screen interaction method and device | |
| CN111723558A (en) | Document display method and device, electronic equipment and storage medium | |
| CN110290398B (en) | Video issuing method and device, storage medium and electronic equipment | |
| CN110489193A (en) | Interface control method, device and the storage medium of smart machine | |
| US11893054B2 (en) | Multimedia information processing method, apparatus, electronic device, and medium | |
| CN113590878B (en) | Method, device and terminal equipment for planning path on video picture | |
| CN110134300A (en) | Picture editing method and device | |
| CN114077508A (en) | Remote image rendering method and device, electronic equipment and medium | |
| CN112714282A (en) | Image processing method, apparatus, device and program product in remote control | |
| CN117119264B (en) | Video data processing system and method | |
| CN109698850B (en) | Processing method and system | |
| US11195248B2 (en) | Method and apparatus for processing pixel data of a video frame | |
| CN108933769B (en) | Streaming media screenshot system, method and device | |
| CN113411669A (en) | Video special effect processing method and device | |
| CN112446936A (en) | Image processing method and device | |
| CN112949252B (en) | Text display method, apparatus and computer readable medium | |
| TWI812003B (en) | Method and system for previewing the image | |
| CN115022680B (en) | Video playing method and device, electronic equipment and computer readable medium | |
| CN115134616B (en) | Live broadcast background control method, device, electronic equipment, medium and program product | |
| CN112578916B (en) | Information processing method and system | |
| CN113672332B (en) | Window display method, device, apparatus, storage medium, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |