CN116546163A - Video control method, device and system based on cloud service platform and storage medium - Google Patents
Video control method, device and system based on cloud service platform and storage medium Download PDFInfo
- Publication number
- CN116546163A CN116546163A CN202211734137.0A CN202211734137A CN116546163A CN 116546163 A CN116546163 A CN 116546163A CN 202211734137 A CN202211734137 A CN 202211734137A CN 116546163 A CN116546163 A CN 116546163A
- Authority
- CN
- China
- Prior art keywords
- video
- control
- cloud service
- service platform
- videos
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 12
- 238000012544 monitoring process Methods 0.000 claims description 22
- 230000009471 action Effects 0.000 claims description 14
- 230000006399 behavior Effects 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 5
- 230000011218 segmentation Effects 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 2
- 230000007547 defect Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 4
- 238000003786 synthesis reaction Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000009434 installation Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
The embodiment of the invention provides a video control method, device and system based on a cloud service platform and a storage medium, and belongs to the technical field of videos. The video control method is applied to a cloud service platform and comprises the following steps: responding to a remote control protocol from a client, which is generated based on the operation of a user on multiple paths of videos, and analyzing to obtain a control instruction on the multiple paths of videos; based on the control instruction, synthesizing the multiple paths of videos into one path of video; and transmitting the synthesized one-path video to the client so as to enable the client to play. According to the invention, the video control is realized in a software mode, the computing power of the cloud service platform is fully utilized, and multiple paths of videos are synthesized to be displayed, so that the defect of hardware mode expansion is effectively avoided, the cost is reduced, and the application mode is flexible.
Description
Technical Field
The invention relates to the technical field of videos, in particular to a video control method, device and system based on a cloud service platform and a storage medium.
Background
The video and audio command and dispatch terminal software integrates the functions of command and dispatch, video conference, video monitoring, wall-mounted control and the like into a whole, and is generally deployed in various application places such as a command hall, a joint duty room, a technical protection room and the like of a user. The audio/video (multimedia) decoding display is the most main core capability, and the command scheduling terminal software (client software) needs to decode and display 16 paths of high-definition videos at most, and generally selects a computer terminal of a foreign CPU chip such as intel. With the implementation of domestic substitution in the years, a domestic CPU chip becomes a necessary option, but the 16 paths of high-definition videos cannot be decoded due to the computing capability of the domestic CPU, and the following two solutions are adopted in the prior art:
(1) PCI decoding card: and inserting a PCI decoding card into the domestic computer to expand the high-definition video decoding capability of the domestic computer so as to realize decoding display of 16 paths of images.
(2) Dedicated decoding device: the computer terminal is externally connected with 1 special decoding device, the computing terminal is connected with the decoding device through a video interface (HDMI, DVI, VGA and other interfaces), then the picture synthesis is realized through technologies such as video superposition, windowing display and the like, and the expansion of decoding capability is realized through the mode.
However, the two solutions described above have the following drawbacks:
1. the cost of the customized equipment is high, and universal equipment cannot be used;
2. the structural requirement on hardware equipment is high;
3. the installation and deployment are inflexible.
Accordingly, there is a need for a video control method to overcome the above-mentioned technical problems.
Disclosure of Invention
The embodiment of the invention aims to provide a video control method, device, system and storage medium based on a cloud service platform, which solve the problems that hardware equipment is high in cost, inflexible in installation and deployment and incapable of decoding multiple paths of videos.
In order to achieve the above object, in a first aspect, an embodiment of the present invention provides a video control method based on a cloud service platform, applied to the cloud service platform, where the video control method includes: responding to a remote control protocol from a client, which is generated based on the operation of a user on multiple paths of videos, and analyzing and obtaining a control instruction and a video source address of the multiple paths of videos; synthesizing the multiple paths of videos into one path of video based on the control instructions and the video source addresses of the multiple paths of videos; and transmitting the synthesized one-path video to the client so as to enable the client to play.
Optionally, the synthesizing the multiple paths of videos into one path of video based on the control instruction and the video source address of the multiple paths of videos includes: acquiring images and sounds of the multiple paths of videos based on the video source address; based on the image instruction of the control instruction, synthesizing the images of the multiple paths of videos into one path of image; synthesizing the sound of the multi-path video into one path of sound based on the sound instruction of the control instruction; and carrying out time synchronization and splicing on the image and the sound to obtain the video.
Optionally, the image instruction of the control instruction includes any one or more of the following: video-on-demand/stop instructions, picture segmentation instructions, image coding instructions, and image decoding instructions; the sound instruction of the control instruction comprises any one or more of the following: play/stop sound instruction, sound encoding instruction, sound decoding instruction, and mixing instruction.
In a second aspect, an embodiment of the present invention provides a video control method based on a cloud service platform, applied to a client, where the video control method includes: responding to the operation of a user on multiple paths of videos, and generating a remote control protocol for video control; the remote control protocol is sent to the cloud service platform, so that the cloud service platform analyzes and obtains control instructions and video source addresses of multiple paths of videos, and the multiple paths of videos are synthesized into one path of video based on the control instructions and the video source addresses of the multiple paths of videos; and playing the path of video sent by the cloud service platform.
Optionally, the generating a remote control protocol for video control in response to the operation action of the user on the multiple paths of videos includes: monitoring an input event obtained by the user aiming at the operation action of the multi-path video at the client, wherein the operation action comprises keyboard input, mouse input, screen control input, image control input and sound control input; and based on the TCP/IP protocol, encapsulating the monitored input event to obtain the remote control protocol.
Optionally, the monitoring the input event obtained by the user in the operation action of the client for the multi-path video includes: aiming at the mouse input, monitoring double click operation, left click operation, right click operation and movement operation of the mouse; monitoring key operation of the keyboard and ASCII codes of keys aiming at the keyboard input; monitoring a coordinate system of the screen control aiming at the screen control input; monitoring the sound source number, the sound control behavior and the mixing volume aiming at the sound control input; and monitoring the image source number, the image control behavior, the image display position and the image split screen number aiming at the image control input.
In a third aspect, an embodiment of the present invention provides a video control device based on a cloud service platform, which is applied to the cloud service platform, and the video control device includes: a memory storing a program capable of running on a processor; and the processor is configured to implement the video control method applied to the cloud service platform in the first aspect when the program is executed.
In a fourth aspect, an embodiment of the present invention provides a video control device based on a cloud service platform, applied to a client, where the video control device includes: a memory storing a program capable of running on a processor; and the processor is configured to implement the video control method of the second aspect applied to the client when the program is executed.
In a fifth aspect, an embodiment of the present invention provides a video control system based on a cloud service platform, where the video control system includes a remote interactive client and a cloud service platform; wherein the client is configured with the video control device of the fourth aspect and the cloud service platform is configured with the video control device of the third aspect.
In a sixth aspect, an embodiment of the present invention provides a machine-readable storage medium, where instructions are stored, where the instructions are configured to cause a machine to perform the video control method according to the first aspect or the video control method according to the second aspect of the present application.
By the technical scheme, compared with the existing hardware mode, the video control method provided by the embodiment of the invention adopts the software mode to realize video control, the computing power of the cloud service platform is fully utilized, multiple paths of videos are synthesized into one path for display, the defect of hardware mode expansion is effectively avoided, the purpose of reducing the cost is achieved, and the application scene is flexible.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings are included to provide a further understanding of embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain, without limitation, the embodiments of the invention. In the drawings:
FIG. 1 is a flow chart of a video control method applied to a cloud service platform according to an exemplary embodiment;
FIG. 2 is a flow chart of a video compositing method according to an illustrative embodiment;
FIG. 3 is a schematic block diagram of a video control apparatus for application to a client, according to an exemplary embodiment;
FIG. 4 is a flowchart of a remote control protocol generation method, according to an exemplary embodiment; and
fig. 5 is a schematic block diagram of a video control system, according to an exemplary embodiment.
Detailed Description
The following describes the detailed implementation of the embodiments of the present invention with reference to the drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the invention, are not intended to limit the invention.
Example 1
Fig. 1 is a schematic flow chart of a video control method based on a cloud service platform according to an exemplary embodiment, and as shown in fig. 1, the video control method is applied to the cloud service platform, and includes steps S110 to S130:
step S110, in response to the remote control protocol generated from the client based on the user' S operation on the multi-path video, the control command and the video source address for the multi-path video are resolved.
For example, in the embodiment of the present invention, the client and the cloud service platform may interact based on a remote control protocol. For example, in consideration of the computing power advantage of the cloud service platform, a software module for video processing may be preset at the cloud service platform end. The software module can realize remote interaction with the client based on a remote control protocol. The remote control protocol may be a TCP/IP protocol, in which a command format of a user for a multi-path video operation is predefined. For example, the TCP/IP protocol may be the video-original-command SIP protocol, or may be the RTSP session protocol. In addition, in order to enable the cloud service platform to effectively acquire the source video and reduce transmission load pressure, the TCP/IP protocol in the embodiment of the invention predefines the format of the source address of the multi-path video, namely, the source address of the multi-path video is encapsulated in the protocol. Furthermore, after the cloud service platform receives the remote control protocol, the remote control protocol can be analyzed based on a preset protocol format so as to obtain a control instruction and a video source address of a user aiming at the multi-path video.
Step S120, based on the control instruction and the video source address of the multiple paths of videos, synthesizing the multiple paths of videos into one path of video.
For example, taking 16 paths of videos as an example, when the cloud service platform receives a control instruction for the 16 paths of videos, the 16 paths of videos are spliced to obtain a complete one path of video by processing the image and the sound of each path of video in the 16 paths of videos.
In a preferred embodiment, as shown in fig. 2, the synthesizing the multiple paths of videos into one path of video based on the control command and the video source address of the multiple paths of videos includes steps S210 to S240:
step S210, acquiring images and sounds of the multiple paths of videos based on the video source address.
For example, the cloud service platform may obtain multiple paths of videos according to the video source address, and further extract images and sounds of each path of videos to obtain multiple images and multiple sounds of the multiple paths of videos.
Step S220, based on the image instruction of the control instruction, the images of the multiple paths of videos are synthesized into one path of image.
More preferably, the image instruction of the control instruction includes any one or more of the following: video-on-demand/stop instructions, picture segmentation instructions, image encoding instructions, and image decoding instructions.
For example, the embodiment of the invention can sequentially decode, divide and superimpose the images in the multi-path video based on the image instruction, and encode the images after the synthesis processing to obtain a complete one-path image. Taking 16 paths as an example, firstly, decoding each path of image in 16 paths of video, then, dividing and superposing the decoded 16 paths of images to synthesize, and finally, obtaining one path of image. Wherein, multichannel video supports H.264, H.265 video codec.
Step S230, synthesizing the sound of the multi-path video into one-path sound based on the sound instruction of the control instruction;
more preferably, the sound command of the control command includes any one or more of the following: play/stop sound instruction, sound encoding instruction, sound decoding instruction, and mixing instruction.
For example, the embodiment of the invention can sequentially decode and mix the sound in the multi-path video based on the sound instruction, and encode the sound after the mixing process to obtain one path of sound. The sound in the embodiment of the invention supports audio coding and decoding such as G.711, G.722, AAC, OPUS and the like. For example, taking 16 paths as an example, each path of sound in the 16 paths of video is decoded first to obtain 16 paths of sound. And then mixing and encoding the decoded 16 paths of sound to finally obtain a complete path of sound.
Step S230, performing time synchronization and splicing on the one path of image and the one path of sound to obtain the one path of video.
For example, the embodiment of the invention carries out time synchronization processing on the generated image and sound so as to keep the image and sound in the video consistent and ensure the authenticity of the generated video to the greatest extent.
It should be noted that, the embodiment of the present invention is not limited to the above control instruction, and a person skilled in the art may set different control instructions according to actual video control needs to implement effective control processing for video.
As can be seen from the steps S210 to S230, in the embodiment of the present invention, by performing decoding processing on each path of image and sound of the multiple paths of video, and splicing the image and the sound respectively, and finally synchronously packaging the spliced image and sound, the multiple paths of video can be effectively synthesized into one path of video suitable for client display, and the processing control on the video is realized without improving the client configuration and without adding hardware, so that the cost is effectively reduced, and the implementation is easy.
Step S130, the synthesized video is transmitted to the client so that the client plays the video.
For example, the cloud service platform may directly transmit the synthesized video to the client. The video source address of the video can be transmitted to the client, so that the client can acquire the video through the video source address of the video, and play and display the video on the screen of the client in a video processing mode such as decoding.
As can be seen from the above steps S110 to S130, the video control method according to the embodiment of the present invention adopts a software mode different from the existing hardware mode, fully uses the computing resources of the cloud service platform, and effectively avoids the defect of expansion by adopting the conventional hardware mode. Especially, aiming at the client adopting the domestic CPU chip, the multi-channel video synthesis is completed by the cloud service platform, so that even if the client has the capability of decoding one channel of video, the client can see the multi-channel synthesized video, thereby effectively reducing the application cost and avoiding the need of configuring more video functions for the client.
Example two
Fig. 3 is a schematic flow chart of a video control method based on a cloud service platform according to an exemplary embodiment, and as shown in fig. 3, the video control method is applied to a client, and includes steps S310 to S330:
in step S310, a remote control protocol for video control is generated in response to a user operation for multiple videos.
In a preferred embodiment, as shown in fig. 4, the generating a remote control protocol for video control in response to a user's operation action on multiple videos includes:
step S410, monitoring an input event obtained by the user on the operation action of the client for the multi-path video, wherein the operation action comprises keyboard input, mouse input, screen control input, image control input and sound control input;
for example, in an operating system, drivers of hardware devices map corresponding device files, and since the device files correspond to the drivers of the hardware devices, the application program opens the device files, so that the operation information of the corresponding hardware devices can be read. In view of this, the embodiment of the present invention monitors the operation actions of hardware such as a keyboard, a mouse, a screen, a display, and a sound, so as to obtain the input event of the user for the multi-path video control. Specifically, when the mouse is moved or the keyboard is pressed, an interrupt is generated and an interrupt handler is entered. In the interrupt processing program, the action of the mouse or the keyboard generates a corresponding instruction to be stored in the buffer area, and then the application program opens the device file to read the operation of the mouse or the keyboard from the buffer area.
More preferably, as shown in table 1 below, the monitoring the user for the input event of the multiple videos includes: aiming at the mouse input, monitoring double click operation, left click operation, right click operation and movement operation of the mouse; monitoring key operation of the keyboard and ASCII codes of keys aiming at the keyboard input; monitoring a coordinate system of the screen control aiming at the screen control input; monitoring the sound source number, the sound control behavior and the mixing volume aiming at the sound control input; and monitoring the image source number, the image control behavior, the image display position and the image split screen number aiming at the image control input.
TABLE 1
It should be noted that the embodiments of the present invention are not limited to the above listed input events, and those skilled in the art may monitor different types of input performed on the video according to actual application needs, which is not limited herein.
Step S420, based on TCP/IP protocol, encapsulates the monitored input event to obtain the remote control protocol.
For example, after an input event for multiple paths of videos is monitored, the embodiment of the invention converts the input event to obtain a remote control protocol based on a preset format of a TCP/IP protocol, and then transmits the remote control protocol to a cloud service platform. In addition, in order to ensure the security of transmission, the embodiment of the invention can also preset an encryption mode for the remote control protocol so as to ensure the security of interaction between the client and the cloud service platform. The encryption mode adopted can be the conventional encryption mode, can also be the encryption aiming at the specific application scene, and is not repeated.
Step S320, the remote control protocol is sent to the cloud service platform, so that the cloud service platform parses the control instruction and the video source address related to the multiple paths of videos, and synthesizes the multiple paths of videos into one path of video based on the control instruction and the video source address related to the multiple paths of videos.
And step S330, playing the path of video sent by the cloud service platform.
As can be seen from steps S310 to S330, in the embodiment of the present invention, by acquiring the operation action of the user on the multiple paths of videos, the control instruction on the multiple paths of videos can be effectively obtained, so that the cloud service platform realizes remote control on the multiple paths of videos based on the interaction between the client and the cloud service platform.
In summary, the video control method provided in the above embodiment has the following advantages:
1) The multi-path video control is realized by adopting a software mode, and the computing resources of the cloud service platform are fully utilized;
2) The defect of a hardware expansion mode is effectively overcome, the application cost is reduced, and the application is convenient and flexible;
3) The configuration of the client is not required to be improved, and the method is particularly suitable for configuring the client of the domestic CPU chip, so that the client can play one-way completed video of multi-way video synthesis under the existing configuration.
Example III
Based on the same technical concept as the first embodiment, an embodiment of the present invention provides a video control device based on a cloud service platform, which is applied to the cloud service platform, and the video control device includes: a memory storing a program capable of running on a processor; and the processor is configured to implement the video control method applied to the cloud service platform in the above embodiment when executing the program.
Further implementation details and advantages of the embodiments of the present invention may refer to the first embodiment, and are not repeated here.
Example IV
Accordingly, based on the same technical concept as the above embodiment, an embodiment of the present invention provides a video control device based on a cloud service platform, applied to a client, where the video control device includes: a memory storing a program capable of running on a processor; and the processor is configured to implement the video control method applied to the client in the above-described second embodiment when executing the program.
Further implementation details and beneficial effects of the embodiment of the present invention can refer to the second embodiment, and are not repeated here.
Example five
As shown in fig. 5, an embodiment of the present invention provides a video control system 500 based on a cloud service platform, where the video control system includes a client 510 and a cloud service platform 520 that interact remotely; wherein, the client 510 is configured with the video control device described in the fourth embodiment, and the cloud service platform 520 is configured with the video control device described in the third embodiment.
Further implementation details and advantages of the embodiments of the present invention may refer to the above embodiments, and are not repeated here.
Example six
An embodiment of the present invention provides a machine-readable storage medium having instructions stored thereon for causing a machine to perform the video control method described in the first embodiment or the video control method described in the second embodiment of the present application.
The video control device comprises a processor and a memory, wherein the analysis unit, the processing unit, the transmission unit, the generation unit, the sending unit, the receiving unit and the like are all stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The kernel can be provided with one or more, and video control is realized by adjusting kernel parameters.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. The video control method based on the cloud service platform is characterized by being applied to the cloud service platform, and comprises the following steps:
responding to a remote control protocol from a client, which is generated based on the operation of a user on multiple paths of videos, and analyzing and obtaining a control instruction and a video source address of the multiple paths of videos;
synthesizing the multiple paths of videos into one path of video based on the control instructions and the video source addresses of the multiple paths of videos; and
and transmitting the synthesized one path of video to the client so as to enable the client to play.
2. The video control method according to claim 1, wherein synthesizing the multiple videos into one video based on the control instruction and the video source address of the multiple videos, comprises:
acquiring images and sounds of the multiple paths of videos based on the video source address;
based on the image instruction of the control instruction, synthesizing the images of the multiple paths of videos into one path of image;
synthesizing the sound of the multi-path video into one path of sound based on the sound instruction of the control instruction;
and carrying out time synchronization and splicing on the image and the sound to obtain the video.
3. The video control method according to claim 2, wherein the image instruction of the control instruction includes any one or more of: video-on-demand/stop instructions, picture segmentation instructions, image coding instructions, and image decoding instructions;
the sound instruction of the control instruction comprises any one or more of the following: play/stop sound instruction, sound encoding instruction, sound decoding instruction, and mixing instruction.
4. The video control method based on the cloud service platform is characterized by being applied to a client, and comprises the following steps:
responding to the operation of a user on multiple paths of videos, and generating a remote control protocol for video control;
the remote control protocol is sent to the cloud service platform, so that the cloud service platform analyzes and obtains control instructions and video source addresses of multiple paths of videos, and the multiple paths of videos are synthesized into one path of video based on the control instructions and the video source addresses of the multiple paths of videos;
and playing the path of video sent by the cloud service platform.
5. The audio-video control method according to claim 4, wherein the generating a remote control protocol for video control in response to an operation action of a user on the multi-path video comprises:
monitoring an input event obtained by the user aiming at the operation action of the multi-path video at the client, wherein the operation action comprises keyboard input, mouse input, screen control input, image control input and sound control input;
and based on the TCP/IP protocol, encapsulating the monitored input event to obtain the remote control protocol.
6. The video control method according to claim 5, wherein monitoring the input event obtained by the user at the client for the operation action of the multi-path video comprises:
aiming at the mouse input, monitoring double click operation, left click operation, right click operation and movement operation of the mouse;
monitoring key operation of the keyboard and ASCII codes of keys aiming at the keyboard input;
monitoring a coordinate system of the screen control aiming at the screen control input;
monitoring the sound source number, the sound control behavior and the mixing volume aiming at the sound control input;
and monitoring the image source number, the image control behavior, the image display position and the image split screen number aiming at the image control input.
7. A video control device based on a cloud service platform, which is applied to the cloud service platform, the video control device comprising:
a memory storing a program capable of running on a processor; and
the processor configured to implement the video control method of any one of the preceding claims 1-3 applied to the cloud service platform when executing the program.
8. A video control device based on a cloud service platform, which is applied to a client, the video control device comprising:
a memory storing a program capable of running on a processor; and
the processor being configured to implement the video control method of any one of the preceding claims 4-6 applied to the client when executing the program.
9. The video control system based on the cloud service platform is characterized by comprising a remote interactive client and the cloud service platform;
wherein the client is configured with the video control device of claim 8 and the cloud service platform is configured with the video control device of claim 7.
10. A machine-readable storage medium having instructions stored thereon for causing a machine to perform the video control method of any of claims 1-3 or the video control method of any of claims 4-6 of the present application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211734137.0A CN116546163A (en) | 2022-12-30 | 2022-12-30 | Video control method, device and system based on cloud service platform and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211734137.0A CN116546163A (en) | 2022-12-30 | 2022-12-30 | Video control method, device and system based on cloud service platform and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116546163A true CN116546163A (en) | 2023-08-04 |
Family
ID=87451252
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211734137.0A Pending CN116546163A (en) | 2022-12-30 | 2022-12-30 | Video control method, device and system based on cloud service platform and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116546163A (en) |
-
2022
- 2022-12-30 CN CN202211734137.0A patent/CN116546163A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2744969C1 (en) | Method and device for effective delivery and use of audio communications for high quality of perception | |
| CN110446114B (en) | Multimedia data processing device, method, electronic equipment and storage medium | |
| US11288033B2 (en) | Method for outputting audio data of applications and display device | |
| CN108200482B (en) | Cross-platform high-definition audio and video playing method, system and client | |
| CN114040251A (en) | Audio and video playing method, system, storage medium and computer program product | |
| CN110545887A (en) | Streaming of augmented/virtual reality space audio/video | |
| US20230294001A1 (en) | Content stream processing | |
| CN112399257B (en) | Cloud desktop video playing method, server, terminal and storage medium | |
| CN114302176A (en) | Video playing method and device | |
| CN113938470A (en) | Method and device for playing RTSP data source by browser and streaming media server | |
| CN111741343B (en) | Video processing method and device and electronic equipment | |
| US9118947B2 (en) | Multi-vision virtualization system and method | |
| CN111918074A (en) | Live video fault early warning method and related equipment | |
| CN116546163A (en) | Video control method, device and system based on cloud service platform and storage medium | |
| KR20140117889A (en) | Client apparatus, server apparatus, multimedia redirection system and the method thereof | |
| US8982128B2 (en) | Method of providing image and display apparatus applying the same | |
| WO2022116822A1 (en) | Data processing method and apparatus for immersive media, and computer-readable storage medium | |
| JP4755717B2 (en) | Broadcast receiving terminal device | |
| CN114339344B (en) | Intelligent device and video recording method | |
| CN114026849A (en) | Information processing apparatus, information processing method, reproduction processing apparatus, and reproduction processing method | |
| CN115243064B (en) | Live broadcast control method, device, equipment and storage medium | |
| CN116781973B (en) | Video encoding and decoding method and device, storage medium and electronic equipment | |
| CN115942021B (en) | Audio and video stream synchronous playing method and device, electronic equipment and storage medium | |
| CN117097907A (en) | Audio and video transcoding device, method, equipment, medium and product | |
| CN116916071A (en) | Video picture display method, system, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |