CN117834344A - Remote control gateway application technology based on video synthesis technology - Google Patents
Remote control gateway application technology based on video synthesis technology Download PDFInfo
- Publication number
- CN117834344A CN117834344A CN202211196075.2A CN202211196075A CN117834344A CN 117834344 A CN117834344 A CN 117834344A CN 202211196075 A CN202211196075 A CN 202211196075A CN 117834344 A CN117834344 A CN 117834344A
- Authority
- CN
- China
- Prior art keywords
- remote control
- video
- video stream
- target
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 70
- 238000005516 engineering process Methods 0.000 title claims abstract description 70
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 claims description 37
- 239000000203 mixture Substances 0.000 claims description 21
- 239000002131 composite material Substances 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 9
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 230000005856 abnormality Effects 0.000 claims description 2
- 238000012545 processing Methods 0.000 description 24
- 238000003860 storage Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 10
- 230000001360 synchronised effect Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 230000005291 magnetic effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 239000003795 chemical substances by application Substances 0.000 description 5
- 239000013307 optical fiber Substances 0.000 description 5
- 238000005457 optimization Methods 0.000 description 5
- 230000003068 static effect Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 239000006227 byproduct Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 230000005294 ferromagnetic effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a remote control gateway application technology based on a video synthesis technology. The gateway comprises a first module, a second module and a control module, wherein the first module is used for acquiring the running state parameters of target controlled equipment, and the second module is used for determining the working mode of the target controlled equipment according to the running state parameters; determining a target video stream in the corresponding original video stream according to the working mode; the third module is used for receiving the original video stream transmitted by the multi-path camera; performing video picture synthesis on the determined target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream. The scheme provided by the invention can reduce the bandwidth of the video backhaul of the harbour site, meet the condition of the harbour site for video backhaul, and realize wireless remote control of the harbour site.
Description
Technical Field
The invention relates to the technical field of video backhaul, in particular to a remote control gateway application technology based on a video synthesis technology.
Background
Current large vertical transport equipment in ports (e.g., shore bridges, field bridges, etc.) is remotely operated via optical fibers. The traditional optical fiber is used for video back transmission and remote control. However, video transmission and remote control are performed by using optical fibers, mobility of port machinery equipment is restricted, the optical fiber deployment cost of each shore bridge is as high as 100-200 ten thousand, maintenance and replacement are required every two years, and popularization of remote control business of large-scale mechanical equipment of a port is restricted by high deployment and operation and maintenance cost, so that a solution with higher cost performance is needed.
After the 5G technology is applied, 5G can be used for replacing optical fibers to become a novel network technology choice for remote control of port machinery equipment. However, as 26 paths of cameras are installed on the current 80M Gao An bridge and simultaneously transmit back video, the total bandwidth requirement reaches 300M/s, and 20 paths of cameras are installed on the 50M high-shore bridge and simultaneously transmit back video, the bandwidth requirement reaches 130M/s. The uplink capacity of the existing 5G single CPE can reach 150M/s theoretically, is affected by the field environment in actual deployment of ports, and can only reach 70-100M/s, and once 4-6 shore bridges are gathered under a single 5G cell for operation, the uplink demand of the single cell can reach approximately 2G/s. Namely, the existing 5G network can not meet the existing requirements, and the floor implementation and popularization of the remote control business of the 5G port machine are greatly restricted. At present, the multi-channel video uploading is realized mainly by increasing the uplink bandwidth of a 5G network in the industry, but a plurality of base stations have high cost and are limited by port site resources, and the multi-channel video uploading is difficult to construct in a landing way. Therefore, no product or solution for reducing the video backhaul bandwidth exists in the port field.
Disclosure of Invention
In order to solve the technical problem of high requirement on wireless video backhaul bandwidth in the existing port field, the embodiment of the invention provides a remote control gateway, a system and a method based on a video synthesis technology.
The technical scheme of the embodiment of the invention is realized as follows:
the embodiment of the invention provides a remote control gateway based on a video synthesis technology, which is connected with target controlled equipment, a multi-path camera and a remote control console, and comprises the following components: the first module is used for acquiring the running state parameters of the target controlled equipment; the second module is used for determining the working mode of the target controlled equipment according to the running state parameters; determining a target video stream in the corresponding original video stream according to the working mode; wherein the target video stream is at least more than two paths; the third module is used for receiving the original video stream transmitted by the multi-path camera; performing video picture synthesis on the determined target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
In the above scheme, the second module is further configured to query a comparison table of the working mode and the original video stream number according to the working mode, determine the number of the target video stream corresponding to the working mode, and send the number of the target video stream to the third module; the third module is further configured to allocate numbers to the received multiple paths of original video streams, receive the numbers of the target video streams sent by the second module, determine the target video streams in the original video streams according to the numbers of the target video streams, and perform video picture synthesis to obtain a synthesized video stream.
In the above scheme, the third module is further configured to check the composite video stream, and perform early warning when checking that the composite video stream is interrupted or has an error in format.
In the above scheme, the third module is further configured to detect network fluctuation and abnormal conditions, and reduce the code rate of the composite video stream when network congestion is caused by network fluctuation or abnormality.
In the above scheme, the third module is further configured to calculate a delay number in a video stream receiving and converting process, and send the delay number and the composite video stream to the remote console.
The embodiment of the invention also provides a remote control system based on the video synthesis technology, which comprises a multi-path camera, a remote control console, target controlled equipment and any one of the remote control gateways based on the video synthesis technology: the multipath cameras are used for collecting original video streams and sending the original video streams to a remote control gateway based on a video synthesis technology; the remote control console is used for receiving the synthesized video stream sent by the remote control gateway based on the video synthesis technology and implementing remote control on the target controlled equipment according to the synthesized video stream; the target controlled equipment is used for sending running state parameters to the remote control gateway based on the video synthesis technology, and receiving and executing the remote control instruction sent by the remote control console.
In the above scheme, the target controlled device is provided with a programmable logic controller system, and the target controlled device collects the running state parameters through the programmable logic controller system and sends the running state parameters to a remote control gateway based on the video synthesis technology.
In the above scheme, the system further comprises a cloud base, and the cloud base is connected with the remote control gateway based on the video synthesis technology and is used for providing component support for the remote control gateway based on the video synthesis technology.
In the above scheme, the remote control console comprises a terminal APP and a terminal SDK; the terminal SDK is used for receiving the synthesized video stream and decoding the synthesized video stream; the terminal APP is used for displaying decoded video stream pictures.
The embodiment of the invention also provides a remote control method based on the video synthesis technology, which comprises the following steps: receiving original video streams transmitted by multiple paths of cameras; acquiring an operation state parameter of a target controlled device, and determining a working mode of the target controlled device according to the operation state parameter; according to the working mode, determining a target video stream in the original video stream corresponding to the working mode; wherein the target video stream is at least more than two paths; synthesizing video pictures of the target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
according to the method provided by the embodiment of the application, the multi-path video streams needing to be returned are combined and returned according to the working mode of the target controlled equipment, so that the bandwidth of the video return of the target controlled equipment can be reduced, the requirements of special fields such as ports and the like on the video return of the target controlled equipment are met, and the wireless remote control of the target controlled equipment is realized.
Drawings
Fig. 1 is a schematic structural diagram of a remote control gateway based on a video synthesis technology according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a time delay composition of a remote control gateway based on a video synthesis technology according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a remote control system based on video synthesis technology according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a practical application structure of a remote control system based on a video synthesis technology according to an embodiment of the present invention;
FIG. 5 is a flow chart of a remote control method based on video synthesis technology according to an embodiment of the invention;
fig. 6 is an internal structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples.
The embodiment of the invention provides a remote control gateway based on a video synthesis technology, which is connected with target controlled equipment, a multi-path camera and a remote control console, as shown in fig. 1, the remote control gateway 100 based on the video synthesis technology comprises:
a first module 101, configured to obtain an operation state parameter of a target controlled device;
a second module 102, configured to determine a working mode of the target controlled device according to the running state parameter; determining a target video stream in the corresponding original video stream according to the working mode; wherein the target video stream is at least more than two paths;
a third module 103, configured to receive an original video stream transmitted by the multiple cameras; performing video picture synthesis on the determined target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
The remote control network 100 based on the video synthesis technology in the embodiment can be applied to remote control scenes of heavy equipment such as port cranes. For port cranes such as a quay crane, a bridge crane and a tire crane, the remote control network 100 based on the video synthesis technology in the embodiment dynamically interfaces with a remote control console by accessing multiple cameras on the port crane, and synthesizes 4 to 6 paths of video pictures required by remote control into 1 path 1080P video streams for returning according to the working mode of the port crane. Therefore, the uplink bandwidth requirement of the video stream required by the remote control of the port crane is reduced by 90%, and the wireless video backhaul in the port field is possible.
In addition, the remote control network 100 based on the video synthesis technology in this embodiment can also be applied to other multipath video backhaul service scenarios in 5G environments. For example, the remote control network 100 based on the video synthesis technology of the embodiment can be used to combine 5-7 paths of monitoring videos of an automatic driving vehicle into 1 path of videos for returning, so as to solve the problem of video monitoring under multi-vehicle aggregation. For another example, the remote control network 100 based on the video synthesis technology in this embodiment may be used to splice and return various videos of the traffic intersection in a video panorama, so as to improve the traffic intersection management efficiency.
The remote control network 100 based on the video compositing technology in this embodiment may be a software and hardware integrated product. Specifically, the hardware form of the remote control network 100 based on the video synthesis technology in this embodiment may be an industrial personal computer, and standard specifications may be 10C (real core), 64G memory, 1T storage, and 1T 4 GPU card; the software application of the remote control network 100 based on the video synthesis technology in this embodiment may include modules, such as the first module 101, the second module 102, and the third module 103, for video access, PLC docking, and video synthesis, to implement functions of decoding, synthesizing, compressing, encoding, transmitting, and the like, of a target picture.
The remote control network 100 based on the video synthesis technology in this embodiment can select, from original video streams transmitted by multiple cameras, a target video stream corresponding to a working mode of a target controlled device to synthesize according to actual scene requirements, and transmit the synthesized video stream in real time, so that the bandwidth of video backhaul of the target controlled device can be reduced, the requirement of special fields such as ports on video backhaul of the target controlled device is met, and wireless remote control of the target controlled device is realized.
In an embodiment, the second module 102 may be further configured to query a comparison table of the working mode and the original video stream number according to the working mode, determine the number of the target video stream corresponding to the working mode, and send the number of the target video stream to the third module 103;
the third module 103 may be further configured to allocate numbers to the received multiple paths of original video streams, receive numbers of the target video streams sent by the second module 102, determine, according to the numbers of the target video streams, a target video stream in the original video streams to perform video frame synthesis, and obtain a synthesized video stream.
According to the method and the device, the numbers are allocated to the original video streams transmitted by the multiple paths of cameras, and the target video streams in the original video streams are determined according to the numbers, so that the video synthesis efficiency can be improved, the time delay generated during video transmission can be reduced, and the error rate of the synthesized video can be reduced.
In an embodiment, the third module 103 is further configured to check the composite video stream, and perform early warning when checking that the composite video stream is interrupted or has an error in format.
When the video stream is interrupted or the format is wrong, the early warning is timely carried out, so that the staff can timely maintain the video stream, and the influence caused by the reasons such as video interruption is reduced.
In an embodiment, the third module 103 is further configured to detect network fluctuations and anomalies, and reduce the code rate of the composite video stream when the network fluctuations or anomalies cause network congestion.
Because of the problems of packet loss and interference in the 5G wireless environment, the embodiment can judge the congestion state in time and reduce the code rate in time by dynamically detecting the network performance when the 5G network performance fluctuates or is abnormal, so that the picture can be ensured to be hardly blocked.
Specifically, the present embodiment may utilize packet loss compensation and congestion control algorithms to detect 5G network performance.
In an embodiment, the third module 103 is further configured to calculate a delay number in the video stream receiving and converting process, and send the delay number and the composite video stream to the remote console.
Specifically, the present embodiment may calculate the delay through a delay statistics algorithm. The delay statistics algorithm is used for calculating the time delay number of the field picture and the operation desk picture, so that the remote control experience of a user can be improved, the accurate quantification of the time delay of each link is realized, and the data support is provided for realizing the optimal delay.
The embodiment can also adopt modes of buffer optimization, timer adjustment, thread load balancing and the like to reduce delay loss to the greatest extent. Here, cache optimization refers to: aiming at a cache evaluation model of each component such as network transceiving, internal forwarding, video encoding and decoding and the like, the cache is reduced to the maximum extent on the premise of not influencing the processing of the code stream, and the processing speed of the code stream is improved. The timer adjustment index: in order to achieve the lowest delay effect, the idle time of the timer in the original system frame is shortened, the processing time of each link is estimated and verified, and the waiting time of the timer is reduced to the minimum. Thread load balancing refers to: the interior of the composite gateway system relates to a plurality of links such as network transceiving, bus forwarding, video payload decoding, encoding, payload adding and the like, and the consumed performance of each processing unit is high or low, so that the CPU consumption of each component is analyzed and verified for realizing the maximum utilization rate of the system performance, CPU threads are reasonably distributed, the delay loss is reduced to the maximum extent, and the performance indexes such as the concurrency number, delay and the like of the gateway are improved through the acceleration of integrated GPU hardware, so that the internal delay can be reduced to 35ms from more than the initial 200 ms.
In addition, the embodiment can also adopt a GPU coding mode, and change the traditional and general timer driving mode into an innovative message driving mode so as to achieve the function of reducing transmission delay. The latency experience may be further improved by changing the conventional thread mode to a functionalized mode to improve QoE (Quality of Experience).
Here, referring to fig. 2, the composition of the delay numbers in this embodiment may be as shown in fig. 2.
In addition, the modes of GPU coding strategy adjustment, parameter optimization and the like can reduce the time delay and network bandwidth. For example, aiming at the problem of excessive bandwidth occupation under a 5G network, 4 paths of 4M uplink H264 code streams are compressed into one path of H265 format downlink code stream with 1.5M bandwidth through multi-picture synthesis, GPU coding strategy adjustment and parameter optimization, so that the network bandwidth is reduced.
In summary, the remote control gateway based on the video synthesis technology in this embodiment has the following advantages:
(1) Functional modularization layering combination design: aiming at video synthesis and service linkage characteristics, the gateway is divided into 3 main processing modules, namely a PLC linkage module, an AS application module and a video cloud platform. The above-described partitioning allows the PLC interface to be adapted to the format of a variety of external instructions. Meanwhile, the AS application module can enable the gateway to have independent upgrading and optimizing space, and the video stream synthesis processing is not affected. In the video cloud platform, the video control flow, the media processing flow and the video access flow are logically processed in a layering manner, all modules are in butt joint through private interfaces, the subsequent upgrading and maintenance of all components are facilitated, all modules are mutually in noninductive cooperation, independent operation of any one module is not affected, and therefore stability and reliability of equipment are improved.
(2) Cloud edge cooperation: by adopting cloud edge collaborative design, the performance improvement space of the subsequent end-side products is fully considered, an edge computing platform interface is reserved in advance, and a high-difficulty instruction which cannot be processed by local computing force is submitted to cloud processing, so that the limit of the end-side computing force is broken through, the overall robustness of the system is improved, and a solid foundation is laid for business capacity expansion.
(3) Cache optimization: in each component of the media processing layer, the buffer memory of each component such as network receiving and transmitting, internal forwarding, video encoding and decoding and the like is calculated in real time, the RTP packet or frame number of asynchronous buffer memory in the thread or between threads is judged, if the buffer memory is bigger, the delay of code stream processing is increased, so that each thread reaches the minimum buffer memory through reasonable evaluation under the premise of not influencing the data integrity in different components.
(4) And (3) timer adjustment: the method mainly comprises the steps of carrying out timing forwarding after the NPU component network receives a packet, carrying out timing forwarding in the CSB component, and carrying out timing coding in the VPU component. The timer is used for solving the multithreading problem of code stream flow, a timer mechanism is introduced for ensuring thread synchronization, and waiting time for processing among threads is generated; to shorten the idle time, the timer interval is modified while the transaction is split to a smaller granularity, with a compression limit of 1ms. The timer introduced delay is reduced from 30ms to below 10 ms.
(5) Thread load balancing: the performance consumption of different components varies according to the use scenario. Reasonable thread allocation can ensure that the CPU utilization rate is higher, if the allocation is unreasonable, the CPU is easy to rush up, the threads are blocked, and finally the display effect is poor. Therefore, the embodiment of the invention configures the thread numbers of each component according to the actual situation, and simultaneously, the multithreading of the same component also performs load balancing in a polling mode.
The embodiment of the invention provides a remote control gateway based on a video synthesis technology, which comprises a first module, a second module and a third module, wherein the first module is used for acquiring the running state parameters of target controlled equipment; the second module is used for determining the working mode of the target controlled equipment according to the running state parameters; determining a target video stream in the corresponding original video stream according to the working mode; wherein the target video stream is at least more than two paths; the third module is used for receiving the original video stream transmitted by the multi-path camera; performing video picture synthesis on the determined target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream. According to the scheme provided by the embodiment of the invention, the multi-path video streams needing to be returned are combined and returned according to the working mode of the target controlled equipment, so that the bandwidth of the video return of the target controlled equipment can be reduced, the requirements of special fields such as ports and the like on the video return of the target controlled equipment are met, and the wireless remote control of the target controlled equipment is realized.
Referring to fig. 3, the remote control system 300 based on the video synthesis technology includes a multi-path camera 301, a remote console 302, a target controlled device 303, and any one of the remote control gateway 100 based on the video synthesis technology described above:
the multi-path camera 301 is configured to collect an original video stream, and send the original video stream to the remote control gateway 100 based on a video synthesis technology;
the remote console 302 is configured to receive a composite video stream sent by the remote control gateway 100 based on a video composition technology, and implement remote control on the target controlled device 303 according to the composite video stream;
the target controlled device 303 is configured to send an operation status parameter to the remote control gateway 100 based on the video synthesis technology, and receive and execute a remote control instruction sent by the remote control console 302.
In practical applications, the target controlled device 303 may be installed with a programmable logic controller system (PLC for short), and collect the operation state parameters through the programmable logic controller system, and send the operation state parameters to the remote control gateway 100 based on the video synthesis technology.
In an embodiment, the system may further comprise a cloud base connected with the video composition technology based remote control gateway 100 for providing component support for the video composition technology based remote control gateway 100.
Specifically, the cloud base may include the following modules: the system comprises an edge application management module, an edge node management module, an interface management module, an application configuration module, an event management module, an equipment management module and a log monitoring management module;
the edge application management module is used for carrying out remote monitoring management on a plurality of devices;
the edge node management module is used for managing the edge nodes;
the interface management module is used for carrying out equipment development interface management;
the application configuration module is used for carrying out video synthesis gateway application configuration, and comprises PLC Agent data configuration, terminal APP address configuration, equipment mode configuration and group meeting control;
the event management module is used for receiving and displaying alarms and notifications reported by the equipment;
the device management module is used for carrying out configuration management on the accessed camera;
and the log monitoring management module is used for monitoring and early warning logs generated by the equipment.
The cloud base in the embodiment of the invention can provide technical platform support for the remote control gateway 100 based on the video synthesis technology through the modules.
In an embodiment, the remote console 302 may include a terminal APP and a terminal SDK;
the terminal SDK is used for receiving the synthesized video stream and decoding the synthesized video stream;
the terminal APP is used for displaying decoded video stream pictures.
Next, with reference to fig. 4, an application of the remote control system based on the video synthesis technology according to the present invention in a specific scenario will be described in detail.
Specifically, in an embodiment, the application scenario may be a port crane (including but not limited to quay crane, bridge crane), the network environment may be 5G and have MEC nodes.
Referring to fig. 4, the components of the remote control system based on the video composition technology of this embodiment may include the following:
1. port crane (understood as target controlled equipment in the above embodiment)
The port crane outputs data streams outwards, including video streams collected by cameras and PLC control signaling. And acquiring multiple paths of video streams through a camera, and acquiring the working mode of the port crane through a monitoring PLC system. The video stream supports a GB28181 protocol, and the PLC control instruction is output through a modbus protocol.
2. Video composition gateway (which can be understood as a remote control gateway based on video composition technology in the above embodiments)
Comprises the following parts:
(1) PLC linkage application controller (which can be understood as the first module in the above embodiment)
The PLC linkage application controller accesses the PLC control instruction through the Modbus protocol, and sends the instruction to the AS application server.
The Modbus protocol is a common language used on electronic controllers. Through this protocol, the controllers can communicate with each other, with the controllers via a network (e.g., ethernet) and other devices.
(2) AS application server (which may be understood AS the second module in the above embodiment)
The AS application server obtains a crane working mode by comparing with the control state table, and can obtain the video stream number to be accessed through the working mode and the camera corresponding relation table, and sends the video stream number of the camera to be accessed to the video cloud platform.
Note that: the crane state includes: 1, standby; 2 lifting operation mode; 3, a trolley operation mode; 4, the cart runs leftwards; and 5, the cart runs to the right.
(3) Video cloud platform (which can be understood as the third module in the above embodiment)
Here, the video cloud platform may include a media controller, a media processor, and an access layer processor.
a. The media controller: including IPC control and real-time media control.
IPC control: registering the accessed camera video stream and distributing independent numbers;
real-time media control: and dynamically controlling the video streams to be synthesized to carry out synthesis processing according to the video stream numbers input by the AS application server.
b. The media processor: including media processing agents and video coding compositions.
Media processing agent: receiving control of a media controller, and creating a terminal, a mixer and a synthesizer;
video coding synthesis: video processing service is provided, video stream is encoded and decoded, and picture composition is carried out.
c. Access layer processor: including SIP signaling and media access.
The method is mainly responsible for accessing video stream data, auditing the accessed multipath video streams, and giving an alarm if the accessed video streams are interrupted or are incorrect in format.
3. Yun De (TCF)
The cloud base provides technical platform support for the video synthesis gateway, industrial personal computer components are developed through the cloud base platform, and component support is provided for subsequent version upgrading and redevelopment. Comprises the following parts:
(1) Edge application management: remote monitoring management is carried out on a plurality of industrial computers;
(2) Edge node management: performing edge node management, namely industrial personal computer management;
(3) ZedgeEdgeProxy: performing development interface management of the industrial personal computer;
(4) Application configuration: performing video synthesis gateway application configuration, including PLC Agent data configuration, terminal APP address configuration, crane mode configuration and group meeting control;
(5) Event management: receiving and displaying an alarm and a notification reported by an industrial personal computer;
(6) And (3) device management: mainly carrying out configuration management on an accessed camera;
(7) Log monitoring management: and monitoring and early warning the log generated by the industrial personal computer.
4. Monitoring center
The monitoring center comprises a terminal APP and an SDK, and is mainly used for displaying video streams.
(1) Terminal APP: displaying a picture synthesized by the video;
(2) Terminal SDK: and receiving the RTP stream and decoding.
Based on the system structure, the interaction process among the components of the system is as follows:
the PLC linkage application controller accesses the PLC control instruction through the Modbus protocol, and sends the instruction to the AS application server. The AS application server obtains the working mode of the port crane by comparing with the control state table, and can obtain the video stream number to be accessed through the working mode and the camera corresponding relation table, and sends the video stream number of the camera to be accessed to the video cloud platform. And the media controller in the video cloud platform dynamically controls the video streams to be synthesized to carry out synthesis processing according to the video stream numbers input by the AS application server. The media controller is also responsible for registering the accessed camera video stream and allocating independent numbers. The media processor performs media processing proxy and video encoding composition functions. The media processing agent module is used for completing the functions of receiving the control of the media controller, creating the terminal, the mixer and the synthesizer. And the video coding and synthesizing module provides video processing service, codes and decodes the video stream and synthesizes pictures. The video stream after the synthesis processing passes through the access layer processor, the access layer processor is mainly responsible for accessing video stream data, auditing the accessed multi-path video stream, and alarming if the accessed video stream is interrupted or the format is incorrect. Finally, the processed video stream is output to a terminal APP and an SDK of a monitoring center to display the video stream. The terminal SDK is responsible for receiving and decoding RTP streams, and the terminal APP is responsible for displaying pictures synthesized by video after decoding.
When the embodiment is applied to remote control scenes of heavy equipment such as port cranes, a plurality of paths of camera video streams can be selected from the input multiple paths of video streams for synthesis according to actual scene requirements, one or more paths of synthesized video stream pictures are transmitted in real time, and the time delay and the picture switching response speed of the display can meet the remote control requirements of operators in the scenes. In addition, the gateway of the embodiment reduces the video backhaul bandwidth, so that the number of port cranes which can be covered by the same base station is more, the deployment and maintenance cost can be further reduced, and the 5G port crane remote control business scale business is possible.
Referring to fig. 5, the embodiment of the invention further provides a remote control method based on the video synthesis technology, as shown in fig. 5, the method includes:
step 501: receiving original video streams transmitted by multiple paths of cameras;
step 502: acquiring an operation state parameter of a target controlled device, and determining a working mode of the target controlled device according to the operation state parameter;
step 503: according to the working mode, determining a target video stream in the original video stream corresponding to the working mode; wherein the target video stream is at least more than two paths;
step 504: synthesizing video pictures of the target video stream to obtain a synthesized video stream;
step 505: and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
The method provided in this embodiment belongs to the same concept as the gateway embodiment, and the specific implementation process of the method is detailed in the gateway embodiment, which is not described herein again.
According to the method, the device and the system, the low-delay, high-bandwidth and mass connection characteristics of the 5G network are utilized, the operation high-definition video of the target controlled equipment is transmitted back in real time and is controlled remotely in real time, an operator is transformed from the site to a central control room for working, and the port operation efficiency can be improved.
To implement the method of the embodiments of the present invention, the embodiments of the present invention also provide a computer program product comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the steps of the method described above.
Based on the hardware implementation of the program modules, and in order to implement the method of the embodiment of the present invention, the embodiment of the present invention further provides an electronic device (computer device). In particular, in one embodiment, the computer device may be a terminal, the internal structure of which may be as shown in fig. 6. The computer apparatus includes a processor a01, a network interface a02, a display screen a04, an input device a05, and a memory (not shown in the figure) which are connected through a system bus. Wherein the processor a01 of the computer device is adapted to provide computing and control capabilities. The memory of the computer device includes an internal memory a03 and a nonvolatile storage medium a06. The nonvolatile storage medium a06 stores an operating system B01 and a computer program B02. The internal memory a03 provides an environment for the operation of the operating system B01 and the computer program B02 in the nonvolatile storage medium a06. The network interface a02 of the computer device is used for communication with an external terminal through a network connection. Which when executed by a processor a01, performs the method of any of the embodiments described above. The display screen a04 of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device a05 of the computer device may be a touch layer covered on the display screen, or may be a key, a track ball or a touch pad arranged on a casing of the computer device, or may be an external keyboard, a touch pad or a mouse.
It will be appreciated by those skilled in the art that the structure shown in fig. 6 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
The device provided by the embodiment of the invention comprises a processor, a memory and a program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the method of any one of the embodiments.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash memory (flashRAM). Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transshipment) such as modulated data signals and carrier waves.
It will be appreciated that the memory of embodiments of the invention may be either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. Wherein the nonvolatile Memory may be Read Only Memory (ROM), programmable Read Only Memory (PROM, programmable Read-Only Memory), erasable programmable Read Only Memory (EPROM, erasable Programmable Read-Only Memory), electrically erasable programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read-Only Memory), magnetic random access Memory (FRAM, ferromagnetic random access Memory), flash Memory (Flash Memory), magnetic surface Memory, optical disk, or compact disk Read Only Memory (CD-ROM, compact Disc Read-Only Memory); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be random access memory (RAM, random Access Memory), which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (SRAM, static Random Access Memory), synchronous static random access memory (SSRAM, synchronous Static Random Access Memory), dynamic random access memory (DRAM, dynamic Random Access Memory), synchronous dynamic random access memory (SDRAM, synchronous Dynamic Random Access Memory), double data rate synchronous dynamic random access memory (ddr SDRAM, double Data Rate Synchronous Dynamic Random Access Memory), enhanced synchronous dynamic random access memory (ESDRAM, enhanced Synchronous Dynamic Random Access Memory), synchronous link dynamic random access memory (SLDRAM, syncLink Dynamic Random Access Memory), direct memory bus random access memory (DRRAM, direct Rambus Random Access Memory). The memory described by embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. The utility model provides a remote control gateway based on video synthesis technique which characterized in that, remote control gateway based on video synthesis technique connects target controlled device, multichannel camera and remote control platform, remote control gateway based on video synthesis technique includes:
the first module is used for acquiring the running state parameters of the target controlled equipment;
the second module is used for determining the working mode of the target controlled equipment according to the running state parameters; determining a target video stream in the corresponding original video stream according to the working mode; wherein the target video stream is at least more than two paths;
the third module is used for receiving the original video stream transmitted by the multi-path camera; performing video picture synthesis on the determined target video stream to obtain a synthesized video stream; and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
2. The remote control gateway based on video composition technology as recited in claim 1, wherein,
the second module is further configured to query a comparison table of the working mode and the original video stream number according to the working mode, determine a number of a target video stream corresponding to the working mode, and send the number of the target video stream to the third module;
the third module is further configured to allocate numbers to the received multiple paths of original video streams, receive the numbers of the target video streams sent by the second module, determine the target video streams in the original video streams according to the numbers of the target video streams, and perform video picture synthesis to obtain a synthesized video stream.
3. The remote control gateway based on video composition technology as recited in claim 1, wherein,
and the third module is also used for checking the synthesized video stream, and early warning is carried out when the synthesized video stream is checked to be interrupted or the format is wrong.
4. The remote control gateway based on video composition technology as recited in claim 1, wherein,
the third module is further configured to detect network fluctuation and abnormal conditions, and reduce a code rate of the composite video stream when network congestion is caused by network fluctuation or abnormality.
5. The remote control gateway based on video composition technology as recited in claim 1, wherein,
the third module is further configured to calculate a delay number in a video stream receiving and converting process, and send the delay number and the composite video stream to the remote console.
6. A remote control system based on video synthesis technology, characterized in that it comprises a multi-path camera, a remote control console, a target controlled device and a remote control gateway based on video synthesis technology according to any one of claims 1 to 5:
the multipath cameras are used for collecting original video streams and sending the original video streams to a remote control gateway based on a video synthesis technology;
the remote control console is used for receiving the synthesized video stream sent by the remote control gateway based on the video synthesis technology and implementing remote control on the target controlled equipment according to the synthesized video stream;
the target controlled equipment is used for sending running state parameters to the remote control gateway based on the video synthesis technology, and receiving and executing the remote control instruction sent by the remote control console.
7. The video composition technology based remote control system according to claim 6, wherein the target controlled device is installed with a programmable logic controller system, and the target controlled device collects an operation state parameter through the programmable logic controller system and transmits the operation state parameter to a video composition technology based remote control gateway.
8. The video composition technology based remote control system of claim 6, further comprising a cloud base coupled to the video composition technology based remote control gateway for providing component support for the video composition technology based remote control gateway.
9. The video composition technology based remote control system according to claim 6, wherein the remote console comprises a terminal APP and a terminal SDK;
the terminal SDK is used for receiving the synthesized video stream and decoding the synthesized video stream;
the terminal APP is used for displaying decoded video stream pictures.
10. A remote control method based on video synthesis technology, the method comprising:
receiving original video streams transmitted by multiple paths of cameras;
acquiring an operation state parameter of a target controlled device, and determining a working mode of the target controlled device according to the operation state parameter;
according to the working mode, determining a target video stream in the original video stream corresponding to the working mode; wherein the target video stream is at least more than two paths;
synthesizing video pictures of the target video stream to obtain a synthesized video stream;
and sending the synthesized video stream to the remote control console so that the remote control console can implement remote control on the target controlled equipment according to the synthesized video stream.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211196075.2A CN117834344A (en) | 2022-09-27 | 2022-09-27 | Remote control gateway application technology based on video synthesis technology |
| PCT/CN2023/072002 WO2024066136A1 (en) | 2022-09-27 | 2023-01-13 | Video composition technology-based remote control gateway application technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211196075.2A CN117834344A (en) | 2022-09-27 | 2022-09-27 | Remote control gateway application technology based on video synthesis technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117834344A true CN117834344A (en) | 2024-04-05 |
Family
ID=90475804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211196075.2A Pending CN117834344A (en) | 2022-09-27 | 2022-09-27 | Remote control gateway application technology based on video synthesis technology |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117834344A (en) |
| WO (1) | WO2024066136A1 (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014145307A2 (en) * | 2013-03-15 | 2014-09-18 | Blue Jeans Network | Provision of video conferencing services using reflector multipoint control units (mcu) and transcoder mcu combinations |
| CN108616759A (en) * | 2016-12-09 | 2018-10-02 | 华为技术服务有限公司 | A kind of video broadcasting method and relevant device |
| CN110856010A (en) * | 2019-11-27 | 2020-02-28 | 北京翔云颐康科技发展有限公司 | Video playing method and device, storage medium and electronic equipment |
| CN112468763B (en) * | 2020-11-11 | 2023-11-24 | 北京融讯科创技术有限公司 | Video transmission and display method, device and equipment for conference television and storage medium |
-
2022
- 2022-09-27 CN CN202211196075.2A patent/CN117834344A/en active Pending
-
2023
- 2023-01-13 WO PCT/CN2023/072002 patent/WO2024066136A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024066136A1 (en) | 2024-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108667870B (en) | IoT data reporting method, device and system | |
| US20220021917A1 (en) | Dynamic load balancing for video analytics pipelines | |
| CN101505278B (en) | Packet forwarding path obtaining method, packet forwarding method and packet forwarding apparatus | |
| CN102664750B (en) | Method, system and device for hot backup of multi-machine | |
| CN103053146B (en) | Data migration method and device | |
| CN102571559B (en) | Time-triggered network message transmission method | |
| CN101873005A (en) | Method for realizing balanced acquisition of electric energy | |
| CN101567861B (en) | Data synchronization method and application system between heterogeneous application systems | |
| CN111552440B (en) | Cloud-edge-end data synchronization method for electric power Internet of things | |
| CN113778615B (en) | Rapid and stable network shooting range virtual machine construction system | |
| CN104284141A (en) | Video monitoring system | |
| CN112714164A (en) | Internet of things system and task scheduling method thereof | |
| CN113242319A (en) | Cloud edge cooperative work method and system based on video cloud service architecture | |
| CN105141911A (en) | Railway video monitoring system interconnecting device and method | |
| CN116915827A (en) | Data transmission method and device of internet of things edge gateway, electronic equipment and medium | |
| CN109582479B (en) | OpenDDS distributed communication method based on reflective memory card | |
| CN113867946A (en) | Method, device, storage medium and electronic equipment for accessing resources | |
| CN117834344A (en) | Remote control gateway application technology based on video synthesis technology | |
| CN101521682A (en) | Synthesized remote monitoring system and processing method of remote monitoring data | |
| US10666359B2 (en) | Multi-layer system self-optimization | |
| CN115580667B (en) | Data transmission method, device, equipment and storage medium | |
| CN108616591B (en) | Interface device and method for data exchange | |
| CN112203063B (en) | Distributed implementation method and system for video networking and electronic equipment | |
| CN115665172A (en) | Management system and management method of embedded terminal equipment | |
| US8774002B2 (en) | Traffic control apparatus and data communication system including same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |