CN116074584A

CN116074584A - Video stream transmission method, device and storage medium

Info

Publication number: CN116074584A
Application number: CN202310065721.XA
Authority: CN
Inventors: 陶咏志; 杨海涛; 冯九龙; 栾晓鹏; 马营营; 冯荟璇
Original assignee: China United Network Communications Group Co Ltd; China Information Technology Designing and Consulting Institute Co Ltd; Beijing Telecom Planning and Designing Institute Co Ltd
Current assignee: China United Network Communications Group Co Ltd; China Information Technology Designing and Consulting Institute Co Ltd; Beijing Telecom Planning and Designing Institute Co Ltd
Priority date: 2023-01-13
Filing date: 2023-01-13
Publication date: 2023-05-05

Abstract

The application discloses a video stream transmission method, a video stream transmission device and a video stream storage medium, relates to the technical field of communication, is applied to a streaming media platform, and is used for solving the problem that video streams shot by different types of monitoring equipment cannot be fused. The method comprises the following steps: acquiring video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and a plurality of video sources are used for shooting target areas from different angles; video encoding is carried out on video streams of a plurality of video sources, and video links in a preset format are obtained; video links are used to associate video streams of multiple video sources; and sending the video link to the terminal equipment for playing the video stream through the webpage by the terminal equipment. In this way, fusion of video streams of multiple video sources can be achieved.

Description

Video stream transmission method, device and storage medium

Technical Field

The embodiment of the application relates to the technical field of streaming media, in particular to a video stream transmission method, a video stream transmission device and a storage medium.

Background

The construction industry is a high-risk industry with a plurality of safety accidents. For the safety of the construction site, the construction site can be monitored in real time by monitoring equipment. Thus, the staff can detect the safety condition of the construction site through the video shot by the monitoring equipment.

Currently, monitoring devices are often single-platform access. The protocols supported by the monitoring devices of different vendors are different. That is, the monitoring devices of each manufacturer only support respective protocols, and cross-platform, cross-protocol and cross-brand interworking cannot be realized. Resulting in a user being able to view only a single type of video source.

Disclosure of Invention

The application provides a video stream transmission method, a video stream transmission device and a storage medium, which are used for solving the problem that video streams shot by different types of monitoring equipment cannot be fused.

In order to achieve the above purpose, the present application adopts the following technical scheme:

in a first aspect, a method for transmitting a video stream is provided, and the method is applied to a streaming media platform, and includes: acquiring video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and a plurality of video sources are used for shooting target areas from different angles; video encoding is carried out on video streams of a plurality of video sources, and video links in a preset format are obtained; video links are used to associate video streams of multiple video sources; and sending the video link to the terminal equipment for playing the video stream through the webpage by the terminal equipment.

In a possible implementation manner, the "video encoding the video streams of the plurality of video sources to obtain the video link in the preset format" includes: if the video source does not support the preset protocol, converting the video stream of the video source into a video stream in the FLV format of the streaming media format, and generating a video link associated with the video stream in the FLV format; if the video source supports the preset protocol, the video stream of the video source is packaged into a video stream in the HTTP format, and a video link associated with the video stream in the HTTP format is generated.

In a possible implementation manner, the method further includes: storing video streams of the plurality of video sources; and responding to the request information of the review video of the terminal equipment, acquiring a video stream corresponding to the request information from the stored video streams, and sending the video stream to the terminal equipment.

In a possible implementation manner, the foregoing "sending a video stream to a terminal device" specifically includes: and sending the video stream corresponding to the request information to one or more CDN servers of the content delivery network so that the terminal equipment obtains the video stream from one or more CDN services.

In a possible implementation manner, the foregoing "sending a video stream to a terminal device" specifically includes: and sending a video data packet to the terminal equipment, wherein the video data packet comprises a video stream corresponding to the request information and preset parameters, and the preset parameters are used for indicating the size of the video stream.

In a possible implementation, the video data packet further includes metadata, where the metadata is used to indicate attribute information of the video stream.

In a possible implementation manner, the streaming media platform includes a video distribution device, where the video distribution device includes a main device and an auxiliary device, and the video distribution device is configured to send a video stream to a terminal device, and the method further includes: and in response to the data processing capability of the main device exceeding a preset threshold or the main device being unable to execute the video stream distribution function, sending request information to the auxiliary device, so that the auxiliary device sends a corresponding video stream to the terminal device according to the request information.

In a second aspect, a video stream transmission device is provided, where the processing device may be a chip or a system on a chip, and may also be a functional module for implementing the method of the first aspect or any of the possible designs of the first aspect. The processing means may implement the functions performed in the aspects described above or in each of the possible designs, which may be implemented by hardware executing corresponding software. The hardware or software comprises one or more modules corresponding to the functions. Such as: the processing device comprises an acquisition unit, a processing unit and a transmission unit.

An acquisition unit configured to acquire video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and multiple video sources are used to capture the target area from different angles.

The processing unit is used for carrying out video coding on video streams of a plurality of video sources to obtain video links in a preset format; video links are used to associate video streams of multiple video sources.

And the transmission unit is used for sending the video link to the terminal equipment and playing the video stream through the webpage by the terminal equipment.

In a possible implementation manner, the processing unit is specifically configured to: if the video source does not support the preset protocol, converting the video stream of the video source into a video stream in the FLV format of the streaming media format, and generating a video link associated with the video stream in the FLV format; if the video source supports the preset protocol, the video stream of the video source is packaged into a video stream in the HTTP format, and a video link associated with the video stream in the HTTP format is generated.

In a possible implementation manner, the apparatus further includes a storage unit, configured to store video streams of the plurality of video sources. And the transmission unit is also used for responding to the request information of the review video of the terminal equipment, acquiring the video stream corresponding to the request information from the stored video streams and sending the video stream to the terminal equipment.

In a possible implementation manner, the transmission unit is specifically configured to: and sending the video stream corresponding to the request information to one or more CDN servers of the content delivery network so that the terminal equipment obtains the video stream from one or more CDN services.

In a possible implementation manner, the transmission unit is specifically configured to: and sending a video data packet to the terminal equipment, wherein the video data packet comprises a video stream corresponding to the request information and preset parameters, and the preset parameters are used for indicating the size of the video stream.

In a possible implementation manner, the streaming media platform includes a video distribution device, where the video distribution device includes a main device and an auxiliary device, the video distribution device is configured to send a video stream to the terminal device, and the transmission unit is further configured to send request information to the auxiliary device in response to a data processing capability of the main device exceeding a preset threshold or the main device being unable to perform a video stream distribution function, so that the auxiliary device sends a corresponding video stream to the terminal device according to the request information.

In a third aspect, a communication device is provided, which may be a streaming media platform or a chip or a system on a chip in a streaming media platform. The communication device may implement the functions performed by the streaming media platform in the above aspects or in each possible design, where the functions may be implemented by hardware, for example: in one possible design, the communication device may include: a processor and a communication interface, the processor being operable to support a communication device to implement the functionality involved in the first aspect or any one of the possible designs of the first aspect, for example: the processor obtains video streams of a plurality of video sources through the communication interface.

In yet another possible design, the communication device may further include a memory for holding computer-executable instructions and data necessary for the communication device. When the communication device is running, the processor executes the computer-executable instructions stored in the memory, so that the communication device performs the video stream transmission method according to the first aspect or any one of the possible designs of the first aspect.

In a fourth aspect, a computer readable storage medium is provided, which may be a readable non-volatile storage medium, the computer readable storage medium storing computer instructions or a program which, when run on a computer, cause the computer to perform the method of transmitting a video stream according to the first aspect or any one of the possible designs of the above aspects.

In a fifth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the processing method of the first aspect or any one of the possible designs of the aspects.

In a sixth aspect, a communication device is provided, which may be a processing device or a chip or a system on a chip in a processing device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, the one or more memories being configured to store computer program code comprising computer instructions that, when executed by the one or more processors, cause the processing apparatus to perform the processing method as described above in the first aspect or any of the possible designs of the first aspect.

In a seventh aspect, a chip system is provided, the chip system comprising a processor and a communication interface, the chip system being operable to implement the functions performed by the processing means in the first aspect or any of the possible designs of the first aspect, e.g. the processor being operable to obtain a plurality of measurement data of a target cell via the communication interface. In one possible design, the chip system further includes a memory for holding program instructions and/or data. The chip system may be composed of a chip, or may include a chip and other discrete devices, without limitation.

The technical effects caused by any design manner of the second aspect to the seventh aspect may be referred to the technical effects caused by any possible design of the first aspect, and are not described herein.

Drawings

Fig. 1 is a schematic structural diagram of a monitoring system according to an embodiment of the present application;

FIG. 2 is a schematic structural diagram of another monitoring system according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a communication device 300 according to an embodiment of the present application;

fig. 4 is a flow chart of a video stream transmission method according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a display interface of a web page according to an embodiment of the present disclosure;

fig. 6 is a flowchart of another video stream transmission method according to an embodiment of the present application;

fig. 7 is a flowchart of another video stream transmission method according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a communication device 80 according to an embodiment of the present application.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of embodiments of the present application as detailed in the accompanying claims.

It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, and/or components.

Prior to introducing the embodiments of the present application, related technical terms related to the embodiments of the present application are explained. It should be noted that these descriptions are for easier understanding of the embodiments of the present application, and should not be construed as limiting the scope of protection claimed by the embodiments of the present application.

The real-time messaging protocol (real time messaging protocol, RTMP) is a family of protocols. The protocol is based on TCP, and can include RTMP basic protocol and RTMPT/RTMPS/RTMPE and other varieties.

RTMP is a network protocol designed for real-time data communication, and is mainly used for audio-video and data communication between Flash/AIR platform and streaming media/interactive server supporting RTMP protocol. Software supporting this protocol includes Adobe Media Server, ultrant Media Server, red5, etc. RTMP, like HTTP, belongs to the application layer of the TCP/IP four-layer model.

Further, in the embodiment of the present application, the transmission protocols may further include a (, transmission control protocol/internet protocol (transmission control protocol/internet protocol, TCP/IP), a network control packet protocol (internet control message protocol, ICMP), a hypertext transfer protocol (hyper text transfer protocol, HTTP), a hypertext transfer security protocol (hypertext transfer protocol secure, HTTPs), a file transfer protocol (file transfer protocol, FTP), a dynamic host configuration protocol (dynamic host configuration protocol, DHCP), a domain name system (domain name system, DNS), a dynamic domain name service (dynamic domain name server, DDNS), a real-time transport protocol (real-time transport protocol, RTP), a real-time streaming protocol (real time streaming protocol, RTSP), an ethernet-based point-to-point communication protocol (point-to-point protocol over ethernet, PPPoE), a network time protocol (network time protocol, NTP), a universal plug and play (universal plug and play, UPnP), a simple mail transfer protocol (simple mail transfer protocol, SMTP), a simple network management protocol (simple network management protocol, SNMP), an internet group management protocol (internet group management protocol, IGMP), 802.1X, a quality of service (quality of service, qoS)), an RTSP/mp.

In a complex construction site, video monitoring can ensure construction quality and personal safety of constructors, and monitor properties such as building materials, equipment and the like; the video monitoring can uniformly manage the dispersed construction sites, so that frequent site supervision and inspection are avoided, the management cost of site personnel is reduced, and the working efficiency is improved.

The current intelligent construction (building site) industry is mostly the current access situation of a single platform, and monitoring equipment (such as a high-definition camera) of each manufacturer only supports a private protocol of an industrial chain of the technology based on a proprietary standard protocol, so that cross-platform, cross-protocol, cross-brand business requirements and old-utilization requirements cannot be realized, and the coverage of intelligent building site products is restricted. The monitoring equipment arranged on the intelligent building site has the phenomenon of supporting different video transmission protocols with multiple brands. For example, a plurality of monitoring devices supporting different video transmission protocols can be installed on the same site, and for example, monitoring devices supporting common transmission protocols in industries such as Ehome transmission protocol, RTSP transmission protocol, HTTP-based streaming media transmission protocol (HTTP live streaming, HLS), streaming video Format (FLV), m3u8, national standard GB28181 and the like can be included.

For installing a plurality of monitoring devices supporting different video transmission protocols on the same site, since one platform can only access the monitoring devices supporting the same video transmission protocol, a worker needs to watch video streams shot by the plurality of monitoring devices supporting different video transmission protocols through a plurality of platforms.

For example, a security center (ISC) streaming platform is a proprietary protocol transcoding and decoding platform that supports device access by a vendor. The platform is connected with monitoring equipment to carry out access management, video management and user management on the camera. However, the platform cannot utilize cameras of the original construction site, namely, cannot uniformly manage video streams shot by various monitoring devices, and cannot integrate safety event data of the site construction condition through uniform pictures.

In addition, the monitoring equipment is generally deployed at a fixed position for monitoring, and can not realize the visualization of a mobile video and the morphological supplementation of multiple visual angles, and can not realize the cooperative linkage of a monitoring picture and pictures of other visual angles.

In view of this, the embodiment of the application provides a video stream transmission method, which is applied to a streaming media platform, and the streaming media platform can obtain a link in an http protocol format by transcoding a video stream shot by a video source supporting multiple video transmission protocols. Based on the link, the user can view video streams photographed by different video sources through a web page of the terminal.

Furthermore, in the embodiment of the application, the streaming media platform can also perform multi-angle auxiliary deviation correction on the monitoring equipment, so that shooting can be performed dynamically at multiple angles.

In an example, in the embodiment of the present application, multiple video sources may directionally push the collected high-definition video to the streaming media platform through a network device (such as a 5G base station). The streaming media platform can fuse video streams of a plurality of video sources to form a unified HTTPS protocol, and forms the video into a unified live broadcast picture through a WEB browser to realize uploading and downloading of video information and information intercommunication.

In addition, in the embodiment of the application, the uploading channels of the remote monitoring camera and the streaming media platform in various protocols realize the collaborative linkage of a plurality of video pictures. And pushing the video to the streaming media platform through different protocols to form the fusion capability of the platform multi-source video.

The user can form a three-dimensional video picture from 360 degrees with multiple angles and multiple dimensions, so that the problems of visual dead angles, errors when visual angles change, association of video recordings and project construction operation pictures and the like are effectively solved, and effective collaboration of remote guidance of project construction operation is ensured.

The method provided in the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of a monitoring system according to an embodiment of the present application. As shown in fig. 1, the monitoring system may include a streaming platform, a plurality of video sources, and a terminal device. And the video sources and the terminal equipment are respectively connected with the streaming media platform.

The streaming media platform can be used for managing a plurality of video sources and video streams shot by the video sources. For example, the streaming platform may convert a video stream captured by a video source into a link in a preset format. The link may be associated with a video stream.

The video source may be used to capture a video stream. For example, the video sources may include monitoring devices (e.g., dome cameras, rifle bolts, etc.), hand held terminals, personal computer (personal computer, PC) cameras, etc. The main functions of the monitoring equipment are to collect, buffer, schedule and transmit and play media content.

The monitoring equipment can comprise an eagle eyeball machine, a panoramic ball machine and a fixed focus gun machine. The three monitoring devices are described below, respectively.

1. Eagle eyeball machine.

The eagle eyeball machine is imaging equipment with a holder and zooming capability. The eagle eyeball machine can horizontally rotate by 360 degrees and vertically rotate by 180 degrees, and can also optically zoom to pull in a far mirror image.

2. A panoramic ball machine.

The panoramic camera can be integrated camera equipment formed by combining 6-8 panoramic cameras and eagle eyeball machines. The panoramic camera can combine photographed pictures through built-in software to form a 360-degree panoramic video.

3. Fixed focus rifle bolt.

The camera Jiao Qiangji is a directional shooting camera without a holder and zoom capability.

The terminal device in fig. 1 may be configured to acquire a video stream captured by a video source based on a link associated with the video stream, and display the acquired video stream.

In some examples, the terminal device may be installed with a browser. The terminal device may send complaint information to the server in response to an input operation of the user by the APP. The input operation of the user may refer to an operation of the user to input complaint information.

In some examples, the terminal device may send complaint information to the server in response to a complaint operation by the user. For example, the complaint operation of the user may be an operation of making a complaint call, sending a complaint short message, or the like.

Specifically, the terminal device may be a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. Specifically, the terminal may be a mobile phone (mobile phone), a tablet computer, or a computer with a wireless transceiver function, and may also be a Virtual Reality (VR) device, an augmented reality (augmented reality, AR) device, a wireless terminal in industrial control, a wireless terminal in unmanned driving, a wireless terminal in telemedicine, a wireless terminal in smart grid, a wireless terminal in smart city (smart city), a smart home, a vehicle-mounted terminal, and the like.

In one possible implementation, as shown in fig. 2, a schematic diagram of another monitoring system is provided in an embodiment of the present application. The monitoring system may include a plurality of video sources, an access layer, a protocol layer, and an application layer. Multiple video sources may be connected to the access stratum through a communication network, such as a fifth generation (5th generation,5G) communication network.

The access layer may be used to support access of video sources of multiple vendors (such as vendor 1-vendor 3 in the figure), multiple transmission protocols (such as Ehome, integrated services digital network user part (integrated services digital network user part, ISUP), GB28181, ONVIF, RTMP, RTSP, FLV, m u8, web real-time communication (web real-time communication, WEBRTC)), multiple types (such as ISC video source, third party video source, mobile terminal/PC terminal, etc.).

Specifically, the access layer can integrate access of multiple protocols, can be compatible with multiple types of video sources, and can effectively avoid the problems of complexity and non-universality of manufacturer private protocol customization when hardware equipment is adopted.

Based on the protocol integration, the centralized processing efficiency of the platform is improved while the resource sharing is realized.

In the embodiment of the application, the access layer also supports multi-class terminal cross-platform access, third-party video access, device push access, device link access, video source access and multi-brand video channel fusion. The access layer can support the access and forwarding of video streams of various standards such as national standards GB/T28181, SDK, onvif, RTSP protocol, ehome protocol and the like, and the access of video source equipment such as a network camera, a network video recorder (network video recorder, NVR), a video server, encoder equipment and the like, and support cascading to an ultra-high-definition streaming media application platform. The application layer can also provide video scheduling and video resource sharing for various cooperation providers in an HTTPS mode, so that seamless butt joint, transmission and distribution of video streams are realized.

In addition, the access layer may also provide cross-platform software development kit (software development kit, SDK) interfacing. The access layer acquires project pictures of the fixed object class expansion assembly (object linking and embedding control extension, OCX) from the ISC platform by establishing interconnection among a plurality of platforms, and establishes long links with other platforms by an application program interface (application programming interface, API) to form a converged streaming media video middle platform. In the access layer, a centralized protocol distribution center is established by adapting to multiple manufacturer equipment of an ISC platform and an external third party, front-end video live broadcasting is realized by protocol scheduling, and video operation surfaces are watched, so that one-line safety operation can be effectively guided, construction is standardized, and an event early warning guiding mechanism is provided.

The protocol layer in fig. 2 may include multiple platforms, for example, an ISC platform, a streaming media platform.

The application layer may be used to provide dynamic based up-to-date event campaigns and to categorize and implement hot spots by item for recommendation. The application layer may also be used to provide high definition images, as well as switching of TAB TABs and playback of streaming video according to event morphology.

The application layer may be configured to convert video streams of video sources of multiple transmission protocols into video links in HTTP protocol format.

In one example, the application layer may also be provided with a converged streaming application platform. The application platform may authenticate and authenticate a third party application (e.g., a terminal device). For example, the application platform may be provided with an API. The API is used for communication connection with the terminal device.

Furthermore, the application layer may be further configured to control a camera (such as an eagle eyeball machine or a panoramic dome camera) with a pan-tilt-zoom (PTZ) and sequentially control the fixed-point movement and shooting of the camera according to a set time period and frequency and pan-tilt-zoom (PTZ) parameters. In the process of controlling the camera inspection, important data of the key nodes can be recorded by taking the event as an locating point and stored together with the video, so that the data of the video structuring comprises. The data packet may include at least: fixed point titles, freeze shots, PTZ data, time stamps, environmental sensor values, artificial intelligence (artificial intelligence, AI) alarm event shots, AI alarm data.

In one example, the application layer may also be used to manage users. For example, there may be user management functions (e.g., user roles, rights partitioning, new creation, modification, deletion, statistics), per-user billing systems, providing packaged compression of old data, providing cache access to new data, providing decompression and temporary access to old data queries.

The old data may refer to video data photographed before the current time. The new data may refer to video data photographed at the current time.

In another example, the application layer may also manage intranet penetration hardware, directly control the camera through the peanut shell service, and obtain the current PTZ parameter of the camera or set the PTZ parameter of the camera, so as to provide the control capability for the camera for the streaming media platform.

In one possible implementation, the streaming media platform may open the underlying interworking by applying a cascade. The streaming media platform can be accessed to and administrated to all lower-level platforms (such as ISC platform) for realizing the priority retrieval and control authority. Under specific conditions, the streaming media platform can take over all the functional access layers of the lower-level platform.

In one example, the streaming media platform may obtain video streams through APIs of various smart sites. For example, the streaming platform may determine a path to acquire the video stream based on the internet protocol (Internet protocol, IP) address of the video source and the internet data center (internet data center, IDC) address, and acquire the video stream through the path. In the data transmission process, the streaming media platform can detect and monitor, and in the case of path failure, data transmission is performed through other paths.

In one possible implementation, one or more content delivery network (content delivery network, CDN) servers may also be included in the monitoring system of fig. 1 and 2. The CDN server may be used to store the video stream. That is, the streaming platform may push the video stream captured by the video source to the CDN server. Thus, the terminal equipment can acquire the video stream from the CND server nearby, and the transmission pressure of the video stream of the streaming media platform is reduced.

In some embodiments, the platform and the various layers in the monitoring system may be carried on a server. The server may be a single server, or may be a server cluster composed of a plurality of servers. In some implementations, the server cluster may also be a distributed cluster. The server may be an entity server or a virtual server, etc.

The system architecture and the service scenario described in the embodiments of the present application are for more clearly describing the technical solution of the embodiments of the present application, and do not constitute a limitation on the technical solution provided in the embodiments of the present application, and those skilled in the art can know that, with the evolution of the network architecture and the appearance of the new service scenario, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.

It should be noted that fig. 1 and fig. 2 are only exemplary frame diagrams, the number of devices in fig. 1 and fig. 2 is not limited, and names of the respective devices are not limited, and other nodes may be included in addition to the functional nodes shown in fig. 1 and fig. 2.

The application scenario of the system is not limited in the embodiments of the present application. The system architecture and the service scenario described in the embodiments of the present application are for more clearly describing the technical solution of the embodiments of the present application, and do not constitute a limitation on the technical solution provided in the embodiments of the present application, and those skilled in the art can know that, with the evolution of the network architecture and the appearance of the new service scenario, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.

In particular, the apparatus of fig. 1 and 2 may each employ the constituent structure shown in fig. 3, or may include the components shown in fig. 3. Fig. 3 is a schematic diagram of a communication device 300 according to an embodiment of the present application, where the communication device 300 may be a chip or a system on a chip in a network device. Alternatively, the communication device 300 may be a chip or a system on chip in a terminal apparatus. Alternatively, the communication device 300 may be a chip or a system on a chip in a processing device. As shown in fig. 3, the communication device 300 includes a processor 301, a communication interface 302, and a communication line 303.

Further, the communication device 300 may also include a memory 304. The processor 301, the memory 304, and the communication interface 302 may be connected by a communication line 303.

The processor 301 is a CPU, general-purpose processor, network processor (network processor, NP), digital signal processor (digital signal processing, DSP), microprocessor, microcontroller, programmable logic device (programmable logic device, PLD), or any combination thereof. The processor 301 may also be any other device having processing functions, such as, without limitation, a circuit, a device, or a software module.

A communication interface 302 for communicating with other devices or other communication networks. The other communication network may be an ethernet, a radio access network (radio access network, RAN), a wireless local area network (wireless local area networks, WLAN), etc. The communication interface 302 may be a module, a circuit, a communication interface, or any device capable of enabling communication.

A communication line 303 for transmitting information between the components included in the communication apparatus 300.

Memory 304 for storing instructions. Wherein the instructions may be computer programs.

The memory 304 may be, but not limited to, a read-only memory (ROM) or other type of static storage device capable of storing static information and/or instructions, a random access memory (random access memory, RAM) or other type of dynamic storage device capable of storing information and/or instructions, an EEPROM, a CD-ROM (compact disc read-only memory) or other optical disk storage, an optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, etc.

It should be noted that the memory 304 may exist separately from the processor 301 or may be integrated with the processor 301. Memory 304 may be used to store instructions or program code or some data, etc. The memory 304 may be located in the communication device 300 or may be located outside the communication device 300, without limitation. The processor 301 is configured to execute the instructions stored in the memory 304 to implement the method for determining antenna parameters provided in the following embodiments of the present application.

In one example, processor 301 may include one or more CPUs, such as CPU0 and CPU1 in fig. 3.

As an alternative implementation, the communication device 300 includes multiple processors, e.g., in addition to the processor 301 in fig. 3, a processor 307 may be included.

As an alternative implementation, the communication apparatus 300 further comprises an output device 305 and an input device 306. Illustratively, the input device 306 is a keyboard, mouse, microphone, or joystick device, and the output device 305 is a display screen, speaker (spaker), or the like.

It should be noted that the communication apparatus 300 may be a desktop computer, a portable computer, a web server, a mobile phone, a tablet computer, a wireless terminal, an embedded device, a chip system, or a device having a similar structure as in fig. 3. Furthermore, the constituent structures shown in fig. 3 do not constitute limitations on the respective apparatuses in fig. 1 and 2, and the respective apparatuses in fig. 1 and 2 may include more or less components than illustrated, or may combine some components, or may be arranged differently, in addition to the components shown in fig. 3.

In the embodiment of the application, the chip system may be formed by a chip, and may also include a chip and other discrete devices.

Further, actions, terms, etc. referred to between embodiments of the present application may be referred to each other without limitation. In the embodiment of the present application, the name of the message or the name of the parameter in the message, etc. interacted between the devices are only an example, and other names may also be adopted in the specific implementation, and are not limited.

In this application, the terms "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.

The following describes a method for handling complaint problems provided in the embodiment of the present application with reference to the communication systems shown in fig. 1 and 2. Wherein, the actions, terms and the like related to the embodiments of the present application can be referred to each other without limitation. In the embodiment of the present application, the name of the message or the name of the parameter in the message, etc. interacted between the devices are only an example, and other names may also be adopted in the specific implementation, and are not limited. The actions involved in the embodiments of the present application are just an example, and other names may be used in specific implementations, for example: the "included" in the embodiments of the present application may also be replaced by "carried on" or the like.

Fig. 4 provides a method for transmitting a video stream according to an embodiment of the present application, as shown in fig. 4, where the method includes:

s401, acquiring video streams of a plurality of video sources.

The video source may be the video source in fig. 1. The video transmission protocols supported by different video sources are different. The video transmission protocol may refer to the above-mentioned various transmission protocols, and will not be described in detail. The plurality of video sources may be used to capture the target area from different angles. The target area may be a worksite as described above. Other areas are also possible, such as public places, traffic scenes, etc.

In one example, after capturing a video stream of a target area, a video source may upload the captured video stream to a streaming platform. Thus, the streaming media platform can acquire video streams shot by a plurality of video sources.

In yet another example, the streaming platform may send indication information to a plurality of video sources. The indication information may be used to indicate the area taken by the video source. For example, the indication information may include a PTZ parameter. After receiving the indication information, the video source can adjust the shooting angle according to the indication information. For example, the angle of the pan-tilt may be adjusted according to the PTZ parameter in the indication information so that the camera of the video source is directed towards the target area.

It should be noted that, in the embodiment of the present application, the video transmission protocol is a format of an adaptation environment for streaming media playing, and is a transmission carrier of different applications.

S402, video encoding is carried out on video streams of a plurality of video sources, and video links in a preset format are obtained.

Wherein the video link may be used to associate video streams of a plurality of video sources. The preset format may be set as needed, for example, the video link may be a link in HTTP format. Video coding may refer to converting a video stream in an original video format into a video stream in another video format by compression techniques. For example, video encoding may be in the format of h.261, H263, H264, a technique, i.e., motion-still image compression (motion-join photographic experts group, M-JPEG), or motion picture standard (motion picture experts group, MPEG).

In one possible implementation, the streaming platform may encode the video stream of the video source with different video encodings, depending on the type of protocol supported by the video source. For example, the preset protocol may be RTSP, RTMP protocol.

In one example, if the video source does not support a preset protocol, the streaming media platform may convert the video stream of the video source to a video stream in FLV format and generate a video link associated with the video stream in FLV format.

For example, the streaming media platform may compress a video stream of the video source through h.264, and transcode the video stream through FFMPEG to obtain a video stream in FLV format.

In yet another example, if the video source supports a preset protocol, the streaming media platform may convert the video stream of the video source to a video stream in HTTP format and generate a video link associated with the video stream in HTTP format.

For example, the streaming platform may encapsulate a video stream into a video stream in RTMP format, and then convert the video stream in RTMP format into a video stream in HTTP format.

Further, the streaming platform may establish a web page (web) -based address (i.e., video link) after converting the video stream into a video stream in FLV format or HTTP format. The address may indicate a storage address of the video stream. That is, the streaming platform may store the video stream after receiving the video stream.

In one example, the streaming platform may be provided with NVR. The NVR device can be used for video recording, storing and forwarding of video streams. After video encoding the video stream, the streaming media platform may store the video stream to the NVR and generate an HTTP link indicating a storage address of the video stream in the NVR. That is, the HTTP link is used to indicate the storage address of the video stream in the NVR.

S403, sending the video link to the terminal equipment. Correspondingly, the terminal device receives the video link.

After receiving the video link, the terminal device may obtain the video stream according to the video link, and play the video stream through the web page.

In one possible implementation manner, the streaming media platform may generate and send a video link matched with the configuration information to the terminal device according to the configuration information of the terminal device.

For example, the streaming media platform may obtain an operating system of the terminal device and a supporting kernel of the browser. Thus, the streaming media platform can generate the corresponding video link according to the operating system (such as an android system and an ISO system) of the terminal equipment and the supporting kernel of the browser. In this way, the streaming platform may generate a video link adapted to the terminal device based on the type of the terminal device. The terminal equipment can play the video stream normally.

In one example, video streaming may be divided into sequential streaming and real-time streaming. Wherein. The sequential streaming may mean that when the terminal device plays the video stream through the video link, the video stream may be played in real time, and the mode of sequential streaming does not support the video playback mechanism. Real-time streaming may refer to playing of a real-time stream formed after video streaming is buffered by NVR, supporting a video playback mechanism.

It should be noted that, when the video stream is streamed in real time, the bandwidth needs to be set, so as to ensure that the video stream can be transmitted to the terminal device in real time. The terminal device can view the video content before or after the current time at will.

In particular, real-time streaming requires the provision of dedicated servers and the use of preset transport protocols (e.g., RTSP, microsoft media server (microsoft media server, MMS), etc.).

In one example, as shown in fig. 5, an exemplary diagram of an interface for a terminal device to play multiple video streams is shown. In fig. 5, the terminal device may display video streams of a plurality of video sources on the same web page. The terminal equipment can acquire video streams of a plurality of video sources according to the video links, and display the video streams of the plurality of video sources on the same webpage through a plurality of windows.

Wherein the plurality of windows in fig. 5 may include a primary window and a plurality of secondary windows. The primary window may be used to display a video stream and the secondary window may be used to associate a video stream of a video source.

In a possible implementation manner, after acquiring the video links associated with the multiple video sources, the terminal device may acquire multiple video streams according to the video links, play any one of the multiple video streams on the primary window, and display pictures of the video streams of each video source on multiple secondary windows respectively. The picture may be a picture in a video structured data packet as described above.

In connection with the page of fig. 5, the terminal device may play the video stream of the video source associated with the secondary window in the primary window in response to clicking the secondary interface. The terminal device may also change the video stream played by the main window in response to the switching operation.

Based on the technical scheme of fig. 4, after the streaming media platform obtains video streams of a plurality of video sources supporting different video transmission protocols, video encoding can be performed on the video streams of the plurality of video sources to obtain video links associated with the video streams, and the video links are sent to the terminal device. The terminal device may play the video stream on the web page via the video link. Thus, for video sources supporting different video transmission protocols, the streaming media platform can fuse multiple video streams to obtain a video link associated with multiple video sources. In this way, the terminal device can link videos and play video streams of a plurality of video sources on the webpage.

In some embodiments, as shown in fig. 6, the method provided in the embodiments of the present application may further include S601 and S602.

S601, storing video streams of a plurality of video sources.

In one example, to address the problem of video streaming misordering caused by worksite asynchronous networks, network delays, and jitter, the streaming platform may first cache the video streaming, for example, into the NVR.

Furthermore, in order to avoid buffer overflow, the streaming media platform may buffer the video stream with a circular linked list structure, and delete the video stream already acquired by the terminal device.

S602, responding to request information of the review video of the terminal equipment, acquiring a video stream corresponding to the request information from the stored video streams, and sending the video stream to the terminal equipment. Correspondingly, the terminal equipment receives and plays the video stream.

The request information of the review video may be request information generated by the terminal device in response to the operation of the review video stream of the user and sent to the streaming media platform. The operation of looking back at the video stream may refer to an operation in which the user clicks a play progress bar of the video stream or clicks a look back button.

In one example, the terminal device may generate and send request information for watching back the video to the streaming media platform in response to an operation of watching back the video stream by the user. The request information may include the review video stream and progress information (e.g., time information, progress scale) of the review video stream. Thus, after receiving the request information, the streaming media platform can determine the corresponding video stream according to the progress information and send the video stream corresponding to the progress information to the terminal device.

For example, the progress information of the video stream currently played by the terminal device is 20% (i.e., the data of the first 20% of the video stream has been played by the terminal device). The terminal device may send a request for 10% -20% of video data to the streaming platform in response to an operation of reviewing 10% of the video stream.

Also for example, the time information of the current fluctuating video stream of the terminal device is 10 minutes (i.e. the terminal device has played for 10 minutes). The terminal device may send video data from 5 th to 10 th minutes to the streaming platform in response to an operation of reviewing the 5 th minute video stream.

In the embodiment of the application, the streaming media platform can randomly review the live broadcast content in the live broadcast process. That is, the terminal device may trace back to a certain point in time at the current point in time, and replay the video stream from the point in time until the video stream is played.

Further, in order to relieve the pressure of the streaming media platform, the streaming media platform may send video streams corresponding to the request information to one or more CDN servers. In this way, the terminal device can obtain the video stream from the CDN server closest to the terminal device. The response speed is improved, and meanwhile, the data processing pressure of the streaming media platform and the blocking degree of the bandwidth are reduced.

In one possible manner, the streaming platform may send video data packets to the terminal device. Correspondingly, the terminal equipment receives the video data packet from the streaming media platform.

The video data packet may include a video stream corresponding to the request information and a preset parameter. The preset parameter may be used to indicate the size of the video stream. For example, the preset parameter may be a length parameter. Based on the preset parameters, the terminal device may determine the size of the video stream that needs to be received.

Further, if the video data packet has no preset parameter, the terminal device will keep the state of receiving the video data consistently.

In one example, the video data packet may also include metadata (metadata) for the video data. The metadata may be used to indicate attribute information of the video stream.

The metadata may be referred to as intermediate data or relay data. The attribute information of the video stream may include a storage location of the video stream, history data, resource lookup, file recording, and the like.

Based on the solution of figure 6, the streaming platform may store the acquired video data. Therefore, when the user needs to review the video, the streaming media platform stores the video data, so that the corresponding video data can be obtained from the stored video data according to the user demand and sent to the terminal equipment of the user, the user demand is met, and the user experience is improved.

In some embodiments, a streaming media platform provided by embodiments of the present application may include a video distribution device. The video distribution device may be used to send a video stream to a terminal device.

In one example, the video distribution device may be divided into a primary device and a secondary device. Wherein the master device is configured to perform a video distribution function. For example, the master device may send a video stream to the terminal device. The secondary device may be configured to perform the function of the primary device in the event that the primary device fails to function properly.

Specifically, the streaming media platform may forward the request information from the terminal device to the auxiliary device in response to the data processing capability of the main device exceeding a preset threshold or the main device being unable to perform the video distribution function, so that the auxiliary device may send the corresponding video stream to the terminal device according to the request information.

For example, after the media streams of the ISC platform and the third party video sources are fused, video distribution devices within the same group may cooperate with each other to load balance in a redirected manner. Video distribution devices within a group may include a primary device and a secondary device.

When the data processing capability of the main device reaches a predetermined threshold, the streaming platform may redirect the request information (such as the video preview request information) of the terminal device to the auxiliary device. After receiving the request information, the auxiliary equipment can inquire the streaming media platform to acquire a video stream corresponding to the request information and execute a data distribution task.

Further, when the streaming media comment detects that the primary device has failed, the secondary device may be used as the primary device. In this way, the usability of the monitoring system can be improved.

In some embodiments, to reduce network overhead, the streaming platform may compress the video stream of the video source using a higher compression rate. For example, H.264/AVC may be employed to compress a video stream of a video source.

In still other embodiments, to better encode the video stream of the video source, the streaming platform may select an optimal video encoding from a plurality of video encodings according to network parameters such as bandwidth, packet loss rate, delay, etc. The above description may be referred to for multiple video encodings, and will not be repeated.

For example, when the bandwidth is smaller than a preset bandwidth and/or the delay is higher than a preset delay, the video stream may be encoded by the video encoding with the highest compression rate of the plurality of video encodings.

For another example, when the packet loss rate is higher than a preset threshold, video encoding with a smaller compression rate may be used to encode the video stream.

In some embodiments, as shown in fig. 7, in the embodiments of the present application, the camera may transmit the video stream to the converged streaming media application platform through RTMP push. The fusion streaming media application platform can generate and send video links to the terminal equipment through CDN technology and video transcoding technology. The terminal device may acquire and play the video stream based on the video link.

The various schemes in the embodiments of the present application may be combined on the premise of no contradiction.

The embodiment of the present application may divide the functional modules or functional units of the processing apparatus of the same sector cell according to the above method example, for example, each functional module or functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules may be implemented in hardware, or in software functional modules or functional units. The division of the modules or units in the embodiments of the present application is merely a logic function division, and other division manners may be implemented in practice.

In the case of dividing the respective functional modules by the respective functions, fig. 8 shows a schematic configuration of a communication device 80, which may be a server or a chip applied to the server, and the communication device 80 may be used to perform the functions of the network apparatus as described in the above embodiments. The communication device 80 shown in fig. 8 may include: acquisition unit 801, processing unit 802, transmission unit 803.

An acquiring unit 801, configured to acquire video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and multiple video sources are used to capture the target area from different angles.

A processing unit 802, configured to perform video encoding on video streams of a plurality of video sources to obtain a video link in a preset format; video links are used to associate video streams of multiple video sources.

A transmission unit 803, configured to send a video link to the terminal device, for the terminal device to play the video stream through the web page.

In a possible implementation manner, the processing unit 802 is specifically configured to: if the video source does not support the preset protocol, converting the video stream of the video source into a video stream in the FLV format of the streaming media format, and generating a video link associated with the video stream in the FLV format; if the video source supports the preset protocol, the video stream of the video source is packaged into a video stream in the HTTP format, and a video link associated with the video stream in the HTTP format is generated.

In a possible implementation manner, the apparatus further includes a storage unit 804, configured to store video streams of the plurality of video sources. The transmission unit 803 is further configured to, in response to the request information of the review video of the terminal device, obtain a video stream corresponding to the request information from the stored video streams, and send the video stream to the terminal device.

In a possible implementation manner, the transmission unit 803 is specifically configured to: and sending the video stream corresponding to the request information to one or more CDN servers of the content delivery network so that the terminal equipment obtains the video stream from one or more CDN services.

In a possible implementation manner, the transmission unit 803 is specifically configured to: and sending a video data packet to the terminal equipment, wherein the video data packet comprises a video stream corresponding to the request information and preset parameters, and the preset parameters are used for indicating the size of the video stream.

In a possible implementation manner, the streaming media platform includes a video distribution device, where the video distribution device includes a main device and an auxiliary device, and the video distribution device is configured to send a video stream to a terminal device, and the transmission unit 803 is further configured to: and in response to the data processing capability of the main device exceeding a preset threshold or the main device being unable to execute the video stream distribution function, sending request information to the auxiliary device, so that the auxiliary device sends a corresponding video stream to the terminal device according to the request information.

In one possible design, the memory unit 804 is also used to store program codes and instructions.

As yet another alternative, the processing unit 802 in fig. 8 may be replaced by a processor, which may integrate the functions of the processing unit 802. The acquisition unit 801 in fig. 8 may be replaced by a transceiver or a transceiving unit, which may integrate the functions of the acquisition unit 801.

Further, when the processing unit 802 is replaced by a processor and the acquiring unit 801 is replaced by a transceiver or a transceiving unit, the communication device 80 according to the embodiment of the present application may be a communication device shown in fig. 3.

Embodiments of the present application also provide a computer-readable storage medium. All or part of the flow in the above method embodiments may be implemented by a computer program to instruct related hardware, where the program may be stored in the above computer readable storage medium, and when the program is executed, the program may include the flow in the above method embodiments. The computer readable storage medium may be an internal storage unit of the communication device (including the data transmitting end and/or the data receiving end) of any of the foregoing embodiments, for example, a hard disk or a memory of the communication device. The computer readable storage medium may be an external storage device of the terminal apparatus, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash card (flash card), or the like, which are provided in the terminal apparatus. Further, the computer readable storage medium may further include both an internal storage unit and an external storage device of the communication apparatus. The computer-readable storage medium is used to store the computer program and other programs and data required by the communication device. The above-described computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

It should be noted that the terms "first" and "second" and the like in the description, claims and drawings of the present application are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.

It should be understood that, in the present application, "at least one (item)" means one or more, "a plurality" means two or more, "at least two (items)" means two or three and three or more, "and/or" for describing an association relationship of an association object, three kinds of relationships may exist, for example, "a and/or B" may mean: only a, only B and both a and B are present, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b or c may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural.

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for transmitting a video stream, the method being applied to a streaming media platform, the method comprising:

acquiring video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and the video sources are used for shooting target areas from different angles;

video encoding is carried out on the video streams of the video sources to obtain video links in a preset format; the video link is used for associating video streams of the plurality of video sources;

and sending the video link to terminal equipment for the terminal equipment to play the video stream through a webpage.

2. The method of claim 1, wherein video encoding the video streams of the plurality of video sources to obtain a video link in a preset format comprises:

if the video source does not support the preset protocol, converting the video stream of the video source into a video stream in a streaming media format FLV format, and generating a video link associated with the video stream in the FLV format;

And if the video source supports the preset protocol, packaging the video stream of the video source into a video stream of a hypertext transfer protocol (HTTP) format, and generating a video link associated with the video stream of the HTTP format.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

storing video streams of the plurality of video sources;

and responding to the request information of the review video of the terminal equipment, acquiring a video stream corresponding to the request information from the stored video stream, and sending the video stream to the terminal equipment.

4. A method according to claim 3, wherein said sending said video stream to said terminal device comprises:

and sending the video stream corresponding to the request information to one or more CDN servers of the content delivery network, so that the terminal equipment obtains the video stream from the one or more CDN services.

5. A method according to claim 3, wherein said sending said video stream to said terminal device comprises:

and sending a video data packet to the terminal equipment, wherein the video data packet comprises a video stream corresponding to the request information and a preset parameter, and the preset parameter is used for indicating the size of the video stream.

6. The method of claim 5, wherein the video data packet further comprises metadata indicating attribute information of the video stream.

7. The method of claim 3, wherein the streaming platform comprises a video distribution device comprising a primary device and a secondary device, the video distribution device configured to send the video stream to the terminal device, the method further comprising:

and in response to the data processing capability of the main equipment exceeding a preset threshold or the main equipment being incapable of executing the video stream distribution function, sending the request information to the auxiliary equipment, so that the auxiliary equipment sends a corresponding video stream to the terminal equipment according to the request information.

8. A transmission device for a video stream, applied to a streaming platform, the transmission device comprising:

an acquisition unit configured to acquire video streams of a plurality of video sources; the video transmission protocols supported by different video sources are different, and the video sources are used for shooting target areas from different angles;

the processing unit is used for carrying out video coding on the video streams of the video sources to obtain video links in a preset format; the video link is used for associating video streams of the plurality of video sources;

And the transmission unit is used for sending the video link to the terminal equipment and playing the video stream through a webpage by the terminal equipment.

9. The apparatus according to claim 8, wherein the processing unit is specifically configured to:

10. The apparatus according to claim 8 or 9, further comprising a storage unit;

the storage unit is used for storing video streams of the plurality of video sources;

the transmission unit is further configured to, in response to request information of the terminal device for watching back the video, obtain a video stream corresponding to the request information from the stored video streams, and send the video stream to the terminal device.

11. The apparatus according to claim 10, wherein the transmission unit is specifically configured to:

12. The apparatus according to claim 10, wherein the transmission unit is specifically configured to:

13. The apparatus of claim 12, wherein the video data packet further comprises metadata indicating attribute information of the video stream.

14. The apparatus of claim 10, wherein the streaming platform comprises a video distribution device comprising a primary device and a secondary device, the video distribution device configured to send the video stream to the terminal device;

the transmission unit is further configured to: and in response to the data processing capability of the main equipment exceeding a preset threshold or the main equipment being incapable of executing the video stream distribution function, sending the request information to the auxiliary equipment, so that the auxiliary equipment sends a corresponding video stream to the terminal equipment according to the request information.

15. A computer readable storage medium having instructions stored therein which, when executed, implement the method of any of claims 1-7.

16. A communication device, comprising: a processor, a memory, and a communication interface; wherein the communication interface is used for the communication of the communication device and other equipment or network; the memory is configured to store one or more programs, the one or more programs comprising computer-executable instructions that, when executed by the communication device, cause the communication device to perform the method of any of claims 1-7.