CN117041472A

CN117041472A - Method and equipment for transmitting video stream

Info

Publication number: CN117041472A
Application number: CN202311093001.0A
Authority: CN
Inventors: 廖春元; 黄海波; 沈结
Original assignee: Hiscene Information Technology Co Ltd
Current assignee: Hiscene Information Technology Co Ltd
Priority date: 2023-08-28
Filing date: 2023-08-28
Publication date: 2023-11-10

Abstract

The application aims to provide a method and equipment for transmitting video streams, which specifically comprise the following steps: sending a corresponding registration request to the virtual network camera device; responding to the registration request, registering the virtual network camera device to the target monitoring platform through national standards, wherein a channel of the virtual network camera device corresponds to at least one of a plurality of conference user identification information participating in the video conference; if the target monitoring platform acquires a streaming request based on the channel, responding to the streaming request, and acquiring a video stream corresponding to the video conference by the virtual network camera device and transmitting the video stream to the target monitoring platform based on the channel. The application opens up the system equipment of two different protocols in a virtual mode, realizes the audio-video intercommunication without increasing the hardware cost additionally, is simple to maintain in a virtual mode, does not need additional wiring, saves the cost and builds a good video transmission environment for users.

Description

Method and equipment for transmitting video stream

Technical Field

The present application relates to the field of communications, and in particular, to a technique for transmitting video streams.

Background

WebRTC is a video conference access protocol, which includes negotiation of signaling and media transmission, GB28181 is a video monitoring access protocol, and uses Rtp/Rtcp protocol to transmit media, if a video monitoring platform wants to schedule video of a real-time video conference terminal, because the access and media transmission protocols are inconsistent, it is difficult to implement interworking.

Disclosure of Invention

An object of the present application is to provide a method and apparatus for transmitting a video stream.

According to one aspect of the present application, there is provided a method for transmitting a video stream, applied to a computer device, wherein the computing device stores one or more conference user identification information, and the one or more conference user identification information has a virtual network camera corresponding thereto, the method comprising:

sending a corresponding registration request to the virtual network camera device, wherein the registration request comprises meeting identification information of a corresponding video meeting, virtual network camera identification information of the virtual network camera device and platform identification information of a target monitoring platform, and the video meeting is in an enabling state;

responding to the registration request, registering the virtual network camera device to the target monitoring platform through national standards, wherein a channel of the virtual network camera device corresponds to at least one of a plurality of conference user identification information participating in the video conference;

If the target monitoring platform acquires a streaming request based on the channel, responding to the streaming request, and acquiring a video stream corresponding to the video conference by the virtual network camera device, and transmitting the video stream to the target monitoring platform based on the channel, wherein the video stream comprises a video stream shared by at least one conference user corresponding to the conference user identification information.

According to an aspect of the present application, there is provided a computer apparatus for transmitting a video stream, wherein the computer apparatus stores one or more conference user identification information, the one or more conference user identification information having virtual network camera devices corresponding thereto, the computer apparatus comprising:

the one-to-one module is used for sending a corresponding registration request to the virtual network camera device, wherein the registration request comprises meeting identification information of a corresponding video meeting, virtual network camera identification information of the virtual network camera device and platform identification information of a target monitoring platform, and the video meeting is in an enabling state;

the second module is used for responding to the registration request, the virtual network camera device is registered to the target monitoring platform through national standards, wherein a channel of the virtual network camera device corresponds to at least one of a plurality of conference user identification information participating in the video conference;

And the three modules are used for responding to the stream pulling request if the stream pulling request of the target monitoring platform based on the channel is obtained, and the virtual network camera device obtains the video stream corresponding to the video conference and transmits the video stream to the target monitoring platform based on the channel, wherein the video stream comprises the video stream shared by at least one conference user corresponding to the conference user identification information.

According to one aspect of the present application, there is provided a computer apparatus, wherein the apparatus comprises:

a processor; and

a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the steps of any of the methods described above.

According to one aspect of the present application there is provided a computer readable storage medium having stored thereon a computer program/instruction which, when executed, causes a system to perform the steps of a method as described in any of the above.

According to one aspect of the present application there is provided a computer program product comprising computer programs/instructions which when executed by a processor implement the steps of a method as described in any of the preceding.

Compared with the prior art, the application opens up the system equipment of two different protocols in a virtual mode, thereby realizing the audio-video intercommunication without increasing the hardware cost additionally, having simple maintenance in a virtual mode, needing no additional wiring, saving the cost and simultaneously building a good video transmission environment for users.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the detailed description of non-limiting embodiments, made with reference to the accompanying drawings in which:

fig. 1 shows a flow chart of a method for transmitting a video stream according to an embodiment of the application;

FIG. 2 illustrates functional blocks of a computer device according to another embodiment of the present application;

FIG. 3 illustrates an exemplary system that may be used to implement various embodiments described in the present application.

The same or similar reference numbers in the drawings refer to the same or similar parts.

Detailed Description

The application is described in further detail below with reference to the accompanying drawings.

In one exemplary configuration of the application, the conference terminal, the devices of the services network, and the trusted party each include one or more processors (e.g., central processing units (Central Processing Unit, CPU)), input/output interfaces, network interfaces, and memory.

The Memory may include non-volatile Memory in a computer readable medium, random access Memory (Random Access Memory, RAM) and/or non-volatile Memory, etc., such as Read Only Memory (ROM) or Flash Memory (Flash Memory). Memory is an example of computer-readable media.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase-Change Memory (PCM), programmable Random Access Memory (Programmable Random Access Memory, PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (Dynamic Random Access Memory, DRAM), other types of Random Access Memory (RAM), read-Only Memory (ROM), electrically erasable programmable read-Only Memory (EEPROM), flash Memory or other Memory technology, read-Only Memory (Compact Disc Read-Only Memory, CD-ROM), digital versatile disks (Digital Versatile Disc, DVD) or other optical storage, magnetic cassettes, magnetic tape storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by the computing device.

The device includes, but is not limited to, a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user equipment includes, but is not limited to, any mobile electronic product which can perform man-machine interaction with a user (for example, perform man-machine interaction through a touch pad), such as a smart phone, a tablet computer and the like, and the mobile electronic product can adopt any operating system, such as an Android operating system, an iOS operating system and the like. The network device includes an electronic device capable of automatically performing numerical calculation and information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a digital signal processor (Digital Signal Processor, DSP), an embedded device, and the like. The network device includes, but is not limited to, a computer, a network host, a single network server, a plurality of network server sets, or a cloud of servers; here, the Cloud is composed of a large number of computers or network servers based on Cloud Computing (Cloud Computing), which is a kind of distributed Computing, a virtual supercomputer composed of a group of loosely coupled computer sets. Including but not limited to the internet, wide area networks, metropolitan area networks, local area networks, VPN networks, wireless Ad Hoc networks (Ad Hoc networks), and the like. Preferably, the device may be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the touch conference terminal, or the network device and the touch conference terminal through a network.

Of course, those skilled in the art will appreciate that the above-described devices are merely examples, and that other devices now known or hereafter may be present as applicable to the present application, and are intended to be within the scope of the present application and are incorporated herein by reference.

In the description of the present application, the meaning of "a plurality" is two or more unless explicitly defined otherwise.

Fig. 1 shows a method for transmitting a video stream, applied to a computer device, wherein the computing device stores one or more conference user identification information, and the one or more conference user identification information has a virtual network camera corresponding to the conference user identification information, and the method comprises step S101, step S102 and step S103. In step S101, a corresponding registration request is sent to the virtual network camera device, where the registration request includes conference identification information of a corresponding video conference, virtual network camera identification information of the virtual network camera device, and platform identification information of a target monitoring platform, and the video conference is in an enabled state; in step S102, in response to the registration request, the virtual network camera device registers to the target monitoring platform through a national standard, where a channel of the virtual network camera device corresponds to at least one of a plurality of conference user identification information participating in the video conference; in step S103, if a pull request of the target monitoring platform based on the channel is obtained, the virtual network camera device obtains a video stream corresponding to the video conference in response to the pull request, and transmits the video stream to the target monitoring platform based on the channel, where the video stream includes a video stream shared by at least one conference user corresponding to the plurality of conference user identification information. The computer device includes, but is not limited to, a user device, a network device, or a collection of user devices and network devices; the user equipment comprises, but is not limited to, any electronic product which can perform man-machine interaction with a user, such as a smart phone, a tablet computer, smart glasses, an unmanned aerial vehicle, a monitoring camera and the like; the network devices include, but are not limited to, computers, network hosts, single network servers, multiple network server sets, or clouds of multiple servers, e.g., ground control center servers, service platforms, etc. The present application is described below in terms of a business platform, and those skilled in the art will appreciate that the embodiments are equally applicable to other computer devices, etc.

The service platform stores one or more conference user identification information, wherein the conference user identification information comprises, but is not limited to, identification information for indicating the uniqueness of a conference user, such as a conference user account number, a binding user mobile phone number or a binding user serial number. And each conference user identification information in the plurality of conference user identification information stored by the service platform corresponds to a conference user and participates in a video conference through a corresponding conference terminal, wherein the conference terminal is provided with a corresponding video conference application, can initiate the video conference through the video conference application, and performs video transmission through connection with a video conference server corresponding to the video conference application, so that video conference and the like are performed. The service platform stores the one or more conference user identification information, and can also establish a corresponding relation between the one or more conference user identification information and the virtual network camera device, for example, the corresponding conference user identification information is based on the monitoring platform to establish the virtual network camera identification information of the virtual network camera device corresponding to the conference user identification information, and the conference user identification information and the virtual network camera identification information are bound. The virtual network camera device is connected with the target monitoring platform through a GB/T28181 protocol, for example, the virtual network camera device is directly connected with the target monitoring platform, or the virtual network camera device is directly connected with other video platforms (such as other monitoring platforms, network video recorders and the like), and the other video platforms connected with the other video platforms or the other video platforms are connected with the target monitoring platform in a configuration mode. The GB/T28181 technical requirements for information transmission, exchange and control of public safety video monitoring networking systems are proposed by the national security alarm system standardization technical Committee (SAC/TC 100), and are a national standard for common drafting of a plurality of units such as the public security department. The standard prescribes the interconnection structure, communication protocol structure, basic requirements and safety requirements of transmission, exchange and control, and technical requirements of control, transmission flow, protocol interface and the like of information transmission, exchange and control in the urban monitoring alarm networking system. The standard is suitable for scheme design, system detection, acceptance and equipment research and development and production related to the safety precaution monitoring alarm networking system, and other information systems can be used by reference. As in some embodiments, the method further includes step S104 (not shown), in which virtual network camera identification information of a virtual network camera device corresponding to the one or more conference user identification information is determined according to a pre-configuration of the one or more conference user identification information in step S104; and establishing or updating the mapping relation between the one or more conference user identification information and the virtual network camera identification information. For example, the service platform may obtain a pre-configuration corresponding to the corresponding conference user identification information, such as a parameter configuration prior to establishing the corresponding virtual network camera device, e.g., a room number of the video conference, a corresponding transmission protocol, etc. The pre-configuration may be a configuration performed by the computer device based on the identification information of each conference user according to a default configuration, or a parameter configuration that the terminal corresponding to the identification information of each conference user uploads to the service platform. After the service platform obtains the corresponding parameter configuration, virtual network camera identification information of the virtual network camera device corresponding to the conference user identification information can be generated based on the conference user identification information, for example, a twenty-bit national standard code is generated according to the national standard, and the twenty-bit national standard code is used for distinguishing the virtual network camera identification information of each conference user identification information. The service platform acquires the corresponding virtual network camera shooting identification information, and can establish or update the mapping relation between the one or more conference user identification information and the virtual network camera shooting identification information, so that the conference user identification information can conveniently and rapidly realize the creation/calling of the virtual network camera shooting device and the like when needed. Subsequently, the service platform creates a corresponding virtual network camera device in the current production environment based on the virtual network camera identification information. For example, after the service of the service platform is started, the service platform establishes a corresponding virtual network camera device based on the mapping relation between the conference user identification information and the virtual network camera identification information, and for example, after the video conference is started or before the video conference is started, the service platform establishes a corresponding virtual network camera device based on the mapping relation between the conference user identification information and the virtual network camera identification information. The number of the virtual network device apparatuses may be one or more, in particular, the virtual network camera apparatuses may be virtual network camera apparatuses corresponding to conference user identification information one by one, for example, after a video conference is started, a service platform establishes a one-to-one virtual network camera apparatus based on a mapping relationship between the conference user identification information and the virtual network camera identification information, and at this time, one virtual network camera apparatus sets a channel, where the channel is used for transmitting a video stream corresponding to a conference user corresponding to the virtual network camera apparatus, and so on. As in some embodiments, the method further comprises, prior to step S101: and if the starting operation of the video conference is acquired, creating the virtual network camera device based on the mapping relation. For example, a conference user corresponding to at least one conference user identification information in a plurality of conference user identification information initiates a video conference with other terminals through corresponding conference terminals, after the video conference is established among the plurality of terminals, a service platform determines starting operation of the corresponding video conference, and after the video conference is started, virtual network camera devices corresponding to all or part of the conference user identification information one by one are established based on a mapping relation, so that real-time rapid transmission of video streams and the like are realized through rapid and direct establishment of the virtual network camera devices.

In some cases, the service platform may also create a corresponding virtual network camera before the video conference starts, where the virtual network camera may correspond to one or more conference user identification information, for example, the virtual network camera sets a plurality of channels, each channel corresponds to one conference user identification information, and so on. As in some embodiments, the method further includes step S105 (not shown), in step S105, creating the virtual network camera based on the mapping relationship; in step S101, if a start operation of the video conference is acquired, a corresponding registration request is sent to the virtual network camera device, where the registration request includes conference identification information of the corresponding video conference, virtual network camera identification information of the virtual network camera device, and platform identification information of a target monitoring platform. For example, after establishing/updating the mapping relationship between the one or more conference user identification information and the virtual network camera identification information, the service platform creates a corresponding virtual network camera device in the current environment based on the mapping relationship, where the corresponding virtual network camera device may be in one-to-one correspondence with the corresponding conference user identification information, or may be one virtual network camera device to establish multiple channels so as to correspond to multiple conference user identification information, where in some embodiments, the number of channels between the virtual network camera device and the target monitoring platform is multiple, where at least one target channel exists in the multiple channels, where the target channel includes a channel participating in the video conference and corresponding to the conference user identification information where the mapping relationship exists between the virtual network camera identification information. For example, for a virtual network camera device that is configured and built in advance, in order to save computing resources and facilitate management, a plurality of channels of the virtual network camera device are generally built based on a mapping relationship, so that a plurality of channels are set in one virtual network camera device, and video streams corresponding to conference users corresponding to a plurality of conference user identification information are transmitted, where the video streams corresponding to the conference users may be video streams acquired by a conference terminal corresponding to the conference users, for example, video streams acquired by the conference terminal, or video streams transmitted by conference terminals corresponding to other conference users acquired by the conference terminal, and so on. After the virtual network camera device is subsequently registered to the target monitoring platform, video streams corresponding to conference users corresponding to a plurality of conference user identification information corresponding to the channels for performing video conference can be transmitted based on the channels.

Specifically, in step S101, a corresponding registration request is sent to the virtual network camera device, where the registration request includes conference identification information of a corresponding video conference, virtual network camera identification information of the virtual network camera device, and platform identification information of a target monitoring platform, and the video conference is in an enabled state. For example, a user holds a terminal, the terminal installs a video conference application, the video conference application is logged in based on conference user identification information, the terminal can send a video conference connection request to other terminals based on conference starting operation of the user, if the other terminals pass through and establish a video conference with the terminal, any terminal in the video conference can transmit a corresponding video stream to the other terminals through communication connection with a video conference server, and the transmitted video stream can be a video stream acquired by the corresponding terminal through a camera device, or a video stream formed by all/part of pictures in a terminal screen acquired by the corresponding terminal through other screen capturing software, and the like. The video conference is in an enabling state and is used for indicating that a conference user corresponding to at least one conference user identification information in the corresponding one or more conference user identification information is currently participating in the video conference, and at least one video stream shared in real time exists in the video conference. The service platform can send a corresponding registration request to the virtual network camera device based on the starting state of the terminal about the video conference, and the registration request is used for establishing a video transmission channel with the target monitoring platform, so that video streams shared by users in the video conference are transmitted to the target monitoring platform and the like. The registration process generally requires conference identification information of the video conference, virtual network camera identification information of the virtual network camera device and platform identification information of the target monitoring platform, wherein the conference identification information is used for indicating the unique identification of the video conference, and the video conference for pulling the video stream can be determined by the virtual network camera device corresponding to the conference identification information; the virtual network camera identification information is used for indicating national standard codes of virtual network camera devices corresponding to conference user identification information (one or more conference users can share video streams) in the current video conference; the platform identification information of the target monitoring platform is used for indicating the unique identification of the monitoring platform receiving the video stream and the like.

In step S102, in response to the registration request, the virtual network camera device registers to the target monitoring platform through a national standard, where a channel of the virtual network camera device corresponds to at least one of a plurality of conference user identification information participating in the video conference. For example, the target monitoring platform comprises a video platform which takes network centralized management and network transmission as cores and completes information transmission, control, management and storage; the monitoring platform realizes monitoring networking and centralized management, and an authorized user can monitor the monitoring site on any computer of the network in real time, so that a powerful and flexible network centralized monitoring platform is provided. The virtual network camera device comprises virtual services which are created by the service platform in the network environment and have functions similar to the camera device. Specifically, the virtual network camera device can realize access to the target monitoring platform by setting corresponding national standard codes, video channel code IDs, configuring SIP server IP addresses and the like through the configuration page. After the target monitoring platform is connected with the virtual network camera device, the target monitoring platform can acquire a video stream shared by the conference user corresponding to the corresponding conference user identification information through a channel of the virtual network camera device, for example, the target monitoring platform selects a video channel of a specific code ID in the virtual network camera device, and then the virtual network camera device pushes the video stream shared by the conference user corresponding to the conference user identification information corresponding to the video channel of the specific code ID, and the like. One or more virtual network camera devices can be registered to a target monitoring platform, and the target monitoring platform can play video streams shared by conference users corresponding to conference user identification information corresponding to the one or more virtual network camera devices.

In some embodiments, the virtual webcam device is registered to the target monitoring platform by national standards. In some embodiments, the virtual network camera device can be registered on the target monitoring platform by configuring access at the virtual network camera device end through a GB/T28181 protocol. Further, the target monitoring platform can select a channel in the virtual network camera device, and push a video stream shared by a conference user corresponding to conference user identification information corresponding to the corresponding channel to the target monitoring platform based on corresponding communication connection.

In step S103, if a pull request of the target monitoring platform based on the channel is obtained, the virtual network camera device obtains a video stream corresponding to the video conference in response to the pull request, and transmits the video stream to the target monitoring platform based on the channel, where the video stream includes a video stream shared by at least one conference user corresponding to the plurality of conference user identification information. The video stream shared by the conference users can be a video stream acquired by a conference terminal corresponding to the shared conference user. For example, the target monitoring platform may acquire a video stream shared in a corresponding video conference based on a channel of the virtual network camera device, if the target monitoring platform acquires a streaming operation of a monitoring person about the corresponding channel, and sends a streaming request to the corresponding virtual network camera device (for example, sends a streaming request in a GB28181 signaling manner, etc.), the virtual network camera device sends a video stream acquisition request of meeting user identification information corresponding to the channel to a video conference server corresponding to the channel based on the streaming request, and the video conference server sends a video stream shared by the meeting user identification information in the video conference to the virtual network camera device based on the video stream acquisition request (for example, the virtual network camera device calls a software development package SDK of the video conference system based on meeting identification information corresponding to the video conference system to remotely join the video conference system, subscribes to a video stream corresponding to the meeting user identification information in the video conference system, etc.), so that the virtual network camera device can transmit the video stream to the target monitoring platform through the channel. Preferably, the video stream is a video stream shared by a conference user corresponding to the conference user identification information corresponding to the currently pulled channel, in some cases, the video stream may also be a video stream shared by other users in a video conference participated by the conference user, for example, the video stream shared by the other users is transmitted to the conference user, so that the video stream is transmitted to the target monitoring platform through the channel corresponding to the conference user, which is not limited herein.

In some embodiments, the computer device and the virtual network camera device interact through a private protocol; the method further includes step S106 (not shown), and in step S106, webRTC information corresponding to the video conference is transmitted to the virtual network camera device through the private protocol. For example, webRTC information of the video conference includes conference identification information (such as a conference room number, etc.), conference user identification information corresponding to the virtual network camera device, and the like. And the virtual network camera device and the service platform interact with each other through a private protocol, so that the user-defined protocol setting between the virtual network camera device and the service platform is realized, such as information interaction based on the user-defined http protocol or websocket message. The device realizing two different access protocols realizes the intercommunication of signaling and video code stream by the private protocol mode. The service platform can synchronously send corresponding webRTC information to the virtual network camera device in the video conference process, or after the target monitoring platform sends a corresponding streaming request to the virtual network camera device, the virtual network camera device sends a corresponding webRTC information acquisition request to the service platform, and after the service platform receives the webRTC information acquisition request, the service platform sends webRTC information related to the video conference to the virtual network camera device for the virtual network camera device to pull a corresponding video stream from the video conference server.

In some embodiments, the method further includes step S107 (not shown), and in step S107, a heartbeat message corresponding to a current conference user to which the video stream belongs and sent by a network device corresponding to the video conference is obtained, and the heartbeat message is sent to the target monitoring platform via the virtual network camera device, where the heartbeat message is used to indicate that the current conference user is in a connection state. For example, the video conference server may monitor a conference state of a conference user corresponding to current conference user identification information corresponding to a current transmitted video stream, for example, monitor a conference state of the conference user through heartbeat information, where the conference state is used to indicate whether the current conference user is still in a video conference, if yes, determine that the corresponding conference state is a connection state, and if not, determine that the corresponding conference state is an offline state. If the heartbeat information indicates that the current conference user is in a connection state (for example, the video conference server sends corresponding heartbeat messages to the target monitoring platform at regular time through the virtual network camera device, etc.), the virtual network camera device can transmit video streams corresponding to the current conference user to the target monitoring platform based on a channel corresponding to the current conference user, etc. In other embodiments, if the heartbeat information indicates that the current conference user is in an offline state (for example, the target monitoring platform does not receive the heartbeat information corresponding to the current conference user for a period of time, etc.), the channel corresponding to the current conference user in the virtual network camera device displays the offline state, and the video stream corresponding to the current conference user cannot be transmitted to the target monitoring platform. In some embodiments, in step S103, if a streaming request of the target monitoring platform based on the channel is obtained and the current conference user is in a connection state, a video stream corresponding to the video conference is transmitted to the virtual network camera device in response to the streaming request, and the video stream is transmitted to the target monitoring platform based on the channel. For example, the target monitoring platform may determine that the current conference user is in a connection state based on the heartbeat message, so that when it is determined that the corresponding channel can perform video transmission, the target monitoring platform may send a corresponding streaming request to the virtual network camera device based on the enabling operation of the monitoring user on the channel, so that a video stream corresponding to the current conference user in the video conference is transmitted to the target monitoring platform based on the video streaming transmission process. For another example, the target monitoring platform may send a corresponding streaming request to the virtual network camera device based on the enabling operation of the monitoring user about the channel, and then the target monitoring platform may determine, based on the heartbeat message, that the current conference user is in the connection state, that the corresponding channel may perform video transmission, so that a video stream corresponding to the current conference user in the video conference is transmitted to the target monitoring platform based on the foregoing video stream transmission process. If the target monitoring platform does not receive the corresponding heartbeat message within the preset time, the current conference user is determined to be in an offline state, and the target monitoring platform cannot acquire the video stream corresponding to the current conference user.

In some embodiments, the channel is in an online state; the method further includes step S108 (not shown), and in step S108, if an online operation of the current conference user about the video conference is obtained, a channel state of a channel corresponding to the conference user identification information of the current conference user is determined as an online state. For example, the virtual network camera device is created before the current conference user joins the video conference, and after the current conference user joins the video conference, if the current conference user joins the video conference, the service platform sends the online information of the current conference user to the virtual network camera device, and the virtual network camera device determines that the current conference user is in a connection state based on the information, adjusts a channel corresponding to the current conference user to be in an online state, and allows the target monitoring platform to call and acquire a corresponding video stream.

In some embodiments, the virtual network camera device obtains a video stream corresponding to the video conference, and transmits the video stream to the target monitoring platform based on the channel, including: the virtual network camera device acquires a video stream corresponding to the video conference, decodes the coded file of the video stream, and recodes the coded file into a recoded video stream conforming to the video parameters of the target monitoring platform; and transmitting the recoded video stream to the target monitoring platform based on the channel. For example, the video stream of the video conference corresponds to the video protocol of webRTC, and the monitoring video acquired by the target monitoring platform is generally GB28181, which are not mutually communicated, and the formats of the corresponding video streams have differences. After receiving the video stream sent by the video conference server, the virtual network camera device recodes the video stream, decodes the video stream into a video stream conforming to the GB28181 protocol, and then transmits the recoded video stream to the target monitoring platform through a channel. Wherein the recoding includes adjusting relevant parameters of the video file in the corresponding video stream, for example, for parameter index GOP (for indicating I frame interval) in webRTC protocol, the interval is very long, between 5-30 min; only the video with the I frame interval in the webRTC protocol video stream is complete, and the video can be presented; after recoding and adjusting, GOP is changed into about 5 seconds, the interval is shortened, the video stream is pushed to the monitoring platform, and the missed background during the I frame interval can not be solved through signaling, so that the problem that the I frame interval is too long is avoided by shortening GOP. Of course, in some cases, we may also adjust the video code stream, such as 720P or 1080P video code stream provided by the video conference, and the virtual network camera device re-encodes the video code stream into a code stream with a suitable resolution based on the video conference, and then transmits the code stream to the target monitoring platform.

The embodiments of a method for transmitting a video stream according to the present application have been mainly described above by way of example, and furthermore, specific apparatuses capable of implementing the embodiments described above are provided, and will be described below with reference to fig. 2.

Fig. 2 shows a computer device for transmitting video streams, wherein the computing device stores one or more conference user identification information, and the one or more conference user identification information has a virtual network camera device corresponding to the one or more conference user identification information, and the device comprises a one-to-one module 101, a two-to-one module 102 and a three-module 103. A one-to-one module 101, configured to send a corresponding registration request to the virtual network camera device, where the registration request includes conference identification information of a corresponding video conference, virtual network camera identification information of the virtual network camera device, and platform identification information of a target monitoring platform, and the video conference is in an enabled state; a second module 102, configured to respond to the registration request, where the virtual network camera device registers to the target monitoring platform through a national standard, and a channel of the virtual camera device corresponds to at least one of a plurality of conference terminal identification information that participates in the video conference; and the three modules 103 are configured to, if a streaming request of the target monitoring platform based on the channel is obtained, respond to the streaming request, obtain a video stream corresponding to the video conference by using the virtual network camera device, and transmit the video stream to the target monitoring platform based on the channel, where the video stream includes a video stream shared by at least one conference user corresponding to the plurality of user terminal identification information. The computer device includes, but is not limited to, a user device, a network device, or a collection of user devices and network devices; the user equipment includes, but is not limited to, any electronic product capable of performing man-machine interaction with a user (such as performing man-machine interaction through a touch pad), such as a smart phone, a tablet computer, smart glasses, a smart helmet and the like; the network devices include, but are not limited to, computers, network hosts, single network servers, multiple network server sets, or clouds of multiple servers, e.g., ground control center servers, service platforms, etc. The present application is described below in terms of a business platform, and those skilled in the art will appreciate that the embodiments are equally applicable to other computer devices, etc.

The specific embodiments of the one-to-one module 101, the two-to-one module 102 and the three-to-one module 103 shown in fig. 2 are the same as or similar to the embodiments of the foregoing step S101, the step S102 and the step S103, and thus are not described in detail and are incorporated herein by reference.

In some embodiments, the apparatus further includes a fourth module (not shown) configured to determine virtual network camera identification information of a virtual network camera device corresponding to the one or more conference user identification information according to a pre-configuration of the one or more conference user identification information; and establishing or updating the mapping relation between the one or more conference user identification information and the virtual network camera identification information. In some embodiments, the apparatus is further configured to, prior to one of the modules 101: and if the starting operation of the video conference is acquired, creating the virtual network camera device based on the mapping relation.

In some embodiments, the apparatus further includes a five module (not shown) for creating the virtual network camera device based on the mapping relationship; and a one-to-one module 101, configured to send a corresponding registration request to the virtual network camera device if the start operation of the video conference is acquired, where the registration request includes conference identification information of the corresponding video conference, virtual network camera identification information of the virtual network camera device, and platform identification information of a target monitoring platform. In some embodiments, the number of channels of the virtual network camera device and the target monitoring platform is multiple, at least one target channel exists in the multiple channels, and the target channel includes a channel which participates in the video conference and corresponds to conference user identification information with a mapping relation with the virtual network camera identification information.

In some embodiments, the computer device and the virtual network camera device interact through a private protocol; the device further includes a six-module (not shown) configured to transmit webRTC information corresponding to the video conference to the virtual network camera device through the private protocol.

In some embodiments, the device further includes a seventh module (not shown) configured to obtain a heartbeat message corresponding to a current conference user to which the video stream belongs, where the heartbeat message is sent by the network device corresponding to the video conference, and send the heartbeat message to the target monitoring platform via the virtual network camera device, where the heartbeat message is used to indicate that the current conference user is in a connection state. In some embodiments, a third module 103 is configured to, if a pull stream request of the target monitoring platform based on the channel is obtained and the current conference user is in a connection state, transmit, in response to the pull stream request, a video stream corresponding to the video conference to the virtual network camera device, and transmit, based on the channel, the video stream to the target monitoring platform.

In some embodiments, the channel is in an online state; the device further includes an eight module (not shown) configured to determine a channel state of a channel corresponding to the conference user identification information of the current conference user as an online state if an online operation of the current conference user with respect to the video conference is acquired. In some embodiments, the virtual network camera device obtains a video stream corresponding to the video conference, and transmits the video stream to the target monitoring platform based on the channel, including: the virtual network camera device acquires a video stream corresponding to the video conference, decodes the coded file of the video stream, and recodes the coded file into a recoded video stream conforming to the video parameters of the target monitoring platform; and transmitting the recoded video stream to the target monitoring platform based on the channel.

The embodiments corresponding to the four modules to the eight modules are the same as or similar to the embodiments of the steps S104 to S108, and are not described in detail herein, and are incorporated by reference.

In addition to the methods and apparatus described in the above embodiments, the present application also provides a computer-readable storage medium storing computer code which, when executed, performs a method as described in any one of the preceding claims.

The application also provides a computer program product which, when executed by a computer device, performs a method as claimed in any preceding claim.

The present application also provides a computer device comprising:

one or more processors;

a memory for storing one or more computer programs;

the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding claim.

FIG. 3 illustrates an exemplary system that may be used to implement various embodiments described herein;

in some embodiments, as shown in fig. 3, system 300 can function as any of the above-described devices of the various described embodiments. In some embodiments, system 300 may include one or more computer-readable media (e.g., system memory or NVM/storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer-readable media and configured to execute the instructions to implement the modules to perform the actions described in the present application.

For one embodiment, the system control module 310 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 305 and/or any suitable device or component in communication with the system control module 310.

The system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315. Memory controller module 330 may be a hardware module, a software module, and/or a firmware module.

The system memory 315 may be used, for example, to load and store data and/or instructions for the system 300. For one embodiment, system memory 315 may include any suitable volatile memory, such as, for example, a suitable DRAM. In some embodiments, the system memory 315 may comprise a double data rate type four synchronous dynamic random access memory (DDR 4 SDRAM).

For one embodiment, system control module 310 may include one or more input/output (I/O) controllers to provide an interface to NVM/storage 320 and communication interface(s) 325.

For example, NVM/storage 320 may be used to store data and/or instructions. NVM/storage 320 may include any suitable nonvolatile memory (e.g., flash memory) and/or may include any suitable nonvolatile storage device(s) (e.g., one or more Hard Disk Drives (HDDs), one or more Compact Disc (CD) drives, and/or one or more Digital Versatile Disc (DVD) drives).

NVM/storage 320 may include storage resources that are physically part of the device on which system 300 is installed or which may be accessed by the device without being part of the device. For example, NVM/storage 320 may be accessed over a network via communication interface(s) 325.

Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device. The system 300 may wirelessly communicate with one or more components of a wireless network in accordance with any of one or more wireless network standards and/or protocols.

For one embodiment, at least one of the processor(s) 305 may be packaged together with logic of one or more controllers (e.g., memory controller module 330) of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be packaged together with logic of one or more controllers of the system control module 310 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die as logic of one or more controllers of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic of one or more controllers of the system control module 310 to form a system on chip (SoC).

In various embodiments, the system 300 may be, but is not limited to being: a server, workstation, desktop computing device, or mobile computing device (e.g., laptop computing device, handheld computing device, tablet, netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or different architectures. For example, in some embodiments, system 300 includes one or more cameras, keyboards, liquid Crystal Display (LCD) screens (including touch screen displays), non-volatile memory ports, multiple antennas, graphics chips, application Specific Integrated Circuits (ASICs), and speakers.

It should be noted that the present application may be implemented in software and/or a combination of software and hardware, e.g., using Application Specific Integrated Circuits (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present application may be executed by a processor to perform the steps or functions described above. Likewise, the software programs of the present application (including associated data structures) may be stored on a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. In addition, some steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.

Furthermore, portions of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application by way of operation of the computer. Those skilled in the art will appreciate that the form of computer program instructions present in a computer readable medium includes, but is not limited to, source files, executable files, installation package files, etc., and accordingly, the manner in which the computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Herein, a computer-readable medium may be any available computer-readable storage medium or communication medium that can be accessed by a computer.

Communication media includes media whereby a communication signal containing, for example, computer readable instructions, data structures, program modules, or other data, is transferred from one system to another. Communication media may include conductive transmission media such as electrical cables and wires (e.g., optical fibers, coaxial, etc.) and wireless (non-conductive transmission) media capable of transmitting energy waves, such as acoustic, electromagnetic, RF, microwave, and infrared. Computer readable instructions, data structures, program modules, or other data may be embodied as a modulated data signal, for example, in a wireless medium, such as a carrier wave or similar mechanism, such as that embodied as part of spread spectrum technology. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. The modulation may be analog, digital or hybrid modulation techniques.

By way of example, and not limitation, computer-readable storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and nonvolatile memory such as flash memory, various read only memory (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, feRAM); and magnetic and optical storage devices (hard disk, tape, CD, DVD); or other now known media or later developed computer-readable information/data that can be stored for use by a computer system.

An embodiment according to the application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to operate a method and/or a solution according to the embodiments of the application as described above.

It will be evident to those skilled in the art that the application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is evident that the word "comprising" does not exclude other elements or steps, and that the singular does not exclude a plurality. A plurality of units or means recited in the apparatus claims can also be implemented by means of one unit or means in software or hardware. The terms first, second, etc. are used to denote a name, but not any particular order.

Claims

1. A method for transmitting a video stream, applied to a computer device, wherein the computing device stores one or more conference user identification information, and the one or more conference user identification information has a virtual network camera corresponding to the one or more conference user identification information, the method comprising:

2. The method of claim 1, wherein the method further comprises:

determining virtual network camera shooting identification information of a virtual network camera shooting device corresponding to the one or more conference user identification information according to the pre-configuration of the one or more conference user identification information;

and establishing or updating the mapping relation between the one or more conference user identification information and the virtual network camera identification information.

3. The method according to claim 2, wherein the method further comprises, before sending the corresponding registration request to the virtual network camera device:

and if the starting operation of the video conference is acquired, creating the virtual network camera device based on the mapping relation.

4. The method of claim 2, wherein the method further comprises:

creating the virtual network camera device based on the mapping relation;

wherein the sending the corresponding registration request to the virtual network camera device includes:

and if the starting operation of the video conference is acquired, sending a corresponding registration request to the virtual network camera device, wherein the registration request comprises conference identification information of the corresponding video conference, virtual network camera identification information of the virtual network camera device and platform identification information of a target monitoring platform.

5. The method according to claim 4, wherein the number of channels of the virtual network camera device and the target monitoring platform is a plurality, at least one target channel exists in the plurality of channels, and the target channel comprises a channel which participates in the video conference and corresponds to conference user identification information in a mapping relation with the virtual network camera identification information.

6. The method of claim 1, wherein the computer device and the virtual network camera interact with each other through a proprietary protocol; wherein the method further comprises:

and transmitting webRTC information corresponding to the video conference to the virtual network camera device through the private protocol.

7. The method of claim 1, wherein the method further comprises:

and acquiring heartbeat messages corresponding to the current conference users to which the video streams belong, which are sent by network equipment corresponding to the video conference, and sending the heartbeat messages to the target monitoring platform through the virtual network camera device, wherein the heartbeat messages are used for indicating that the current conference users are in a connection state.

8. The method of claim 7, wherein if the obtaining the streaming request of the target monitoring platform based on the channel, responding to the streaming request, the virtual network camera device obtains a video stream corresponding to the video conference, and transmits the video stream to the target monitoring platform based on the channel, including:

If a streaming request of the target monitoring platform based on the channel is acquired, and the current conference user is in a connection state, responding to the streaming request, transmitting a video stream corresponding to the video conference to the virtual network camera device, and transmitting the video stream to the target monitoring platform based on the channel.

9. The method of claim 8, wherein the channel is in an online state; wherein the method further comprises:

and if the online operation of the current conference user about the video conference is acquired, determining the channel state of the channel corresponding to the conference user identification information of the current conference user as an online state.

10. The method of claim 1, wherein the virtual network camera device obtains a video stream corresponding to the video conference and transmits the video stream to the target monitoring platform based on the channel, comprising:

the virtual network camera device acquires a video stream corresponding to the video conference, decodes the coded file of the video stream, and recodes the coded file into a recoded video stream conforming to the video parameters of the target monitoring platform;

And transmitting the recoded video stream to the target monitoring platform based on the channel.

11. A computer device for transmitting a video stream, wherein the computing device stores one or more conference user identification information, the one or more conference user identification information having virtual network cameras corresponding thereto, the computer device comprising:

12. A computer device, wherein the device comprises:

a processor; and

a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the steps of the method of any one of claims 1 to 10.

13. A computer readable storage medium having stored thereon a computer program/instructions which, when executed, cause a system to perform the steps of the method according to any of claims 1 to 10.

14. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method of any one of claims 1 to 10.