CN116708392A

CN116708392A - Method and device for transmitting media stream file, storage medium and electronic device

Info

Publication number: CN116708392A
Application number: CN202310750812.7A
Authority: CN
Inventors: 孙俊伟; 王克彦; 曹亚曦; 俞鸣园; 费敏健; 吕少卿
Original assignee: Zhejiang Huachuang Video Signal Technology Co Ltd
Current assignee: Zhejiang Huachuang Video Signal Technology Co Ltd
Priority date: 2023-06-21
Filing date: 2023-06-21
Publication date: 2023-09-05

Abstract

The embodiment of the invention provides a method and a device for transmitting a media stream file, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring a first media stream, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference; processing a first media stream to obtain a first media stream file set to be downloaded, wherein the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file is used for carrying out file index on the first group of media stream files, and the first group of media stream files is used for representing the first media stream; and when the first media stream file set is requested to be downloaded, sending first configuration information and the first media stream file set to the CDN device, wherein the first configuration information is used for indicating that the first group of media stream files are cached on the CDN device for a first preset time period. By the embodiment of the invention, the technical problem of low concurrency of live broadcast services in the related technology is solved.

Description

Method and device for transmitting media stream file, storage medium and electronic device

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a method and a device for transmitting a media stream file, a storage medium and an electronic device.

Background

The video conference system comprises various participation devices such as MCU (Multipoint Control Unit multipoint control unit, namely video conference server), soft and hard terminals, recording and broadcasting server and the like. The terminal collects image and sound and sends the image and sound to the MCU through coding. The MCU fuses or does not fuse the images sent by the terminals according to meeting requirements, and sends the images to each participating terminal after sound mixing or unmixed sound mixing, so that the audio and video call of the multiparty meeting participants is realized. When large-scale enterprises and other organizations hold large-scale conferences such as ten-thousand conferences, the number of people is large, the interactive conference of the whole person is often difficult to realize, and at the moment, two modes of video conference and online live broadcast are adopted to be carried out simultaneously. In this scenario, we need a live solution supporting high concurrency video conferencing audio/video streams. Typical browsers live without plug-ins, i.e. HLS (HTTP Live Streaming) live. In order to improve the access capability of the concurrent number and control the hardware deployment cost, a scheme is often considered to realize a CDN source station of the system, and then access a mature CDN network (Content Delivery Network) to carry out Internet distribution of audio and video streams. However, after the conventional HLS service is accessed to the CDN, there is a problem that the CDN hit rate is low, so that the source pressure is not shared by the CDN, and further, the problem of limited live broadcast concurrency capability is caused.

Aiming at the technical problem of low concurrency of live broadcast services in the related technology, no effective solution is proposed at present.

Disclosure of Invention

The embodiment of the invention provides a transmission method and device of a media stream file, a storage medium and an electronic device, which are used for at least solving the technical problem of low concurrency of live broadcast services in the related technology.

According to an embodiment of the present invention, there is provided a transmission method of a media stream file, including: acquiring a first media stream, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference currently performed in a video conference system; processing the first media stream to obtain a first media stream file set to be downloaded, wherein the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for carrying out file index on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream; and under the condition that the first media stream file set is requested to be downloaded, sending first configuration information and the first media stream file set to CDN equipment, wherein the first configuration information is used for indicating that the first group of media stream files of the second type are cached on the CDN equipment for a first preset time period.

In an exemplary embodiment, the sending the first configuration information and the first media stream file set to the CDN device includes: and sending an HTTP protocol message to the CDN device, wherein the header of the HTTP protocol message carries the first configuration information, and the data field of the HTTP protocol message carries the first media stream file set.

In an exemplary embodiment, the sending, in a case where the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set to a CDN device includes: sending first configuration information and the first media stream file set to the CDN device when the first media stream file set is requested to be downloaded through the Internet; after processing the first media stream to obtain a first media stream file set to be downloaded, the method further includes: and in the case that the first media stream file set is requested to be downloaded through a local area network, sending the first media stream file set to a terminal device requesting to be downloaded in the local area network.

In one exemplary embodiment, in a case where the first set of media stream files is requested to be downloaded, sending the first configuration information and the first set of media stream files to a CDN device includes: under the condition that the first media stream file set is requested to be downloaded by first terminal equipment at a first moment, sending the first configuration information and the first media stream file set to the CDN equipment, and sending the first media stream file set to the first terminal equipment through the CDN equipment; the method further comprises the steps of: in the case that a second media stream file set is requested to be downloaded by a second terminal device at a second moment, a first media stream file subset which is the same as that in the first media stream file set exists in the second media stream file set, and the second moment is earlier than the sum of the first moment and the first preset time length, sending the second media stream file subset to the CDN device, and sending the second media stream file subset and the first media stream file subset cached on the CDN device to the second terminal device through the CDN device, wherein the second media stream file subset comprises media stream files except the first media stream file subset in the second media stream file set; the second media stream file set includes a second media stream file of the first type and a second group of media stream files of the second type, the second media stream file of the first type is used for carrying out file index on the second group of media stream files of the second type, and the second group of media stream files of the second type is used for representing media streams generated after the second moment when video conferences currently carried out in the video conference system are live broadcast.

In an exemplary embodiment, the method further comprises: and when a second media stream file subset is sent to the CDN device, sending second configuration information to the CDN device, wherein the second configuration information is used for indicating that the second media stream file subset is cached on the CDN device for the first preset time period or a second preset time period different from the first preset time period, or the second configuration information is also used for indicating that the second media stream file set is cached on the CDN device for the first preset time period or a second preset time period different from the first preset time period.

In an exemplary embodiment, the method further comprises: resetting, on the CDN device, a remaining cache duration of the first subset of media stream files to the first predetermined duration, if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the first predetermined duration; or resetting the remaining cache duration of the first subset of media stream files to the second predetermined duration on the CDN device if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the second predetermined duration.

In an exemplary embodiment, the processing the first media stream to obtain a first media stream file set to be downloaded includes: and slicing the first media stream to obtain the first media stream file set to be downloaded.

In an exemplary embodiment, the method further comprises: and under the condition that live broadcasting is started for the video conference currently performed in the video conference system, generating a target live broadcasting address, wherein the target live broadcasting address is used for indicating that the first media stream file set is requested to be downloaded through the Internet or a local area network.

In one exemplary embodiment, the target live address includes a first live address and a second live address; the first direct broadcast address comprises a first IP address used by a direct broadcast service in the video conference system, a port number used by the direct broadcast service and a conference number of the video conference, wherein the first IP address is an IP address in a local area network, and the direct broadcast service is used for directly broadcasting the video conference currently performed in the video conference system; the second live address comprises a domain name of the CDN device and a conference number of the video conference, wherein a source station address set by the CDN device is a second IP address used by the live broadcast service, a source station port set by the CDN device is a port number used by the live broadcast service, the second IP address is an IP address of the Internet, and the source station address and the source station port are used for acquiring a media stream provided by the live broadcast service and generated by live broadcasting the video conference currently performed in the video conference system.

According to another embodiment of the present invention, there is also provided a transmission apparatus for a media stream file, including: the system comprises an acquisition module, a video conference system and a video conference system, wherein the acquisition module is used for acquiring a first media stream, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference currently performed in the video conference system; the processing module is used for processing the first media stream to obtain a first media stream file set to be downloaded, wherein the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for carrying out file index on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream; the first sending module is configured to send, when the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set to a CDN device, where the first configuration information is used to indicate that the first group of media stream files of the second type are cached on the CDN device for a first predetermined duration.

According to a further embodiment of the invention, there is also provided a computer readable storage medium having stored therein a computer program, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.

According to a further embodiment of the invention, there is also provided an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.

According to the method and the device for downloading the media streams, the first media streams are obtained, wherein the first media streams comprise media streams generated by live broadcasting of a video conference which is currently performed, the first media streams are processed to obtain a first media stream file set to be downloaded, the first media stream file set comprises first media stream files of a first type and first group media stream files of a second type, when the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set are sent to content delivery network CDN equipment, and the first configuration information is used for indicating that the first group media stream files of the second type are cached on the CDN equipment for a first preset time period. The first group of media stream files are indicated to be cached on the CDN equipment, so that the aim of improving the CDN hit rate can be achieved, and the problem that the CDN hit rate is low due to no caching in the CDN after the live service is accessed to the CDN in the related art is avoided, and the problem that the concurrency capacity of the live service is low is further caused. Therefore, the technical problem of low concurrency of live broadcast services in the related technology is solved, and the effect of improving the concurrency of live broadcast services is achieved.

Drawings

FIG. 1 is a block diagram of a mobile terminal hardware structure of a method for transmitting a media stream file according to an embodiment of the present application;

FIG. 2 is a flow chart of a method of transmitting a media stream file according to an embodiment of the present application;

fig. 3 is a schematic view of a video conference system architecture according to an embodiment of the present application;

fig. 4 is a diagram of HLS live services according to an embodiment of the application;

fig. 5 is a block diagram of a transmission apparatus of a media stream file according to an embodiment of the present application.

Detailed Description

Embodiments of the present application will be described in detail below with reference to the accompanying drawings in conjunction with the embodiments.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.

The method embodiments provided in the embodiments of the present application may be performed in a mobile terminal, a computer terminal or similar computing device. Taking the operation on a mobile terminal as an example, fig. 1 is a block diagram of a mobile terminal hardware structure of a method for transmitting a media stream file according to an embodiment of the present application. As shown in fig. 1, a mobile terminal may include one or more (only one is shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 for communication functions and an input-output device 108. It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely illustrative and not limiting of the structure of the mobile terminal described above. For example, the mobile terminal may also include more or fewer components than shown in fig. 1, or have a different configuration than shown in fig. 1.

The memory 104 may be used to store a computer program, for example, a software program of application software and a module, such as a computer program corresponding to a transmission method of a media stream file in an embodiment of the present invention, and the processor 102 executes the computer program stored in the memory 104 to perform various functional applications and data processing, that is, implement the above-mentioned method. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely located relative to the processor 102, which may be connected to the mobile terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, simply referred to as NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is configured to communicate with the internet wirelessly.

In this embodiment, a method for transmitting a media stream file is provided, and fig. 2 is a flowchart of a method for transmitting a media stream file according to an embodiment of the present invention, as shown in fig. 2, where the flowchart includes the following steps:

step S202, a first media stream is obtained, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference currently performed in a video conference system;

step S204, processing the first media stream to obtain a first media stream file set to be downloaded, where the first media stream file set includes a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for carrying out file index on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream;

step S206, in a case that the first media stream file set is requested to be downloaded, sending first configuration information and the first media stream file set to a CDN device, where the first configuration information is used to indicate that the first group of media stream files of the second type are cached on the CDN device for a first predetermined period of time.

Through the steps, the first media stream is obtained, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference which is currently performed, the first media stream is processed to obtain a first media stream file set to be downloaded, the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, when the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set are sent to a content delivery network CDN device, and the first configuration information is used for indicating that the first group of media stream files of the second type are cached on the CDN device for a first preset time period. The first group of media stream files are indicated to be cached on the CDN equipment, so that the aim of improving the CDN hit rate can be achieved, and the problem that the CDN hit rate is low due to no caching in the CDN after the live service is accessed to the CDN in the related art is avoided, and the problem that the concurrency capacity of the live service is low is further caused. Therefore, the technical problem of low concurrency of live broadcast services in the related technology is solved, and the effect of improving the concurrency of live broadcast services is achieved.

The main execution body of the steps may be a video conference system, a processor, a device, a controller, an application control program in the device, a processor with man-machine interaction capability configured on a storage device, a processing device or a processing unit with similar processing capability, or the like, but is not limited thereto.

In the technical solution provided in step S202, the first media stream may be a media stream generated by live broadcasting of a video conference currently performed in the video conference system, for example, there may be multiple participants in the video conference, and in general, the live broadcasting function is started for the video conference by the conference initiator or the host, and optionally, the live broadcasting function may be started on a video conference terminal where the conference initiator is located, or may be started on a management interface of the video conference system; in addition, when the functions of a camera, a microphone and the like are opened by a plurality of participants of the video conference, the video conference system can collect the audio and video stream data of each participant at the same time, namely, a plurality of paths of audio and video streams can be generated, and then the plurality of paths of audio and video streams are processed, for example, the plurality of paths of audio are subjected to audio mixing, the plurality of paths of video are subjected to picture fusion and the like, and the processed audio and video stream data can be sent to a live broadcast service; of course, whether the functions of the cameras, microphones and the like of the participants are started or not can be set.

In the technical solution provided in the above step S204, the first media stream obtained in the step S202 is processed to obtain a first media stream file set, where the first media stream file set may be downloaded, for example, the first media stream data may be sliced, or the first media stream may be transcoded, which may be understood that the first media stream in the step S202 is sent to a live broadcast service (for example, HLS live broadcast service, which belongs to a video conference system), where the live broadcast service may convert the first media stream data into HLS live broadcast data sources, for example, generate HLS slice ts files (corresponding to the first group of media stream files of the second type) and m3u8 files (corresponding to the first media stream files of the first type), and store the m3u8 files in a memory, where the m3u8 files may be used to index a group of ts files, and the m3u8 files may be used as a media playlist, where a series of multimedia resource slices (for example, such as a group of ts files) are recorded, and the sequential playing of these slices may complete the rendering of the multimedia resources. The HLS live service may provide live services to the outside to enable HLS live sessions.

In the solution provided in step S206, when the first media stream file set is requested to be downloaded, the first configuration information and the first media stream file set may be sent to the CDN device, for example, a request initiated by the user through the internet WEB browser end may be online watching live broadcast, that is, the request to download the first media stream file set, where in this step, the HLS live broadcast service may send first configuration information to the CDN device to instruct that the first group of media stream files (such as a group of slice ts files) are cached on the CDN device for a first predetermined period (such as 3S, 10S, 30ms, or other periods), and for HTTP downloads of two files (such as the m3u8 file and the ts file), a differentiated HTTP header Cache-Control value may be set, for example, the HLS live broadcast service may send an HTTP protocol packet to the CDN device, where the header of the packet may carry the first configuration information, for example, may carry setting information of a Cache-Control field. Of course, as the video conference or live broadcast proceeds, the first media stream is continuously changing, and accordingly the first media stream file set is changing. The CDN caches the first group of media stream files of the second type on the CDN device according to the indication of the first configuration information, for example, when the first terminal device initiates a live broadcast request (which may be understood as a request to view live broadcast), the HLS live broadcast service sends the first group of media stream files of the second type to the CDN device corresponding to the first terminal device, and instructs the CDN device to cache the first group of media stream files of the second type on the CDN device for the first predetermined time, so that when other terminal devices (such as the second terminal device) also initiate live broadcast requests, it is assumed that the second terminal device and the first terminal device are both in the same CDN node service range, at this time, the second terminal device can directly obtain from the CDN when requesting to download live broadcast content (similar to the first media stream file set), which improves the CDN hit rate, and avoids the problem that in the prior art, the problem that the content needs to be downloaded from a media stream source station, that in the related art, the CDN is low in hit in the related art, does not cause a problem of low pressure to the source station, thereby resulting in a low concurrency of live broadcast service. The first predetermined time period may be set according to actual application requirements.

In the above embodiment, the purpose of improving the hit rate of the CDN can be achieved by indicating to cache the first group of media stream files on the CDN device, so that the problem that in the related art, after the live service is accessed to the CDN, the hit rate of the CDN is low due to no cache in the CDN, and the problem that the concurrency capability of the live service is low is further caused. Therefore, the technical problem of low concurrency of live broadcast services in the related technology is solved, and the effect of improving the concurrency of live broadcast services is achieved.

In an alternative embodiment, the sending the first configuration information and the first media stream file set to the CDN device includes: and sending an HTTP protocol message to the CDN device, wherein the header of the HTTP protocol message carries the first configuration information, and the data field of the HTTP protocol message carries the first media stream file set.

In the foregoing embodiment, the HLS live service is based on the HTTP transmission protocol, and the live service may send an HTTP protocol packet to the CDN device, and may notify the CDN device side of the first configuration information through the HTTP protocol packet, so as to instruct the CDN device to determine a caching policy, such as not to cache (no-cache), or cache for a predetermined period of time, for example, the first predetermined period of time in this embodiment. Through the embodiment, the purpose of sending the first configuration information to the CDN device through the HTTP message is achieved.

In an optional embodiment, the sending, in a case where the first media stream file set is requested to be downloaded, the first configuration information and the first media stream file set to the CDN device includes: sending first configuration information and the first media stream file set to the CDN device when the first media stream file set is requested to be downloaded through the Internet; after processing the first media stream to obtain a first media stream file set to be downloaded, the method further includes: and in the case that the first media stream file set is requested to be downloaded through a local area network, sending the first media stream file set to a terminal device requesting to be downloaded in the local area network.

In the above embodiment, when the first media stream file set is requested to be downloaded through the internet, the first configuration information and the first media stream file set may be sent to the CDN device, for example, the user requests to watch live broadcast through an internet WEB browser or a terminal device, that is, requests to download the first media stream file set, and at this time, the HLS live broadcast service (or referred to as a live broadcast source station, or simply referred to as a source station) may send the first media stream file set to the CDN device, and then send the first media stream file set to the internet WEB browser or the terminal device by the CDN device. Alternatively, when the first media stream file set is requested to be downloaded through the local area network, the first media stream file set may be sent to a terminal device requesting to download in the local area network, for example, the user requests to watch live broadcast through a private WEB browser (or a terminal device), that is, requests to download the first media stream file set, where an HLS live broadcast service (or called a live broadcast source station, or simply called a source station) may send the first media stream file set directly to the terminal device. The embodiment can provide live broadcast service through private network and Internet.

In an alternative embodiment, in a case where the first media stream file set is requested to be downloaded, sending the first configuration information and the first media stream file set to the CDN device includes: under the condition that the first media stream file set is requested to be downloaded by first terminal equipment at a first moment, sending the first configuration information and the first media stream file set to the CDN equipment, and sending the first media stream file set to the first terminal equipment through the CDN equipment; the method further comprises the steps of: in the case that a second media stream file set is requested to be downloaded by a second terminal device at a second moment, a first media stream file subset which is the same as that in the first media stream file set exists in the second media stream file set, and the second moment is earlier than the sum of the first moment and the first preset time length, sending the second media stream file subset to the CDN device, and sending the second media stream file subset and the first media stream file subset cached on the CDN device to the second terminal device through the CDN device, wherein the second media stream file subset comprises media stream files except the first media stream file subset in the second media stream file set; the second media stream file set includes a second media stream file of the first type and a second group of media stream files of the second type, the second media stream file of the first type is used for carrying out file index on the second group of media stream files of the second type, and the second group of media stream files of the second type is used for representing media streams generated after the second moment when video conferences currently carried out in the video conference system are live broadcast.

In the above embodiment, when the first media stream file set is requested to be downloaded by the first terminal device at the first moment, the first configuration information and the first media stream file set may be sent to the CDN device corresponding to the first terminal device, and then, when the second terminal device requests to download the second media stream file set at the second moment, for example, the second terminal device requests to watch live broadcast or join live broadcast, because the second moment is different from the first moment, the corresponding live broadcast content also changes, that is, when the second media stream file set is downloaded (different from the first media stream file set), and when the second media stream file set and the first media stream file set have the same first media stream file subset, the second media stream file subset may be sent to the CDN device at this moment, and the second media stream file subset and the first media stream file subset (the CDN device has cached) are sent to the second terminal device, for example, if a group of resources corresponding to the first moment content is 1-10. Ts, a group of resources corresponding to the second moment content is different from the first moment, that a group of resources corresponding to 6. Ts of live broadcast content is corresponding to the second moment, and the live broadcast content can be added to the first terminal device (live broadcast content is not needed to achieve the live broadcast), and the current media stream effect can be achieved at the same time when the live broadcast content is not needed by the first terminal device, and the live broadcast content is partially downloaded (live broadcast).

In an alternative embodiment, the method further comprises: and when a second media stream file subset is sent to the CDN device, sending second configuration information to the CDN device, wherein the second configuration information is used for indicating that the second media stream file subset is cached on the CDN device for the first preset time period or a second preset time period different from the first preset time period, or the second configuration information is also used for indicating that the second media stream file set is cached on the CDN device for the first preset time period or a second preset time period different from the first preset time period.

In the foregoing embodiment, optionally, when the second subset of media stream files is sent to the CDN device, second configuration information may also be sent to the CDN device, where the second configuration information is similar to the first configuration information in the foregoing embodiment, and the second configuration information is used to indicate that the second subset of media stream files is cached on the CDN device for a first predetermined period of time, that is, the same as the predetermined period of time indicated in the first configuration information, and optionally, the cached period of time may also be reconfigured, for example, the second configuration information is used to indicate that the second subset of media stream files is cached on the CDN device for a second predetermined period of time; optionally, the second configuration information may further instruct the second media stream file set to be cached on the CDN device for a first predetermined time period or a second predetermined time period. The first predetermined time period and the second predetermined time period may be in the order of seconds (e.g., 1 second, or 3 seconds, or other seconds), or may be in the order of milliseconds (e.g., 30ms, or 100ms, or other milliseconds).

In an alternative embodiment, the method further comprises: resetting, on the CDN device, a remaining cache duration of the first subset of media stream files to the first predetermined duration, if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the first predetermined duration; or resetting the remaining cache duration of the first subset of media stream files to the second predetermined duration on the CDN device if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the second predetermined duration.

As an optional implementation manner, when the second configuration information is used to indicate that the second media stream file is collected and cached on the CDN device for a first predetermined time period (for example, 10 seconds), because the files in the first media stream file subset are already cached in the CDN device for a period of time, at this time, the remaining cache time period of the files in the first media stream file subset may be lower than the first predetermined time period, and the second configuration information may be used to indicate that the remaining cache time period of the first media stream file subset is reset to the first predetermined time period; optionally, when the second configuration information indicates that the second media stream file is cached on the CDN device for a second predetermined time period, the remaining cache time period of the files in the first subset of media stream files may be indicated to be reset to the second predetermined time period on the CDN device.

In an optional embodiment, the processing the first media stream to obtain a first media stream file set to be downloaded includes: and slicing the first media stream to obtain the first media stream file set to be downloaded.

In the above embodiment, the first media stream may be sliced to obtain a first media stream file set to be downloaded, for example, the first media stream data is converted into an HLS live data source, a group of HLS slice ts files and m3u8 files are generated, so as to obtain the first media stream file set, and the first media stream file set may be stored in the memory.

In an alternative embodiment, the method further comprises: and under the condition that live broadcasting is started for the video conference currently performed in the video conference system, generating a target live broadcasting address, wherein the target live broadcasting address is used for indicating that the first media stream file set is requested to be downloaded through the Internet or a local area network.

In the above embodiment, when a live video conference is started in a video conference system, for example, when a conference sponsor or a host starts a video conference live function, the video conference system will generate a target live address, where the target live address may be used to indicate that the first media stream file set is requested to be downloaded through the internet or a local area network, or it may be understood that the target live address may be used to indicate that the live video is watched or added to the live video through the internet or the local area network.

In an alternative embodiment, the target live address includes a first live address and a second live address; the first direct broadcast address comprises a first IP address used by a direct broadcast service in the video conference system, a port number used by the direct broadcast service and a conference number of the video conference, wherein the first IP address is an IP address in a local area network, and the direct broadcast service is used for directly broadcasting the video conference currently performed in the video conference system; the second live address comprises a domain name of the CDN device and a conference number of the video conference, wherein a source station address set by the CDN device is a second IP address used by the live broadcast service, a source station port set by the CDN device is a port number used by the live broadcast service, the second IP address is an IP address of the Internet, and the source station address and the source station port are used for acquiring a media stream provided by the live broadcast service and generated by live broadcasting the video conference currently performed in the video conference system.

In the above embodiment, the target live address may include a first live address for indicating to watch live or join live through the local area network and a second live address for indicating to watch live (i.e., watch live content of the video conference) or join live through the internet. The first direct broadcast address may include a first IP address (e.g., private IP address: 10.35.148.111, or others) used by a live service in the video conference system, a port number (e.g., 8821, or others) used by the live service, and a conference number (e.g., 9136943 xxxx) of the video conference, for example, the first direct broadcast address is: http://10.35.148.111:8821/live/91369430851/index.m3u8; the second live address may include an acceleration domain name (e.g., hls. Hit. Com, or other) of the CDN device and a conference number (e.g., 9136943 xxxx) of the video conference, for example, the second live address is: http:// hls.hit.com/live/91369430851/index.m3u8. According to the embodiment, two types of live broadcast m3u8 addresses are generated aiming at the private network and the Internet, so that the purpose of automatically switching live broadcast scenes of the private network and live broadcast scenes of the Internet can be achieved.

It will be apparent that the embodiments described above are merely some, but not all, embodiments of the invention. The present invention will be specifically described with reference to examples.

Fig. 3 is a schematic structural diagram of a video conference system according to an embodiment of the present invention, where the video conference system includes a selective forwarding unit SFU (Selective Forwarding Unit), a media processing task, an HLS live broadcast service, and a terminal (such as terminal 1 and terminal 2 in fig. 3), and the SFU includes a signaling service and a media service. The main functions of each constituent unit in the system are described below.

In the video conference system, the signaling service and the media processing task can interact, when the video conference starts live broadcast, the signaling service can start the media processing task, and when the video conference stops live broadcast, the signaling service can stop the media processing task.

The media processing task can acquire the audio and video streams of the conference from the conference media service and process the acquired audio and video streams, for example, the media processing actions such as audio mixing and video multi-picture fusion can be completed; the media processing task may also initiate a push stream to the HLS live service to send the processed media stream (corresponding to the aforementioned first media stream) to the HLS live service.

The HLS live service may receive media stream data pushed from the media processing task and process the media stream data, for example, slice the media stream data to obtain a slice ts file and an m3u8 file (corresponding to the first media stream file set), and the HLS live service may provide a live service to the outside. Both the media processing tasks and HLS live services in fig. 3 are equivalent to software modules.

In the following, description is given of HLS live service provided by a video conference system, and fig. 4 is a schematic diagram of HLS live service according to an embodiment of the present invention, where the structure of the video conference system is the same as that of fig. 3, and will not be described in detail herein. The video conference system in the embodiment of the invention can realize the purpose of private network live broadcast or Internet live broadcast through the self-contained live broadcast service, such as playing of live broadcast audio and video streams through a private network WEB browser or an Internet WEB browser in fig. 4.

Logic implemented by each unit or module in the videoconference system and logic at the browser end are described below.

1. Signaling service logic:

(1) When the controlled trigger starts live broadcast, the signaling service starts a media processing task for the conference, and when the live broadcast is stopped, the media processing task is stopped;

(2) A live address setting persistence and query interface is provided.

2. Media processing task logic:

(1) Starting a live broadcast simulation terminal to initiate a conference to a conference system, acquiring conference audio and video streams from corresponding conference media services, and completing media processing actions such as audio mixing, video multi-picture fusion and the like;

(2) Acquiring available HLS live broadcast service, and respectively producing a private network live broadcast address and an Internet live broadcast address according to the private network address of the live broadcast service, the service port, the butted CDN domain name and the conference number;

(3) The two live addresses are reported to the signaling service;

(4) And starting the private push protocol client to initiate push to the HLS live broadcast service, and sending the processed audio and video stream (corresponding to the first media stream) to the HLS live broadcast service.

3. HLS live service logic:

(1) Providing an audio and video stream push service of a private push protocol, and realizing self-description of push URL;

(2) Receiving push streaming audio and video data (corresponding to the first media stream) from a media processing task, converting the push streaming audio and video data into an HLS live broadcast data source, generating an HLS slice ts file and an m3u8 file, and storing the HLS slice ts file and the m3u8 file in a memory;

(3) Providing HLS live service to the outside, implementing HLS live session, in particular, setting a differentiated HTTP header Cache-Control value (corresponding to the aforementioned first configuration information, or second configuration information) for HTTP download of two files, including:

a) Setting a Cache-Control value to be max-age=0 for an m3u8 file (corresponding to the first media stream file of the first type);

b) Setting a Cache-Control value of max-age=30 (corresponding to the first predetermined time period) for the ts file (corresponding to the first group of media stream files of the second type);

(4) And automatically generating an HLS live address entry according to the value of the plug-flow URL.

4. Browser-side JS logic:

(1) Judging the URL address of the current web page, if the URL address is the Internet domain name, acquiring an Internet live broadcast address from a signaling service, otherwise, acquiring a private network live broadcast address like the signaling service;

(2) And embedding the m3u8 live address into the web page to play the live audio and video stream.

An example is given below:

(1) The video conference system starts live broadcast aiming at a conference with a conference number 91369430851;

(2) The private network IP address of the HLS live broadcast service is 10.35.148.111, and the public network IP address is 180.184.99.27;

(3) The HLS live broadcast service port is 8821;

(4) The plug flow service port of the HLS live broadcast service is 3883;

(5) The acceleration domain name of the third party CDN application is hls.

The private network HLS live address (corresponding to the first direct address) generated by the media processing task is:

http://10.35.148.111:8821/live/91369430851/index.m3u8；

the internet HLS live address (corresponding to the aforementioned second live address) generated by the media processing task is:

http://hls.hitry.com/live/91369430851/index.m3u8；

The private protocol push stream address generated by the media processing task is as follows:

http://10.35.148.111:3883/livepushstream＝91369430851；

the source address set by the third-party CDN is 180.184.99.27, and the port is 8821.

The HLS protocol interaction example in the embodiment of the present application is as follows, which is only an example and not limited to this case.

GET/live/91369430851/index.m3u8 HTTP/1.1

Connection:keep-alive

User-Agent:Mozilla/5.0(Windows NT 6.1；WOW64)AppleWebKit/537.36(KHTML,like Gecko)Chrome/80.0.3987.87Safari/537.36SE 2.X MetaSr 1.0

Accept:*/*

Accept-Encoding:gzip,deflate

Accept-Language:zh-CN,zh；q＝0.9

HTTP/1.1 200OK

Content-Type:application/vnd.apple.mpegurl

Content-Length:215

Connection:keep-alive

Content-Range:bytes 0-214/215

Cache-Control:max-age＝0

GET/live/91369430851/index_seg_82.ts HTTP/1.1

Connection:keep-alive

Accept:*/*

Accept-Encoding:gzip,deflate

Accept-Language:zh-CN,zh；q＝0.9

HTTP/1.1 200OK

Content-Type:video/octet-stream

Connection:close

Cache-Control:max-age＝30

According to the embodiment of the application, the purposes of efficiently accessing the CDN to the HLS live broadcast source station and improving the hit rate of the CDN are realized by setting the differentiated HTTP Cache-Control values for the two files of the HLS live broadcast. By generating two live broadcast m3u8 addresses aiming at the private network and the Internet, the automatic switching of the live broadcast scene of the private network and the live broadcast scene of the Internet is realized, and the purpose of saving CDN flow cost is achieved. The HLS live broadcast service plug flow URL self-description is automatically converted into an HLS live broadcast data source, and plug flow URL management logic is removed, so that the aim of greatly simplifying the complexity of live broadcast management is fulfilled.

Compared with the related art, the embodiment of the application has the following technical effects: 1) The hit rate of the edge nodes of the CDN is greatly improved, and the hit rate of the CDN can reach more than 90% during large-scale live broadcast, so that the pressure of the live source station of HLS is greatly reduced, and the large concurrency capacity of live broadcast of the HLS is improved. And when the traditional HLS live service is in butt joint with the CDN, the CDN hit rate is less than 5%. 2) The dependence of a third-party live center and a special CDN for video live is eliminated, and the source station is connected with the general CDN through the embodiment of the application, so that the high concurrency live service without plug-in of the browser can be realized; and the live content distribution is carried out only by relying on the third-party CDN, and when the live content distribution is in butt joint with a third-party system, no additional plug-flow interface is arranged besides the HTTP file downloading interface, and a live URL management interface is also not needed. The complexity of docking with a third party system is greatly simplified, the development complexity is reduced, and the system reliability is improved. 3) The video conference system is provided with live broadcast capability, and can be realized in the system without a third party live broadcast center or a third party CDN according to small-scale conference live broadcast requirements. The self-completeness of the video conference system is improved, CDN flow is reduced, and conference cost is saved.

From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to each embodiment of the present invention.

In this embodiment, there is also provided a transmission device for a media stream file, and fig. 5 is a block diagram of a structure of the transmission device for a media stream file according to an embodiment of the present invention, as shown in fig. 5, where the device includes:

an obtaining module 502, configured to obtain a first media stream, where the first media stream includes a media stream generated by live broadcasting a video conference currently performed in a video conference system;

a processing module 504, configured to process the first media stream to obtain a first media stream file set to be downloaded, where the first media stream file set includes a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for performing file indexing on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream;

A first sending module 506, configured to send, if the first set of media stream files is requested to be downloaded, first configuration information and the first set of media stream files to a CDN device, where the first configuration information is used to indicate that the first group of media stream files of the second type are cached on the CDN device for a first predetermined duration.

In an alternative embodiment, the first sending module 506 includes: the first sending unit is configured to send an HTTP protocol packet to the CDN device, where a header of the HTTP protocol packet carries the first configuration information, and a data field of the HTTP protocol packet carries the first media stream file set.

In an alternative embodiment, the first sending module 506 includes: a second sending unit, configured to send, when the first media stream file set is requested to be downloaded through the internet, first configuration information and the first media stream file set to the CDN device; the device further comprises: and the second sending module is used for sending the first media stream file set to terminal equipment requesting to download in the local area network under the condition that the first media stream file set is requested to be downloaded through the local area network after the first media stream is processed to obtain the first media stream file set to be downloaded.

In an alternative embodiment, the first sending module 506 includes: a third sending unit, configured to send, when the first media stream file set is requested to be downloaded by a first terminal device at a first moment, the first configuration information and the first media stream file set to the CDN device, and send, by the CDN device, the first media stream file set to the first terminal device; the device further comprises: a third sending module, configured to send, when a second media stream file set is requested to be downloaded by a second terminal device at a second time, where a first media stream file subset that is the same as a first media stream file subset exists in the second media stream file set and the second time is earlier than a sum of the first time and the first predetermined time, a second media stream file subset to the CDN device, and send, through the CDN device, the second media stream file subset and the first media stream file subset cached on the CDN device to the second terminal device, where the second media stream file subset includes media stream files in the second media stream file set except for the first media stream file subset; the second media stream file set includes a second media stream file of the first type and a second group of media stream files of the second type, the second media stream file of the first type is used for carrying out file index on the second group of media stream files of the second type, and the second group of media stream files of the second type is used for representing media streams generated after the second moment when video conferences currently carried out in the video conference system are live broadcast.

In an alternative embodiment, the apparatus further comprises: a fourth sending module, configured to send second configuration information to the CDN device when sending the second subset of media stream files to the CDN device, where the second configuration information is used to instruct to cache the second subset of media stream files on the CDN device for the first predetermined duration or a second predetermined duration different from the first predetermined duration, or the second configuration information is further used to instruct to cache the second subset of media stream files on the CDN device for the first predetermined duration or a second predetermined duration different from the first predetermined duration.

In an alternative embodiment, the apparatus further comprises: a first resetting module, configured to reset, on the CDN device, a remaining cache duration of the first subset of media stream files to the first predetermined duration if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the first predetermined duration; or a second resetting module, configured to reset, on the CDN device, a remaining cache duration of the first subset of media stream files to the second predetermined duration if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the second predetermined duration.

In an alternative embodiment, the processing module 504 includes: and the processing unit is used for slicing the first media stream to obtain the first media stream file set to be downloaded.

In an alternative embodiment, the apparatus further comprises: the generating module is used for generating a target live address under the condition that live broadcast is started for the video conference currently performed in the video conference system, wherein the target live address is used for indicating that the first media stream file set is requested to be downloaded through the Internet or a local area network.

It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, each of the above modules may be located in a different processor in any combination.

Embodiments of the present invention also provide a computer readable storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.

In one exemplary embodiment, the computer readable storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.

An embodiment of the invention also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.

In an exemplary embodiment, the electronic apparatus may further include a transmission device connected to the processor, and an input/output device connected to the processor.

Specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the exemplary implementation, and this embodiment is not described herein.

It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may be implemented in program code executable by computing devices, so that they may be stored in a memory device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described herein, or they may be separately manufactured as each integrated circuit module, or a plurality of modules or steps may be manufactured as a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.

The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for transmitting a media stream file, comprising:

acquiring a first media stream, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference currently performed in a video conference system;

processing the first media stream to obtain a first media stream file set to be downloaded, wherein the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for carrying out file index on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream;

and under the condition that the first media stream file set is requested to be downloaded, sending first configuration information and the first media stream file set to CDN equipment, wherein the first configuration information is used for indicating that the first group of media stream files of the second type are cached on the CDN equipment for a first preset time period.

2. The method of claim 1, wherein the sending the first configuration information and the first set of media stream files to the CDN device comprises:

and sending an HTTP protocol message to the CDN device, wherein the header of the HTTP protocol message carries the first configuration information, and the data field of the HTTP protocol message carries the first media stream file set.

3. The method of claim 1, wherein the step of determining the position of the substrate comprises,

the sending, in a case where the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set to a CDN device includes: sending first configuration information and the first media stream file set to the CDN device when the first media stream file set is requested to be downloaded through the Internet;

after processing the first media stream to obtain a first media stream file set to be downloaded, the method further includes: and in the case that the first media stream file set is requested to be downloaded through a local area network, sending the first media stream file set to a terminal device requesting to be downloaded in the local area network.

4. The method of claim 1, wherein the step of determining the position of the substrate comprises,

In the case that the first media stream file set is requested to be downloaded, sending first configuration information and the first media stream file set to a CDN device includes: under the condition that the first media stream file set is requested to be downloaded by first terminal equipment at a first moment, sending the first configuration information and the first media stream file set to the CDN equipment, and sending the first media stream file set to the first terminal equipment through the CDN equipment;

the method further comprises the steps of: in the case that a second media stream file set is requested to be downloaded by a second terminal device at a second moment, a first media stream file subset which is the same as that in the first media stream file set exists in the second media stream file set, and the second moment is earlier than the sum of the first moment and the first preset time length, sending the second media stream file subset to the CDN device, and sending the second media stream file subset and the first media stream file subset cached on the CDN device to the second terminal device through the CDN device, wherein the second media stream file subset comprises media stream files except the first media stream file subset in the second media stream file set;

The second media stream file set includes a second media stream file of the first type and a second group of media stream files of the second type, the second media stream file of the first type is used for carrying out file index on the second group of media stream files of the second type, and the second group of media stream files of the second type is used for representing media streams generated after the second moment when video conferences currently carried out in the video conference system are live broadcast.

5. The method according to claim 4, wherein the method further comprises:

when the second subset of media stream files is sent to the CDN device, second configuration information is sent to the CDN device,

the second configuration information is used for indicating that the second subset of media stream files is cached on the CDN device for the first predetermined time period or a second predetermined time period different from the first predetermined time period, or the second configuration information is also used for indicating that the second subset of media stream files is cached on the CDN device for the first predetermined time period or a second predetermined time period different from the first predetermined time period.

6. The method of claim 5, wherein the method further comprises:

resetting, on the CDN device, a remaining cache duration of the first subset of media stream files to the first predetermined duration, if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the first predetermined duration; or alternatively

And resetting the remaining cache duration of the first subset of media stream files to the second predetermined duration on the CDN device if the second configuration information is further used to indicate that the second set of media stream files is cached on the CDN device for the second predetermined duration.

7. The method according to any one of claims 1 to 6, wherein said processing the first media stream to obtain a first set of media stream files to be downloaded comprises:

and slicing the first media stream to obtain the first media stream file set to be downloaded.

8. The method according to claim 1, wherein the method further comprises:

and under the condition that live broadcasting is started for the video conference currently performed in the video conference system, generating a target live broadcasting address, wherein the target live broadcasting address is used for indicating that the first media stream file set is requested to be downloaded through the Internet or a local area network.

9. The method of claim 8, wherein the target live address comprises a first live address and a second live address;

the first direct broadcast address comprises a first IP address used by a direct broadcast service in the video conference system, a port number used by the direct broadcast service and a conference number of the video conference, wherein the first IP address is an IP address in a local area network, and the direct broadcast service is used for directly broadcasting the video conference currently performed in the video conference system; the second live address comprises a domain name of the CDN device and a conference number of the video conference, wherein a source station address set by the CDN device is a second IP address used by the live broadcast service, a source station port set by the CDN device is a port number used by the live broadcast service, the second IP address is an IP address of the Internet, and the source station address and the source station port are used for acquiring a media stream provided by the live broadcast service and generated by live broadcasting the video conference currently performed in the video conference system.

10. A transmission apparatus for a media stream file, comprising:

The system comprises an acquisition module, a video conference system and a video conference system, wherein the acquisition module is used for acquiring a first media stream, wherein the first media stream comprises a media stream generated by live broadcasting of a video conference currently performed in the video conference system;

the processing module is used for processing the first media stream to obtain a first media stream file set to be downloaded, wherein the first media stream file set comprises a first media stream file of a first type and a first group of media stream files of a second type, the first media stream file of the first type is used for carrying out file index on the first group of media stream files of the second type, and the first group of media stream files of the second type is used for representing the first media stream;

the first sending module is configured to send, when the first media stream file set is requested to be downloaded, first configuration information and the first media stream file set to a CDN device, where the first configuration information is used to indicate that the first group of media stream files of the second type are cached on the CDN device for a first predetermined duration.

11. A computer readable storage medium, characterized in that a computer program is stored in the computer readable storage medium, wherein the computer program, when being executed by a processor, implements the steps of the method according to any of the claims 1 to 9.

12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method as claimed in any one of claims 1 to 9 when the computer program is executed.