CN114257572A - Data processing method and device, computer readable medium and electronic equipment - Google Patents
Data processing method and device, computer readable medium and electronic equipment Download PDFInfo
- Publication number
- CN114257572A CN114257572A CN202010955417.9A CN202010955417A CN114257572A CN 114257572 A CN114257572 A CN 114257572A CN 202010955417 A CN202010955417 A CN 202010955417A CN 114257572 A CN114257572 A CN 114257572A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- live
- video
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 32
- 230000002159 abnormal effect Effects 0.000 claims abstract description 60
- 238000000034 method Methods 0.000 claims abstract description 26
- 230000000977 initiatory effect Effects 0.000 claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 15
- 230000005540 biological transmission Effects 0.000 claims description 26
- 230000002452 interceptive effect Effects 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 11
- 238000006467 substitution reaction Methods 0.000 claims description 4
- 230000002547 anomalous effect Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 17
- 239000003999 initiator Substances 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000013480 data collection Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000035943 smell Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Abstract
The present application belongs to the field of computer technologies, and in particular, relates to a data processing method, a data processing apparatus, a computer-readable medium, and an electronic device. The method comprises the following steps: the method comprises the steps that a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal are obtained, and the plurality of live broadcast data sources are used for collecting data of different modal types to form live broadcast content; respectively acquiring the data acquisition state of each live broadcast data source, and determining that the live broadcast data source is a normal data source or an abnormal data source according to the data acquisition state; when the live broadcast data source is an abnormal data source, acquiring a substitute data source with the same data modal type as the abnormal data source; and acquiring live broadcast content based on the multi-mode data through at least two live broadcast data sources in the normal data source and the alternative data source, and sending the live broadcast content to a live broadcast display end. The method and the device can reduce the dependency of the live network on hardware equipment and improve the stability and reliability of the live network.
Description
Technical Field
The present application belongs to the field of computer technologies, and in particular, relates to a data processing method, a data processing apparatus, a computer-readable medium, and an electronic device.
Background
With the development of computer and internet technologies, live webcasting has gradually become a mainstream information dissemination medium. Anyone can broadcast own visitors and smells through any network platform at any time. Therefore, live broadcast is an information transmission mode which can better embody the timeliness of information, and compared with other media such as newspapers, televisions, social network sites and the like, live broadcast on a network has higher information transmission speed and wider information transmission range.
The network live broadcast mainly utilizes the internet and the streaming media technology to carry out real-time information transmission, live broadcast content integrates various rich elements such as images, sounds, characters and the like, and a network anchor can display rich and colorful live broadcast content to users watching the live broadcast in a sound and shape mode.
Compared with various traditional media, the media admission threshold of the network live broadcast is greatly reduced, and anyone can form self media by means of a network live broadcast platform. However, the network live broadcast also requires some necessary hardware device support, limited by the formal requirements of the live content. For example, in the field of live video broadcasting, if the network anchor does not have audio and video acquisition equipment such as a camera and a microphone configured in advance or related equipment fails, live broadcasting cannot be performed. Therefore, how to continuously generate live broadcast content to ensure the continuity and stability of live network broadcast is an urgent problem to be solved at present.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present application and therefore may include information that does not constitute prior art known to a person of ordinary skill in the art.
Disclosure of Invention
An object of the embodiments of the present application is to provide a data processing method, a data processing apparatus, a computer readable medium, and an electronic device, which overcome technical problems, such as easy interruption of live network and poor stability of live network, at least to a certain extent.
Additional features and advantages of embodiments of the present application will be set forth in the detailed description which follows, or may be learned by practice of embodiments of the present application.
According to an aspect of an embodiment of the present application, there is provided a data processing method including: the method comprises the steps that a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal are obtained, and the live broadcast data sources are used for collecting data of different modal types to form live broadcast content; respectively acquiring the data acquisition state of each live data source, and determining that the live data source is a normal data source or an abnormal data source according to the data acquisition state; when the live broadcast data source is an abnormal data source, acquiring a substitute data source with the same data modality type as the abnormal data source; and acquiring live broadcast content based on multi-mode data through at least two live broadcast data sources in the normal data source and the alternative data source, and sending the live broadcast content to the live broadcast display terminal.
According to an aspect of an embodiment of the present application, there is provided a data processing apparatus including: the data source acquisition module is configured to acquire a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal; the state acquisition module is configured to respectively acquire the data acquisition states of the live data sources and determine that the live data sources are normal data sources or abnormal data sources according to the data acquisition states; a data source substitution module configured to, when the live data source is an abnormal data source, obtain a substitution data source having the same data modality type as the abnormal data source; and the content acquisition module is configured to acquire live content based on multi-mode data through at least two live data sources in the normal data source and the alternative data source and send the live content to the live display end.
In some embodiments of the present application, based on the above technical solutions, the state obtaining module includes: the connection state acquisition unit is configured to respectively acquire the device connection states of the data acquisition interfaces corresponding to the live data sources, and the device connection states are used for indicating whether the data acquisition interfaces are connected with data acquisition devices or not; a first state determination unit configured to determine a data acquisition state of a live data source corresponding to the data acquisition interface according to the device connection state.
In some embodiments of the present application, based on the above technical solutions, the state obtaining module includes: a data stream receiving unit configured to receive data streams through the respective live data sources; a transmission state acquisition unit configured to acquire a data stream transmission state of a data stream received by each of the live data sources, respectively; a second state determination unit configured to determine a data collection state of a live data source corresponding to the data stream according to the data stream transmission state.
In some embodiments of the present application, based on the above technical solution, the data source replacement module includes: a modality type obtaining unit configured to obtain a data modality type of the abnormal data source acquisition data; the data source set acquisition unit is configured to acquire a candidate data source set corresponding to the abnormal data source according to the data modality type; a substitute data source selection unit configured to select a substitute data source from the set of candidate data sources.
In some embodiments of the present application, based on the above technical solution, the alternative data source selecting unit includes: a priority obtaining subunit configured to obtain a data source priority of each candidate data source in the candidate data source set; a data source sorting subunit configured to sort the candidate data sources according to the data source priorities; and the data source selection subunit is configured to select an alternative data source from the candidate data source set according to the sorting result of the candidate data sources.
In some embodiments of the present application, based on the above technical solution, the live data source includes a video acquisition data source for acquiring video modality data through a video acquisition device and an audio acquisition data source for acquiring audio modality data through an audio acquisition device; and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a video file data source for generating video modal data through a video file.
In some embodiments of the present application, based on the above technical solutions, the content obtaining module includes: the audio acquisition unit is configured to acquire audio modal data acquired by an audio acquisition device through the audio acquisition data source; the first video acquisition unit is configured to read file contents of a video file through the video file data source and generate video modality data according to the file contents; a data combining unit configured to combine the audio modality data and the video modality data into live content based on multimodal data.
In some embodiments of the present application, based on the above technical solution, the file content of the video file includes one or more image files for displaying prompt text; the first video acquisition unit includes: a file arrangement subunit configured to arrange the one or more image files in an image presentation order to form an image sequence; a first video encoding subunit configured to video encode the sequence of images at a video frame rate to generate video modality data.
In some embodiments of the present application, based on the above technical solution, the live data source includes a video acquisition data source for acquiring video modality data through a video acquisition device and an audio acquisition data source for acquiring audio modality data through an audio acquisition device; and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a terminal interface data source for generating video modal data through an interactive interface of the terminal equipment.
In some embodiments of the present application, based on the above technical solutions, the content obtaining module includes: the audio acquisition unit is configured to acquire audio modal data acquired by an audio acquisition device through the audio acquisition data source; the second video acquisition unit is configured to acquire interface content of an interactive interface of the terminal equipment through the terminal interface data source and generate video modal data according to the interface content; a data combining unit configured to combine the audio modality data and the video modality data into live content based on multimodal data.
In some embodiments of the present application, based on the above technical solution, the interface content includes an interface image of the interactive interface; the second video acquisition unit includes: the interface image acquisition subunit is configured to acquire images of the interactive interface of the terminal equipment according to a video frame rate to obtain an interface image sequence consisting of interface images of the interactive interface; a second video coding subunit configured to perform video coding on the interface image sequence at the video frame rate to generate video modality data.
In some embodiments of the present application, based on the above technical solutions, the data processing apparatus further includes: the switching instruction response module is configured to respond to a data source switching instruction and acquire a data source to be switched in the live data source; and the data source switching module is configured to acquire a target data source with the same data modality type as the data source to be switched and replace the data source to be switched with the target data source.
According to an aspect of the embodiments of the present application, there is provided a computer readable medium, on which a computer program is stored, which when executed by a processor implements a data processing method as in the above technical solutions.
According to an aspect of an embodiment of the present application, there is provided an electronic apparatus including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the data processing method as in the above technical solution via executing the executable instructions.
According to an aspect of embodiments herein, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the data processing method as in the above technical scheme.
In the technical scheme provided by the embodiment of the application, whether each live data source can normally carry out data acquisition or not can be monitored by acquiring the data acquisition state of each live data source used for carrying out content live broadcast at the live broadcast initiating terminal, and once a certain live data source is found to be in an abnormal state, the live data source can be immediately replaced by a substitute data source capable of generating the same modal data, so that the live broadcast can be normally initiated and live broadcast content can be continuously generated, the dependency of the live broadcast on hardware equipment can be reduced, and the stability and the reliability of the live broadcast can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the embodiments of the application. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 schematically shows an exemplary system architecture block diagram to which the technical solution of the embodiment of the present application is applied.
Fig. 2 schematically shows a flow chart of steps of a data processing method in an embodiment of the present application.
Fig. 3 schematically illustrates a scene diagram of network live broadcast based on multiple live broadcast data sources in an embodiment of the present application.
Fig. 4 schematically shows a scene diagram of live webcasting based on a video file as an alternative data source in an embodiment of the present application.
Fig. 5 schematically illustrates a scene diagram of live webcasting by using interface content based on an interactive interface as an alternative data source in an embodiment of the present application.
Fig. 6 schematically shows a block diagram of a data processing apparatus according to an embodiment of the present application.
FIG. 7 schematically illustrates a block diagram of a computer system suitable for use in implementing an electronic device of an embodiment of the present application.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the application. One skilled in the relevant art will recognize, however, that the embodiments of the application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the embodiments of the present application.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Fig. 1 schematically shows a system architecture block diagram of a content live broadcast system to which technical solutions of embodiments of the present application are applied.
As shown in fig. 1, the content live broadcasting system 100 may mainly include a live broadcasting initiator 110, a server 120 and a live broadcasting presenter 130.
The live broadcast initiator 110 is a terminal device located on a network anchor side for generating live broadcast content to initiate a network live broadcast, and the network anchor may generate live broadcast content by using various electronic devices such as a smart phone, a tablet computer, a laptop computer, and a desktop computer, and upload the live broadcast content to the server 120 through a network (e.g., a communication medium such as a wireless communication link or a wireless communication link).
The server 120 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services.
The live display terminal 130 is a terminal device located at a live viewer side for displaying live content, and the live viewer can receive and watch live content distributed by the server 120 in real time through a network.
The content live broadcasting system 100 in the embodiment of the present application may have any number of terminal devices and servers according to implementation requirements. For example, the server 120 may be a server group consisting of a plurality of server devices. In addition, the technical solution provided in the embodiment of the present application may be applied to the live broadcast initiator 110, or may also be applied to the server 120, or may be implemented by both the live broadcast initiator 110 and the server 120, which is not particularly limited in this embodiment of the present application.
The live broadcast initiator 110 needs to continuously perform data acquisition and processing to form continuous live broadcast content during the process of initiating or performing live broadcast. Depending on the form of the live broadcast, the data used to form the live content may generally include streaming media data in a variety of different modalities, such as video streams, audio streams, text streams, image streams, and so on. For example, the webcast may collect a video stream through a camera, and simultaneously collect an audio stream through a microphone, the video stream data and the audio stream data are synchronously uploaded to the server 120, and the server 120 may integrate the two paths of data into a live content for live display, and then push the live content to the live display terminal 130 through the network to be displayed to a live viewer.
For live content formed based on data of multiple different modalities, data of various modalities is generally collected from a fixed data source. In some related technologies of the present application, if a data source for collecting data fails, problems such as failure of live broadcast initiation or live broadcast interruption may be caused. For example, when video stream data is specified to be collected through a camera, if the camera is not installed on a terminal device used by a webmaster or the camera fails, the webmaster cannot perform live broadcasting. In addition, if the camera is accidentally unplugged during live webcasting, and video stream data cannot be acquired, live webcasting is forced to be ended, a webmaster needs to reconnect the camera and restart live webcasting, live webcasting audiences need to re-enter a live webcasting room, and user experience is very poor. In order to solve the problems, embodiments of the present application provide a method for processing live broadcast data, which reduces excessive dependence of a live broadcast initiating terminal on hardware devices by configuring a substitute data source, ensures that the live broadcast initiating terminal can continuously generate live broadcast content, and ensures overall stability and reliability of network live broadcast.
The following describes in detail a data processing method applied to a live webcast scenario, which is provided by the present application, with reference to specific embodiments.
Fig. 2 schematically shows a flowchart of steps of a data processing method in an embodiment of the present application, where the data processing method may be performed by a terminal device at a live broadcast initiator, by a server, or by both the terminal device and the server. In the embodiment of the present application, a data processing method executed by a terminal device at a live broadcast initiating end is taken as an example for explanation, and as shown in fig. 2, the data processing method mainly includes the following steps S210 to S240.
Step S210: the method comprises the steps of obtaining a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal, wherein the plurality of live broadcast data sources are used for collecting data of different modal types to form live broadcast content.
Step S220: respectively acquiring the data acquisition state of each live data source, and determining that the live data source is a normal data source or an abnormal data source according to the data acquisition state.
Step S230: and when the live data source is an abnormal data source, acquiring a substitute data source with the same data modality type as the abnormal data source.
Step S240: and acquiring live broadcast content based on the multi-mode data through at least two live broadcast data sources in the normal data source and the alternative data source, and sending the live broadcast content to a live broadcast display end.
In the data processing method provided by the embodiment of the application, whether each live data source can normally perform data acquisition can be monitored by acquiring the data acquisition state of each live data source used for performing live content at the live initiating terminal, and once a certain live data source is found to be in an abnormal state, the live data source can be immediately replaced by a substitute data source capable of generating the same modal data, so that the live network broadcast can be normally initiated and live content can be continuously generated, the dependence of the live network broadcast on hardware equipment can be reduced, and the stability and reliability of the live network broadcast can be greatly improved.
Each step of the data processing method provided in the embodiment of the present application is described in detail below with reference to an application scenario of live webcasting.
In step S210, a plurality of live broadcast data sources for performing content live broadcast from the live broadcast initiator to the live broadcast presenter are obtained, and the plurality of live broadcast data sources are used for acquiring data of different modality types to form live broadcast content.
The live broadcast data source is a data source for generating live broadcast content on the terminal equipment of the live broadcast initiating terminal, and a plurality of live broadcast data sources respectively used for acquiring data of different modal types can be pre-configured at the live broadcast initiating terminal in order to provide live broadcast content combined in various media forms such as visual images, sound, texts and the like for live broadcast audiences. For example, a video capture data source for capturing video modality data through a video capture device and an audio capture data source for capturing audio modality data through an audio capture device may be configured at the live broadcast initiator.
Fig. 3 schematically illustrates a scene diagram of network live broadcast based on multiple live broadcast data sources in an embodiment of the present application. As shown in fig. 3, in this application scenario, a client program of the webmaster may capture video data through a camera 301 to form a video stream, and may capture audio data through a microphone 302 to form an audio stream. The video stream and the audio stream are sent to the server 303 together, the server 303 can integrate the two paths of data to form live content which can be played, and then the live content is pushed to a client program at a viewer side, so that the live content is displayed to the viewer.
In step S220, the data acquisition status of each live data source is obtained, and the live data source is determined to be a normal data source or an abnormal data source according to the data acquisition status.
The data acquisition state of the live data source is used for indicating whether the live data source can normally acquire data. If a live data source is capable of normal data acquisition to form a data stream for live presentation, the live data source may be determined to be a normal data source. And if one live data source cannot normally acquire data or cannot normally transmit data, the live data source is determined as an abnormal data source.
In an embodiment of the present application, the live data source performs data acquisition through an external device (such as a camera, a microphone, and the like) connected to the terminal device, and if the external device for acquiring data is not normally connected to the terminal device, the external device will not be able to provide corresponding live data. On this basis, the embodiment of the application can judge whether the external equipment is normally connected or not by detecting the connection state of the corresponding external equipment, and further determine the data acquisition state of the live data source.
Specifically, the method and the device for acquiring the live broadcast data can acquire the device connection state of each data acquisition interface corresponding to each live broadcast data source, wherein the device connection state is used for indicating whether the data acquisition interface is connected with the data acquisition device or not; and then determining the data acquisition state of the live data source corresponding to the data acquisition interface according to the equipment connection state. In this embodiment, each live data source may correspond to one data collection interface on the terminal device, and the data collection interface may be a physical interface or a network interface having a specified function. For example, a physical interface, such as a USB interface, for connecting a camera or other external devices may generally be provided on a computer device. The device connection state can be judged by detecting whether each physical interface is connected with the corresponding external device. Also for example, a network interface for wireless communication connection functions such as a bluetooth connection or wifi connection may be provided on the computer device. The device connection state can be judged by detecting whether the network interface establishes normal wireless communication connection with the external device.
In another embodiment of the present application, when a live data source can collect data to form a data stream, a transmission state of the data stream can be monitored to determine a data collection state of the live data source. Specifically, the embodiment of the application can receive data streams through each live data source respectively; then respectively acquiring the data stream transmission states of the data streams received by the live data sources; and further determining the data acquisition state of the live data source corresponding to the data stream according to the transmission state of the data stream. The data stream transmission state can be characterized in a plurality of dimensions such as data delay, jitter, packet loss and the like, and if the data stream transmitted by one live data source has the problems of higher delay rate or higher packet loss rate and the like, the data stream transmission state can be judged to be an abnormal state. On the basis, even if the live data source is normally connected with an external device for data acquisition, the live data source can still be determined as an abnormal data source due to the fact that a continuous and stable data stream cannot be provided.
In step S230, when the live data source is an abnormal data source, an alternative data source having the same data modality type as the abnormal data source is obtained.
When a live data source is determined to be an abnormal data source, the embodiment of the application can first acquire the data modality type of data acquired by the abnormal data source; the data modality types may include data types in various media forms such as video, audio, image, text, and the like. According to the data modality type of the data collected by the abnormal data source, a candidate data source set corresponding to the abnormal data source can be obtained, and a substitute data source can be further selected from the candidate data source set. The candidate data source set is a set composed of at least one candidate data source, and each candidate data source can provide live data with the same data modality type as the abnormal data source.
In an embodiment of the present application, when selecting the alternative data source, the data source priority of each candidate data source in the candidate data source set may be obtained, and after sorting each candidate data source according to the data source priority, the alternative data source is selected from the candidate data source set according to the sorting result of the candidate data source. In the embodiment of the present application, the priority of the data source may be configured for each candidate data source in advance, and a substitute data source may be selected according to the priority order. In another embodiment of the present application, the data source may also be visually displayed according to candidate data sources selectable from the candidate data source set, for example, a data source selection page may be displayed to a user through an interaction interface of the terminal device, and then an alternative data source may be determined according to a selection operation of the user.
In step S240, live content based on the multimodal data is obtained through at least two live data sources of the normal data source and the alternative data source, and the live content is sent to the live display end.
After the abnormal data source is replaced by the substitute data source, at least two live data sources of the normal data source and the substitute data source are used for data acquisition to form live content based on multi-mode data, and then the live content can be normally sent to a live display end under the condition that the preset live data source is abnormal, so that live network broadcast can be started.
In the related technology of the application, the live broadcast initiating terminal can preset the live broadcast type of the network live broadcast, and determine each live broadcast data source for generating the live broadcast content based on the live broadcast type. For example, when the live type is network video live, at least two data signals including a video stream and an audio stream need to be acquired from a plurality of live data sources. When the network video live broadcast is started or in the network video live broadcast process, if any one live broadcast data source is abnormal, live broadcast interruption can be caused due to the loss of the corresponding data signal. In the technical scheme provided by the embodiment of the application, when the live broadcast data source is detected to be abnormal, the abnormal data source can be immediately switched to the alternative data source so as to keep continuous transmission of the data signal, and thus live broadcast interruption is avoided. The method for switching the data source may include: acquiring a data transmission Protocol for pushing Live content from a Live broadcast initiator to a Live broadcast display end, where the data transmission Protocol may include, for example, a Real Time Streaming Protocol (RTSP), a Real Time Messaging Protocol (RTMP), a Streaming media transmission Protocol (HTTP Live Streaming, HLS) based on HTTP, and the like; replacing the address of a live data source configured in a data transmission protocol from a first address of an abnormal data source to a second address of a substitute data source; and acquiring a data signal from the second address according to a data transmission protocol, and continuously pushing a data stream based on the substitute data source to the live broadcast display terminal to keep the continuity of the data stream.
In one embodiment of the present application, the live data source includes a video capture data source that captures video modality data by a video capture device and an audio capture data source that captures audio modality data by an audio capture device. When the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a video file data source for generating video modal data through a video file.
On this basis, the embodiment of the present application may utilize a video file data source to generate the video modality data instead of the video capture data source. Specifically, the method comprises the following steps: acquiring audio modal data acquired by audio acquisition equipment through an audio acquisition data source; reading the file content of the video file through a video file data source, and generating video modal data according to the file content; and the audio modal data and the video modal data are combined into live broadcast content based on the multi-modal data.
In some alternative embodiments, the file content of the video file may include one or more image files for presenting prompt text; for example, a suggestive word such as "no camera" may be displayed on the image file. When generating video modality data according to file contents, embodiments of the present application may arrange one or more image files in an image presentation order to form an image sequence, and further perform video coding on the image sequence according to a video frame rate to generate the video modality data.
Fig. 4 schematically shows a scene diagram of live webcasting based on a video file as an alternative data source in an embodiment of the present application. As shown in fig. 4, in this application scenario, a video capture data source (e.g., a camera in fig. 3) originally used for capturing video data is an abnormal data source due to abnormal device connection or abnormal data transmission, and based on this, the embodiment of the present application may determine, based on the data source priority or based on a user selection, a video file data source that generates video data based on a video file 401 as an alternative data source for replacing the video capture data source.
The client program of the webcast can form a video stream by reading the file content of the video file 401, and can simultaneously form an audio stream by collecting audio data through the microphone 402. The video stream and the audio stream are sent to the server 403 together, and the server 403 can integrate the two paths of data to form live content for playing, and then push the live content to a client program on the viewer side, so as to show the live content to the viewer.
In another embodiment of the present application, the live data source includes a video capture data source that captures video modality data by a video capture device and an audio capture data source that captures audio modality data by an audio capture device. And when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a terminal interface data source for generating video modal data through an interactive interface of the terminal equipment.
On this basis, the embodiment of the application can utilize the terminal interface data source to replace the video acquisition data source to generate the video modality data. Specifically, the method comprises the following steps: acquiring audio modal data acquired by audio acquisition equipment through an audio acquisition data source; acquiring interface content of an interactive interface of terminal equipment through a terminal interface data source, and generating video modal data according to the interface content; and the audio modal data and the video modal data are combined into live broadcast content based on the multi-modal data.
In some alternative implementations, the interface content may include an interface image of the interactive interface. For example, when the network anchor uses a mobile phone to perform network live broadcasting, a picture displayed on a screen of the mobile phone in real time is an interface image of the interactive interface. When generating video mode data according to the interface content, the embodiment of the application can perform image acquisition on the interactive interface of the terminal device according to the video frame rate to obtain an interface image sequence composed of the interface images of the interactive interface, and further perform video coding on the interface image sequence according to the video frame rate to generate the video mode data.
Fig. 5 schematically illustrates a scene diagram of live webcasting by using interface content based on an interactive interface as an alternative data source in an embodiment of the present application. As shown in fig. 5, in the application scenario, a video capture data source (e.g., a camera in fig. 3) originally used for capturing video data is an abnormal data source due to abnormal device connection or abnormal data transmission, and on this basis, according to the priority of the data source or according to a user selection, the embodiment of the present application may determine, as an alternative data source for replacing the video capture data source, a terminal interface data source that generates video data based on interface content of an interactive interface.
The client program of the webcast can form a video stream by continuously and uninterruptedly stepping the pictures on the screen 501, and can form an audio stream by collecting audio data through the microphone 502. The video stream and the audio stream are sent to the server 503 together, and the server 503 can integrate the two paths of data to form live content for playing, and then push the live content to a client program on the viewer side, so as to show the live content to the viewer.
In one embodiment of the present application, the live data source may also be actively replaced by the user according to the live needs. Specifically, the method comprises the following steps: responding to a data source switching instruction, and acquiring a data source to be switched in a live data source; and acquiring a target data source with the same data mode type as the data source to be switched, and replacing the data source to be switched with the target data source.
In the embodiment of the application, according to a data source switching instruction triggered by a user, a target data source can be actively selected, and the data source to be switched is replaced through the target data source, so that the adjustment of the live broadcast content is realized. For example, the user may switch between camera data and screen data of the terminal device to change the live video image content.
Based on the technical scheme provided by the embodiment of the application, the network anchor can start live broadcast under the condition that the terminal equipment does not have a camera. In the live broadcast process, if a camera is accidentally unplugged or a connection fault, a data transmission fault and other problems occur, a video picture can be automatically switched to the content of a pre-configured video file or a display picture of a screen of a terminal device, so that the stability and reliability of network live broadcast are maintained. In addition, according to the live broadcast requirement, the data source switching can be actively carried out during live broadcast so as to enrich the live broadcast content and improve the flexibility of network live broadcast.
It should be noted that although the various steps of the methods in the embodiments of the present application are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
The following describes embodiments of an apparatus of the present application, which may be used to perform the data processing method in the above-described embodiments of the present application. Fig. 6 schematically shows a block diagram of a data processing apparatus according to an embodiment of the present application. As shown in fig. 6, the data processing apparatus 600 includes: a data source obtaining module 610 configured to obtain a plurality of live data sources for performing live content broadcast from a live broadcast initiator to a live broadcast presenter; a state obtaining module 620, configured to obtain data collecting states of the live data sources respectively, and determine that the live data sources are normal data sources or abnormal data sources according to the data collecting states; a data source replacement module 630, configured to, when the live data source is an abnormal data source, obtain a replacement data source having the same data modality type as the abnormal data source; a content obtaining module 640 configured to obtain live content based on multi-modal data through at least two live data sources of the normal data source and the alternative data source, and send the live content to the live display end.
In some embodiments of the present application, based on the above embodiments, the status obtaining module 620 includes: the connection state acquisition unit is configured to respectively acquire the device connection states of the data acquisition interfaces corresponding to the live data sources, and the device connection states are used for indicating whether the data acquisition interfaces are connected with data acquisition devices or not; a first state determination unit configured to determine a data acquisition state of a live data source corresponding to the data acquisition interface according to the device connection state.
In some embodiments of the present application, based on the above embodiments, the status obtaining module 620 includes: a data stream receiving unit configured to receive data streams through the respective live data sources; a transmission state acquisition unit configured to acquire a data stream transmission state of a data stream received by each of the live data sources, respectively; a second state determination unit configured to determine a data collection state of a live data source corresponding to the data stream according to the data stream transmission state.
In some embodiments of the present application, based on the above embodiments, the data source replacement module 630 includes: a modality type obtaining unit configured to obtain a data modality type of the abnormal data source acquisition data; the data source set acquisition unit is configured to acquire a candidate data source set corresponding to the abnormal data source according to the data modality type; a substitute data source selection unit configured to select a substitute data source from the set of candidate data sources.
In some embodiments of the present application, based on the above embodiments, the alternative data source selecting unit includes: a priority obtaining subunit configured to obtain a data source priority of each candidate data source in the candidate data source set; a data source sorting subunit configured to sort the candidate data sources according to the data source priorities; and the data source selection subunit is configured to select an alternative data source from the candidate data source set according to the sorting result of the candidate data sources.
In some embodiments of the present application, based on the above embodiments, the live data source includes a video acquisition data source for acquiring video modality data through a video acquisition device and an audio acquisition data source for acquiring audio modality data through an audio acquisition device; and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a video file data source for generating video modal data through a video file.
In some embodiments of the present application, based on the above embodiments, the content obtaining module 640 includes: the audio acquisition unit is configured to acquire audio modal data acquired by an audio acquisition device through the audio acquisition data source; the first video acquisition unit is configured to read file contents of a video file through the video file data source and generate video modality data according to the file contents; a data combining unit configured to combine the audio modality data and the video modality data into live content based on multimodal data.
In some embodiments of the present application, based on the above embodiments, the file content of the video file includes one or more image files for displaying prompt text; the first video acquisition unit includes: a file arrangement subunit configured to arrange the one or more image files in an image presentation order to form an image sequence; a first video encoding subunit configured to video encode the sequence of images at a video frame rate to generate video modality data.
In some embodiments of the present application, based on the above embodiments, the live data source includes a video acquisition data source for acquiring video modality data through a video acquisition device and an audio acquisition data source for acquiring audio modality data through an audio acquisition device; and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a terminal interface data source for generating video modal data through an interactive interface of the terminal equipment.
In some embodiments of the present application, based on the above embodiments, the content obtaining module 640 includes: the audio acquisition unit is configured to acquire audio modal data acquired by an audio acquisition device through the audio acquisition data source; the second video acquisition unit is configured to acquire interface content of an interactive interface of the terminal equipment through the terminal interface data source and generate video modal data according to the interface content; a data combining unit configured to combine the audio modality data and the video modality data into live content based on multimodal data.
In some embodiments of the present application, based on the above embodiments, the interface content includes an interface image of the interactive interface; the second video acquisition unit includes: the interface image acquisition subunit is configured to acquire images of the interactive interface of the terminal equipment according to a video frame rate to obtain an interface image sequence consisting of interface images of the interactive interface; a second video coding subunit configured to perform video coding on the interface image sequence at the video frame rate to generate video modality data.
In some embodiments of the present application, based on the above embodiments, the data processing apparatus 600 further includes: the switching instruction response module is configured to respond to a data source switching instruction and acquire a data source to be switched in the live data source; and the data source switching module is configured to acquire a target data source with the same data modality type as the data source to be switched and replace the data source to be switched with the target data source.
The specific details of the data processing apparatus provided in each embodiment of the present application have been described in detail in the corresponding method embodiment, and are not described herein again.
Fig. 7 schematically shows a block diagram of a computer system of an electronic device for implementing an embodiment of the present application.
It should be noted that the computer system 700 of the electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU) 701 that can perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the random access memory 703, various programs and data necessary for system operation are also stored. The cpu 701, the rom 702, and the ram 703 are connected to each other via a bus 704. An Input/Output interface 705(Input/Output interface, i.e., I/O interface) is also connected to the bus 704.
The following components are connected to the input/output interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a local area network card, a modem, and the like. The communication section 709 performs communication processing via a network such as the internet. A driver 710 is also connected to the input/output interface 705 as necessary. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.
In particular, according to embodiments of the present application, the processes described in the various method flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by the central processor 701, performs various functions defined in the system of the present application.
It should be noted that the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM), a flash Memory, an optical fiber, a portable Compact Disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the application. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (15)
1. A data processing method, comprising:
the method comprises the steps that a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal are obtained, and the live broadcast data sources are used for collecting data of different modal types to form live broadcast content;
respectively acquiring the data acquisition state of each live data source, and determining that the live data source is a normal data source or an abnormal data source according to the data acquisition state;
when the live broadcast data source is an abnormal data source, acquiring a substitute data source with the same data modality type as the abnormal data source;
and acquiring live broadcast content based on multi-mode data through at least two live broadcast data sources in the normal data source and the alternative data source, and sending the live broadcast content to the live broadcast display terminal.
2. The data processing method according to claim 1, wherein the separately acquiring the data acquisition status of each live data source comprises:
respectively acquiring the equipment connection state of each data acquisition interface corresponding to each live broadcast data source, wherein the equipment connection state is used for indicating whether the data acquisition interface is connected with data acquisition equipment or not;
and determining the data acquisition state of the live data source corresponding to the data acquisition interface according to the equipment connection state.
3. The data processing method according to claim 1, wherein the separately acquiring the data acquisition status of each live data source comprises:
receiving data streams through the live data sources respectively;
respectively acquiring the data stream transmission state of the data stream received by each live data source;
and determining the data acquisition state of a live data source corresponding to the data stream according to the data stream transmission state.
4. The data processing method of claim 1, wherein the obtaining an alternate data source having the same data modality type as the anomalous data source comprises:
acquiring a data modality type of the data acquired by the abnormal data source;
acquiring a candidate data source set corresponding to the abnormal data source according to the data modality type;
and selecting an alternative data source from the candidate data source set.
5. The data processing method of claim 4, wherein the selecting an alternative data source from the set of candidate data sources comprises:
acquiring the data source priority of each candidate data source in the candidate data source set;
sorting each candidate data source according to the data source priority;
and selecting a substitute data source from the candidate data source set according to the sorting result of the candidate data sources.
6. The data processing method of claim 1, wherein the live data source comprises a video acquisition data source for acquiring video modality data by a video acquisition device and an audio acquisition data source for acquiring audio modality data by an audio acquisition device;
and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a video file data source for generating video modal data through a video file.
7. The data processing method of claim 6, wherein the obtaining live content based on multimodal data through at least two live data sources of the normal data source and the alternative data source comprises:
acquiring audio modal data acquired by audio acquisition equipment through the audio acquisition data source;
reading the file content of a video file through the video file data source, and generating video modal data according to the file content;
and composing the audio modal data and the video modal data into live content based on multi-modal data.
8. The data processing method of claim 7, wherein the file content of the video file comprises one or more image files for presenting prompt text; the generating of the video modality data according to the file content includes:
arranging the one or more image files according to an image display sequence to form an image sequence;
the image sequence is video encoded at a video frame rate to generate video modality data.
9. The data processing method of claim 1, wherein the live data source comprises a video acquisition data source for acquiring video modality data by a video acquisition device and an audio acquisition data source for acquiring audio modality data by an audio acquisition device;
and when the video acquisition data source is an abnormal data source and the audio acquisition data source is a normal data source, the substitute data source comprises a terminal interface data source for generating video modal data through an interactive interface of the terminal equipment.
10. The data processing method of claim 9, wherein the obtaining live content based on multimodal data through at least two of the normal data source and the alternative data source comprises:
acquiring audio modal data acquired by audio acquisition equipment through the audio acquisition data source;
acquiring interface content of an interactive interface of the terminal equipment through the terminal interface data source, and generating video modal data according to the interface content;
and composing the audio modal data and the video modal data into live content based on multi-modal data.
11. The data processing method of claim 10, wherein the interface content comprises an interface image of the interactive interface; the generating of the video modality data according to the interface content includes:
acquiring images of an interactive interface of the terminal equipment according to a video frame rate to obtain an interface image sequence consisting of interface images of the interactive interface;
and carrying out video coding on the interface image sequence according to the video frame rate to generate video mode data.
12. The data processing method according to any one of claims 1 to 11, characterized in that the method further comprises:
responding to a data source switching instruction, and acquiring a data source to be switched in the live broadcast data source;
and acquiring a target data source with the same data modality type as the data source to be switched, and replacing the data source to be switched with the target data source.
13. A data processing apparatus, comprising:
the data source acquisition module is configured to acquire a plurality of live broadcast data sources for carrying out content live broadcast from a live broadcast initiating terminal to a live broadcast display terminal;
the state acquisition module is configured to respectively acquire the data acquisition states of the live data sources and determine that the live data sources are normal data sources or abnormal data sources according to the data acquisition states;
a data source substitution module configured to, when the live data source is an abnormal data source, obtain a substitution data source having the same data modality type as the abnormal data source;
and the content acquisition module is configured to acquire live content based on multi-mode data through at least two live data sources in the normal data source and the alternative data source and send the live content to the live display end.
14. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 12.
15. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the data processing method of any one of claims 1 to 12 via execution of the executable instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010955417.9A CN114257572B (en) | 2020-09-11 | 2020-09-11 | Data processing method, device, computer readable medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010955417.9A CN114257572B (en) | 2020-09-11 | 2020-09-11 | Data processing method, device, computer readable medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114257572A true CN114257572A (en) | 2022-03-29 |
| CN114257572B CN114257572B (en) | 2023-11-24 |
Family
ID=80788754
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010955417.9A Active CN114257572B (en) | 2020-09-11 | 2020-09-11 | Data processing method, device, computer readable medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114257572B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022218425A1 (en) * | 2021-04-15 | 2022-10-20 | 北京字节跳动网络技术有限公司 | Recording streaming method and apparatus, device, and medium |
| CN117135417A (en) * | 2023-10-26 | 2023-11-28 | 环球数科集团有限公司 | Scenic spot intelligent marketing and virtual live broadcast system based on multi-mode large model |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101998104A (en) * | 2009-08-31 | 2011-03-30 | 中国移动通信集团公司 | Generating method for video telephone and substitute video thereof |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN107071503A (en) * | 2017-02-09 | 2017-08-18 | 腾讯科技（深圳）有限公司 | The method of net cast, device and live connect streaming server |
| CN107241615A (en) * | 2017-07-31 | 2017-10-10 | 合网络技术（北京）有限公司 | Live pause method, system, live pause device and direct broadcast server |
| CN108012161A (en) * | 2017-11-10 | 2018-05-08 | 广州华多网络科技有限公司 | Net cast method, system and terminal device |
| CN108259989A (en) * | 2018-01-19 | 2018-07-06 | 广州华多网络科技有限公司 | Method, computer readable storage medium and the terminal device of net cast |
| CN108650521A (en) * | 2018-05-17 | 2018-10-12 | 上海七牛信息技术有限公司 | A kind of live broadcasting method, device and multimedia play system |
| CN111107296A (en) * | 2019-11-26 | 2020-05-05 | 视联动力信息技术股份有限公司 | Audio data acquisition method and device, electronic equipment and readable storage medium |
-
2020
- 2020-09-11 CN CN202010955417.9A patent/CN114257572B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101998104A (en) * | 2009-08-31 | 2011-03-30 | 中国移动通信集团公司 | Generating method for video telephone and substitute video thereof |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN107071503A (en) * | 2017-02-09 | 2017-08-18 | 腾讯科技（深圳）有限公司 | The method of net cast, device and live connect streaming server |
| CN107241615A (en) * | 2017-07-31 | 2017-10-10 | 合网络技术（北京）有限公司 | Live pause method, system, live pause device and direct broadcast server |
| CN108012161A (en) * | 2017-11-10 | 2018-05-08 | 广州华多网络科技有限公司 | Net cast method, system and terminal device |
| CN108259989A (en) * | 2018-01-19 | 2018-07-06 | 广州华多网络科技有限公司 | Method, computer readable storage medium and the terminal device of net cast |
| CN108650521A (en) * | 2018-05-17 | 2018-10-12 | 上海七牛信息技术有限公司 | A kind of live broadcasting method, device and multimedia play system |
| CN111107296A (en) * | 2019-11-26 | 2020-05-05 | 视联动力信息技术股份有限公司 | Audio data acquisition method and device, electronic equipment and readable storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022218425A1 (en) * | 2021-04-15 | 2022-10-20 | 北京字节跳动网络技术有限公司 | Recording streaming method and apparatus, device, and medium |
| CN117135417A (en) * | 2023-10-26 | 2023-11-28 | 环球数科集团有限公司 | Scenic spot intelligent marketing and virtual live broadcast system based on multi-mode large model |
| CN117135417B (en) * | 2023-10-26 | 2023-12-22 | 环球数科集团有限公司 | Scenic spot intelligent marketing and virtual live broadcast system based on multi-mode large model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114257572B (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020233142A1 (en) | Multimedia file playback method and apparatus, electronic device, and storage medium | |
| CN109803151B (en) | Multimedia data stream switching method and device, storage medium and electronic device | |
| CN110858827B (en) | Broadcast starting acceleration method and device and computer readable storage medium | |
| CN108810657B (en) | Method and system for setting video cover | |
| CN106792230B (en) | Advertisement interaction method and system based on live video | |
| US20160164970A1 (en) | Application Synchronization Method, Application Server and Terminal | |
| CN113286197A (en) | Information display method and device, electronic equipment and storage medium | |
| CN114257572B (en) | Data processing method, device, computer readable medium and electronic equipment | |
| CN114154012A (en) | Video recommendation method and device, electronic equipment and storage medium | |
| US20240015361A1 (en) | Multi-mode conversion of multiple video streams | |
| CN111818383B (en) | Video data generation method, system, device, electronic equipment and storage medium | |
| WO2015180446A1 (en) | System and method for maintaining connection channel in multi-device interworking service | |
| CN111614954A (en) | Index acquisition processing method and device for streaming media, computer and storage medium | |
| KR20220144857A (en) | Multimedia data publishing method and apparatus, device and recording medium | |
| CN112243158B (en) | Media file processing method and device, computer readable medium and electronic equipment | |
| CN109948082B (en) | Live broadcast information processing method and device, electronic equipment and storage medium | |
| CN112770171A (en) | Content display method, device, system, equipment and storage medium | |
| CN113923530B (en) | Interactive information display method and device, electronic equipment and storage medium | |
| CN111405308B (en) | Method and device for sending live audio and video data | |
| CN115086775A (en) | Video display method and device | |
| CN108769565B (en) | Automatic switching method of picture layout, server and local recording and broadcasting system | |
| CN106302543B (en) | Multimedia display method, device and system | |
| KR102051985B1 (en) | Synchronization of Media Rendering in Heterogeneous Networking Environments | |
| CN111142740A (en) | Data updating method, device and storage medium | |
| US9584572B2 (en) | Cloud service device, multi-image preview method and cloud service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |