WO2018077259A1 - 一种媒体信息的切换方法及服务器、计算机存储介质 - Google Patents

一种媒体信息的切换方法及服务器、计算机存储介质 Download PDF

Info

Publication number
WO2018077259A1
WO2018077259A1 PCT/CN2017/108282 CN2017108282W WO2018077259A1 WO 2018077259 A1 WO2018077259 A1 WO 2018077259A1 CN 2017108282 W CN2017108282 W CN 2017108282W WO 2018077259 A1 WO2018077259 A1 WO 2018077259A1
Authority
WO
WIPO (PCT)
Prior art keywords
media information
signal
electrical signal
target
audio
Prior art date
Application number
PCT/CN2017/108282
Other languages
English (en)
French (fr)
Inventor
钱浩
刘克松
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2018077259A1 publication Critical patent/WO2018077259A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • H04N21/4383Accessing a communication channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • H04N21/4383Accessing a communication channel
    • H04N21/4384Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency

Definitions

  • the present invention relates to information switching technology, and in particular, to a method for switching media information, a server, and a computer storage medium.
  • each user can be used as a producer and publisher of media information.
  • the live programs (or live media information) produced by each user are also independent.
  • the production and release time of live programs (or live media information) is also independent. Therefore, in multiple live programs (or live broadcasts) Switching between media information) cannot ensure timeliness and fluency. For example, when the background server switches between multiple live programs (or live media information), there will be problems such as live broadcast interruption on the user side, let alone It takes a lot of time and processing cost to compile multiple live programs (or live media information) into a set of network programs.
  • the embodiments of the present invention provide a method for switching media information, a server, and a computer storage medium, which at least solve the problems existing in the prior art.
  • a method for switching media information according to an embodiment of the present invention includes:
  • the server includes:
  • a receiving unit configured to receive at least one piece of media information
  • a converting unit configured to convert the at least one piece of media information into at least one electrical signal corresponding to the at least one piece of media information
  • An acquiring unit configured to acquire a handover request, where the handover request is used to switch current media information played on the live broadcast end to target media information;
  • a response unit configured to switch, according to the switching request, a current electrical signal corresponding to the current media information to a target electrical signal corresponding to the target media information, where the target electrical signal is transmitted to the live broadcast Before the end playing, the target electrical signal is encoded and converted to obtain the target media information, and the target media information is transmitted to the live end for playing.
  • a computer storage medium according to an embodiment of the present invention, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used in the method for switching media information according to any one of the foregoing solutions.
  • a method for switching media information according to an embodiment of the present invention is applied to a server, a server package Enclosing one or more processors and memory, and one or more programs, wherein the one or more programs are stored in a memory, the programs may include one or more of each corresponding to a group a module of instructions, the one or more processors being configured to execute instructions; the method comprising:
  • the embodiment of the present invention converts the received at least one piece of media information to obtain at least one electrical signal corresponding to the at least one piece of media information, because the delay of transmission of the electrical signal is low, and the momentary interruption during the live broadcast switching, The electrical signal can be recovered instantaneously. Therefore, after the switching request is obtained, the current electrical signal corresponding to the current media information can be switched to the target electrical signal corresponding to the target media information to reduce the transmission delay.
  • the time cost and the processing cost are saved, and the media type information is supported on the live broadcast end, so that the target electrical signal is encoded and converted before the target electrical signal is transmitted to the live broadcast end, so as to obtain the information of the playback media type, that is, the target media is retrieved.
  • Information transfer the target media information to the live broadcast for playback. With the embodiment of the invention, timeliness and playback fluency can be ensured when switching between multiple live programs (or live media information).
  • 1 is a schematic diagram of hardware entities of each party performing information interaction in an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a method for implementing a method according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of another method for implementing an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of transmission of assembling a multi-channel signal into one SDI signal according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of a system according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a switching system to which an embodiment of the present invention is applied;
  • FIG. 7 is a schematic diagram of converting an SDI signal by acquiring logic in a switching system to which an embodiment of the present invention is applied;
  • FIG. 8 is a schematic diagram of information assembly logic in a handover system to which an embodiment of the present invention is applied;
  • FIG. 9 is a schematic diagram of coding logic in a handover system to which an embodiment of the present invention is applied;
  • FIG. 10 is a schematic structural diagram of a server according to an embodiment of the present invention.
  • module A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings.
  • suffixes such as “module,” “component,” or “unit” used to denote an element are merely illustrative of the embodiments of the present invention, and do not have a specific meaning per se. Therefore, “module” and “component” can be used in combination.
  • first, second, etc. are used herein to describe various elements (or various thresholds or various applications or various instructions or various operations), etc., these elements (or thresholds) Or application or instruction or operation) should not be limited by these terms. These terms are only used to distinguish one element (or threshold or application or instruction or operation) and another element (or threshold or application or instruction or operation).
  • the first operation may be referred to as a second operation, and the second operation may also be referred to as Referring to the first operation, without departing from the scope of the invention, both the first operation and the second operation are operations, but the two are not the same operation.
  • the steps in the embodiment of the present invention are not necessarily processed in the order of the steps described.
  • the steps may be selectively arranged to be reordered according to requirements, or the steps in the embodiment may be deleted, or the steps in the embodiment may be added.
  • the description of the steps in the embodiments of the present invention is only an optional combination of the steps, and does not represent a combination of the steps of the embodiments of the present invention.
  • the order of the steps in the embodiments is not to be construed as limiting the present invention.
  • the intelligent terminal (such as a mobile terminal) of the embodiment of the present invention can be implemented in various forms.
  • the mobile terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (PDA, Personal Digital Assistant), a tablet (PAD), a portable multimedia player ( Mobile terminals such as PMP (Portable Media Player), navigation devices, and the like, and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PAD tablet
  • PMP Portable Multimedia Player
  • navigation devices and the like
  • fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 1 is a schematic diagram of hardware entities of each party performing information interaction according to an embodiment of the present invention.
  • FIG. 1 includes: a first end of a live broadcast interaction, a server 2, and a second end 3 of a live broadcast interaction;
  • the terminal (such as the anchor end) may use a terminal device such as a mobile phone, a desktop computer, a PC, or an all-in-one.
  • the terminal device 11-14 performs information interaction with the server through a wired network or a wireless network.
  • the second end of the live interaction (such as the audience) can also A terminal device such as a mobile phone, a desktop computer, a PC, or an all-in-one is used.
  • a mobile phone such as the terminal device 31-35, is used.
  • the switching of the media information is converted by the media information (such as video information), and the conversion of the media information (such as video information) to the electrical signal is converted.
  • the resulting electrical signal is encoded to retrieve media information (such as video information) for playback.
  • the re-obtaining media information may be initial media information (such as original video information) obtained from a first end of the live interaction (such as an anchor end), such as media information A1-A2, or It is new media information (such as new video information) different from the original media information (such as the original video information), for example, a plurality of media information B1-B2 obtained according to the media information A1-A2, or according to the media information A1- A2 completes a complete media information B.
  • the processing logic 10 of the server is as shown in FIG.
  • the processing logic 10 of the server includes: S1, the server will interact from multiple live broadcasts, with the server 2 as an execution entity that performs a switching response to the media information (such as video information) in the live broadcast scenario.
  • At least one piece of media information received by one end (such as the anchor end, the user of the anchor end may be the producer and publisher of the media information) is converted into at least one electrical signal (such as an SDI electrical signal) corresponding to the at least one piece of media information.
  • S2. Obtain a handover request, where the handover request is initiated by a second end of the live interaction (such as a viewer, the user of the audience may be a player of the media information), and the handover request is used for the current media information to be played on the live broadcast end.
  • the server responds to the handover request, and switches a current electrical signal corresponding to the current media information to a target electrical signal corresponding to the target media information, where the second end of the live interaction (eg, the audience, the audience)
  • the user of the end may be the player of the media information.
  • the information supporting the playing is the information of the media type, and then the target electrical signal is encoded and converted before the target electrical signal is transmitted to the live broadcast to obtain the live interaction.
  • the second end (such as the viewer, the user of the viewer may be the player of the media information) plays the target media information, and transmits the target media information to the second end of the live interaction (such as the viewer, the user of the viewer may be the media information) Player), at the second end of the live interaction (such as the viewer, the user of the viewer can be the player of the media information) Target media information.
  • the target media information includes: at least one piece of media information directly received from a first end of the live broadcast interaction (eg, the anchor end, the user of the anchor end may be the producer and publisher of the media information), and/or according to the direct reception At least one media information obtained by the media information and different from the at least one media information directly received, and/or an assembled form of media information obtained according to the directly received at least one media information.
  • the processing logic 10 may exist in the form of a unit in one server, or may be in the form of multiple hardware entities in a server cluster system composed of multiple servers.
  • the response processing logic for the handover request includes: 1) receiving media information from the first end of the live broadcast (for example, collecting, in the form of a unit in a server or a hardware entity in the server cluster system). 2) media information is switched to an electrical signal (such as an SDI electrical signal); an electrical signal (such as an SDI electrical signal) is encoded and converted to obtain media information that can be played on the second end of the live broadcast.
  • each user since each user is independent and scattered throughout the network, each user's live program (or live media information) is also independent, and the live program (or live broadcast) The production and release time of media information) is also independent. Therefore, switching between multiple live programs (or live media information) cannot ensure timeliness and fluency.
  • the background server is in multiple live programs ( When switching between live media information, there will be problems such as live broadcast interruption on the user side, let alone a lot of time cost and compilation of multiple live programs (or live media information) into a set of network programs. Processing costs.
  • the received at least one piece of media information is converted to obtain at least one electrical signal corresponding to the at least one piece of media information, because the delay of transmission of the electrical signal is low, and the momentary interruption during the live broadcast switching
  • the electrical signal can be recovered instantaneously. Therefore, after obtaining the handover request, responding to the handover request, the current electrical signal corresponding to the current media information can be switched to the target electrical signal corresponding to the target media information for transmission, so as to reduce the transmission delay.
  • the target electrical signal is encoded and converted to obtain the information of the playing media type, that is, the target media information is retrieved, and the target media information is transmitted to the live end for playing, and the plurality of live programs are played. Timeliness and playback fluency can be ensured when switching between (or live media information).
  • FIG. 1 is only a system architecture example for implementing the embodiment of the present invention.
  • the embodiment of the present invention is not limited to the system structure described in FIG. 1 above, and various embodiments of the method of the present invention are proposed based on the system architecture described above in FIG. .
  • the method includes: the server receiving at least one media information, and converting the at least one media information into at least one corresponding to the at least one media information
  • One way electrical signal (101) the media information may be a network video stream, and the network video stream is converted into an SDI electrical signal. Since the network video stream is a video file, if the network is resumed, it needs to be buffered for a certain period of time to play the current file. SDI is an electrical signal that transmits image signals of one frame and one frame by high and low levels. Therefore, when an SDI electrical signal is transmitted, if it is instantaneously interrupted, it can be recovered instantaneously.
  • the existing broadcast television technology can be used, and the buffer processing with millisecond level can be well matched to meet the needs of seamless connection during handover.
  • the handover request is used to switch the current media information played on the live broadcast to the target media information (102).
  • the switching request switching the current electrical signal corresponding to the current media information to a target electrical signal corresponding to the target media information for transmission, and transmitting the target electrical signal to the live broadcast terminal (specifically, live broadcast
  • live broadcast terminal specifically, live broadcast
  • the second end of the interaction encodes and converts the target electrical signal to obtain the target media information, and transmits the target media information to the live broadcast terminal for playing (103).
  • the conversion of one of the plurality of media information is performed.
  • the initial target media information is media information A, corresponding to the target electrical signal B(A), and the transmission destination.
  • the electrical signal B(A), the code conversion result is the media information A, that is, the target media information A is retrieved, or the media information A' obtained based on the media information A.
  • the target media information A or A′ is used as the feedback result of the handover request of the second end of the live broadcast (specifically, the second end of the live broadcast interaction), that is, the target media information A or A′ is sent to the second end of the live broadcast that initiates the handover request ( Specifically, the second end of the live broadcast interaction, the target media information A or A′ is played on the second end of the live broadcast (specifically, the second end of the live broadcast interaction).
  • the target media information is transmitted to the second end of the live broadcast (specifically, the second end of the live broadcast interaction) for playing.
  • the result of the output switching result is obtained by coding and conversion, and is the target media information.
  • the first end of the live broadcast (such as the anchor end) sends the live video stream to the service background server of the webcast through the PC or the mobile phone, and then obtains the live video stream from the background server, and is used for video streaming.
  • the signal conversion is converted to obtain an SDI electrical signal.
  • the image signal and the audio signal collected by playing the live video stream are converted into an SDI signal, and the switched SDI electrical signal is encoded by seamless switching to obtain a network.
  • the target media information in the form of a video stream that is, the target media information is transmitted to the CDN in the form of a network video stream, and then distributed to the second end of the live interaction (such as the viewer) through the CDN to view the target media information.
  • a method for switching media information according to an embodiment of the present invention includes: receiving, by a server, at least one piece of media information, playing the at least one piece of media information, and outputting to One less playback signal (201). Determining the obtained at least one playback signal as at least one electrical signal (202) corresponding to the at least one media information to convert the at least one media information into at least one electrical signal corresponding to the at least one media information.
  • the media information is a live video stream
  • the playback signal including the image signal and the audio signal
  • the SDI signal is obtained according to the image signal and the audio signal, that is, through the special collection processing. And the conversion gets the SDI signal.
  • the network video stream is a video file
  • SDI is an electrical signal, which is to send an image of one frame and one frame by high and low levels.
  • the signal therefore, when the SDI electrical signal is transmitted, it can be recovered instantaneously if it is interrupted instantaneously.
  • the existing broadcast television technology can be used, and the buffer processing with millisecond level can be switched well, which can well meet the needs of seamless connection during handover.
  • the handover request is used to switch current media information played on the live broadcast end to target media information (203).
  • the at least one electrical signal corresponding to the at least one piece of media information is assembled into an electrical signal, and the electrical signal is transmitted as the target electrical signal (204).
  • Decoding and converting the target electrical signal before the target electrical signal is transmitted to the live end (specifically, the second end of the live broadcast interaction) to obtain the target media information, and transmitting the target media information to the live broadcast
  • the end plays (205). For example, converting a network video stream into an SDI electrical signal transmission, and utilizing the low delay of the SDI electrical signal transmission, improves the problem of delay and low processing efficiency in the existing switching process.
  • the initial target media information is the media information A, the corresponding target electrical signal B (A), the transmission target electrical signal B (A), and the encoded conversion result is the media.
  • the information A that is, the target media information A is retrieved, or the media information A' obtained based on the media information A.
  • Sending the target media information A or A' as the feedback result of the switching request of the second end of the live broadcast (specifically, the second end of the live broadcast interaction), that is, sending The target media information A or A' is used to play the target media information A or A at the second end of the live broadcast (specifically, the second end of the live broadcast interaction). '.
  • the target media information is transmitted to the second end of the live broadcast (specifically, the second end of the live broadcast interaction) for playing.
  • the multi-channel electrical signal is assembled into an electrical signal, and the result of the output assembly (the electrical signal) is encoded and converted, and is the target media information.
  • the first end of the live broadcast (such as the anchor end) sends the live video stream to the service background server of the webcast through the PC or the mobile phone, and then obtains the live video stream from the background server, and is used for video streaming.
  • the conversion of the signal conversion obtains the SDI electrical signal, for example, converting the image signal and the audio signal collected by playing the live video stream into an SDI signal, and by seamlessly switching, the content of each user's individual live broadcast can be collected to the server.
  • Centralized switching can eventually be assembled into a set of network programs.
  • the switched SDI electrical signal is encoded to obtain the target media information in the form of a network video stream, that is, the target media information is transmitted to the CDN in the form of a network video stream, and then distributed to the second end of the live interaction through the CDN (such as the audience side). ) Watch the target media information.
  • the target media information is even integrated with the variety, sports and other programs, so that the personal live broadcast can be integrated into the production of variety, sports and other programs.
  • Adding the diversified content of the program that is, the embodiment of the present invention not only performs switching between the mobile phone and the live broadcast of the PC, but also can mix a plurality of contents such as a mobile phone, a PC, a video camera, and a video recorder to obtain a
  • the network program of diversified content realizes the collection and arrangement of multiple network personal live broadcasts, and is made into a network program and provided to the user for playing.
  • the method further includes: assembling the at least one electrical signal corresponding to the at least one piece of media information into an electrical signal as the target electrical signal. Transfer.
  • the method further includes: extracting, from each of the electrical signals of the at least one electrical signal, a first image signal and a first audio signal, and respectively The first image signal and the first audio signal are transmitted, such as the de-embedding process mentioned later.
  • the audio and video synchronization processing is performed according to the second audio signal and the first image signal, and then each of the electrical signals is re-synthesized, such as the embedding processing mentioned later.
  • Performing audio processing on the first audio signal according to the preset policy to obtain the second audio signal specifically: 1) acquiring the preset policy, where the preset policy is audio processing of tuning, After the first audio signal is tuned, the second audio signal is obtained; 2) acquiring the preset strategy, and when the preset strategy is audio processing of mixing, the first audio signal is mixed and obtained.
  • the second audio signal specifically: 1) acquiring the preset policy, where the preset policy is audio processing of tuning, After the first audio signal is tuned, the second audio signal is obtained; 2) acquiring the preset strategy, and when the preset strategy is audio processing of mixing, the first audio signal is mixed and obtained.
  • the second audio signal specifically: 1) acquiring the preset policy, where the preset policy is audio processing of tuning, After the first audio signal is tuned, the second audio signal is obtained; 2) acquiring the preset strategy, and when the preset strategy is audio processing of mixing, the first audio signal is mixed and obtained.
  • the processing logic at least includes: 1) receiving media information from the first end of the live broadcast (such as collecting media information); 2) switching the media information into an electrical signal (such as an SDI electrical signal);
  • the SDI electrical signal is encoded and converted to obtain media information that can be played on the second end of the live broadcast.
  • the acquisition, switching, and encoding (such as re-encoding the finished SDI signal into a network video stream, then transmitting to the CDN and distributing it to the CDN User side) is elaborated.
  • the acquisition phase the mobile phone or PC will transmit the captured picture to the background of the live broadcast service platform through the network, and then pull the video stream from the background to the network collection device through the video stream VID, so that the picture can be collected in the network collection device.
  • the live video and audio are presented, and the live video and audio signals are output and converted into SDI signals.
  • the switching phase the SDI signal transmitted from the collected signal is switched. Since the general broadcast television level switcher will eliminate the audio embedded in the SDI, it is necessary to perform de-embedding before the switching, that is, the audio is from the SDI. The solution is embedded and then tuned. The tuning process includes adjusting the sound level and mixing, and finally, the output image signal and the audio signal are synchronously adjusted by video and audio, and then embedded, that is, the audio signal is embedded in the SDI signal.
  • the encoding phase re-encode the finished SDI signal into a network video stream, then push it to the CDN and distribute it.
  • the media information switching system of the embodiment of the present invention includes: a live broadcast end and a server end, and the live broadcast end is divided into a first end of the live broadcast interaction (such as the anchor end) 41 and a second end of the live broadcast interaction ( Such as the audience side) 42.
  • the first end of the live broadcast interaction (such as the anchor end) 41 the user may be the producer and publisher of the media information, used to upload the media information to the server; and the second end of the live interaction (such as the viewer) 42
  • the user may be a player of the media information, and is used to initiate a handover request, where the handover request is used to switch the current media information played on the live broadcast end to the target media information, and the feedback result obtained by the server after responding to the handover request is obtained.
  • the feedback result is the requested target media information.
  • the server 43 is configured to convert media information (such as video information) received from a first end of the live interaction (such as a video broadcast) to an electrical signal, and encode the converted electrical signal to obtain media information (such as video information). ) Play.
  • the re-obtaining media information may be initial media information (such as original video information) obtained from a first end of the live interaction (such as an anchor end), such as media information A1-A2, or Is new media information (such as new video) that is different from the original media information (such as the original video information) Information), for example, a plurality of media information B1-B2 obtained from the media information A1-A2, or a complete media information B compiled according to the media information A1-A2.
  • the server 43 includes: a receiving unit 431, configured to receive at least one piece of media information; a converting unit 432, configured to convert the at least one media information into at least one electrical signal corresponding to the at least one piece of media information;
  • the switching request is used to switch the current media information played on the live broadcast end to the target media information;
  • the response unit 434 is configured to respond to the handover request, and use the current electrical signal corresponding to the current media information. Switching to a target electrical signal corresponding to the target media information for transmission, and encoding and converting the target electrical signal before the target electrical signal is transmitted to the live broadcast terminal to obtain the target media information, and the transmission station
  • the target media information is played to the live broadcast terminal for playing.
  • the server receives the at least one media information, and converts the at least one media information into at least one electrical signal corresponding to the at least one media information.
  • the media information may be a network video stream, and the network video stream is converted into an SDI electrical signal. Since the network video stream is a video file, if the network is resumed, it needs to be buffered for a certain period of time to play the current file.
  • SDI is an electrical signal that transmits image signals of one frame and one frame by high and low levels. Therefore, when an SDI electrical signal is transmitted, if it is instantaneously interrupted, it can be recovered instantaneously.
  • the existing broadcast television technology can be used, and the buffer processing with millisecond level can be switched well, which can well meet the needs of seamless connection during handover.
  • Obtaining a handover request where the handover request is used to switch current media information played on the live broadcast end to target media information.
  • the initial target media information is the media information A
  • the corresponding target electrical signal B (A) the transmission target electrical signal B (A)
  • the encoded conversion result is the media information A, That is, the target media information A or the media information A' obtained based on the media information A is retrieved.
  • the target media information A or A′ is used as the feedback result of the handover request of the second end of the live broadcast (specifically, the second end of the live broadcast interaction), that is, the target media information A or A′ is sent to the second end of the live broadcast that initiates the handover request ( Specifically, the second end of the live broadcast interaction, the target media information A or A′ is played on the second end of the live broadcast (specifically, the second end of the live broadcast interaction).
  • the target media information is transmitted to the second end of the live broadcast (specifically, the second end of the live broadcast interaction) for playing.
  • the result of the output switching result is obtained by coding and conversion, and is the target media information.
  • the first end of the live broadcast (such as the anchor end) sends the live video stream to the service background server of the webcast through the PC or the mobile phone, and then obtains the live video stream from the background server, and is used for video streaming.
  • the signal conversion is converted to obtain an SDI electrical signal.
  • the image signal and the audio signal collected by playing the live video stream are converted into an SDI signal, and the switched SDI electrical signal is encoded by seamless switching to obtain a network.
  • the target media information in the form of a video stream that is, the target media information is transmitted to the CDN in the form of a network video stream, and then distributed to the second end of the live interaction (such as the viewer) through the CDN to view the target media information.
  • the converting unit is further configured to: collect the at least one piece of media information; play the at least one piece of media information, and output at least one piece of playing information And determining the obtained at least one play signal as at least one electrical signal corresponding to the at least one piece of media information.
  • the server further includes an assembly unit, configured to: assemble the at least one electrical signal corresponding to the at least one piece of media information into an electrical signal and perform the electrical signal as the target electrical signal. transmission.
  • the server further includes: a signal extracting unit, configured to extract, from each of the at least one electrical signal, the first image signal and the first audio signal, and respectively Transmitting the first image signal and the first audio signal; a signal processing unit, configured to perform audio processing on the first audio signal according to a preset policy, to obtain a second audio signal; and a signal synthesis unit, configured to The second audio signal and the first image signal recombine the each electrical signal.
  • a signal extracting unit configured to extract, from each of the at least one electrical signal, the first image signal and the first audio signal, and respectively Transmitting the first image signal and the first audio signal
  • a signal processing unit configured to perform audio processing on the first audio signal according to a preset policy, to obtain a second audio signal
  • a signal synthesis unit configured to The second audio signal and the first image signal recombine the each electrical signal.
  • the signal processing unit is further configured to: acquire the preset policy, and when the preset policy is audio processing of tuning, perform tuning on the first audio signal. The second audio signal is then obtained.
  • the signal processing unit is further configured to: acquire the preset policy, and when the preset policy is audio processing of mixing, mix the first audio signal. The second audio signal is then obtained.
  • a microprocessor for the processor for data processing, a microprocessor, a central processing unit (CPU), a digital signal processor (DSP, Digital Singnal Processor) or programmable logic may be used when performing processing.
  • An FPGA Field-Programmable Gate Array
  • An operation instruction for a storage medium, includes an operation instruction, where the operation instruction may be computer executable code, and the operation instruction is used to implement the information processing method in the foregoing embodiment of the present invention.
  • the client waits for a long re-buffer. Such an operation will take a lot of time, no fluency, and can not give customers a good experience in the live broadcast, let alone compile any orderly program preparation into a set of network programs, in the traditional webcast, it is impossible to achieve
  • the personal webcasts are assembled into a set of network programs, and this new program production and broadcast mode is presented to the user.
  • the previous live webcast requires a mobile phone or PC to collect through the camera, and then the software is encoded into a network video stream, which is transmitted to the network video service platform through the Internet, and then accessed and distributed through the platform, and each user can watch To the live broadcast of the live broadcaster, if you want to change to the live broadcaster of another location, you need to change the live stream address in the background, which will cause the live video transition to be interrupted, because when changing the live stream address, The previous live video stream file was interrupted. After that, the new live stream needs to be re-submitted by the client and then distributed from the CDN. The client needs to identify the buffer, which will take a lot of time, and there is no continuity, and it is impossible to broadcast the personal network.
  • the embodiments of the present invention are used to collect individual live broadcasts into one point, perform centralized switching, and integrate into a set of programs, and even programs such as variety shows and sports. Convergence, personal live broadcast into the production of variety, sports and other programs, adding program content.
  • the live broadcaster sends the live broadcast to the background of the live web service through the PC or the mobile phone, and obtains the live stream from the background. After the special acquisition for conversion, the collected signal is converted into the SDI signal and enters the switching device, and is realized by the switching device.
  • the SDI signal after the switching is sent to the encoder for encoding, transmitted to the CDN as a network video stream, and then distributed.
  • a plurality of network personal live broadcasts can be arranged and arranged, and the program can be played to the user.
  • the embodiments of the present invention are applicable to live broadcast of network video, live broadcast of mobile phones, and live broadcast of traditional broadcast television.
  • live broadcasts need to frequently switch network video sources, and the video source is from a network stream or a mobile phone system.
  • a mobile phone network live stream backend switching system adopting the embodiment of the present invention can be divided into three processing logics: collection, switching, and encoding, in the overall architecture of the system shown in FIG. 6 .
  • the following is a description of each processing logic.
  • (1) Acquisition stage the mobile phone or PC transmits the captured picture to the background of the live broadcast service platform through the network, and then pulls the video stream from the background to the network collection device through the corresponding VID of the network video stream, so that The live picture and audio are presented in the picture of the acquisition device, and the picture and audio signals are output and converted into SDI signals, as shown in FIG. Since the network video stream is a video file, if the current is restored, the buffer needs to be buffered for a certain period of time to play the current file, and the SDI is an electrical signal, and the image signal of one frame and one frame is transmitted by the high and low levels. If it is instantaneously interrupted, it can be recovered in an instant.
  • the network video stream into an electrical signal such as SDI before transmitting.
  • SDI transmission the existing broadcast television technology can be used, and the switcher has a millisecond-level buffer to meet the seamless connection requirements at the time of handover.
  • the SDI signal transmitted from the collected signal enters the switcher. Since the general broadcast TV level switcher will eliminate the audio embedded in the SDI, it is switched in. Before the station, the audio is de-embedded by the de-embedder and then input into the mixer. Like the broadcast television system, the switcher can perform various smooth switching such as direction, 3D, and fly in, and the functions of packaging, letters, etc. can be realized through the switcher.
  • the mixer can adjust the sound level, mix and so on. After the output video and audio adjustment is synchronized, it enters the adder and is embedded in the SDI signal, as shown in FIG.
  • the network video stream After the network video stream is converted into an SDI signal, it needs to be produced by a switcher and a mixer, etc., in order to solve the problem that the network video stream cannot smoothly switch the video.
  • the network video source can be smoothly switched to realize the access or switching of the mobile phone or PC signal, and the network video stream captured by the remote mobile phone or PC can be switched or compiled into a set of customization after being transmitted to the switcher and the mixer.
  • the network programs are all possible, providing an expansion space for the development of subsequent live broadcast services.
  • Encoding phase This phase is relatively simple, that is, re-encoding the finished SDI signal into a network video stream, and then pushing down the CDN for distribution, as shown in FIG.
  • the embodiment of the present invention further provides a server, as shown in FIG. 10, including a processor 601, a bus 602, a computer storage medium 603, and a computer storage medium including program code or a computer program.
  • the program code, or computer program can be executed by processor 601 to perform the steps described in the foregoing methods.
  • the computer storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories, such as a mobile phone. , computers, tablet devices, personal digital assistants, etc.
  • the computer readable storage medium provided by the embodiment of the present invention has a computer program stored thereon, and when the computer program is executed by the processor, the following steps of the method for switching the media information are performed.
  • the computer program when executed by the processor, it also executes:
  • the computer program when executed by the processor, it also executes:
  • the at least one electrical signal corresponding to the at least one piece of media information is assembled into an electrical signal and transmitted as the target electrical signal.
  • the computer program when executed by the processor, it also executes:
  • the computer program when executed by the processor, it also executes:
  • the second audio signal is obtained after the first audio signal is tuned.
  • the computer program when executed by the processor, it also executes:
  • the preset strategy is audio processing of the mixing
  • the second audio signal is obtained after the first audio signal is mixed.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit;
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed.
  • the foregoing storage device includes the following steps: the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • ROM read-only memory
  • RAM random access memory
  • magnetic disk or an optical disk.
  • optical disk A medium that can store program code.
  • the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a RAM, a magnetic disk, or an optical disk.
  • At least one received media information is converted to obtain at least one electrical signal corresponding to the at least one media information, and the delay is short due to transmission of the electrical signal, and the moment when the live broadcast is switched Intermittently, the electrical signal can be recovered instantaneously. Therefore, after acquiring the handover request, responding to the handover request, the current electrical signal corresponding to the current media information can be switched to the target electrical signal corresponding to the target media information for transmission, so as to reduce transmission time.
  • the target media information is transmitted to the live broadcast terminal for playback.
  • timeliness and playback fluency can be ensured when switching between multiple live programs (or live media information).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了一种媒体信息的切换方法及服务器、计算机存储介质,其中,所述方法包括:接收至少一个媒体信息;将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。

Description

一种媒体信息的切换方法及服务器、计算机存储介质
相关申请的交叉引用
本申请基于申请号为201610940818.0、申请日为2016年10月31日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明涉及信息切换技术,尤其涉及一种媒体信息的切换方法及服务器、计算机存储介质。
背景技术
随着网络技术和智能终端的发展,使得每一个用户都可以作为媒体信息的制作者和发布者,在直播的场景中,由于每一个用户都是独立和分散存在于在整个网络中的,则每一个用户所制作的直播节目(或称直播媒体信息)也具有独立性,直播节目(或称直播媒体信息)的制作和发布时间也具有独立性,因此,在多个直播节目(或称直播媒体信息)间进行切换是无法确保时效性和流畅性的,比如,后台服务器在多个直播节目(或称直播媒体信息)间进行切换时,在用户侧会出现直播中断等问题,更谈不上将多个直播节目(或称直播媒体信息)汇编成一套网络节目时需要耗费大量的时间成本和处理成本。
发明内容
有鉴于此,本发明实施例提供了一种媒体信息的切换方法及服务器、计算机存储介质,至少解决了现有技术存在的问题。
本发明实施例的技术方案是这样实现的:
本发明实施例的一种媒体信息的切换方法,所述方法包括:
接收至少一个媒体信息;
将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
本发明实施例的一种服务器,所述服务器包括:
接收单元,用于接收至少一个媒体信息;
转换单元,用于将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
获取单元,用于获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
响应单元,用于响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
本发明实施例的一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于上述方案任一项所述的媒体信息的切换方法。
本发明实施例的一种媒体信息的切换方法,应用于服务器,服务器包 括有一个或多个处理器以及存储器,以及一个或一个以上的程序,其中,所述一个或一个以上的程序存储于存储器中,所述程序可以包括一个或一个以上的每一个对应于一组指令的模块,所述一个或多个处理器被配置为执行指令;所述方法包括:
接收至少一个媒体信息;
将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
本发明实施例是将接收的至少一个媒体信息进行转换,以得到与所述至少一个媒体信息对应的至少一路电信号,由于电信号的传输时时延较低,且在直播切换时的瞬间间断,电信号可以瞬间恢复,因此,获取切换请求后,对切换请求进行响应,可以将与当前媒体信息对应的当前电信号切换为与目标媒体信息对应的目标电信号进行传输,以便减少传输时延,节约时间成本和处理成本,在直播端支持播放媒体类型的信息,从而在目标电信号传输至直播端播放前对该目标电信号进行编码转换,以得到播放媒体类型的信息,即重新得到目标媒体信息,传输目标媒体信息至直播端进行播放。采用本发明实施例,在多个直播节目(或称直播媒体信息)间进行切换时能确保时效性和播放流畅性。
附图说明
图1为本发明实施例中进行信息交互的各方硬件实体的示意图;
图2为本发明实施例一方法实现流程示意图;
图3为本发明实施例又一方法实现流程示意图;
图4为本发明实施例中组装多路信号为一路SDI信号的传输示意图;
图5为本发明实施例一系统架构示意图;
图6为应用本发明实施例的一切换系统的组成示意图;
图7为应用本发明实施例的一切换系统中通过采集逻辑以转换得到SDI信号的示意图;
图8为应用本发明实施例的一切换系统中信息组装逻辑的示意图;
图9为应用本发明实施例的一切换系统中编码逻辑的示意图;
图10为应用本发明实施例一服务器组成结构示意图。
具体实施方式
下面结合附图对技术方案的实施作进一步的详细描述。
现在将参考附图描述实现本发明各个实施例的移动终端。在后续的描述中,使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明实施例的说明,其本身并没有特定的意义。因此,"模块"与"部件"可以混合地使用。
在下面的详细说明中,陈述了众多的具体细节,以便彻底理解本发明。不过,对于本领域的普通技术人员来说,显然可在没有这些具体细节的情况下实践本发明。在其他情况下,没有详细说明公开的公知方法、过程、组件、电路和网络,以避免不必要地使实施例的各个方面模糊不清。
另外,本文中尽管多次采用术语“第一”、“第二”等来描述各种元件(或各种阈值或各种应用或各种指令或各种操作)等,不过这些元件(或阈值或应用或指令或操作)不应受这些术语的限制。这些术语只是用于区分一个元件(或阈值或应用或指令或操作)和另一个元件(或阈值或应用或指令或操作)。例如,第一操作可以被称为第二操作,第二操作也可以被 称为第一操作,而不脱离本发明的范围,第一操作和第二操作都是操作,只是二者并不是相同的操作而已。
本发明实施例中的步骤并不一定是按照所描述的步骤顺序进行处理,可以按照需求有选择的将步骤打乱重排,或者删除实施例中的步骤,或者增加实施例中的步骤,本发明实施例中的步骤描述只是可选的顺序组合,并不代表本发明实施例的所有步骤顺序组合,实施例中的步骤顺序不能认为是对本发明的限制。
本发明实施例中的术语“和/或”指的是包括相关联的列举项目中的一个或多个的任何和全部的可能组合。还要说明的是:当用在本说明书中时,“包括/包含”指定所陈述的特征、整数、步骤、操作、元件和/或组件的存在,但是不排除一个或多个其他特征、整数、步骤、操作、元件和/或组件和/或它们的组群的存在或添加。
本发明实施例的智能终端(如移动终端)可以以各种形式来实施。例如,本发明实施例中描述的移动终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、个人数字助理(PDA,Personal Digital Assistant)、平板电脑(PAD)、便携式多媒体播放器(PMP,Portable Media Player)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面,假设终端是移动终端。然而,本领域技术人员将理解的是,除了特别用于移动目的的元件之外,根据本发明的实施方式的构造也能够应用于固定类型的终端。
图1为本发明实施例中进行信息交互的各方硬件实体的示意图,图1中包括:直播交互的第一端1、服务器2和直播交互的第二端3;其中,直播交互的第一端(如主播端)可以采用手机、台式机、PC机、一体机等类型的终端设备,如终端设备11-14所示,终端设备11-14通过有线网络或者无线网络与服务器进行信息交互。直播交互的第二端(如观众端)也可以 采用手机、台式机、PC机、一体机等类型的终端设备,本实施例中采用手机,如终端设备31-35所示。采用本发明实施例,在媒体直播场景中,对媒体信息(如视频信息)的切换,通过媒体信息(如视频信息)的接收,由媒体信息(如视频信息)到电信号的转换,将转换得到的电信号进行编码,以重新得到媒体信息(如视频信息)进行播放。其中,所述重新得到媒体信息(如视频信息)可以为从直播交互的第一端(如主播端)得到的最初的媒体信息(如原有视频信息),如媒体信息A1-A2,也可以是有别于最初的媒体信息(如原有视频信息)的新媒体信息(如新视频信息),比如,根据媒体信息A1-A2得到的多个媒体信息B1-B2,或者根据媒体信息A1-A2进行汇编得到的一个完整的媒体信息B。以服务器2为针对媒体直播场景中对媒体信息(如视频信息)进行切换响应的执行实体而言,服务器的处理逻辑10如图1所示,包括:S1、服务器将从多个直播交互的第一端(如主播端,主播端的用户可以是媒体信息的制作者和发布者)接收的至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号(比如SDI电信号)。S2、获取切换请求,所述切换请求由直播交互的第二端(如观众端,观众端的用户可以是媒体信息的播放者)发起,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息。S3、服务器响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在直播交互的第二端(如观众端,观众端的用户可以是媒体信息的播放者)支持播放的信息为媒体类型的信息,则在将目标电信号传输至直播端播放前对所述目标电信号进行编码转换,以得到可以在直播交互的第二端(如观众端,观众端的用户可以是媒体信息的播放者)播放的目标媒体信息,传输所述目标媒体信息至直播交互的第二端(如观众端,观众端的用户可以是媒体信息的播放者),在直播交互的第二端(如观众端,观众端的用户可以是媒体信息的播放者)播放 目标媒体信息。所述目标媒体信息包括:从直播交互的第一端(如主播端,主播端的用户可以是媒体信息的制作者和发布者)直接接收的至少一个媒体信息,和/或根据该直接接收的至少一个媒体信息得到的、且有别于该直接接收的至少一个媒体信息的至少一个媒体信息,和/或根据该直接接收的至少一个媒体信息得到的一个汇编形式的媒体信息。
这里需要指出的是,处理逻辑10可以采用单元的形式存在于一个服务器,也可以采用多个硬件实体的形式分别于由多个服务器构成的服务器集群系统中。不管是某一个服务器中的单元形式,还是服务器集群系统中硬件实体的形式,本发明实施例中,针对切换请求的响应处理逻辑至少包括:1)从直播第一端接收媒体信息(具体如采集媒体信息);2)将媒体信息切换为电信号(如SDI电信号);对电信号(如SDI电信号)进行编码转换,以得到可以在直播第二端播放的媒体信息。
在直播的场景中,由于每一个用户都是独立和分散存在于在整个网络中的,则每一个用户所制作的直播节目(或称直播媒体信息)也具有独立性,直播节目(或称直播媒体信息)的制作和发布时间也具有独立性,因此,在多个直播节目(或称直播媒体信息)间进行切换是无法确保时效性和流畅性的,比如,后台服务器在多个直播节目(或称直播媒体信息)间进行切换时,在用户侧会出现直播中断等问题,更谈不上将多个直播节目(或称直播媒体信息)汇编成一套网络节目时需要耗费大量的时间成本和处理成本。采用本发明实施例,将接收的至少一个媒体信息进行转换,以得到与所述至少一个媒体信息对应的至少一路电信号,由于电信号的传输时时延较低,且在直播切换时的瞬间间断,电信号可以瞬间恢复,因此,获取切换请求后,对切换请求进行响应,可以将与当前媒体信息对应的当前电信号切换为与目标媒体信息对应的目标电信号进行传输,以便减少传输时延,节约时间成本和处理成本,在直播端支持播放媒体类型的信息, 从而在目标电信号传输至直播端播放前对该目标电信号进行编码转换,以得到播放媒体类型的信息,即重新得到目标媒体信息,传输目标媒体信息至直播端进行播放,在多个直播节目(或称直播媒体信息)间进行切换时能确保时效性和播放流畅性。
上述图1的例子只是实现本发明实施例的一个系统架构实例,本发明实施例并不限于上述图1所述的系统结构,基于上述图1所述的系统架构,提出本发明方法各个实施例。
本发明实施例的一种媒体信息的切换方法,如图2所示,所述方法包括:服务器接收至少一个媒体信息,将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号(101)。比如,媒体信息可以为网络视频流,将网络视频流转换为SDI电信号,由于网络视频流传输的是视频文件,如果在断流的再恢复的情况下,需要缓冲一定时间才能够播放当前文件,而SDI是电信号,是靠高低电平来发送一帧一帧的图像信号,因此,当传输SDI电信号时,如果瞬间间断,也可以瞬间即可恢复。且在SDI传输的情况下可以借助已有的广播电视技术,具有毫秒级的缓冲(buffer)处理的切换,能很好的满足切换时无缝衔接的需要。获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息(102)。响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端(具体为直播交互的第二端)播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放(103)。比如,将网络视频流转换为SDI电信号传输,利用SDI电信号传输时时延较低的特性来改善现有切换过程中时延和处理效率低下的问题。以多个媒体信息中的一个媒体信息的转换进行举例,比如,初始的目标媒体信息为媒体信息A,对应目标电信号B(A),传输目标 电信号B(A),编码转换结果为媒体信息A,即重新得到目标媒体信息A,或者,基于媒体信息A得到的媒体信息A’。将目标媒体信息A或A’作为系统响应直播第二端(具体为直播交互的第二端)切换请求的反馈结果,即发送目标媒体信息A或A’给发起切换请求的直播第二端(具体为直播交互的第二端),在直播第二端(具体为直播交互的第二端)播放该目标媒体信息A或A’。传输所述目标媒体信息至所述直播第二端(具体为直播交互的第二端)进行播放。
现有技术中,在传统的网络直播中,当个人网络直播或者手机直播在网络上已经开放入口时,只能允许这一个人直播,如果想要切换到另外一人直播的话,需要更改视频直播后台的视频流地址,这样就会使当前的直播瞬间断流,在用户端呈现出来的是瞬间黑屏,然后内容分发网络(CDN,Content Delivery Network)重新分发新的视频流,用户端等待漫长的重新缓冲。这样一次操作,会耗费大量时间,毫无流畅度可言,无法在直播场景中给用户侧带来良好的播放效果。
本发明实施例中,是针对多路间的任意切换,输出的切换结果经编码转换后得到的结果,为目标媒体信息。具体的,直播交互的第一端(如主播端)通过PC或者手机将直播的视频流发送到网络直播的服务后台服务器后,从后台服务器拿到直播的视频流,经过用于视频流到电信号转换的转换,得到SDI电信号,比如,将播放直播的视频流所采集到的图像信号和音频信号转换成SDI信号,通过无缝切换,对切换后的SDI电信号进行编码,以得到网络视频流形式的目标媒体信息,即:以网络视频流形式传输目标媒体信息到CDN,之后通过CDN分发给直播交互的第二端(如观众端)收看目标媒体信息。
本发明实施例的一种媒体信息的切换方法,如图3所示,所述方法包括:服务器接收至少一个媒体信息,播放所述至少一个媒体信息,输出至 少一个播放信号(201)。将得到的至少一个播放信号确定为与至少一个媒体信息对应的至少一路电信号(202),以将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号。比如,媒体信息为直播的视频流时,获取在播放直播的视频流所采集到的播放信号(包括图像信号和音频信号),根据图像信号和音频信号得到SDI信号,即通过该特殊的采集处理而转换得到该SDI信号。由于网络视频流传输的是视频文件,如果在断流的再恢复的情况下,需要缓冲一定时间才能够播放当前文件,而SDI是电信号,是靠高低电平来发送一帧一帧的图像信号,因此,当传输SDI电信号时,如果瞬间间断,也可以瞬间即可恢复。且在SDI传输的情况下可以借助已有的广播电视技术,具有毫秒级的buffer处理的切换,能很好的满足切换时无缝衔接的需要。获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息(203)。响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,针对所述目标电信号而言,如图4所示,是将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号,将该路电信号作为所述目标电信号进行传输(204)。在所述目标电信号传输至直播端(具体为直播交互的第二端)播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放(205)。比如,将网络视频流转换为SDI电信号传输,利用SDI电信号传输时时延较低的特性来改善现有切换过程中时延和处理效率低下的问题。以多个媒体信息中的一个媒体信息的转换进行举例,比如,初始的目标媒体信息为媒体信息A,对应目标电信号B(A),传输目标电信号B(A),编码转换结果为媒体信息A,即重新得到目标媒体信息A,或者,基于媒体信息A得到的媒体信息A’。将目标媒体信息A或A’作为系统响应直播第二端(具体为直播交互的第二端)切换请求的反馈结果,即发送 目标媒体信息A或A’给发起切换请求的直播第二端(具体为直播交互的第二端),在直播第二端(具体为直播交互的第二端)播放该目标媒体信息A或A’。传输所述目标媒体信息至所述直播第二端(具体为直播交互的第二端)进行播放。
现有技术中,在传统的网络直播中,当个人网络直播或者手机直播在网络上已经开放入口时,只能允许这一个人直播,如果想要切换到另外一人直播的话,需要更改视频直播后台的视频流地址,这样就会使当前的直播瞬间断流,在用户端呈现出来的是瞬间黑屏,然后CDN重新分发新的视频流,用户端等待漫长的重新缓冲。这样一次操作,会耗费大量时间,毫无流畅度可言,无法在直播场景中给用户侧带来良好的播放效果。而且,由于现有的操作,会耗费大量时间,毫无流畅度可言,因此,将任何有序的节目筹备汇编成一套网络节目更是无从实现,所以在传统网络直播中,是无法实现将个人网络直播汇集成一套网络节目的。
本发明实施例中,是将多路电信号组装为一路电信号,输出的组装结果(该路电信号)经编码转换后得到的结果,为所述目标媒体信息。具体的,直播交互的第一端(如主播端)通过PC或者手机将直播的视频流发送到网络直播的服务后台服务器后,从后台服务器拿到直播的视频流,经过用于视频流到电信号转换的转换,得到SDI电信号,比如,将播放直播的视频流所采集到的图像信号和音频信号转换成SDI信号,通过无缝切换,可以将每个用户个体直播的内容汇集到本服务器进行集中切换,最终可以汇集成一套网络节目。对切换后的SDI电信号进行编码,以得到网络视频流形式的目标媒体信息,即:以网络视频流形式传输目标媒体信息到CDN,之后通过CDN分发给直播交互的第二端(如观众端)收看目标媒体信息。这里需要指出的是,对汇集成一套节目而言,该目标媒体信息甚至和综艺、体育等节目进行融合,实现个人直播融入到综艺、体育等节目制作中,以 增添节目的多元化内容,也就是说,本发明实施例不仅仅是手机和PC的直播之间的切换制作,更可以将手机、PC、摄像机、录像机等多个内容进行混合制作,以得到一套多元化内容的网络节目,实现多个网络个人直播的汇集编排,制作成网络节目并提供给用户进行播放。
基于上述各个实施例,在本发明实施例一实施方式中,所述方法还包括:将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
基于上述各个实施例,在本发明实施例一实施方式中,所述方法还包括:从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第一音频信号,并分别传输所述第一图像信号和所述第一音频信号,如后续提及的解嵌处理。对所述第一音频信号按照预设策略进行音频处理,以得到第二音频信号。比如,根据所述第二音频信号和所述第一图像信号进行音视频同步处理后重新合成所述每一路电信号,如后续提及的加嵌处理。
对所述第一音频信号按照预设策略进行音频处理,以得到第二音频信号,具体包括:1)获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号;2)获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
基于上述各个实施例,处理逻辑至少包括:1)从直播第一端接收媒体信息(具体如采集媒体信息);2)将媒体信息切换为电信号(如SDI电信号);对电信号(如SDI电信号)进行编码转换,以得到可以在直播第二端播放的媒体信息。
针对该处理逻辑,在一个实际应用为例,对采集、切换包装、编码(如将制作完成的SDI信号重新编码成网络视频流,然后传输到CDN并分发给 用户侧)进行具体阐述。
一,采集阶段:手机或者PC将拍摄的画面通过网络传输到直播服务平台后台,然后通过视频流VID,从后台将视频流拉取到网络采集设备中播放,这样就可以在网络采集设备的画面中呈现直播画面和音频,再将直播画面和音频信号输出并转换成SDI信号。
二,切换阶段:将从采集信号那里传过来的SDI信号进行切换,由于一般广播电视级切换台都会消除嵌入在SDI里的音频,所以,在进行切换之前需要先进行解嵌,即将音频从SDI中解嵌出来,然后进行调音处理。调音处理包括调节声音电平和混音等处理,最后,将输出的图像信号和音频信号进行视音频同步调节后进行加嵌,即将音频信号嵌入到SDI信号中。
三,编码阶段:将制作完成的SDI信号重新编码成网络视频流,然后推送到CDN并分发出去。
本发明实施例的一种媒体信息切换系统,如图5所示,包括:直播端和服务器端,直播端分为直播交互的第一端(如主播端)41和直播交互的第二端(如观众端)42。其中,在直播交互的第一端(如主播端)41,其用户可以是媒体信息的制作者和发布者,用于上传媒体信息到服务器;而直播交互的第二端(如观众端)42,其用户可以是媒体信息的播放者,用于发起切换请求,切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息,接收服务器对该切换请求响应后得到的反馈结果,所述反馈结果为所请求的目标媒体信息。服务器43,用于将从直播交互的第一端(如主播端)接收的媒体信息(如视频信息)转换到电信号,将转换得到的电信号进行编码,以重新得到媒体信息(如视频信息)进行播放。其中,所述重新得到媒体信息(如视频信息)可以为从直播交互的第一端(如主播端)得到的最初的媒体信息(如原有视频信息),如媒体信息A1-A2,也可以是有别于最初的媒体信息(如原有视频信息)的新媒体信息(如新视频 信息),比如,根据媒体信息A1-A2得到的多个媒体信息B1-B2,或者根据媒体信息A1-A2进行汇编得到的一个完整的媒体信息B。
服务器43包括:接收单元431,用于接收至少一个媒体信息;转换单元432,用于将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;获取单元433,用于获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;响应单元434,用于响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
具体的,服务器接收至少一个媒体信息,将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号。比如,媒体信息可以为网络视频流,将网络视频流转换为SDI电信号,由于网络视频流传输的是视频文件,如果在断流的再恢复的情况下,需要缓冲一定时间才能够播放当前文件,而SDI是电信号,是靠高低电平来发送一帧一帧的图像信号,因此,当传输SDI电信号时,如果瞬间间断,也可以瞬间即可恢复。且在SDI传输的情况下可以借助已有的广播电视技术,具有毫秒级的buffer处理的切换,能很好的满足切换时无缝衔接的需要。获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息。响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至直播端(具体为直播交互的第二端)播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。比如,将网络视频流转换为SDI电信号传输,利用SDI电信号传输时时延较低的特性来改善现有切换过程中时延和处理效率低下的问题。以多个媒 体信息中的一个媒体信息的转换进行举例,比如,初始的目标媒体信息为媒体信息A,对应目标电信号B(A),传输目标电信号B(A),编码转换结果为媒体信息A,即重新得到目标媒体信息A,或者,基于媒体信息A得到的媒体信息A’。将目标媒体信息A或A’作为系统响应直播第二端(具体为直播交互的第二端)切换请求的反馈结果,即发送目标媒体信息A或A’给发起切换请求的直播第二端(具体为直播交互的第二端),在直播第二端(具体为直播交互的第二端)播放该目标媒体信息A或A’。传输所述目标媒体信息至所述直播第二端(具体为直播交互的第二端)进行播放。
现有技术中,在传统的网络直播中,当个人网络直播或者手机直播在网络上已经开放入口时,只能允许这一个人直播,如果想要切换到另外一人直播的话,需要更改视频直播后台的视频流地址,这样就会使当前的直播瞬间断流,在用户端呈现出来的是瞬间黑屏,然后CDN重新分发新的视频流,用户端等待漫长的重新缓冲。这样一次操作,会耗费大量时间,毫无流畅度可言,无法在直播场景中给用户侧带来良好的播放效果。
本发明实施例中,是针对多路间的任意切换,输出的切换结果经编码转换后得到的结果,为目标媒体信息。具体的,直播交互的第一端(如主播端)通过PC或者手机将直播的视频流发送到网络直播的服务后台服务器后,从后台服务器拿到直播的视频流,经过用于视频流到电信号转换的转换,得到SDI电信号,比如,将播放直播的视频流所采集到的图像信号和音频信号转换成SDI信号,通过无缝切换,对切换后的SDI电信号进行编码,以得到网络视频流形式的目标媒体信息,即:以网络视频流形式传输目标媒体信息到CDN,之后通过CDN分发给直播交互的第二端(如观众端)收看目标媒体信息。
在本发明实施例一实施方式中,所述转换单元,进一步用于:采集所述至少一个媒体信息;播放所述至少一个媒体信息,输出至少一个播放信 号;将得到的所述至少一个播放信号确定为与所述至少一个媒体信息对应的至少一路电信号。
在本发明实施例一实施方式中,所述服务器还包括组装单元,用于:将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
在本发明实施例一实施方式中,所述服务器还包括:信号提取单元,用于从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第一音频信号,并分别传输所述第一图像信号和所述第一音频信号;信号处理单元,用于对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号;信号合成单元,用于根据所述第二音频信号和所述第一图像信号重新合成所述每一路电信号。
在本发明实施例一实施方式中,所述信号处理单元,进一步用于:获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号。
在本发明实施例一实施方式中,所述信号处理单元,进一步用于:获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
其中,对于用于数据处理的处理器而言,在执行处理时,可以采用微处理器、中央处理器(CPU,Central Processing Unit)、数字信号处理器(DSP,Digital Singnal Processor)或可编程逻辑阵列(FPGA,Field-Programmable Gate Array)实现;对于存储介质来说,包含操作指令,该操作指令可以为计算机可执行代码,通过所述操作指令来实现上述本发明实施例信息处理方法流程中的各个步骤。
这里需要指出的是:以上涉及终端和服务器项的描述,与上述方法描述是类似的,同方法的有益效果描述,不做赘述。对于本发明终端和服务 器实施例中未披露的技术细节,请参照本发明方法流程描述的实施例所描述内容。
以一个现实应用场景为例对本发明实施例阐述如下:
在直播场景中,近两年由于个人直播、网络手机直播兴起,个人网络直播越来越普遍,可以展现生活中的个体差异,而这些直播一直都是单独个体直播节目,无法实现在同一时间汇集、展现给观众。具体的,在传统的网络直播中,当个人网络直播或者手机直播在网络上已经开放入口时,只能允许这一个人直播,如果想要切换到另外一人直播的话,需要更改视频直播后台的视频流地址,这样就会使当前的直播瞬间断流,在用户端呈现出来的是瞬间黑屏,然后CDN重新分发新的视频流到用户端进行实时播放。用户端等待漫长的重新缓冲。这样一次操作,会耗费大量时间,毫无流畅度可言,无法在直播中给客户良好体验,更别提将任何有序的节目筹备汇编成一套网络节目,在传统网络直播中,是无法实现将个人网络直播汇集成一套网络节目,这种新的节目制作播出模式呈现给用户的。
综上所述,以往的网络直播,需要手机或者PC通过摄像头采集,然后软件编码成网络视频流,通过互联网传输到网络视频服务平台,然后才通过平台接入、分发出去,各用户端可以看到直播者的直播画面,这时如果想要更换为另一个地点的直播者换面,就需要在后台更改直播流地址,导致正在直播的视频换面会中断,这是因为更改直播流地址时,中断了之前的直播视频流文件。之后,新的直播流接入后需要重新由用户端提请求,然后从CDN处分发,用户端需要识别缓冲,这都会耗费大量时间,而且毫无连贯性可言,也无法实现将个人网络直播汇集成一套网络节目播出。想要将个人网络直播汇集成一套网络节目播出,需要满足:1)多个视频源源按流程采集、接入直播系统;2)各个视频源之间平滑切换;3)视频源信号为了适应不同系统,不断变换传输形式。
基于上述分析,对于直播场景中的媒体信息切换及媒体信息汇编而言,采用本发明实施例,将一个个个体直播汇集到一点,进行集中切换,汇集成一套节目,甚至和综艺、体育等节目进行融合,实现个人直播融入到综艺、体育等节目制作中,增添节目多元化内容。具体的,直播者通过PC或者手机将直播发送到网络直播服务后台,从后台拿到直播流,经过用于转换的特殊采集,将采集到的信号转换成SDI信号进入切换设备,通过切换设备实现无缝切换,将切换之后的SDI的信号送入编码机进行编码,以网络视频流的方式传输到CDN,之后分发出去。这样就可以实现多个网络个人直播的汇集编排,制作成节目播放给用户。本发明实施例适用于网络视频直播、手机直播及传统广播电视直播,特别是直播中需要频繁切换网络视频源,而视频源来自于网络流或者手机统的情况。
如图6所示,为采用本发明实施例的一种手机网络直播流后端切换系统,在图6所示的系统整体架构中,可以分为:采集、切换包装、编码三个处理逻辑,以下对各个处理逻辑分别阐述。
(1)采集阶段:手机或者PC将拍摄的画面通过网络传输到直播服务平台后台,然后通过网络视频流对应的标识VID,从后台将视频流拉取到网络采集设备中播放,这样就可以在采集设备的画面中呈现直播画面和音频,再将画面和音频信号输出并转换成SDI信号,如图7所示。由于网络视频流传输的是视频文件,如果在断流的再恢复的情况下,需要缓冲一定时间才能够播放当前文件,而SDI是电信号,靠高低电平来发送一帧一帧的图像信号,如果瞬间间断,瞬间即可恢复,因此,需要先将网络视频流转换为SDI这种电信号后再进行传输。SDI传输的情况下可以借助已有的广播电视技术,切换台具有毫秒级的buffer,以满足切换时的无缝衔接需要。
(2)切换阶段:从采集信号那里传过来的SDI信号进入切换台,由于一般广播电视级切换台都会消除嵌入在SDI里的音频,所以,在进入切换 台之前先用解嵌器将音频解嵌出来,然后输入到调音台当中。如广播电视系统一样,切换台可以做各种划向、3D、飞入等平滑切换,而通过切换台可以实现包装、字母等功能。而调音台可以调节声音电平,混音等制作。之后输出的视音频调节同步后进入加嵌器,嵌入到SDI信号中,如图8所示。将网络视频流转化为SDI信号之后,还需要经过切换台和调音台等制作,是为了解决网络视频流不能够平滑切换视频的问题。通过此途径可以平滑切换网络视频源,以实现手机或PC信号的接入或切换,及远距离手机或PC拍摄的网络视频流传输入切换台和调音台后无论是切换还是汇编成一套自定义的网络节目都成为可能,为后续直播业务的发展提供了扩展空间。
(3)编码阶段:这一阶段较为简单,就是将制作完成的SDI信号重新编码成网络视频流,然后推倒CDN分发出去,如图9所示。
本发明实施例还提供了一种服务器,如图10所示,包括处理器601、总线602、计算机存储介质603、计算机存储介质中包括程序代码或称为计算机程序。该程序代码或称为计算机程序可由处理器601执行,以完成前述方法所述步骤。计算机存储介质可以是FRAM、ROM、PROM、EPROM、EEPROM、Flash Memory、磁表面存储器、光盘、或CD-ROM等存储器;也可以是包括上述存储器之一或任意组合的各种设备,如移动电话、计算机、平板设备、个人数字助理等。
本发明实施例提供的计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器运行时,执行如下媒体信息的切换方法的步骤。
一实施例中,该计算机程序被处理器运行时,执行:
接收至少一个媒体信息;
将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
一实施例中,该计算机程序被处理器运行时,还执行:
采集所述至少一个媒体信息;
播放所述至少一个媒体信息,输出至少一个播放信号;
将得到的所述至少一个播放信号确定为与所述至少一个媒体信息对应的至少一路电信号。
一实施例中,该计算机程序被处理器运行时,还执行:
将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
一实施例中,该计算机程序被处理器运行时,还执行:
从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第一音频信号,并分别传输所述第一图像信号和所述第一音频信号;
对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号;
根据所述第二音频信号和所述第一图像信号重新合成所述每一路电信号。
一实施例中,该计算机程序被处理器运行时,还执行:
获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号。
一实施例中,该计算机程序被处理器运行时,还执行:
获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。
另外,在本发明各实施例中的各功能单元可以全部集成在一个处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
或者,本发明上述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。 基于这样的理解,本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。
工业实用性
采用本发明实施例,是将接收的至少一个媒体信息进行转换,以得到与所述至少一个媒体信息对应的至少一路电信号,由于电信号的传输时时延较低,且在直播切换时的瞬间间断,电信号可以瞬间恢复,因此,获取切换请求后,对切换请求进行响应,可以将与当前媒体信息对应的当前电信号切换为与目标媒体信息对应的目标电信号进行传输,以便减少传输时延,节约时间成本和处理成本,在直播端支持播放媒体类型的信息,从而在目标电信号传输至直播端播放前对该目标电信号进行编码转换,以得到播放媒体类型的信息,即重新得到目标媒体信息,传输目标媒体信息至直播端进行播放。采用本发明实施例,在多个直播节目(或称直播媒体信息)间进行切换时能确保时效性和播放流畅性。

Claims (19)

  1. 一种媒体信息的切换方法,所述方法包括:
    接收至少一个媒体信息;
    将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
    获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
    响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
  2. 根据权利要求1所述的方法,其中,将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号,包括:
    采集所述至少一个媒体信息;
    播放所述至少一个媒体信息,输出至少一个播放信号;
    将得到的所述至少一个播放信号确定为与所述至少一个媒体信息对应的至少一路电信号。
  3. 根据权利要求1所述的方法,其中,所述方法还包括:
    将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
  4. 根据权利要求1至3任一项所述的方法,其中,所述方法还包括:
    从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第一音频信号,并分别传输所述第一图像信号和所述第一音频信号;
    对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号;
    根据所述第二音频信号和所述第一图像信号重新合成所述每一路电信号。
  5. 根据权利要求4所述的方法,其中,对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号,包括:
    获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号。
  6. 根据权利要求4所述的方法,其中,对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号,包括:
    获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
  7. 一种服务器,所述服务器包括:
    接收单元,用于接收至少一个媒体信息;
    转换单元,用于将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
    获取单元,用于获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
    响应单元,用于响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
  8. 根据权利要求7所述的服务器,其中,所述转换单元,进一步用于:
    采集所述至少一个媒体信息;
    播放所述至少一个媒体信息,输出至少一个播放信号;
    将得到的所述至少一个播放信号确定为与所述至少一个媒体信息对应的至少一路电信号。
  9. 根据权利要求7所述的服务器,其中,所述服务器还包括组装单元,用于:
    将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
  10. 根据权利要求7至9任一项所述的服务器,其中,所述服务器还包括:
    信号提取单元,用于从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第一音频信号,并分别传输所述第一图像信号和所述第一音频信号;
    信号处理单元,用于对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号;
    信号合成单元,用于根据所述第二音频信号和所述第一图像信号重新合成所述每一路电信号。
  11. 根据权利要求10所述的服务器,其中,所述信号处理单元,进一步用于:
    获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号。
  12. 根据权利要求10所述的服务器,其中,所述信号处理单元,进一步用于:
    获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
  13. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求1至6任一项所述的媒体信息的切换方法。
  14. 一种媒体信息的切换方法,应用于服务器,服务器包括有一个或 多个处理器以及存储器,以及一个或一个以上的程序,其中,所述一个或一个以上的程序存储于存储器中,所述程序可以包括一个或一个以上的每一个对应于一组指令的模块,所述一个或多个处理器被配置为执行指令;所述方法包括:
    接收至少一个媒体信息;
    将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号;
    获取切换请求,所述切换请求用于将在直播端播放的当前媒体信息切换为目标媒体信息;
    响应所述切换请求,将与所述当前媒体信息对应的当前电信号切换为与所述目标媒体信息对应的目标电信号进行传输,在所述目标电信号传输至所述直播端播放前对所述目标电信号进行编码转换,以得到所述目标媒体信息,传输所述目标媒体信息至所述直播端进行播放。
  15. 根据权利要求14所述的方法,其中,将所述至少一个媒体信息转换为与所述至少一个媒体信息对应的至少一路电信号,包括:
    采集所述至少一个媒体信息;
    播放所述至少一个媒体信息,输出至少一个播放信号;
    将得到的所述至少一个播放信号确定为与所述至少一个媒体信息对应的至少一路电信号。
  16. 根据权利要求14所述的方法,其中,所述方法还包括:
    将与所述至少一个媒体信息对应的所述至少一路电信号组装成一路电信号并作为所述目标电信号进行传输。
  17. 根据权利要求14至16任一项所述的方法,其中,所述方法还包括:
    从所述至少一路电信号的每一路电信号中,提取出第一图像信号和第 一音频信号,并分别传输所述第一图像信号和所述第一音频信号;
    对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号;
    根据所述第二音频信号和所述第一图像信号重新合成所述每一路电信号。
  18. 根据权利要求17所述的方法,其中,对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号,包括:
    获取所述预设策略,所述预设策略为调音的音频处理时,对所述第一音频信号进行调音后得到所述第二音频信号。
  19. 根据权利要求17所述的方法,其中,对所述第一音频信号按照预设策略进行音频处理后,得到第二音频信号,包括:
    获取所述预设策略,所述预设策略为混音的音频处理时,对所述第一音频信号进行混音后得到所述第二音频信号。
PCT/CN2017/108282 2016-10-31 2017-10-30 一种媒体信息的切换方法及服务器、计算机存储介质 WO2018077259A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610940818.0A CN106507186B (zh) 2016-10-31 2016-10-31 一种媒体信息的切换方法、服务器及存储介质
CN201610940818.0 2016-10-31

Publications (1)

Publication Number Publication Date
WO2018077259A1 true WO2018077259A1 (zh) 2018-05-03

Family

ID=58321692

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/108282 WO2018077259A1 (zh) 2016-10-31 2017-10-30 一种媒体信息的切换方法及服务器、计算机存储介质

Country Status (2)

Country Link
CN (1) CN106507186B (zh)
WO (1) WO2018077259A1 (zh)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743475A (zh) * 2019-01-10 2019-05-10 杭州星犀科技有限公司 多路直播的导播装置
CN112019488A (zh) * 2019-05-31 2020-12-01 广州市百果园信息技术有限公司 一种语音处理的方法、装置、设备和存储介质
CN112738540A (zh) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质
CN113347459A (zh) * 2021-06-11 2021-09-03 杭州星犀科技有限公司 基于Android系统的自主音频源切换方法、装置和计算设备
CN114442039A (zh) * 2020-11-05 2022-05-06 中国移动通信集团山东有限公司 一种声源定位方法、装置和电子设备
CN114553846A (zh) * 2022-01-11 2022-05-27 南方电网深圳数字电网研究院有限公司 一种实时采集流媒体的直播方法及装置
CN114553846B (zh) * 2022-01-11 2024-05-14 南方电网数字平台科技(广东)有限公司 一种实时采集流媒体的直播方法及装置

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106507186B (zh) * 2016-10-31 2020-01-10 腾讯科技(深圳)有限公司 一种媒体信息的切换方法、服务器及存储介质
CN108347622B (zh) * 2018-03-06 2020-06-30 腾讯科技(深圳)有限公司 多媒体数据推送方法、装置、存储介质及设备
CN109257614B (zh) * 2018-09-11 2021-05-07 腾讯数码(天津)有限公司 一种直播会话接入控制方法、装置及存储介质
CN111901690B (zh) * 2020-06-15 2024-03-15 视联动力信息技术股份有限公司西藏分公司 流状态检测方法、装置及计算机可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101141434A (zh) * 2006-09-06 2008-03-12 微普国际有限公司 可根据网路频宽自动选择设定档的媒体串流播放方法
CN201252603Y (zh) * 2008-09-18 2009-06-03 北京东方艾迪普科技发展有限公司 电视三维图文视频实时点评播报系统
CN203445986U (zh) * 2013-08-21 2014-02-19 徐乾伟 摄即传的ip传输系统
CN103856787A (zh) * 2012-12-04 2014-06-11 上海文广科技(集团)有限公司 基于公网的带解说音频回传的直播系统及其直播方法
EP2908516A1 (en) * 2014-02-14 2015-08-19 Alcatel Lucent Process for transmitting an ongoing video stream from a publisher to a receiver through a MCU unit during a live session
CN106027991A (zh) * 2016-07-12 2016-10-12 李巍 一种医疗视频影像直播一体机
CN106507186A (zh) * 2016-10-31 2017-03-15 腾讯科技(深圳)有限公司 一种媒体信息的切换方法及服务器

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4561447B2 (ja) * 2005-04-06 2010-10-13 ソニー株式会社 データ処理装置及びデータ処理方法
US9716854B2 (en) * 2008-04-09 2017-07-25 Imagine Communications Corp. Video multiviewer system with distributed scaling and related methods
CN101969439B (zh) * 2010-10-11 2015-01-14 北京中科大洋科技发展股份有限公司 一种利用无线通讯网络实现电视新闻直播的系统
CN102291399B (zh) * 2011-08-08 2015-07-22 成都索贝数码科技股份有限公司 一种流媒体切换台
CN103607544B (zh) * 2013-11-25 2016-11-09 深圳市中帝威科技有限公司 一种大容量高清sdi无缝矩阵切换器
CN105120184B (zh) * 2015-10-09 2018-06-19 深圳市捷视飞通科技有限公司 一种基于fpga的高清视频无缝矩阵系统
CN105763941A (zh) * 2016-03-02 2016-07-13 深圳市茁壮网络股份有限公司 一种频道切换方法和系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101141434A (zh) * 2006-09-06 2008-03-12 微普国际有限公司 可根据网路频宽自动选择设定档的媒体串流播放方法
CN201252603Y (zh) * 2008-09-18 2009-06-03 北京东方艾迪普科技发展有限公司 电视三维图文视频实时点评播报系统
CN103856787A (zh) * 2012-12-04 2014-06-11 上海文广科技(集团)有限公司 基于公网的带解说音频回传的直播系统及其直播方法
CN203445986U (zh) * 2013-08-21 2014-02-19 徐乾伟 摄即传的ip传输系统
EP2908516A1 (en) * 2014-02-14 2015-08-19 Alcatel Lucent Process for transmitting an ongoing video stream from a publisher to a receiver through a MCU unit during a live session
CN106027991A (zh) * 2016-07-12 2016-10-12 李巍 一种医疗视频影像直播一体机
CN106507186A (zh) * 2016-10-31 2017-03-15 腾讯科技(深圳)有限公司 一种媒体信息的切换方法及服务器

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743475A (zh) * 2019-01-10 2019-05-10 杭州星犀科技有限公司 多路直播的导播装置
CN109743475B (zh) * 2019-01-10 2023-12-12 杭州星犀科技有限公司 多路直播的导播装置
CN112019488A (zh) * 2019-05-31 2020-12-01 广州市百果园信息技术有限公司 一种语音处理的方法、装置、设备和存储介质
CN112019488B (zh) * 2019-05-31 2023-12-12 广州市百果园信息技术有限公司 一种语音处理的方法、装置、设备和存储介质
CN114442039A (zh) * 2020-11-05 2022-05-06 中国移动通信集团山东有限公司 一种声源定位方法、装置和电子设备
CN112738540A (zh) * 2020-12-25 2021-04-30 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质
CN112738540B (zh) * 2020-12-25 2023-09-05 广州虎牙科技有限公司 多设备直播切换方法、装置、系统、电子设备和可读存储介质
CN113347459A (zh) * 2021-06-11 2021-09-03 杭州星犀科技有限公司 基于Android系统的自主音频源切换方法、装置和计算设备
CN113347459B (zh) * 2021-06-11 2023-08-11 杭州星犀科技有限公司 基于Android系统的自主音频源切换方法、装置和计算设备
CN114553846A (zh) * 2022-01-11 2022-05-27 南方电网深圳数字电网研究院有限公司 一种实时采集流媒体的直播方法及装置
CN114553846B (zh) * 2022-01-11 2024-05-14 南方电网数字平台科技(广东)有限公司 一种实时采集流媒体的直播方法及装置

Also Published As

Publication number Publication date
CN106507186B (zh) 2020-01-10
CN106507186A (zh) 2017-03-15

Similar Documents

Publication Publication Date Title
WO2018077259A1 (zh) 一种媒体信息的切换方法及服务器、计算机存储介质
CN110383848B (zh) 用于多设备呈现的定制视频流式传输
KR101615974B1 (ko) 모바일 미디어 서버
WO2017101369A1 (zh) 直播视频的转码方法及装置
US11356493B2 (en) Systems and methods for cloud storage direct streaming
US11516518B2 (en) Live streaming with live video production and commentary
US8643779B2 (en) Live audio track additions to digital streams
JP2011526381A (ja) ピアツーピアネットワークのための放送シーディング
CN101990126B (zh) 互联网点播或直播信号动态切换中插播广告的方法
RU2646391C2 (ru) Устройство поставки контента, способ поставки контента, программа, терминальное устройство и система поставки контента
CN101917391A (zh) 一种网络视频的播放方法及一种网络视频播放系统
US20130135179A1 (en) Control method and device thereof
WO2016197865A1 (zh) 数据传输方法、装置和智能电视系统
JP2015511435A (ja) 放送符号化、録画および配信システムならびにその方法
US20220377394A1 (en) Systems and methods for optimizing a set-top box to retrieve missed content
KR102090070B1 (ko) 스트리밍 서버, 클라이언트 단말 및 이를 이용한 av 라이브 스트리밍 시스템
US20130291011A1 (en) Transcoding server and method for overlaying image with additional information therein
CN1972447A (zh) 基于流媒体技术的多画面播放器及其播放方法
US20170048291A1 (en) Synchronising playing of streaming content on plural streaming clients
JP5997500B2 (ja) 放送通信連携受信装置
CN109640136B (zh) 一种控制电视的方法、装置、电子设备及可读介质
CN102710967A (zh) 一种云电视系统与方法
CN1327443C (zh) 一种流媒体点播的音视频切换方法
CN113055636A (zh) 一种数据处理方法及会议系统
CN202019423U (zh) 基于p2p技术的具有hdmi接口的高清iptv机顶盒

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17866354

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17866354

Country of ref document: EP

Kind code of ref document: A1