CN112752143A - Method and device for optimizing coding of streaming media server - Google Patents
Method and device for optimizing coding of streaming media server Download PDFInfo
- Publication number
- CN112752143A CN112752143A CN202011601289.4A CN202011601289A CN112752143A CN 112752143 A CN112752143 A CN 112752143A CN 202011601289 A CN202011601289 A CN 202011601289A CN 112752143 A CN112752143 A CN 112752143A
- Authority
- CN
- China
- Prior art keywords
- audio
- video data
- video
- target information
- transmitted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000000694 effects Effects 0.000 claims abstract description 19
- 238000006243 chemical reaction Methods 0.000 claims description 38
- 238000005457 optimization Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 17
- 230000015654 memory Effects 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 7
- 230000009467 reduction Effects 0.000 claims description 6
- 238000013075 data extraction Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 12
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for optimizing the coding of a streaming media server, comprising the following steps: extracting audio and video data to be transmitted before streaming media service broadcasting; detecting whether the audio and video data to be transmitted comprises target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data are transmitted and played by a streaming media server; if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data; and sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data. The invention processes the audio and video data to be transmitted before the streaming media service broadcast, and solves the problem of poor audio and video effect caused by the audio and video stream data quality and the network quality of the bearing data.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for optimizing coding of a streaming media server.
Background
Streaming media refers to a form of media that streams audio, video, and multimedia files over a network. The streaming media server is a core system of streaming media application, is a key platform for operators to provide video services for users, and has the main functions of collecting, caching, scheduling, transmitting and playing streaming media contents.
At present, users generally cannot obtain better audio and video effects due to the influence of the quality of transmitted audio and video stream data and the quality of a network carrying data. For example, if there is a noise in the audio/video stream, after playing through the streaming media server, each client will also hear the noise. Therefore, how to guarantee the quality of audio/video transmission and playing services is a major problem faced by the streaming media server.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method and an apparatus for optimizing coding of a streaming media server, which solve the problem of poor audio and video effects caused by the quality of audio and video stream data and the quality of a network carrying data.
In order to achieve the purpose, the invention provides the following technical scheme:
a method for optimizing coding of a streaming media server comprises the following steps:
extracting audio and video data to be transmitted before streaming media service broadcasting;
detecting whether the audio and video data to be transmitted comprises target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data to be transmitted is transmitted and played by a streaming media server;
if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data;
and sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data.
Optionally, the method further comprises:
configuring an audio and video stream address corresponding to a real-time streaming protocol, and establishing audio and video stream connection;
extracting audio and video data to be transmitted in the audio and video stream;
and processing the audio and video data to be transmitted by starting a local playing audio and video interface.
Optionally, the target information includes audio data with noise, and the processing the target information according to a processing mode matched with the target information includes:
and denoising the audio data with the noise to obtain denoised audio data.
Optionally, the target information includes audio and video data generated by a network anomaly, and the processing of the target information according to a processing mode matched with the target information includes:
acquiring a playing interface corresponding to the audio and video data generated by the network abnormity;
if the playing interface has playing delay or picture jitter, performing cache reduction playing processing on the audio and video data to obtain processed audio and video data;
and if packet loss exists in the playing interface, performing image processing on the audio and video data to obtain the processed audio and video data.
Optionally, the method further comprises:
detecting whether audio protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
if so, carrying out audio protocol conversion on the audio data in the audio and video data;
detecting whether video protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
and if so, carrying out video protocol conversion on the video data in the audio and video data.
Optionally, the method further comprises:
and carrying out transmission protocol conversion on the processed audio and video data to obtain the converted audio and video data.
A streaming server encoding optimization apparatus, comprising:
the extraction unit is used for extracting audio and video data to be transmitted before the streaming media service broadcast;
the detection unit is used for detecting whether the audio and video data to be transmitted comprise target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data to be transmitted are transmitted and played by a streaming media server;
the processing unit is used for processing the target information according to a processing mode matched with the target information if the target information exists to obtain processed audio and video data;
and the sending unit is used for sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data.
Optionally, the apparatus further comprises:
the configuration unit is used for configuring an audio and video stream address corresponding to the real-time stream transmission protocol and establishing audio and video stream connection;
the data extraction unit is used for extracting audio and video data to be transmitted in the audio and video stream;
and the data processing unit is used for processing the audio and video data to be transmitted by starting a local playing audio and video interface.
Optionally, the processing unit is specifically configured to:
and denoising the audio data with the noise to obtain denoised audio data.
Optionally, the target information includes audio and video data generated by a network anomaly, and the processing unit is specifically configured to:
acquiring a playing interface corresponding to the audio and video data generated by the network abnormity;
if the playing interface has playing delay or picture jitter, performing cache reduction playing processing on the audio and video data to obtain processed audio and video data;
and if packet loss exists in the playing interface, performing image processing on the audio and video data to obtain the processed audio and video data.
Optionally, the apparatus further comprises: a first conversion unit to:
detecting whether audio protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
if so, carrying out audio protocol conversion on the audio data in the audio and video data;
detecting whether video protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
and if so, carrying out video protocol conversion on the video data in the audio and video data.
Optionally, the apparatus further comprises: a second conversion unit to:
and carrying out transmission protocol conversion on the processed audio and video data to obtain the converted audio and video data.
A storage medium storing executable instructions which, when executed by a processor, implement a streaming server coding optimization method as described in any one of the above.
An electronic device, comprising:
a memory for storing a program;
a processor configured to execute the program, where the program is specifically configured to implement the streaming server coding optimization method described in any one of the above.
Compared with the prior art, the invention provides a method and a device for optimizing the coding of a streaming media server, which comprises the following steps: extracting audio and video data to be transmitted before streaming media service broadcasting; detecting whether the audio and video data to be transmitted comprises target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data are transmitted and played by a streaming media server; if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data; and sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data. The invention processes the audio and video data to be transmitted before the streaming media service broadcast, and solves the problem of poor audio and video effect caused by the audio and video stream data quality and the network quality of the bearing data.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for encoding and optimizing a streaming media server according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a deployment structure and coding optimization process according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an encoding optimization apparatus for a streaming media server according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first" and "second," and the like in the description and claims of the present invention and the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not set forth for a listed step or element but may include steps or elements not listed.
The embodiment of the invention provides a Streaming media server coding optimization method, which performs audio and video self-adaptive coding enhancement in a Streaming media communication system, namely, before Streaming media service broadcasting, the latent function of pre-acquisition, coding, quality optimization, stream pushing and Streaming media RTSP (Real Time Streaming Protocol) service is added, so as to better obtain audio and video effects. The streaming media server is a core system of streaming media application, is a key platform for operators to provide video services for users, and has the main functions of collecting, caching, scheduling, transmitting and playing streaming media contents.
Referring to fig. 1, a method for encoding and optimizing a streaming media server according to an embodiment of the present invention is shown, where the method may include the following steps:
s101, before the streaming media service is broadcasted, audio and video data to be transmitted are extracted.
In the embodiment of the invention, before the existing streaming media server processes the broadcast, the pre-acquisition, coding, instruction optimization, stream pushing and streaming media RTSP service pre-function is added, audio and video detection is firstly carried out, local playing of video pictures is provided, bottom layer transmission information and data statistics are displayed in real time, and then self-adaptive processing is carried out aiming at 4 conditions, including whether noise exists, whether a network has delay, packet loss, jitter and the like, whether a coding protocol needs to be converted and the like. Specifically, when the audio/video data to be transmitted is acquired, the RTSP audio/video stream address of the encoder that executes the encoding optimization method may be configured, and audio/video stream connection is established. Then, an audio/video detection module can be utilized to capture audio/video data in the RTSP stream, a local playing audio/video interface is started, the transmitted audio/video data is processed, namely, the problem of the audio/video data to be transmitted can be judged through the current audio/video interface, and then subsequent processing is carried out.
S102, detecting whether the audio and video data to be transmitted comprises target information.
The target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data are transmitted and played by the streaming media server. If the audio and video stream has noise, each client can hear the noise after being played by the streaming media server; if a large delay, jitter or packet loss occurs in the network, the delay is amplified to affect the viewing of the user after being played by the streaming media server. Some streaming media servers do not support the audio and video data coding protocol or transmission protocol transmitted by the existing system, so that the streaming media servers cannot be used. These are target information that affect the streaming server to transmit the playing.
S103, if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data.
And S104, sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data.
And selecting a corresponding processing mode to process the target information according to the influence factors in the target information so as to ensure that the processed audio and video data can obtain higher transmission and playing effects. After audio and video stream detection is carried out, local playing of audio and video pictures is provided, data information and data statistics of bottom layer transmission are displayed in real time, and then self-adaptive processing is carried out aiming at the problems, including whether noise exists or not, whether delay, packet loss, jitter and the like exist in a network or not, whether a coding protocol needs to be converted or not, and whether a transmission protocol needs to be converted or not. And finally, transmitting the optimized audio and video to the existing streaming media server for transmission and playing, so that the client user can better obtain the audio and video effect.
The following describes a process of performing corresponding processing when different influence factors exist in the target information. It should be noted that the following processes may be completed one by one, or may be processed in a certain order, and the order of processing is not limited in the embodiment of the present invention.
Wherein the target information includes audio data with noise, and the processing of the target information according to the processing mode matched with the target information includes: and denoising the audio data with the noise to obtain denoised audio data.
Correspondingly, the target information includes audio and video data generated by network abnormality, and the processing of the target information according to a processing mode matched with the target information includes: acquiring a playing interface corresponding to the audio and video data generated by the network abnormity; if the playing interface has playing delay or picture jitter, performing cache reduction playing processing on the audio and video data to obtain processed audio and video data; and if packet loss exists in the playing interface, performing image processing on the audio and video data to obtain the processed audio and video data.
Specifically, the protocol conversion process includes:
detecting whether audio protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
if so, carrying out audio protocol conversion on the audio data in the audio and video data;
detecting whether video protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
and if so, carrying out video protocol conversion on the video data in the audio and video data.
Correspondingly, the method further comprises the following steps:
and carrying out transmission protocol conversion on the processed audio and video data to obtain the converted audio and video data.
The following describes the method for optimizing the coding of the streaming media server according to the present invention with a specific application example. Referring to fig. 2, a schematic diagram of a deployment structure and coding optimization process provided by an embodiment of the present invention is shown. In an enterprise Multimedia information system integration project, a plurality of audio and video devices are connected to an AV (audio and video) matrix device through an HDMI (High Definition Multimedia Interface) physical line, an output end of the AV matrix device is connected to an audio and video encoder, and after obtaining a certain path of audio and video input stream, a corresponding RTSP audio and video stream can be sent out, and a streaming media server pulls the RST audio and video stream, and plays the RST audio and video stream on each client APP after forwarding. The invention adds the prepositive functions of pre-acquisition, encoding, quality optimization, pushing and streaming media RTSP service before the streaming media server pulls the RTSP stream of the encoder, and transmits the RTSP stream to the streaming media server for forwarding after the processing is finished so as to better obtain the audio and video effect. The method comprises the following specific steps:
configuring audio and video data in RTSP (real time streaming protocol) flow of an encoder, and starting a local playing audio and video interface;
executing an audio/video detection module to detect audio/video streams and capturing audio/video data in the RTSP stream;
acquiring bottom layer audio and video data information in real time and displaying the information on an interface;
judging whether noises such as current sound exist in the audio, and if no noise exists, continuing to execute the operation;
if the audio frequency has noise, executing noise removal processing, removing noise in the sound, and continuing to execute;
judging whether the network has abnormity such as delay, packet loss and the like, and if the network has no abnormity, continuing to execute;
if the network is abnormal, executing audio and video quality enhancement processing, executing cache reduction playing processing aiming at delay and jitter conditions, executing audio and video image recombination to restore partial mosaic picture aiming at packet loss conditions, and continuing to execute;
judging whether the coding and decoding protocol needs to be converted, if the conversion coding is not configured, continuing to execute;
if audio protocol conversion is needed, executing a corresponding audio protocol conversion algorithm, and if video protocol conversion is needed, executing a video protocol conversion algorithm; the conversion can be carried out simultaneously, and the two algorithms are called to be continuously executed; the audio can be converted by mp3, wma, m4r, aac, opus protocol and the like.
Judging whether the transmission protocol needs to be converted, if the conversion transmission protocol is not configured, continuing to execute;
if the configuration needs to be converted, executing a conversion protocol algorithm according to the pre-configured parameters, and continuing to execute; for example, the RTSP protocol is converted to the RTMP protocol.
And sending the processed audio and video stream to the existing streaming media server, and transmitting and playing the processed audio and video stream by the streaming media server.
Therefore, the embodiment of the invention adds the prepositive functions of pre-acquisition, coding, quality optimization, stream pushing and streaming media RTSP service before the prior streaming media service transmits the broadcast audio/video stream, can support wider streaming media server software and better obtain the audio/video effect.
Referring to fig. 3, it shows a schematic structural diagram of an encoding optimization apparatus for a streaming media server according to an embodiment of the present invention, where the apparatus includes:
the extracting unit 10 is configured to extract audio and video data to be transmitted before a streaming media service broadcast;
the detection unit 20 is configured to detect whether the audio/video data to be transmitted includes target information, where the target information is information that can affect an audio/video effect of the audio/video data to be transmitted when the audio/video data is transmitted and played by a streaming media server;
the processing unit 30 is configured to, if target information exists, process the target information according to a processing mode matched with the target information to obtain processed audio/video data;
and the sending unit 40 is configured to send the processed audio and video data to a streaming media server, so that the streaming media server transmits and plays the processed audio and video data.
Optionally, the apparatus further comprises:
the configuration unit is used for configuring an audio and video stream address corresponding to the real-time stream transmission protocol and establishing audio and video stream connection;
the data extraction unit is used for extracting audio and video data to be transmitted in the audio and video stream;
and the data processing unit is used for processing the audio and video data to be transmitted by starting a local playing audio and video interface.
Optionally, the processing unit is specifically configured to:
and denoising the audio data with the noise to obtain denoised audio data.
Optionally, the target information includes audio and video data generated by a network anomaly, and the processing unit is specifically configured to:
acquiring a playing interface corresponding to the audio and video data generated by the network abnormity;
if the playing interface has playing delay or picture jitter, performing cache reduction playing processing on the audio and video data to obtain processed audio and video data;
and if packet loss exists in the playing interface, performing image processing on the audio and video data to obtain the processed audio and video data.
Optionally, the apparatus further comprises: a first conversion unit to:
detecting whether audio protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
if so, carrying out audio protocol conversion on the audio data in the audio and video data;
detecting whether video protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
and if so, carrying out video protocol conversion on the video data in the audio and video data.
Optionally, the apparatus further comprises: a second conversion unit to:
and carrying out transmission protocol conversion on the processed audio and video data to obtain the converted audio and video data.
The invention provides a coding optimization device of a streaming media server, which comprises: extracting audio and video data to be transmitted before streaming media service broadcasting; detecting whether the audio and video data to be transmitted comprises target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data are transmitted and played by a streaming media server; if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data; and sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data. The invention processes the audio and video data to be transmitted before the streaming media service broadcast, and solves the problem of poor audio and video effect caused by the audio and video stream data quality and the network quality of the bearing data.
Based on the foregoing embodiments, an embodiment of the present invention further provides a storage medium, where the storage medium stores executable instructions, and the instructions, when executed by a processor, implement the method for encoding and optimizing a streaming media server according to any one of the above embodiments.
An embodiment of the present invention further provides an electronic device, including: a memory for storing a program; a processor configured to execute the program, where the program is specifically configured to implement the streaming server coding optimization method described in any one of the above.
The Processor or the CPU may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device implementing the above-mentioned processor function may be other electronic devices, and the embodiments of the present application are not particularly limited.
The computer storage medium/Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); but may also be various terminals such as mobile phones, computers, tablet devices, personal digital assistants, etc., that include one or any combination of the above-mentioned memories.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present application may be integrated into one processing module, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit. Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable Memory device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, and an optical disk.
The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.
Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.
The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for optimizing coding of a streaming media server is characterized by comprising the following steps:
extracting audio and video data to be transmitted before streaming media service broadcasting;
detecting whether the audio and video data to be transmitted comprises target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data to be transmitted is transmitted and played by a streaming media server;
if the target information exists, processing the target information according to a processing mode matched with the target information to obtain processed audio and video data;
and sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data.
2. The method of claim 1, further comprising:
configuring an audio and video stream address corresponding to a real-time streaming protocol, and establishing audio and video stream connection;
extracting audio and video data to be transmitted in the audio and video stream;
and processing the audio and video data to be transmitted by starting a local playing audio and video interface.
3. The method of claim 1, wherein the target information comprises noisy audio data, and wherein processing the target information according to a processing mode matching the target information comprises:
and denoising the audio data with the noise to obtain denoised audio data.
4. The method according to claim 1, wherein the target information includes audio/video data generated by a network anomaly, and the processing the target information according to a processing mode matched with the target information includes:
acquiring a playing interface corresponding to the audio and video data generated by the network abnormity;
if the playing interface has playing delay or picture jitter, performing cache reduction playing processing on the audio and video data to obtain processed audio and video data;
and if packet loss exists in the playing interface, performing image processing on the audio and video data to obtain the processed audio and video data.
5. The method of claim 1, further comprising:
detecting whether audio protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
if so, carrying out audio protocol conversion on the audio data in the audio and video data;
detecting whether video protocol conversion needs to be carried out on the audio and video data to be transmitted or not;
and if so, carrying out video protocol conversion on the video data in the audio and video data.
6. The method of claim 1, further comprising:
and carrying out transmission protocol conversion on the processed audio and video data to obtain the converted audio and video data.
7. An apparatus for encoding optimization of a streaming media server, comprising:
the extraction unit is used for extracting audio and video data to be transmitted before the streaming media service broadcast;
the detection unit is used for detecting whether the audio and video data to be transmitted comprise target information, wherein the target information is information capable of influencing the audio and video effect of the audio and video data to be transmitted when the audio and video data to be transmitted are transmitted and played by a streaming media server;
the processing unit is used for processing the target information according to a processing mode matched with the target information if the target information exists to obtain processed audio and video data;
and the sending unit is used for sending the processed audio and video data to a streaming media server so that the streaming media server transmits and plays the processed audio and video data.
8. The apparatus of claim 7, further comprising:
the configuration unit is used for configuring an audio and video stream address corresponding to the real-time stream transmission protocol and establishing audio and video stream connection;
the data extraction unit is used for extracting audio and video data to be transmitted in the audio and video stream;
and the data processing unit is used for processing the audio and video data to be transmitted by starting a local playing audio and video interface.
9. A storage medium storing executable instructions which, when executed by a processor, implement a streaming server coding optimization method according to any one of claims 1 to 6.
10. An electronic device, comprising:
a memory for storing a program;
a processor configured to execute the program, where the program is specifically configured to implement the method for encoding optimization of a streaming server according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011601289.4A CN112752143A (en) | 2020-12-30 | 2020-12-30 | Method and device for optimizing coding of streaming media server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011601289.4A CN112752143A (en) | 2020-12-30 | 2020-12-30 | Method and device for optimizing coding of streaming media server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112752143A true CN112752143A (en) | 2021-05-04 |
Family
ID=75647307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011601289.4A Pending CN112752143A (en) | 2020-12-30 | 2020-12-30 | Method and device for optimizing coding of streaming media server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112752143A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095108A (en) * | 2021-10-09 | 2022-02-25 | 福建新大陆通信科技股份有限公司 | Smart broadcasting method applied to client |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1949879A (en) * | 2005-10-11 | 2007-04-18 | 华为技术有限公司 | Lip synchronous method for multimedia real-time transmission in packet network and apparatus thereof |
| CN109168031A (en) * | 2018-11-06 | 2019-01-08 | 杭州云英网络科技有限公司 | Streaming Media method for pushing and device, steaming media platform |
| CN109963184A (en) * | 2017-12-14 | 2019-07-02 | 阿里巴巴集团控股有限公司 | A kind of method, apparatus and electronic equipment of audio-video network broadcasting |
| CN111064972A (en) * | 2019-11-28 | 2020-04-24 | 湖北工业大学 | Live video control method based on IPV9 |
| CN111107396A (en) * | 2019-12-31 | 2020-05-05 | 斑马网络技术有限公司 | Hardware-based vehicle audio remote output method, device and system |
-
2020
- 2020-12-30 CN CN202011601289.4A patent/CN112752143A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1949879A (en) * | 2005-10-11 | 2007-04-18 | 华为技术有限公司 | Lip synchronous method for multimedia real-time transmission in packet network and apparatus thereof |
| CN109963184A (en) * | 2017-12-14 | 2019-07-02 | 阿里巴巴集团控股有限公司 | A kind of method, apparatus and electronic equipment of audio-video network broadcasting |
| CN109168031A (en) * | 2018-11-06 | 2019-01-08 | 杭州云英网络科技有限公司 | Streaming Media method for pushing and device, steaming media platform |
| CN111064972A (en) * | 2019-11-28 | 2020-04-24 | 湖北工业大学 | Live video control method based on IPV9 |
| CN111107396A (en) * | 2019-12-31 | 2020-05-05 | 斑马网络技术有限公司 | Hardware-based vehicle audio remote output method, device and system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095108A (en) * | 2021-10-09 | 2022-02-25 | 福建新大陆通信科技股份有限公司 | Smart broadcasting method applied to client |
| CN114095108B (en) * | 2021-10-09 | 2023-05-30 | 福建新大陆通信科技股份有限公司 | Intelligent broadcasting method applied to client |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10698952B2 (en) | Using digital fingerprints to associate data with a work | |
| US9047516B2 (en) | Content fingerprinting | |
| KR101757878B1 (en) | Contents processing apparatus, contents processing method thereof, server, information providing method of server and information providing system | |
| JP5175948B2 (en) | Video display device, noise removal method, and video display system | |
| CN112087633B (en) | Video decoding method, device and storage medium | |
| US9128593B2 (en) | Enabling an interactive program associated with a live broadcast on a mobile device | |
| WO2020211731A1 (en) | Video playing method and related device | |
| CN110012217B (en) | Method and device for determining acquisition resolution and electronic equipment | |
| CN106998485B (en) | Video live broadcasting method and device | |
| CN110996134A (en) | Video playing method, device and storage medium | |
| KR20130115389A (en) | Receiver and method for reporting the usage of advanced television services | |
| CN103200461A (en) | Multiple-player-terminal synchronized playing system and playing method | |
| CN112771881B (en) | Bullet screen processing method and device, electronic equipment and computer readable storage medium | |
| RU2603629C2 (en) | Terminal device, server device, information processing method, program and system for providing related applications | |
| WO2016090889A1 (en) | Promotion information processing method, device and apparatus, and non-volatile computer storage medium | |
| CN111510755A (en) | Audio and video switching method and device, computer equipment and readable storage medium | |
| CN112770168B (en) | Video playing method, related device and equipment | |
| WO2020026009A1 (en) | Video object recommendation method and apparatus, and device/terminal/server | |
| WO2015154549A1 (en) | Data processing method and device | |
| CN112752143A (en) | Method and device for optimizing coding of streaming media server | |
| US10762913B2 (en) | Image-based techniques for audio content | |
| CN111356006B (en) | Video playing method, device, server and storage medium | |
| CN112926546A (en) | Bullet screen sending method, bullet screen sending device, bullet screen equipment and readable storage medium | |
| CN110855619A (en) | Processing method and device for playing audio and video data, storage medium and terminal equipment | |
| CN104573413B (en) | A kind of guard method of multimedia resource and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210504 |