CN104869474A - Expansible mobile streaming media system and application method thereof - Google Patents

Expansible mobile streaming media system and application method thereof Download PDF

Info

Publication number
CN104869474A
CN104869474A CN201410061804.2A CN201410061804A CN104869474A CN 104869474 A CN104869474 A CN 104869474A CN 201410061804 A CN201410061804 A CN 201410061804A CN 104869474 A CN104869474 A CN 104869474A
Authority
CN
China
Prior art keywords
streaming media
audio
video
media server
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410061804.2A
Other languages
Chinese (zh)
Inventor
韩兆强
冀德
姚刚霞
陈长清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fengwang Science (beijing) Co Ltd
Original Assignee
Fengwang Science (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fengwang Science (beijing) Co Ltd filed Critical Fengwang Science (beijing) Co Ltd
Priority to CN201410061804.2A priority Critical patent/CN104869474A/en
Publication of CN104869474A publication Critical patent/CN104869474A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses an expansible mobile streaming media system and an application method thereof. The system comprises a front-end collector, a streaming media server, a terminal player and an application server, wherein the front-end collector configures parameters according to instruction from the application server, processes collected audio and video according to the configured parameters, and transmits the processed audio and video to the streaming media server; the streaming media server receives audio and video streams from the front-end collector, processes the audio and video streams according to requirements, and transmits the processed audio and video streams to the terminal player; and the terminal player negotiates with the application server, obtains an optimal address of the streaming media server according the present network connection manner, and receives the audio and video streams from the corresponding streaming media server. The expansible mobile streaming media system and the application method thereof can be used to solve the problems that in the prior art, the compatibility of the player is low and that different qualities of streaming media cannot be provided for different network connection manners.

Description

A kind of extendible mobile stream media system and application process thereof
Technical field
The present invention relates to mobile flow medium technology, particularly relate to a kind of extendible mobile stream media system and application process thereof.
Background technology
A complete stream media system comprises: front-end acquisition device, streaming media server, terminal player.Wherein, front-end acquisition device controls the equipment such as camera, microphone, gathers corresponding Audio and Video respectively, and carries out encoding (compression), encapsulating, and forms audio frequency and video, and is sent on the streaming media server on backstage according to stream protocol form; After streaming media server receives audio/video flow, carry out certain process according to demand, as transcoding, preservation etc., finally, the audio/video flow after process is distributed; Terminal player connects streaming media server, and obtain Streaming Media from streaming media server, be reduced to audio/video information after parsing, then decoded audio, video (decompress(ion)), finally play.
As above there is following shortcoming in prior art:
1, the player that current Android platform carries can support the Streaming Media of RTSP agreement, but the player RTSP of Android lowest version (less than 4.0) system supports poor, compatible bad, there will be various problems such as cannot playing, audio frequency and video are asynchronous, disconnect after broadcasting a period of time.
2, current smart mobile phone (Android, apple, Windows Phone etc.) carries out network when connecting, and can use WIFI mode, can use again 3G(and be about to the 4G that releases), the mode such as 2.5G, and different connected mode, network speed is different.If only provide a set of stream medium data, in order to meet the connected mode of low network speed, bandwidth, the video flowing of low bit-rate, low frame per second then can only be provided, so, the video that terminal player is play just there will be unintelligible, slack phenomenon, connecting for high speed is then a kind of waste, because they can support the video flowing transmitting high code check, high frame per second, high definition.
Summary of the invention
The object of the present invention is to provide a kind of extendible mobile stream media system and application process thereof, for solving player poor compatibility in prior art and the problem of the Streaming Media of different quality cannot being provided for different internetwork connection modes.
To achieve these goals, the invention provides a kind of extendible mobile stream media system, it is characterized in that, comprising: front-end acquisition device, streaming media server, terminal player, application server;
Described front-end acquisition device, for the instruction configuration parameter issued according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to described streaming media server;
Described streaming media server, for receiving described audio/video flow from described front-end acquisition device, is distributed to described terminal player after processing to described audio/video flow according to demand;
Described terminal player, for holding consultation with described application server, according to current internetwork connection mode, obtaining optimum streaming media server address, and receiving described audio/video flow from corresponding streaming media server.
Described extendible mobile stream media system, wherein, described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
Described extendible mobile stream media system, wherein, described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
Described extendible mobile stream media system, wherein, audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
Described extendible mobile stream media system, wherein, described terminal player is when play quality is bad, contact described application server, obtain the streaming media server compared with low bit-rate, or when play quality is good, contact described application server, obtain the streaming media server of high code rate.
To achieve these goals, the invention provides a kind of application process of extendible mobile stream media system, it is characterized in that, comprising:
Step one, the instruction configuration parameter that front-end acquisition device issues according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server;
Step 2, described streaming media server receives described audio/video flow from described front-end acquisition device, is distributed to terminal player after processing to described audio/video flow according to demand;
Step 3, described terminal player and described application server are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive described audio/video flow from corresponding streaming media server.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
The application process of described extendible mobile stream media system, wherein, in described step 3, comprising:
Described terminal player, when play quality is bad, contacts described application server, obtains the streaming media server compared with low bit-rate, or when play quality is good, contacts described application server, obtains the streaming media server of high code rate.
Compared with prior art, the present invention proposes a set of stream media system being suitable for intelligent terminal and playing, and the flow host-host protocol used, stream encapsulation standard, concrete Advantageous Effects is:
1, solve Streaming Media load time length, postpone more problem;
2, improve the quality of Streaming Media, as definition, fluency, audio-visual synchronization etc.;
3, support all intelligent terminals, and can connect for different networks the stream that different quality is provided.
Accompanying drawing explanation
Fig. 1 is the extendible mobile stream media system structure chart of the present invention;
Fig. 2 is the application process flow chart of the extendible mobile stream media system of the present invention.
Embodiment
Describe the present invention below in conjunction with the drawings and specific embodiments, but not as a limitation of the invention.
As shown in Figure 1, be the extendible mobile stream media system structure chart of the present invention.This mobile stream media system 100 comprises: front-end acquisition device 10, streaming media server 20, terminal player 30, application server 40.
Front-end acquisition device 10, first and application server 40 is consulted, and according to the instruction that application server 40 issues, flexible configuration parameter, as the coding parameter of audio frequency and video, frame per second, code check, streaming media server address etc., then camera is controlled, the equipment such as microphone, gather corresponding Audio and Video respectively, and carry out encode (compression) according to configuration parameter, be packaged into FLV form, and according to the stream protocol form configured, be sent on the multiple stage streaming media server 20 of configuration, as low frame per second (<10fps[10 frame is per second]), the stream of low bit-rate (<100kbps[100K bits per second]) delivers to streaming media server A, the stream of high frame per second (>20fps), high code check (>400kbps) delivers to streaming media server B, etc.
Streaming media server 20, after receiving the audio/video flow that front-end acquisition device 10 sends, carries out certain process according to demand, as preserved, finally, is distributed by the stream after process;
Terminal player 30, first hold consultation with application server 40, according to current internetwork connection mode, obtain optimum streaming media server address, then from corresponding streaming media server receiver, video stream, the terminal player connected for WIFI mode as network obtains from streaming media server A; The terminal player that network connects for 2.5G then obtains from streaming media server B, etc.In order to solve Android platform RTSP compatibility issue, need to realize normal stream agreement (as RTSP, RTMP etc.), FLV format analysis, audio/video decoding, audio and video playing/control etc., and in order to support all smart mobile phone models, can not be optimized by assembler language, comprise the instruction etc. that can not use floating-point coprocessor, and the compile option of standard must be used to carry out cross compile, generate the instruction set of ARM V5, can run on all smart mobile phones.
Application server 40 mainly provides applied logic to control and configuration management function, and holds consultation with front-end acquisition device 10, terminal player 30.Operation personnel can be visited by browser and application server 40 manages.
In order to reduce Streaming Media load time length, postpone more problem, need to carry out following optimization respectively to front-end acquisition device 10, streaming media server 20, terminal player 30 3 parts:
(1) front-end acquisition device 10, reduces initialization duration, and optimizes audio/video coding process, uses the codec of fast coding as far as possible.
(2) streaming media server 20, does not do long buffering, accelerates distribution speed; Do not do transcoding process, reduce the workload of recompile of decoding again, just decrease delay yet.
(3) terminal player 30, since it is known front-end acquisition device 10 uses codec to encode, so just can the size of cutting decoding code in terminal player 30, and delete useless judgement branch, so both can reduce the size of application program installation kit, from before about 1M reduced to 400K, decrease 60%, can the speed of service be accelerated again, reduce the delay of decoding and bringing; In addition, terminal player 30 is only resolved for concrete real time flow medium, therefore can also optimize the discriminatory analysis process of stream format, makes it identify the time shorten of stream media format, accelerates the load time.Owing to being real-time live broadcast, the present invention can also remove buffering, plays the audio, video data received in real time, thus reduces delay.
In order to improve the quality of Streaming Media, as definition, fluency, audio-visual synchronization etc., when front-end acquisition device 10 is encoded, at least use per second 3 key frames, because Streaming Media allows to lose some data in transmitting procedure, if the underfrequency of key frame, the interval also namely between key frame is long, then cannot reduce complete video image, cause the mosaic effect of subregion.Only have by the time next key frame time, complete video image could be restored according to key frame information; And controlled by terminal player 30, ensure the synchronism of audio frequency and video, if find to occur a large amount of frame losings or audio frequency and video asynchronous (illustrating that audio, video data is made mistakes, may is that network is bad) in certain period, then terminal player 30 initiatively contact application server 40, obtain the streaming media server compared with low bit-rate, reconnect; And play quality good time, terminal player 30 also can contact application server 40, attempts obtaining the streaming media server of high code rate (also i.e. higher video quality), when network allows, promotes the sensory effects of user as much as possible.
Like this, just can dynamic conditioning, streaming media playing quality in self adaptation heterogeneous networks situation.
As shown in Figure 2, be the application process flow chart of the extendible mobile stream media system of the present invention.Composition graphs 1, be described the application process of extendible mobile stream media system, the method comprises the steps:
Step 201, the instruction configuration parameter that front-end acquisition device 10 issues according to application server 40, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server 20;
Particularly, front-end acquisition device 10, first and application service 40 is consulted, and according to the instruction that application server 40 issues, flexible configuration parameter, as the coding parameter of audio frequency and video, frame per second, code check, streaming media server address etc., then camera is controlled, the equipment such as microphone, gather corresponding Audio and Video respectively, and carry out encode (compression) according to configuration parameter, be packaged into FLV form, and according to the stream protocol form configured, be sent on the multiple stage streaming media server 20 of configuration, as low frame per second (<10fps[10 frame is per second]), the stream of low bit-rate (<100kbps[100K bits per second]) delivers to streaming media server A, the stream of high frame per second (>20fps), high code check (>400kbps) delivers to streaming media server B, etc..
Step 202, streaming media server 20 receives audio/video flow from front-end acquisition device 10, is distributed to terminal player 30 after processing to audio/video flow according to demand;
Particularly, streaming media server 20 carries out certain process according to demand after receiving the audio/video flow that front-end acquisition device 10 sends, and as preserved, finally, is distributed by the stream after process;
Step 203, terminal player 30 and application server 40 are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive audio/video flow from corresponding streaming media server.
Particularly, terminal player 30 is first held consultation with application server 40, according to current internetwork connection mode, obtains optimum streaming media server address, then from corresponding streaming media server receiver, video stream, the terminal player as WIFI connected mode obtains from streaming media server A; The terminal player of 2.5G then obtains from streaming media server B, etc.
Flexible configuration of the present invention, when do not affect gather front-end and back-end result of broadcast, can according to the network bandwidth of the scale of business, different time sections, user number etc. carry out dynamic conditioning.
The present invention is directed to the smart mobile phone of current increasingly extensive use, be positioned the player on intelligent mobile phone platform, support all intelligent mobile phone systems; The Streaming Media load time is fast, delay is few; The quality of Streaming Media is high, and picture is clear, smooth.
The present invention has been applied to the interactive channel functions in mobile video broadcasting, and main broadcaster can use front-end acquisition device, and its audio frequency and video are passed to streaming media server, and user can use mobile phone to connect streaming media server, the audio frequency and video of direct viewing main broadcaster.Practice confirms, no matter is WIFI, or 2.5G, 3G etc., and play quality is all satisfied, and delay, load time etc. be all at least like product 1/3rd or shorter.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection range that all should belong to the claim appended by the present invention.

Claims (10)

1. an extendible mobile stream media system, is characterized in that, comprising: front-end acquisition device, streaming media server, terminal player, application server;
Described front-end acquisition device, for the instruction configuration parameter issued according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to described streaming media server;
Described streaming media server, for receiving described audio/video flow from described front-end acquisition device, is distributed to described terminal player after processing to described audio/video flow according to demand;
Described terminal player, for holding consultation with described application server, according to current internetwork connection mode, obtaining optimum streaming media server address, and receiving described audio/video flow from corresponding streaming media server.
2. extendible mobile stream media system according to claim 1, is characterized in that, described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
3. extendible mobile stream media system according to claim 1, is characterized in that, described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
4. the extendible mobile stream media system according to claim 1,2 or 3, is characterized in that, audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
5. the extendible mobile stream media system according to claim 1,2 or 3, it is characterized in that, described terminal player is when play quality is bad, contact described application server, obtain the streaming media server compared with low bit-rate, or when play quality is good, contact described application server, obtain the streaming media server of high code rate.
6. an application process for extendible mobile stream media system, is characterized in that, comprising:
Step one, the instruction configuration parameter that front-end acquisition device issues according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server;
Step 2, described streaming media server receives described audio/video flow from described front-end acquisition device, is distributed to terminal player after processing to described audio/video flow according to demand;
Step 3, described terminal player and described application server are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive described audio/video flow from corresponding streaming media server.
7. the application process of extendible mobile stream media system according to claim 6, is characterized in that, in described step one, comprising:
Described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
8. the application process of extendible mobile stream media system according to claim 6, is characterized in that, in described step one, comprising:
Described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
9. the application process of the extendible mobile stream media system according to claim 6,7 or 8, is characterized in that, in described step one, comprising:
Audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
10. the application process of the extendible mobile stream media system according to claim 6,7 or 8, is characterized in that, in described step 3, comprising:
Described terminal player, when play quality is bad, contacts described application server, obtains the streaming media server compared with low bit-rate, or when play quality is good, contacts described application server, obtains the streaming media server of high code rate.
CN201410061804.2A 2014-02-24 2014-02-24 Expansible mobile streaming media system and application method thereof Pending CN104869474A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410061804.2A CN104869474A (en) 2014-02-24 2014-02-24 Expansible mobile streaming media system and application method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410061804.2A CN104869474A (en) 2014-02-24 2014-02-24 Expansible mobile streaming media system and application method thereof

Publications (1)

Publication Number Publication Date
CN104869474A true CN104869474A (en) 2015-08-26

Family

ID=53914909

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410061804.2A Pending CN104869474A (en) 2014-02-24 2014-02-24 Expansible mobile streaming media system and application method thereof

Country Status (1)

Country Link
CN (1) CN104869474A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109195024A (en) * 2018-08-24 2019-01-11 深圳爱克莱特科技股份有限公司 A kind of lamp light control system data processing system based on stream media technology
CN112073809A (en) * 2020-08-09 2020-12-11 富盛科技股份有限公司 Method for supporting browser to play video with any coding format
CN112584341A (en) * 2019-09-30 2021-03-30 华为技术有限公司 Communication method and device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101695129A (en) * 2009-10-09 2010-04-14 中兴通讯股份有限公司 Method and system for realizing video monitoring by mobile terminal supporting multimodes
CN101835029A (en) * 2010-04-21 2010-09-15 深圳市紫云鑫软件技术有限公司 Control method, system and client for playing streaming media
CN101997891A (en) * 2009-08-28 2011-03-30 华为技术有限公司 Method, device and system for allocating P2P media stream
CN102098513A (en) * 2010-12-20 2011-06-15 北京交通大学 Real-time transmission method of wireless video
CN102281213A (en) * 2011-08-31 2011-12-14 王胄 Instant messaging method and system for supporting voice and video message
CN102368819A (en) * 2011-10-24 2012-03-07 南京大学 System for collection, transmission, monitoring and publishment of mobile video
CN102413145A (en) * 2011-10-29 2012-04-11 华为技术有限公司 Media content access method, service server and mobile terminal
CN103179438A (en) * 2011-12-20 2013-06-26 中国移动通信集团上海有限公司 Method and device for determining of video playing first access code rate
CN103248962A (en) * 2013-04-23 2013-08-14 华为技术有限公司 Method, equipment and system for obtaining streaming media data

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101997891A (en) * 2009-08-28 2011-03-30 华为技术有限公司 Method, device and system for allocating P2P media stream
CN101695129A (en) * 2009-10-09 2010-04-14 中兴通讯股份有限公司 Method and system for realizing video monitoring by mobile terminal supporting multimodes
CN101835029A (en) * 2010-04-21 2010-09-15 深圳市紫云鑫软件技术有限公司 Control method, system and client for playing streaming media
CN102098513A (en) * 2010-12-20 2011-06-15 北京交通大学 Real-time transmission method of wireless video
CN102281213A (en) * 2011-08-31 2011-12-14 王胄 Instant messaging method and system for supporting voice and video message
CN102368819A (en) * 2011-10-24 2012-03-07 南京大学 System for collection, transmission, monitoring and publishment of mobile video
CN102413145A (en) * 2011-10-29 2012-04-11 华为技术有限公司 Media content access method, service server and mobile terminal
CN103179438A (en) * 2011-12-20 2013-06-26 中国移动通信集团上海有限公司 Method and device for determining of video playing first access code rate
CN103248962A (en) * 2013-04-23 2013-08-14 华为技术有限公司 Method, equipment and system for obtaining streaming media data

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109195024A (en) * 2018-08-24 2019-01-11 深圳爱克莱特科技股份有限公司 A kind of lamp light control system data processing system based on stream media technology
CN112584341A (en) * 2019-09-30 2021-03-30 华为技术有限公司 Communication method and device
CN112584341B (en) * 2019-09-30 2022-12-27 华为云计算技术有限公司 Communication method and device
CN112073809A (en) * 2020-08-09 2020-12-11 富盛科技股份有限公司 Method for supporting browser to play video with any coding format

Similar Documents

Publication Publication Date Title
CN105472477B (en) A kind of data transmission method, device and equipment
CN101945096B (en) Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof
CN107211200B (en) Method and apparatus for transmitting/receiving media data
CN112752115B (en) Live broadcast data transmission method, device, equipment and medium
US8613013B2 (en) Ad splicing using re-quantization variants
US10015530B2 (en) Extracting data from advertisement files for ad insertion
CN107743252A (en) A kind of method for reducing live delay
CN103024491B (en) The video broadcasting method of mobile terminal and system
CN104320716A (en) A video uplink transmission method based on collaborative multiple terminals
CN104581385A (en) Multi-screen interactive self-adaptive playback method and system
CN105681817A (en) Intelligent terminal video and audio collection, transmission and playing system and method
CN113938470A (en) Method and device for playing RTSP data source by browser and streaming media server
CN104869474A (en) Expansible mobile streaming media system and application method thereof
CN105979284B (en) Mobile terminal video sharing method
CN101719990A (en) Method for censoring stream media live programs
CN103826084A (en) Audio encoding method
US20240080487A1 (en) Method, apparatus for processing media data, computer device and storage medium
CN103929682A (en) Method and device for setting key frames in video live broadcast system
CN103024450A (en) Method and system for achieving interactive television through near field communication (NFC) technology
CN103024441A (en) Method for playing television programs by mobile terminal
CN107071356A (en) A kind of multimedia optimization server and its video information processing method
CN104093089A (en) Cinema program live telecasting system and method
CN104333765B (en) A kind of processing method and processing unit of net cast stream
CN102710967A (en) Cloud television system and method
CN102740120A (en) Digital television live program broadcasting integrity judging method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150826

RJ01 Rejection of invention patent application after publication