CN104869474A - Expansible mobile streaming media system and application method thereof - Google Patents
Expansible mobile streaming media system and application method thereof Download PDFInfo
- Publication number
- CN104869474A CN104869474A CN201410061804.2A CN201410061804A CN104869474A CN 104869474 A CN104869474 A CN 104869474A CN 201410061804 A CN201410061804 A CN 201410061804A CN 104869474 A CN104869474 A CN 104869474A
- Authority
- CN
- China
- Prior art keywords
- streaming media
- audio
- video
- media server
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an expansible mobile streaming media system and an application method thereof. The system comprises a front-end collector, a streaming media server, a terminal player and an application server, wherein the front-end collector configures parameters according to instruction from the application server, processes collected audio and video according to the configured parameters, and transmits the processed audio and video to the streaming media server; the streaming media server receives audio and video streams from the front-end collector, processes the audio and video streams according to requirements, and transmits the processed audio and video streams to the terminal player; and the terminal player negotiates with the application server, obtains an optimal address of the streaming media server according the present network connection manner, and receives the audio and video streams from the corresponding streaming media server. The expansible mobile streaming media system and the application method thereof can be used to solve the problems that in the prior art, the compatibility of the player is low and that different qualities of streaming media cannot be provided for different network connection manners.
Description
Technical field
The present invention relates to mobile flow medium technology, particularly relate to a kind of extendible mobile stream media system and application process thereof.
Background technology
A complete stream media system comprises: front-end acquisition device, streaming media server, terminal player.Wherein, front-end acquisition device controls the equipment such as camera, microphone, gathers corresponding Audio and Video respectively, and carries out encoding (compression), encapsulating, and forms audio frequency and video, and is sent on the streaming media server on backstage according to stream protocol form; After streaming media server receives audio/video flow, carry out certain process according to demand, as transcoding, preservation etc., finally, the audio/video flow after process is distributed; Terminal player connects streaming media server, and obtain Streaming Media from streaming media server, be reduced to audio/video information after parsing, then decoded audio, video (decompress(ion)), finally play.
As above there is following shortcoming in prior art:
1, the player that current Android platform carries can support the Streaming Media of RTSP agreement, but the player RTSP of Android lowest version (less than 4.0) system supports poor, compatible bad, there will be various problems such as cannot playing, audio frequency and video are asynchronous, disconnect after broadcasting a period of time.
2, current smart mobile phone (Android, apple, Windows Phone etc.) carries out network when connecting, and can use WIFI mode, can use again 3G(and be about to the 4G that releases), the mode such as 2.5G, and different connected mode, network speed is different.If only provide a set of stream medium data, in order to meet the connected mode of low network speed, bandwidth, the video flowing of low bit-rate, low frame per second then can only be provided, so, the video that terminal player is play just there will be unintelligible, slack phenomenon, connecting for high speed is then a kind of waste, because they can support the video flowing transmitting high code check, high frame per second, high definition.
Summary of the invention
The object of the present invention is to provide a kind of extendible mobile stream media system and application process thereof, for solving player poor compatibility in prior art and the problem of the Streaming Media of different quality cannot being provided for different internetwork connection modes.
To achieve these goals, the invention provides a kind of extendible mobile stream media system, it is characterized in that, comprising: front-end acquisition device, streaming media server, terminal player, application server;
Described front-end acquisition device, for the instruction configuration parameter issued according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to described streaming media server;
Described streaming media server, for receiving described audio/video flow from described front-end acquisition device, is distributed to described terminal player after processing to described audio/video flow according to demand;
Described terminal player, for holding consultation with described application server, according to current internetwork connection mode, obtaining optimum streaming media server address, and receiving described audio/video flow from corresponding streaming media server.
Described extendible mobile stream media system, wherein, described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
Described extendible mobile stream media system, wherein, described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
Described extendible mobile stream media system, wherein, audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
Described extendible mobile stream media system, wherein, described terminal player is when play quality is bad, contact described application server, obtain the streaming media server compared with low bit-rate, or when play quality is good, contact described application server, obtain the streaming media server of high code rate.
To achieve these goals, the invention provides a kind of application process of extendible mobile stream media system, it is characterized in that, comprising:
Step one, the instruction configuration parameter that front-end acquisition device issues according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server;
Step 2, described streaming media server receives described audio/video flow from described front-end acquisition device, is distributed to terminal player after processing to described audio/video flow according to demand;
Step 3, described terminal player and described application server are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive described audio/video flow from corresponding streaming media server.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
The application process of described extendible mobile stream media system, wherein, in described step one, comprising:
Audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
The application process of described extendible mobile stream media system, wherein, in described step 3, comprising:
Described terminal player, when play quality is bad, contacts described application server, obtains the streaming media server compared with low bit-rate, or when play quality is good, contacts described application server, obtains the streaming media server of high code rate.
Compared with prior art, the present invention proposes a set of stream media system being suitable for intelligent terminal and playing, and the flow host-host protocol used, stream encapsulation standard, concrete Advantageous Effects is:
1, solve Streaming Media load time length, postpone more problem;
2, improve the quality of Streaming Media, as definition, fluency, audio-visual synchronization etc.;
3, support all intelligent terminals, and can connect for different networks the stream that different quality is provided.
Accompanying drawing explanation
Fig. 1 is the extendible mobile stream media system structure chart of the present invention;
Fig. 2 is the application process flow chart of the extendible mobile stream media system of the present invention.
Embodiment
Describe the present invention below in conjunction with the drawings and specific embodiments, but not as a limitation of the invention.
As shown in Figure 1, be the extendible mobile stream media system structure chart of the present invention.This mobile stream media system 100 comprises: front-end acquisition device 10, streaming media server 20, terminal player 30, application server 40.
Front-end acquisition device 10, first and application server 40 is consulted, and according to the instruction that application server 40 issues, flexible configuration parameter, as the coding parameter of audio frequency and video, frame per second, code check, streaming media server address etc., then camera is controlled, the equipment such as microphone, gather corresponding Audio and Video respectively, and carry out encode (compression) according to configuration parameter, be packaged into FLV form, and according to the stream protocol form configured, be sent on the multiple stage streaming media server 20 of configuration, as low frame per second (<10fps[10 frame is per second]), the stream of low bit-rate (<100kbps[100K bits per second]) delivers to streaming media server A, the stream of high frame per second (>20fps), high code check (>400kbps) delivers to streaming media server B, etc.
Streaming media server 20, after receiving the audio/video flow that front-end acquisition device 10 sends, carries out certain process according to demand, as preserved, finally, is distributed by the stream after process;
Terminal player 30, first hold consultation with application server 40, according to current internetwork connection mode, obtain optimum streaming media server address, then from corresponding streaming media server receiver, video stream, the terminal player connected for WIFI mode as network obtains from streaming media server A; The terminal player that network connects for 2.5G then obtains from streaming media server B, etc.In order to solve Android platform RTSP compatibility issue, need to realize normal stream agreement (as RTSP, RTMP etc.), FLV format analysis, audio/video decoding, audio and video playing/control etc., and in order to support all smart mobile phone models, can not be optimized by assembler language, comprise the instruction etc. that can not use floating-point coprocessor, and the compile option of standard must be used to carry out cross compile, generate the instruction set of ARM V5, can run on all smart mobile phones.
Application server 40 mainly provides applied logic to control and configuration management function, and holds consultation with front-end acquisition device 10, terminal player 30.Operation personnel can be visited by browser and application server 40 manages.
In order to reduce Streaming Media load time length, postpone more problem, need to carry out following optimization respectively to front-end acquisition device 10, streaming media server 20, terminal player 30 3 parts:
(1) front-end acquisition device 10, reduces initialization duration, and optimizes audio/video coding process, uses the codec of fast coding as far as possible.
(2) streaming media server 20, does not do long buffering, accelerates distribution speed; Do not do transcoding process, reduce the workload of recompile of decoding again, just decrease delay yet.
(3) terminal player 30, since it is known front-end acquisition device 10 uses codec to encode, so just can the size of cutting decoding code in terminal player 30, and delete useless judgement branch, so both can reduce the size of application program installation kit, from before about 1M reduced to 400K, decrease 60%, can the speed of service be accelerated again, reduce the delay of decoding and bringing; In addition, terminal player 30 is only resolved for concrete real time flow medium, therefore can also optimize the discriminatory analysis process of stream format, makes it identify the time shorten of stream media format, accelerates the load time.Owing to being real-time live broadcast, the present invention can also remove buffering, plays the audio, video data received in real time, thus reduces delay.
In order to improve the quality of Streaming Media, as definition, fluency, audio-visual synchronization etc., when front-end acquisition device 10 is encoded, at least use per second 3 key frames, because Streaming Media allows to lose some data in transmitting procedure, if the underfrequency of key frame, the interval also namely between key frame is long, then cannot reduce complete video image, cause the mosaic effect of subregion.Only have by the time next key frame time, complete video image could be restored according to key frame information; And controlled by terminal player 30, ensure the synchronism of audio frequency and video, if find to occur a large amount of frame losings or audio frequency and video asynchronous (illustrating that audio, video data is made mistakes, may is that network is bad) in certain period, then terminal player 30 initiatively contact application server 40, obtain the streaming media server compared with low bit-rate, reconnect; And play quality good time, terminal player 30 also can contact application server 40, attempts obtaining the streaming media server of high code rate (also i.e. higher video quality), when network allows, promotes the sensory effects of user as much as possible.
Like this, just can dynamic conditioning, streaming media playing quality in self adaptation heterogeneous networks situation.
As shown in Figure 2, be the application process flow chart of the extendible mobile stream media system of the present invention.Composition graphs 1, be described the application process of extendible mobile stream media system, the method comprises the steps:
Step 201, the instruction configuration parameter that front-end acquisition device 10 issues according to application server 40, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server 20;
Particularly, front-end acquisition device 10, first and application service 40 is consulted, and according to the instruction that application server 40 issues, flexible configuration parameter, as the coding parameter of audio frequency and video, frame per second, code check, streaming media server address etc., then camera is controlled, the equipment such as microphone, gather corresponding Audio and Video respectively, and carry out encode (compression) according to configuration parameter, be packaged into FLV form, and according to the stream protocol form configured, be sent on the multiple stage streaming media server 20 of configuration, as low frame per second (<10fps[10 frame is per second]), the stream of low bit-rate (<100kbps[100K bits per second]) delivers to streaming media server A, the stream of high frame per second (>20fps), high code check (>400kbps) delivers to streaming media server B, etc..
Step 202, streaming media server 20 receives audio/video flow from front-end acquisition device 10, is distributed to terminal player 30 after processing to audio/video flow according to demand;
Particularly, streaming media server 20 carries out certain process according to demand after receiving the audio/video flow that front-end acquisition device 10 sends, and as preserved, finally, is distributed by the stream after process;
Step 203, terminal player 30 and application server 40 are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive audio/video flow from corresponding streaming media server.
Particularly, terminal player 30 is first held consultation with application server 40, according to current internetwork connection mode, obtains optimum streaming media server address, then from corresponding streaming media server receiver, video stream, the terminal player as WIFI connected mode obtains from streaming media server A; The terminal player of 2.5G then obtains from streaming media server B, etc.
Flexible configuration of the present invention, when do not affect gather front-end and back-end result of broadcast, can according to the network bandwidth of the scale of business, different time sections, user number etc. carry out dynamic conditioning.
The present invention is directed to the smart mobile phone of current increasingly extensive use, be positioned the player on intelligent mobile phone platform, support all intelligent mobile phone systems; The Streaming Media load time is fast, delay is few; The quality of Streaming Media is high, and picture is clear, smooth.
The present invention has been applied to the interactive channel functions in mobile video broadcasting, and main broadcaster can use front-end acquisition device, and its audio frequency and video are passed to streaming media server, and user can use mobile phone to connect streaming media server, the audio frequency and video of direct viewing main broadcaster.Practice confirms, no matter is WIFI, or 2.5G, 3G etc., and play quality is all satisfied, and delay, load time etc. be all at least like product 1/3rd or shorter.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection range that all should belong to the claim appended by the present invention.
Claims (10)
1. an extendible mobile stream media system, is characterized in that, comprising: front-end acquisition device, streaming media server, terminal player, application server;
Described front-end acquisition device, for the instruction configuration parameter issued according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to described streaming media server;
Described streaming media server, for receiving described audio/video flow from described front-end acquisition device, is distributed to described terminal player after processing to described audio/video flow according to demand;
Described terminal player, for holding consultation with described application server, according to current internetwork connection mode, obtaining optimum streaming media server address, and receiving described audio/video flow from corresponding streaming media server.
2. extendible mobile stream media system according to claim 1, is characterized in that, described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
3. extendible mobile stream media system according to claim 1, is characterized in that, described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
4. the extendible mobile stream media system according to claim 1,2 or 3, is characterized in that, audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
5. the extendible mobile stream media system according to claim 1,2 or 3, it is characterized in that, described terminal player is when play quality is bad, contact described application server, obtain the streaming media server compared with low bit-rate, or when play quality is good, contact described application server, obtain the streaming media server of high code rate.
6. an application process for extendible mobile stream media system, is characterized in that, comprising:
Step one, the instruction configuration parameter that front-end acquisition device issues according to described application server, processes the audio frequency and video gathered according to configuration parameter, and the audio/video flow obtained after process is sent to streaming media server;
Step 2, described streaming media server receives described audio/video flow from described front-end acquisition device, is distributed to terminal player after processing to described audio/video flow according to demand;
Step 3, described terminal player and described application server are held consultation, and according to current internetwork connection mode, obtain optimum streaming media server address, and receive described audio/video flow from corresponding streaming media server.
7. the application process of extendible mobile stream media system according to claim 6, is characterized in that, in described step one, comprising:
Described front-end acquisition device adopts fast coding mode to process to audio frequency and video, and adds key frame when processing.
8. the application process of extendible mobile stream media system according to claim 6, is characterized in that, in described step one, comprising:
Described front-end acquisition device adopts FLV form to encapsulate according to configuration parameter to audio frequency and video.
9. the application process of the extendible mobile stream media system according to claim 6,7 or 8, is characterized in that, in described step one, comprising:
Audio/video flow is sent to different streaming media servers according to the height difference of frame per second, code check by described front-end acquisition device.
10. the application process of the extendible mobile stream media system according to claim 6,7 or 8, is characterized in that, in described step 3, comprising:
Described terminal player, when play quality is bad, contacts described application server, obtains the streaming media server compared with low bit-rate, or when play quality is good, contacts described application server, obtains the streaming media server of high code rate.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410061804.2A CN104869474A (en) | 2014-02-24 | 2014-02-24 | Expansible mobile streaming media system and application method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410061804.2A CN104869474A (en) | 2014-02-24 | 2014-02-24 | Expansible mobile streaming media system and application method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104869474A true CN104869474A (en) | 2015-08-26 |
Family
ID=53914909
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410061804.2A Pending CN104869474A (en) | 2014-02-24 | 2014-02-24 | Expansible mobile streaming media system and application method thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104869474A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109195024A (en) * | 2018-08-24 | 2019-01-11 | 深圳爱克莱特科技股份有限公司 | A kind of lamp light control system data processing system based on stream media technology |
CN112073809A (en) * | 2020-08-09 | 2020-12-11 | 富盛科技股份有限公司 | Method for supporting browser to play video with any coding format |
CN112584341A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Communication method and device |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101695129A (en) * | 2009-10-09 | 2010-04-14 | 中兴通讯股份有限公司 | Method and system for realizing video monitoring by mobile terminal supporting multimodes |
CN101835029A (en) * | 2010-04-21 | 2010-09-15 | 深圳市紫云鑫软件技术有限公司 | Control method, system and client for playing streaming media |
CN101997891A (en) * | 2009-08-28 | 2011-03-30 | 华为技术有限公司 | Method, device and system for allocating P2P media stream |
CN102098513A (en) * | 2010-12-20 | 2011-06-15 | 北京交通大学 | Real-time transmission method of wireless video |
CN102281213A (en) * | 2011-08-31 | 2011-12-14 | 王胄 | Instant messaging method and system for supporting voice and video message |
CN102368819A (en) * | 2011-10-24 | 2012-03-07 | 南京大学 | System for collection, transmission, monitoring and publishment of mobile video |
CN102413145A (en) * | 2011-10-29 | 2012-04-11 | 华为技术有限公司 | Media content access method, service server and mobile terminal |
CN103179438A (en) * | 2011-12-20 | 2013-06-26 | 中国移动通信集团上海有限公司 | Method and device for determining of video playing first access code rate |
CN103248962A (en) * | 2013-04-23 | 2013-08-14 | 华为技术有限公司 | Method, equipment and system for obtaining streaming media data |
-
2014
- 2014-02-24 CN CN201410061804.2A patent/CN104869474A/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101997891A (en) * | 2009-08-28 | 2011-03-30 | 华为技术有限公司 | Method, device and system for allocating P2P media stream |
CN101695129A (en) * | 2009-10-09 | 2010-04-14 | 中兴通讯股份有限公司 | Method and system for realizing video monitoring by mobile terminal supporting multimodes |
CN101835029A (en) * | 2010-04-21 | 2010-09-15 | 深圳市紫云鑫软件技术有限公司 | Control method, system and client for playing streaming media |
CN102098513A (en) * | 2010-12-20 | 2011-06-15 | 北京交通大学 | Real-time transmission method of wireless video |
CN102281213A (en) * | 2011-08-31 | 2011-12-14 | 王胄 | Instant messaging method and system for supporting voice and video message |
CN102368819A (en) * | 2011-10-24 | 2012-03-07 | 南京大学 | System for collection, transmission, monitoring and publishment of mobile video |
CN102413145A (en) * | 2011-10-29 | 2012-04-11 | 华为技术有限公司 | Media content access method, service server and mobile terminal |
CN103179438A (en) * | 2011-12-20 | 2013-06-26 | 中国移动通信集团上海有限公司 | Method and device for determining of video playing first access code rate |
CN103248962A (en) * | 2013-04-23 | 2013-08-14 | 华为技术有限公司 | Method, equipment and system for obtaining streaming media data |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109195024A (en) * | 2018-08-24 | 2019-01-11 | 深圳爱克莱特科技股份有限公司 | A kind of lamp light control system data processing system based on stream media technology |
CN112584341A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Communication method and device |
CN112584341B (en) * | 2019-09-30 | 2022-12-27 | 华为云计算技术有限公司 | Communication method and device |
CN112073809A (en) * | 2020-08-09 | 2020-12-11 | 富盛科技股份有限公司 | Method for supporting browser to play video with any coding format |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105472477B (en) | A kind of data transmission method, device and equipment | |
CN101945096B (en) | Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof | |
CN107211200B (en) | Method and apparatus for transmitting/receiving media data | |
CN112752115B (en) | Live broadcast data transmission method, device, equipment and medium | |
US8613013B2 (en) | Ad splicing using re-quantization variants | |
US10015530B2 (en) | Extracting data from advertisement files for ad insertion | |
CN107743252A (en) | A kind of method for reducing live delay | |
CN103024491B (en) | The video broadcasting method of mobile terminal and system | |
CN104320716A (en) | A video uplink transmission method based on collaborative multiple terminals | |
CN104581385A (en) | Multi-screen interactive self-adaptive playback method and system | |
CN105681817A (en) | Intelligent terminal video and audio collection, transmission and playing system and method | |
CN113938470A (en) | Method and device for playing RTSP data source by browser and streaming media server | |
CN104869474A (en) | Expansible mobile streaming media system and application method thereof | |
CN105979284B (en) | Mobile terminal video sharing method | |
CN101719990A (en) | Method for censoring stream media live programs | |
CN103826084A (en) | Audio encoding method | |
US20240080487A1 (en) | Method, apparatus for processing media data, computer device and storage medium | |
CN103929682A (en) | Method and device for setting key frames in video live broadcast system | |
CN103024450A (en) | Method and system for achieving interactive television through near field communication (NFC) technology | |
CN103024441A (en) | Method for playing television programs by mobile terminal | |
CN107071356A (en) | A kind of multimedia optimization server and its video information processing method | |
CN104093089A (en) | Cinema program live telecasting system and method | |
CN104333765B (en) | A kind of processing method and processing unit of net cast stream | |
CN102710967A (en) | Cloud television system and method | |
CN102740120A (en) | Digital television live program broadcasting integrity judging method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
EXSB | Decision made by sipo to initiate substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150826 |
|
RJ01 | Rejection of invention patent application after publication |