CN105847957A - Method and device for live broadcast based on mobile terminal - Google Patents

Method and device for live broadcast based on mobile terminal Download PDF

Info

Publication number
CN105847957A
CN105847957A CN201610366002.1A CN201610366002A CN105847957A CN 105847957 A CN105847957 A CN 105847957A CN 201610366002 A CN201610366002 A CN 201610366002A CN 105847957 A CN105847957 A CN 105847957A
Authority
CN
China
Prior art keywords
video data
audio
video
coding
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610366002.1A
Other languages
Chinese (zh)
Inventor
张金良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TVMining Beijing Media Technology Co Ltd
Original Assignee
TVMining Beijing Media Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TVMining Beijing Media Technology Co Ltd filed Critical TVMining Beijing Media Technology Co Ltd
Priority to CN201610366002.1A priority Critical patent/CN105847957A/en
Publication of CN105847957A publication Critical patent/CN105847957A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6377Control signals issued by the client directed to the server or network components directed to server

Abstract

The invention discloses a method and a device for live broadcast based on a mobile terminal so as to be used for realizing a purpose of live broadcast through the mobile terminal. The method comprises the steps of receiving a live broadcast request from a user, calling an audio/video data collector on the mobile terminal, sending preset audio/video data collection parameters to the audio/video data collector so as to carry out audio/video data collection on a current scene by the audio/video data collector according to the audio/video data collection parameters, carrying out packaging processing on the collected audio/video data so as to acquire packaged audio/video data, uploading the packaged audio/video data to a server, and providing the packaged audio/video data to other mobile terminals by the server so as to realize live broadcast.

Description

A kind of on-the-spot broadcasting method and device based on mobile terminal
Technical field
The present invention relates to technical field of internet application, particularly to a kind of on-the-spot broadcasting based on mobile terminal Method and device.
Background technology
On-the-spot broadcasting refers at the scene along with generation, the development process of event make and broadcast radio and television simultaneously The broadcast mode of program, generally, people can be existing by the viewing of the terminal device such as television set or personal computer The program that field is live.
In order to realize above-mentioned on-the-spot broadcasting, in the related, mainly sound is realized by following three kinds of modes Video acquisition works: 1, connect video camera and the side of sound control equipment by network encoder in the wired context Formula;2, in the wireless context by the way of live broadcast vehicle connects video camera and sound control equipment;3, at wireless ring Under border directly by the way of video capture device.As can be seen here, needed for existing audio-video collection mode Equipment volume is big, it is impossible to realize carrying easily.
Along with the fast development of mobile terminal technology, mobile terminal application is more and more extensive, and function is the most increasingly Powerful and easy to carry, it is desirable to be broadcast live by mobile terminal, with satisfied variation Demand.
Summary of the invention
The present invention provides a kind of on-the-spot broadcasting method and device based on mobile terminal, in order to pass through mobile terminal Realize live purpose.
The present invention provides a kind of on-the-spot broadcasting method based on mobile terminal, including:
Receive the on-the-spot broadcasting from user to ask, call the audio, video data collector on mobile terminal;
Audio, video data acquisition parameter set in advance is sent to described audio, video data collector, with by institute State audio, video data collector, according to described audio, video data acquisition parameter, current live is carried out audio frequency and video number According to collection;
It is packaged the audio, video data collected processing, the audio, video data after being encapsulated;
Audio, video data after described encapsulation is uploaded onto the server, by described server by after described encapsulation Audio, video data is supplied to other mobile terminals to realize on-the-spot broadcasting.
In an embodiment of the present invention, described audio, video data acquisition parameter include audio data collecting parameter and Video data acquiring parameter;
Described audio data collecting parameter includes audio sample rate, audio sound number of channels and audio sample dot format In one or more;
Described video data acquiring parameter include recorded video width, highly, frame per second scope and pixel One or more in coded format.
In an embodiment of the present invention, the described audio, video data to collecting is packaged processing, including:
It is packaged the voice data in described audio, video data and video data respectively processing;
When being packaged the voice data in described audio, video data processing, call on described mobile terminal Audio data coding function, audio coding parameters set in advance is supplied to described audio data coding letter Number, is encoded described voice data by described audio data coding function, the audio frequency number after encapsulation coding According to;
When being packaged the video data in described audio, video data processing, call on described mobile terminal Video data encoding function, video coding parameter set in advance is supplied to described video data encoding letter Number, by described video data encoding function to described coding video data, the video counts after encapsulation coding According to.
In an embodiment of the present invention, the video that video data is on-fixed frame per second in described audio, video data Data, described by described video data encoding function to described coding video data, including:
The video data of described on-fixed frame per second is processed into the video data of fixing frame per second, by described video counts According to the coding function coding video data to described fixing frame per second.
In an embodiment of the present invention, the audio, video data after described encapsulation is write, by writing thread, the literary composition specified Part presss from both sides, and described is uploaded onto the server by audio, video data after described encapsulation, including:
By uploading file described in thread monitor, when monitoring the sound after said write thread completes described encapsulation During the write operation of video data, by transmission control protocol TCP by the audio, video data after described encapsulation Upload onto the server.
The present invention also provides for a kind of on-the-spot broadcasting device based on mobile terminal, including:
Calling module, asks for receiving the on-the-spot broadcasting from user, calls the audio frequency and video on mobile terminal Data acquisition unit;
Acquisition module, for sending audio, video data acquisition parameter set in advance to described audio, video data Collector, with by described audio, video data collector according to described audio, video data acquisition parameter to current live Carry out the collection of audio, video data;
Package module, for being packaged process, the sound after being encapsulated to the audio, video data collected Video data;
Upper transmission module, for uploading onto the server the audio, video data after described encapsulation, by described server Audio, video data after described encapsulation is supplied to other mobile terminals to realize on-the-spot broadcasting.
In an embodiment of the present invention, described audio, video data acquisition parameter include audio data collecting parameter and Video data acquiring parameter;
Described audio data collecting parameter includes audio sample rate, audio sound number of channels and audio sample dot format In one or more;
Described video data acquiring parameter include recorded video width, highly, frame per second scope and pixel One or more in coded format.
In an embodiment of the present invention, described package module is additionally operable to:
It is packaged the voice data in described audio, video data and video data respectively processing;
When being packaged the voice data in described audio, video data processing, call on described mobile terminal Audio data coding function, audio coding parameters set in advance is supplied to described audio data coding letter Number, is encoded described voice data by described audio data coding function, the audio frequency number after encapsulation coding According to;
When being packaged the video data in described audio, video data processing, call on described mobile terminal Video data encoding function, video coding parameter set in advance is supplied to described video data encoding letter Number, by described video data encoding function to described coding video data, the video counts after encapsulation coding According to.
In an embodiment of the present invention, the video that video data is on-fixed frame per second in described audio, video data Data, described package module is additionally operable to:
The video data of described on-fixed frame per second is processed into the video data of fixing frame per second, by described video counts According to the coding function coding video data to described fixing frame per second.
In an embodiment of the present invention, the audio, video data after described encapsulation is write, by writing thread, the literary composition specified Part presss from both sides, and described upper transmission module is additionally operable to:
By uploading file described in thread monitor, when monitoring the sound after said write thread completes described encapsulation During the write operation of video data, by transmission control protocol TCP by the audio, video data after described encapsulation Upload onto the server.
In embodiments of the present invention, receive the on-the-spot broadcasting from user and ask, call the sound on mobile terminal Video data acquiring device, sends audio, video data acquisition parameter set in advance to audio, video data collection Device, to be carried out audio frequency and video number according to audio, video data acquisition parameter to current live by audio, video data collector According to collection.Subsequently, being packaged the audio, video data collected processing, the sound after being encapsulated regards Frequency evidence, uploads onto the server the audio, video data after encapsulation, by server by the audio frequency and video number after encapsulation According to being supplied to other mobile terminals to realize on-the-spot broadcasting.As can be seen here, the embodiment of the present invention is by mobile whole End carries out the collection of audio, video data to current live, and can quickly upload the audio, video data of collection extremely Server, it is achieved live purpose.
Other features and advantages of the present invention will illustrate in the following description, and, partly from explanation Book becomes apparent, or understands by implementing the present invention.The purpose of the present invention and other advantages can Realize by structure specifically noted in the specification write, claims and accompanying drawing and obtain ?.
Below by drawings and Examples, technical scheme is described in further detail.
Accompanying drawing explanation
Accompanying drawing is for providing a further understanding of the present invention, and constitutes a part for specification, with this Bright embodiment is used for explaining the present invention together, is not intended that limitation of the present invention.In the accompanying drawings:
Fig. 1 is the flow chart of on-the-spot broadcasting method based on mobile terminal in one embodiment of the invention;And
Fig. 2 is the structural representation of on-the-spot broadcasting device based on mobile terminal in one embodiment of the invention.
Detailed description of the invention
Below in conjunction with accompanying drawing, the preferred embodiments of the present invention are illustrated, it will be appreciated that described herein Preferred embodiment is merely to illustrate and explains the present invention, is not intended to limit the present invention.
It is illustrated in figure 1 the flow chart of on-the-spot broadcasting method based on mobile terminal in one embodiment of the invention, The method comprises the following steps S11-S14.
Step S11, receives the on-the-spot broadcasting from user and asks, call the audio, video data on mobile terminal Collector.
In this step, mobile terminal can be the terminal devices such as smart mobile phone, intelligent glasses, panel computer. In an embodiment of the present invention, application can be developed on mobile terminals, such as live application etc., when user's point When hitting the shooting push button in live application, generate on-the-spot broadcasting request.Further, the sound on mobile terminal Video data acquiring device can be to be audio data collecting device and video data acquiring device respectively, and voice data is adopted The microphone etc. that storage can carry such as mobile terminal, video data acquiring device can carry such as mobile terminal Camera.For example, it is possible to the camera collection video data carried by mobile terminal, it is also possible to by moving The microphone that dynamic terminal carries gathers voice data.
Step S12, sends audio, video data acquisition parameter set in advance to audio, video data collector, Current live is carried out audio, video data by audio, video data collector according to audio, video data acquisition parameter Collection.
Step S13, is packaged the audio, video data collected processing, the audio frequency and video after being encapsulated Data.
Step S14, uploads onto the server the audio, video data after encapsulation, by server by the sound after encapsulation Video data is supplied to other mobile terminals to realize on-the-spot broadcasting.
In this step, the audio, video data after encapsulation is uploaded onto the server by mobile terminal, and this server can To be multimedia server, other mobile terminals can initiate the sound after obtaining encapsulation to this multimedia server The request of video data, after this multimedia server receives request, regards the sound after encapsulation according to this request Frequency is according to being supplied to other mobile terminals to realize on-the-spot broadcasting.
In embodiments of the present invention, receive the on-the-spot broadcasting from user and ask, call the sound on mobile terminal Video data acquiring device, sends audio, video data acquisition parameter set in advance to audio, video data collection Device, to be carried out audio frequency and video number according to audio, video data acquisition parameter to current live by audio, video data collector According to collection.Subsequently, being packaged the audio, video data collected processing, the sound after being encapsulated regards Frequency evidence, uploads onto the server the audio, video data after encapsulation, by server by the audio frequency and video number after encapsulation According to being supplied to other mobile terminals to realize on-the-spot broadcasting.As can be seen here, the embodiment of the present invention is by mobile whole End carries out the collection of audio, video data to current live, and can quickly upload the audio, video data of collection extremely Server, it is achieved live purpose.
In an embodiment of the present invention, the audio, video data acquisition parameter that above step S12 is mentioned, can wrap Include audio data collecting parameter and video data acquiring parameter.Further, audio data collecting parameter is permissible One or more including in audio sample rate, audio sound number of channels and audio sample dot format;Video data Acquisition parameter can include recorded video width, highly, in frame per second scope and pixel coded format One or more.
During actual acquisition, can be as follows with setting audio data acquisition parameters:
Audio sample rate, sample_rate=48000;
Audio sound number of channels, channel_num=1;
Audio sample dot format,
AUDIO_FORMAT=AudioFormat.ENCODING_PCM_16BIT.
Furthermore it is also possible to it is as follows to set video data acquiring parameter:
The width of recorded video, width=640;
The height of recorded video, height=480;
The frame per second scope of recorded video, framerate=[0,30], does not props up mobile terminal (such as mobile phone etc.) One fixing frame rate value is set when holding recording, a frame per second scope recorded can only be set;
Recorded video pixel coded format, yuv420p.
It should be noted that above-mentioned signal is only citing, the present invention is not limited to this.
In an embodiment of the present invention, above step S13 is packaged place to the audio, video data collected Reason, embodiments provides a kind of optional scheme, in this scenario, and can be respectively to audio frequency and video number Voice data and video data according to are packaged processing, specifically:
When being packaged the voice data in audio, video data processing, the sound on mobile terminal can be called Audio coding parameters set in advance, according to coding function, is supplied to audio data coding function, by sound by frequency Voice data is encoded by frequency according to coding function, the voice data after encapsulation coding.When actual coding, Audio data coding can become the audio stream of aac standard, and audio coding parameters can be arranged according to following:
Audio sample rate, sample_rate=48000;
Audio sound number of channels, channel_num=1;
Audio code rate, bitrate=24000 (24k).
When being packaged the video data in audio, video data processing, regarding on mobile terminal can be called Video coding parameter set in advance, according to coding function, is supplied to video data encoding function by frequency, by regarding Frequency to coding video data, encapsulates the video data after coding according to coding function.When actual coding, Video data encoding can become the video flowing of h264 standard, and video coding parameter can be arranged according to following:
Video width, width=640;
Video height, height=480;
Video code rate, (800k samples relatively low code check thus controls the data of video bitrate=800000 Measure less);
Video frame rate, framerate=25;
I frame period, key_I_frame_interval=50.
In an embodiment of the present invention, due to video that the video data in audio, video data is on-fixed frame per second Data, thus when by video data encoding function to coding video data, need on-fixed frame per second Video data be processed into the video data of fixing frame per second, video data encoding function fixing frame per second is regarded Frequency is according to encoding.Further, a kind of video counts by on-fixed frame per second is embodiments provided According to being processed into the video data of fixing frame per second, the video data of fixing frame per second is entered video data encoding function The alternative of row coding, the program comprises the steps A1-A3.
Step A1, carries out video according to video data acquiring parameter to current live at video data acquiring device During the collection of data, starting timer and start timing, video data acquiring device just often gathers one-frame video data Send video data encoding function to.
In this step, video data acquiring device can be the camera carried on mobile terminal, camera pair The video data recorded is numbered.When video data acquiring, record frame per second scope and be set to [0,30], The frame per second rule of actual camera recorded video is:
(1), when the picture light recorded is normal, picture has normal change, and the frame per second at this moment recorded is 30 Frame is per second;
(2), when the picture light recorded is very dark, and picture is not changed in substantially, the frame per second at this moment recorded It is that 13 frame left and right are per second.
Step A2, when timer arrives and specifies duration, it is judged that the video that video data encoding function receives Whether the totalframes of data is to fix the frame number that frame per second is corresponding, the most then continue executing with step A3.
In this step, it is intended that duration could be arranged to 1 second, the frame number that fixing frame per second is corresponding can be 25 Frame.It is to say, when monitoring timer and arriving 1 second, it is judged that what video data encoding function received regards Whether the totalframes of frequency evidence is 25 frames.
Step A3, by the coding video data of the video data encoding function totalframes to receiving, and Restart timing.
In this step, if the totalframes of the video data of video data encoding function reception is 25 frames, then By the coding video data of the video data encoding function totalframes (25 frame) to receiving, and again open Beginning timing, returns and performs step A1.
Further, when timer arrives and specifies duration, if judging what video data encoding function received The frame number that totalframes is corresponding more than fixing frame per second, then the video of the totalframes received from video data encoding function Data abandon the video data of the frame number corresponding beyond fixing frame per second, by video data encoding function to residue Coding video data, and restart timing.
It is exemplified as example, when monitoring timer and arriving 1 second, it is judged that video data encoding function with above-mentioned The totalframes of the video data received is more than 25 frames, it is assumed that is 28 frames, then connects from video data encoding function The video data of the totalframes (28 frame) received abandons the frame number (25 frame) corresponding beyond fixing frame per second Video data, i.e. abandons the video data beyond 3 frames, by video data encoding function to remaining video counts Encode according to (video datas of 25 frames), and restart timing, return and perform step A1.
Further, when timer arrives and specifies duration, if judging what video data encoding function received The frame number that totalframes is corresponding less than fixing frame per second, then arrive by timer in video data acquiring device when specifying duration The last one-frame video data transmitted constantly sends video data encoding function to, until video data The frame number that the totalframes that coding function receives is corresponding equal to fixing frame per second;When the reception of video data encoding function During the totalframes frame number corresponding equal to fixing frame per second, by regarding of the video data encoding function totalframes to receiving Frequency is according to encoding, and restarts timing.
It is exemplified as example, when monitoring timer and arriving 1 second, it is judged that video data encoding function with above-mentioned The totalframes of the video data received is less than 25 frames, it is assumed that be 23 frames, then regard when being arrived 1 second by timer Frequently the one-frame video data that data acquisition unit transmits for the last time constantly sends video data encoding function to, Until the totalframes that video data encoding function receives is equal to the frame number (25 frame) that fixing frame per second is corresponding;When regarding During the totalframes that frequency receives according to coding function frame number (25 frame) corresponding equal to fixing frame per second, by video counts According to the coding video data of the coding function totalframes to receiving, and restart timing, return and perform Step A1.
In an embodiment of the present invention, in order to improve the accuracy and efficiency of coding, at video data acquiring device During often collection one-frame video data is conveyed to video data encoding function, abandon the video of designated frame Data, this designated frame is the 6th frame.
In an embodiment of the present invention, above-mentioned coded system can use following algorithm to realize:
A, carries out counting numbering no to the video data recorded;
If (no%6==0)
Abandon this frame of video
Else
Send frame of video to encoder (that is, video data encoding function)
B, starts 1 second timer, records timer corresponding number of times respond_no, adds up to give coding The video frame number of device;
encoded_no
Respond_no*25 is the frame number that output video needs
If frame number error is missframe_no
Missframe_no=respond_no*25 encoded_no
if(missframe_no>0)
{ frame number that coding completes, less than the frame number being actually needed, at this moment needs to increase frame of video, it is simply that same One uncoded frame of video copies many parts to encoder }
else if(missframe_no<0)
{ frame number that coding completes, more than the frame number being actually needed, at this moment needs to reduce frame of video, namely to the greatest extent Amount abandons some frames more }
In an embodiment of the present invention, when the audio-visual data after coding is packaged, apply at present The video encapsulation form supported is TS, and this application is according to TS tunneling, uses C language to achieve right The TS wrapper that frame of video and audio frame are packaged.The TS wrapper using C language to realize has very Good professional platform independence, can transplant easily on the cell phone platform of main flow.
In an embodiment of the present invention, the audio, video data after encapsulation is write, by writing thread, the file specified Folder, the audio, video data after encapsulation is uploaded onto the server, embodiments provides one by step S14 Optional scheme, i.e. by uploading this file specified of thread monitor, completes envelope when monitoring write thread During the write operation of the audio, video data after dress, by TCP (Transmission Control Protocol, Transmission control protocol) audio, video data after encapsulation is uploaded onto the server.
It should be noted that in actual applications, above-mentioned all optional embodiments can use the side of combination Formula is combined, and forms the alternative embodiment of the present invention, and this is no longer going to repeat them.
Corresponding to the on-the-spot broadcasting method based on mobile terminal in above-described embodiment, the present invention also provides for one On-the-spot broadcasting device based on mobile terminal.It is illustrated in figure 2 in one embodiment of the invention based on mobile terminal On-the-spot broadcasting device structural representation, including:
Calling module 21, asks for receiving the on-the-spot broadcasting from user, and the sound called on mobile terminal regards Frequently data acquisition unit;
Acquisition module 22, for adopting audio, video data acquisition parameter set in advance transmission to audio, video data Storage, to be carried out audio frequency and video according to audio, video data acquisition parameter to current live by audio, video data collector The collection of data;
Package module 23, for being packaged process, after being encapsulated to the audio, video data collected Audio, video data;
Upper transmission module 24, for the audio, video data after encapsulation is uploaded onto the server, will encapsulation by server After audio, video data be supplied to other mobile terminals with realize on-the-spot broadcasting.
In an embodiment of the present invention, audio, video data acquisition parameter includes audio data collecting parameter and video Data acquisition parameters;
Audio data collecting parameter includes in audio sample rate, audio sound number of channels and audio sample dot format One or more;
Video data acquiring parameter include recorded video width, highly, frame per second scope and pixel coding One or more in form.
In an embodiment of the present invention, above-mentioned package module 23 is additionally operable to:
It is packaged the voice data in audio, video data and video data respectively processing;
When being packaged the voice data in audio, video data processing, call the audio frequency number on mobile terminal According to coding function, audio coding parameters set in advance is supplied to audio data coding function, by audio frequency number According to coding function, voice data is encoded, the voice data after encapsulation coding;
When being packaged the video data in audio, video data processing, call the video counts on mobile terminal According to coding function, video coding parameter set in advance is supplied to video data encoding function, by video counts According to coding function to coding video data, the video data after encapsulation coding.
In an embodiment of the present invention, the video data in audio, video data is the video counts of on-fixed frame per second According to, above-mentioned package module 21 is additionally operable to:
The video data of on-fixed frame per second is processed into the video data of fixing frame per second, by video data encoding letter Several coding video datas to fixing frame per second.
In an embodiment of the present invention, the audio, video data after encapsulation is write, by writing thread, the file specified Folder, upper transmission module 24 is additionally operable to:
By uploading thread monitor file, when monitoring writing of the audio, video data after write thread completes encapsulation When entering to operate, by transmission control protocol TCP, the audio, video data after encapsulation is uploaded onto the server.
The said apparatus of the embodiment of the present invention: receive the on-the-spot broadcasting from user and ask, call mobile terminal On audio, video data collector, by audio, video data acquisition parameter set in advance send to audio, video data Collector, regards current live being carried out sound by audio, video data collector according to audio, video data acquisition parameter The collection of frequency evidence.Subsequently, it is packaged the audio, video data collected processing, after being encapsulated Audio, video data, uploads onto the server the audio, video data after encapsulation, server is regarded by the sound after encapsulation Frequency is according to being supplied to other mobile terminals to realize on-the-spot broadcasting.As can be seen here, the embodiment of the present invention is by moving Dynamic terminal carries out the collection of audio, video data to current live, and can quickly upload the audio frequency and video number of collection According to server, it is achieved live purpose.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter Calculation machine program product.Therefore, the present invention can use complete hardware embodiment, complete software implementation or knot The form of the embodiment in terms of conjunction software and hardware.And, the present invention can use and wherein wrap one or more Computer-usable storage medium containing computer usable program code (include but not limited to magnetic disc store and Optical memory etc.) form of the upper computer program implemented.
The present invention is with reference to method, equipment (system) and computer program product according to embodiments of the present invention The flow chart of product and/or block diagram describe.It should be understood that can by computer program instructions flowchart and / or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/ Or the combination of square frame.These computer program instructions can be provided to all-purpose computer, special-purpose computer, embedding The processor of formula processor or other programmable data processing device is to produce a machine so that by calculating The instruction that the processor of machine or other programmable data processing device performs produces for realizing at flow chart one The device of the function specified in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or the process of other programmable datas can be guided to set In the standby computer-readable memory worked in a specific way so that be stored in this computer-readable memory Instruction produce and include the manufacture of command device, this command device realizes in one flow process or multiple of flow chart The function specified in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes Sequence of operations step must be performed to produce computer implemented place on computer or other programmable devices Reason, thus the instruction performed on computer or other programmable devices provides for realizing flow chart one The step of the function specified in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification without deviating from this to the present invention The spirit and scope of invention.So, if these amendments of the present invention and modification belong to the claims in the present invention And within the scope of equivalent technologies, then the present invention is also intended to comprise these change and modification.

Claims (10)

1. an on-the-spot broadcasting method based on mobile terminal, it is characterised in that including:
Receive the on-the-spot broadcasting from user to ask, call the audio, video data collector on mobile terminal;
Audio, video data acquisition parameter set in advance is sent to described audio, video data collector, with by institute State audio, video data collector, according to described audio, video data acquisition parameter, current live is carried out audio frequency and video number According to collection;
It is packaged the audio, video data collected processing, the audio, video data after being encapsulated;
Audio, video data after described encapsulation is uploaded onto the server, by described server by after described encapsulation Audio, video data is supplied to other mobile terminals to realize on-the-spot broadcasting.
Method the most according to claim 1, it is characterised in that
Described audio, video data acquisition parameter includes audio data collecting parameter and video data acquiring parameter;
Described audio data collecting parameter includes audio sample rate, audio sound number of channels and audio sample dot format In one or more;
Described video data acquiring parameter include recorded video width, highly, frame per second scope and pixel One or more in coded format.
Method the most according to claim 1 and 2, it is characterised in that the described sound to collecting Video data is packaged processing, including:
It is packaged the voice data in described audio, video data and video data respectively processing;
When being packaged the voice data in described audio, video data processing, call on described mobile terminal Audio data coding function, audio coding parameters set in advance is supplied to described audio data coding letter Number, is encoded described voice data by described audio data coding function, the audio frequency number after encapsulation coding According to;
When being packaged the video data in described audio, video data processing, call on described mobile terminal Video data encoding function, video coding parameter set in advance is supplied to described video data encoding letter Number, by described video data encoding function to described coding video data, the video counts after encapsulation coding According to.
Method the most according to claim 3, it is characterised in that the video in described audio, video data Data are the video data of on-fixed frame per second, described by described video data encoding function to described video data Encode, including:
The video data of described on-fixed frame per second is processed into the video data of fixing frame per second, by described video counts According to the coding function coding video data to described fixing frame per second.
Method the most according to claim 1, it is characterised in that the audio, video data after described encapsulation Being write, by write thread, the file specified, described being uploaded to by audio, video data after described encapsulation services Device, including:
By uploading file described in thread monitor, when monitoring the sound after said write thread completes described encapsulation During the write operation of video data, by transmission control protocol TCP by the audio, video data after described encapsulation Upload onto the server.
6. an on-the-spot broadcasting device based on mobile terminal, it is characterised in that including:
Calling module, asks for receiving the on-the-spot broadcasting from user, calls the audio frequency and video on mobile terminal Data acquisition unit;
Acquisition module, for sending audio, video data acquisition parameter set in advance to described audio, video data Collector, with by described audio, video data collector according to described audio, video data acquisition parameter to current live Carry out the collection of audio, video data;
Package module, for being packaged process, the sound after being encapsulated to the audio, video data collected Video data;
Upper transmission module, for uploading onto the server the audio, video data after described encapsulation, by described server Audio, video data after described encapsulation is supplied to other mobile terminals to realize on-the-spot broadcasting.
Device the most according to claim 6, it is characterised in that
Described audio, video data acquisition parameter includes audio data collecting parameter and video data acquiring parameter;
Described audio data collecting parameter includes audio sample rate, audio sound number of channels and audio sample dot format In one or more;
Described video data acquiring parameter include recorded video width, highly, frame per second scope and pixel One or more in coded format.
8. according to the device described in claim 6 or 7, it is characterised in that described package module is additionally operable to:
It is packaged the voice data in described audio, video data and video data respectively processing;
When being packaged the voice data in described audio, video data processing, call on described mobile terminal Audio data coding function, audio coding parameters set in advance is supplied to described audio data coding letter Number, is encoded described voice data by described audio data coding function, the audio frequency number after encapsulation coding According to;
When being packaged the video data in described audio, video data processing, call on described mobile terminal Video data encoding function, video coding parameter set in advance is supplied to described video data encoding letter Number, by described video data encoding function to described coding video data, the video counts after encapsulation coding According to.
Device the most according to claim 8, it is characterised in that the video in described audio, video data Data are the video data of on-fixed frame per second, and described package module is additionally operable to:
The video data of described on-fixed frame per second is processed into the video data of fixing frame per second, by described video counts According to the coding function coding video data to described fixing frame per second.
Device the most according to claim 6, it is characterised in that the audio, video data after described encapsulation Being write, by write thread, the file specified, described upper transmission module is additionally operable to:
By uploading file described in thread monitor, when monitoring the sound after said write thread completes described encapsulation During the write operation of video data, by transmission control protocol TCP by the audio, video data after described encapsulation Upload onto the server.
CN201610366002.1A 2016-05-27 2016-05-27 Method and device for live broadcast based on mobile terminal Pending CN105847957A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610366002.1A CN105847957A (en) 2016-05-27 2016-05-27 Method and device for live broadcast based on mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610366002.1A CN105847957A (en) 2016-05-27 2016-05-27 Method and device for live broadcast based on mobile terminal

Publications (1)

Publication Number Publication Date
CN105847957A true CN105847957A (en) 2016-08-10

Family

ID=56595002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610366002.1A Pending CN105847957A (en) 2016-05-27 2016-05-27 Method and device for live broadcast based on mobile terminal

Country Status (1)

Country Link
CN (1) CN105847957A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341412A (en) * 2016-09-28 2017-01-18 天脉聚源(北京)科技有限公司 Method and apparatus for processing audio and video data
CN108712654A (en) * 2018-05-18 2018-10-26 网宿科技股份有限公司 A kind of code-transferring method and equipment of audio/video flow
CN110324654A (en) * 2019-08-02 2019-10-11 广州虎牙科技有限公司 Main broadcaster end live video frame processing method, device, equipment, system and medium
CN111954004A (en) * 2020-08-21 2020-11-17 腾讯科技(深圳)有限公司 Data processing method, control equipment, remote user terminal and data processing system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101945096A (en) * 2010-07-13 2011-01-12 上海未来宽带技术及应用工程研究中心有限公司 Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof
CN102821308A (en) * 2012-06-04 2012-12-12 西安交通大学 Multi-scene streaming media courseware recording and direct-broadcasting method
CN104053014A (en) * 2013-03-13 2014-09-17 腾讯科技(北京)有限公司 Live broadcast system and method based on mobile terminal, and mobile terminal
CN105578207A (en) * 2015-12-18 2016-05-11 无锡天脉聚源传媒科技有限公司 Video frame rate conversion method and device
US20160373661A1 (en) * 2015-06-16 2016-12-22 Chengdu Ck Technology Co., Ltd. Camera system for generating images with movement trajectories

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101945096A (en) * 2010-07-13 2011-01-12 上海未来宽带技术及应用工程研究中心有限公司 Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof
CN102821308A (en) * 2012-06-04 2012-12-12 西安交通大学 Multi-scene streaming media courseware recording and direct-broadcasting method
CN104053014A (en) * 2013-03-13 2014-09-17 腾讯科技(北京)有限公司 Live broadcast system and method based on mobile terminal, and mobile terminal
US20160373661A1 (en) * 2015-06-16 2016-12-22 Chengdu Ck Technology Co., Ltd. Camera system for generating images with movement trajectories
CN105578207A (en) * 2015-12-18 2016-05-11 无锡天脉聚源传媒科技有限公司 Video frame rate conversion method and device

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341412A (en) * 2016-09-28 2017-01-18 天脉聚源(北京)科技有限公司 Method and apparatus for processing audio and video data
CN108712654A (en) * 2018-05-18 2018-10-26 网宿科技股份有限公司 A kind of code-transferring method and equipment of audio/video flow
WO2019218415A1 (en) * 2018-05-18 2019-11-21 网宿科技股份有限公司 Transcoding method and device for audio-video stream
CN108712654B (en) * 2018-05-18 2020-04-14 网宿科技股份有限公司 Audio and video stream transcoding method and device
CN110324654A (en) * 2019-08-02 2019-10-11 广州虎牙科技有限公司 Main broadcaster end live video frame processing method, device, equipment, system and medium
CN111954004A (en) * 2020-08-21 2020-11-17 腾讯科技(深圳)有限公司 Data processing method, control equipment, remote user terminal and data processing system

Similar Documents

Publication Publication Date Title
CN105959717A (en) Live broadcast method based on mobile terminal and live broadcast device
CN105991962B (en) Connection method, information display method, device and system
CN100493135C (en) Device and method for displaying image in mobile terminal
CN102263959B (en) Direct broadcast transfer method and system
CN105847957A (en) Method and device for live broadcast based on mobile terminal
US20090300685A1 (en) System, method, and device for transmitting video captured on a wireless device
TWI386062B (en) Method, apparatus and computer program product for processing media content
CN103297682A (en) Moving image shooting apparatus and method of using a camera device
EP1988547A1 (en) A method and system of implementing multimedia recording and media resource handling device
CN110784718B (en) Video data encoding method, apparatus, device and storage medium
CN104053014A (en) Live broadcast system and method based on mobile terminal, and mobile terminal
CN101945096A (en) Video live broadcast system facing to set-top box and PC of mobile phone and working method thereof
CN103391403A (en) Method and device for realizing multi-lens video shooting real-time editing
JP2018117259A (en) One-to-many audio video streaming method by audio video synchronous take in
CN108924631B (en) Video generation method based on audio and video shunt storage
CN109788224A (en) Video recording method, device, network shooting device and storage medium
CN112565224B (en) Video processing method and device
WO2018204117A1 (en) Web real-time communication from an audiovisual file
CN111526387A (en) Video processing method and device, electronic equipment and storage medium
CN101272383A (en) Real-time audio data transmission method
CN108668167B (en) Video restoration method and device
KR20140123753A (en) Method and apparatus for schduling video traffic in wireless communication system
US11017817B2 (en) Image processing apparatus, image processing method, camera apparatus, remote control apparatus, and camera system
EP2405649B1 (en) Method and terminal for synchronously recording sounds and images of opposite ends based on circuit domain video telephone
US8768140B2 (en) Data processing unit and data encoding device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160810

RJ01 Rejection of invention patent application after publication