CN109089131A - A kind of record screen live broadcasting method, device, equipment and storage medium based on IOS system - Google Patents
A kind of record screen live broadcasting method, device, equipment and storage medium based on IOS system Download PDFInfo
- Publication number
- CN109089131A CN109089131A CN201811105770.7A CN201811105770A CN109089131A CN 109089131 A CN109089131 A CN 109089131A CN 201811105770 A CN201811105770 A CN 201811105770A CN 109089131 A CN109089131 A CN 109089131A
- Authority
- CN
- China
- Prior art keywords
- buffer area
- frame
- picture frame
- server
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
Abstract
The application provides a kind of record screen live broadcasting method, device, equipment and storage medium based on IOS system.The method includes the steps: during the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area, and each frame picture frame in the buffer area is sent to server-side；If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to send the parts of images frame in buffer area to server-side, so that the quantity for the picture frame that server-side was received in the unit time meets preset condition.It aims to solve the problem that in the prior art, when main broadcaster's client carries out record screen live streaming using the terminal device based on IOS system, the high technical problem of Caton probability occurs in corresponding spectator client.
Description
Technical field
This application involves Internet technology, in particular to a kind of record screen live broadcasting method, device, equipment based on IOS system
And storage medium.
Background technique
Record screen live streaming is one of current live streaming common mode of industry, and record screen live streaming is main broadcaster's client by recording screen
The live video stream is sent to server-side to make live video stream by the content of upper display, so that server-side is distributed to
The process that corresponding spectator client plays.
But find in practical applications, main broadcaster's client carries out record screen live streaming using the terminal device based on IOS system
When, the probability that Caton occurs in corresponding spectator client can be higher, and the sometimes corresponding all spectators of main broadcaster's client
There is Caton phenomenon simultaneously in client.And IOS system is the Mobile operating system developed by Apple Inc., is the behaviour of current mainstream
Make one of system, how to solve the above-mentioned IOS system that is based on and carry out the technical issues of occurring when record screen live streaming, be that industry is broadcast live at present
The problem that technical staff does not capture always.
Summary of the invention
In view of this, the application provides a kind of record screen live broadcasting method, device, equipment and storage medium based on IOS system,
It aims to solve the problem that in the prior art, when main broadcaster's client carries out record screen live streaming using the terminal device based on IOS system, corresponding sight
There is the high technical problem of Caton probability in many clients.
Specifically, the application is achieved by the following technical solution:
The application's in a first aspect, providing a kind of record screen live broadcasting method based on IOS system, the method includes steps
It is rapid:
During the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area, and send described delay to server-side
Deposit each frame picture frame in area；
If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to send to server-side slow
The parts of images frame in area is deposited, so that the quantity for the picture frame that server-side was received in the unit time meets preset condition.
In some instances, it includes: the buffer area that the repetition, which sends the parts of images frame in buffer area to server-side,
The frame picture frame of middle acquisition time the latest.
In some instances, each frame picture frame sent to server-side in the buffer area, comprising:
Sequencing and preset temporal frequency by the picture frame in buffer area according to acquisition time, are sent to one by one
Server-side.
In some instances, the method also includes steps: sending the frame figure in the buffer area to server-side every time
As judging the quantity of picture frame in the buffer area after frame, if quantity is greater than 1, discharges in buffer area and have been issued to server-side
Picture frame.
In some instances, if the quantity of the picture frame obtained in the buffer area unit time is less than preset value,
It repeats to send the parts of images frame in buffer area to server-side, comprising:
If the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, described in reservation
Picture frame；
After reaching preset time, described image frame is sent to server-side again.
In the second aspect of the application, a kind of record screen live broadcasting method based on IOS system is provided, the method includes steps
It is rapid:
The picture frame that the record screen that main broadcaster's client is sent obtains is received, and described image frame is stored to buffer area；
If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to the main broadcaster client
Corresponding live streaming client is held to send the parts of images frame in the buffer area, so that each corresponding live streaming client is in unit
Between the quantity of picture frame that receives meet preset condition.
In some instances, if the quantity of the picture frame obtained in the buffer area unit time is less than preset value,
It repeats to send the parts of images frame in the buffer area to the corresponding live streaming client of main broadcaster's client, comprising:
If the quantity of the picture frame in the buffer area is greater than 1, it is corresponding that main broadcaster's client is sent in described image frame
Live streaming client after, discharge described image frame；
If the quantity of the picture frame in the buffer area is 1, it is corresponding that main broadcaster's client is sent in described image frame
After client is broadcast live, retain described image frame, and after reaching preset time, described image frame is sent to main broadcaster client again
Hold corresponding live streaming client.
In the third aspect of the application, a kind of record screen live broadcast device based on IOS system is provided, described device includes:
The picture frame that record screen obtains is stored in buffer area during the record screen of live streaming by cache module；
Processing module, for each frame picture frame in the buffer area to be sent to server-side, if the buffer area unit
The quantity of the picture frame obtained in time is less than preset value, repeats to send the parts of images frame in buffer area to server-side, so that
Server-side meets preset condition in the quantity for the picture frame that the unit time receives.
In some instances, the processing module is also used to: sending the frame figure in the buffer area to server-side every time
As judging the quantity of picture frame in the buffer area after frame, if quantity is greater than 1, discharges in buffer area and have been issued to server-side
Picture frame.
In some instances, if the quantity of the picture frame obtained in the buffer area unit time is less than preset value,
When repeating to send the parts of images frame in buffer area to server-side, the processing module is specifically used for:
If the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, described in reservation
Picture frame；
After reaching preset time, described image frame is sent to server-side again.
In the fourth aspect of the application, a kind of terminal device is provided, comprising:
Processor；For storing the memory of the processor-executable instruction；
Wherein, the processor is configured to executing the operation as described in aforementioned first aspect as described in any one method.
At the 5th aspect of the application, a kind of storage medium is provided, program is stored thereon with, which is executed by processor
The operation of any one method as described in aforementioned first aspect.
The application is for the record screen live streaming based on IOS system, and during record screen live streaming, the picture frame that record screen is obtained is first
It is stored in buffer area, and sends each frame picture frame in the buffer area to server-side；Detecting the buffer area unit
When the quantity of the picture frame obtained in time is less than preset value, the parts of images in buffer area is sent to server-side by repeating
The quantity of frame, the picture frame for receiving server-side in the unit time meets preset condition, to solve in traditional technology, Zhu Boke
When family end carries out record screen live streaming using the terminal device based on IOS system, it is high that Caton probability occurs in corresponding spectator client
Technical problem.And it is straight to be particularly suitable for solving the terminal device record screen based on IOS system for the method that the embodiment of the present application proposes
Sowing time, because screen-picture is static so that IOS system refresh frequency reduces, and the picture frame for causing record to shield actual acquisition reduces and meets with
There is the problem of Caton in the spectator client caused by.
Detailed description of the invention
Fig. 1 is a kind of schematic diagram of record screen live streaming；
Fig. 2 is a kind of flow chart for record screen live broadcasting method based on IOS system that the embodiment of the present application illustrates；
Fig. 3 is the flow chart for another record screen live broadcasting method based on IOS system that the embodiment of the present application illustrates；
Fig. 4 is a kind of schematic diagram for record screen live streaming that the embodiment of the present application illustrates；
Fig. 5 be the record screen live broadcasting method based on IOS system that illustrates of the embodiment of the present application apply with based on IOS
An interaction diagrams on the connected terminal device of the terminal device of system；
Fig. 6 is that the record screen live broadcasting method based on IOS system that the embodiment of the present application illustrates is used in server-side
Flow chart；
Fig. 7 is that a kind of structure of record screen live broadcast device based on IOS system shown in one exemplary embodiment of the application is shown
It is intended to；
Fig. 8 is a kind of hardware structural diagram of terminal device shown in one exemplary embodiment of the application.
Specific embodiment
The application is described in detail below with reference to specific embodiment shown in the drawings.But these embodiments are simultaneously
The application is not limited, structure that those skilled in the art are made according to these embodiments, method or functionally
Transformation is all contained in the protection scope of the application.
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application.
It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority
Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps
It may be combined containing one or more associated any or all of project listed.
Record screen live streaming is one of current live streaming common mode of industry, is particularly suitable for the live streaming shape such as game, software teaching
Formula.It referring to Fig.1, is the schematic diagram of a scenario of record screen live streaming, the first spectator client, the second spectator client and main broadcaster's client point
It is not installed on electronic equipment 110,120 and 130, main broadcaster's client can call camera shooting by screen capture, and cooperation
The other modes such as head recorded video, shooting photo make live data, and live data includes a frame frame picture frame and audio data,
Then the live data of production is sent to by server-side 100 by network.Server-side 100 is used to provide the background service of live streaming,
Such as the corresponding relationship of each main broadcaster's client and spectator client is saved, it is broadcast live the distribution etc. of data, as the first spectators visitor
In same direct broadcasting room, main broadcaster's client can will be thought by server-side for family end, the second spectator client and main broadcaster's client
The live data to be shown is shared in the first spectator client of same direct broadcasting room and the broadcasting of the second spectator client, for the
The user of one spectator client and the second spectator client viewing.In this application with main broadcaster's client same direct broadcasting room visitor
Family end is referred to as the corresponding client of main broadcaster's client.
But find in practical applications, main broadcaster's client carries out record screen live streaming using the terminal device based on IOS system
When, the probability that Caton occurs in corresponding spectator client can be higher, and the sometimes corresponding all spectators of main broadcaster's client
There is Caton phenomenon simultaneously in client.And IOS system is the Mobile operating system developed by Apple Inc., is the behaviour of current mainstream
Make one of system, how to solve the above-mentioned IOS system that is based on and carry out the technical issues of occurring when record screen live streaming, be that industry is broadcast live at present
The problem that technical staff does not capture always.
Applicant through a large number of experiments and the study found that causes main broadcaster's client to set using the terminal based on IOS system
When for carrying out record screen live streaming, it is caused by following reason that the high problem of Caton probability, which occurs, in corresponding spectator client: IOS system
In order to save the power consumption of equipment, there are a power consumption protection mechanism, power consumption protection mechanism regulation: (do not examine screen-picture is static
Measure the variation of pixel) in the state of, screen refresh rate is reduced, power consumption is reduced with this.Due to the above-mentioned power consumption of IOS system
Protection mechanism, and by way of record screen to capture picture frame related to screen refresh rate, so that being based on IOS system carries out record screen
When live streaming, if place terminal device screen-picture remains static, main broadcaster's client will be unable to capture the figure of regulation frame per second
As frame, such as defined frame per second is 24 frames/second, and the picture frame of the possible 1s actual acquisition of main broadcaster's client can work as main broadcaster less than 24
When client does not capture the picture frame of regulation frame per second, it will appear via the video flowing that server-side is sent to spectator client broadcasting
Visual Caton.
In view of the above technical problems and there is the analysis of the reason of technical problem, the application proposes a kind of based on IOS system
The record screen live streaming scheme of system.Referring to Fig. 2, a kind of record screen live streaming based on IOS system illustrated for the embodiment of the present application
The flow chart of method, method described in the embodiment of the present application can be used on the terminal device based on IOS system, the terminal
Equipment can be smart phone, tablet computer, PDA (PersonalDigital Assistant, personal digital assistant) etc..Eventually
Application program can be installed in end equipment, record screen live streaming may be implemented by the application program, the application program may is that
Software is broadcast live in internet, in some examples, when internet live streaming software carries out record screen live streaming, can be referred to as main broadcaster's client.
The part steps of the record screen live broadcasting method based on IOS system are as follows:
S210: during the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area.
The picture frame that the record screen obtains refers to that perhaps full content is obtained by way of record screen in a portion.
A kind of common situation is: the image of image and camera acquisition that the picture frame that record screen obtains is obtained by the mode of record screen is to draw
The form of middle picture synthesizes, and certainly may be other forms, does not repeat one by one herein.
The picture frame of the form storage caching of queue can be used in the buffer area that the embodiment of the present application proposes.In some examples
In, which may include at least one queue, and in some examples, some buffer areas may include multiple queues.
S220: each frame picture frame in the buffer area is sent to server-side.
In some instances, specifically may is that the picture frame in buffer area according to the sequencing of acquisition time and
Preset temporal frequency, is sent to server-side one by one.In some instances, the preset temporal frequency may is that 40 milliseconds,
Certain temporal frequency can also be determined according to the frame per second of live data.In some examples, step S210 and S220 be may is that
During the record screen of live streaming, after often obtaining a frame picture frame by record screen, which is stored in buffer area, and according to default
The picture frame is sent to server-side by temporal frequency.
S230: it if the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeats to server-side
The parts of images frame in buffer area is sent, so that the quantity for the picture frame that server-side was received in the unit time meets default item
Part.
In this step, " quantity of the picture frame obtained in the buffer area unit time is less than preset value " can be characterization
The record screen picture still duration is more than certain value.Under normal circumstances, the picture frame (such as per second) recording screen and obtaining in the unit time
Quantity and the frame per second of live data match, such as 1 second 24 frame, when the picture frame of acquisition per second is less than 24 frame, explanation is deposited
Shield picture still problem in record, and the quiescent duration is more than 1/24 second, under this condition, if without processing, it is corresponding
It will appear visual Caton when client terminal playing live data.
In some instances, the repetition that this step proposes sends the parts of images frame in buffer area to server-side and can wrap
It includes: the frame picture frame of acquisition time the latest in the buffer area.Such as: judge the figure obtained in the buffer area unit time
At the time of whether being less than preset value as the quantity of frame, buffer area is cached with two field pictures frame, i.e. picture frame a and picture frame b, and schemes
The time stored as frame b to buffer area is later than picture frame a, then picture frame b can be repeatedly sent to server-side, so that service
End meets preset condition in the quantity for the picture frame that the unit time receives.
The preset condition that the embodiment of the present application proposes can also match with the frame per second of live data.Such as: live data
Frame per second be 24 frame per second, then preset condition can be, server-side is per second to receive 24 frame picture frames, just can guarantee corresponding
When the client terminal playing live data, visual Caton will not be generated because of scarce frame.
Referring to Fig.1, it is illustrated with a specific example, main broadcaster's client operates in the terminal based on IOS system and sets
On standby 130, after main broadcaster client user is using record screen live streaming, main broadcaster's client grabs electronic equipment screen by way of record screen
The image of upper displaying obtains the picture frame that record screen obtains, and one frame picture frame of every acquisition stores described image frame to buffer area,
And be sent to server-side 100 from buffer area by a frame frame picture frame so that server-side 100 by described image frame be sent to it is described
The corresponding client of main broadcaster's client (such as the first spectator client and the second spectator client) plays out.And described
Buffer area can open a sub thread while initialization, which can execute a task: continuous poll buffer area system
The quantity of the picture frame obtained in the buffer area unit time is counted, if the quantity of the picture frame obtained in the buffer area unit time
Less than preset value, then repeat to send the parts of images frame in buffer area to server-side, such as preset value is the image of acquisition per second
The quantity of frame is 24 frames, and 1s only obtains 22 frame picture frames at present, then repeats to send the picture frame that two frames have been issued to server
(this two frame repeat the picture frame sent can it is identical also cannot be different) so that the number of the picture frame received in server-side 1s
Amount is 24, i.e., the quantity of picture frame that server-side was received in the unit time meets preset condition.If in the buffer area unit time
The quantity of the picture frame of acquisition is no less than preset value, then can execute the operation that release has been issued to the picture frame of server, and
Continue poll buffer area.
So far, method described in Fig. 2 obtains record screen during record screen live streaming for the record screen live streaming based on IOS system
The picture frame obtained is first stored in buffer area, and each frame picture frame in the buffer area is sent to server-side；Detecting
When stating the quantity of the picture frame obtained in the buffer area unit time less than preset value, sent in buffer area by repeating to server-side
Parts of images frame, the quantity for the picture frame for receiving server-side in the unit time meets preset condition, to solve traditional skill
In art, when main broadcaster's client carries out record screen live streaming using the terminal device based on IOS system, corresponding spectator client card
The high technical problem of probability.And the method that the embodiment of the present application proposes, is particularly suitable for solving the terminal based on IOS system
Equipment record screen live streaming when screen-picture it is static, because screen-picture it is static so that IOS system refresh frequency reduce, and cause record shield
The picture frame of actual acquisition is reduced and the problem of Caton occurs in the spectator client by caused by.
Further, in some instances, after sending the frame picture frame in the buffer area to server-side every time, judge institute
The quantity of picture frame in buffer area is stated, such as using sub thread poll buffer area, counts the quantity of the picture frame of buffer area caching,
If quantity is greater than 1, the picture frame that server-side is had been issued in buffer area is discharged.To reduce the EMS memory occupation of buffer area.One tool
In the example of body, such as after picture frame a is sent to server-side, buffer area is there are two picture frame, and a picture frame a is another
A picture frame b, wherein picture frame b acquisition time is later than picture frame a, and and be not issued to server-side, then release described image
Frame a.
Referring to Fig. 3, for the process for another record screen live broadcasting method based on IOS system that the embodiment of the present application illustrates
Figure, the method includes the steps:
S310: during the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area.
The specific implementation of this step is referred to the step S210 of Fig. 2, and details are not described herein again.
S311: each frame picture frame in the buffer area is sent to server-side.
The specific implementation of this step is referred to the step S220 of Fig. 2, and details are not described herein again.
S320: after sending the frame picture frame in the buffer area to server-side every time, judge image in the buffer area
The quantity of frame.
In this step, it can be and run a sub thread in buffer area, sent in the buffer area to server-side every time
The poll buffer area, judges the quantity of picture frame in the buffer area after one frame picture frame.
S330: if quantity is greater than 1, the picture frame that server-side is had been issued in buffer area is discharged.
S340: it if the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, protects
Stay described image frame；After reaching preset time, the picture frame by the reservation is sent to server-side again.
In one specific example, this step may is that when the picture frame of buffer area only one when, the picture frame send out
Server-side is given, and the picture frame is remained in buffer area, while opening a sub thread, sub thread setting sleep
Mechanism determines sleeping time (being equivalent to preset time) that the sleeping time can determine according to frame per second, such as when frame per second is 24 frames
When (one second 24 frame picture frame of broadcasting), sleeping time can be 40 milliseconds, and the specific mode for calculating sleeping time may is that with 1
Second determines sleeping time according to obtained data value divided by frame per second, such as 1 second/24 frames are about 40 milliseconds/frame, so working as frame per second
When being 24, sleeping time can be 40 milliseconds, and sending picture frame according to the sleeping time can guarantee that corresponding spectator client plays
Video not Caton.Wherein, the sleeping time can be identical or corresponding with above-mentioned predeterminated frequency.When sub thread sleep mechanism
After, which is sent to server-side.
S330 or S340 is executed the step, can continue then to execute step S320, step is executed according to judging result selection
Rapid S330 or S340 constantly repeats for the picture frame of the reservation to be sent to if the quantity of the picture frame in buffer area is continuously 1
Server-side does not allow corresponding client so that the quantity for the picture frame that server-side was received in the unit time meets preset condition
Occurs Caton problem because picture frame is lacked.
Method described in Fig. 2 and Fig. 3 in addition to that can apply on the terminal device based on IOS system, can also with
On the connected terminal device of terminal device based on IOS system, application program can be installed on the terminal device, answered by this
Record screen live streaming may be implemented with program, the application program may is that software is broadcast live in internet.Referring to Fig. 4, implement for the application
The schematic diagram of a scenario for the record screen live streaming that example illustrates.Screen client is thrown in operation on terminal device 410 based on IOS system
411, the picture thrown screen client 411 and be used to capture 410 screen of terminal device passes through network with the terminal device 410
Main broadcaster's client 412 is run on the terminal device 420 of connection, the terminal device 420 is connected by network with server-side 400,
Server-side 400 has the terminal device 430 and 440 of live streaming client to be connected with operation, wherein runs on terminal device 430 and 440
Live streaming client and main broadcaster's client 412 in same direct broadcasting room.In conjunction with Fig. 5, the record screen live broadcasting method based on IOS system is answered
With an interaction diagrams on the terminal device being connected with the terminal device based on IOS system.Part steps are as follows:
S510: the image that screen client 411 is obtained by recording screen mode is thrown；
S520: described image is sent to main broadcaster's client 412；
S530: after the image procossing that main broadcaster's client 412 sends the throwing screen client 411, obtain what record screen obtained
Picture frame, and the picture frame of acquisition is stored in buffer area；
S540: main broadcaster's client 412 sends each frame picture frame in the buffer area to server-side 400；
S550: if the quantity of the picture frame obtained in the buffer area unit time is less than preset value, main broadcaster's client 412
It repeats to send the parts of images frame in buffer area to server-side 400, so that the picture frame that server-side 400 is received in the unit time
Quantity meet preset condition.
The specific implementation of each step of Fig. 5 is referred to earlier figures 2 and the corresponding specific embodiment of Fig. 3, and details are not described herein again.
In some instances, the aforementioned record screen live broadcasting method based on IOS system can also be executed by server-side, reference Fig. 6,
Main broadcaster's client is sent to server-side (S610) during the record screen of live streaming, by the picture frame that record screen obtains；
S620: server-side receives described image frame and stores to a buffer area；
S630: it if the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeats to the master
The parts of images frame in the corresponding live streaming client transmission buffer area of client is broadcast, so that each corresponding live streaming client is in unit
The quantity for the picture frame that time receives meets preset condition.
The specific implementation of each step of Fig. 6 is referred to earlier figures 2 and the corresponding specific embodiment of Fig. 3, and details are not described herein again.
In addition, the description of each step, can be implemented as software, hardware or its form combined, for example, this field skill
Art personnel can implement these as the form of software code, can be the calculating that can be realized the corresponding logic function of the step
Machine executable instruction.When it is realized in the form of software, the executable instruction be can store in memory, and be set
Processor in standby executes.
Corresponding with the aforementioned record screen embodiment of live broadcasting method based on IOS system, present invention also provides be based on IOS system
The record screen live broadcast device of system and the embodiment of vision facilities.
It is a kind of one embodiment block diagram of the record screen live broadcast device 700 based on IOS system of the application, the dress referring to Fig. 7
It sets and includes:
The picture frame that record screen obtains is stored in buffer area during the record screen of live streaming by cache module 710；
Processing module 720, for each frame picture frame in the buffer area to be sent to server-side, if the buffer area list
The quantity of the picture frame obtained in the time of position is less than preset value, repeats to send the parts of images frame in buffer area to server-side, with
The quantity for the picture frame for receiving server-side in the unit time meets preset condition.
In some instances, it includes: the buffer area that the repetition, which sends the parts of images frame in buffer area to server-side,
The frame picture frame of middle acquisition time the latest.
In some instances, the processing module 720 is used to each frame picture frame in the buffer area being sent to service
When end, it is specifically used for:
Sequencing and preset temporal frequency by the picture frame in buffer area according to acquisition time, are sent to one by one
Server-side.
In some instances, the processing module 720 is also used to: sending the frame in the buffer area to server-side every time
After picture frame, the quantity of picture frame in the buffer area is judged, if quantity is greater than 1, discharges in buffer area and have been issued to server-side
Picture frame.
In some instances, if image of the processing module 720 for being obtained in the buffer area unit time
The quantity of frame is less than preset value, when repeating to send the parts of images frame in buffer area to server-side, is specifically used for:
If the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, described in reservation
Picture frame；
After reaching preset time, described image frame is sent to server-side again.
It is shown in Figure 8, correspond to the above method, the application provides a kind of terminal device simultaneously.As shown in figure 8, this sets
Standby may include processor 801 and machine readable storage medium 802, wherein processor 801 and machine readable storage medium
802 are usually connected with each other by internal bus 803.In other possible implementations, the equipment is also possible that outside
Interface 804, can be communicated with other equipment or component.Further, it is stored on machine readable storage medium 802
The control logic 805 of record screen live streaming based on IOS system, the logic module which functionally divides can be
The structure of record screen live broadcast device shown in Fig. 7 based on IOS system.The processor 801 is for executing following steps:
During the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area, and send described delay to server-side
Deposit each frame picture frame in area；
If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to send to server-side slow
The parts of images frame in area is deposited, so that the quantity for the picture frame that server-side was received in the unit time meets preset condition.
In some instances, it includes: the buffer area that the repetition, which sends the parts of images frame in buffer area to server-side,
The frame picture frame of middle acquisition time the latest.
In some instances, each frame picture frame sent to server-side in the buffer area, comprising:
Sequencing and preset temporal frequency by the picture frame in buffer area according to acquisition time, are sent to one by one
Server-side.
In some instances, the processor 801 is also used to execute: sending one in the buffer area to server-side every time
After frame picture frame, the quantity of picture frame in the buffer area is judged, if quantity is greater than 1, discharges in buffer area and have been issued to service
The picture frame at end.
In some instances, if the quantity of the picture frame obtained in the buffer area unit time is less than preset value,
It repeats to send the parts of images frame in buffer area to server-side, comprising:
If the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, described in reservation
Picture frame；
After reaching preset time, described image frame is sent to server-side again.
Machine readable storage medium 802 described in Fig. 8 may is that RAM (deposit by Radom Access Memory, arbitrary access
Reservoir), volatile memory, nonvolatile memory, flash memory, memory driver (such as hard disk drive), solid state hard disk, any class
The storage dish (such as CD, dvd) of type perhaps similar storage medium or their combination.
The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.
Claims (10)
1. a kind of record screen live broadcasting method based on IOS system, which is characterized in that the method includes the steps:
During the record screen of live streaming, the picture frame that record screen obtains is stored in buffer area；
Each frame picture frame in the buffer area is sent to server-side；
If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to send buffer area to server-side
In parts of images frame so that the quantity for the picture frame that server-side was received in the unit time meets preset condition.
2. the method according to claim 1, wherein the repetition sends the part figure in buffer area to server-side
As frame includes: the frame picture frame of acquisition time the latest in the buffer area.
3. the method according to claim 1, wherein each frame figure sent to server-side in the buffer area
As frame, comprising:
Sequencing and preset temporal frequency by the picture frame in buffer area according to acquisition time, are sent to service one by one
End.
4. the method according to claim 1, wherein the method also includes steps:
After sending the frame picture frame in the buffer area to server-side every time, the quantity of picture frame in the buffer area is judged,
If quantity is greater than 1, the picture frame that server-side is had been issued in buffer area is discharged.
5. if according to the method described in claim 4, the it is characterized in that, image obtained in the buffer area unit time
The quantity of frame is less than preset value, repeats to send the parts of images frame in buffer area to server-side, comprising:
If the quantity of the picture frame in the buffer area is 1, after described image frame is sent to server-side, retain described image
Frame；
After reaching preset time, described image frame is sent to server-side again.
6. a kind of record screen live broadcasting method based on IOS system, which is characterized in that the method includes the steps:
The picture frame that the record screen that main broadcaster's client is sent obtains is received, and described image frame is stored to buffer area；
If the quantity of the picture frame obtained in the buffer area unit time is less than preset value, repeat to main broadcaster's client pair
The live streaming client answered sends the parts of images frame in the buffer area, so that each corresponding live streaming client connects in the unit time
The quantity of the picture frame received meets preset condition.
7. if according to the method described in claim 6, the it is characterized in that, image obtained in the buffer area unit time
The quantity of frame is less than preset value, repeats to send the part in the buffer area to the corresponding live streaming client of main broadcaster's client
Picture frame, comprising:
If the quantity of the picture frame in the buffer area is greater than 1, it is corresponding straight that main broadcaster's client is sent in described image frame
After broadcasting client, described image frame is discharged；
If the quantity of the picture frame in the buffer area is 1, the corresponding live streaming of main broadcaster's client is sent in described image frame
After client, retain described image frame, and after reaching preset time, described image frame is sent to main broadcaster's client pair again
The live streaming client answered.
8. a kind of record screen live broadcast device based on IOS system, which is characterized in that described device includes:
The picture frame that record screen obtains is stored in buffer area during the record screen of live streaming by cache module；
Processing module, for each frame picture frame in the buffer area to be sent to server-side, if the buffer area unit time
The quantity of the picture frame of interior acquisition is less than preset value, repeats to send the parts of images frame in buffer area to server-side, so that service
End meets preset condition in the quantity for the picture frame that the unit time receives.
9. a kind of terminal device characterized by comprising
Processor；For storing the memory of the processor-executable instruction；
Wherein, the processor is configured to executing the operation as described in claim 1 to 7 any one method.
10. a kind of storage medium, is stored thereon with program, which is characterized in that the program be executed by processor as claim 1 to
The operation of method described in 7 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811105770.7A CN109089131B (en) | 2018-09-21 | 2018-09-21 | Screen recording live broadcast method, device, equipment and storage medium based on IOS system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811105770.7A CN109089131B (en) | 2018-09-21 | 2018-09-21 | Screen recording live broadcast method, device, equipment and storage medium based on IOS system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109089131A true CN109089131A (en) | 2018-12-25 |
| CN109089131B CN109089131B (en) | 2021-07-23 |
Family
ID=64842189
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811105770.7A Active CN109089131B (en) | 2018-09-21 | 2018-09-21 | Screen recording live broadcast method, device, equipment and storage medium based on IOS system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109089131B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110139117A (en) * | 2019-05-17 | 2019-08-16 | 歌尔科技有限公司 | Live data method for pushing and device |
| CN110149546A (en) * | 2019-04-15 | 2019-08-20 | 广州虎牙信息科技有限公司 | Mobile terminal and its video shielded based on record mend frame method, computer storage medium |
| CN110177308A (en) * | 2019-04-15 | 2019-08-27 | 广州虎牙信息科技有限公司 | Mobile terminal and its audio-video frame losing method in record screen, computer storage medium |
| CN112804549A (en) * | 2021-01-15 | 2021-05-14 | 北京字节跳动网络技术有限公司 | Live broadcast data processing method and device |
| CN114245196A (en) * | 2021-12-08 | 2022-03-25 | 卓米私人有限公司 | Screen recording stream pushing method and device, electronic equipment and storage medium |
| CN116668762A (en) * | 2022-11-10 | 2023-08-29 | 荣耀终端有限公司 | Screen recording method and device |
| CN117221617A (en) * | 2023-09-28 | 2023-12-12 | 杭州星犀科技有限公司 | Live broadcast push flow system, method and computer storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101287106A (en) * | 2007-04-09 | 2008-10-15 | 株式会社日立制作所 | Video delivery device, video receiver and key frame delivery method |
| WO2015094166A1 (en) * | 2013-12-16 | 2015-06-25 | Intel Corporation | Video conferencing with improved bandwidth efficiency over wireless display (widi) channel |
| CN107231563A (en) * | 2016-03-24 | 2017-10-03 | 腾讯科技（深圳）有限公司 | Method for processing video frequency and device |
| CN108391123A (en) * | 2018-02-09 | 2018-08-10 | 维沃移动通信有限公司 | A kind of method and terminal generating video |
-
2018
- 2018-09-21 CN CN201811105770.7A patent/CN109089131B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101287106A (en) * | 2007-04-09 | 2008-10-15 | 株式会社日立制作所 | Video delivery device, video receiver and key frame delivery method |
| WO2015094166A1 (en) * | 2013-12-16 | 2015-06-25 | Intel Corporation | Video conferencing with improved bandwidth efficiency over wireless display (widi) channel |
| CN107231563A (en) * | 2016-03-24 | 2017-10-03 | 腾讯科技（深圳）有限公司 | Method for processing video frequency and device |
| CN108391123A (en) * | 2018-02-09 | 2018-08-10 | 维沃移动通信有限公司 | A kind of method and terminal generating video |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110149546A (en) * | 2019-04-15 | 2019-08-20 | 广州虎牙信息科技有限公司 | Mobile terminal and its video shielded based on record mend frame method, computer storage medium |
| CN110177308A (en) * | 2019-04-15 | 2019-08-27 | 广州虎牙信息科技有限公司 | Mobile terminal and its audio-video frame losing method in record screen, computer storage medium |
| CN110139117A (en) * | 2019-05-17 | 2019-08-16 | 歌尔科技有限公司 | Live data method for pushing and device |
| CN110139117B (en) * | 2019-05-17 | 2022-06-21 | 歌尔科技有限公司 | Live broadcast data pushing method and device |
| CN112804549A (en) * | 2021-01-15 | 2021-05-14 | 北京字节跳动网络技术有限公司 | Live broadcast data processing method and device |
| CN114245196A (en) * | 2021-12-08 | 2022-03-25 | 卓米私人有限公司 | Screen recording stream pushing method and device, electronic equipment and storage medium |
| CN114245196B (en) * | 2021-12-08 | 2024-04-19 | 卓米私人有限公司 | Screen recording and stream pushing method and device, electronic equipment and storage medium |
| CN116668762A (en) * | 2022-11-10 | 2023-08-29 | 荣耀终端有限公司 | Screen recording method and device |
| CN116668762B (en) * | 2022-11-10 | 2024-04-05 | 荣耀终端有限公司 | Screen recording method and device |
| CN117221617A (en) * | 2023-09-28 | 2023-12-12 | 杭州星犀科技有限公司 | Live broadcast push flow system, method and computer storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109089131B (en) | 2021-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109089131A (en) | A kind of record screen live broadcasting method, device, equipment and storage medium based on IOS system | |
| US10986414B1 (en) | Resource management for video playback and chat | |
| WO2017107649A1 (en) | Video transmission method and device | |
| CN112929741B (en) | Video frame rendering method and device, electronic equipment and storage medium | |
| CN108235120B (en) | Live video stream pushing method and device and electronic equipment | |
| US20170163934A1 (en) | Data, multimedia & video transmission updating system | |
| CN109391852B (en) | Message display method, device, equipment and storage medium | |
| CN103141089A (en) | System and method for controllably viewing digital video streams captured by surveillance cameras | |
| WO2021129830A1 (en) | Video transmission method, apparatus, device and system | |
| US9344678B2 (en) | Information processing apparatus, information processing method and computer-readable storage medium | |
| CN108174267A (en) | The sending device of interactive information, method and computer readable storage medium in live streaming | |
| CN112019905A (en) | Live broadcast playback method, computer equipment and readable storage medium | |
| CN106658113B (en) | Multimedia data processing method and device | |
| CN104080006A (en) | Video processing device and method | |
| CN108696771A (en) | A kind of video broadcasting method and device | |
| CN114510191A (en) | Screen projection method and device | |
| CN108668138A (en) | A kind of method for downloading video and user terminal | |
| CN103596037B (en) | A kind of control method of live video stream buffering | |
| US11438545B2 (en) | Video image-based media stream bandwidth reduction | |
| CN113766261A (en) | Method and device for determining pre-pulling duration, electronic equipment and storage medium | |
| CN104267918B (en) | A kind of image display method and system | |
| CN113271496B (en) | Video smooth playing method and system in network live broadcast and readable storage medium | |
| CN111954041A (en) | Video loading method, computer equipment and readable storage medium | |
| CN111918125B (en) | Video playing method, device and system | |
| CN107004018B (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |