CN108989830A - A kind of live broadcasting method, device, electronic equipment and storage medium - Google Patents

A kind of live broadcasting method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN108989830A
CN108989830A CN201811003598.4A CN201811003598A CN108989830A CN 108989830 A CN108989830 A CN 108989830A CN 201811003598 A CN201811003598 A CN 201811003598A CN 108989830 A CN108989830 A CN 108989830A
Authority
CN
China
Prior art keywords
image
camera
server
target image
main broadcaster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811003598.4A
Other languages
Chinese (zh)
Inventor
练志辉
屈秋竹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huya Information Technology Co Ltd
Original Assignee
Guangzhou Huya Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huya Information Technology Co Ltd filed Critical Guangzhou Huya Information Technology Co Ltd
Priority to CN201811003598.4A priority Critical patent/CN108989830A/en
Publication of CN108989830A publication Critical patent/CN108989830A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/26Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window

Abstract

The application provides a kind of live broadcasting method, device, electronic equipment and storage medium.The method is main comprising steps of arouse camera service, obtains the first image of the camera service background operation acquisition;Obtain the second image that local device current screen is shown;After the first image and the second synthesis target image image, the target image is sent to server, is shown so that the target image is distributed to specified spectator client by server.It seeks to fill that spectator client while showing the demand of main broadcaster's image and game image, and solve the problem of that main broadcaster's image in game live streaming on main broadcaster's client game image causes to block to partial game image.

Description

A kind of live broadcasting method, device, electronic equipment and storage medium
Technical field
This application involves internet area more particularly to a kind of live broadcasting method, device, electronic equipment and storage mediums.
Background technique
Game live streaming is one of live form most popular at present.Spectators in game live streaming be both concerned about that main broadcaster operated trip The real-time game image obtained when play, but be concerned about main broadcaster to the operation image of game or explain image (acquired by camera, can Main broadcaster's image is referred to as with the image for acquiring camera).In order to meet the demand of spectators, current game direct seeding technique In, main broadcaster's image that game image and camera acquire is shown the equipment where itself by main broadcaster's client in a form of picture-in-picture Screen on, and obtain the above-mentioned image including main broadcaster's image and game image by way of record screen and be sent to server, with Make server be distributed to spectator client to show.Although current game direct seeding technique meets spectators can see game simultaneously The demand of image and main broadcaster's image, but produces following technical problem in main broadcaster's client: being shown in game image with small picture On main broadcaster's image partial game image is caused to block, sometimes the shield portions be game operation region, cause interfere main broadcaster Operation to game.
The technical issues of above-mentioned main broadcaster's client generates how is solved, and meets the needs of spectators simultaneously as urgently to be resolved The problem of.
Summary of the invention
In view of this, the application provides a kind of live broadcasting method, device, electronic equipment and storage medium.
Specifically, the application is achieved by the following technical solution:
The application's in a first aspect, providing a kind of live broadcasting method, the method includes the steps:
Arouse camera service, obtains the first image of the camera service background operation acquisition;
Obtain the second image that local device current screen is shown;
After the first image and the second synthesis target image image, the target image is sent to server, with Make server that the target image is distributed to specified spectator client to show.
In some instances, first image for obtaining the camera running background acquisition, comprising:
It is that after exporting target, camera captured image frame is sent out that Surface Texture object, which is arranged, by api interface Give Surface Texture object;
According to the Surface Texture object and corresponding Texture Identification in graphic package interface, the first figure is obtained Picture.
In some instances, the first image and the second image press picture-in-picture, left and right split screen or upper and lower in the target image The mode of split screen synthesizes.
In some instances, the method also includes steps: the switching command of response user's triggering, the screen of equipment at place The first image is shown on curtain, wherein the first image is shown according to preset display parameters.
In some instances, the switching command of the response user triggering, is showing described the on the screen of the device One image, comprising:
After the switching command for detecting user's triggering, the camera of running background is adjusted to front stage operation, where making The first image is shown on the screen of equipment.
In some instances, the display parameters of the first image are instructed by the setting of user and are determined.
In some instances, the display parameters of the first image are obtained according to image recognition algorithm, wherein described first Image, which is shown in the second image, influences Minimum Area.
In some instances, described by the first image and the second synthesis target image image, by the target image It is sent to server, comprising:
Second image is plotted on input painting canvas according to preset display parameters;
The first image is subjected to matrixing according to preset display parameters, is plotted to the specified of the input painting canvas Position;
Display content on the input painting canvas is encoded, and is sent to server.
The second aspect of the application, provides a kind of electronic equipment, and the electronic equipment includes: to be connected by internal bus External interface, memory, processor and display;
Wherein, the memory, for storing the corresponding machine readable instructions of live streaming control logic;
The external interface for being connected with camera, and is in communication with each other camera with processor;
The processor obtains the first figure of the camera service background operation acquisition for arousing camera service Picture;Obtain the second image that local device current screen is shown;After the first image and the second synthesis target image image, The target image is sent to server, so that the target image is distributed to specified spectator client exhibition by server Show.
The third aspect of the application, provides a kind of electronic equipment, and the electronic equipment includes: to be connected by internal bus Camera, memory, processor and display;
Wherein, the memory, for storing the corresponding machine readable instructions of live streaming control logic;
The camera, for acquiring the first image;
The processor obtains the first figure of the camera service background operation acquisition for arousing camera service Picture;Obtain the second image that local device current screen is shown;After the first image and the second synthesis target image image, The target image is sent to server, so that the target image is distributed to specified spectator client exhibition by server Show.
The fourth aspect of the application, provides a kind of live broadcast device, and the live broadcast device includes:
Module is obtained, for arousing camera service, obtains the first image of the camera service background operation acquisition; Obtain the second image that local device current screen is shown;
Processing module, for by after the first image and the second synthesis target image image, the target image to be sent out Server is given, is shown so that the target image is distributed to specified spectator client by server.
The fourth aspect of the application provides a kind of storage medium, and such as above-mentioned the is realized when described program is executed by processor On the one hand the step of described any one the method.
The application only shows game image (the second image) on the screen of the device by main broadcaster's client institute, does not show and takes the photograph As main broadcaster's image (the first image) that head acquires, make occlusion issue of main broadcaster's client there is no main broadcaster's image to game image; Main broadcaster's image and game image are wanted while seen for spectators, and main broadcaster's client captures place equipment screen by way of record screen The game image shown on curtain, and camera is opened, make camera running background, the main broadcaster's image for reaching camera acquisition is not shown Show on the screen, then by after main broadcaster's image and game image synthesis target image, the target image is sent to clothes Business device, the target image is distributed to specified spectator client and shown by server, so that the image that spectator client is shown Not only included main broadcaster's image but also included game image.Through the above scheme, main broadcaster's client main broadcaster's image is solved to game image The problem of blocking, and meet the user of spectator client simultaneously while seeing the demand of game image and main broadcaster's image.
Detailed description of the invention
Fig. 1 a is a kind of live scene schematic diagram shown in one exemplary embodiment of the application;
Fig. 1 b is a kind of existing game live streaming schematic diagram shown in one exemplary embodiment of the application;
Fig. 2 is a kind of flow chart of live broadcasting method in one exemplary embodiment of the application;
Fig. 3 is a kind of main broadcaster's client end interface schematic diagram in one exemplary embodiment of the application;
Fig. 4 is one of one exemplary embodiment of the application game live streaming schematic diagram;
Fig. 5 is the hardware architecture diagram of one of one exemplary embodiment of the application electronic equipment;
Fig. 6 is the hardware architecture diagram of another electronic equipment in one exemplary embodiment of the application;
Fig. 7 is the logic diagram of one of one exemplary embodiment of the application live broadcast device.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the application.
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application. It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from In the case where the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ... When " or " in response to determination ".
A referring to Fig.1 implements the live scene schematic diagram exemplified, the first spectator client, the second spectators client for application End and main broadcaster's client are respectively installed on electronic equipment 110,120 and 130, and main broadcaster's client can call camera to record Video shoots photo or/and makes live video stream by other modes such as screen captures, is then sent to clothes by network Business device 100.Server 100 is used to provide the background service of internet live streaming, such as saves each main broadcaster's client and spectators client The corresponding relationship at end is broadcast live the distribution of video flowing and the distribution of interactive message etc., when the first spectator client and second In same direct broadcasting room, main broadcaster's client can share the live video stream of desired displaying for spectator client and main broadcaster's client To the first spectator client and the second spectator client in same direct broadcasting room, for the first spectator client and the second spectators visitor The user at family end watches.The live video stream includes audio data and several frame live videos.
" main broadcaster's client " " spectator client " that the embodiment of the present application proposes can refer to installation on an electronic device soft Part, in some cases, the live streaming client and spectator client are integrated on a software, when the identity of user is main broadcaster When, which can be referred to as main broadcaster's client, and when the identity of user is spectators, which is referred to as spectators client End.
The electronic equipment can have networking function.Such as mobile terminal (such as smart phone, Intelligent flat and notes This computer etc.) and fixed terminal (desktop computer, server, smart television and car-mounted terminal etc.) etc..The application does not limit electronics The type of equipment.
Game live streaming is one of live form most popular at present.Spectators in game live streaming be both concerned about that main broadcaster operated trip The real-time game image obtained when play, but be concerned about main broadcaster to the operation image of game or explain image (acquired by camera, can Main broadcaster's image is referred to as with the image for acquiring camera).B referring to Fig.1, the one kind schematically shown for the embodiment of the present application are existing There is the schematic diagram that game is broadcast live in technology, main broadcaster's client 140, camera service 143 and games 144 are installed in electronics In equipment 145, the main broadcaster's image 142 for 143 acquisition of game image 141 and camera service that games 144 make when running It is shown on the screen of electronic equipment 145 in a form of picture-in-picture, main broadcaster's client 140 obtains above-mentioned packet by way of record screen The image for including main broadcaster's image 142 and game image 141 is sent to server 150, so that server 150 is distributed to spectator client 160, spectator client 160 is installed on electronic equipment 161, and spectator client 160 will described include main broadcaster's image 142 and trip The image of play image 141 is shown on the screen of electronic equipment 161.It can be with although current game direct seeding technique meets spectators The demand for seeing game image and main broadcaster's image simultaneously, but produces following technical problem in main broadcaster's client: aobvious with small picture Show that main broadcaster's image on game image causes to block to partial game image, the shield portions are game operation region sometimes, Lead to the operation for interfering main broadcaster to game.
The technical issues of above-mentioned main broadcaster's client generates how is solved, and meets the needs of spectators simultaneously as urgently to be resolved The problem of.
The application in view of the above technical problems, provides a kind of live broadcasting method, device, electronic equipment and storage medium.Reference Fig. 2 is a kind of flow chart for live broadcasting method that the embodiment of the present application is schematically shown, the method includes the steps:
S210: arouse camera service;
The camera service can be system service program.
S220: the first image of the camera service background operation acquisition is obtained;
The first image can be referred to as main broadcaster's image.
S230: the second image that local device current screen is shown is obtained;
If in game live streaming, second image can be referred to as game image.
S240: after the first image and the second synthesis target image image, the target image is sent to service Device is shown so that the target image is distributed to specified spectator client by server.
It should be noted that above-mentioned steps S220 and S230 do not need to distinguish sequencing, can carry out simultaneously, it can also be first S220 is executed, S230 is executed afterwards, or first carry out S230, executes S220 afterwards.It, can be with when executing step S240 in some examples It is by the first image of identical time stamp and the second synthesis target image image, to reduce delay.
In some instances, the method can be by main broadcaster's client executing.In some instances, main broadcaster's client It is mounted on an electronic device, the electronic equipment can be configured with built-in camera, can also be connected by external interface outer It sets camera and carries out Image Acquisition.When the electronic equipment itself is configured with built-in camera, it is also possible to pass through external interface Image Acquisition is carried out using external camera.Which specifically used camera collection image, according to the user's choice or default is selected Determination is selected, the embodiment of the present application is not intended to limit.
" arousing camera service " described in step S210 can be after the operation of main broadcaster's client, by main broadcaster's client It executes, then the camera service execution opens camera, makes camera collection image, when camera services front stage operation When, the first image of the acquisition is shown into (rendering) on the screen, preview mode is opened, at this point, user can be set first The display parameters of image, the display parameters include: display size, position, resolution ratio and/or special efficacy etc., and the special efficacy includes: Textures and/or U.S. face etc..
After the instruction of user's triggering " silence shooting ", step S220 is executed.Referring to Fig. 3, the finger of " the silence shooting " It enables, can be triggered after the control 320 that user triggers " silence shooting " on interface 310.Camera service is from front stage operation Switch to running background, the first image of camera capture is no longer displayed on the screen, but is sent to main broadcaster by camera service Client.
There are many mode for running camera service background, and in a specific example, step S220 may is that main broadcaster It is output target that Surface Texture object S1, which is arranged, by api interface (such as: setCameraPreview) in client, and It is not using display screen as output target, so that camera captured image frame is not shown on the screen;Then make camera Captured image frame is sent to Surface Texture object S1;According to the Surface Texture object S1 and figure journey Corresponding Texture Identification (Texure ID) T1 in sequence interface (OpenGL ES) obtains the first image.
In some instances, the step S230 may is that main broadcaster's client obtains Surface Texure by recording screen Object S2 is obtained according to the S2 and Texture Identification (Texure ID) T2 corresponding in graphic package interface (OpenGL ES) Second image.
In some instances, the step S240 may is that the input painting canvas (input surface) for obtaining encoder, Wherein, the image being plotted on input surface will be automatically into coding process;Second image is (pre- by presetting If) display parameters be plotted on the input painting canvas;According to the display parameters pre-set, the first image is subjected to matrix Transformation is plotted to the designated position of the input painting canvas, encodes to the image on input painting canvas, by the target figure after coding As being sent to server, shown so that the target image is distributed to specified spectator client by server.
In some instances, described according to pre-set display parameters, the first image and second in the target image Image can synthesize in the way of picture-in-picture, left and right split screen or upper and lower split screen.Such as: with the second image for big picture, the first figure Picture-in-picture form as being small picture.
Fig. 4 schematically illustrates a kind of schematic diagram of live broadcasting method by taking game live scene as an example.Referring to Fig. 4, main broadcaster's client 410, spectator client 440 is respectively installed on electronic equipment 420 and electronic equipment 450, and server 430 is distinguished by network Connection is established with electronic equipment 420 and electronic equipment 450, main broadcaster's client 410 and spectator client 440 are in same live streaming In.Game client (or games) 411 and camera service 412, the game are also equipped on electronic equipment 420 After client 411 is run, game image 414 is rendered on the screen of electronic equipment 420, and main broadcaster's client 420 passes through record screen Mode obtain game image (the second image);Main broadcaster's client 420 arouses camera service 412, after so that camera is serviced 412 Platform operation, camera service 412 capture main broadcaster's image (the first image) from camera, main broadcaster's image are not shown in electricity On the screen of sub- equipment 420, from fig. 4, it can be seen that showing game image 414 on the screen of electronic equipment 420, main broadcaster is not shown Image 415, so that there is no main broadcaster's images to the occlusion issue of game image for main broadcaster's client.Of course it is to be understood that electronics is set Content relevant to being broadcast live can also be shown on standby 420 screen, such as: room number information, barrage, control and/or present letter Breath etc., does not elaborate herein.Main broadcaster's client 410 captures the game image 414 that record screen obtains and camera running background Main broadcaster's image 415 by preset display parameters synthesize target image 416, and by a frame frame target image 416 by coding after It is sent to server 430, a frame frame target image 416 is sent to spectator client 440, spectator client 440 by server 430 After receiving the frame frame target image 416, (display) is rendered on the screen of electronic equipment 450, from fig. 4, it can be seen that due to Target image 450 includes main broadcaster's image 415 and game image 414, so showing there is main broadcaster simultaneously on the screen of electronic equipment 450 Image 415 and game image 414, the needs of meeting spectator client user while watching game image and main broadcaster's image.It needs Illustrate, herein described live broadcasting method is not limited to game live scene, and the live broadcasting method can be adapted for arbitrarily Live scene, in other live scenes, the games can be any other application program, it is of course also possible to described Second image is not made by application program, but the image of any display on an electronic device.
The method that the embodiment of the present application proposes not only meets spectator client while watching game image and main broadcaster's image Demand, it is thus also avoided that main broadcaster's image of main broadcaster's client reduces main broadcaster visitor to the occlusion issue of game image in the prior art Disturbing factor of the user at family end when carrying out game operation.Importantly, the method proposed by the embodiment of the present application, solution It has determined current the problem of rarely game main broadcaster is started broadcasting by mobile terminal.It is known that portable due to mobile terminal The rapid development of property and its hardware performance, so that the user volume of mobile terminal game (such as hand trip) catches up with and surpasses traditional fixation gradually Terminal (end PC) game.Meet the needs of spectators again while game main broadcaster is in order to not influence to the operation of game, is being moved When moved end game (such as hand trip) is broadcast live, the game image on mobile terminal is sent to fixed terminal, fixed terminal acquisition master Image is broadcast, server will be sent to after main broadcaster's image and game image synthesis.It can be seen that traditional technology needs two electronic equipments to match Closing work could complete to be broadcast live, and game live streaming is made to lose mobility.Compared to traditional technology, the application only needs an electricity Sub- equipment neither can interfere main broadcaster to operate, and meet audience demand and be broadcast live, and reduce the quantity of required electronic equipment With the complexity of operation, the wish that main broadcaster is started broadcasting using mobile terminal is greatly increased.
In some instances, the live broadcasting method can be comprising steps of respond the switching command of user's triggering, at place The first image is shown on the screen of equipment.It can specifically be obtained by following technological means:
After main broadcaster's client detects the switching command of user's triggering, before the camera service of script running background is adjusted to When showing the first image on the screen, image to be shown on script screen (former second image) and camera are adopted for platform operation First image of collection is plotted on painting canvas according to the display parameters pre-set, by the image rendering on the painting canvas to screen On.By taking game is broadcast live as an example, if display game image and main broadcaster's image are shown in the form of picture-in-picture, game image is big picture, Main broadcaster's image is small picture, then can be game image (the second image) being plotted to painting canvas T1 according to preset display parameters On, then after main broadcaster's image (the first image) that camera service is acquired carries out rectangular transform according to preset display parameters, draw On the designated position for making the painting canvas T1, finally the image rendering on the painting canvas T1 is shown to screen.In the present embodiment In, it is sent to the target image of server, what the first image and record screen that front stage operation acquisition can be serviced by camera obtained The synthesis of second image is also possible to the second image that record screen obtains.
In some instances, the switching command of the response user triggering, is showing described the on the screen of the device When one image, the display parameters of the first image can be if the next stage is as user setting: 1, pre- as described in above-described embodiment Look at the stage;2, user trigger switching command when/after.If in preview phase, after user triggers switching command, by preset display Parameter shows the first image.If when user triggers switching command/after, pop-up setting window is joined so that user setting is shown Number.
In other example, the switching command of the response user triggering is showing institute on the screen of the device When stating the first image, the display parameters of the first image can be obtained according to image recognition algorithm.Specifically it may is that according to figure After obtaining " influencing Minimum Area " in the second image as recognizer, the size of the first image is made to be less than the influence smallest region Domain, and the influence Minimum Area is set by the position of the first image, so that the image of display is to the second image (as swum Play image) influence it is minimum.In some instances, described " influence Minimum Area " be obtained by image recognition algorithm it is entire In image, to the smallest region of the second image contributions, such as the map display area in game image or dialog box area can be Domain etc..It is appreciated that being directed to different game or software, Different Effects weight can be preset, when image recognition, according to influence Weight determines the influence value in each region.
In practical applications, the display content of the second image is varied, for different display contents, main broadcaster's client The display parameters of upper first image can use different strategies.For example, certain touch-controls are clicked in class game, it is every in game image A region is required to user's operation, does not have temporarily to the lesser region of game-effects, and in certain strategies or sports class game, Some regions (map display area, message display area or dialog region) are temporary in game image is blocked, will not be to trip Play operation or result generate large effect.For above situation, in some instances, for specific second image, response The switching command of user's triggering, when showing the first image on the screen of the device, the display of the first image is joined Number is obtained according to image recognition algorithm.In specific example, the switching command of the response user triggering is calculated according to image recognition Method after showing that the first image may is that the switching command for detecting user's triggering on the screen of the device, work as by judgement Whether preceding second image belongs to preset second image type, if so, executing according to image recognition algorithm in place equipment The first image is shown on screen;If it is not, according to the pre-set display parameters of user or the display parameters of default.
It is appreciated that in some examples, the switching command of above-mentioned response user triggering, in the screen of main broadcaster's client device First image of upper display, can be arbitrarily dragged according to the instruction of user.
Corresponding with the embodiment of aforementioned live broadcasting method, present invention also provides the embodiments of live broadcast device.
Installation practice can also be realized by software realization by way of hardware or software and hardware combining.With For software realization, as the device on a logical meaning, being will be in memory by the processor of terminal device where it Corresponding computer program instructions are read into memory what operation was formed.It is that the application is straight referring to Fig. 5 for hardware view A kind of hardware structure diagram of electronic equipment where broadcasting device, the electronic equipment includes: the outside connected by internal bus 510 Interface 520, memory 530, processor 540 and display 550;
Wherein, the memory 530, for storing the corresponding machine readable instructions of live streaming control logic;
The external interface 520 for being connected with camera 560, and is in communication with each other camera 560 with processor 540;
The processor 540 obtains the first of the camera service background operation acquisition for arousing camera service Image;Obtain the second image that local device current screen is shown;By the first image and the second synthesis target image image Afterwards, the target image is sent to server, so that the target image is distributed to specified spectator client by server It shows.
It should be noted that other than processor shown in fig. 5, memory, external interface, display and memory, Terminal device (electronic equipment) in embodiment where device can also include it generally according to the actual functional capability of the terminal device His hardware, repeats no more this.
It is another hardware structure diagram of electronic equipment where the application live broadcast device, the electronic equipment packet referring to Fig. 6 It includes: camera 660, memory 630, processor 640 and the display 650 connected by internal bus 610;
Wherein, the memory 630, for storing the corresponding machine readable instructions of live streaming control logic;
The camera 660, for acquiring the first image;
The processor 640 obtains the first of the camera service background operation acquisition for arousing camera service Image;Obtain the second image that local device present displays 650 are shown;By the first image and the second synthesis target image After image, the target image is sent to server, so that the target image is distributed to specified spectators visitor by server Family end is shown.
It should be noted that other than processor shown in fig. 6, memory, camera, display and memory, it is real The terminal device (electronic equipment) in example where device is applied generally according to the actual functional capability of the terminal device, can also include other Hardware repeats no more this.
Referring to FIG. 7, a kind of live broadcast device 700, comprising:
Module 710 is obtained, for arousing camera service, obtains the first figure of the camera service background operation acquisition Picture;Obtain the second image that local device current screen is shown;
Processing module 720: for by after the first image and the second synthesis target image image, by the target image It is sent to server, is shown so that the target image is distributed to specified spectator client by server.
In some instances, the acquisition module is specifically used for:
It is that after exporting target, camera captured image frame is sent out that Surface Texure object, which is arranged, by api interface Give SurfaceTexure object;
According to the SurfaceTexure object and corresponding Texture Identification in graphic package interface, the first image is obtained.
In some instances, the first image and the second image press picture-in-picture, left and right split screen or upper and lower in the target image The mode of split screen synthesizes.
In some instances, described device further includes switching module, the switching module, for responding cutting for user's triggering Instruction is changed, is showing the first image on the screen of the device, wherein the first image is according to preset display parameters Display.
In some instances, after the switching module is specifically used for the switching command for detecting user's triggering, backstage is transported The capable camera is adjusted to front stage operation, makes to show the first image on the screen of the device.
In some instances, the display parameters of the first image are instructed by the setting of user and are determined.
In some instances, the display parameters of the first image are obtained according to image recognition algorithm, wherein described first Image, which is shown in the second image, influences Minimum Area.
In some instances, described by the first image and the second synthesis target image image, by the target image It is sent to server, the processing module is specifically used for:
Second image is plotted on input painting canvas according to preset display parameters;
The first image is subjected to matrixing according to preset display parameters, is plotted to the specified of the input painting canvas Position;
Display content on the input painting canvas is encoded, and is sent to server.
It is (including but unlimited that the storage medium for wherein including program code in one or more can be used in the embodiment of the present application In magnetic disk storage, CD-ROM, optical memory etc.) on the form of computer program product implemented.Computer can use storage Medium includes permanent and non-permanent, removable and non-removable media, can be accomplished by any method or technique information Storage.Information can be computer readable instructions, data structure, the module of program or other data.The storage medium of computer Example include but is not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices or any other non-biography Defeated medium, can be used for storage can be accessed by a computing device information.
The function of each unit and the realization process of effect are specifically detailed in the above method and correspond to step in above-mentioned apparatus Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual The purpose for needing to select some or all of the modules therein to realize application scheme.Those of ordinary skill in the art are not paying Out in the case where creative work, it can understand and implement.
The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.

Claims (12)

1. a kind of live broadcasting method, which is characterized in that the method includes the steps:
Arouse camera service, obtains the first image of the camera service background operation acquisition;
Obtain the second image that local device current screen is shown;
After the first image and the second synthesis target image image, the target image is sent to server, so that clothes The target image is distributed to specified spectator client and shown by business device.
2. the method according to claim 1, wherein described obtain the first of the camera running background acquisition Image, comprising:
It is that after exporting target, camera captured image frame is sent to that Surface Texture object, which is arranged, by api interface Surface Texture object;
According to the Surface Texture object and corresponding Texture Identification in graphic package interface, the first image is obtained.
3. method according to claim 1 or 2, which is characterized in that the first image and the second image in the target image It is synthesized in the way of picture-in-picture, left and right split screen or upper and lower split screen.
4. the method according to claim 1, wherein the method also includes steps: response user's triggering is cut Instruction is changed, is showing the first image on the screen of the device, wherein the first image is according to preset display parameters Display.
5. according to the method described in claim 4, it is characterized in that, the switching command of the response user triggering, sets at place The first image is shown on standby screen, comprising:
After the switching command for detecting user's triggering, the camera of running background is adjusted to front stage operation, equipment where making Screen on show the first image.
6. according to the method described in claim 4, it is characterized in that, the display parameters of the first image are referred to by the setting of user It enables and determining.
7. according to the method described in claim 4, it is characterized in that, the display parameters of the first image are calculated according to image recognition Method obtains, wherein the first image, which is shown in the second image, influences Minimum Area.
8. the method according to claim 1, wherein described by the first image and the second synthesis target image The target image is sent to server by image, comprising:
Second image is plotted on input painting canvas according to preset display parameters;
The first image is subjected to matrixing according to preset display parameters, is plotted to the specific bit of the input painting canvas It sets;
Display content on the input painting canvas is encoded, and is sent to server.
9. a kind of electronic equipment, which is characterized in that the electronic equipment includes: the external interface connected by internal bus, deposits Reservoir, processor and display;
Wherein, the memory, for storing the corresponding machine readable instructions of live streaming control logic;
The external interface for being connected with camera, and is in communication with each other camera with processor;
The processor obtains the first image of the camera service background operation acquisition for arousing camera service;It obtains Take the second image that local device current screen is shown;After the first image and the second synthesis target image image, by institute It states target image and is sent to server, shown so that the target image is distributed to specified spectator client by server.
10. a kind of electronic equipment, which is characterized in that the electronic equipment includes: the camera connected by internal bus, stores Device, processor and display;
Wherein, the memory, for storing the corresponding machine readable instructions of live streaming control logic;
The camera, for acquiring the first image;
The processor obtains the first image of the camera service background operation acquisition for arousing camera service;It obtains Take the second image that local device current screen is shown;After the first image and the second synthesis target image image, by institute It states target image and is sent to server, shown so that the target image is distributed to specified spectator client by server.
11. a kind of live broadcast device, which is characterized in that the live broadcast device includes:
Module is obtained, for arousing camera service, obtains the first image of the camera service background operation acquisition;It obtains The second image that local device current screen is shown;
Processing module, for by after the first image and the second synthesis target image image, the target image to be sent to Server is shown so that the target image is distributed to specified spectator client by server.
12. a kind of storage medium, is stored thereon with computer program, which is characterized in that real when described program is executed by processor The step of existing claim 1 to 8 any one the method.
CN201811003598.4A 2018-08-30 2018-08-30 A kind of live broadcasting method, device, electronic equipment and storage medium Pending CN108989830A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811003598.4A CN108989830A (en) 2018-08-30 2018-08-30 A kind of live broadcasting method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811003598.4A CN108989830A (en) 2018-08-30 2018-08-30 A kind of live broadcasting method, device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN108989830A true CN108989830A (en) 2018-12-11

Family

ID=64548397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811003598.4A Pending CN108989830A (en) 2018-08-30 2018-08-30 A kind of live broadcasting method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108989830A (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109862385A (en) * 2019-03-18 2019-06-07 广州虎牙信息科技有限公司 Method, apparatus, computer readable storage medium and the terminal device of live streaming
CN110049245A (en) * 2019-04-22 2019-07-23 联想(北京)有限公司 Information processing method and electronic equipment
CN110113307A (en) * 2019-04-01 2019-08-09 视联动力信息技术股份有限公司 A kind of method and apparatus of live streaming
CN110139030A (en) * 2019-04-24 2019-08-16 薄涛 Mixed reality processing system, method, server and its storage medium
CN111147353A (en) * 2019-12-23 2020-05-12 网易(杭州)网络有限公司 Method and device for identifying friend, computer storage medium and electronic equipment
CN111447353A (en) * 2019-01-16 2020-07-24 北京字节跳动网络技术有限公司 Image acquisition method and device, electronic equipment and storage medium
CN111760266A (en) * 2020-07-01 2020-10-13 网易(杭州)网络有限公司 Game live broadcast method and device and electronic equipment
CN112019907A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast picture distribution method, computer equipment and readable storage medium
CN112073641A (en) * 2020-09-18 2020-12-11 深圳市众志联城科技有限公司 Image shooting method and device, mobile terminal and storage medium
CN112148901A (en) * 2020-09-22 2020-12-29 上海连尚网络科技有限公司 Editing method and device of live stream
CN112619138A (en) * 2021-01-06 2021-04-09 网易(杭州)网络有限公司 Method and device for displaying skill special effect in game
CN112637624A (en) * 2020-12-14 2021-04-09 广州繁星互娱信息科技有限公司 Live stream processing method, device, equipment and storage medium
CN112770135A (en) * 2021-01-21 2021-05-07 腾讯科技(深圳)有限公司 Live broadcast-based content explanation method and device, electronic equipment and storage medium
CN112788358A (en) * 2020-12-31 2021-05-11 腾讯科技(深圳)有限公司 Video live broadcast method, video sending method, device and equipment for game match
CN113014960A (en) * 2019-12-19 2021-06-22 腾讯科技(深圳)有限公司 Method, device and storage medium for online video production
CN113114931A (en) * 2021-03-28 2021-07-13 大运汽车股份有限公司 Remote photographing control method in automobile
CN113115115A (en) * 2021-03-05 2021-07-13 广州虎牙科技有限公司 Message pushing method and device, electronic equipment and computer-readable storage medium
CN113630614A (en) * 2021-08-09 2021-11-09 广州虎牙科技有限公司 Game live broadcast method, device, system, electronic equipment and readable storage medium
CN113709519A (en) * 2021-08-27 2021-11-26 上海掌门科技有限公司 Method and equipment for determining live broadcast shielding area
CN113852833A (en) * 2021-08-30 2021-12-28 阿里巴巴(中国)有限公司 Multi-device collaborative live broadcast method and device and electronic device
CN113938753A (en) * 2021-12-20 2022-01-14 北京搜狐新动力信息技术有限公司 Live broadcast data processing method and device, storage medium and equipment
CN114222149A (en) * 2021-11-17 2022-03-22 武汉斗鱼鱼乐网络科技有限公司 Plug flow method, device, medium and computer equipment
CN115086745A (en) * 2022-06-30 2022-09-20 北京字跳网络技术有限公司 Live video processing method, device, equipment and medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104410916A (en) * 2014-12-03 2015-03-11 广州华多网络科技有限公司 On-line living broadcast method and equipment
US20150119142A1 (en) * 2013-10-28 2015-04-30 Nvidia Corporation Gamecasting techniques
CN104822077A (en) * 2014-12-04 2015-08-05 腾讯科技(北京)有限公司 Client operating method and client
US20150290540A1 (en) * 2014-04-15 2015-10-15 Microsoft Corporation Positioning a camera video overlay on gameplay video
CN105791958A (en) * 2016-04-22 2016-07-20 北京小米移动软件有限公司 Method and device for live broadcasting game
CN105933778A (en) * 2016-06-17 2016-09-07 北京奇虎科技有限公司 Live broadcast method and device based on screen contents of terminal
CN106230841A (en) * 2016-08-04 2016-12-14 深圳响巢看看信息技术有限公司 A kind of video U.S. face and the method for plug-flow in real time in network direct broadcasting based on terminal
CN106303329A (en) * 2016-08-11 2017-01-04 广州爱九游信息技术有限公司 Record screen live broadcasting method and device, mobile device and live broadcast system
CN106559696A (en) * 2016-12-01 2017-04-05 北京小米移动软件有限公司 Method for sending information and device
CN107105315A (en) * 2017-05-11 2017-08-29 广州华多网络科技有限公司 Live broadcasting method, the live broadcasting method of main broadcaster's client, main broadcaster's client and equipment
CN107948702A (en) * 2017-11-21 2018-04-20 广州酷狗计算机科技有限公司 Synchronous method, device, terminal and the storage medium of Application Status
CN108024123A (en) * 2017-11-08 2018-05-11 北京密境和风科技有限公司 A kind of live video processing method, device, terminal device and server
CN108156520A (en) * 2017-12-29 2018-06-12 珠海市君天电子科技有限公司 Video broadcasting method, device, electronic equipment and storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150119142A1 (en) * 2013-10-28 2015-04-30 Nvidia Corporation Gamecasting techniques
US20150290540A1 (en) * 2014-04-15 2015-10-15 Microsoft Corporation Positioning a camera video overlay on gameplay video
CN104410916A (en) * 2014-12-03 2015-03-11 广州华多网络科技有限公司 On-line living broadcast method and equipment
CN104822077A (en) * 2014-12-04 2015-08-05 腾讯科技(北京)有限公司 Client operating method and client
CN105791958A (en) * 2016-04-22 2016-07-20 北京小米移动软件有限公司 Method and device for live broadcasting game
CN105933778A (en) * 2016-06-17 2016-09-07 北京奇虎科技有限公司 Live broadcast method and device based on screen contents of terminal
CN106230841A (en) * 2016-08-04 2016-12-14 深圳响巢看看信息技术有限公司 A kind of video U.S. face and the method for plug-flow in real time in network direct broadcasting based on terminal
CN106303329A (en) * 2016-08-11 2017-01-04 广州爱九游信息技术有限公司 Record screen live broadcasting method and device, mobile device and live broadcast system
CN106559696A (en) * 2016-12-01 2017-04-05 北京小米移动软件有限公司 Method for sending information and device
CN107105315A (en) * 2017-05-11 2017-08-29 广州华多网络科技有限公司 Live broadcasting method, the live broadcasting method of main broadcaster's client, main broadcaster's client and equipment
CN108024123A (en) * 2017-11-08 2018-05-11 北京密境和风科技有限公司 A kind of live video processing method, device, terminal device and server
CN107948702A (en) * 2017-11-21 2018-04-20 广州酷狗计算机科技有限公司 Synchronous method, device, terminal and the storage medium of Application Status
CN108156520A (en) * 2017-12-29 2018-06-12 珠海市君天电子科技有限公司 Video broadcasting method, device, electronic equipment and storage medium

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111447353A (en) * 2019-01-16 2020-07-24 北京字节跳动网络技术有限公司 Image acquisition method and device, electronic equipment and storage medium
CN111447353B (en) * 2019-01-16 2022-06-24 北京字节跳动网络技术有限公司 Image acquisition method and device, electronic equipment and storage medium
CN109862385A (en) * 2019-03-18 2019-06-07 广州虎牙信息科技有限公司 Method, apparatus, computer readable storage medium and the terminal device of live streaming
CN110113307A (en) * 2019-04-01 2019-08-09 视联动力信息技术股份有限公司 A kind of method and apparatus of live streaming
CN110049245A (en) * 2019-04-22 2019-07-23 联想(北京)有限公司 Information processing method and electronic equipment
CN110139030A (en) * 2019-04-24 2019-08-16 薄涛 Mixed reality processing system, method, server and its storage medium
CN112019907A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast picture distribution method, computer equipment and readable storage medium
CN113014960A (en) * 2019-12-19 2021-06-22 腾讯科技(深圳)有限公司 Method, device and storage medium for online video production
CN111147353A (en) * 2019-12-23 2020-05-12 网易(杭州)网络有限公司 Method and device for identifying friend, computer storage medium and electronic equipment
CN111147353B (en) * 2019-12-23 2022-04-08 网易(杭州)网络有限公司 Method and device for identifying friend, computer storage medium and electronic equipment
CN111760266A (en) * 2020-07-01 2020-10-13 网易(杭州)网络有限公司 Game live broadcast method and device and electronic equipment
CN112073641A (en) * 2020-09-18 2020-12-11 深圳市众志联城科技有限公司 Image shooting method and device, mobile terminal and storage medium
CN112148901A (en) * 2020-09-22 2020-12-29 上海连尚网络科技有限公司 Editing method and device of live stream
CN112637624A (en) * 2020-12-14 2021-04-09 广州繁星互娱信息科技有限公司 Live stream processing method, device, equipment and storage medium
CN112788358B (en) * 2020-12-31 2022-02-18 腾讯科技(深圳)有限公司 Video live broadcast method, video sending method, device and equipment for game match
CN112788358A (en) * 2020-12-31 2021-05-11 腾讯科技(深圳)有限公司 Video live broadcast method, video sending method, device and equipment for game match
WO2022147931A1 (en) * 2021-01-06 2022-07-14 网易(杭州)网络有限公司 Method and apparatus for displaying skill special effect in game
CN112619138A (en) * 2021-01-06 2021-04-09 网易(杭州)网络有限公司 Method and device for displaying skill special effect in game
CN112770135B (en) * 2021-01-21 2021-12-10 腾讯科技(深圳)有限公司 Live broadcast-based content explanation method and device, electronic equipment and storage medium
CN112770135A (en) * 2021-01-21 2021-05-07 腾讯科技(深圳)有限公司 Live broadcast-based content explanation method and device, electronic equipment and storage medium
CN113115115A (en) * 2021-03-05 2021-07-13 广州虎牙科技有限公司 Message pushing method and device, electronic equipment and computer-readable storage medium
CN113114931A (en) * 2021-03-28 2021-07-13 大运汽车股份有限公司 Remote photographing control method in automobile
CN113630614A (en) * 2021-08-09 2021-11-09 广州虎牙科技有限公司 Game live broadcast method, device, system, electronic equipment and readable storage medium
CN113709519A (en) * 2021-08-27 2021-11-26 上海掌门科技有限公司 Method and equipment for determining live broadcast shielding area
CN113709519B (en) * 2021-08-27 2023-11-17 上海掌门科技有限公司 Method and equipment for determining live broadcast shielding area
CN113852833A (en) * 2021-08-30 2021-12-28 阿里巴巴(中国)有限公司 Multi-device collaborative live broadcast method and device and electronic device
CN113852833B (en) * 2021-08-30 2024-03-22 阿里巴巴(中国)有限公司 Multi-device collaborative live broadcast method and device and electronic device
CN114222149A (en) * 2021-11-17 2022-03-22 武汉斗鱼鱼乐网络科技有限公司 Plug flow method, device, medium and computer equipment
CN113938753B (en) * 2021-12-20 2022-04-26 北京搜狐新动力信息技术有限公司 Live broadcast data processing method and device, storage medium and equipment
CN113938753A (en) * 2021-12-20 2022-01-14 北京搜狐新动力信息技术有限公司 Live broadcast data processing method and device, storage medium and equipment
CN115086745A (en) * 2022-06-30 2022-09-20 北京字跳网络技术有限公司 Live video processing method, device, equipment and medium
CN115086745B (en) * 2022-06-30 2024-01-23 北京字跳网络技术有限公司 Live video processing method, device, equipment and medium

Similar Documents

Publication Publication Date Title
CN108989830A (en) A kind of live broadcasting method, device, electronic equipment and storage medium
WO2021175055A1 (en) Video processing method and related device
CN109327727B (en) Live stream processing method in WebRTC and stream pushing client
CN107105315A (en) Live broadcasting method, the live broadcasting method of main broadcaster's client, main broadcaster's client and equipment
JP6397911B2 (en) Video broadcast system and method for distributing video content
CN110290425A (en) A kind of method for processing video frequency, device and storage medium
CN111970532B (en) Video playing method, device and equipment
US11450044B2 (en) Creating and displaying multi-layered augemented reality
CN111083515B (en) Method, device and system for processing live broadcast content
CN106713942B (en) Video processing method and device
CN111491174A (en) Virtual gift acquisition and display method, device, equipment and storage medium
CN108683826A (en) Video data handling procedure, device, computer equipment and storage medium
US9172943B2 (en) Dynamic modification of video content at a set-top box device
CN107529091B (en) Video editing method and device
CN110784733B (en) Live broadcast data processing method and device, electronic equipment and readable storage medium
CN111937397A (en) Media data processing method and device
CN113115110B (en) Video synthesis method and device, storage medium and electronic equipment
CN107040808B (en) Method and device for processing popup picture in video playing
CN106604127A (en) Multimedia information sharing method, device and terminal device
CN104602127A (en) Method and system for synchronously playing directed videos and video director
CN114095744B (en) Video live broadcast method and device, electronic equipment and readable storage medium
CN113747240B (en) Video processing method, apparatus and storage medium
CN113099245A (en) Panoramic video live broadcast method, system and computer readable storage medium
CN109286760B (en) Entertainment video production method and terminal thereof
CN110418078A (en) Video generation method, device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181211

RJ01 Rejection of invention patent application after publication