CN106603912A - Video live broadcast control method and device - Google Patents
Video live broadcast control method and device Download PDFInfo
- Publication number
- CN106603912A CN106603912A CN201611104572.XA CN201611104572A CN106603912A CN 106603912 A CN106603912 A CN 106603912A CN 201611104572 A CN201611104572 A CN 201611104572A CN 106603912 A CN106603912 A CN 106603912A
- Authority
- CN
- China
- Prior art keywords
- view
- video camera
- finding
- point
- interest
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Abstract
The invention discloses a video live broadcast control method and device. The method includes: obtaining a video image input signal of positioning cameras, and obtaining position information of a point of interest in an image according to the video image input signal; according to the obtained position information of the point of interest, calculating shooting parameters of the view-finding cameras and generating a control signal, and controlling the view-finding cameras to perform shooting according to the shooting parameters; obtaining shooting pictures of the plurality of view-finding cameras, and calculating the suitability degree of the pictures shot by the view-finding cameras; and outputting one or more paths of shot pictures in the plurality of view-finding cameras according to a switching control strategy. Through the video live broadcast control method provided by the invention, automatic control of multi-camera video live broadcasting can be realized.
Description
Technical field
The present invention relates to video display arts field, more particularly to a kind of net cast automatically switched for many seats in the plane
Control method and device.
Background technology
In existing multimachine digital video live broadcast system, multiple video cameras are commonly equipped with from multiple angle shot stage pictures, so
Select the picture effect using most suitable video camera live afterwards.In order to reach the effect of multiple angle shots, need in difference
Location arrangements multiple cameras difference shooting picture, each video camera is equipped with photographer, and the performer tracked on stage claps
Take the photograph, and share out the work and help one another, such as someone is responsible for close shot feature, someone is responsible for stage overall picture, and the picture of multiple video cameras is final all
Instructor in broadcasting's platform is input to, and instructor in broadcasting's platform is furnished with instructor in broadcasting, the picture effect of each video camera is watched by instructor in broadcasting, then according to performer on stage
Position and facial direction, exporting most suitable camera views is used to broadcast.
It can be seen that, in existing many seat in the plane direct seeding techniques, as each video camera needs to be equipped with artificial track up, instructor in broadcasting's platform
Outfit artificial screening is needed to go out suitable picture for broadcasting, this is accomplished by the team of a complete shooting instructor in broadcasting of specialty, into
This is higher, also cannot automatization, it is less efficient.
The content of the invention
To overcome the shortcomings of that above-mentioned prior art is present, the purpose of the present invention is to provide a kind of live video control
And device, the automatization live to realize multimachine digital video.
It is that, up to above-mentioned purpose, the present invention proposes a kind of live video control, comprises the steps：
Step one, obtains the video image input signal of positioning shooting machine, obtains figure according to the video image input signal
The positional information of the point of interest as in；
Step 2, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view and produces
Control signal, each video camera of finding a view of control are shot according to acquisition parameters；
Step 3, obtains multiple stage and finds a view the shooting picture of video camera, calculate the suitable of each shot by camera picture of finding a view
It is right；
Step 4, according to a switching control strategy, output multiple stage is found a view one or more shooting picture in video camera.
Further, in step one, video image is obtained using the Background difference to video image motion object detection
In moving target be point of interest, the Geometric center coordinates of the minimum area-encasing rectangle of the moving target are the position of the point of interest
Information.
Further, in step 2, the acquisition parameters include shooting direction parameter or/and zooming parameter.
Further, the shooting direction parameter is the shooting direction angle of video camera of finding a view, by the point of interest
The position of positional information and default video camera of finding a view obtains.
Further, the zooming parameter by the shooting angle of video camera of finding a view and moving target in camera position
Visual angle obtains, and the moving target is on two diagonal tops of the minimum area-encasing rectangle that the visual angle of camera position is the moving target
Point and the angle found a view between video camera.
Further, step 3 is further included：
Calculate the point of interest region of acquired shooting picture；
Point of interest region according to obtaining is calculated the actual interest point accounting of shooting picture；
Calculate according to the actual interest point accounting and default expectation point of interest accounting
The fitness of picture.
Further, use duration and each find a view shooting of the switching control strategy according to each video camera of finding a view
The fitness of picture captured by machine, selects corresponding shooting picture output.
Further, the switching control strategy includes following 1) to one or more in 4)：
If 1) currently find a view video camera continuously using beyond most long patient time, be switched to fitness highest other
Find a view video camera；
If 2) have the fitness of other video cameras of finding a view beyond fitness and the shooting of currently finding a view of video camera of currently finding a view
And this threshold value is used more than minimum using duration, then be switched to fitness highest other video cameras of finding a view；
If 3) having this of video camera of finding a view, to account for total ratio for using duration using duration less than lowest tolerated value and current
Find a view video camera this use duration more than it is minimum use threshold value when, then be switched to this using the most short shooting of finding a view of duration
Machine；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value when, no matter fitness, all
Do not carry out finding a view the switching of video camera shooting picture.
Further, the positioning shooting machine is carried out shooting using thermal camera and infrared light compensating lamp and obtains the video
Image.
To reach above-mentioned purpose, the present invention also provides a kind of net cast control device, including：
Positioning unit, for obtaining the video image input signal of positioning shooting machine, according to the video image input signal
Obtain the positional information of the point of interest in image；
Control unit, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view and produces
Raw control signal, each video camera of finding a view of control are shot according to acquisition parameters；
Fitness processing unit, obtains multiple stage and finds a view the shooting picture of video camera, calculate each shot by camera of finding a view
The fitness of picture；
Output select unit, for according to a switching control strategy, export that multiple stage finds a view in video camera one or more
Shooting picture.
Further, the fitness processing unit is further included：
Point of interest area calculation unit, for calculating the point of interest region of acquired shooting picture；
Actual interest point accounting computing unit, for the reality for being calculated the shooting picture according to the point of interest region for obtaining
Border point of interest accounting；
Fitness computing unit, calculates and respectively takes according to the actual interest point accounting and default expectation point of interest accounting
The fitness of scape shot by camera picture.
Further, use duration and each find a view shooting of the switching control strategy according to each video camera of finding a view
The fitness of picture captured by machine, selects corresponding shooting picture output.
Further, the switching control strategy includes following 1) to one or more in 4)：
If 1) currently find a view video camera continuously using beyond most long patient time, be switched to fitness highest other
Find a view video camera；
If 2) have the fitness of other video cameras of finding a view beyond fitness and the shooting of currently finding a view of video camera of currently finding a view
And this threshold value is used more than minimum using duration, then be switched to fitness highest other video cameras of finding a view；
If 3) having this of video camera of finding a view, to account for total ratio for using duration using duration less than lowest tolerated value and current
Find a view video camera this use duration more than it is minimum use threshold value when, then be switched to this using the most short shooting of finding a view of duration
Machine；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value when, no matter fitness, all
Do not carry out finding a view the switching of video camera shooting picture.
Compared with prior art, a kind of live video control of the invention and device are believed by obtaining the position of point of interest
Breath, goes out the acquisition parameters of each video camera of finding a view according to the positional information calculation of point of interest and produces corresponding control signal control
Each video camera of finding a view, calculates the appropriate degree of each computer of finding a view to the shooting picture of each computer of finding a view, and according to one
Switching control strategy selects one or more shooting picture to export, and realizes and multiple cameras are automatically controlled, improve and regard
Frequently live efficiency, is particularly suitable for the scene of self-help service.
Description of the drawings
Fig. 1 is part noun exemplary plot in the present invention；
The step of Fig. 2 is a kind of live video control of first embodiment of the invention flow chart；
Fig. 3 is point of interest location information schematic diagram in the specific embodiment of the invention；
Fig. 4 is shooting direction schematic diagram in the specific embodiment of the invention；
Point of interest area schematics of the Fig. 5 for video camera shooting picture of finding a view in the specific embodiment of the invention；
Structural representations of the Fig. 6 for a kind of net cast control device of second embodiment of the invention；
Fig. 7 is the detail structure chart of fitness processing unit 603 in the specific embodiment of the invention；
The top view and front view of the video living transmission system that Fig. 8 and Fig. 9 is applied by the specific embodiment of the invention；
Figure 10 is net cast control device application situation schematic diagram in the specific embodiment of the invention.
Specific embodiment
Below by way of specific instantiation and embodiments of the present invention are described with reference to the drawings, those skilled in the art can
The further advantage and effect of the present invention are understood easily by content disclosed in the present specification.The present invention also can be different by other
Instantiation implemented or applied, the every details in this specification also can based on different viewpoints with application, without departing substantially from
Various modifications and change are carried out under the spirit of the present invention.
Before the present invention is introduced, Fig. 1 is first coordinated to be explained as follows some nouns used in the present invention：
Shooting direction:Represent which direction video camera is shot toward three dimensions；
Scaling：Represent the scaling of camera lens；
Point of interest accounting:Represent that point-of-interest (such as face) accounts for the ratio of whole picture area, such as accounting is fewer, illustrates this
Video camera is more likely to photographing panoramic picture；
Default point of interest accounting:Represent the percentage ratio for expecting that the point of interest of video camera shooting accounts for picture area；
Actual interest point accounting:Represent that the point of interest of actual video camera shooting accounts for the percentage ratio of picture area；
Duration is used always:Represent how long current camera, in live, has been used to live picture；
This uses duration:After expression is switched to oneself, how long experienced, it is -1 currently not use then value.
The step of Fig. 2 is a kind of live video control of first embodiment of the invention flow chart.As shown in Fig. 2 this
A kind of live video control is invented, is comprised the steps：
Step 201, obtains the video image input signal of positioning shooting machine, obtains figure according to the video image input signal
The positional information of the point of interest as in.
In the specific embodiment of the invention, video image is obtained using the Background difference to video image motion object detection
In point of interest the band of position.The basic thought of Background difference is that one frame picture of input regards background image, by present image
It is compared with background image, moving target is isolated from background, the target of motion is point of interest, the position letter of point of interest
The Geometric center coordinates of the minimum area-encasing rectangle of breath moving target are represented.
As a example by obtaining the point of interest location information of stage, as shown in Figure 3, it is assumed that stage size 1920*1080, the upper left corner
Elements of a fix origin (0,0), moving target top left co-ordinate (800, -400), length and width are all 100, then central area is (800+
100/2, -400+-100/2), as (850, -450).
As Background difference is disturbed larger by ambient light, in the specific embodiment of the invention, positioning shooting machine adopts infrared photography
Machine and infrared light compensating lamp are shot, and are not adopted visible light shooting, can so be eliminated the interference of visible ambient light.
Step 202, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view and produces
Control signal, each video camera of finding a view of control are shot according to acquisition parameters.
In this step, acquisition parameters include shooting direction or/and zooming parameter, and wherein shooting direction represents video camera of finding a view
Which shoot toward three dimensions direction, zooming parameter refers to find a view the lens zoom parameter of video camera.To below be described separately
The calculating of two parameters：
In this step, video camera shooting direction parameter of finding a view for each according to the position of point of interest and default takes
The position calculation of scape video camera obtains the shooting direction angle of video camera of finding a view.For example, find a view the direction angle, θ table of video camera
Show, towards stage upper left position as start angle, be 0 degree, it is positive direction to deflect to the right (i.e. clockwise), demarcate every first
Platform is found a view camera position and stage position, it is assumed that the stage upper left corner is for (0,0) point, stage are wide by 1080, long
1920, in (300, -1200) place, moving target minimum area-encasing rectangle is (800, -400) and (900, -500) institute group for position for video camera
Into rectangle, point of interest location is (850, -450) place, it is stipulated that each video camera is towards (0,0) angle put is 0 °, then shoot
Directioin parameter θ can be obtained by slope formula and angle formulae：
Slope formula is:K=(y2-y1)/(x2-x1)
Angle formulae is:Tan θ=| (k1-k2)/(1+k1*k2) |
In the specific embodiment of the invention, zero (0,0) point to video camera of finding a view (300, -1200) point straight line be
L1, according to slope computing formula this straight slope k1 be:-4；Point of interest (850, -450) point to video camera of finding a view (300, -
1200) it is L2 to put straight line, according to slope computing formula this straight slope k2 is:15/11, then straight line L1, the angle theta of L2 is：
Then shooting direction parameter be line with zero to video camera of finding a view as start line, 50.29 ° of sides clockwise
To.
In this step, for the zooming parameter of each video camera of finding a view, can be existed by the shooting angle/moving target of video camera
The visual angle of camera position is calculated, and the shooting angle of the video camera is the fixed value of video camera, is taken as in the present invention
90 °, two pair angular vertex (points of the moving target in the minimum area-encasing rectangle that the visual angle of camera position is moving target
(800, -400) and point (900, -500)) with the angle found a view between video camera, in the specific embodiment of the invention, equally may be used
According to above-mentioned slope and angle formulae, it is 8.6 ° to obtain moving target at the visual angle of camera position, then zooming parameter is 90/
8.6, about 10.
Step 203, obtains multiple stage and finds a view the shooting picture of video camera, calculate the suitable of each shot by camera picture of finding a view
It is right.
In the specific embodiment of the invention, step 203 is further included：
Step S1, calculates the point of interest region of acquired shooting picture.In this step, using the method for recognition of face
Quantity and the position of face in shooting picture are calculated, and are surrounded with minimum rectangle, this rectangular area is point of interest region,
As in Fig. 5, the point of interest region in shooting picture is 400*1600.
Step S2, is calculated the actual interest point accounting of the shooting picture according to the point of interest region for obtaining.The present invention
In, point of interest accounting refers to the ratio that point-of-interest (such as face) accounts for whole picture area, and such as accounting is fewer, illustrates the shooting
Machine is more likely to photographing panoramic picture, and actual interest point accounting then represents that the point of interest that the actual video camera shoots accounts for whole picture
The percentage ratio of area.As shown in fig. 5, it is assumed that stage size 1920*1080, the i.e. whole picture area are 1920*1080, if should
Point of interest region in shooting picture be 400*1600, then its actual point of interest accounting be (400*1600)/(1080*1920)=
30.8%.
Step S3, calculates according to actual interest point accounting and expectation point of interest accounting
Fitness.In the present invention, expect that point of interest accounting represents the percentage for expecting that the point of interest of video camera shooting accounts for picture area
Than, generally to preset, actual interest point accounting is obtained by step S2, and the fitness of captured picture is obtained by equation below
：
Fitness=1- | (expecting point of interest accounting-actual interest point accounting) |/expect point of interest accounting
In the specific embodiment of the invention, it is assumed that expect that point of interest accounting is 30%, then the fitness of the video camera be 1-|
(30%-30.8%) |=99.2%.
Step 204, according to a switching control strategy, output multiple stage is found a view one or more shooting picture in video camera.
Find a view in video camera multiple, needs are selected for live shooting of finding a view according to certain switching control strategy
Machine, make it is live go out existing multiple seats in the plane (angle) switching of picture, in picture, point of interest (personage) should be than more prominent.
In the specific embodiment of the invention, the switching control strategy be according to the use duration of each video camera of finding a view and
The fitness of each shot by camera picture of finding a view, selects optimum shooting picture output.Specifically, use duration here
Duration is used with this using duration including total, always current camera is represented in live using duration, have been used to live picture
Face how long；This is represented using duration and is switched to after oneself, how long be experienced, be not currently in using then its value for-
1.Specifically, the switching control strategy includes following 1) to 4) one or more：
If 1) video camera of currently finding a view then is switched to continuously using beyond most long patient time (default, such as 20 seconds)
Fitness highest other video cameras of finding a view；
If 2) have the fitness of other video cameras of finding a view beyond fitness and the shooting of currently finding a view of video camera of currently finding a view
And this threshold value (such as 5s) is used more than minimum using duration, then be switched to fitness highest other video cameras of finding a view；
If 3) this for having a video camera of finding a view accounts for total ratio for using duration less than lowest tolerated value (for example using duration
10%) and currently find a view video camera this use duration more than it is minimum use threshold value (such as 5s) when, then being switched to this makes
With the most short video camera of finding a view of duration；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value (such as 5s) when, no matter fitness
How, then do not carry out finding a view the switching of video camera.
By above-mentioned switching control strategy, it is ensured that as far as possible using fitness highest video camera, while will not lead
Cause camera lens long-time not switch, or Shot change is too fast causes film flicker.
Structural representations of the Fig. 6 for a kind of net cast control device of second embodiment of the invention.As shown in fig. 6, this
A kind of net cast control device is invented, including：Positioning unit 601, control unit 602, fitness processing unit 603 and defeated
Go out select unit 604.
Positioning unit 601, for obtaining the video image input signal of positioning shooting machine, according to the video image input letter
Number obtain image in point of interest positional information.
In the specific embodiment of the invention, positioning unit 601 is using the Background difference to video image motion object detection
Obtain the band of position of the point of interest in video image.The basic thought of Background difference is one frame picture of input as Background
Picture, present image and background image are compared, and moving target is isolated from background, and the target of motion is point of interest,
The Geometric center coordinates of the minimum area-encasing rectangle of the positional information moving target of point of interest are represented.
As Background difference is disturbed larger by ambient light, in the specific embodiment of the invention, positioning shooting machine adopts infrared photography
Machine and infrared light compensating lamp are shot, and are not adopted visible light shooting, can so be eliminated the interference of visible ambient light.
Control unit 602, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view simultaneously
Control signal is produced, each video camera of finding a view of control is shot according to acquisition parameters.
In the present invention, acquisition parameters include shooting direction or/and zooming parameter, and wherein shooting direction represents video camera of finding a view
Which shoot toward three dimensions direction, zooming parameter refers to find a view the lens zoom parameter of video camera.To below be described separately
The calculating of two parameters：
Each is found a view video camera shooting direction parameter, according to the position of point of interest and default video camera of finding a view
Position calculation obtains the shooting direction parameter of video camera of finding a view.For example, the shooting direction of video camera of finding a view represented with angle, θ, court
To stage upper left position as start angle, it is 0 degree, it is positive direction to deflect to the right (i.e. clockwise), and shooting direction parameter θ can
Obtained by angle formulae：
Angle formulae is:Tan θ=| (k1-k2)/(1+k1*k2) |
Wherein, (x1, y1) is that (0,0) slope of the point to camera coordinates point straight line of finding a view, k2 are emerging to zero for K1
Slope of the interest point position to camera coordinates point straight line of finding a view, slope k 1/k2 can be obtained by slope formula:K=(y2-y1)/
(x2-x1)。
For the zooming parameter of each video camera of finding a view, can be by the shooting angle/moving target of video camera in position for video camera
The visual angle put is calculated, and the shooting angle of the video camera is the fixed value of video camera, is taken as 90 °, the fortune in the present invention
Moving-target the visual angle of camera position for moving target minimum area-encasing rectangle two pairs of angular vertexs (point (800, -400) and
Point (900, -500)) with the angle found a view between video camera, in the specific embodiment of the invention, equally can according to above-mentioned slope and
Angle formulae, obtains moving target at the visual angle of camera position, will not be described here.
Fitness processing unit 603, finds a view the shooting picture of video camera for obtaining multiple stage, calculates each video camera of finding a view
The fitness of captured picture.
Fig. 7 is the detail structure chart of fitness processing unit 603 in the specific embodiment of the invention.It is embodied as in the present invention
In example, fitness processing unit 603 is further included：
Point of interest area calculation unit 6031, for calculating the point of interest region of acquired shooting picture.In the present invention
In specific embodiment, point of interest area calculation unit 6031 calculates face in shooting picture by the method using recognition of face
Quantity and position, and surrounded with minimum rectangle, this rectangular area is point of interest region；
Actual interest point accounting computing unit 6032, for being calculated the shooting picture according to the point of interest region for obtaining
Actual interest point accounting.In the present invention, point of interest accounting refers to the ratio that point-of-interest (such as face) accounts for whole picture area
Value, such as accounting is fewer, illustrates that the video camera is more likely to photographing panoramic picture, and actual interest point accounting then represents the actual shooting
The point of interest that machine shoots accounts for the percentage ratio of whole picture area.
Fitness computing unit 6033, calculates according to actual interest point accounting and expectation point of interest accounting
The fitness of picture captured by machine.In the present invention, expect that point of interest accounting is represented and expect that the point of interest that the video camera shoots accounts for picture
The percentage ratio of face area, generally presets, and actual interest point accounting is obtained by step S2, and the fitness of captured picture passes through
Equation below is obtained：
Fitness=1- | (expecting point of interest accounting-actual interest point accounting) |/expect point of interest accounting.
Output select unit 604, for according to a switching control strategy, output multiple stage finds a view all the way or many in video camera
Road shooting picture.
In the system that multiple stage finds a view video camera, needs are selected according to certain switching control strategy and are found a view for live
Video camera, make it is live go out existing multiple seats in the plane (angle) switching of picture, in picture, point of interest (personage) should be than more prominent.
In the specific embodiment of the invention, the switching control strategy be according to the use duration of each video camera of finding a view and
The fitness of each shot by camera picture of finding a view, selects suitable shooting picture output.Specifically, use duration here
Duration is used with this using duration including total, always current camera is represented in live using duration, have been used to live picture
Face how long；This is represented using duration and is switched to after oneself, how long be experienced, be not currently in using then its value for-
1.Specifically, the switching control strategy includes following 1) to 4) one or more：
If 1) video camera of currently finding a view then is switched to continuously using beyond most long patient time (default, such as 20 seconds)
Fitness highest other video cameras of finding a view；
If 2) have the fitness of other video cameras of finding a view beyond fitness and the shooting of currently finding a view of video camera of currently finding a view
And this use threshold value (such as 5s) using duration is minimum more than one, then be switched to fitness highest other shootings of finding a view
Machine；
If 3) this for having a video camera of finding a view accounts for total ratio for using duration less than lowest tolerated value (for example using duration
10%) and currently find a view video camera this use duration more than it is minimum use threshold value (such as 5s) when, then being switched to this makes
With the most short video camera of finding a view of duration；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value (such as 5s) when, no matter fitness
How, then do not carry out finding a view the switching of video camera.
By above-mentioned switching control strategy, it is ensured that found a view video camera using fitness highest as far as possible, while not
Camera lens long-time can be caused not switch, or Shot change is too fast causes film flicker.
The top view and front view of the video living transmission system that Fig. 8 and Fig. 9 is applied by the specific embodiment of the invention.At this
In bright specific embodiment, the system is applied to stage environment, including infrared light compensating lamp 80, positioning shooting machine (thermal camera)
81st, and some video camera 82 and net cast control devices 83 of finding a view.
Wherein, positioning shooting machine 81 is arranged at the top of stage, from top to shooting stage panorama, 80 oblique peace of infrared light compensating lamp
It is mounted in above stage, launches infrared light obliquely, infrared light naked eyes are invisible, do not affect stage-lighting effect, when people's (or motion
Object) on stage of walking about when, body or head can reflect infrared light to positioning shooting machine 81, and positioning shooting machine 81 can shoot
To one piece of speck, adjustment positioning shooting machine 81 so as to can photograph just whole stages, the wide high level of shooting picture resolution is fixed
Justice is stage width high level；Video camera 82 respectively find a view according to demand, stage surrounding, alignment stage central authorities, it is possible to shoot are distributed in
Stage panorama.
Figure 10 is net cast control device application situation schematic diagram in the specific embodiment of the invention.The net cast is controlled
Device includes positioning unit, control unit, fitness processing unit and output select unit, and positioning unit receives positioning shooting
The picture signal of machine, to each video camera output control signal of finding a view, the shooting picture of each video camera of finding a view is defeated for control unit
Go out to fitness processing unit and output select unit, live picture is exported according to switching selection strategy.
In sum, the positional information of a kind of live video control of the invention and device by acquisition point of interest, root
Go out the acquisition parameters of each video camera of finding a view and produce corresponding control signal according to the positional information calculation of point of interest and control each
Find a view video camera, the appropriate degree of each computer of finding a view is calculated to the shooting picture of each computer of finding a view, and according to a switching
Control strategy selects one or more shooting picture to export, and realizes and multiple cameras are automatically controlled, improve video straight
The efficiency broadcast, is particularly suitable for the scene of self-help service.
Any those skilled in the art can be repaiied to above-described embodiment under the spirit and the scope without prejudice to the present invention
Decorations and change.Therefore, the scope of the present invention, should be as listed by claims.
Claims (13)
1. a kind of live video control, comprises the steps：
Step one, obtains the video image input signal of positioning shooting machine, is obtained in image according to the video image input signal
Point of interest positional information；
Step 2, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view and produces control
Signal, each video camera of finding a view of control are shot according to acquisition parameters；
Step 3, obtains multiple stage and finds a view the shooting picture of video camera, calculate the fitness of each shot by camera picture of finding a view；
Step 4, according to a switching control strategy, output multiple stage is found a view one or more shooting picture in video camera.
2. a kind of live video control as claimed in claim 1, it is characterised in that：In step one, using to video
It is point of interest that the Background difference of image motion object detection obtains the moving target in video image, the most parcel of the moving target
The Geometric center coordinates for enclosing rectangle are the positional information of the point of interest.
3. a kind of live video control as claimed in claim 1, it is characterised in that：In step 2, the acquisition parameters
Including shooting direction parameter or/and zooming parameter.
4. a kind of live video control as claimed in claim 3, it is characterised in that：The shooting direction parameter is to find a view
The shooting direction angle of video camera, is obtained by the position of the positional information and default video camera of finding a view of the point of interest.
5. a kind of live video control as claimed in claim 3, it is characterised in that：The zooming parameter is taken the photograph by finding a view
The shooting angle of camera is obtained at the visual angle of camera position with moving target, and the moving target is at the visual angle of camera position
For two pairs of angular vertexs and the angle found a view between video camera of the minimum area-encasing rectangle of the moving target.
6. a kind of live video control as claimed in claim 1, it is characterised in that step 3 is further included：
Calculate the point of interest region of acquired shooting picture；
Point of interest region according to obtaining is calculated the actual interest point accounting of shooting picture；
Calculate according to the actual interest point accounting and default expectation point of interest accounting
Fitness.
7. a kind of live video control as claimed in claim 1, it is characterised in that：The switching control strategy is according to each
Platform is found a view the fitness of the use duration of video camera and each shot by camera picture of finding a view, and selects corresponding shooting picture
Output.
8. a kind of live video control as claimed in claim 7, it is characterised in that the switching control strategy include as
It is lower 1) to one or more in 4)：
If 1) continuously using beyond most long patient time, other find a view video camera of currently finding a view to be switched to fitness highest
Video camera；
If 2) have the fitness of other video cameras of finding a view beyond the fitness of video camera of currently finding a view and currently find a view shooting and
This uses threshold value more than minimum using duration, then be switched to fitness highest other video cameras of finding a view；
If 3) this for having a video camera of finding a view accounts for total ratio using duration using duration and is less than lowest tolerated value and currently finds a view
Video camera this using duration more than it is minimum using threshold value when, then be switched to this using the most short video camera of finding a view of duration；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value when, no matter fitness, do not enter
The switching of capable video camera shooting picture of finding a view.
9. a kind of live video control as claimed in claim 1, it is characterised in that：The positioning shooting machine is using infrared
Video camera and infrared light compensating lamp are carried out shooting and obtain the video image.
10. a kind of net cast control device, including：
Positioning unit, for obtaining the video image input signal of positioning shooting machine, obtains according to the video image input signal
The positional information of the point of interest in image；
Control unit, according to the positional information of the point of interest for obtaining, calculates the acquisition parameters of each video camera of finding a view and produces control
Signal processed, each video camera of finding a view of control are shot according to acquisition parameters；
Fitness processing unit, obtains multiple stage and finds a view the shooting picture of video camera, calculate each shot by camera picture of finding a view
Fitness；
Output select unit, finds a view one or more shooting in video camera for according to a switching control strategy, exporting multiple stage
Picture.
11. a kind of net cast control devices as claimed in claim 10, it is characterised in that fitness processing unit is further
Including：
Point of interest area calculation unit, for calculating the point of interest region of acquired shooting picture；
Actual interest point accounting computing unit, the reality for being calculated the shooting picture according to the point of interest region for obtaining are emerging
Interest point accounting；
Fitness computing unit, calculates respectively to find a view and takes the photograph according to the actual interest point accounting and default expectation point of interest accounting
The fitness of picture captured by camera.
12. net cast control devices as claimed in claim 10, it is characterised in that：The switching control strategy is according to each
Find a view the fitness of the use duration of video camera and each shot by camera picture of finding a view, select corresponding shooting picture defeated
Go out.
13. net cast control devices as claimed in claim 12, it is characterised in that the switching control strategy includes as follows
1) to one or more in 4)：
If 1) continuously using beyond most long patient time, other find a view video camera of currently finding a view to be switched to fitness highest
Video camera；
If 2) have the fitness of other video cameras of finding a view beyond the fitness of video camera of currently finding a view and currently find a view shooting and
This uses threshold value more than a minimum using duration, then be switched to fitness highest other video cameras of finding a view；
If 3) this for having a video camera of finding a view accounts for total ratio using duration using duration and is less than lowest tolerated value and currently finds a view
Video camera this using duration more than it is minimum using threshold value when, then be switched to this using the most short video camera of finding a view of duration；
If 4) currently find a view video camera this use duration less than it is minimum use threshold value when, no matter fitness, do not enter
The switching of capable video camera shooting picture of finding a view.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611104572.XA CN106603912B (en) | 2016-12-05 | 2016-12-05 | Video live broadcast control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611104572.XA CN106603912B (en) | 2016-12-05 | 2016-12-05 | Video live broadcast control method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106603912A true CN106603912A (en) | 2017-04-26 |
| CN106603912B CN106603912B (en) | 2020-09-11 |
Family
ID=58597023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611104572.XA Active CN106603912B (en) | 2016-12-05 | 2016-12-05 | Video live broadcast control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106603912B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124662A (en) * | 2017-05-10 | 2017-09-01 | 腾讯科技（上海）有限公司 | Net cast method, device, electronic equipment and computer-readable recording medium |
| CN107197320A (en) * | 2017-06-21 | 2017-09-22 | 北京小米移动软件有限公司 | Net cast methods, devices and systems |
| CN108521867A (en) * | 2017-07-18 | 2018-09-11 | 杭州他若信息科技有限公司 | It is voted based on remote audience and controls camera fields of view |
| CN110956106A (en) * | 2019-11-20 | 2020-04-03 | 广州华多网络科技有限公司 | Processing method, device, storage medium and equipment for live broadcast |
| CN111931564A (en) * | 2020-06-29 | 2020-11-13 | 北京大学 | Target tracking method and device based on face recognition |
| CN112423139A (en) * | 2020-11-20 | 2021-02-26 | 千脉文化传媒(上海)有限公司 | Multi-machine live broadcast method, system, equipment and storage medium based on mobile terminal |
| WO2021081756A1 (en) * | 2019-10-29 | 2021-05-06 | 苏州随闻智能科技有限公司 | Video image display method and apparatus |
| CN114979689A (en) * | 2022-05-05 | 2022-08-30 | 咪咕视讯科技有限公司 | Multi-machine position live broadcast directing method, equipment and medium |
| CN115223384A (en) * | 2021-03-29 | 2022-10-21 | 东风汽车集团股份有限公司 | Vehicle data display method and device, electronic equipment and storage medium |
| TWI794905B (en) * | 2021-04-20 | 2023-03-01 | 大陸商北京安博盛贏教育科技有限責任公司 | Method and apparatus for controlling video frame image in live classroom |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05328343A (en) * | 1992-05-19 | 1993-12-10 | Fujitsu Ltd | Multi-screen video conference system |
| CN101785306A (en) * | 2007-07-13 | 2010-07-21 | 坦德伯格电信公司 | Method and system for automatic camera control |
| CN102148965A (en) * | 2011-05-09 | 2011-08-10 | 上海芯启电子科技有限公司 | Video monitoring system for multi-target tracking close-up shooting |
| CN102300043A (en) * | 2010-06-23 | 2011-12-28 | 中兴通讯股份有限公司 | Method for adjusting meeting place camera of remote presentation meeting system |
| WO2016074123A1 (en) * | 2014-11-10 | 2016-05-19 | 深圳锐取信息技术股份有限公司 | Video generating method and device of video generating system |
-
2016
- 2016-12-05 CN CN201611104572.XA patent/CN106603912B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05328343A (en) * | 1992-05-19 | 1993-12-10 | Fujitsu Ltd | Multi-screen video conference system |
| CN101785306A (en) * | 2007-07-13 | 2010-07-21 | 坦德伯格电信公司 | Method and system for automatic camera control |
| CN102300043A (en) * | 2010-06-23 | 2011-12-28 | 中兴通讯股份有限公司 | Method for adjusting meeting place camera of remote presentation meeting system |
| CN102148965A (en) * | 2011-05-09 | 2011-08-10 | 上海芯启电子科技有限公司 | Video monitoring system for multi-target tracking close-up shooting |
| WO2016074123A1 (en) * | 2014-11-10 | 2016-05-19 | 深圳锐取信息技术股份有限公司 | Video generating method and device of video generating system |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124662A (en) * | 2017-05-10 | 2017-09-01 | 腾讯科技（上海）有限公司 | Net cast method, device, electronic equipment and computer-readable recording medium |
| CN107124662B (en) * | 2017-05-10 | 2022-03-18 | 腾讯科技（上海）有限公司 | Video live broadcast method and device, electronic equipment and computer readable storage medium |
| CN107197320A (en) * | 2017-06-21 | 2017-09-22 | 北京小米移动软件有限公司 | Net cast methods, devices and systems |
| CN108521867B (en) * | 2017-07-18 | 2020-10-30 | 杭州他若信息科技有限公司 | Controlling camera view based on remote audience voting |
| CN108521867A (en) * | 2017-07-18 | 2018-09-11 | 杭州他若信息科技有限公司 | It is voted based on remote audience and controls camera fields of view |
| WO2021081756A1 (en) * | 2019-10-29 | 2021-05-06 | 苏州随闻智能科技有限公司 | Video image display method and apparatus |
| CN114641984A (en) * | 2019-10-29 | 2022-06-17 | 苏州随闻智能科技有限公司 | Video image display method and device |
| CN110956106B (en) * | 2019-11-20 | 2023-10-10 | 广州方硅信息技术有限公司 | Live broadcast on-demand processing method, device, storage medium and equipment |
| CN110956106A (en) * | 2019-11-20 | 2020-04-03 | 广州华多网络科技有限公司 | Processing method, device, storage medium and equipment for live broadcast |
| CN111931564A (en) * | 2020-06-29 | 2020-11-13 | 北京大学 | Target tracking method and device based on face recognition |
| CN112423139A (en) * | 2020-11-20 | 2021-02-26 | 千脉文化传媒(上海)有限公司 | Multi-machine live broadcast method, system, equipment and storage medium based on mobile terminal |
| CN115223384A (en) * | 2021-03-29 | 2022-10-21 | 东风汽车集团股份有限公司 | Vehicle data display method and device, electronic equipment and storage medium |
| CN115223384B (en) * | 2021-03-29 | 2024-01-16 | 东风汽车集团股份有限公司 | Vehicle data display method and device, electronic equipment and storage medium |
| TWI794905B (en) * | 2021-04-20 | 2023-03-01 | 大陸商北京安博盛贏教育科技有限責任公司 | Method and apparatus for controlling video frame image in live classroom |
| US11812152B2 (en) | 2021-04-20 | 2023-11-07 | Beijing Ambow Shengying Education And Technology Co., Ltd. | Method and apparatus for controlling video frame image in live classroom |
| CN114979689A (en) * | 2022-05-05 | 2022-08-30 | 咪咕视讯科技有限公司 | Multi-machine position live broadcast directing method, equipment and medium |
| CN114979689B (en) * | 2022-05-05 | 2023-12-08 | 咪咕视讯科技有限公司 | Multi-machine-position live broadcast guide method, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106603912B (en) | 2020-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106603912A (en) | Video live broadcast control method and device | |
| US7535498B2 (en) | Electronic viewing device | |
| JP4153146B2 (en) | Image control method for camera array and camera array | |
| US10438633B2 (en) | Method and system for low cost television production | |
| CN112040092A (en) | Real-time virtual scene LED shooting system and method | |
| CN108289220B (en) | Virtual image processing method, image processing system, and storage medium | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| CN204481940U (en) | Binocular camera is taken pictures mobile terminal | |
| CN106550239A (en) | 360 degree of panoramic video live broadcast systems and its implementation | |
| US20130335520A1 (en) | Robotic Camera System with Context Display | |
| WO2003083773A3 (en) | Imaging method and system | |
| CN105072314A (en) | Virtual studio implementation method capable of automatically tracking objects | |
| WO2007142621A1 (en) | Modification of post-viewing parameters for digital images using image region or feature information | |
| JP2013514004A (en) | 3D recording and display system using proximal and distal focused images | |
| CN107734244B (en) | Panorama movie playback method and playing device | |
| CN105120247A (en) | White-balance adjusting method and electronic device | |
| JP2007086269A (en) | Camera system and focal length adjusting method of zoom lens optical system of camera system | |
| CN106131581A (en) | The panoramic video manufacturing technology of mixed image | |
| CN107016728A (en) | A kind of method and system that photography is simulated in virtual reality scenario | |
| JP2009081822A (en) | Data transmission device and method, and view environment control apparatus, system and method | |
| CN107659786A (en) | A kind of panoramic video monitoring device and processing method | |
| WO2005099248A3 (en) | Method and camera for simulating the optical effect of a lenticular grid hardcopy | |
| CN108848368A (en) | A kind of 3D image pickup method of VR video | |
| Mohanty | Source Attribution of Modern Multi-camera Smartphones. | |
| US20230379594A1 (en) | Image blending |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |