Embodiment
Hereinafter also describe the present invention in detail with reference to accompanying drawing in conjunction with the embodiments.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.
Figure 1 shows that the flow chart of the Online class instructor in broadcasting control method that preferred embodiment according to the present invention provides.As shown in Figure 1, the Online class instructor in broadcasting control method that preferred embodiment of the present invention provides comprises step 102 ~ 106.
In step 102, parameter management equipment arranges the splicing parameter being used for video-splicing and the presetting bit parameter being used for motion target tracking according to the multichannel first video data setting of input, and splicing parameter is sent to video-splicing control appliance, and presetting bit parameter is sent to motion target tracking equipment.
In step 104, motion target tracking equipment is when multichannel first video data based on input detects moving target, according to presetting bit state modulator tracking camera, moving target is followed the tracks of, and the second video data of comprising moving target is notified video-splicing control appliance as main video data.Wherein, the second video data of moving target and the video data of controlled above-mentioned tracking camera collection is comprised.
In step 106, video-splicing control appliance splices multichannel second video data according to splicing parameter and main video data, obtains composite video data, and composite video data are sent to outside.
Before normal operation, need to debug system, the setting of some parameters is mainly completed, such as presetting bit parameter (comprising the boundary line information between partition information, region), splicing parameter (comprising splicing masterplate, window size information) in debug process.
Need when arranging presetting bit parameter to use the first video data, it is the video data that positioning analysis camera obtains that this first video data can be understood as, this positioning analysis camera can obtain the picture of specific region scene, the picture in such as region, dais, the picture in student region.The dividing condition in region can be determined according to this first video data.After setting parameter, give corresponding equipment to perform follow-up processing procedure these Parameter transfer.
Motion target tracking equipment is followed the tracks of moving target according to the presetting bit state modulator tracking camera pre-set, if such as detect that student district has student walking about, then motion target tracking equipment controls tracking camera immediately and rotates, student tracking camera being followed the tracks of walk about.Wherein, motion target tracking equipment detects whether have moving target according to the first video data, then the second video data comprising this moving target is informed to video-splicing control appliance, this second video data can be understood as the video data that tracking camera obtains.
The presetting bit parameter preset likely has error or does not consider actual conditions, therefore, additionally provides a kind of scheme of dynamic conditioning tracking camera tracing area in the present embodiment:
If motion target tracking module detects that the number of times of the boundary line that moving target is crossed between region is greater than preset value within a predetermined period of time, then notifying parameters management equipment with boundary line for benchmark to move region that predeterminable range formed as transitional region to both sides.
As shown in Figure 2, solid line is the original Region dividing line arranged, classroom is divided into region A, B, C, motion target tracking module can add up the number of times that moving target crosses over boundary line between region, if detect in such as one minute in certain hour section student back and forth through the boundary line between region A and region B and total degree more than 10 times, to illustrate that on this borderline region student movement is comparatively frequent, then using this boundary line for benchmark to move region that predeterminable range (such as 1 meter) formed as transitional region (shadow region 202 see in Fig. 2) to both sides.After determining transitional region, tracking camera can be made not monitor this transitional region, tracking camera can be avoided like this in the process of following the tracks of the moving target in transitional region to carry out back rotation, thus reduce the useful life of video camera.
In order to improve the intelligent of Online class instructor in broadcasting control system, also add some carry out splicing adjustment function to video data in the present embodiment, as described below:
Remote controller guide broadcast message treatment facility sends first mode switching command;
Instructor in broadcasting's message processing device is after receiving first mode switching command, and notice video-splicing control appliance carries out splicing adjustment;
Video-splicing control appliance, after receiving the notice from instructor in broadcasting's message processing device, adjusts the video data of the major-minor video data difference correspondence in composite video data.
Such as, remote controller is provided with first mode switching push button, first mode refers to the pattern of exchanging major-minor video data, if teacher wishes that major-minor video data swaps round, the first mode switching push button on remote controller can be triggered, remote controller guide broadcast message treatment facility sends first mode switching command, instructor in broadcasting's message processing device and then notice video-splicing control appliance carry out splicing adjustment, major-minor video exchanged by video-splicing control appliance, suppose that current is the splicing form of picture-in-picture, before adjustment, key frame is teacher's picture, auxiliary picture is PPT picture, now teacher explains is to a certain section of picture of PPT, PPT can be seen clearly to allow student, teacher triggers first mode switching push button by remote controller, execution result is as key frame using PPT picture, using teacher's picture as auxiliary picture.Certainly, if teacher continues the first mode switching push button pressed on remote controller, spliced video pictures can revert to again original major-minor video data, and namely key frame is teacher's picture, and auxiliary picture is PPT picture.
In addition, the another kind splicing adjustment function of increase is as described below:
Remote controller guide broadcast message treatment facility sends the second pattern switching command;
Instructor in broadcasting's message processing device is after receiving the second pattern switching command, and former splicing parameter is replaced with the splicing parameter corresponding with the second pattern switching command by notice video-splicing control appliance;
Video-splicing control appliance splices multichannel second video data (such as, corresponding to the video data of teacher, corresponding to the video data of speech student, the video data corresponding to PPT) according to the splicing parameter after renewal and main video data.
Such as, remote controller is also provided with the second pattern switching command, it is the pattern (for the ease of understanding, splicing parameter herein can be understood as splice template) changing splicing parameter that the second pattern can be understood as.Suppose that current video-splicing template is the form of picture-in-picture, teacher wishes to see teacher's picture, PPT picture and speech student picture on one display simultaneously, at this moment the second mode switch button on remote controller can be triggered, video-splicing control appliance is after receiving notice, picture-in-picture form is switched to 3 panes form, and what show screen display like this is exactly the picture be made up of teacher's picture, PPT picture and speech student picture.
In addition, described parameter management equipment can also arrange image trace speed, and image trace speed data is sent to motion target tracking equipment; Motion target tracking equipment controls tracking camera according to image trace speed data and follows the tracks of moving target.
In order to can fast initialization when next time starts, can the described splicing parameter arranged, described presetting bit parameter and described image trace speed data be kept in the configuration file in described parameter management equipment;
When system restart, read described splicing parameter, presetting bit parameter and the image trace speed data in configuration file and distinguish initialize motion target following equipment and video-splicing control appliance according to the data read.
The intelligent director system of Based PC framework, software architecture, two large divisions can be comprised: intelligent instructor in broadcasting's program and audio frequency and video high definition plug-in unit, intelligence instructor in broadcasting program is with stealth mode at backstage independent operating when normal operation, for realizing controlling and according to intelligent instructor in broadcasting's strategy etc. of teaching scene from motion tracking, video pictures splicing of moving target; Audio frequency and video high definition plug-in component operation is in browser environment, belong to a part for straight recording and broadcasting system platform, be mainly used in the network transmission function realizing audio frequency and video, wherein, before Video coding, the instruction sent according to intelligent instructor in broadcasting's program is needed to complete the splicing function of multi-channel video picture.
Figure 3 shows that the schematic diagram of the Online class instructor in broadcasting control system that another preferred embodiment according to the present invention provides.
As can be seen from Figure 3, in Online class instructor in broadcasting control system of the present invention, traditional image trace main frame and recorded broadcast main frame are all replaced by a PC, and it at least comprises multi-path high-definition video signal collecting card 302, multichannel SD video frequency collection card 304, video card 306, remote signal receiver 308 on hardware.
Wherein, multi-path high-definition video frequency collection card 302 is used for collection three road high-definition video signal, is respectively teacher's tracking camera image, student trace camera review and teaching electronic brain VGA signal.Be to support that three road high-definition video signals gather to the requirement of this capture card simultaneously, collect vision signal for video-splicing.
Multichannel SD video frequency collection card 304 is used for the clear vision signal of collection 4 road sign, wherein 2 tunnels are used for the analysis of teacher's track and localization, 2 tunnels are used for student trace positioning analysis, be to support that the clear vision signal of 4 road sign gathers to the requirement of this capture card simultaneously, collect the tracking of vision signal for moving target.
The amount of calculation related to due to motion target tracking location algorithm and video-splicing function is very large, and realizing CPU usage with pure software can be higher, thus affects the performance of recorded broadcast function, and system may be caused time serious normally smoothly to run.Therefore, the mode that have employed GPU hardware acceleration for the functional module that these amounts of calculation are larger realizes, to reach the object improving overall system performance.Therefore have employed 2 pieces of video cards 306, is one piece of integrated graphics card and one piece of display card respectively.Wherein, integrated graphics card is used for video-splicing, and display card is used for the tracking of moving target.
In order to improve the ease for use of system, introducing the manual instructor in broadcasting's function taking remote controller as carrier, with to the full extent close to the effect of truly attending class, having reduced the interference to the normal teaching process of teacher.
Like this, teacher can be switched to corresponding teaching scene mode comparatively easily according to the sight of attending class, and changes video pictures Splicing model, meets the demand of teaching scene.
Figure 4 shows that the schematic diagram of the Online class instructor in broadcasting control system that another preferred embodiment according to the present invention provides.Online class instructor in broadcasting control system in the present embodiment mainly comprises two parts: control section 400A and execution part 400B, wherein, control section mainly comprises: instructor in broadcasting's control module 406, equipment trace debug module 404, parameter configuration management module 402, manual instructor in broadcasting's message processing module 408, motion target tracking module 412, video-splicing control module 410, first video acquisition module 416, cradle head control module 418, first interprocess communication module 414.Perform part 400B mainly to comprise: instructor in broadcasting's message processing module 420, second interprocess communication module 422, second video acquisition module 424, video-splicing module 426 and video encoding module 428.
Online class instructor in broadcasting control system has two kinds of mode of operations: equipment debugging pattern and intelligent guided mode.
Under equipment debugging pattern, the main working process of Online class instructor in broadcasting control system:
First video acquisition module 416 gathers vision signal (the such as vision signal of positioning analysis camera and the vision signal of tracking camera), the vision signal of collection is sent to motion target tracking module 412 by the first video acquisition module 416, equipment trace debug module 404 can acquire each road video signal image by instructor in broadcasting's control module 406 from motion target tracking module 142, and various image trace parameter is set (such as, the presetting bit parameter of video camera and image trace speed) and video-splicing parameter, wherein image trace parameter can be set to motion target tracking module 412, and video-splicing parameter can be set to video-splicing control module 410, splicing parameter can be set to the video-splicing module 426 performed in part 400B by video-splicing control module 410 by the first interprocess communication module 414, thus the control realized video-splicing picture.
These parameters also can be saved in configuration file by parameter configuration management module 402, so that the parameter that system log (SYSLOG) is arranged; When reopening intelligent instructor in broadcasting's program, the configuration parameter before automatically reading from configuration file, and key parameter is checked, to judge that whether parameter effective; If effectively, then use the parameter of reading to carry out each functional module of initialization system, and automatically enter into intelligent guided mode, with Stealth Modus at running background; If invalid parameters, then enter into equipment debugging pattern, need to reset effective parameter.
Under intelligent guided mode, the main working process of Online class instructor in broadcasting control system:
Motion target tracking module 412 is according to according to the moving object detection result in teacher's tracing area and student trace region, by cradle head control module 418 actuated camera, Faculty and Students are followed the tracks of, and automatically can produce instructor in broadcasting's signal, this Autoconducting signal (instruction comprises the video signal information of moving target) is sent to instructor in broadcasting's control module 406, to realize the automatic switchover of instructor in broadcasting's picture, as detected, there is moving target in student region, then be preferentially switched to the splicing instruction that student trace video camera is main video-splicing picture; When student's regional movement target disappears, then generate and be switched to the splicing instruction that teacher's tracking camera is main video-splicing picture.
Instructor in broadcasting's control module 406 sends instructor in broadcasting's instruction to video-splicing control module 410 after receiving Autoconducting signal, and this instructor in broadcasting's instruction comprises information vision signal as key frame.Frequently, after splicing control module 410 receives instructor in broadcasting's instruction, send video-splicing instruction by the first interprocess communication module 414, the information that this video-splicing instruction comprises at least comprises: the size of splice template, window and size, main video signal.
After the video-splicing module 426 performed in part 400B receives this splicing instruction, splice according to the splice template of specifying, and using the vision signal of specifying as main video signal, the vision signal of collection is sent to video-splicing module 426 by the second video acquisition module 424, such as picture-in-picture template, the video data obtained by student trace video camera is as main video data, and the video data that teacher's tracking camera obtains is as auxiliary video data.Spliced data send to outside by network after the coding of video encoding module 428.
In teaching process, teacher can switch teaching scene by the Web page of remote controller or straight recording and broadcasting system, at this moment, instructor in broadcasting's message processing module 420 can generate teaching pattern switching signal, and by the second interprocess communication module 422, its signal is sent to manual instructor in broadcasting's message processing module 408, then, manual instructor in broadcasting's message processing module 408 can generate manual instructor in broadcasting's signal according to teaching scene, and this manual instructor in broadcasting's signal is sent to instructor in broadcasting's control module 406, instructor in broadcasting's control module 406 sends instructor in broadcasting's instruction to video-splicing control module 410.Video-splicing control module 410 and then video-splicing instruction is sent to video-splicing module 426 by the first interprocess communication module 414, second interprocess communication module 422, video-splicing module can complete the splicing of video pictures according to command request, such as switch major-minor video, or change splice template.
Figure 5 shows that the schematic diagram of the Online class instructor in broadcasting control system that another preferred embodiment according to the present invention provides.
In the present embodiment, Online class instructor in broadcasting control system comprises:
Parameter management equipment 502, be connected to motion target tracking equipment 504 and video-splicing control appliance 506, the splicing parameter being used for video-splicing and the presetting bit parameter being used for motion target tracking according to the multichannel first video data setting of input are set, and described splicing parameter is sent to video-splicing control appliance, and described presetting bit parameter is sent to motion target tracking equipment;
Described motion target tracking equipment 504, receive the presetting bit parameter from described parameter management equipment, when multichannel first video data based on input detects moving target, according to described presetting bit state modulator tracking camera, described moving target is followed the tracks of, and the second video data of comprising described moving target is notified described video-splicing control appliance as main video data;
Described video-splicing control appliance 506, after receiving the notice from described motion target tracking equipment, according to described splicing parameter and described main video data, described multichannel second video data is spliced, obtain composite video data, and described composite video data are sent to outside.
Compared to prior art, according to the long-range director method of Online class provided by the invention and system, Based PC framework is high is integrated with the function such as moving target automatic tracking, video pictures intelligent connecting, and the integrated level of system is greatly improved; Simultaneously due to Based PC framework, be that all more original independently embedded product has superiority in the flexibility of hardware performance and software development.
These are only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.