CN113422933B - Recording and broadcasting system, recording and broadcasting method and medium based on teaching - Google Patents
Recording and broadcasting system, recording and broadcasting method and medium based on teaching Download PDFInfo
- Publication number
- CN113422933B CN113422933B CN202110716118.4A CN202110716118A CN113422933B CN 113422933 B CN113422933 B CN 113422933B CN 202110716118 A CN202110716118 A CN 202110716118A CN 113422933 B CN113422933 B CN 113422933B
- Authority
- CN
- China
- Prior art keywords
- interface
- monitoring interface
- monitoring
- segmentation
- recording
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012544 monitoring process Methods 0.000 claims abstract description 164
- 230000011218 segmentation Effects 0.000 claims abstract description 56
- 238000013507 mapping Methods 0.000 claims description 8
- 229910052731 fluorine Inorganic materials 0.000 claims description 7
- 125000001153 fluoro group Chemical group F* 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 230000035515 penetration Effects 0.000 claims description 4
- 238000005259 measurement Methods 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 3
- 230000004075 alteration Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Abstract
The invention discloses a recording and broadcasting system based on teaching, a recording and broadcasting method and a recording and broadcasting medium, and belongs to the technical field of teaching tools. The method comprises the following steps: determining a set of predefined segmentation patterns based on which to segment an in-application interface; acquiring video images shot by a plurality of video acquisition units, and respectively displaying the video images into a preset interface template to generate a monitoring interface; carrying out layered coding on the video images at a coding server end to form a plurality of code stream gears; and under the condition that the currently displayed initial interface of the equipment screen belongs to the monitoring interface and the typesetting of the monitoring interface accords with the set of the segmentation modes, receiving a switching instruction for switching the segmentation modes, selecting a corresponding code stream gear, and selecting the sequence number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation modes to generate a current playing interface. The method and the device can improve user experience, highly freely customize the desired picture, and are simple to operate, more convenient and faster.
Description
Technical Field
The invention belongs to the technical field of teaching tools, and particularly relates to a recording and broadcasting system, a recording and broadcasting method and a recording and broadcasting medium based on teaching.
Background
The recording and playing system integrates and synchronously records video, audio and image signals of electronic equipment shot and recorded on site to generate a standardized streaming media file for external live broadcasting, storage, later editing and on-demand playing. The recording and broadcasting system and the school teaching are organically combined, collected signals of competitive courses, important meetings and the like are recorded into a computer hard disk through multiple camera positions, and students or teachers watch video files from different camera viewing angles. Meanwhile, the information sources on the network are sorted and uploaded, and the purpose of fully utilizing the network learning resources is achieved.
In the existing teaching recording and broadcasting system, a host simultaneously records a plurality of monitored video streams and generates the video streams in a specified class directory while broadcasting a teaching scene; and when the recorded class time is played back, displaying a plurality of video streams for the window, and switching the video streams in the playing window. However, when some teaching recording and broadcasting software windows are played, the head portrait of the character in the video is small, the user feels poor, the content of the video stream in the window is inconvenient to change, and the user cannot rearrange the window according to the watching requirement.
Disclosure of Invention
The invention provides a recording and broadcasting system, a recording and broadcasting method and a recording and broadcasting medium based on teaching to solve the technical problems in the background technology.
The invention adopts the following technical scheme: a recording and broadcasting method based on teaching comprises the following steps:
determining a set of predefined segmentation patterns based on which to segment the in-application interface;
acquiring video images shot by a plurality of video acquisition units, and respectively displaying the video images into a preset interface template to generate a monitoring interface; carrying out layered coding on the video images at a coding server end to form a plurality of code stream gears;
and under the condition that the currently displayed initial interface of the equipment screen belongs to the monitoring interface and the typesetting of the monitoring interface accords with the set of the segmentation modes, receiving a switching instruction for switching the segmentation modes, selecting a corresponding code stream gear, and selecting the sequence number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation modes to generate a current playing interface.
Video recording: the video acquisition unit sends the acquired video image updating data to the video storage unit, when the video is replayed, the video storage unit transmits the video image to the replay management unit, and the replay management unit executes the updating logic management module, the pause/start module and the fast/slow module according to the requirements.
In a further embodiment, the composition of the monitoring interface includes information D n ，D n (d，s n ，x n ，y n ，w n ，h n T); where n denotes the number of the monitoring interface, d denotes the type of the division pattern, s n Numbering signal sources of the monitoring interface with the sequence number n; x is a radical of a fluorine atom n 、y n X for the monitoring interface numbered n in the current segmentation modeAn axis coordinate value and a y axis coordinate value; w is a n ，h n The width and height of the monitoring interface numbered n in the current segmentation mode; t is the number of the current segmentation mode.
In a further embodiment, the types of segmentation patterns include: and in the preset mode and the user-defined mode, the value of d satisfies the following relation:
In a further embodiment, the value of the signal source is set according to a predetermined scenario, for example:
the signal source number s n The values of (A) at least comprise the following five types:
when the signal source of the monitoring interface is close-up by the teacher, s n Is 8;
when the signal source of the monitoring interface is a teacher panorama s n Is 9;
the signal source of the monitoring interface is student's special time, s n Is 10;
when the signal source of the monitoring interface is the panoramic view of the student s n Is taken as value of 11;
when the signal source of the monitoring interface is an external input medium, s n Is 6.
By adopting the technical scheme: used for judging whether the signal source of the current playing interface is misplaced when the execution instruction is generated, if so, the signal source is misplacedThen information D n Information of harmony D n’ There is a difference that a change instruction needs to be executed.
In a further embodiment, the interface template includes information D n’ ，D n’ (d，s n’ ，x n’ ，y n’ ，w n’ ，h n’ T); n is the serial number of the interface template, and the serial number sequence of the interface template is consistent with the serial number of the monitoring interface; d represents the type of the segmentation pattern, s n’ Numbering the signal source of the interface template with the number n; x is a radical of a fluorine atom n’ 、y n’ The coordinate values of the x axis and the y axis of the interface template with the serial number n are respectively; w is a n’ ，h n’ Respectively, the width and height of the interface template with the serial number n.
In a further embodiment, determining the correspondence between the first data parameter and the second data parameter, and determining whether to execute the alteration instruction further represents:
the method for generating the current playing interface by selecting the serial number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation mode specifically comprises the following steps:
judgment information D n And D n’ Whether the mapping relation is satisfied, whether the change instruction is executed is determined:
when the monitoring interface with the same serial number in the playing interface is consistent with the signal source of the interface template, and the x-axis coordinate, the y-axis coordinate, the width and the height of the monitoring interface and the interface template are enlarged or reduced according to preset values, no change instruction needs to be executed;
when the monitoring interface with the same serial number in the playing interface is inconsistent with the signal source of the interface template, or the x-axis coordinate, the y-axis coordinate, the width and the height are not enlarged or reduced according to the preset values, a change instruction needs to be executed.
In a further embodiment of the method of the invention,
if it is
The change instruction does not need to be executed;
if s n’ ≠s n Or (x) n’ ，y n’ )≠δ(x n ，y n ) Or (w) n’ ，h n’ )≠σ(w n ，h n ) Then a change instruction needs to be executed; where δ and σ are both constant proportionality.
In a further embodiment, the change instruction comprises: the signal source of the monitoring interface in the current playing interface, the x-axis coordinate and/or the y-axis coordinate of the monitoring interface in the current playing interface, the width and/or the height of the monitoring interface in the current playing interface, and the number of the segmentation modes of the video window are changed. And adjusting the monitoring interface in the current playing interface through the change instruction so as to adapt to the use requirement of the customer.
Further comprising: changing the address and port number of the video acquisition unit, then connecting with the network camera for communication through a socket protocol through network penetration, and sending a 16-system code to the network camera based on a standard visca protocol so as to control the upper, lower, left and right sides of the holder and the zooming-in and zooming-out of the focal length.
In a further embodiment, the network camera interface uses an SDK interface to obtain the quality of the code stream required for playing; the code stream quality of pictures recorded by the camera is directly reduced.
The method for hierarchically coding the video image to form a plurality of code stream gears comprises the following processes:
dividing code stream gears according to the code stream quality, and correspondingly setting a connection time area for each gear;
sending a speed measurement request to the server, monitoring and calculating the actual connection time of the request;
and comparing the actual connection time with the set connection time region, and analyzing the set connection time region to which the actual connection time belongs, namely selecting a corresponding code stream gear.
The code stream quality is divided into at least four gears according to the bandwidth of the network; and selecting corresponding gears according to the base numbers in the monitoring interface set to realize synchronous playing.
The gears at least comprise a first gear, a second gear, a third gear and a fourth gear; the code stream quality corresponding to each file is different, and the code stream quality comprises: the method comprises the following steps: resolution, code rate, and frame rate.
The concrete expression is as follows:
| resolution ratio | Code rate | Frame rate | Gear position | Time zone |
| 640*480 | |
1～7 | 1 | 0-100ms |
| 720×480 | 2048kbps | 8～15 | 2 | 100-200ms |
| 1280×720 | 3500kbps | 16～23 | 3 | 200ms-300ms |
| 1280×720 | |
24～30 | 4 | 300ms+ |
In a further embodiment, a teaching-based recording and broadcasting system is used for implementing the recording and broadcasting method.
A predefined set module to determine a set of predefined segmentation patterns based on which to segment the in-application interface;
the acquisition module is used for acquiring video images shot by the plurality of video acquisition units and respectively displaying the video images into a preset interface template to generate a monitoring interface;
the code stream grading module is used for coding the video images in a layering way at the coding server end to form a plurality of code stream gears;
and the switching module is used for receiving a switching instruction for switching the segmentation mode under the condition that the initial interface currently displayed on the screen of the equipment belongs to the monitoring interface and the typesetting of the monitoring interface conforms to the set of the segmentation modes, selecting a corresponding code stream gear, and selecting the serial number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation modes to generate the current playing interface.
The execution standard is embodied in the form of a first data parameter, and the acquisition process of the first data parameter is as follows: each video image is respectively played and recorded in a monitoring interface mode;
a storage medium having stored therein a computer program for execution by a processor to implement a recording and playing method as described above.
The invention has the beneficial effects that: according to the method, the playing mode is set from the cloud according to the use requirement, the first data parameter and the segmentation mode are generated at the same time to serve as the playing standard, when the execution instruction is generated in the video window of the client, the second data parameter at the client is matched with the playing standard so as to meet the use requirement during actual playing, if the execution instruction is not matched with the playing standard, the video picture is changed, the setting of the video picture is supported, the video source of the video window, the position of the video window, the size of the video window and the number of the video windows are changed at will, the user experience is improved, the wanted picture is customized freely, the operation is simple, and the method is more convenient and faster. Through a simple visual mode, the tedious operation of the user on the setting of the picture is greatly reduced,
drawings
Fig. 1 is a diagram showing a division state pattern when n takes a value of 5 in embodiment 1.
Fig. 2 is a structural diagram of a display screen interface in embodiment 2.
Detailed Description
The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings and embodiments. All other embodiments, which can be obtained by a person skilled in the art without inventive effort based on the embodiments of the present invention, are within the scope of the present invention.
Example 1
In the embodiment, in order to switch video streams at any time during teaching live broadcast, a specified video is switched according to teaching requirements, and meanwhile, in order to realize arbitrary switching among a plurality of videos during playback, the video switching method and the video switching device can be used for switching a plurality of videos at any time during playback.
The embodiment discloses a recorded broadcast method based on teaching, which comprises recorded broadcast video picture control and recorded broadcast cradle head control. The recorded and played video picture control specifically comprises the following procedures: establishing connection with a server through an FTP protocol, acquiring a required binary parameter command code from the server, and analyzing transcoding through a client;
the method comprises the steps of obtaining video images shot by a plurality of video acquisition units, wherein each video image is played and recorded in a monitoring interface mode, and in the embodiment, a video camera is selected as the video acquisition unit. I.e. there are several cameras and several surveillance interfaces. In other words, if 5 cameras shoot at different positions at the same time, five video images are acquired, and five monitoring interfaces are provided.
Defining the monitoring interface which is currently played as a monitoring interface set, and judging the segmentation mode of the current playing interface based on the cardinality in the monitoring interface set. In other words,when there are five monitoring interfaces, the cardinality in the set is five, the segmentation mode is determined according to the cardinality, and the data parameter corresponding to each element in the monitoring interface set (namely the monitoring interface in the current playing interface) is obtained as D n 。
Generating an execution instruction based on the segmentation mode, and playing a selected monitoring interface set in a video window of the client in a monitoring interface form in the current playing interface, wherein the information of the interface template is D n’ 。
Judgment information D n And D n’ Whether the mapping relation is satisfied or not, so as to determine whether the change instruction is executed or not.
Video recording: the video acquisition unit sends acquired video image updating data to the video storage unit, when the video is replayed, the video storage unit transmits the video image to the replay management unit, the replay management unit executes the updating logic management module, the pause/start module and the fast/slow module according to requirements, and the recorded and played video picture manipulation is met during replay.
In a further embodiment, the composition of the monitoring interface includes information D n ，D n (d，s n ，x n ，y n ，w n ，h n T); where n denotes the number of the monitoring interface, d denotes the type of the division pattern, s n Numbering a signal source of a monitoring interface with the sequence number n; x is the number of n 、y n The x-axis coordinate value and the y-axis coordinate value of the monitoring interface numbered n in the current segmentation mode; w is a n ，h n The width and height of the monitoring interface numbered n in the current segmentation mode; t is the number of the current partition mode.
The types of the segmentation patterns include: in the preset mode and the user-defined mode, the value of d satisfies the following relation:
in a further embodiment, if the segmentation mode is a predetermined mode, the value of d is 0.
In other words, when there are five monitoring interfaces, then n takes on values of 1, 2, 3, 4 and 5. The first data parameter for the monitoring interface numbered 1 is denoted as (0,s) 1 ，x 1 ，y 1 ，w 1 ，h 1 T), the first data parameter of the monitoring interface numbered 2 is denoted (0, s) 2 ，x 2 ，y 2 ，w 2 ，h 2 T), and so on, the first data parameter of the monitoring interface numbered 5 is represented as (0, s) 5 ，x 5 ，y 5 ，w 5 ，h 5 ，T)。
In a further embodiment, the signal source number s n The values of (A) at least comprise the following five types: when the signal source of the monitoring interface is close-up by the teacher, s n Is 8; when the signal source of the monitoring interface is the teacher panorama s n Is 9; the signal source of the monitoring interface is student specific time, s n Is 10; when the signal source of the monitoring interface is the panoramic view of the student s n Is 11; when the signal source of the monitoring interface is an external input medium, s n Is 6.
In other words, when the source of the monitoring interface numbered 1 is close-up to the teacher, then the first data parameter of the monitoring interface numbered 1 is represented as (0, 8, x) 1 ，y 1 ，w 1 ，h 1 T); when the source of the monitoring interface numbered 2 is close-up for the student, the first data parameter for the monitoring interface numbered 2 is represented as (0, 10, x) 2 ，y 2 ，w 2 ，h 2 T), and x n Has a value in the range of 0 to 1920 n The value range of (A) is 0 to 1080; w is a n Has a value range of 0 to 1920,h n The value range of (A) is 0 to 1080. In other words, the maximum value of the X axis of the coordinate where the playing interface is located is 1920, and the maximum value of the y axis is 1080; the maximum value of the width of the playing interface is 1920, and the maximum value of the height of the playing interface is 1080.
In a further embodiment, when there is one monitoring interface, the number of T is 1, and only 1 monitoring interface plays (1 split screen); when the number of the monitoring interfaces is two, the serial numbers of the T are No. 1 and No. 2, the No. 1 is that only one monitoring interface is played (1 split screen), and the No. 2 is that the two monitoring interfaces are played (2 split screen); when the number of the monitoring interfaces is three, the values of T are 1, 2 and 3, wherein the 1 is that only one monitoring interface is played (1 split screen), the 2 is that two monitoring interfaces are played (2 split screen), the 3 is that three monitoring interfaces are played (3 split screen), and so on, and T = n, n split screen selections exist. When the number of the monitoring interfaces is 5 in combination with the above embodiment, then T =5, five segmentation modes are included: 1 split screen, 2 split screen, 3 split screen, 4 split screen and 5 split screen. And when the segmentation mode is a self-defined mode, the value of d is 1, the number of the monitoring interfaces in the current playing interface and the relative arrangement positions of the monitoring interfaces in the current playing interface are selected according to the requirements of a user, and the self-defined split screen exists.
According to the split-screen mode, an execution instruction is generated in an application internal interface, information of a set window originates from a video window of a client to play a monitoring interface set in a mode of a monitoring interface in a current playing interface, and a data parameter of the monitoring interface in the current playing interface is acquired as D n’ 。D n’ (d，s n’ ，x n’ ，y n’ ，w n’ ，h n’ T); n is the serial number of the interface template, and the serial number sequence of the interface template is consistent with the serial number of the monitoring interface; d represents the type of segmentation pattern, s n’ Numbering the signal source of the interface template with the number n; x is a radical of a fluorine atom n’ 、y n’ The coordinate values of the x axis and the y axis of the interface template with the serial number n are respectively; w is a n’ ，h n’ Respectively, the width and height of the interface template with the serial number n.
By comparison of D n And D n’ Judging whether a monitoring interface in a current playing interface in a device screen meets mapping with an interface template, if not, dragging a video window by using a DROP interface and a DRAGOVER interface of HTML5, moving the video window to be replaced to release a mouse, sending a command code through an Http protocol, receiving the command code by a server, changing a video picture, supporting the setting of the video picture, and changing the video window at willThe position of video source, video window, the size of video window and the quantity of video window promote user experience, and the maneuverability in later stage is big.
Judging whether the first data parameter and the second data parameter meet the mapping relation or not, and determining whether to execute the change instruction further comprises the following steps:
when the monitoring interface with the same serial number in the playing interface is consistent with the signal source of the interface template, and the x-axis coordinate, the y-axis coordinate, the width and the height of the monitoring interface and the interface template are enlarged or reduced according to preset values, no change instruction needs to be executed;
and when the monitoring interface with the same serial number in the playing interface is not consistent with the signal source of the interface template, or the x-axis coordinate, the y-axis coordinate, the width and the height are not enlarged or reduced according to the preset values, executing a change instruction.
In a further embodiment of the method of the invention,
if it is
The change instruction does not need to be executed;
if s n’ ≠s n Or (x) n’ ，y n’ )≠δ(x n ，y n ) Or (w) n’ ，h n’ )≠σ(w n ，h n ) Then a change instruction needs to be executed; where δ and σ are both constant of proportionality.
In other words, if s n’ ＝s n The logic of replacement is to drag the window with the mouse from five small windows below, move to the large picture above, then release the mouse, and then make a judgment. Wherein, the main judgment is whether the signal source in the picture is the same as the signal source dragged by the mouse
Assuming that the given monitoring interface is a teacher close-up signal source, and the monitoring interface in the current playing interface of the corresponding number in the video window generates a teacher panoramic signal source or a user puts the teacher panoramic signal source into the corresponding number to be released, and knows that the teacher close-up signal is inside through the obtained first data parameter (No. 8); and the current acquisition of the second data parameter is that the teacher panoramic signal source (No. 9) is not the same signal source, so that the replacement picture is changed into teacher close-up to be replaced by the teacher panoramic.
If the coordinates and the size are not consistent, the consistency is realized through the position of the dragging or video window, the size of the video window and the number of the video windows.
In a further embodiment, the alteration instruction includes: the signal source of the monitoring interface in the current playing interface, the x-axis coordinate and/or the y-axis coordinate of the monitoring interface in the current playing interface, the width and/or the height of the monitoring interface in the current playing interface, and the number of the segmentation modes of the video window are changed. And adjusting the monitoring interface in the current playing interface through the change instruction so as to be suitable for the use requirement of the customer.
In a further embodiment, the recording and playing cradle head control specifically includes: the address and the port number of the video acquisition unit are changed, then the video acquisition unit is connected with the network camera through a network penetration protocol for communication, and a 16-system code is sent to the network camera based on a standard visca protocol so as to control the up, down, left and right of the holder and the zoom-in and zoom-out of the focal length.
In the actual picture switching process, the main picture is often delayed due to the influence of network bandwidth, delay jitter, packet loss rate and the like in the transmission of video streams, and the delay of two to three seconds is caused when the pictures of the camera are directly acquired below the main picture, so that the delay influence caused by the network bandwidth is reduced by reducing the code stream quality of the pictures recorded by the camera.
The code stream quality of the camera is reduced through an SDK interface provided by a camera manufacturer, sending a speed measurement request to the server, monitoring and calculating the actual connection time of the request; and comparing the actual connection time with the set connection time region, and analyzing the set connection time region to which the actual connection time belongs, namely selecting a corresponding code stream gear.
The code stream quality is divided into at least four gears according to the bandwidth of the network; and selecting corresponding gears according to the cardinality in the monitoring interface set for realizing synchronous playing.
The gears at least comprise a first gear, a second gear, a third gear and a fourth gear; the code stream quality corresponding to each file is different, and the code stream quality comprises: the method comprises the following steps: resolution, code rate, and frame rate. The least delay effect is best for the first-gear picture, and so on.
The concrete expression is as follows:
| resolution ratio | Code rate | Frame rate | Gear position | Time |
| 640*480 | |
1～7 | 1 | 0-100ms |
| 720×480 | 2048kbps | 8～15 | 2 | 100-200ms |
| 1280×720 | 3500kbps | 16～23 | 3 | 200ms-300ms |
| 1280×720 | |
24～30 | 4 | 300ms+ |
The collected actual connection time is assumed to be 80ms and then falls into the first gear; and if the acquired actual connection time is 150ms, the mobile terminal falls into the gear, the gears are sequentially judged, and the corresponding code stream is selected.
Example 2
Based on embodiment 1, this embodiment discloses a recorded broadcast system based on teaching, including the display screen, the display screen includes operation area, cloud layer broadcast district and video window district. The operation area is internally provided with a segmentation mode unit, a volume adjusting unit, a brightness adjusting unit, a recording mode unit and other basic operation control units.
The cloud layer playing area is used for playing monitoring interfaces, and the number of the monitoring interfaces is consistent with that of the video acquisition units. The video window area is a client viewing area, and the number and the sequence of the monitoring interfaces in the current playing interface played in the video window area depend on the segmentation mode.
Further comprising: the video acquisition units are connected with the input end of the display screen; the plurality of video acquisition units are arranged to shoot from a plurality of angles and upload the shot to a secondary window or a video window of the display; in this embodiment, the video capture units are selected from cameras, are disposed at different corners of a classroom, and are respectively used for capturing other external input media such as teachers, teacher panorama, student close-up, student panorama, or courseware.
Further comprising: the cloud end unit is simultaneously connected with the input end of the display screen and the output end of the video acquisition unit; the cloud end unit is used for storing and managing video images; the cloud end unit is also set to output execution standards; and the video playing area in the display screen plays according to the execution standard. The judgment criteria are as follows:
acquiring video images shot by a plurality of video acquisition units, wherein each video image is played and recorded in a monitoring interface mode;
defining a currently played monitoring interface as a monitoring interface set, judging a segmentation mode of the currently played interface based on a cardinal number in the monitoring interface set, and acquiring a data parameter corresponding to each element in the monitoring interface set as a first data parameter;
generating an execution instruction based on the segmentation mode, playing a monitoring interface set in a video window of the client in a monitoring interface mode in the current playing interface, and acquiring data parameters of the monitoring interface in the current playing interface as second data parameters;
and judging whether the first data parameter and the second data parameter meet the mapping relation or not so as to determine whether the change instruction is executed or not. The first data parameter is D n (d，s n ，x n ，y n ，w n ，h n T); wherein n represents the sequence number of the monitoring interfaces in the monitoring interface set; d represents the type of segmentation pattern, s n Numbering the signal source of the monitoring interface with the number n; x is a radical of a fluorine atom n 、y n The x-axis coordinate value and the y-axis coordinate value of the monitoring interface with the number n are respectively; w is a n ，h n The width and height of the monitoring interface, numbered n, respectively; t is the number of the current segmentation mode. Acquiring the data parameter of the monitoring interface in the current playing interface as the second data parameter further shows that:
the second data parameter is D n’ (d，s n’ ，x n’ ，y n’ ，w n’ ，h n’ T); n is the number of the monitoring interface in the current playing interface, and the number sequence is consistent with the number of the monitoring interface; d represents the type of segmentation pattern, s n’ Numbering a signal source of a monitoring interface in a current playing interface with the number n; x is a radical of a fluorine atom n’ 、y n’ The coordinate values of the x axis and the y axis of the monitoring interface in the current playing interface with the number n are respectively; w is a n’ ，h n’ The width and height of the monitoring interface in the current playing interface, which are numbered n respectively.
Judging whether the first data parameter and the second data parameter meet the mapping relation or not, and determining whether to execute the change instruction further comprises the following steps: when the monitoring interfaces with the same number are consistent with the signal sources of the monitoring interfaces in the current playing interface and the x-axis coordinate, the y-axis coordinate, the width and the height of the monitoring interfaces in the current playing interface are consistent, the change instruction does not need to be executed; when one or more of the signal source, the x-axis coordinate, the y-axis coordinate, the width and the height of the monitoring interface with the same number are inconsistent with those of the monitoring interface in the current playing interface, a change instruction needs to be executed.
Example 3
A storage medium having a computer program stored therein, the computer program being executed by a processor to implement the recording and broadcasting method according to any of the embodiments, the method comprising:
video recording and playing picture control and video recording and playing holder control. The recorded and played video picture control specifically comprises the following procedures: acquiring video images shot by a plurality of video acquisition units, wherein each video image is played and recorded in a monitoring interface mode;
defining a currently played monitoring interface as a monitoring interface set, judging a segmentation mode of the currently played interface based on a cardinal number in the monitoring interface set, and acquiring a data parameter corresponding to each element in the monitoring interface set as a first data parameter;
generating an execution instruction based on the segmentation mode, playing a monitoring interface set in a video window of the client in a monitoring interface mode in the current playing interface, and acquiring data parameters of the monitoring interface in the current playing interface as second data parameters;
and judging whether the first data parameter and the second data parameter meet the mapping relation or not so as to determine whether the change instruction is executed or not.
The recording and broadcasting cradle head control specifically comprises: the address and the port number of the video acquisition unit are changed, then the video acquisition unit is connected with the network camera through a network penetration protocol for communication, and a 16-system code is sent to the network camera based on a standard visca protocol so as to control the up, down, left and right of the holder and the zoom-in and zoom-out of the focal length.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (7)
1. A recording and broadcasting method based on teaching is characterized by comprising the following steps:
determining a set of predefined segmentation patterns based on which to segment the in-application interface;
the method comprises the steps of obtaining video images shot by a plurality of video acquisition units, and respectively displaying the video images into a preset interface template to generate a monitoring interface; carrying out layered coding on the video images at a coding server end to form a plurality of code stream gears;
under the condition that the initial interface currently displayed on the screen of the equipment belongs to the monitoring interface and the typesetting of the monitoring interface accords with the set of the segmentation modes, receiving a switching instruction for switching the segmentation modes, selecting a corresponding code stream gear, and selecting the sequence number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation modes to generate a current playing interface;
the composition of the monitoring interface comprises information D n ，D n (d，s n ，x n ，y n ，w n ，h n T); where n denotes the number of the monitoring interface, d denotes the type of the division pattern, s n Numbering signal sources of the monitoring interface with the sequence number n; x is a radical of a fluorine atom n 、y n The x-axis coordinate value and the y-axis coordinate value of the monitoring interface numbered n in the current segmentation mode; w is a n ，h n The width and height of the monitoring interface numbered n in the current segmentation mode; t is the number of the current segmentation mode;
the interface template includes information D n’ ，D n’ (d，s n’ ，x n’ ，y n’ ，w n’ ，h n’ T); n is the serial number of the interface template, and the serial number sequence is consistent with the serial number of the monitoring interface; d represents the type of the segmentation pattern, s n’ Numbering the signal source of the interface template with the number n; x is a radical of a fluorine atom n’ 、y n’ The coordinate values of the x axis and the y axis of the interface template with the serial number n are respectively; w is a n’ ，h n’ Respectively, the width and height of the interface template with the serial number n;
the method for generating the current playing interface by selecting the serial number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation mode specifically comprises the following steps:
judgment information D n And D n’ Whether the mapping relation is satisfied, whether the change instruction is executed is determined:
when the monitoring interface with the same serial number in the playing interface is consistent with the signal source of the interface template, and the x-axis coordinate, the y-axis coordinate, the width and the height of the monitoring interface and the interface template are enlarged or reduced according to preset values, no change instruction needs to be executed;
and when the monitoring interface with the same serial number in the playing interface is not consistent with the signal source of the interface template, or the x-axis coordinate, the y-axis coordinate, the width and the height are not enlarged or reduced according to the preset values, executing a change instruction.
2. The recording and broadcasting method based on teaching of claim 1,
the types of the segmentation modes include: and in the preset mode and the user-defined mode, the value of d satisfies the following relation:
3. the recording and broadcasting method based on teaching of claim 1,
the change instruction includes: and changing a signal source of the monitoring interface in the current playing interface, the x-axis coordinate and/or the y-axis coordinate of the monitoring interface in the current playing interface, the width and/or the height of the monitoring interface in the current playing interface, and the number of the segmentation mode of the video window.
4. The recording and broadcasting method based on teaching of claim 1,
further comprising: the address and the port number of the video acquisition unit are changed, then the video acquisition unit is connected with the network camera through a network penetration protocol for communication, and a 16-system code is sent to the network camera based on a standard visca protocol so as to control the up, down, left and right of the holder and the zoom-in and zoom-out of the focal length.
5. The recording and broadcasting method based on teaching of claim 1,
the method for forming a plurality of code stream gears by carrying out layered coding on video images comprises the following processes:
dividing code stream gears according to the code stream quality, and correspondingly setting a connection time area for each gear;
sending a speed measurement request to the server, monitoring and calculating the actual connection time of the request;
and comparing the actual connection time with the set connection time region, and analyzing the set connection time region to which the actual connection time belongs, namely selecting a corresponding code stream gear.
6. A recording and broadcasting system based on teaching for implementing the recording and broadcasting method of any one of claims 1 to 5, comprising:
a predefined set module to determine a set of predefined segmentation patterns based on which to segment the in-application interface;
the acquisition module is used for acquiring video images shot by the plurality of video acquisition units and respectively displaying the video images into a preset interface template to generate a monitoring interface;
the code stream grading module is used for coding the video images in a layering way at the coding server end to form a plurality of code stream gears;
and the switching module is used for receiving a switching instruction for switching the segmentation mode under the condition that the initial interface currently displayed on the screen of the equipment belongs to the monitoring interface and the typesetting of the monitoring interface conforms to the set of the segmentation modes, selecting a corresponding code stream gear, and selecting the serial number of the monitoring interface and the typesetting of the monitoring interface according to the segmentation modes to generate the current playing interface.
7. A storage medium, characterized in that a computer program is stored in the storage medium, which computer program is executed by a processor to implement the recording and broadcasting method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110716118.4A CN113422933B (en) | 2021-06-23 | 2021-06-23 | Recording and broadcasting system, recording and broadcasting method and medium based on teaching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110716118.4A CN113422933B (en) | 2021-06-23 | 2021-06-23 | Recording and broadcasting system, recording and broadcasting method and medium based on teaching |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113422933A CN113422933A (en) | 2021-09-21 |
| CN113422933B true CN113422933B (en) | 2022-10-25 |
Family
ID=77717867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110716118.4A Active CN113422933B (en) | 2021-06-23 | 2021-06-23 | Recording and broadcasting system, recording and broadcasting method and medium based on teaching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113422933B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083397A (en) * | 2019-12-13 | 2020-04-28 | 浙江大华技术股份有限公司 | Recorded broadcast picture switching method, system, readable storage medium and equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491414B (en) * | 2015-11-19 | 2017-05-17 | 深圳市鹰硕技术有限公司 | Synchronous display method and device of images |
| CN111176600A (en) * | 2020-01-02 | 2020-05-19 | 深圳震有科技股份有限公司 | Video canvas control method, video monitoring device and storage medium |
| CN112637672A (en) * | 2020-12-11 | 2021-04-09 | 深圳乐播科技有限公司 | Screen projection method, screen projection receiving terminal and screen projection sending terminal |
-
2021
- 2021-06-23 CN CN202110716118.4A patent/CN113422933B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083397A (en) * | 2019-12-13 | 2020-04-28 | 浙江大华技术股份有限公司 | Recorded broadcast picture switching method, system, readable storage medium and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113422933A (en) | 2021-09-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101270780B1 (en) | Virtual classroom teaching method and device | |
| WO2017206917A1 (en) | Video management system, multi-screen display card and monitoring all-in-one machine | |
| KR101367260B1 (en) | A virtual lecturing apparatus for configuring a lecture picture during a lecture by a lecturer | |
| US7903903B1 (en) | Integrated live video production system | |
| KR20060025518A (en) | Methods and apparatus for interactive point-of-view authoring of digital video content | |
| KR101351085B1 (en) | Physical picture machine | |
| WO2006123780A1 (en) | Remote distribution system and remote distribution method | |
| US8643672B2 (en) | Instant message analytics of historical conversations in relation to present communication | |
| CN105306872B (en) | Control the methods, devices and systems of multipoint videoconference | |
| US20040078805A1 (en) | System method and apparatus for capturing recording transmitting and displaying dynamic sessions | |
| KR100901111B1 (en) | Live-Image Providing System Using Contents of 3D Virtual Space | |
| CN110933350A (en) | Electronic cloud mirror recording and broadcasting system, method and device | |
| CN113422933B (en) | Recording and broadcasting system, recording and broadcasting method and medium based on teaching | |
| CN109523844B (en) | Virtual live broadcast simulation teaching system and method | |
| JP6519374B2 (en) | Video playback program, apparatus and method | |
| Lampi et al. | An automatic cameraman in a lecture recording system | |
| CN116016866A (en) | Integrated shooting and recording and broadcasting system for synchronous writing and recording and broadcasting method thereof | |
| US20060070001A1 (en) | Computer assisted presentation authoring for multimedia venues | |
| KR101796226B1 (en) | System for outputting multiple videos simultaneously | |
| WO2020238973A1 (en) | Automatic detection and real-time pushing method for multi-channel audio/video | |
| WO2009035198A1 (en) | 3d virtual studio lecture and conference apparatus | |
| KR102619761B1 (en) | Server for TelePresentation video Conference System | |
| CN115331504B (en) | Interactive teaching system based on wireless recording and broadcasting system | |
| CN210327787U (en) | Recorded broadcast system | |
| KR102595431B1 (en) | System and method for producing and distributing realistic video contents |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A teaching based recording system, recording method, and medium Granted publication date: 20221025 Pledgee: Bank of Nanjing Co.,Ltd. Jiangning sub branch Pledgor: Jiangsu Xiaoniu Electronic Technology Co.,Ltd. Registration number: Y2024980004310 |