CN116347016B - Matrix switcher for video conference - Google Patents
Matrix switcher for video conference Download PDFInfo
- Publication number
- CN116347016B CN116347016B CN202310619240.9A CN202310619240A CN116347016B CN 116347016 B CN116347016 B CN 116347016B CN 202310619240 A CN202310619240 A CN 202310619240A CN 116347016 B CN116347016 B CN 116347016B
- Authority
- CN
- China
- Prior art keywords
- data
- display
- speed
- video
- conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011159 matrix material Substances 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 claims abstract description 35
- 230000001360 synchronised effect Effects 0.000 claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims abstract description 16
- 238000007689 inspection Methods 0.000 claims abstract description 8
- 238000006243 chemical reaction Methods 0.000 claims description 34
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 9
- 230000003993 interaction Effects 0.000 description 3
- 239000013307 optical fiber Substances 0.000 description 3
- 238000012827 research and development Methods 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The invention provides a matrix switcher for video conferences, which comprises a synchronous transmission module: for synchronously receiving high-speed conference data and converting the high-speed conference data into target data; wherein the target data comprises high-speed serial data or parallel data; and a decoding module: the method comprises the steps of performing HDCP decoding on target data to generate multi-path high-speed video stream data; and the split screen display module is as follows: the device is used for synchronously caching the multi-path high-speed video stream data and carrying out split-screen display after synchronous caching; the split screen display comprises the following steps: distributing display, cross switching display, splicing display and built-in scene round inspection display; and the intelligent central control module: and the intelligent control device is used for receiving the control signal and performing intelligent control through the upper computer. The invention can realize synchronous transmission, video split-screen display and video splicing; the intelligent control system can realize various split-screen modes including distribution display, cross switching display, splicing display and built-in scene round inspection display, realize remote control and network control of the matrix switcher and realize intelligent regulation and control.
Description
Technical Field
The invention relates to the technical field of matrix switchers, in particular to a matrix switcher for video conferences.
Background
At present, the matrix switcher transmits one or multiple channels of video and audio signals to one or multiple display devices respectively, for example, two computer hosts share one display, the matrix switcher can output contents on the two computer hosts to the same one or multiple displays at will, and the matrix switcher is a device for switching the output of multiple channels of signals.
The existing matrix switcher can realize split screen control, but cannot realize simultaneous connection of a plurality of video input devices under the existing conference condition, realize arbitrary split screen display of videos, and realize split screen splicing when in split screen display.
Disclosure of Invention
The invention provides a matrix switcher for a video conference, which is used for solving the problems that although the existing matrix switcher can realize split screen control, under the existing conference condition, the existing matrix switcher cannot realize the simultaneous connection of a plurality of video input devices, realize any split screen display of videos and realize split screen splicing when the split screen display is realized.
The invention provides a matrix switcher for video conferences, which specifically comprises:
and the synchronous transmission module is used for: the method comprises the steps of synchronously receiving high-speed conference data and converting the high-speed conference data into target data; wherein,,
the target data includes high-speed serial data or parallel data;
and a decoding module: the method comprises the steps of performing HDCP decoding on target data to generate multi-path high-speed video stream data;
and the split screen display module is as follows: the device is used for synchronously caching the multi-path high-speed video stream data and carrying out split-screen display after synchronous caching; wherein,,
the split screen display includes: distributing display, cross switching display, splicing display and built-in scene round inspection display;
and the intelligent central control module: and the intelligent control device is used for receiving the control signal and performing intelligent control through the upper computer.
Preferably, the synchronous transmission module includes:
a data input unit: acquiring high-speed conference data sent by input equipment through an input interface; wherein,,
the high-speed conference data includes: conference display data, data addresses, and data time stamps;
comparison unit: the phase difference calculation method comprises the steps of judging whether the time stamps of different input devices are the same according to the data address of high-speed conference data, and performing phase difference calculation when the time stamps are different;
a time stamp updating unit: the method comprises the steps of acquiring phase differences of different input devices, and updating time stamps during data conversion based on the phase differences; wherein,,
the update time stamp comprises a synchronous time stamp and a serial time stamp;
a conversion unit: the method comprises the steps of setting a data conversion mode based on an update time stamp, and converting conference data of different types; wherein,,
the data conversion mode includes: a parallel conversion mode and a serial conversion mode;
a conversion output unit: and the method is used for outputting the converted target data to different conference playing devices through the output ports according to the update time stamp.
Preferably, the parallel data includes the following conversion steps:
step 1: decoding the high-speed serial data by a plurality of serial decoders to determine a clock of the input device;
step 2: calculating clock difference of different input devices to determine a difference clock;
step 3: according to the differential clock, the clock of different input devices is delayed;
step 4: the high-speed serial data of the different input devices are converted into parallel data according to the clock delay.
Preferably, the decoding module includes:
video weighting unit: the method comprises the steps of acquiring a data frame rate of input equipment high-speed conference data, and determining data weight values of different data frames; wherein,,
different data frames correspond to different data weight values;
key value determination unit: the method comprises the steps of determining meeting key values from high-speed meeting data according to data weight values, and taking the meeting key values as decoding values; wherein,,
setting a decoding value through a data weight value;
decoding unit: the method comprises the steps of performing HDCP decoding shift operation according to a data weight value and a decoding value, and determining the decoding value;
video streaming unit: for determining multiple paths of target video stream data based on the decoded values.
Preferably, the split screen display module includes:
display unit: the method comprises the steps of dividing multipath high-speed video stream data into frame images, and determining a video memory address corresponding to each frame image;
and a caching unit: the device is used for setting a synchronous buffer area according to the output equipment, and importing the image frames into the synchronous buffer area according to the video memory address;
mode selection unit: and the split screen display mode is used for receiving the split screen display mode set by the user, and the split screen display is performed through the output equipment according to the split screen display mode.
Preferably, the allocation display includes:
controlling the output device to display a distribution interface of the high-speed video stream data in response to a split-screen display triggering operation of a user for different high-speed video stream data, wherein,
the distribution interface comprises at least one type of video stream icon;
the allocation interface comprises the step of carrying out proportional allocation on the display interface of each output device;
and determining output equipment corresponding to the high-speed video stream data of different types according to the distribution interface.
Preferably, the cross-switch display includes:
setting a selection instruction of the cross split screen according to the data input equipment;
responding to receiving a selection instruction of a cross split screen type in a plurality of split screen types of the terminal equipment; wherein,,
the terminal equipment can input and output simultaneously;
displaying an output device and a split screen interface corresponding to the cross split screen type through the current terminal device; wherein,,
the split screen interface comprises at least two terminal devices which are simultaneously output and input;
and controlling the terminal equipment to cross display the video stream data according to the split screen interface.
Preferably, the mosaic display includes the following steps:
acquiring high-speed video stream data of a plurality of input devices, and inputting the high-speed serial video stream data into a sliding window according to frames;
constructing a scene model based on the frame pose of each frame of video data in the sliding window and the bit depth information of the characteristic points of the high-speed video stream data; wherein,,
the bit depth information of the feature points is obtained by triangulating the feature points;
matching the characteristic points of each frame of video data with the characteristic points of the scene model to obtain a matching result;
video splicing is carried out on the high-speed video stream data of different input devices under the split-splice control of users based on the matching result, so that spliced video is obtained after the splicing is completed;
and displaying the spliced video through output equipment.
Preferably, the intelligent central control module comprises:
the upper computer unit: the method is used for setting an upper computer instruction and an upper computer program; wherein,,
the upper computer instruction is a key instruction and an infrared remote control instruction;
the upper computer program is connected with the local area network through RS232, and split screen control is carried out on the WEB page program and the third party program through the local area network.
Preferably, the intelligent central control module is further used for automatically powering off, wherein the step of automatically powering off is as follows:
when the matrix switcher is started, meeting power of the matrix switcher is fed back to the upper computer;
when the conference power is within a first threshold, the upper computer controls the matrix switcher to be powered off;
when the conference power is within the second threshold, the active signal of the upper computer is received through the matrix switcher, the conference stage is entered, and the conference power of the matrix switcher is uploaded to the upper computer in real time.
The beneficial effects of the invention are as follows:
the invention can be connected with various input and output devices, converts high-speed serial data into parallel data, and then realizes synchronous transmission, video split screen display and video splicing. Further converting the parallel video data into high-speed serial video stream data of blue light video; the invention can realize various split screen modes, including distribution display, cross switching display, splice display and built-in scene round inspection display; finally, the invention can realize remote control and network control of the matrix switcher and realize on-line intelligent regulation and control.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
fig. 1 is a diagram showing a matrix switcher for video conferences according to an embodiment of the present invention;
FIG. 2 is a view showing the composition of a split screen mode of split screen control in the embodiment of the present invention;
fig. 3 is a schematic diagram illustrating connection of input/output devices according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
The invention relates to a video matrix switcher, which is used for optical fiber transmission:
the invention has the functions that: one or more video/audio signals are respectively transmitted to one or more display devices, for example, two computer hosts share one display, and the matrix switcher can randomly output the contents on the two computer hosts to one or more displays. Matrix switches are a class of devices that switch the output of multiple signals;
the application method of the invention comprises the following steps:
the interface of the matrix is divided into a signal INPUT/OUTPUT interface, the INPUT part is a signal INPUT end, and the OUTPUT part is a signal OUTPUT end. The OUTPUT end of the signal source (such as a computer or a DVD) device is connected to the matrix INPUT end (INPUT), and the matrix OUTPUT end OUTPUT is connected to the INPUT interface of the signal using device (such as a projector or a television) to perform switching operation in a mode of key, serial port or webpage. The traditional matrix is connected with the equipment through copper wires, and the invention is connected with the equipment through optical fibers and the matrix/optical fibers are directly connected to a chip.
In a specific embodiment of the present invention, the matrix switcher is mainly used for video conferences, and facilitates switching transmission of different data streams in a conference process in a conference mode, including:
and the synchronous transmission module is used for: the method comprises the steps of synchronously receiving high-speed data and converting the data into target data; wherein,,
the target data includes high-speed serial data or parallel data;
and a decoding module: the method comprises the steps of performing HDCP decoding on target data to generate multi-path high-speed video stream data;
and the split screen display module is as follows: the device is used for synchronously caching the multi-path high-speed video stream data and carrying out split-screen display after synchronous caching; wherein,,
the split screen display includes: distributing display, cross switching display, splicing display and built-in scene round inspection display;
and the intelligent central control module: and the intelligent control device is used for receiving the control signal and performing intelligent control through the upper computer.
The working principle of the technical scheme is as follows:
as shown in fig. 1, fig. 2 and fig. 3, in this embodiment, the synchronous transmission module is used for connecting a plurality of input/output devices through a matrix switcher, for example: set top boxes, hosts, notebooks, blu-ray DVDs, decoders, televisions, displays, projectors, LED displays, etc.; and high-number serial data of the devices are received, parallel data are generated during a conference, and synchronous transmission, video split-screen display and video splicing are facilitated.
In this embodiment, the decoding module performs HDCP decoding on the parallel data, and converts the parallel data, mainly, high-speed serial data into parallel data, and double-cross conversion of the parallel data into high-speed serial data, for example, conversion of high-speed serial video stream data of blue light video; the matrix switcher INPUT interface is used for receiving conference data in a conference and outputting the conference data to the OUTPUT equipment through the OUTPUT interface;
in this embodiment, during split-screen display, first, high-speed serial video stream data INPUT by an INPUT device is synchronously cached, after the caching, the cached video can be called to realize split-screen display, and the synchronous caching means that data received by different INPUT interface ends are synchronously cached, cached in different storage spaces, and then displayed in a display mode according to requirements;
the split screen display comprises distribution display, cross switching display, splicing display and built-in scene round inspection display; the distribution display is to arbitrarily distribute the high-speed serial video stream data to be displayed on any output device, including the display proportion and the displayed data stream type (for example, two screens are used for displaying conference sites, one screen is used for displaying a conference PPT interface, or one screen is used for displaying PPT and the other screen is used for displaying other conference related videos); the cross switching display is to cross-switch the high-speed serial video stream data of the input and output equipment, and can also cross-switch the output equipment displayed in real time. The splicing display is to splice the high-speed serial video stream data of the input device to generate complete unified single video, so as to output the spliced video. The built-in scene round-robin display is to preset a conference scene, divide display time of a plurality of video pictures to be round-robin displayed, sequentially circulate the plurality of video pictures, and realize synchronous combination in a split screen display mode.
In this embodiment, the intelligent central control module enters the control interface of the matrix switcher through the remote control device by using the local area network and the internet, and realizes the remote control of the matrix switcher through the webpage program or the APP, thereby intelligently realizing split screen distribution and intelligent power-off.
The beneficial effects of the technical scheme are as follows:
(1) The device can be connected with various input and output devices, converts high-speed serial data into parallel data, and then realizes synchronous transmission, video split-screen display and video splicing.
(2) The parallel video data can be converted into high-speed serial video stream data of blue light video, and the serial video can be divided into parallel video.
(3) Various split-screen modes can be realized, including distribution display, cross switching display, splicing display and built-in scene round inspection display.
(4) The matrix switcher can be controlled remotely and in a network manner, so that different conference modes of the matrix switcher can be controlled intelligently on line, and split screen control and data supervision can be realized.
Preferably, the synchronous transmission module includes:
a data input unit: acquiring high-speed conference data sent by input equipment through an input interface; wherein,,
the high-speed conference data includes: conference display data, data addresses, and data time stamps;
a first comparison unit: the phase difference calculation method comprises the steps of judging whether the time stamps of different input devices are the same according to the data address of high-speed conference data, and performing phase difference calculation when the time stamps are different;
a time stamp updating unit: the method comprises the steps of acquiring phase differences of different input devices, and updating time stamps during data conversion based on the phase differences; wherein,,
the update time stamp comprises a synchronous time stamp and a serial time stamp;
a conversion unit: the method comprises the steps of setting a data conversion mode based on an update time stamp, and converting conference data of different types; wherein,,
the data conversion mode includes: a parallel conversion mode and a serial conversion mode;
a conversion output unit: and the method is used for outputting the converted target data to different conference playing devices through the output ports according to the update time stamp.
The working principle of the technical scheme is as follows:
in this embodiment, the present invention can obtain the high-speed conference data of different input devices when data is input, so as to implement statistics on the original data of the conference, the address of the data, i.e. the device address and the data timestamp of different input devices, i.e. the generation and transmission time of the data.
In this embodiment, the comparison unit determines specific devices for inputting data for data addresses of different data packets in data streams of different high-speed conference data, and when there are multiple high-speed conference data, determines whether the data of different addresses are the same timestamp, so as to calculate a phase difference for the data of the same timestamp, and when the data needs to be converted into parallel data through the phase difference, performs time stamp synchronization for the data according to the phase difference, and then sends the data to different conference receiving devices; when the data is required to be converted into serial data, converting the data into serial video stream data, and setting a specific time stamp of each data packet in the video stream; and then, parallel or serial conversion of the data is realized by using the time stamp as a conversion time sequence of the data based on a time synchronization mode, and the converted data is transmitted to different output devices.
The beneficial effects of the technical scheme are as follows:
in the parallel data conversion process, the phase of the input equipment can be determined through phase contrast of the input equipment, and the data conversion mode is determined based on the updated time stamp to perform data conversion when the data are subjected to parallel or serial conversion through the phase difference; thus, at the time of data conversion, conversion is faster.
Preferably, the parallel data includes the following conversion steps:
step 1: decoding the high-speed serial data by a plurality of serial decoders to determine a clock of the input device;
step 2: calculating clock difference of different input devices to determine a difference clock;
step 3: according to the differential clock, the clock of different input devices is delayed;
step 4: the high-speed serial data of the different input devices are converted into parallel data according to the clock delay.
The working principle of the technical scheme is as follows:
in this embodiment, step 1 decodes video data of different input devices by setting a serial decoder, and determines clocks of the input and output devices.
In this embodiment, step 2 may synchronize high-speed serial data of different input devices through differential clock during parallel data conversion of the input devices by differential computation.
The beneficial effects of the technical scheme are as follows:
the invention can realize the processing of clock data of different input and output devices and determine the differential clocks of different constant data, thereby being convenient for the parallel processing of the data of different input and output devices.
Preferably, the decoding module includes:
video weighting unit: the method comprises the steps of acquiring a data frame rate of input equipment high-speed conference data, and determining data weight values of different data frames; wherein,,
different data frames correspond to different data weight values;
key value determination unit: the method comprises the steps of determining meeting key values from high-speed meeting data according to data weight values, and taking the meeting key values as decoding values; wherein,,
setting a decoding value through a data weight value;
decoding unit: the method comprises the steps of performing HDCP decoding shift operation according to a data weight value and a decoding value, and determining the decoding value;
video streaming unit: for determining multiple paths of target video stream data based on the decoded values.
The working principle of the technical scheme is as follows:
in this embodiment, during decoding, the present invention can determine conference key values of different conference video stream data through the data weight values, and decode video stream data through the conference key values of the video stream data.
In this embodiment, the key value is set along with the data weight value and is set to the decoding value with different importance degrees, so as to protect the security of the conference video stream data, and the shift operation of the video stream data can be performed based on the addition of the video stream data, and the video stream data is converted into the high-speed serial video stream data through the shift operation.
The beneficial effects of the technical scheme are that:
(1) The decoding value of the data can be set according to the weight value of the data, so that the safety of the data is ensured;
(2) The decoding value can be determined through HDCP decoding shift operation, the conference data is converted into multi-path target video stream data, the decoding value can determine output equipment of the multi-path target video stream data, and conference data with different importance degrees can be transmitted to terminal equipment of different conference personnel for display.
Preferably, the split screen display module includes:
display unit: the method comprises the steps of dividing high-speed video stream data into frame images, and determining a video memory address corresponding to each frame image;
and a caching unit: the device is used for setting a synchronous buffer area according to the output equipment, and importing the image frames into the synchronous buffer area according to the video memory address;
mode selection unit: and the split screen display mode is used for receiving the split screen display mode set by the user, and the split screen display is performed through the output equipment according to the split screen display mode.
The working principle of the technical scheme is as follows:
in this embodiment, the video memory unit may determine the video memory addresses corresponding to different frame images in the high-speed serial video stream data, and implement the call to the high-speed video stream data through the video memory addresses.
In this embodiment, the high-speed serial video stream data can be buffered in one area by synchronizing the buffer areas, and displayed by different output devices.
In this embodiment, the mode selection unit may set a display mode of the conference data according to a mode of split screen display, and display the conference data through different conference receiving devices, where the display mode and the display data of the different conference receiving devices may be different.
The beneficial effects of the technical scheme are that:
when a conference is carried out, different conference devices can display data through different split screen display modes, and different data can also be displayed.
Preferably, the allocation display includes:
controlling the output device to display a distribution interface of the high-speed video stream data in response to a split-screen display triggering operation of a user for different high-speed video stream data, wherein,
the distribution interface comprises at least one type of video stream icon;
the allocation interface comprises the step of carrying out proportional allocation on the display interface of each output device;
and determining output equipment corresponding to the high-speed video stream data of different types according to the distribution interface.
The working principle of the technical scheme is as follows:
in this embodiment, an allocation interface is set, through which different video stream data can be split-screen displayed through different output devices, and the split-screen interface can be performed during split-screen selection, including split-screen size, split-screen proportion, split-screen display of different data, and the like.
In this embodiment, the frequency division interface may realize synchronous display of the same video stream for different output devices of the display interface, and may also realize proportional adjustment of the screen.
The beneficial effects of the technical scheme are that:
when the conference data transmission is carried out, different data can be displayed in a split screen mode, different split screen control is realized according to different split screen triggering operations, and the video stream icons represent data types.
Preferably, the cross-switch display includes:
setting a selection instruction of the cross split screen according to the data input equipment;
responding to receiving a selection instruction of a cross split screen type in a plurality of split screen types of the terminal equipment; wherein,,
the terminal equipment can input and output simultaneously;
displaying an output device and a split screen interface corresponding to the cross split screen type through the current terminal device; wherein,,
the split screen interface comprises at least two terminal devices which are simultaneously output and input;
and controlling the terminal equipment to cross display the video stream data according to the split screen interface.
The principle of the technical scheme is as follows:
in this embodiment, when performing cross-switching display, different output devices that need to perform split-screen display may be determined by setting a selection instruction of a cross split-screen;
in this embodiment, the video displayed by different output devices may be different by controlling a plurality of output devices and controlling the cross display of the input device and the output device.
The beneficial effects of the technical scheme are that:
the cross switching display can realize the exchange display of the data of the conference input equipment and the conference output equipment, and can realize the synchronous interaction of conference data. Terminal devices of both parties participating in the synchronous control conference display conference data of the other parties.
Preferably, the mosaic display includes the following steps:
acquiring high-speed video stream data of a plurality of input devices, and inputting the high-speed serial video stream data into a sliding window according to frames;
constructing a scene model based on the frame pose of each frame of video data in the sliding window and the bit depth information of the characteristic points of the high-speed video stream data; wherein,,
the bit depth information of the feature points is obtained by triangulating the feature points;
matching the first characteristic points of the first video data with the characteristic points of the scene model to obtain a matching result;
video splicing is carried out on the high-speed video stream data of different input devices under the split-splice control of users based on the matching result, so that spliced video is obtained after the splicing is completed;
and displaying the spliced video through output equipment.
The principle of the technical scheme is as follows:
in this embodiment, when video stitching is performed, different video frames may be stitched by setting a sliding window.
In this embodiment, the video data bit depth information and the feature points are extracted to determine the target splicing point when video is spliced, so as to implement video splicing.
In this embodiment, the scene model is a scene model of a conference, and the scene model is a splicing template of video stream data, which is used for splicing and sorting when video is spliced.
The beneficial effects of the technical scheme are that:
according to the video streaming method and the video streaming device, the data of different conference participants can be spliced and displayed at will according to the sequence of the preset scene model, so that the conference data of the different conference participants can be spliced, for example, the research and development data of different research and development nodes are spliced, and a complete research and development video is generated.
Preferably, the intelligent central control module comprises:
the upper computer unit: the method is used for setting an upper computer instruction and an upper computer program; wherein,,
the upper computer instruction is a key instruction and an infrared remote control instruction;
the upper computer program is connected with the local area network through RS232, and split screen control is carried out on the WEB page program and the third party program through the local area network.
The principle of the technical scheme is as follows:
in this embodiment, the remote split screen control and the remote depth control of the matrix switcher can be realized in a networking mode through the instructions and the programs of the upper computer.
In this embodiment, the upper computer may be an intelligent interaction device such as a computer or a mobile phone, and the intelligent interaction device controls the matrix switcher through a network.
Preferably, the intelligent central control module is further used for automatically powering off, wherein the step of automatically powering off is as follows:
when the matrix switcher is started, meeting power of the matrix switcher is fed back to the upper computer;
when the conference power is within a first threshold, the upper computer controls the matrix switcher to be powered off;
when the conference power is within the second threshold, the active signal of the upper computer is received through the matrix switcher, the conference stage is entered, and the conference power of the matrix switcher is uploaded to the upper computer in real time.
The principle of the technical scheme is as follows:
in this embodiment, the power control of the matrix switcher is performed when the matrix switcher is started, and the matrix switcher can detect whether the matrix switcher can be started or not by the upper computer in a real-time feedback manner through real-time feedback of real-time power, so as to perform power-off control.
In this embodiment, the conference power is real-time power;
in this embodiment, the first threshold is a power threshold of over-current and over-voltage of the matrix switcher;
in this embodiment, the second threshold is a power threshold under the rated operation condition of the matrix switcher;
in this embodiment, the matrix switch is subjected to dual detection before and after the meeting, and if the current and voltage of the matrix switch are too large, the power is turned off to prevent the matrix switch from being burnt.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (7)
1. A matrix switcher for video conferences, comprising:
and the synchronous transmission module is used for: the method comprises the steps of synchronously receiving high-speed conference data and converting the high-speed conference data into target data; wherein,,
the target data includes high-speed serial data or parallel data;
and a decoding module: the method comprises the steps of performing HDCP decoding on target data to generate multi-path high-speed video stream data;
and the split screen display module is as follows: the device is used for synchronously caching the multi-path high-speed video stream data and carrying out split-screen display after synchronous caching; wherein,,
the split screen display includes: distributing display, cross switching display, splicing display and built-in scene round inspection display;
and the intelligent central control module: the intelligent control device is used for receiving the control signal and performing intelligent control through the upper computer;
the synchronous transmission module comprises:
a data input unit: acquiring high-speed conference data sent by input equipment through an input interface; wherein,,
the high-speed conference data includes: conference display data, data addresses, and data time stamps;
comparison unit: the phase difference calculation method comprises the steps of judging whether the time stamps of different input devices are the same according to the data address of high-speed conference data, and performing phase difference calculation when the time stamps are different;
a time stamp updating unit: the method comprises the steps of acquiring phase differences of different input devices, and updating time stamps during data conversion based on the phase differences; wherein,,
the update time stamp comprises a synchronous time stamp and a serial time stamp;
a conversion unit: the method comprises the steps of setting a data conversion mode based on an update time stamp, and converting conference data of different types; wherein,,
the data conversion mode includes: a parallel conversion mode and a serial conversion mode;
a conversion output unit: the method comprises the steps of outputting converted target data to different conference playing devices through an output port according to an update timestamp;
the parallel data comprises the following generation steps:
step 1: decoding the high-speed serial data by a plurality of serial decoders to determine a clock of the input device;
step 2: calculating clock difference of different input devices to determine a difference clock;
step 3: according to the differential clock, carrying out clock delay on high-speed serial data of different input devices;
step 4: according to the clock delay, converting high-speed serial data of different input devices into parallel data;
the split screen display module comprises:
display unit: the method comprises the steps of dividing multipath high-speed video stream data into frame images, and determining a video memory address corresponding to each frame image;
and a caching unit: the device is used for setting a synchronous buffer area according to the output equipment, and importing the image frames into the synchronous buffer area according to the video memory address;
mode selection unit: and the split screen display mode is used for receiving the split screen display mode set by the user, and the split screen display is performed through the output equipment according to the split screen display mode.
2. A matrix switcher for video conferences as defined in claim 1, wherein the decoding module comprises:
video weighting unit: the method comprises the steps of acquiring a data frame rate of input equipment high-speed conference data, and determining data weight values of different data frames; wherein,,
different data frames correspond to different data weight values;
key value determination unit: the method comprises the steps of determining meeting key values from high-speed meeting data according to data weight values, and taking the meeting key values as decoding values; wherein,,
setting a decoding value through a data weight value;
decoding unit: the method comprises the steps of performing HDCP decoding shift operation according to a data weight value and a decoding value, and determining the decoding value;
video streaming unit: for determining multiple paths of target video stream data based on the decoded values.
3. A matrix switcher for video conferences as defined in claim 1, wherein the distribution display includes:
controlling the output device to display a distribution interface of the high-speed video stream data in response to a split-screen display triggering operation of a user for different high-speed video stream data, wherein,
the distribution interface comprises at least one type of video stream icon;
the allocation interface comprises the step of carrying out proportional allocation on the display interface of each output device;
and determining output equipment corresponding to the high-speed video stream data of different types according to the distribution interface.
4. A matrix switcher for video conferences as defined in claim 1, wherein the cross-switch display includes:
setting a selection instruction of the cross split screen according to the data input equipment;
responding to receiving a selection instruction of a cross split screen type in a plurality of split screen types of the terminal equipment; wherein,,
the terminal equipment can input and output simultaneously;
displaying an output device and a split screen interface corresponding to the cross split screen type through the current terminal device; wherein,,
the split screen interface comprises at least two terminal devices which are simultaneously output and input;
and controlling the terminal equipment to cross display the video stream data according to the split screen interface.
5. A matrix switcher for video conferences as claimed in claim 1, wherein the tiled display includes the steps of:
acquiring high-speed video stream data of a plurality of input devices, and inputting the high-speed serial video stream data into a sliding window according to frames;
constructing a scene model based on the frame pose of each frame of video data in the sliding window and the bit depth information of the characteristic points of the high-speed video stream data; wherein,,
the bit depth information of the feature points is obtained by triangulating the feature points;
matching the characteristic points of each frame of video data with the characteristic points of the scene model to obtain a matching result;
video stitching is carried out on the high-speed video stream data of different input devices based on the matching result, and stitched videos are obtained after stitching is completed;
and displaying the spliced video through output equipment.
6. The matrix switcher for video conferences of claim 1, wherein the intelligent central control module comprises:
the upper computer unit: the method is used for setting an upper computer instruction and an upper computer program; wherein,,
the upper computer instruction is a key instruction and an infrared remote control instruction;
the upper computer program is connected with the local area network through RS232, and split screen control is carried out on the WEB page program and the third party program through the local area network.
7. The matrix switcher for video conferences of claim 1 wherein the intelligent central control module is further configured to automatically power down, wherein the step of automatically powering down is as follows:
when the matrix switcher is started, meeting power of the matrix switcher is fed back to the upper computer;
when the conference power is within a first threshold, the upper computer controls the matrix switcher to be powered off;
when the conference power is within the second threshold, the active signal of the upper computer is received through the matrix switcher, the conference stage is entered, and the conference power of the matrix switcher is uploaded to the upper computer in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310619240.9A CN116347016B (en) | 2023-05-30 | 2023-05-30 | Matrix switcher for video conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310619240.9A CN116347016B (en) | 2023-05-30 | 2023-05-30 | Matrix switcher for video conference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116347016A CN116347016A (en) | 2023-06-27 |
| CN116347016B true CN116347016B (en) | 2023-08-22 |
Family
ID=86891588
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310619240.9A Active CN116347016B (en) | 2023-05-30 | 2023-05-30 | Matrix switcher for video conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116347016B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980701B (en) * | 2023-09-21 | 2024-02-20 | 广东保伦电子股份有限公司 | Wireless switching control method, device and system based on two-dimensional secret code |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104767943A (en) * | 2015-04-17 | 2015-07-08 | 武汉兴图新科电子股份有限公司 | One-key large-screen display system and method |
| CN105681685A (en) * | 2014-11-17 | 2016-06-15 | 孤山电子科技（上海）有限公司 | Signal processor and system and implementation method of picture in picture and multi-screen display |
| CN107295321A (en) * | 2017-08-11 | 2017-10-24 | 成都希德电子信息技术有限公司 | The advertisement projecting system of timesharing split screen |
| CN108184094A (en) * | 2017-12-29 | 2018-06-19 | 北京视觉世界科技有限公司 | Video picture displaying method and device |
| CN113709540A (en) * | 2021-08-20 | 2021-11-26 | 北京计算机技术及应用研究所 | Multi-source video acquisition switching and display system and method based on domestic processor |
-
2023
- 2023-05-30 CN CN202310619240.9A patent/CN116347016B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681685A (en) * | 2014-11-17 | 2016-06-15 | 孤山电子科技（上海）有限公司 | Signal processor and system and implementation method of picture in picture and multi-screen display |
| CN104767943A (en) * | 2015-04-17 | 2015-07-08 | 武汉兴图新科电子股份有限公司 | One-key large-screen display system and method |
| CN107295321A (en) * | 2017-08-11 | 2017-10-24 | 成都希德电子信息技术有限公司 | The advertisement projecting system of timesharing split screen |
| CN108184094A (en) * | 2017-12-29 | 2018-06-19 | 北京视觉世界科技有限公司 | Video picture displaying method and device |
| CN113709540A (en) * | 2021-08-20 | 2021-11-26 | 北京计算机技术及应用研究所 | Multi-source video acquisition switching and display system and method based on domestic processor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116347016A (en) | 2023-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210099655A1 (en) | Intelligent display for processing video and metadata streams | |
| US10511803B2 (en) | Video signal transmission method and device | |
| RU2367110C1 (en) | Device and method for managing video images | |
| CN207399423U (en) | A kind of distributed network video process apparatus | |
| CN105491393A (en) | Method for implementing multi-user live video business | |
| CN105262974A (en) | Method for realizing wireless screen sharing of multiple users | |
| WO2013077525A1 (en) | Control method and device using same | |
| JP6172610B2 (en) | Video conferencing system | |
| CN101365097A (en) | Conferencing system, server, image display method, and computer program product | |
| CN116347016B (en) | Matrix switcher for video conference | |
| EP2683155A1 (en) | System and Method for Processing Video and/or Audio Signals | |
| WO2014101428A1 (en) | Image control method and terminal, video conference apparatus | |
| CN105516689A (en) | Method and system for distributed tiled display | |
| CN101938626A (en) | Video session terminal, system, and method | |
| CN205336455U (en) | Distributing type tiled display system | |
| CN103856809A (en) | Method, system and terminal equipment for multipoint at the same screen | |
| CN114546308A (en) | Application interface screen projection method, device, equipment and storage medium | |
| JPH09505448A (en) | Networks enabled for multimedia | |
| CN106134184A (en) | Information terminal, system, control method and record medium | |
| CN105306872A (en) | Method, apparatus and system for controlling multipoint video conference | |
| CN106603537A (en) | System and method for marking video signal source of mobile intelligent terminal | |
| Luzuriaga et al. | Software-based video–audio production mixer via an IP network | |
| CN207869152U (en) | A kind of multimedia messages distributed interactive system | |
| CN209805954U (en) | Clear transmission distributed system of 4K superelevation | |
| CN107613376A (en) | A kind of live broadcasting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |