CN117201835A - Multi-signal source pushing method, system, medium and equipment - Google Patents
Multi-signal source pushing method, system, medium and equipment Download PDFInfo
- Publication number
- CN117201835A CN117201835A CN202311167916.1A CN202311167916A CN117201835A CN 117201835 A CN117201835 A CN 117201835A CN 202311167916 A CN202311167916 A CN 202311167916A CN 117201835 A CN117201835 A CN 117201835A
- Authority
- CN
- China
- Prior art keywords
- signal source
- pushing
- signal
- source picture
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000009471 action Effects 0.000 claims description 25
- 230000003238 somatosensory effect Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 description 18
- 230000004044 response Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 4
- 230000003111 delayed effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000012856 packing Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- IRLPACMLTUPBCL-KQYNXXCUSA-N 5'-adenylyl sulfate Chemical compound C1=NC=2C(N)=NC=NC=2N1[C@@H]1O[C@H](COP(O)(=O)OS(O)(=O)=O)[C@@H](O)[C@H]1O IRLPACMLTUPBCL-KQYNXXCUSA-N 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Abstract
The invention relates to a multi-signal source pushing method, a system, a medium and equipment, wherein the system comprises two signal pushing terminals, a target terminal and a server, each signal pushing terminal acquires a signal source picture of a signal source, codes and forms an encoded video stream, and reports information of the signal source picture and an encoded video stream address to the server; the server stores the information to form signal source picture summary information; the signal pushing terminal is also used for analyzing the pushing data and determining different pushing instructions, and sending the pushing instructions to the server; the pushing instruction comprises information of a signal source picture to be pushed, a target terminal and a display mode on the target terminal; the server is also used for receiving the push instruction, determining a target coded video stream address and sending the target coded video stream address and the push instruction to the target terminal; and the target terminal acquires the signal source picture and displays the signal source picture according to the display mode. The invention can improve the pushing efficiency and save the pushing cost.
Description
Technical Field
The invention relates to a multi-signal source pushing method, a system, a medium and equipment for pushing a plurality of signal sources.
Background
Fig. 1 schematically illustrates a prior art multi-signal source push system. As shown in the drawing, in the related art, a video input terminal of the image mosaic controller 300 is connected to a plurality of signal sources (101, 102, 103, 104), a video output terminal of the image mosaic controller 300 is connected to a screen 401, and a control input terminal of the image mosaic controller 300 is connected to the central control apparatus 201. The center control device 201 controls the display of the respective video signal sources on the screen 401 by controlling the image stitching controller 300.
In the prior art, all signal sources must be uniformly connected to an image splicing controller, and then the pushing and displaying of each signal source can be realized by controlling the image splicing controller.
Disclosure of Invention
In order to solve the above problems, the present application provides a multi-signal source push system, which includes: each signal pushing terminal is connected with corresponding input equipment and display equipment;
each signal pushing terminal is respectively connected with one or more signal sources, acquires signal source pictures of the signal sources respectively connected with the signal pushing terminals, codes and forms coded video streams corresponding to the signal source pictures, and reports information of the signal source pictures and coded video stream addresses to a server;
The server is used for receiving the information of the signal source pictures and the coded video stream address sent by each signal pushing terminal, storing and forming signal source picture summary information, and sending the signal source picture summary information to each signal pushing terminal for signal source picture selection;
each signal pushing terminal is also used for collecting pushing data generated by pushing operation on the input equipment, analyzing the pushing data, determining different pushing instructions according to analysis results, and sending the pushing instructions to a server; the pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is pushed, and a display mode of the signal source picture to be pushed on the target terminal;
the server is further configured to receive a push instruction, determine a target encoded video stream address corresponding to the information of the signal source picture in the push instruction according to the information of the signal source picture in the push instruction and the information and the encoded video stream address of the signal source picture reported by each signal push terminal, and send the target encoded video stream address and the push instruction to a corresponding target terminal according to the target terminal indicated in the push instruction;
The target terminal is used for receiving the target coded video stream address and the pushing instruction, acquiring a signal source picture according to the target coded video stream address, decoding the signal source picture, and displaying the decoded signal source picture according to a display mode indicated in the pushing instruction.
According to some embodiments of the invention, the input device and the display device are touch screen displays; the signal pushing terminal associates a touch object with a signal source picture to be pushed in advance, sets a touch direction to be associated with a target terminal in the direction, and associates a touch gesture with a display mode; the display mode comprises full screen picture display, reduced display and display at a certain grid position, or when the signal source pictures to be pushed simultaneously comprise a plurality of signal source pictures, the signal source pictures are displayed at different grid positions together according to a certain distribution mode; the touch gestures include single-finger swipes, multi-finger swipes, and palm swipes.
According to some embodiments of the present invention, the input device includes a somatosensory pushing device that sets a somatosensory pushing direction in advance to be associated with a target terminal in the direction, associates a somatosensory pushing action mode with a display mode, and associates a somatosensory pushing action object with a signal source screen to be pushed; or the input device comprises a mouse, the signal pushing terminal associates the moving direction of the mouse with the target terminal in advance, associates the clicking mode of the mouse with the display mode, and associates the selected object of the mouse with the signal source picture to be pushed.
According to some embodiments of the application, the information of the signal source picture includes a signal source picture ID, a signal source picture definition, a signal source picture authority, a signal source control protocol, a control ip and a port, a main and auxiliary code stream, whether a public network is opened, a public network code stream address, or an authority of a signal push terminal where the signal source picture is located.
The application also provides a multi-signal source pushing method, which comprises the following steps:
s11, each signal pushing terminal acquires a signal source picture of each connected signal source, codes and forms a coded video stream corresponding to the signal source picture, and reports information of the signal source picture and an address of the coded video stream to a server;
s12, the server receives information of signal source pictures and coded video stream addresses sent by each signal pushing terminal, stores the information and forms signal source picture summary information, and sends the signal source picture summary information to each signal pushing terminal for signal source picture selection;
s13, responding to push data generated by push operation, analyzing the push data by the signal push terminal, determining different push instructions according to analysis results, and sending the push instructions to the server; the pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is pushed, and a display mode of the signal source picture to be pushed on the target terminal;
S14, the server receives the pushing instruction, determines a target coded video stream address corresponding to the information of the signal source picture in the pushing instruction according to the information of the signal source picture in the pushing instruction and the information and the coded video stream address of the signal source picture reported by each signal pushing terminal, and sends the target coded video stream address and the pushing instruction to the corresponding target terminal according to the target terminal indicated in the pushing instruction;
s15, the target terminal receives the target coded video stream address and the pushing instruction, acquires the corresponding coded video stream according to the target coded video stream address, decodes the coded video stream, and displays the decoded signal source picture according to the display mode indicated in the pushing instruction.
According to some embodiments of the invention, the push data includes touch data, the method includes: the signal pushing terminal associates a touch object with a signal source picture to be pushed in advance, sets a touch direction to be associated with a target terminal in the direction, and associates a touch gesture with a display mode;
the touch gestures include single-finger swipe, multi-finger swipe, and palm swipe;
the display mode includes full screen display, reduced display, display in a certain grid position, or when the signal source picture to be pushed includes multiple signal source pictures at the same time, the signal source pictures are displayed in different grid positions together in a certain distribution mode.
According to some embodiments of the application, the push data comprises somatosensory push data, the method comprising: the signal pushing terminal sets the motion sensing pushing direction to be associated with a target terminal in the direction in advance, associates the motion sensing pushing action mode with the display mode, and associates the motion sensing pushing action object with a signal source picture to be pushed; or the pushing data comprise mouse input data, the signal pushing terminal correlates the moving direction of the mouse with the target terminal in advance, correlates the clicking mode of the mouse with the display mode, and correlates the selected object of the mouse with the signal source picture to be pushed.
According to some embodiments of the present application, the information of the signal source picture includes a signal source picture ID, a signal source picture definition, a signal source picture authority, a signal source control protocol, a control ip and a port, a main and auxiliary code stream, whether a public network is opened, a public network code stream address, or an authority of a signal push terminal where the signal source picture is located.
The application also provides a device for pushing the multiple signal sources, which comprises a processor and a memory; the processor performs the multi-signal source push method based on a computer program stored in a memory.
The application also provides a computer readable storage medium storing a computer program which when executed by a processor implements the multi-signal source push method.
According to the embodiment of the application, the display and the display mode of each signal source picture on the target terminal can be rapidly realized at the local signal pushing terminal without an image splicing controller, and the control of the display mode can be realized when pushing is initiated, so that the two parties do not need to communicate with each other in other channels in the later period to carry out negotiation control, and the repeated communication confirmation is avoided. In addition, the server only needs to transmit a small amount of pushing instructions in the whole pushing process, and signal source video streams at various places do not need to be forwarded or stored, so that the server load is low, and the problems of signal delay, large consumption of server resources and the like caused by the fact that the server participates in forwarding of a large amount of video streams are avoided. In addition, in the application, as each signal source can be respectively positioned at a plurality of different terminals, unlike the control display technology of the image splicing controller in the prior art, all signal sources are required to be uniformly connected to the image splicing controller, and then the pushing and the display of each signal source can be realized by controlling the image splicing controller, the problems of difficult connection and the like caused by the distance between the signal source and the image splicing controller are also existed, and the application does not have the problems. As will be further understood from the following description, the signal acquisition and encoding video streaming step and the step of reporting the server of the present application occur prior to the push process independently of the subsequent push process, and when the actual push action occurs, the signal acquisition and encoding action does not need to be temporarily initiated, so that the problems of delayed push response and the like caused by performing encoding in response to push in the push process can be avoided.
Drawings
Fig. 1 is a schematic diagram of a multi-signal source push system in the prior art.
Fig. 2 illustrates a schematic diagram of a multiple signal source push system according to some embodiments of the application.
Fig. 3 shows an internal module of the signal push terminal of fig. 2 and a connection manner between the internal module and a server and a signal source.
Fig. 4 is a flow chart of a multi-signal source push method according to some embodiments of the application.
Fig. 5 illustrates a schematic block diagram of an apparatus 500 for multi-signal source pushing according to some embodiments of the application.
Detailed Description
In the present application, the network is used to implement, and the essence is to cover the wired or wireless network connection implemented by the necessary firmware or software of the switch, router, etc., and also cover the wired or wireless network connection implemented by some service end or other computer as medium. In the present application, the networks involved may include Wi-fi networks, bluetooth networks, private Area Networks (PANs), local Area Networks (LANs), wide Area Networks (WANs), IEEE 802.1x, intranets, the internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile communications (GSM), general Packet Radio Service (GPRS), cdmaOne, CDMA2000, evolution-data optimized (EV-DO), enhanced data rates for GSM evolution (EDGE), universal Mobile Telecommunications System (UMTS), digital Enhanced Cordless Telecommunications (DECT), digital AMPS (IS-136/TDMA), integrated Digital Enhanced Network (iDEN), wiMAX, LTE advanced, mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private, e.g., VPN.
The present application will be described by way of example with reference to the accompanying drawings in conjunction with the embodiments, and it should be noted that the embodiments of the present application and features of the embodiments may be combined with each other without conflict. In addition, the described embodiments are some, but not all, embodiments of the application.
Fig. 2 illustrates a schematic diagram of a multiple signal source push system according to some embodiments of the application.
The multi-signal source pushing system comprises: signal push terminals 601 and 602, target terminal 603, server 900.
Each signal pushing terminal is connected with two signal sources, and the output end is connected with a touch screen display. As shown in fig. 2, signal sources 701 and 702 may be connected to the signal push terminal 601 through an HDMI line, and signal sources 703 and 704 may be connected to the signal push terminal 602 through an HDMI line. Each signal pushing terminal is connected with a corresponding input device and a display device, and is shown to comprise a touch screen display (501 and 502) through which a user touch control and output pushing interface can be received. Other instruction input modes besides gesture touch push, such as somatosensory push, mouse selection push and the like, can be adopted.
The target terminal 603 and the two signal push terminals are connected to the server 900 through a switch. Two signal push terminals and one target terminal are shown in the figure, which may actually be a plurality of such signal push terminals and target terminals. Each signal push terminal and the target terminal are accessed to the network constructed by the switch 800, and other encoder nodes can be added in the actual use process, namely, the other encoder nodes are connected with the switch to serve as network coding signal sources.
Fig. 3 shows the internal modules of the signal push terminal 601 of fig. 2 and the connection between the internal modules and the server and the signal source.
As shown in fig. 3, the signal pushing terminal 601 includes a signal acquisition encoding module 6001, a display touch acquisition module 6002, a touch gesture recognition module 6003, a pushing instruction packaging module 6004 and a network instruction sending module 6005. These modules may also be combined with each other to exist as a new module or the functions of the respective modules may be divided in a new manner.
The signal source 701 may be connected to the HDMI video input port of the signal push terminal 601 through an HDMI line, and the signal source 702 may be connected to the HDMI video input port of the signal push terminal 601 through an HDMI line.
The signal collection and encoding module 6001 collects a signal (or referred to as a signal source picture) of the HDMI video input port, and encodes the signal to form an rtsp video stream (or referred to as an encoded video stream), where the rtsp video stream may be stored on an rtsp stream server (not shown in the figure) of the signal pushing terminal 601 itself. The signal acquisition and encoding module 6001 on each signal pushing terminal further reports the information of the signal source picture and the rtsp video stream address (encoded video stream address) to the server 900. The information of the signal source picture includes a signal source picture ID, a signal source picture definition, a signal source picture authority, a signal source picture ownership, a signal source control protocol, a control ip and a port, a main and auxiliary code stream, whether a public network, a public network code stream address, or an authority of a signal push terminal where the signal source picture is located (such as an authority of a signal push terminal 601 where the signal source picture is located).
According to some embodiments of the present invention, the rtsp video stream may also be sent to the signal push terminal 601 by other signal sources through a network, and the latter stores the rtsp video stream on the rtsp stream server of the signal push terminal 601 itself; or the rtsp video stream may be obtained and decoded by the signal push terminal 601 through a network, and then a view is obtained through a screenshot operation and encoded to form the rtsp video stream.
The server 900 is configured to receive the information of the signal source frames and the coded video stream address sent by each signal pushing terminal 601 and 602, store and form signal source frame summary information, and send the signal source frame summary information to each signal pushing terminal 601 and 602 for signal source frame selection. The signal source picture summary information may include information of all signal source pictures, or the signal source picture summary information may not include the encoded video stream address, so as to hide the encoded video stream addresses on other signal push terminals from each signal push terminal. The server 900 may describe the signal source pictures in the form of a list or a set of thumbnails, and the sending the signal source picture summary information to each signal pushing terminal for signal source picture selection may include sending the list or the set of thumbnails to each signal pushing terminal 601 and 602.
The signal pushing terminal can also associate a touch object with a signal source picture to be pushed in advance, set a touch direction to be associated with a target terminal in the direction, and associate a touch gesture with a display mode.
When a user pushes on the touch screen display 501, the touch screen display 501 transmits touch data to the signal pushing terminal 601, the display touch acquisition module 6002 of the signal pushing terminal 601 acquires the touch data, the touch gesture recognition module 6003 analyzes the touch data (e.g., analyzes different touch results including touch objects, touch directions, and touch gestures based on the previously implemented association settings), and transmits the analysis result to the push instruction packaging module 6004. The push instruction packing module 6004 determines different push instructions (for example, determines a signal source screen to be pushed according to a touch object, determines a target terminal according to a touch direction, and determines a display mode according to a touch gesture) according to different analysis results, and packs. The pushing instruction may include information of a signal source picture to be pushed selected by a pushing operation based on signal source picture summary information (for example, a signal source picture to be pushed selected by performing a touch operation on a signal source picture thumbnail in a signal source picture summary information graph), a target terminal 603 to which the signal source picture to be pushed is to be pushed, a display manner of the signal source picture to be pushed on the target terminal 603 may include a full screen picture display, a reduced display, a display at a certain grid position, or when the signal source picture to be pushed includes multiple signal source pictures (signal sources 701 and 702) at the same time, the signal source pictures are displayed together at different grid positions in a certain distribution manner, such as a left-right distribution or an up-down distribution. The pushing action corresponds to an action corresponding to an input for generating pushing data, and a user can select one or more signal source pictures to be pushed from the signal source picture summary list through the input, namely the pushing action.
When the input device includes a somatosensory pushing device, the signal pushing terminal 601 may set a somatosensory pushing direction to be associated with a target terminal in the direction in advance, and associate a somatosensory pushing action mode with a display mode, and associate a somatosensory pushing action object with a signal source screen to be pushed; or when the input device includes a mouse, the signal pushing terminal 601 may associate a moving direction of the mouse with the target terminal in advance, associate a clicking mode of the mouse with a display mode, and associate a selected object of the mouse with a signal source screen to be pushed.
The push instruction packing module 6004 sends the packed push instruction to the network instruction sending module 6005, and the network instruction sending module 6005 sends the push instruction to the server 900.
The server 900 receives the push instruction, determines a target encoded video stream address corresponding to the information (such as the signal source picture ID) of the signal source picture in the push instruction according to the information (such as the signal source picture ID) of the signal source picture in the push instruction, the information (such as the signal source picture ID) of the signal source picture reported by each signal push terminal and the encoded video stream address, and sends the target encoded video stream address and the push instruction to the corresponding target terminal according to the target terminal indicated in the push instruction. In the application, sending the target coded video stream address and the push command to the corresponding target terminal comprises sending the target coded video stream address and the push command to the target terminal, or sending part of the target coded video stream address and the push command to the target terminal, for example, sending only the information of the display mode and the signal source picture in the target coded video stream address and the push command to the target terminal, or sending only the display mode in the target coded video stream address and the push command to the target terminal.
The target terminal receives the target encoded video stream address and the push command, obtains a corresponding encoded video stream according to the target encoded video stream address (for example, from an rtsp stream server of the signal push terminal 601), decodes the encoded video stream, displays the decoded signal source picture according to the display mode indicated in the push command, and can additionally display other information of the signal source picture. If the signal source pictures to be pushed are pictures of two signal sources, the target terminal acquires each signal source picture according to the coded video stream address of each signal source picture to decode, and displays the decoded signal source pictures according to the display mode indicated in the pushing instruction.
According to the embodiment of the invention, the display and the display mode of each signal source picture on the target terminal can be rapidly realized at the local signal pushing terminal without an image splicing controller, and the control of the display mode can be realized when pushing is initiated, so that the two parties do not need to communicate with each other in other channels in the later period to carry out negotiation control, and the repeated communication confirmation is avoided. In addition, the server only needs to transmit a small amount of pushing instructions in the whole pushing process, and signal source video streams at various places do not need to be forwarded or stored, so that the server load is low, and the problems of signal delay, large consumption of server resources and the like caused by the fact that the server participates in forwarding of a large amount of video streams are avoided. In addition, in the invention, as each signal source can be respectively positioned at a plurality of different terminals, unlike the control display technology of the image splicing controller in the prior art, all signal sources are required to be uniformly connected to the image splicing controller, and then the pushing and the display of each signal source can be realized by controlling the image splicing controller, the problems of difficult connection and the like caused by the distance between the signal source and the image splicing controller are also existed, and the invention does not have the problems. As will be further understood from the following description, the signal acquisition and encoding video streaming step and the step of reporting the server of the present invention occur prior to the push process independently of the subsequent push process, and when the actual push action occurs, the signal acquisition and encoding action does not need to be temporarily initiated, so that the problems of delayed push response and the like caused by performing encoding in response to push in the push process can be avoided.
The application further provides a multi-signal source pushing method. Fig. 4 is a flowchart of a multi-signal source push method according to some embodiments of the present application, where the execution subject of each step may be each terminal described in fig. 2-3, or may be independent of each terminal described in fig. 2-3, and as shown in the figure, the method includes the following steps:
s11, each signal pushing terminal acquires a signal source picture of each connected signal source, codes and forms a coded video stream corresponding to the signal source picture, and reports information of the signal source picture and an address of the coded video stream to a server.
As shown in fig. 3, the signal of the HDMI video input port may be collected by the signal collection encoding module 6001 and encoded to form an rtsp video stream. The rtsp video stream can be stored in the rtsp stream server of the signal push terminal. According to some embodiments of the present application, the rtsp video stream may also be sent to the signal push terminal by other signal sources through a network, and the latter stores the rtsp video stream on the rtsp stream server of the signal push terminal itself. According to some embodiments of the present application, the rtsp video stream may also be obtained and decoded by the signal push terminal through a network to be displayed, and then a view is obtained through a screenshot operation and encoded to form the rtsp video stream.
S12, the server receives information of signal source pictures and coded video stream addresses sent by the signal pushing terminals, stores the information and forms signal source picture summary information, and sends the signal source picture summary information to the signal pushing terminals for signal source picture selection.
The signal source picture summary information may include information of all signal source pictures, and each signal source picture may be embodied in the form of a list or a thumbnail set. The server can send the signal source picture summary information to each signal pushing terminal for signal source picture selection. The signal source picture summary information sent to each signal pushing terminal may also not contain the encoded video stream addresses, so as to hide all the encoded video stream addresses on other signal pushing terminals from each signal pushing terminal. The server may describe the signal source pictures in the form of a list or a set of thumbnails.
S13, responding to push data generated by push operation, analyzing the push data by the signal push terminal, determining different push instructions according to analysis results, and sending the push instructions to the server; the pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is pushed, and a display mode of the signal source picture to be pushed on the target terminal.
When the signal pushing is carried out, the signal pushing terminal collects pushing data, analyzes the pushing data, determines different pushing instructions according to analysis results (including analysis of different touch results), and sends the pushing instructions to the server. The pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is to be pushed, and a display mode of the signal source picture to be pushed on the target terminal can comprise full screen picture display, reduced display and display, or when the signal source picture to be pushed simultaneously comprises a plurality of signal source pictures, the signal source pictures are displayed together at different grid positions in a certain distribution mode, such as left-right distribution or up-down distribution.
The push data may include touch data, and the method may include: the signal pushing terminal associates a touch object with a signal source picture to be pushed in advance, sets a touch direction to be associated with a target terminal in the direction, and associates a touch gesture with a display mode.
Touch gestures may include single-finger swipes, multi-finger swipes, and palm swipes.
The display mode may include full screen display, reduced display, display at a certain grid position, or when the signal source screen to be pushed includes multiple signal source screens at the same time, the signal source screens are displayed together at different grid positions in a certain distribution mode.
When the pushing mode is somatosensory pushing, the pushing data may include somatosensory pushing data, and the method may include: the signal pushing terminal sets the motion sensing pushing direction to be associated with a target terminal in the direction in advance, associates the motion sensing pushing action mode with the display mode, and associates the motion sensing pushing action object with a signal source picture to be pushed; or the pushing data comprise mouse input data, the signal pushing terminal correlates the moving direction of the mouse with the target terminal in advance, correlates the clicking mode of the mouse with the display mode, and correlates the selected object of the mouse with the signal source picture to be pushed.
S14, the server receives the pushing instruction, determines a target coded video stream address corresponding to the information of the signal source picture in the pushing instruction according to the information of the signal source picture in the pushing instruction, the information of the signal source picture and the coded video stream address reported by each signal pushing terminal, and sends the target coded video stream address and the pushing instruction to the corresponding target terminal according to the target terminal indicated in the pushing instruction.
In the application, the sending of the target encoded video stream address and the push instruction to the corresponding target terminal includes sending the target encoded video stream address and the push instruction, or a part of the target encoded video stream address and the push instruction, to the target terminal.
S15, the target terminal receives the target coded video stream address and the pushing instruction, acquires the corresponding coded video stream according to the target coded video stream address, decodes the coded video stream, and displays the decoded signal source picture according to the display mode indicated in the pushing instruction.
The display mode comprises full screen display, reduced display and display at a certain grid position, or when the signal source pictures to be pushed simultaneously comprise a plurality of signal source pictures, the signal source pictures are displayed at different grid positions together according to a certain distribution mode, such as left-right distribution or up-down distribution.
In addition, the corresponding detailed descriptions previously set forth with reference to FIGS. 2-3 are incorporated by reference herein and are not repeated here.
According to the embodiment of the application, the display and the display mode of each signal source picture on the target terminal can be rapidly realized at the local signal pushing terminal without an image splicing controller, and the control of the display mode can be realized when pushing is initiated, so that the two parties do not need to communicate with each other in other channels in the later period to carry out negotiation control, and the repeated communication confirmation is avoided. In addition, the server only needs to transmit a small amount of pushing instructions in the whole pushing process, and signal source video streams at various places do not need to be forwarded or stored, so that the server load is low, and the problems of signal delay, large consumption of server resources and the like caused by the fact that the server participates in forwarding of a large amount of video streams are avoided. In addition, in the application, as each signal source can be respectively positioned at a plurality of different terminals, unlike the control display technology of the image splicing controller in the prior art, all signal sources are required to be uniformly connected to the image splicing controller, and then the pushing and the display of each signal source can be realized by controlling the image splicing controller, the problems of difficult connection and the like caused by the distance between the signal source and the image splicing controller are also existed, and the application does not have the problems. As will be further understood from the following description, the signal acquisition and encoding video streaming step and the step of reporting the server of the present application occur prior to the push process independently of the subsequent push process, and when the actual push action occurs, the signal acquisition and encoding action does not need to be temporarily initiated, so that the problems of delayed push response and the like caused by performing encoding in response to push in the push process can be avoided.
Fig. 5 illustrates a schematic block diagram of an apparatus 500 for multi-signal source pushing according to some embodiments of the application. As shown in fig. 5, the device includes a processor 51, a memory 52, and a bus 53.
In some examples, the device may also include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, the processor 51, the memory 52, and the output port 503 are connected to each other through the bus 53, and the input device 501 and the output device 504 are connected to the bus 53 through the input port 502 and the output port 503, respectively, and further connected to other components of the device. The output interface and the input interface may be represented by I/O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 through the input port 502; processor 51 processes the input information based on computer-executable instructions stored in memory 52 to generate output information, temporarily or permanently stores the output information in memory 52, and then communicates the output information to output device 504 via output port 503; the output device 504 outputs the output information to the outside of the device. The input device 501 may be, for example, a signal acquisition coding module 6001 (or device) and a display touch acquisition module 6002 (or device) mentioned in the present application. The output device may be, for example, a network instruction transmitting module (or device) or the like in the present application.
The memory 52 includes mass storage for data or instructions. By way of example, and not limitation, memory 52 may comprise an HDD, floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Memory 52 may include removable or non-removable (or fixed) media, where appropriate. The memory 52 may be internal or external to the device, where appropriate. In a particular embodiment, the memory 52 is a non-volatile solid state memory. In particular embodiments, memory 52 includes Read Only Memory (ROM). The ROM may be mask programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these, where appropriate.
The bus 53 includes hardware, software, or both, coupling the various components to one another. By way of example, and not limitation, bus 53 may comprise an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of the above. Although embodiments of the invention have been described and illustrated with respect to a particular bus, the invention contemplates any suitable bus or interconnect.
The processor 51 performs the actions of the signal push terminal described above with respect to fig. 2-4 based on a computer program stored in the memory 52.
According to further embodiments of the present invention, the computer program may be divided into one or more units in various ways, stored in the memory, and executed by the processor to accomplish the present invention. The one or more elements may be a series of computer program instruction segments capable of performing the specified functions, which instruction segments describe the execution of the computer program in the device. The computer program may be divided into a plurality of modules according to the functions of the modules in the embodiments described above with reference to fig. 3, or include the modules in the embodiments described above with reference to fig. 3. For simplicity, this will not be repeated here.
The processor may be a central processing unit (Central Processing Unit, CPU), other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is a control center of the device, connecting the various parts of the overall device using various interfaces and lines. The device may be a computing device such as a desktop computer, a notebook computer, a palm computer, a cloud server, or a portion thereof. The device may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that the schematic is merely an example of a device and is not meant to be limiting.
The corresponding details previously described with reference to fig. 2-4 are incorporated herein by reference and will not be described in detail herein.
The present application also proposes a computer readable storage medium storing a computer program which, when executed by a processor, implements the actions of the signal pushing terminal described above with reference to fig. 2-4.
The corresponding details previously described with reference to fig. 2-4 are incorporated herein by reference and will not be described in detail herein.
The computer program comprises computer program code which may be in source code form, object code form, executable file or in some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
According to the embodiment of the application, the display and the display mode of each signal source picture on the target terminal can be rapidly realized at the local signal pushing terminal without a splice controller, and the control of the display mode can be realized when pushing is initiated, so that the two parties do not need to communicate with each other in other channels in the later period to carry out negotiation control, and the repeated communication confirmation is avoided. In addition, the server only needs to transmit a small amount of pushing instructions in the whole pushing process, and signal source video streams at various places do not need to be forwarded or stored, so that the server load is low, and the problems of signal delay, large consumption of server resources and the like caused by the fact that the server participates in forwarding of a large amount of video streams are avoided. In addition, in the present application, since each signal source may be located at a plurality of different terminals, unlike the control display technology of the splice controller in the prior art, the latter must uniformly connect all signal sources to the splice controller, and then push and display of each signal source can be achieved by controlling the splice controller, so that there is also a problem of difficult connection caused by the distance between the signal source and the splice controller, and the present application does not have such a problem. As will be further understood from the following description, the signal acquisition and encoding video streaming step and the step of reporting the server of the present application occur prior to the push process independently of the subsequent push process, and when the actual push action occurs, the signal acquisition and encoding action does not need to be temporarily initiated, so that the problems of delayed push response and the like caused by performing encoding in response to push in the push process can be avoided.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention. It should be noted that although the structure of the apparatus of the present invention and the method of operation thereof are depicted in the accompanying drawings in a particular order, this does not require or imply that the operations be performed in that particular order, or that all of the illustrated operations be performed, to achieve desirable results. Rather, the steps depicted in the flowcharts may change the order of execution. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.
Claims (10)
1. A multiple signal source push system comprising: each signal pushing terminal is connected with corresponding input equipment and display equipment;
each signal pushing terminal is respectively connected with one or more signal sources, acquires signal source pictures of the signal sources respectively connected with the signal pushing terminals, codes and forms coded video streams corresponding to the signal source pictures, and reports information of the signal source pictures and coded video stream addresses to a server;
The server is used for receiving the information of the signal source pictures and the coded video stream address sent by each signal pushing terminal, storing and forming signal source picture summary information, and sending the signal source picture summary information to each signal pushing terminal for signal source picture selection;
each signal pushing terminal is also used for collecting pushing data generated by pushing operation on the input equipment, analyzing the pushing data, determining different pushing instructions according to analysis results, and sending the pushing instructions to a server; the pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is pushed, and a display mode of the signal source picture to be pushed on the target terminal;
the server is further configured to receive a push instruction, determine a target encoded video stream address corresponding to the information of the signal source picture in the push instruction according to the information of the signal source picture in the push instruction and the information and the encoded video stream address of the signal source picture reported by each signal push terminal, and send the target encoded video stream address and the push instruction to a corresponding target terminal according to the target terminal indicated in the push instruction;
The target terminal is used for receiving the target coded video stream address and the pushing instruction, acquiring a signal source picture according to the target coded video stream address, decoding the signal source picture, and displaying the decoded signal source picture according to a display mode indicated in the pushing instruction.
2. The multiple signal source push system of claim 1, wherein the input device and display device are touch screen displays; the signal pushing terminal associates a touch object with a signal source picture to be pushed in advance, sets a touch direction to be associated with a target terminal in the direction, and associates a touch gesture with a display mode; the display mode comprises full screen picture display, reduced display and display at a certain grid position, or when the signal source pictures to be pushed simultaneously comprise a plurality of signal source pictures, the signal source pictures are displayed at different grid positions together according to a certain distribution mode; the touch gestures include single-finger swipes, multi-finger swipes, and palm swipes.
3. The multi-signal-source pushing system according to claim 1, wherein the input device includes a somatosensory pushing device that previously sets a somatosensory pushing direction to be associated with a target terminal in the direction, associates a somatosensory pushing action mode with a display mode, and associates a somatosensory pushing action object with a signal source screen to be pushed; or the input device comprises a mouse, the signal pushing terminal associates the moving direction of the mouse with the target terminal in advance, associates the clicking mode of the mouse with the display mode, and associates the selected object of the mouse with the signal source picture to be pushed.
4. The multi-signal source push system of claim 1, wherein the information of the signal source picture includes a signal source picture ID, a signal source picture definition, a signal source picture authority, a signal source picture ownership, a signal source control protocol, a control ip and port, a main and auxiliary code stream, whether a public network is opened, a public network code stream address, or an authority of a signal push terminal where the signal source picture is located.
5. The multi-signal source pushing method comprises the following steps:
s11, each signal pushing terminal acquires a signal source picture of each connected signal source, codes and forms a coded video stream corresponding to the signal source picture, and reports information of the signal source picture and an address of the coded video stream to a server;
s12, the server receives information of signal source pictures and coded video stream addresses sent by each signal pushing terminal, stores the information and forms signal source picture summary information, and sends the signal source picture summary information to each signal pushing terminal for signal source picture selection;
s13, responding to push data generated by push operation, analyzing the push data by the signal push terminal, determining different push instructions according to analysis results, and sending the push instructions to the server; the pushing instruction comprises information of a signal source picture to be pushed, which is selected by pushing operation based on signal source picture summary information, a target terminal to which the signal source picture to be pushed is pushed, and a display mode of the signal source picture to be pushed on the target terminal;
S14, the server receives the pushing instruction, determines a target coded video stream address corresponding to the information of the signal source picture in the pushing instruction according to the information of the signal source picture in the pushing instruction and the information and the coded video stream address of the signal source picture reported by each signal pushing terminal, and sends the target coded video stream address and the pushing instruction to the corresponding target terminal according to the target terminal indicated in the pushing instruction;
s15, the target terminal receives the target coded video stream address and the pushing instruction, acquires the corresponding coded video stream according to the target coded video stream address, decodes the coded video stream, and displays the decoded signal source picture according to the display mode indicated in the pushing instruction.
6. The multi-signal source push method of claim 5, wherein the push data comprises touch data, the method comprising: the signal pushing terminal associates a touch object with a signal source picture to be pushed in advance, sets a touch direction to be associated with a target terminal in the direction, and associates a touch gesture with a display mode;
the touch gestures include single-finger swipe, multi-finger swipe, and palm swipe;
The display mode includes full screen display, reduced display, display in a certain grid position, or when the signal source picture to be pushed includes multiple signal source pictures at the same time, the signal source pictures are displayed in different grid positions together in a certain distribution mode.
7. The multi-signal source push method of claim 5, wherein the push data comprises somatosensory push data, the method comprising: the signal pushing terminal sets the motion sensing pushing direction to be associated with a target terminal in the direction in advance, associates the motion sensing pushing action mode with the display mode, and associates the motion sensing pushing action object with a signal source picture to be pushed; or the pushing data comprise mouse input data, the signal pushing terminal correlates the moving direction of the mouse with the target terminal in advance, correlates the clicking mode of the mouse with the display mode, and correlates the selected object of the mouse with the signal source picture to be pushed.
8. The multi-signal source pushing method according to claim 5, wherein the information of the signal source picture includes a signal source picture ID, a signal source picture definition, a signal source picture authority, a signal source picture ownership, a signal source control protocol, a control ip and port, a main and auxiliary code stream, whether a public network is opened, a public network code stream address, or an authority of a signal pushing terminal where the signal source picture is located.
9. The device for pushing multiple signal sources comprises a processor and a memory; the processor performs the multi-signal source push method of one of claims 5-8 based on a computer program stored in a memory.
10. A computer readable storage medium storing a computer program which, when executed by a processor, implements the multi-signal source push method of one of claims 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311167916.1A CN117201835A (en) | 2023-09-12 | 2023-09-12 | Multi-signal source pushing method, system, medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311167916.1A CN117201835A (en) | 2023-09-12 | 2023-09-12 | Multi-signal source pushing method, system, medium and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117201835A true CN117201835A (en) | 2023-12-08 |
Family
ID=88991968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311167916.1A Pending CN117201835A (en) | 2023-09-12 | 2023-09-12 | Multi-signal source pushing method, system, medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117201835A (en) |
-
2023
- 2023-09-12 CN CN202311167916.1A patent/CN117201835A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9311692B1 (en) | Scalable buffer remote access | |
| EP3826270A1 (en) | Cooperative control method for user equipment, user equipment, and communications system | |
| CN109862301B (en) | Screen video sharing method and device and electronic equipment | |
| CN111221491A (en) | Interaction control method and device, electronic equipment and storage medium | |
| CN111045620B (en) | Multi-signal-source scene on-screen display method and multi-signal-source scene on-screen display system | |
| US20190051147A1 (en) | Remote control method, apparatus, terminal device, and computer readable storage medium | |
| CN112462931B (en) | Signal source calling and controlling method and system | |
| US20150296054A1 (en) | Server apparatus, terminal, thin client system, screen transmission method and program | |
| JP2016031411A (en) | Radio communication system, display device and display method | |
| CN105760128A (en) | Multimedia data processing method and system and related devices | |
| US20150201199A1 (en) | Systems and methods for facilitating video encoding for screen-sharing applications | |
| CN111629234B (en) | Transmission method, device, equipment and storage medium for coexistence of different types of videos | |
| CN111510741A (en) | System and method for transmission and distributed display of at least two video signals | |
| US10191709B2 (en) | Display apparatus configured to determine a processing mode to transfer image contents to another display apparatus | |
| JP2016503619A (en) | Method, apparatus and recording medium for providing content | |
| CN104486665A (en) | Remote assistance method and device of mobile terminal | |
| US20230316583A1 (en) | Method and device for performing rendering using latency compensatory pose prediction with respect to three-dimensional media data in communication system supporting mixed reality/augmented reality | |
| CN111913677B (en) | Method and system for controlling spliced screen | |
| CN111010567B (en) | Multi-signal-source remote calling method and system | |
| CN117201835A (en) | Multi-signal source pushing method, system, medium and equipment | |
| CN106201385B (en) | Control method and device and electronic equipment | |
| CN117319759A (en) | Multi-signal source pushing and displaying method, system, medium and equipment | |
| CN111510742B (en) | System and method for transmission and display of at least two video signals | |
| CN115543083A (en) | Image display method and device and electronic equipment | |
| CN114039969A (en) | Data transmission method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |