CN112039961B - Streaming media system, data stream collection method, and storage medium - Google Patents
Streaming media system, data stream collection method, and storage medium Download PDFInfo
- Publication number
- CN112039961B CN112039961B CN202010822838.4A CN202010822838A CN112039961B CN 112039961 B CN112039961 B CN 112039961B CN 202010822838 A CN202010822838 A CN 202010822838A CN 112039961 B CN112039961 B CN 112039961B
- Authority
- CN
- China
- Prior art keywords
- data stream
- distributed node
- equipment
- decoding
- streaming media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
- H04L67/1048—Departure or maintenance mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a streaming media system, wherein control equipment of the streaming media system is used for receiving display demand information of a user, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to decoding equipment; the decoding equipment is used for receiving the scheduling instruction, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment; the distributed node equipment is used for receiving the display request, acquiring a streaming media data stream from the signal source equipment according to the display request, acquiring a storage data stream, and sending the storage data stream to the decoding equipment; the decoding device is further configured to receive the stored data stream and send the stored data stream to the display device; the display device is used for receiving and displaying the stored data stream. The invention also discloses a data stream collecting method and a storage medium. The maintenance cost of the streaming media system is low.
Description
Technical Field
The present invention relates to the field of streaming media technologies, and in particular, to a streaming media system, a data stream collection method, and a storage medium.
Background
Currently, a streaming media system includes a front-end device, a streaming media server, and a back-end display device. The streaming media server is a cluster formed by a plurality of PC (Personal Computer, chinese: personal computer) hosts, wherein one PC host is used as a core unit for managing a core database, running service processes, and the other PCs are used as forwarding units for mobilizing management by the core unit.
The core unit of the streaming media server is high in configuration and high in price, and when the core unit is abnormal and down, the whole streaming media system falls into a paralysis state, so that the maintenance cost is high.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The main purpose of the present invention is to provide a streaming media system, a data stream collecting method and a storage medium, which aim to solve the technical problem of high maintenance cost of the existing streaming media system.
In order to achieve the above object, the present invention provides a streaming media system, which includes a control device, a display device, a distributed node device, a decoding device, and a signal source device; wherein, the liquid crystal display device comprises a liquid crystal display device,
the control equipment is used for receiving display demand information of a user, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to the decoding equipment;
The decoding equipment is used for receiving the scheduling instruction, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment;
the distributed node equipment is used for receiving the display request, acquiring a streaming media data stream from the signal source equipment according to the display request, acquiring a storage data stream, and sending the storage data stream to the decoding equipment;
the decoding device is further configured to receive the stored data stream and send the stored data stream to the display device;
the display device is used for receiving and displaying the stored data stream.
Optionally, the signal source device includes a plurality of signal source devices;
the distributed node device is further configured to determine, according to the display request, a signal source device corresponding to the display request from a plurality of signal source devices, and obtain a streaming media data stream from the signal source device corresponding to the display request, so as to obtain a storage data stream.
Optionally, the streaming media system further includes a switch, and the distributed node device includes a plurality of distributed node devices, where the plurality of distributed node devices are connected to the decoding device through the switch.
Optionally, the distributed node device stores a storage data stream; the decoding device is further configured to receive a first broadcast message of the distributed node device, and determine, based on the first broadcast message, whether the distributed node device stores a storage data stream corresponding to the display request; if yes, the display request is sent to distributed node equipment storing a storage data stream corresponding to the display request.
Optionally, the decoding device is further configured to, after determining whether the distributed node device stores the stored data stream corresponding to the display request, receive a second broadcast message of the distributed node device, determine, based on the second broadcast message, a distributed node device with a smallest real-time load in the distributed node device, and send the display request to the distributed node device with the smallest real-time load.
Optionally, the decoding device is further configured to resend the display request to the distributed node device once when the stored data stream is not received in a preset time interval, until the decoding device receives the stored data stream in the preset time interval, and stops sending the display request to the distributed node device, where a starting time of the preset time interval is a time of last sending the display request.
Optionally, the decoding device includes a plurality of decoding devices, and the switch forwards the stored data stream to the plurality of decoding devices through a unicast or multicast transmission mode.
Optionally, the distributed node device is further configured to add a PTS to the streaming media data stream to obtain the storage data stream;
the decoding device is further configured to decode the stored data stream based on the PTS to obtain a decoded stored data stream.
In addition, in order to achieve the above object, the present invention also provides a data stream collecting method, which is applied to a streaming media system, wherein the streaming media system comprises a control device, a display device, a distributed node device, a decoding device and a signal source device; the method comprises the following steps:
the control equipment receives display demand information of a user, generates a scheduling instruction according to the display demand information, and sends the scheduling instruction to the decoding equipment;
the decoding equipment receives the scheduling instruction, generates a display request according to the scheduling instruction, and sends the display request to the distributed node equipment;
the distributed node equipment receives the display request, acquires a streaming media data stream from the signal source equipment according to the display request, acquires a storage data stream, and sends the storage data stream to the decoding equipment;
The decoding device receives the stored data stream and transmits the stored data stream to the display device;
the display device receives and displays the stored data stream.
Optionally, the signal source device includes a plurality of signal source devices; the step of obtaining the stream media data stream from the signal source device by the distributed node device according to the display request, and obtaining the stored data stream comprises the following steps:
the distributed node equipment determines selected signal source equipment corresponding to the display request from a plurality of signal source equipment according to the display request;
and the distributed node equipment acquires the streaming media data stream from the selected signal source equipment to acquire a storage data stream.
Optionally, the distributed node device includes a plurality of distributed node devices, where the distributed node devices store a storage data stream; before the step of the decoding device sending the display request to the distributed node device, the method further comprises the steps of:
the decoding device receives a first broadcast message of the distributed node device;
the decoding device judges whether the distributed node device stores a stored data stream corresponding to the display request or not based on the first broadcast message;
The step of the decoding device sending the display request to the distributed node device includes:
if yes, the decoding device sends the display request to distributed node devices storing the storage data stream corresponding to the display request.
Optionally, after the step of determining, by the decoding device, whether the distributed node device stores a stored data stream corresponding to the display request, the method further includes the steps of:
if not, the decoding device receives a second broadcast message of the distributed node device;
the decoding device determines the distributed node device with the minimum real-time load in the distributed node devices based on the second broadcast message;
the step of the decoding device sending the display request to the distributed node device includes:
the decoding device sends the display request to the distributed node device with the minimum real-time load.
Optionally, the step of receiving the stored data stream by the decoding device includes:
and when the decoding device does not receive the stored data stream within a preset time interval, retransmitting the display request to the distributed node device once until the decoding device receives the stored data stream within the preset time interval, stopping transmitting the display request to the distributed node device, wherein the starting time of the preset time interval is the time of last transmitting the display request.
Optionally, the step of obtaining the stored data stream by the distributed node device includes:
the distributed node equipment adds PTS to the stream media data stream to obtain a stored data stream;
before the step of the decoding device transmitting the stored data stream to the display device, the method further comprises the steps of:
the decoding device decodes the stored data stream based on the PTS to obtain a decoded stored data stream.
In addition, in order to achieve the above object, the present invention also provides a data stream collecting device, which is applied to a streaming media system, wherein the streaming media system comprises a control device, a display device, a distributed node device, a decoding device and a signal source device; the device comprises:
the control module is used for receiving display demand information of a user by the control equipment, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to the decoding equipment;
the first sending module is used for receiving the scheduling instruction by the decoding equipment, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment;
The second sending module is used for receiving the display request by the distributed node equipment, obtaining a streaming media data stream from the signal source equipment according to the display request, obtaining a storage data stream and sending the storage data stream to the decoding equipment;
the third sending module is used for receiving the stored data stream by the decoding device and sending the stored data stream to the display device;
and the display module is used for receiving and displaying the stored data stream by the display equipment.
In addition, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a program of a data stream collecting method, which when executed by a processor, implements the steps of the data stream collecting method as set forth in any one of the above.
The invention provides a streaming media system, which comprises a control device, a display device, a distributed node device, a decoding device and a signal source device; the control equipment is used for receiving display demand information of a user, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to the decoding equipment; the decoding equipment is used for receiving the scheduling instruction, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment; the distributed node equipment is used for receiving the display request, acquiring a streaming media data stream from the signal source equipment according to the display request, acquiring a storage data stream, and sending the storage data stream to the decoding equipment; the decoding device is further configured to receive the stored data stream and send the stored data stream to the display device; the display device is used for receiving and displaying the stored data stream. Because each device in the streaming media system needs less data for executing instructions and processing, the devices in the streaming media system do not need higher configuration; when the equipment in the streaming media system fails, the operation of the equipment which does not fail in the streaming media system is not affected, and only the equipment which fails is required to be maintained, so that the equipment configuration is not high, and the maintenance cost is lower.
Drawings
FIG. 1 is a schematic diagram of a data flow collection device in a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a streaming media system according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram of a streaming media system according to a first embodiment of the present invention;
FIG. 4 is a schematic diagram of a control software interface provided by a first embodiment of the streaming media system of the present invention;
FIG. 5 is a schematic diagram of a distribution area of a streaming media system according to a first embodiment of the present invention;
FIG. 6 is a flowchart of a data stream collection method according to a first embodiment of the present invention;
fig. 7 is a block diagram of a data stream collecting device according to a first embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The traditional streaming media system comprises a streaming media server, wherein the streaming media server adopts a PC architecture, a streaming media cluster is formed by a plurality of PC hosts, one of the streaming media clusters is used as a core unit to run a service process, a core database is carried, all forwarding units in the system are managed, and each PC host is used for running and managing a splicing matrix host; the PC host of the core unit requires a higher configuration and therefore the solution costs are higher. The streaming server runs a separate core database with core arbitration and management facilities, which if a two-machine hot standby scheme is employed to improve stability, means an increase in cost and redundancy of the facilities. In addition, the conventional streaming media server generally adopts static binding forwarding source addresses, and a large number of parameters need to be manually configured into a core database, so that the complicated operation degree is increased.
However, with the conventional streaming media system, when the core equipment is down, the whole system falls into a paralysis state. In addition, the streaming media server generally adopts a static binding forwarding source address, does not have a dynamic load balancing algorithm, needs to manually configure a large number of parameters into a core database, increases the complexity of operation, and can cause unreasonable network bandwidth utilization, such as overload of the network bandwidth of a certain unit, but lower network bandwidth of other units. The streaming media server has higher configuration requirement, so the scheme has high cost and is not suitable for civil use or occasions with low project budget. The access signal of the streaming media server is single in variety, and the output streaming media protocols are diversified, but the real-time performance of the streaming media server is not high, so that the real-time performance of the display of the terminal decoder is not ensured.
The invention provides a streaming media system, a data stream collection method, a data stream collection device and a storage medium.
Referring to fig. 1, fig. 1 is a schematic diagram of a data flow collection device of a hardware running environment according to an embodiment of the present invention.
As shown in fig. 1, the user activity recognition apparatus may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display (Display), the optional user interface 1003 may also include a standard wired interface as well as a wireless interface, and the wired interface of the user interface 1003 may be a universal serial bus (Universal Serial Bus, USB) interface in the present invention. The network interface 1004 may optionally include a standard wired interface as well as a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high speed random access memory (Random Access Memory, RAM); the Memory may be a stable Memory, such as a Non-volatile Memory (Non-volatile Memory), and specifically, a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Those skilled in the art will appreciate that the structure shown in fig. 1 is not limiting of the data stream collection device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a data stream collection program may be included in a memory 1005, which is a type of computer storage medium.
In the data stream collecting device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server, and performing data communication with the background server; the user interface 1003 is mainly used for connecting peripherals; the data stream collecting apparatus calls a data stream collecting program stored in the memory 1005 through the processor 1001 and executes the data stream collecting method provided by the embodiment of the present invention.
Referring to fig. 2, fig. 2 is a schematic view of a streaming media structure provided in a first embodiment of a streaming media system according to the present invention, where the streaming media system includes: control equipment, display equipment, distributed node equipment, decoding equipment and signal source equipment; wherein, the liquid crystal display device comprises a liquid crystal display device,
and a control device 13, configured to receive display requirement information of a user, generate a scheduling instruction according to the display requirement information, and send the scheduling instruction to the decoding device 14.
It should be noted that the control device may be a smart phone, a computer, etc., and in the present invention, the number of control devices is not limited. The control device installs the vims control software that can run in the control device with windows, android, IOS, linux, kylin operating system installed. And according to the display demand information of the receiving user, the VIMIS control software generates a scheduling instruction and sends the scheduling instruction to the decoding equipment so that the decoding equipment generates a display request according to the scheduling instruction. The display requirement information of the user can be that the display device displays the stream media data stream collected by the signal source device. In addition, the vims control software can also generate different scheduling instructions according to different requirement information of the user, so as to transmit, display, store, delete and the like the streaming media data stream and the storage data stream through the different scheduling instructions.
The number of decoding devices may be plural, and the present invention is not limited. One decoding device corresponds to one display device. After receiving the stored data stream, the decoding device sends the stored data stream to the corresponding display device for display.
It will be appreciated that the user may send display requirement information to the control device in which the vims control software is installed, either by voice input or by typing.
The scheduling instruction is generated according to display demand information received by a control device provided with VIMIS control software; and after receiving the scheduling instruction, the decoding equipment generates a display request corresponding to the scheduling instruction. The scheduling instruction corresponding to the display requirement information may include device information of the signal source device, device information of the display device, and device information of the decoding device, where the device information of different devices is different.
For example, the display requirement information of the user is that the a display device displays a streaming media data stream collected by the B signal source device, the control device installed with the vims control software obtains the display requirement information of the user, generates a scheduling instruction, sends the scheduling instruction to the C decoding device corresponding to the a display device, generates a display request by the C decoding device, and sends the display request to the distributed node device; and the distributed node equipment acquires the streaming media data stream of the signal source equipment B, acquires a corresponding storage data stream, sends the storage data stream to the C decoding equipment, sends the storage data stream to the display equipment A by the C decoding equipment, and displays the storage data stream by the display equipment A.
The decoding device 14 is configured to receive the scheduling instruction, generate a display request according to the scheduling instruction, and send the display request to the distributed node device 12.
It should be noted that, the distributed node device stores a storage data stream; the decoding device is further configured to receive a first broadcast message of the distributed node device, and determine, based on the first broadcast message, whether the distributed node device stores a storage data stream corresponding to the display request; if yes, the display request is sent to distributed node equipment storing a storage data stream corresponding to the display request.
The display request comprises signal source equipment information corresponding to the streaming media data stream to be acquired; the first broadcast message is sent by the distributed node device and includes device information of a signal source device corresponding to the stored data stream currently stored by the distributed node device. When a display request is matched with equipment information of signal source equipment in a first broadcast message, the distributed node equipment stores a storage data stream corresponding to the display request; when the display request does not match with the device information of the signal source device in the first broadcast message, the distributed node device does not store a stored data stream corresponding to the display request. When the distributed node device stores the stored data stream, the decoding device transmits a display request to the distributed node device storing the stored data stream.
After the decoding device judges that the distributed node device stores the storage data stream corresponding to the display request, the decoding device sends the display request to the distributed node device storing the storage data stream corresponding to the display request, so that the distributed node device storing the storage data stream corresponding to the display request sends the storage data stream to the decoding device.
And after the decoding equipment judges that the distributed node equipment does not store the stored data stream corresponding to the display request, receiving a second broadcast message of the distributed node equipment, determining the distributed node equipment with the minimum real-time load in the distributed node equipment based on the second broadcast message, and sending the display request to the distributed node equipment with the minimum real-time load. And the distributed node equipment with the minimum real-time load acquires the streaming media data stream from the signal source equipment after receiving the display request.
The second broadcast message is sent by the distributed node equipment and comprises load information of the distributed node equipment; the load information can comprise network load, stream media data stream processing load and stream media data stream storage load, and the minimum load can be the minimum comprehensive load determined after comprehensive judgment based on the current load information; the decoding device sends the display request to the least loaded distributed node device.
The signal source device 11 is configured to collect a streaming media data stream.
It should be noted that, the signal source device of the present invention may be a webcam, a personal camera, a video camera, etc., and in this embodiment, the number of signal source devices is not limited. The number of the signal source devices is multiple, the application range of the streaming media system is larger, the region range related to the streaming media system can be county range, urban range, provincial range or national range, and the number of the signal source devices, the display devices, the control devices, the distributed node devices and the decoding devices related to the corresponding different ranges can be greatly different.
In addition, the streaming media data stream and the storage data stream may be smaller data packets, that is, the streaming media data stream will divide the whole streaming media data stream to be displayed into smaller data packets with time sequence in the transmission process, and each time a data packet with corresponding time sequence is transmitted. The time sequence refers to the sequence of the data packets in the whole streaming media data stream. For example, a 10-minute stream is split into 10 packets during transmission, each packet corresponding to a one-minute stream, a first packet comprising a first-minute stream, a second packet comprising a second-minute stream, and so on, wherein the first packet is the first packet to be transmitted.
It should be understood that the data formats of the streaming media data streams collected by different signal source devices may be different, and the transmission protocols of the data streams may also be different, and the transmission protocols of the streaming media data streams may be RTMP, RTSP, HLS, HTML, GB28181 protocols.
In a specific application, different locations correspond to different signal source devices, and the different signal source devices have different device information. When the streaming media data streams are scheduled, the streaming media data streams collected by the signal source devices of the corresponding places can be obtained by searching place names, and the streaming media data streams of the corresponding places can be collected by determining the device information of the signal source devices. The signal source device and the distributed node device may be connected by a network cable.
The distributed node device 12 is configured to receive the display request, obtain a streaming media data stream from the signal source device 11 according to the display request, obtain a storage data stream, and send the storage data stream to the decoding device 14 through the switch 15.
It should be noted that the number of the distributed node devices may be plural, and the present invention is not limited thereto. The distributed node equipment comprises a data stream processing unit and a storage unit; the data stream processing unit is used for carrying out protocol conversion and adding PTS on the stream media data stream, and the storage unit is used for storing the stream media data stream so as to obtain a stored data stream; the storage unit may buffer the streaming media data stream, and when the transmission of the storage data stream is successful, immediately delete the storage data stream to save storage space; the storage unit can store the streaming media data stream for a long time so that a user can delete or store the streaming media data stream according to requirements.
In addition, the signal source devices and the distributed node devices may not be in one-to-one correspondence, and any one of the distributed node devices may acquire a streaming media data stream collected by any one of the signal source devices.
It can be understood that the distributed node device obtains the streaming media data stream from the signal source device through the above protocol, and converts the streaming media data stream of different protocols into the streaming media data stream of UDP (User Datagram Protocol) protocol through the data stream processing unit. The UDP protocol ensures the stability of streaming media data stream transmission and low latency, and is suitable for application scenes with severe network environments. In addition, the data stream processing unit adds a PTS to the stream media data stream, and then the storage unit stores the stream media data stream processed by the data stream processing unit to obtain a stored data stream.
In a specific application, the stored data stream may be a real-time streaming media data stream collected by the signal source device, buffered by the distributed node device for a period of time, and then forwarded to the decoding device, so that the decoding device sends the stored data stream to the display device for real-time data stream display (i.e., live broadcast display); the storage data stream may also be a stream media data stream collected by the signal source device, and stored in the distributed node device, when the distributed node device receives the display request, the distributed node device sends the storage data stream corresponding to the display request to the decoding device, so that the decoding device sends the storage data stream to the display device for display (i.e. recording and playing).
In addition, the distributed node device is further configured to determine, according to the display request, a signal source device corresponding to the display request from a plurality of signal source devices, and obtain a streaming media data stream from the signal source device corresponding to the display request, so as to obtain a storage data stream.
When the distributed node device does not store the stored data stream corresponding to the display request, the distributed node device determines one signal source device for collecting the stream media data stream to be displayed from a plurality of signal source devices according to the display request, and acquires the stream media data stream from the signal source device. Streaming media systems are not limited to displaying stored data streams.
The distributed node device is connected with the decoding device through the switch, and after the distributed node device sends the stored data stream to the switch, the switch sends the stored data stream to the decoding device through a unicast or multicast transmission mode. One stream media data stream can be simultaneously sent to 256 decoding devices through a unicast transmission mode, and one stream media data stream can be simultaneously sent to decoding devices with unlimited quantity through a multicast transmission mode.
It will be appreciated that when the number of distributed node devices accessed is large, the switch may be a tera switch as the core switch and a gigabit switch as the bottom switch.
Further, the signal source device includes a plurality of signal source devices. When the distributed node equipment stores the storage data stream corresponding to the display request, the decoding equipment sends the display request to the distributed node equipment storing the storage data stream corresponding to the display request, and the distributed node equipment directly sends the storage data stream corresponding to the display request to the decoding equipment without the distributed node equipment acquiring the corresponding streaming media data stream from the signal source equipment again; and when the distributed node equipment does not store the stored data stream corresponding to the display request, the distributed node equipment acquires the streaming media data stream from the signal source equipment corresponding to the display request from the plurality of signal source equipment. Further, when the distributed node device does not store the stored data stream corresponding to the display request, the decoding device determines the distributed node device with the smallest load based on the second broadcast message, and sends the display request to the distributed node device with the smallest load, and the distributed node device obtains the streaming media data stream from the signal source devices corresponding to the display request in the plurality of signal source devices. One distributed node device can acquire and transmit streaming media data streams collected by at most 16 signal source devices at the same time.
In a specific application, the connection mode between the decoding device and the switch may be a network cable, and the connection mode between the switch and the distributed node device may be a network cable.
The decoding device 14 is further configured to receive the stored data stream and transmit the stored data stream to the display device 16.
It should be noted that, the streaming media data stream is encoded and compressed in the distributed node device to obtain a storage data stream, and the bandwidth occupied by the storage data stream in the transmission process is smaller, wherein the video coding format is H.264/H.265, the audio coding format is G711/G726/PCM/AAC, and the audio sampling rate is 8-48KHz. The decoding device supports simultaneous decoding of 16 channels with a video resolution of 1920x1080 @ 60fps per channel. The decoding device acquires the PTS of the stored data stream, processes the stored data stream based on the PTS, and the acquired stored data stream is a stored data stream in which audio and video are synchronized.
In addition, when the decoding device does not receive the stored data stream within a preset time interval, the decoding device resends the display request to the distributed node device once, until the decoding device receives the stored data stream within the preset time interval, the decoding device stops sending the display request to the distributed node device, and the starting time of the preset time interval is the time of sending the display request last time. The preset time interval can be set according to requirements, and the invention is not particularly limited.
In a specific application, the stored data stream is transmitted in a data packet mode, in the transmission process, the data stream is transmitted according to the time sequence of the data packet, when the data packet is transmitted in failure, the decoding device can resend a display request once, the distributed node device can determine the time sequence of the lost data packet according to the display request sent by the decoding device, resends the corresponding data packet according to the time sequence, and when the decoding device receives the data packet, the decoding device does not send the display request; meanwhile, the distributed node equipment can delete the stored data packets, so that the cache space is saved, and the load of the distributed node equipment is reduced.
A display device 16 for receiving and displaying the stored data stream.
It should be noted that, the display device is that the decoding device is connected with the LED screen through the HDMI2.0/DVI/DP/VGA/3.5mm audio interface, so as to output a data stream, and parameters of the output data stream may be manually configured, for example, adjust a resolution, a frame rate, a volume, etc. of the output data stream.
In this embodiment, a streaming media system is provided, where the streaming media system includes a control device, a display device, a distributed node device, a decoding device, and a signal source device; the control equipment is used for receiving display demand information of a user, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to the decoding equipment; the decoding equipment is used for receiving the scheduling instruction, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment; the distributed node equipment is used for receiving the display request, acquiring a streaming media data stream from the signal source equipment according to the display request, acquiring a storage data stream, and sending the storage data stream to the decoding equipment; the decoding device is further configured to receive the stored data stream and send the stored data stream to the display device; the display device is used for receiving and displaying the stored data stream. Because each device in the streaming media system needs less data for executing instructions and processing, the devices in the streaming media system do not need higher configuration; when the equipment in the streaming media system fails, the operation of the equipment which does not fail in the streaming media system is not affected, and only the equipment which fails is required to be maintained, so that the equipment configuration is not high, and the maintenance cost is lower.
The distributed node equipment also carries out protocol conversion on the data stream to obtain the data stream of UDP protocol with better transmission stability and low latency, so that the streaming media system is suitable for a poor network environment, and the real-time display effect of the data stream is better.
When the streaming media data stream is compressed and converted, PTS is added to the streaming media data stream, so that the audio and video of the stored data stream decoded by the decoding device are synchronous, and the display effect of the data stream is better.
The transmission process of the streaming media data stream adopts a load balancing transmission mode, so that the load of each distributed node device is balanced, and the running state of the distributed node device is good.
Meanwhile, the switch sends the stored data stream to the decoding equipment in a unicast or multicast transmission mode, and can send the data stream to a plurality of decoding equipment at the same time, so that the expansion range of the streaming media system is wider.
In addition, when the distributed node equipment stores the stored data stream corresponding to the display request, the distributed node equipment directly sends the stored data stream to the corresponding decoding equipment, and the distributed node equipment does not need to acquire the stream media data stream identical to the stored data stream from the signal source equipment again, so that the same stream media data stream is prevented from being acquired for multiple times, and the data stream collection efficiency of the stream media system is improved.
In addition, when the decoding device does not receive the stored data stream, the distributed node device retransmits the stored data stream according to the received display request. The decoding device has better integrity of the received data stream, so that the data stream displayed by the display device is more complete.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a streaming media system according to a first embodiment of the present invention.
In this embodiment, the distributed node is a distributed node device, the decoding node is a decoding device, the LED screen is a display device, and the signal source is a signal source device.
The control device may be a PC (Chinese: personal computer, english: personal Computer) and tablet computer in which VIMIS control software is installed. The PC is connected with the switch through a network cable, and the tablet personal computer is connected with the switch through wireless equipment.
The signal sources are connected with the distributed nodes through the switch, and the distributed nodes can acquire streaming media data streams of any signal source.
The decoding node is connected with the distributed nodes through a switch. The switch can be used as a centralized hub for a large number of distributed nodes, encoding nodes and signal sources.
The decoding nodes are connected with the corresponding LED screens.
Referring to fig. 4, fig. 4 is a schematic diagram of a control software interface according to a first embodiment of the streaming media system of the present invention.
The streaming media data stream can be dragged, deleted, added and the like at the interface of the VIMIS control software, the streaming media data stream to be amplified and displayed can be dragged to the middle of the interface for display, and the displayed picture can be amplified or reduced; meanwhile, signal sources can be added and deleted, namely, corresponding signal sources are directly deleted among streaming media data streams which are not required to be displayed, and corresponding signal sources are searched for and added to streaming media data streams which are required to be displayed but are not currently displayed. The streaming media data stream may be a real-time streaming media data stream or a streaming media data stream stored for replay.
Referring to fig. 5, fig. 5 is a schematic diagram of a distribution area of a streaming media system according to a first embodiment of the present invention.
The streaming media system can be distributed worldwide, and streaming media data collected by any signal source in the whole system can be displayed in different areas.
Referring to fig. 6, fig. 6 is a flowchart of a data stream collecting method according to a first embodiment of the present invention, where the method is applied to a streaming media system, and the streaming media system includes a control device, a display device, a distributed node device, a decoding device, and a signal source device; the data stream collection method comprises the following steps:
Step S101: the control equipment receives display demand information of a user, generates a scheduling instruction according to the display demand information, and sends the scheduling instruction to the decoding equipment.
Step S102: the decoding equipment receives the scheduling instruction, generates a display request according to the scheduling instruction, and sends the display request to the distributed node equipment.
Step S103: the distributed node equipment receives the display request, acquires a streaming media data stream from the signal source equipment according to the display request, acquires a storage data stream, and sends the storage data stream to the decoding equipment.
Step S104: the decoding device receives the stored data stream and transmits the stored data stream to the display device.
Step S105: the display device receives and displays the stored data stream.
Optionally, the signal source device includes a plurality of signal source devices; the step of obtaining the stream media data stream from the signal source device by the distributed node device according to the display request, and obtaining the stored data stream comprises the following steps:
the distributed node equipment determines selected signal source equipment corresponding to the display request from a plurality of signal source equipment according to the display request;
And the distributed node equipment acquires the streaming media data stream from the selected signal source equipment to acquire a storage data stream.
Optionally, the distributed node device includes a plurality of distributed node devices, where the distributed node devices store a storage data stream; before the step of the decoding device sending the display request to the distributed node device, the method further comprises the steps of:
the decoding device receives a first broadcast message of the distributed node device;
the decoding device judges whether the distributed node device stores a stored data stream corresponding to the display request or not based on the first broadcast message;
the step of the decoding device sending the display request to the distributed node device includes:
if yes, the decoding device sends the display request to distributed node devices storing the storage data stream corresponding to the display request.
Optionally, after the step of determining, by the decoding device, whether the distributed node device stores a stored data stream corresponding to the display request, the method further includes the steps of:
if not, the decoding device receives a second broadcast message of the distributed node device;
The decoding device determines the distributed node device with the minimum real-time load in the distributed node devices based on the second broadcast message;
the step of the decoding device sending the display request to the distributed node device includes:
the decoding device sends the display request to the distributed node device with the minimum real-time load.
Optionally, the step of receiving the stored data stream by the decoding device includes:
and when the decoding device does not receive the stored data stream within a preset time interval, retransmitting the display request to the distributed node device once until the decoding device receives the stored data stream within the preset time interval, stopping transmitting the display request to the distributed node device, wherein the starting time of the preset time interval is the time of last transmitting the display request.
Optionally, the step of obtaining the stored data stream by the distributed node device includes:
the distributed node equipment adds PTS to the stream media data stream to obtain a stored data stream;
before the step of the decoding device transmitting the stored data stream to the display device, the method further comprises the steps of:
The decoding device decodes the stored data stream based on the PTS to obtain a decoded stored data stream.
Referring to fig. 7, fig. 7 is a block diagram of a data stream collecting apparatus according to a first embodiment of the streaming media system, the apparatus includes:
a control module 701, configured to receive display requirement information of a user, generate a scheduling instruction according to the display requirement information, and send the scheduling instruction to the decoding device;
a first sending module 702, configured to receive the scheduling instruction by the decoding device, generate a display request according to the scheduling instruction, and send the display request to the distributed node device;
a second sending module 703, configured to receive the display request by the distributed node device, obtain a streaming media data stream from the signal source device according to the display request, obtain a storage data stream, and send the storage data stream to the decoding device;
a third transmitting module 704, configured to receive the stored data stream by the decoding device and transmit the stored data stream to the display device;
and the display module 705 is configured to receive and display the stored data stream by using the display device.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
From the foregoing description of embodiments, it will be apparent to those skilled in the art that the methods of the embodiments described above may be implemented by means of software plus a necessary hardware platform of a streaming media system, and that, based on such understanding, the technical solutions of the present invention may be embodied essentially or partly in the form of a software product stored in a storage medium, comprising instructions for causing a terminal system to perform the methods of the embodiments of the present invention.
The foregoing description of the preferred embodiments of the present invention should not be taken as limiting the scope of the invention, but rather should be understood to cover all modifications, equivalents, and alternatives falling within the scope of the invention as defined by the following description and drawings, or by direct or indirect application to other relevant art(s).
Claims (8)
1. The stream media system is characterized by comprising a control device, a display device, a distributed node device, a decoding device and a signal source device; wherein, the liquid crystal display device comprises a liquid crystal display device,
the control equipment is used for receiving display demand information of a user, generating a scheduling instruction according to the display demand information and sending the scheduling instruction to the decoding equipment;
the decoding equipment is used for receiving the scheduling instruction, generating a display request according to the scheduling instruction, and sending the display request to the distributed node equipment;
the distributed node equipment is used for receiving the display request, acquiring a streaming media data stream from the signal source equipment according to the display request, acquiring a storage data stream, and sending the storage data stream to the decoding equipment;
the decoding device is further configured to receive the stored data stream and send the stored data stream to the display device;
The display device is used for receiving and displaying the stored data stream;
the streaming media system further comprises a switch, wherein the distributed node equipment comprises a plurality of distributed node equipment, and the plurality of distributed node equipment is connected with the decoding equipment through the switch;
the decoding device comprises a plurality of decoding devices, and the switch forwards the storage data stream to the plurality of decoding devices in a unicast or multicast transmission mode.
2. The streaming media system of claim 1, wherein the signal source device comprises a plurality of signal source devices;
the distributed node device is further configured to determine, according to the display request, a signal source device corresponding to the display request from a plurality of signal source devices, and obtain a streaming media data stream from the signal source device corresponding to the display request, so as to obtain a storage data stream.
3. The streaming media system of claim 1, wherein the distributed node devices store a stored data stream; the decoding device is further configured to receive a first broadcast message of the distributed node device, and determine, based on the first broadcast message, whether the distributed node device stores a storage data stream corresponding to the display request; if yes, the display request is sent to distributed node equipment storing a storage data stream corresponding to the display request.
4. The streaming media system according to claim 3, wherein the decoding device is further configured to, after determining whether the distributed node device stores the stored data stream corresponding to the display request, if not, receive a second broadcast message of the distributed node device, determine, based on the second broadcast message, a distributed node device with the smallest real-time load among the distributed node devices, and send the display request to the distributed node device with the smallest real-time load.
5. The streaming media system according to claim 3 or 4, wherein the decoding device is further configured to resend the display request to the distributed node device once when the stored data stream is not received within a preset time interval until the decoding device receives the stored data stream within the preset time interval, and stops sending the display request to the distributed node device, where a starting time of the preset time interval is a time when the display request was sent last time.
6. The streaming media system according to claim 1, wherein the distributed node device is further configured to add a PTS to the streaming media data stream to obtain the stored data stream;
The decoding device is further configured to decode the stored data stream based on the PTS to obtain a decoded stored data stream.
7. The data stream collecting method is characterized by being applied to a streaming media system, wherein the streaming media system comprises a control device, a display device, a distributed node device, a plurality of decoding devices, a switch and a signal source device; the method comprises the following steps:
the control equipment receives display demand information of a user, generates a scheduling instruction according to the display demand information, and sends the scheduling instruction to the decoding equipment;
the decoding equipment receives the scheduling instruction, generates a display request according to the scheduling instruction, and sends the display request to the distributed node equipment;
the distributed node equipment receives the display request, acquires a streaming media data stream from the signal source equipment according to the display request, acquires a storage data stream, and sends the storage data stream to the decoding equipment through the switch; the switch forwards the storage data stream to the plurality of decoding devices in a unicast or multicast transmission mode;
The decoding device receives the stored data stream and transmits the stored data stream to the display device;
the display device receives and displays the stored data stream.
8. A computer-readable storage medium, on which a program of a data stream collecting method is stored, which program, when being executed by a processor, implements the steps of the data stream collecting method as claimed in claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010822838.4A CN112039961B (en) | 2020-08-13 | 2020-08-13 | Streaming media system, data stream collection method, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010822838.4A CN112039961B (en) | 2020-08-13 | 2020-08-13 | Streaming media system, data stream collection method, and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112039961A CN112039961A (en) | 2020-12-04 |
| CN112039961B true CN112039961B (en) | 2023-08-08 |
Family
ID=73578422
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010822838.4A Active CN112039961B (en) | 2020-08-13 | 2020-08-13 | Streaming media system, data stream collection method, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112039961B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114938463A (en) * | 2022-06-22 | 2022-08-23 | 深圳市泛联信息科技有限公司 | Video display system and method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857439A (en) * | 2012-09-03 | 2013-01-02 | 国网电力科学研究院 | Media data access and scheduling system architecture design method based on multi-node cooperation |
| CN203289552U (en) * | 2012-09-26 | 2013-11-13 | 北京声迅电子股份有限公司 | On-wall decoding display system for monitoring |
| CN104539901A (en) * | 2014-12-24 | 2015-04-22 | 上海伟视清数字技术有限公司 | Decoding display control system and method |
| CN104980768A (en) * | 2015-07-13 | 2015-10-14 | 广州洪森科技有限公司 | Video processing method based on Tilera many-core processor |
| CN105450994A (en) * | 2015-12-03 | 2016-03-30 | 河北远东通信系统工程有限公司 | Video commanding and dispatching system and method based on RTSP |
| CN107911706A (en) * | 2017-12-18 | 2018-04-13 | 青岛国信发展（集团）有限责任公司 | The audio/video player system and method for multi-brand compatibility |
| CN108174230A (en) * | 2017-12-29 | 2018-06-15 | 安徽国通亿创科技股份有限公司 | Audio and video live broadcast system based on elasticity distribution formula Streaming Media |
| WO2019019370A1 (en) * | 2017-07-24 | 2019-01-31 | 平安科技（深圳）有限公司 | Processing method for live broadcast of audio and video, storage medium and mobile terminal |
| CN110493657A (en) * | 2019-08-22 | 2019-11-22 | 兰州启源信息技术服务有限公司 | OnStream intelligent online steaming media platform system |
| CN111050025A (en) * | 2019-12-04 | 2020-04-21 | 深圳市创凯智能股份有限公司 | Audio and video display control method, device and system and computer readable storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105900443B (en) * | 2013-12-11 | 2020-01-14 | 瑞典爱立信有限公司 | Method and system for synchronizing media streams |
| US11057450B2 (en) * | 2016-06-07 | 2021-07-06 | Rgb Spectrum | Systems, methods, and devices for seamless switching between multiple source streams |
-
2020
- 2020-08-13 CN CN202010822838.4A patent/CN112039961B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857439A (en) * | 2012-09-03 | 2013-01-02 | 国网电力科学研究院 | Media data access and scheduling system architecture design method based on multi-node cooperation |
| CN203289552U (en) * | 2012-09-26 | 2013-11-13 | 北京声迅电子股份有限公司 | On-wall decoding display system for monitoring |
| CN104539901A (en) * | 2014-12-24 | 2015-04-22 | 上海伟视清数字技术有限公司 | Decoding display control system and method |
| CN104980768A (en) * | 2015-07-13 | 2015-10-14 | 广州洪森科技有限公司 | Video processing method based on Tilera many-core processor |
| CN105450994A (en) * | 2015-12-03 | 2016-03-30 | 河北远东通信系统工程有限公司 | Video commanding and dispatching system and method based on RTSP |
| WO2019019370A1 (en) * | 2017-07-24 | 2019-01-31 | 平安科技（深圳）有限公司 | Processing method for live broadcast of audio and video, storage medium and mobile terminal |
| CN107911706A (en) * | 2017-12-18 | 2018-04-13 | 青岛国信发展（集团）有限责任公司 | The audio/video player system and method for multi-brand compatibility |
| CN108174230A (en) * | 2017-12-29 | 2018-06-15 | 安徽国通亿创科技股份有限公司 | Audio and video live broadcast system based on elasticity distribution formula Streaming Media |
| CN110493657A (en) * | 2019-08-22 | 2019-11-22 | 兰州启源信息技术服务有限公司 | OnStream intelligent online steaming media platform system |
| CN111050025A (en) * | 2019-12-04 | 2020-04-21 | 深圳市创凯智能股份有限公司 | Audio and video display control method, device and system and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 基于流媒体的分布式显示控制系统设计探析;夏爱民;刘东亚;徐晓刚;;现代信息科技(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112039961A (en) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9693080B2 (en) | Distribution control system, distribution control method, and computer-readable storage medium | |
| US9628866B2 (en) | Distribution control system and distribution system | |
| US20120304235A1 (en) | Method and system for playing video file, and media resource server | |
| US9723337B2 (en) | Distribution control system and distribution system | |
| US20160044079A1 (en) | Distribution control system, distribution control method, and computer-readable storage medium | |
| US9781193B2 (en) | Distribution control system, distribution system, distribution control method, and computer-readable storage medium | |
| US9578079B2 (en) | Distribution control system, distribution system, distribution control method, and computer-readable storage medium | |
| US10250665B2 (en) | Distribution control system, distribution system, distribution control method, and computer-readable storage medium | |
| US20140282778A1 (en) | Distribution control system, distribution system, distribution control method, and computer-readable storage medium | |
| EP2974317B1 (en) | Computer system, distribution control system, distribution control method, and computer-readable storage medium | |
| CN113489805B (en) | Butt joint method, device, equipment and storage medium of cloud desktop system | |
| CN105208406A (en) | Video data providing method and apparatus, video playing method and apparatuses, and video playing system | |
| US9596435B2 (en) | Distribution control apparatus, distribution control method, and computer program product | |
| CN112039961B (en) | Streaming media system, data stream collection method, and storage medium | |
| EP3754998A1 (en) | Streaming media quality monitoring method and system | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment | |
| CN115988577A (en) | Data transmission method, data transmission device, storage medium and electronic equipment | |
| WO2011097793A1 (en) | Method, apparatus and system for remote access | |
| JP6442832B2 (en) | Delivery control system, delivery system, delivery control method, and program | |
| CN116233504A (en) | Live broadcast push flow method and device | |
| JP2015220741A (en) | Distribution control system, distribution control method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Lin Chunyu Inventor after: Xie Beijing Inventor before: Lin Chunyu Inventor before: Xie Yi |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |