WO2021129885A1 - Ip network-based audio/video transmission method and system - Google Patents

Ip network-based audio/video transmission method and system Download PDF

Info

Publication number
WO2021129885A1
WO2021129885A1 PCT/CN2020/141741 CN2020141741W WO2021129885A1 WO 2021129885 A1 WO2021129885 A1 WO 2021129885A1 CN 2020141741 W CN2020141741 W CN 2020141741W WO 2021129885 A1 WO2021129885 A1 WO 2021129885A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
audio
video
node
encoded
Prior art date
Application number
PCT/CN2020/141741
Other languages
French (fr)
Chinese (zh)
Inventor
王飞
何常
Original Assignee
威创集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 威创集团股份有限公司 filed Critical 威创集团股份有限公司
Publication of WO2021129885A1 publication Critical patent/WO2021129885A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/22—Adaptations for optical transmission

Definitions

  • the present invention relates to the field of audio and video technology, and more specifically, to an audio and video transmission method and system based on an IP network.
  • the audio and video transmission system composed of splicing walls and seats mainly adopts a centralized processor centralized control method, which has limited data processing capabilities. , Generally, it only supports the transmission of audio and video signals with up to 1080P resolution, and cannot support the transmission requirements of ultra-high-definition image quality.
  • the present invention aims to overcome the defect that the audio and video transmission system composed of the splicing wall and seats in the prior art cannot transmit ultra-high-definition picture quality audio and video signals, and provides an audio and video transmission method and system based on an IP network to solve the problem
  • the audio and video transmission system composed of splicing walls and seats cannot transmit ultra-high-definition picture quality audio and video signals.
  • the technical solution adopted by the present invention is an audio and video transmission method based on an IP network.
  • the method includes: an IP encoding node collects original audio and video signals; and the IP encoding node encodes the original audio and video signals to generate The encoded signal corresponding to the original audio and video signal, the encoded signal is Ethernet data; the IP encoding node transmits the encoded signal to the designated IP decoding node through the switch of the IP network; the IP decoding node pair The coded signal is decoded to obtain a decoded signal corresponding to the coded signal; the IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
  • the transmission of audio and video signals is performed based on the IP network, and the processing of the audio and video signals in each stage of the transmission process is completed by nodes, which can improve the data processing capacity of the audio and video transmission system.
  • the IP encoding node Convert the original audio and video signal into an encoded signal of Ethernet data type, so that the encoded signal can be transmitted in the switch of the IP network, and the IP decoding node performs image processing on the decoded signal to obtain the target audio and video whose output parameters are specified output parameters Signal, that is, the output resolution of the target audio and video signal can be 4K.
  • the present invention also provides an audio and video transmission system based on IP network, the system includes:
  • IP encoding node used to collect original audio and video signals; the IP encoding node establishes a communication connection with the switch of the IP network;
  • the IP encoding node is further configured to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, and the encoded signal is Ethernet data;
  • the IP encoding node is further configured to transmit the encoded signal to a designated IP decoding node through the switch; the IP decoding node establishes a communication connection with the switch;
  • the IP decoding node is configured to decode the encoded signal to obtain a decoded signal corresponding to the encoded signal;
  • the IP decoding node is also used to perform image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
  • the transmission of audio and video signals is performed based on the IP network, and the processing of the audio and video signals in each stage of the transmission process is completed by nodes, which can improve the data processing capacity of the audio and video transmission system.
  • the IP encoding node Convert the original audio and video signal into an encoded signal of Ethernet data type, so that the encoded signal can be transmitted in the switch of the IP network, and the IP decoding node performs image processing on the decoded signal to obtain the target audio and video whose output parameters are specified output parameters Signal, that is, the output resolution of the target audio and video signal can be 4K.
  • the present invention has the beneficial effects of improving the data processing capability of an audio and video transmission system composed of a wall connection and a seat, and solving the problem that the audio and video transmission system cannot transmit ultra-high-definition image quality audio and video signals.
  • Figure 1 is a network architecture diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
  • Fig. 2 is a block diagram of the working principle of an IP encoding node disclosed in the present invention.
  • Fig. 3 is a block diagram of the working principle of an IP decoding node disclosed in the present invention.
  • Fig. 4 is a schematic flowchart of an audio and video transmission method based on an IP network disclosed in the present invention.
  • FIG. 5 is a schematic flowchart of another audio and video transmission method based on an IP network disclosed in the present invention.
  • Fig. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
  • FIG. 1 is a network architecture diagram of an audio and video transmission system based on an IP network disclosed in the present invention. It is understandable that Figure 1 is only an exemplary network architecture diagram of the audio and video transmission system based on the IP network disclosed in the present invention.
  • the network architecture of the technical solution of the invention belongs to the protection scope of the invention, and there is no specific limitation on this.
  • the audio and video transmission system based on an IP network may include at least one IP encoding node and at least one IP decoding node, each IP encoding node and Each IP decoding node establishes a communication connection with a switch of the IP network.
  • the switch may be a gigabit switch.
  • the switch and the IP encoding node and the switch and the IP decoding node can be connected through a network cable or optical fiber.
  • Each IP encoding node is connected to at least one personal computer (PC) or other types of information sources.
  • PC personal computer
  • the IP encoding node and the information source can be connected through a high-definition multimedia interface (HDMI) cable.
  • HDMI high-definition multimedia interface
  • USB Universal Serial Bus
  • each IP decoding node is connected to at least one terminal for communication, such as a splicing wall or an agent terminal.
  • the agent terminal can be equipped with at least an agent display, keyboard, mouse, and U disk.
  • the IP decoding node and the splicing wall can be connected via HDMI cables. Connection, the IP decoding node and the agent terminal can be connected through a network cable or optical fiber.
  • the processing of audio and video signals in each stage of the transmission process can be completed by nodes.
  • FIG. 2 is a block diagram of the working principle of an IP encoding node disclosed in the present invention.
  • the two different IP encoding chips included in the IP encoding node are respectively connected with the high-speed signal extension integrated circuit and the universal serial bus hub (Universal Serial Bus). Hub, USB Hub), central control interface board, switch chip (specifically can be an Ethernet switch chip), and audio interface (specifically can be a 3.5mm audio interface) to establish a connection.
  • USB Hub Universal Serial Bus
  • switch chip specifically can be an Ethernet switch chip
  • audio interface specifically can be a 3.5mm audio interface
  • the high-speed signal expansion integrated circuit is connected to the HDMI interface (including the high-definition multimedia output interface and the high-definition multimedia input interface), the USB Hub is connected to USB (specifically TypeB USB), the central control interface board is connected to the central control interface, and Ethernet switching The chip is connected with RJ45 interface and SFP optical interface.
  • the IP encoding node collects the original audio and video signals through each interface connected to each of the high-speed signal expansion integrated circuit, USB Hub and the central control interface board, and is encoded by the IP encoding chip, and then the encoded signal obtained by the encoding is passed through the RJ45 interface by the Ethernet switching chip And the SFP optical port transmits the coded signal to the switch of the IP network.
  • FIG. 3 is a block diagram of the working principle of an IP decoding node disclosed in the present invention.
  • the IP decoding node includes two different IP decoding chips (specific dedicated IP decoding chips can be selected according to the decoding requirements), Field Programmable Gate Array (FPGA), USB Hub, Video interface chip, switching chip (specifically, Ethernet switch chip), audio interface (specifically, 3.5mm audio interface), and high-definition multimedia output interface.
  • FPGA Field Programmable Gate Array
  • Video interface chip specifically, Ethernet switch chip
  • audio interface specifically, 3.5mm audio interface
  • high-definition multimedia output interface The specific connection relationship is shown in Figure 3.
  • the IP decoding node receives the encoded signal through the RJ45 interface and the SFP optical port connected to the Ethernet switch chip, the Ethernet switch chip converts the encoded data obtained from the encoding into an encoded signal suitable for transmission in the chip, and the Ethernet switch chip encodes it
  • the encoded signal transmitted to the IP encoding chip is decoded by the IP decoding chip, and the decoded decoded signal is decoded by the FPGA to perform image processing to obtain the target audio and video signal, and then use each output interface to output according to the output requirements of the target audio and video signal Target audio and video signals.
  • FIG. 4 is a schematic flowchart of an audio and video transmission method based on an IP network disclosed in the present invention.
  • the audio and video transmission method based on an IP network disclosed in this embodiment may include the following steps:
  • the IP encoding node collects original audio and video signals.
  • the above-mentioned IP encoding node establishes a communication connection with the switch of the IP network.
  • the IP network may be a local area network composed of switches.
  • the switch may be a gigabit switch or other types of switches. Any two nodes entering the switch provide exclusive access.
  • the IP network may include at least one IP encoding node.
  • the working principle of the IP encoding node can be seen in Figure 2.
  • the IP encoding node collects original audio such as HDMI signals, audio signals, USB signals, and central control signals through the high-speed signal expansion integrated circuit, audio interface, USB Hub, and central control interface board. Video signal.
  • the IP encoding node supports audio and video data with multiple input parameters, such as audio and video data with a resolution of 4K and an image refresh rate of 60 Hz. Different input resolutions can be configured through VWAS software.
  • the IP encoding node encodes the foregoing original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, where the encoded signal is Ethernet data.
  • the IP encoding node encodes the above-mentioned original audio and video signals. Specifically, it can be compressed and encoded by the dedicated IP encoding chip 1 and/or the dedicated IP encoding chip 1 shown in FIG. 2, so that the original audio and video signals are converted The resulting coded signal is easy to transmit in the IP network.
  • the IP encoding node transmits the encoded signal to the designated IP decoding node through the switch.
  • the aforementioned designated IP decoding node establishes a communication connection with the switch.
  • the IP network may include at least one IP decoding node, and the aforementioned designated IP decoding node may be selected from the IP decoding nodes included in the IP network.
  • the IP encoding node can transmit the encoded signal to the switch through the RJ45 Ethernet port, and then the switch transmits the encoded signal to the designated IP decoding node.
  • the network interface of the IP encoding node and the IP decoding node may be a Gigabit Ethernet electrical port or an optical port.
  • the above-mentioned switch may be a Gigabit switch.
  • the above-mentioned IP network-based audio and video transmission method may further include the following steps: the IP encoding node detects whether an audio and video transmission instruction is received, and the audio and video transmission instruction includes the device identification of the target terminal; if so, the IP encoding node Among the several IP encoding nodes corresponding to the device identifier, it is determined that the IP decoding node with the best network state is the designated IP decoding node. Allocating different designated IP decoding nodes for different terminals and rationally allocating network resources is conducive to improving the transmission speed of audio and video.
  • the IP decoding node decodes the encoded signal to obtain a decoded signal corresponding to the encoded signal.
  • the IP decoding node decodes the encoded signal, which can be specifically encoded by the dedicated IP decoding chip 1 and/or the dedicated IP decoding chip 1 shown in FIG. 3.
  • the IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is the specified output parameter.
  • the IP decoding node supports audio and video data with multiple output parameters, such as resolution.
  • output parameters can be set to 4K resolution and 60 Hz image refresh frequency according to actual needs. Different output resolutions can be configured through VWAS software.
  • All nodes can be managed through any IP encoding node, IP decoding node or switch, or through an agent terminal connected to any IP decoding node.
  • the implementation of the audio and video transmission method of the IP network shown in Figure 4 the transmission of audio and video signals based on the IP network, the sub-nodes complete the processing of the audio and video signals in each stage of the transmission process, and improve the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals.
  • FIG. 5 is a schematic flowchart of another audio and video transmission method based on an IP network disclosed in the present invention.
  • the audio and video transmission method based on an IP network disclosed in this embodiment may include the following steps:
  • the IP encoding node collects original audio and video signals.
  • the IP encoding node establishes a communication connection with the switch of the IP network.
  • the IP encoding node divides the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal.
  • the IP encoding node encodes the first audio and video sub-signal to obtain the first encoded signal corresponding to the first audio and video sub-signal, and encodes the second audio and video sub-signal to obtain the second audio and video sub-signal corresponding to the The second coded signal.
  • the IP encoding node generates an encoded signal corresponding to the original audio and video signal according to the first encoded signal and the second encoded signal, where the encoded signal is Ethernet data.
  • steps 502 to 504 the audio and video signals collected by the IP encoding node on the interface are divided into two audio and video stream channels through the high-speed signal expansion integrated circuit chip, namely the first audio and video sub-signal and the second audio and video stream.
  • the audio and video sub-signals are compressed and encoded on two different dedicated IP encoding chips respectively.
  • the system delay introduced by the two IP encoding chips is different.
  • Two different IP encoding chips respectively compress and encode the first audio and video sub-signal and the second audio and video sub-signal to convert them into Ethernet data, and then input a piece of switching chip, and then connect to the two panels of the panel through the switching chip.
  • Road RJ45 interface The system delay introduced by the two IP encoding chips.
  • Two different IP encoding chips respectively compress and encode the first audio and video sub-signal and the second audio and video sub-signal to convert them into Ethernet data, and then input a piece of switching chip, and then connect to the two panels of the panel through the switching chip.
  • the Ethernet output panel interface of the IP encoding node also supports 1 SFP optical port output.
  • One SFP optical port and two RJ45 ports can be fully exchanged through the switching chip.
  • Using two different IP encoding chips can not only increase the system's audio and video stream acquisition and processing capacity, but also flexibly select different channels or perform channel backups to ensure application reliability.
  • Through the central control interface it can also receive and send infrared signals, and the serial port asynchronous transmission standard interface RS232 signal.
  • the IP encoding node transmits the encoding signal to the designated IP decoding node through the switch.
  • the aforementioned designated IP decoding node establishes a communication connection with the switch.
  • the IP decoding node divides the coded signal into a first coded sub-signal and a second coded sub-signal.
  • this embodiment may further include the following steps:
  • the IP encoding node detects whether the display parameters of the original audio and video signals meet the preset display parameters; if so, perform step 506; if not, it can re-collect new original audio and video signals.
  • the IP encoding node can loop out and display the original audio and video data collected by the interface, thereby detecting whether the input signal is normal and locally displayed, that is, detecting whether the display parameters of the original audio and video signals meet the preset display parameters. Conducive to improving the success rate of audio and video transmission.
  • the IP decoding node decodes the first encoded sub-signal to obtain the first decoded signal corresponding to the first encoded sub-signal, and decodes the second encoded sub-signal to obtain the second decoded corresponding to the second encoded sub-signal signal.
  • the IP decoding node obtains a decoded signal corresponding to the encoded signal according to the first decoded signal and the second decoded signal.
  • the IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is the specified output parameter.
  • the decoding channel of the IP decoding node is divided into two channels.
  • the encoded signal is received from the RJ45 interface or SFP optical port of the panel, sent to the switching chip, and then divided by the switching chip
  • the first coding sub-signal and the second coding sub-signal are respectively sent to two dedicated IP decoding chips.
  • the two IP decoding chips are sent to the FPGA chip or directly output from the decoding chip to the panel interface.
  • processing such as image cutting, scaling, superimposing, and splicing will be performed inside the FPGA, and then sent to the dedicated video output interface chip, and the interface chip is sent to the panel interface.
  • the IP decoding node supports two different IP decoding chips to realize normal decoding without application scenarios.
  • step 509 may include: the IP decoding node determines whether the output parameter of the decoded signal matches the specified output parameter; if not, the IP decoding node determines the image according to the output parameter of the decoded signal and the specified output parameter Processing method, the image processing method includes at least one of image cutting, image scaling, image overlay and image splicing; the IP decoding node performs image processing on the decoded signal according to the image processing method to obtain the target audio and video whose output parameters are specified output parameters signal.
  • the implementation of this embodiment can perform image processing according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
  • both the IP encoding node and the IP decoding node support the KVM function and the U disk function.
  • the IP encoding node is connected to the above-mentioned IP encoding chip by the TypeB USB interface through the USB Hub chip, which can realize the information transfer between the keyboard and mouse information, U disk data and PC/source terminal accessed by the IP decoding node .
  • the USB interface type of the IP decoding node can be a TypeA interface, which can be specifically used as a keyboard, mouse interface and U disk interface to complete the access of keyboard and mouse signals and U disk data.
  • the USB interface conforms to the USB2.0 interface specification, and the maximum transmission rate is 480Mbps.
  • the USB signal connected from the IP decoding node will be converted into Ethernet data by the above IP decoding chip, and finally transmitted to the designated IP encoding node via the IP network.
  • the audio and video transmission system based on the IP network can use the switch group LAN, only need to develop the IP encoding and IP decoding node equipment and upper management software, compared with the original centralized processor, a series of collection, processing, control, and switching are required to be developed.
  • the difficulty of development work such as, backplane, etc. is greatly reduced, which can effectively reduce project risks and reduce project development cycles.
  • the IP network-based audio and video transmission system can complete the networking with a universal Gigabit switch. The networking and expansion are convenient.
  • the system supports two encoding and decoding hardware solutions, which can achieve backup and increase channel capacity, and support different delay performance , In addition, it also supports application scenarios of multiple resolutions, and can access and output multiple resolutions through software control, with better compatibility.
  • the implementation of the audio and video transmission method of the IP network shown in Figure 5 the transmission of audio and video signals based on the IP network, the sub-nodes complete the processing of each stage of the audio and video signal in the transmission process, and improve the audio and video transmission system
  • the use of two encoding channels and two decoding channels can not only increase the audio and video stream acquisition and processing capacity of the audio and video transmission system, but also can flexibly select different channels or perform channel backups to improve reliability.
  • detecting whether the display parameters of the original audio and video signals meet the preset display parameters is beneficial to improve the success rate of audio and video transmission.
  • image processing can be performed according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
  • FIG. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
  • the audio and video transmission system based on an IP network disclosed in this embodiment may include:
  • the IP encoding node 601 is used to collect original audio and video signals; the IP encoding node 601 establishes a communication connection with the switch 603 of the IP network;
  • the IP encoding node 601 is also used to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, and the encoded signal is Ethernet data;
  • the IP encoding node 601 is also used to transmit the encoded signal to the designated IP decoding node 602 through the switch 603; the IP decoding node 602 establishes a communication connection with the switch 603;
  • the IP encoding node 601 is also used to detect whether an audio and video transmission instruction is received.
  • the audio and video transmission instruction includes the device identification of the target terminal; if so, the IP encoding node 601 obtains a number of IP encoding nodes corresponding to the device identification.
  • the IP decoding node 602 with the best network status is the designated IP decoding node 602. Allocating different designated IP decoding nodes 602 to different terminals, and reasonably allocating network resources, is beneficial to improve the transmission speed of audio and video.
  • the IP decoding node 602 is used to decode the encoded signal to obtain the decoded signal corresponding to the encoded signal;
  • the IP decoding node 602 is also used to perform image processing on the decoded signal to obtain the target audio and video signal whose output parameter is the specified output parameter.
  • the implementation of the audio and video transmission system of the IP network shown in Figure 6 is based on the IP network for the transmission of audio and video signals.
  • the sub-nodes complete the processing of the audio and video signals in each stage of the transmission process, which improves the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals.
  • FIG. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
  • the audio and video transmission system based on an IP network shown in this embodiment is improved on the basis of Embodiment 3. Yes, in the audio and video transmission system based on the IP network shown in this embodiment:
  • the IP encoding node 601 is used to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal.
  • the specific method is as follows:
  • the IP encoding node 601 is used to divide the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal; and to encode the first audio and video sub-signal to obtain the corresponding audio and video sub-signal.
  • a first encoded signal; and, encoding a second audio and video sub-signal to obtain a second encoded signal corresponding to the second audio and video sub-signal; and generating an original audio and video signal corresponding to the first encoded signal and the second encoded signal The encoded signal.
  • the method for the IP decoding node 602 to decode the encoded signal to obtain the decoded signal corresponding to the encoded signal is specifically as follows:
  • the IP decoding node 602 is configured to divide the coded signal into a first coded sub-signal and a second coded sub-signal; and decode the first coded sub-signal to obtain a first decoded signal corresponding to the first coded sub-signal; and , Decoding the second encoded sub-signal to obtain a second decoded signal corresponding to the second encoded sub-signal; and obtaining a decoded signal corresponding to the encoded signal according to the first decoded signal and the second decoded signal.
  • the IP encoding node 601 is also used to detect whether the display parameters of the original audio and video signal conform to the preset before dividing the original audio and video signal into the first audio and video signal and the second audio signal. Display parameters; IP encoding node 601, specifically used to divide the original audio and video signal into a first audio and video signal and a second audio signal when the display parameters of the original audio and video signal meet the preset display parameters. In addition, the IP encoding node 601 is also used to re-collect new original audio and video signals when the display parameters of the original audio and video signals do not meet the preset display parameters.
  • the IP encoding node can loop out and display the original audio and video data collected by the interface, thereby detecting whether the input signal is normal and locally displayed, that is, detecting whether the display parameters of the original audio and video signals meet the preset display parameters. Conducive to improving the success rate of audio and video transmission.
  • the method for the IP decoding node 602 to perform image processing on the decoded signal to obtain the target audio and video signal whose output parameter is the specified output parameter is specifically as follows:
  • the IP decoding node 602 is used to determine whether the output parameters of the decoded signal match the specified output parameters; and, when the output parameters of the decoded signal do not match the specified output parameters, determine the image according to the output parameters of the decoded signal and the specified output parameters Processing method, the image processing method includes at least one of image cutting, image scaling, image superimposition and image splicing; and image processing is performed on the decoded signal according to the image processing method to obtain the target audio and video signal whose output parameter is the specified output parameter .
  • the implementation of this embodiment can perform image processing according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
  • the audio and video transmission system of the IP network shown in Embodiment 4 is based on the IP network for audio and video signal transmission, and the sub-nodes complete the processing of each stage of the audio and video signal in the transmission process, which improves the audio and video transmission system
  • the data processing capability of the and then can transmit ultra-high-definition picture quality audio and video signals.
  • the use of two encoding channels and two decoding channels can not only increase the audio and video stream acquisition and processing capacity of the audio and video transmission system, but also can flexibly select different channels or perform channel backups to improve reliability.
  • detecting whether the display parameters of the original audio and video signals meet the preset display parameters is beneficial to improve the success rate of audio and video transmission.
  • image processing can be performed according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.

Abstract

An IP network-based audio/video transmission method and system, relating to the technical field of audios/videos, and capable of solving the problem of inability of an audio/video transmission system consisting of a splicing wall and agents to transmit audio/video signals having an ultra-high-definition picture quality. The IP network-based audio/video transmission method comprises: an IP encoding node acquires an original audio/video signal; the IP encoding node establishes a communication connection with a switch of an IP network; the IP encoding node encodes the original audio/video signal to generate an encoded signal corresponding to the original audio/video signal, the encoded signal being Ethernet data; the IP encoding node transmits the encoded signal to a designated IP decoding node by means of the switch; the IP decoding node establishes a communication connection with the switch; the IP decoding node decodes the encoded signal to obtain a decoded signal corresponding to the encoded signal, and performs image processing on the decoded signal to obtain a target audio/video signal with an output parameter being a designated output parameter.

Description

一种基于IP网络的音视频传输方法及系统An audio and video transmission method and system based on IP network
本申请要求于2019年12月23日提交至中国专利局、申请号为201911340161.4、发明名称为“一种基于IP网络的音视频传输方法及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed to the Chinese Patent Office on December 23, 2019, with the application number 201911340161.4, and the invention title "A method and system for audio and video transmission based on IP network". The entire content of the application is approved The reference is incorporated in this application.
技术领域Technical field
本发明涉及音视频技术领域，更具体地，涉及一种基于IP网络的音视频传输方法及系统。The present invention relates to the field of audio and video technology, and more specifically, to an audio and video transmission method and system based on an IP network.
背景技术Background technique
随着音视频行业技术不断发展，人们对于视频图像品质的要求越来越高。目前，4K分辨率超高清显示器在拼接墙的应用需求越来越多，然而，拼接墙和坐席组成的音视频传输系统主要采用集中式处理器集中控制的方法，集中式处理器数据处理能力有限，一般最高仅支持1080P分辨率的音视频信号的传输，无法支持超高清画质的音视频信号传输要求。With the continuous development of technology in the audio and video industry, people have higher and higher requirements for the quality of video images. At present, there are more and more applications for 4K resolution ultra-high-definition displays in splicing walls. However, the audio and video transmission system composed of splicing walls and seats mainly adopts a centralized processor centralized control method, which has limited data processing capabilities. , Generally, it only supports the transmission of audio and video signals with up to 1080P resolution, and cannot support the transmission requirements of ultra-high-definition image quality.
发明内容Summary of the invention
本发明旨在克服上述现有技术的拼接墙和坐席组成的音视频传输系统无法传输超高清画质的音视频信号的缺陷，提供一种基于IP网络的音视频传输方法及系统，用于解决拼接墙和坐席组成的音视频传输系统无法传输超高清画质的音视频信号的问题。The present invention aims to overcome the defect that the audio and video transmission system composed of the splicing wall and seats in the prior art cannot transmit ultra-high-definition picture quality audio and video signals, and provides an audio and video transmission method and system based on an IP network to solve the problem The audio and video transmission system composed of splicing walls and seats cannot transmit ultra-high-definition picture quality audio and video signals.
本发明采取的技术方案是一种基于IP网络的音视频传输方法，所述方法包括：IP编码节点采集原始音视频信号；所述IP编码节点将所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号，所述编码信号为以太网数据；所述IP编码节点通过所述IP网络的交换机将所述编码信号传输至指定的IP解码节点；所述IP解码节点对所述编码信号进行解码，以获得所述编码信号对应的解码信号；所述IP解码节点对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The technical solution adopted by the present invention is an audio and video transmission method based on an IP network. The method includes: an IP encoding node collects original audio and video signals; and the IP encoding node encodes the original audio and video signals to generate The encoded signal corresponding to the original audio and video signal, the encoded signal is Ethernet data; the IP encoding node transmits the encoded signal to the designated IP decoding node through the switch of the IP network; the IP decoding node pair The coded signal is decoded to obtain a decoded signal corresponding to the coded signal; the IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
本发明的方法中，基于IP网络进行音视频信号的传输，并分节点完成音视频信号在传输过程中各个阶段的处理工作，能够提高音视频的传输系统的数据处理能力，其中，IP编码节点将原始音视频信号转化为以太网数 据类的编码信号，使得编码信号能够在IP网络的交换机中进行传输，IP解码节点对解码信号进行图像处理，能够获得输出参数为指定输出参数的目标音视频信号，即目标音视频信号的输出分辨率可以是4K。In the method of the present invention, the transmission of audio and video signals is performed based on the IP network, and the processing of the audio and video signals in each stage of the transmission process is completed by nodes, which can improve the data processing capacity of the audio and video transmission system. Among them, the IP encoding node Convert the original audio and video signal into an encoded signal of Ethernet data type, so that the encoded signal can be transmitted in the switch of the IP network, and the IP decoding node performs image processing on the decoded signal to obtain the target audio and video whose output parameters are specified output parameters Signal, that is, the output resolution of the target audio and video signal can be 4K.
本发明还提供一种基于IP网络的音视频传输系统，其所述系统包括：The present invention also provides an audio and video transmission system based on IP network, the system includes:
IP编码节点，用于采集原始音视频信号；所述IP编码节点与所述IP网络的交换机建立通讯连接；IP encoding node, used to collect original audio and video signals; the IP encoding node establishes a communication connection with the switch of the IP network;
所述IP编码节点，还用于对所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号，所述编码信号为以太网数据；The IP encoding node is further configured to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, and the encoded signal is Ethernet data;
所述IP编码节点，还用于通过所述交换机将所述编码信号传输至指定的IP解码节点；所述IP解码节点与所述交换机建立通讯连接；The IP encoding node is further configured to transmit the encoded signal to a designated IP decoding node through the switch; the IP decoding node establishes a communication connection with the switch;
所述IP解码节点，用于对所述编码信号进行解码，以获得所述编码信号对应的解码信号；The IP decoding node is configured to decode the encoded signal to obtain a decoded signal corresponding to the encoded signal;
所述IP解码节点，还用于对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The IP decoding node is also used to perform image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
本发明的系统中，基于IP网络进行音视频信号的传输，并分节点完成音视频信号在传输过程中各个阶段的处理工作，能够提高音视频的传输系统的数据处理能力，其中，IP编码节点将原始音视频信号转化为以太网数据类的编码信号，使得编码信号能够在IP网络的交换机中进行传输，IP解码节点对解码信号进行图像处理，能够获得输出参数为指定输出参数的目标音视频信号，即目标音视频信号的输出分辨率可以是4K。In the system of the present invention, the transmission of audio and video signals is performed based on the IP network, and the processing of the audio and video signals in each stage of the transmission process is completed by nodes, which can improve the data processing capacity of the audio and video transmission system. Among them, the IP encoding node Convert the original audio and video signal into an encoded signal of Ethernet data type, so that the encoded signal can be transmitted in the switch of the IP network, and the IP decoding node performs image processing on the decoded signal to obtain the target audio and video whose output parameters are specified output parameters Signal, that is, the output resolution of the target audio and video signal can be 4K.
与现有技术相比，本发明的有益效果为：提高接墙和坐席组成的音视频传输系统的数据处理能力，解决该音视频传输系统无法传输超高清画质的音视频信号的问题。Compared with the prior art, the present invention has the beneficial effects of improving the data processing capability of an audio and video transmission system composed of a wall connection and a seat, and solving the problem that the audio and video transmission system cannot transmit ultra-high-definition image quality audio and video signals.
附图说明Description of the drawings
图1为本发明公开的一种基于IP网络的音视频传输系统的网络架构图。Figure 1 is a network architecture diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
图2为本发明公开的一种IP编码节点的工作原理框图。Fig. 2 is a block diagram of the working principle of an IP encoding node disclosed in the present invention.
图3为本发明公开的一种IP解码节点的工作原理框图。Fig. 3 is a block diagram of the working principle of an IP decoding node disclosed in the present invention.
图4为本发明公开的一种基于IP网络的音视频传输方法的流程示意 图。Fig. 4 is a schematic flowchart of an audio and video transmission method based on an IP network disclosed in the present invention.
图5为本发明公开的另一种基于IP网络的音视频传输方法的流程示意图。FIG. 5 is a schematic flowchart of another audio and video transmission method based on an IP network disclosed in the present invention.
图6本发明公开的一种基于IP网络的音视频传输系统的架构图。Fig. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention.
具体实施方式Detailed ways
本发明附图仅用于示例性说明，不能理解为对本发明的限制。为了更好说明以下实施例，附图某些部件会有省略、放大或缩小，并不代表实际产品的尺寸；对于本领域技术人员来说，附图中某些公知结构及其说明可能省略是可以理解的。The drawings of the present invention are only used for exemplary description, and should not be construed as limiting the present invention. In order to better illustrate the following embodiments, some components in the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product; for those skilled in the art, some well-known structures in the drawings and their descriptions may be omitted. Understandable.
为了更好地理解本发明公开的信源主机的远程控制方法，下面先对本发明实施例公开的一种分布式音视频传输系统进行描述。请参阅图1，图1是本发明公开的一种基于IP网络的音视频传输系统的网络架构图。可以理解的是，图1仅为本发明公开的基于IP网络的音视频传输系统的一示例性网络架构图，其它任何在图1所示的基础上进行优化或者变形得到的，且能够实现本发明技术方案的网络架构均属于本发明保护范围，对此不作具体限定。如图1所示，以拼接墙和坐席组成的音视频传输系统为例，该基于IP网络的音视频传输系统可以包括位于至少一个IP编码节点和至少一个IP解码节点，每一IP编码节点以及每一IP解码节点均分别与IP网络的交换机建立通信连接，具体的，该交换机可以是千兆交换机，交换机与IP编码节点之间以及交换机与IP解码节点之间可以通过网线或光纤进行连接。每一IP编码节点通信连接有至少一个个人计算机(Personal Computer，PC)或者其他类型的信源，具体的，IP编码节点与信源之间可以通过高清多媒体接口(High Definition Multimedia Interface，HDMI)电缆、通用串行总线(Universal Serial Bus，USB)延长线以及音频线进行连接，其中，HDMI电缆可以同时发送未压缩的音频及视频信号。此外，每一IP解码节点通信连接有至少一个终端，如拼接墙或者坐席终端，其中，坐席终端至少可以设置有坐席显示器、键盘、鼠标和U盘，IP解码节点与拼接墙可以通过HDMI电缆进行连接，IP解码节点与坐席终端可以通过网线或光纤进行连接。基于图1所示的基于IP网络的音视频传输系统的网络架构进行 音视频信号的传输，能够分节点完成音视频信号在传输过程中各个阶段的处理工作。In order to better understand the remote control method of the source host disclosed in the present invention, a distributed audio and video transmission system disclosed in the embodiments of the present invention will be described below. Please refer to FIG. 1. FIG. 1 is a network architecture diagram of an audio and video transmission system based on an IP network disclosed in the present invention. It is understandable that Figure 1 is only an exemplary network architecture diagram of the audio and video transmission system based on the IP network disclosed in the present invention. The network architecture of the technical solution of the invention belongs to the protection scope of the invention, and there is no specific limitation on this. As shown in Figure 1, taking an audio and video transmission system composed of a splicing wall and seats as an example, the audio and video transmission system based on an IP network may include at least one IP encoding node and at least one IP decoding node, each IP encoding node and Each IP decoding node establishes a communication connection with a switch of the IP network. Specifically, the switch may be a gigabit switch. The switch and the IP encoding node and the switch and the IP decoding node can be connected through a network cable or optical fiber. Each IP encoding node is connected to at least one personal computer (PC) or other types of information sources. Specifically, the IP encoding node and the information source can be connected through a high-definition multimedia interface (HDMI) cable. , Universal Serial Bus (USB) extension cable and audio cable to connect, among them, HDMI cable can send uncompressed audio and video signals at the same time. In addition, each IP decoding node is connected to at least one terminal for communication, such as a splicing wall or an agent terminal. The agent terminal can be equipped with at least an agent display, keyboard, mouse, and U disk. The IP decoding node and the splicing wall can be connected via HDMI cables. Connection, the IP decoding node and the agent terminal can be connected through a network cable or optical fiber. Based on the network architecture of the IP network-based audio and video transmission system shown in Figure 1 for audio and video signal transmission, the processing of audio and video signals in each stage of the transmission process can be completed by nodes.
请一并参阅图2，图2为本发明公开的一种IP编码节点的工作原理框图。如图2所示，IP编码节点包括的两片不同的IP编码芯片(具体可以根据编码要求选用特定的专用IP编码芯片)均分别与高速信号扩展集成电路、通用串行总线集线器(Universal Serial Bus Hub，USB Hub)、中控接口板、交换芯片(具体可以是以太网交换芯片)以及音频接口(具体可以是3.5mm音频接口)建立连接。此外，高速信号扩展集成电路连接有HDMI接口(包括高清多媒体输出接口和高清多媒体输入接口)，USB Hub连接有USB(具体可以是TypeB USB)，中控接口板连接有中控接口，以太网交换芯片连接有RJ45接口和SFP光口。IP编码节点通过高速信号扩展集成电路、USB Hub以及中控接口板各自连接的各个接口采集原始音视频信号，由IP编码芯片进行编码，再由以太网交换芯片将编码获得的编码信号通过RJ45接口和SFP光口将编码信号传输至IP网络的交换机。Please also refer to FIG. 2, which is a block diagram of the working principle of an IP encoding node disclosed in the present invention. As shown in Figure 2, the two different IP encoding chips included in the IP encoding node (specific specific IP encoding chips can be selected according to the encoding requirements) are respectively connected with the high-speed signal extension integrated circuit and the universal serial bus hub (Universal Serial Bus). Hub, USB Hub), central control interface board, switch chip (specifically can be an Ethernet switch chip), and audio interface (specifically can be a 3.5mm audio interface) to establish a connection. In addition, the high-speed signal expansion integrated circuit is connected to the HDMI interface (including the high-definition multimedia output interface and the high-definition multimedia input interface), the USB Hub is connected to USB (specifically TypeB USB), the central control interface board is connected to the central control interface, and Ethernet switching The chip is connected with RJ45 interface and SFP optical interface. The IP encoding node collects the original audio and video signals through each interface connected to each of the high-speed signal expansion integrated circuit, USB Hub and the central control interface board, and is encoded by the IP encoding chip, and then the encoded signal obtained by the encoding is passed through the RJ45 interface by the Ethernet switching chip And the SFP optical port transmits the coded signal to the switch of the IP network.
请一并参阅图3，图3为本发明公开的一种IP解码节点的工作原理框图。如图3所示，IP解码节点包括两片不同的IP解码芯片(具体可以根据解码要求选用特定的专用IP解码芯片)、现场可编程逻辑门阵列(Field Programmable Gate Array，FPGA)、USB Hub、视频接口芯片、交换芯片(具体可以是以太网交换芯片)以及音频接口(具体可以是3.5mm音频接口)和高清多媒体输出接口，具体的连接关系详见图3。IP解码节点通过太网交换芯片连接的RJ45接口和SFP光口接收编码信号，由以太网交换芯片将编码获得的编码数据转换成适于在芯片中传输的编码信号，由以太网交换芯片将编码信号传输至IP编码芯片的编码信号，再由IP解码芯片进行解码，由FPGA对解码获得解码信号进行图像处理，以获得目标音视频信号，再根据目标音视频信号的输出要求利用各个输出接口输出目标音视频信号。Please also refer to FIG. 3, which is a block diagram of the working principle of an IP decoding node disclosed in the present invention. As shown in Figure 3, the IP decoding node includes two different IP decoding chips (specific dedicated IP decoding chips can be selected according to the decoding requirements), Field Programmable Gate Array (FPGA), USB Hub, Video interface chip, switching chip (specifically, Ethernet switch chip), audio interface (specifically, 3.5mm audio interface), and high-definition multimedia output interface. The specific connection relationship is shown in Figure 3. The IP decoding node receives the encoded signal through the RJ45 interface and the SFP optical port connected to the Ethernet switch chip, the Ethernet switch chip converts the encoded data obtained from the encoding into an encoded signal suitable for transmission in the chip, and the Ethernet switch chip encodes it The encoded signal transmitted to the IP encoding chip is decoded by the IP decoding chip, and the decoded decoded signal is decoded by the FPGA to perform image processing to obtain the target audio and video signal, and then use each output interface to output according to the output requirements of the target audio and video signal Target audio and video signals.
实施例1Example 1
如图4所示，图4为本发明公开的一种基于IP网络的音视频传输方法的流程示意图，本实施例公开的基于IP网络的音视频传输方法可以包括以 下步骤：As shown in FIG. 4, FIG. 4 is a schematic flowchart of an audio and video transmission method based on an IP network disclosed in the present invention. The audio and video transmission method based on an IP network disclosed in this embodiment may include the following steps:
401、IP编码节点采集原始音视频信号。401. The IP encoding node collects original audio and video signals.
本实施例中，上述IP编码节点与IP网络的交换机建立通讯连接，该IP网络具体可以是利用交换机组成的局域网，该交换机具体可以是千兆交换机，也可以是其他类型的交换机，能够为接入交换机的任意两个节点提供独享的通路。可以理解，IP网络可以包括至少一个IP编码节点。此外，IP编码节点的工作原理具体可参阅图2，IP编码节点通过高速信号扩展集成电路、音频接口、USB Hub以及中控接口板采集HDMI信号、音频信号、USB信号、中控信号等原始音视频信号。IP编码节点支持多种输入参数的音视频数据，如4K分辨率和60赫兹的图像刷新频率的音视频数据。可通过VWAS软件配置不同的输入分辨率。In this embodiment, the above-mentioned IP encoding node establishes a communication connection with the switch of the IP network. The IP network may be a local area network composed of switches. The switch may be a gigabit switch or other types of switches. Any two nodes entering the switch provide exclusive access. It can be understood that the IP network may include at least one IP encoding node. In addition, the working principle of the IP encoding node can be seen in Figure 2. The IP encoding node collects original audio such as HDMI signals, audio signals, USB signals, and central control signals through the high-speed signal expansion integrated circuit, audio interface, USB Hub, and central control interface board. Video signal. The IP encoding node supports audio and video data with multiple input parameters, such as audio and video data with a resolution of 4K and an image refresh rate of 60 Hz. Different input resolutions can be configured through VWAS software.
402、IP编码节点对上述原始音视频信号进行编码，以生成原始音视频信号对应的编码信号，该编码信号为以太网数据。402. The IP encoding node encodes the foregoing original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, where the encoded signal is Ethernet data.
本实施例中，IP编码节点对上述原始音视频信号进行编码，具体可以是通过图2所示的专用IP编码芯片1和/或专用IP编码芯片1进行压缩编码，从而使得原始音视频信号转化成的编码信号便于在IP网络中传输。In this embodiment, the IP encoding node encodes the above-mentioned original audio and video signals. Specifically, it can be compressed and encoded by the dedicated IP encoding chip 1 and/or the dedicated IP encoding chip 1 shown in FIG. 2, so that the original audio and video signals are converted The resulting coded signal is easy to transmit in the IP network.
403、IP编码节点通过交换机将编码信号传输至指定的IP解码节点。403. The IP encoding node transmits the encoded signal to the designated IP decoding node through the switch.
本实施例中，上述指定的IP解码节点与交换机建立通讯连接。可以理解，IP网络可以包括至少一个IP解码节点，上述指定的IP解码节点可以是在IP网络中包括的IP解码节点中选取。举例来说，IP编码节点可以通过RJ45以太网口将编码信号传输至交换机，再由交换机将编码信号传输至指定的IP解码节点。In this embodiment, the aforementioned designated IP decoding node establishes a communication connection with the switch. It can be understood that the IP network may include at least one IP decoding node, and the aforementioned designated IP decoding node may be selected from the IP decoding nodes included in the IP network. For example, the IP encoding node can transmit the encoded signal to the switch through the RJ45 Ethernet port, and then the switch transmits the encoded signal to the designated IP decoding node.
本实施例中，IP编码节点与IP解码节点的网络接口可以为千兆以太网电口或光口，对应的，上述交换机可以采用千兆交换机。In this embodiment, the network interface of the IP encoding node and the IP decoding node may be a Gigabit Ethernet electrical port or an optical port. Correspondingly, the above-mentioned switch may be a Gigabit switch.
本实施例中，上述基于IP网络的音视频传输方法还可以包括以下步骤：IP编码节点检测是否接收到音视频传输指令，该音视频传输指令包括目标终端的设备标识；若是，IP编码节点从该设备标识对应的若干IP编码节点中确定出网络状态最优的IP解码节点为指定的IP解码节点。为不同的终端分配不同的指定的IP解码节点，合理分配网络资源，有利于提高音视频的传输速度。In this embodiment, the above-mentioned IP network-based audio and video transmission method may further include the following steps: the IP encoding node detects whether an audio and video transmission instruction is received, and the audio and video transmission instruction includes the device identification of the target terminal; if so, the IP encoding node Among the several IP encoding nodes corresponding to the device identifier, it is determined that the IP decoding node with the best network state is the designated IP decoding node. Allocating different designated IP decoding nodes for different terminals and rationally allocating network resources is conducive to improving the transmission speed of audio and video.
404、IP解码节点对编码信号进行解码，以获得编码信号对应的解码信号。404. The IP decoding node decodes the encoded signal to obtain a decoded signal corresponding to the encoded signal.
本实施例中，IP解码节点对编码信号进行解码，具体可以是通过图3所示的专用IP解码芯片1和/或专用IP解码芯片1进行编码。In this embodiment, the IP decoding node decodes the encoded signal, which can be specifically encoded by the dedicated IP decoding chip 1 and/or the dedicated IP decoding chip 1 shown in FIG. 3.
405、IP解码节点对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。405. The IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is the specified output parameter.
本实施例中，IP解码节点支持多种输出参数的音视频数据，如分辨率，举例来说，当将该基于IP网络的音视频传输方法应用于拼接墙和坐席组成的音视频传输系统时，可以根据实际需求设定输出参数为4K分辨率和60赫兹的图像刷新频率。可通过VWAS软件配置不同的输出分辨率。In this embodiment, the IP decoding node supports audio and video data with multiple output parameters, such as resolution. For example, when the IP network-based audio and video transmission method is applied to an audio and video transmission system composed of a splicing wall and seats , The output parameters can be set to 4K resolution and 60 Hz image refresh frequency according to actual needs. Different output resolutions can be configured through VWAS software.
所有节点均可通过任意一个IP编码节点、IP解码节点或者交换机进行管理，或者，通过任意一个IP解码节点连接的坐席终端进行管理。All nodes can be managed through any IP encoding node, IP decoding node or switch, or through an agent terminal connected to any IP decoding node.
可见，实施实施图4所示的IP网络的音视频传输方法，基于IP网络进行音视频信号的传输，分节点完成音视频信号在传输过程中各个阶段的处理工作，提高了音视频的传输系统的数据处理能力，进而能够传输超高清画质的音视频信号。It can be seen that the implementation of the audio and video transmission method of the IP network shown in Figure 4, the transmission of audio and video signals based on the IP network, the sub-nodes complete the processing of the audio and video signals in each stage of the transmission process, and improve the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals.
实施例2Example 2
如图5所示，图5为本发明公开的另一种基于IP网络的音视频传输方法的流程示意图，本实施例公开的基于IP网络的音视频传输方法可以包括以下步骤：As shown in FIG. 5, FIG. 5 is a schematic flowchart of another audio and video transmission method based on an IP network disclosed in the present invention. The audio and video transmission method based on an IP network disclosed in this embodiment may include the following steps:
501、IP编码节点采集原始音视频信号。501. The IP encoding node collects original audio and video signals.
本实施例中，IP编码节点与IP网络的交换机建立通讯连接。In this embodiment, the IP encoding node establishes a communication connection with the switch of the IP network.
502、IP编码节点将原始音视频信号划分成第一音视频子信号和第二音视频子信号。502. The IP encoding node divides the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal.
503、IP编码节点对第一音视频子信号进行编码，以获得第一音视频子信号对应的第一编码信号，并对第二音视频子信号进行编码，以获得第二音视频子信号对应的第二编码信号。503. The IP encoding node encodes the first audio and video sub-signal to obtain the first encoded signal corresponding to the first audio and video sub-signal, and encodes the second audio and video sub-signal to obtain the second audio and video sub-signal corresponding to the The second coded signal.
504、IP编码节点根据第一编码信号和第二编码信号生成原始音视频信号对应的编码信号，该编码信号为以太网数据。504. The IP encoding node generates an encoded signal corresponding to the original audio and video signal according to the first encoded signal and the second encoded signal, where the encoded signal is Ethernet data.
请一并参阅图2，步骤502～步骤504中，IP编码节点对接口采集到的音视频信号通过高速信号扩展集成电路芯片分成两个音视频流通道，即第一音视频子信号和第二音视频子信号，再分别在两片不同的专用IP编码芯片进行压缩编码。两片IP编码芯片引入的系统延时有差异。两个不同的IP编码芯片分别对第一音视频子信号和第二音视频子信号进行压缩编码，以将其转换为以太网数据，再输入一片交换芯片，然后通过交换芯片连接至面板的两路RJ45接口。IP编码节点以太网输出面板接口还支持1路SFP光口输出，一路SFP光口与两路RJ45接口可通过交换芯片进行全交换。采用两片不同IP编码芯片，既可以增加系统音视频流采集处理容量，又可以灵活选择不同通道或进行通道备份，保证应用可靠性。通过中控接口还可以接收和发送红外信号、串口异步传输标准接口RS232信号。Please also refer to Figure 2. In steps 502 to 504, the audio and video signals collected by the IP encoding node on the interface are divided into two audio and video stream channels through the high-speed signal expansion integrated circuit chip, namely the first audio and video sub-signal and the second audio and video stream. The audio and video sub-signals are compressed and encoded on two different dedicated IP encoding chips respectively. The system delay introduced by the two IP encoding chips is different. Two different IP encoding chips respectively compress and encode the first audio and video sub-signal and the second audio and video sub-signal to convert them into Ethernet data, and then input a piece of switching chip, and then connect to the two panels of the panel through the switching chip. Road RJ45 interface. The Ethernet output panel interface of the IP encoding node also supports 1 SFP optical port output. One SFP optical port and two RJ45 ports can be fully exchanged through the switching chip. Using two different IP encoding chips can not only increase the system's audio and video stream acquisition and processing capacity, but also flexibly select different channels or perform channel backups to ensure application reliability. Through the central control interface, it can also receive and send infrared signals, and the serial port asynchronous transmission standard interface RS232 signal.
505、IP编码节点通过交换机将上述编码信号传输至指定的IP解码节点。505. The IP encoding node transmits the encoding signal to the designated IP decoding node through the switch.
本实施例中，上述指定的IP解码节点与交换机建立通讯连接。In this embodiment, the aforementioned designated IP decoding node establishes a communication connection with the switch.
506、IP解码节点将编码信号划分成第一编码子信号和第二编码子信号。506. The IP decoding node divides the coded signal into a first coded sub-signal and a second coded sub-signal.
作为一种可选的实施方式，在步骤506之前，本实施例还可以包括以下步骤：As an optional implementation manner, before step 506, this embodiment may further include the following steps:
IP编码节点检测原始音视频信号的显示参数是否符合预设的显示参数；若是，执行步骤506；若否，可以重新采集新的原始音视频信号。The IP encoding node detects whether the display parameters of the original audio and video signals meet the preset display parameters; if so, perform step 506; if not, it can re-collect new original audio and video signals.
本实施方式中，IP编码节点对接口采集的原始音视频数据可以进行环出显示，从而检测输入信号是否正常和本地显示，即检测原始音视频信号的显示参数是否符合预设的显示参数，有利于提高音视频传输的成功率。In this embodiment, the IP encoding node can loop out and display the original audio and video data collected by the interface, thereby detecting whether the input signal is normal and locally displayed, that is, detecting whether the display parameters of the original audio and video signals meet the preset display parameters. Conducive to improving the success rate of audio and video transmission.
507、IP解码节点对第一编码子信号进行解码，以获得第一编码子信号对应的第一解码信号，并对第二编码子信号进行解码，以获得第二编码子信号对应的第二解码信号。507. The IP decoding node decodes the first encoded sub-signal to obtain the first decoded signal corresponding to the first encoded sub-signal, and decodes the second encoded sub-signal to obtain the second decoded corresponding to the second encoded sub-signal signal.
508、IP解码节点根据第一解码信号和第二解码信号获取编码信号对应的解码信号。508. The IP decoding node obtains a decoded signal corresponding to the encoded signal according to the first decoded signal and the second decoded signal.
509、IP解码节点对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。509. The IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is the specified output parameter.
请一并参阅图3，步骤506～步骤509中，IP解码节点解码通道分为两个通道，从面板的RJ45接口或SFP光口接收编码信号，送入交换芯片，再由交换芯片将其划分成第一编码子信号和第二编码子信号，并分别送入两片专用IP解码芯片。两片IP解码芯片解码后分别送入FPGA芯片或者直接由解码芯片输出到面板接口。当解码数据送入FPGA，在FPGA内部会进行图像切割、缩放、叠加、拼接等处理，然后发送至专用视频输出接口芯片，由接口芯片发送至面板接口。IP解码节点支持两路不同IP解码芯片，实现不用应用场景的正常解码。Please refer to Figure 3 together. In steps 506 to 509, the decoding channel of the IP decoding node is divided into two channels. The encoded signal is received from the RJ45 interface or SFP optical port of the panel, sent to the switching chip, and then divided by the switching chip The first coding sub-signal and the second coding sub-signal are respectively sent to two dedicated IP decoding chips. After decoding, the two IP decoding chips are sent to the FPGA chip or directly output from the decoding chip to the panel interface. When the decoded data is sent to the FPGA, processing such as image cutting, scaling, superimposing, and splicing will be performed inside the FPGA, and then sent to the dedicated video output interface chip, and the interface chip is sent to the panel interface. The IP decoding node supports two different IP decoding chips to realize normal decoding without application scenarios.
作为一种可选的实施方式，步骤509可以包括：IP解码节点判断解码信号的输出参数是否与指定输出参数相匹配；若否，IP解码节点根据解码信号的输出参数和指定输出参数确定出图像处理方式，图像处理方式包括图像切割、图像缩放、图像叠加和图像拼接中的至少一种；IP解码节点根据图像处理方式对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。As an optional implementation manner, step 509 may include: the IP decoding node determines whether the output parameter of the decoded signal matches the specified output parameter; if not, the IP decoding node determines the image according to the output parameter of the decoded signal and the specified output parameter Processing method, the image processing method includes at least one of image cutting, image scaling, image overlay and image splicing; the IP decoding node performs image processing on the decoded signal according to the image processing method to obtain the target audio and video whose output parameters are specified output parameters signal.
可见，实施本实施方式，可以根据指定输出参数进行图像处理，进而使得输出的目标音视频信号更符合用户需求，有利于提高用户粘度。It can be seen that the implementation of this embodiment can perform image processing according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
本实施例中，IP编码节点与IP解码节点均支持KVM功能和U盘功能。举例来说，IP编码节点由TypeB USB接口和上述IP编码芯片，通过USB Hub芯片相连，能够实现IP解码节点接入的键盘和鼠标信息、U盘数据和PC/信源端之间的信息传递。IP解码节点的USB接口类型可以为TypeA接口，具体可以作为键盘、鼠标接口以及U盘接口，完成键鼠信号及U盘数据的接入。USB接口符合USB2.0接口规范，最大传输速率480Mbps。从IP解码节点接入的USB信号，会经上述IP解码芯片转换为以太网数据，最终经IP网络传输到指定的IP编码节点。In this embodiment, both the IP encoding node and the IP decoding node support the KVM function and the U disk function. For example, the IP encoding node is connected to the above-mentioned IP encoding chip by the TypeB USB interface through the USB Hub chip, which can realize the information transfer between the keyboard and mouse information, U disk data and PC/source terminal accessed by the IP decoding node . The USB interface type of the IP decoding node can be a TypeA interface, which can be specifically used as a keyboard, mouse interface and U disk interface to complete the access of keyboard and mouse signals and U disk data. The USB interface conforms to the USB2.0 interface specification, and the maximum transmission rate is 480Mbps. The USB signal connected from the IP decoding node will be converted into Ethernet data by the above IP decoding chip, and finally transmitted to the designated IP encoding node via the IP network.
可以理解，基于IP网络的音视频传输系统可利用交换机组局域网，仅需要开发IP编码和IP解码节点设备和上层管理软件，相比原集中处理器所需开发一系列采集、处理、控制、交换、背板等开发工作，难度大大降低，可以有效降低项目风险，减少项目开发周期。基于IP网络的音视频传输系统搭配通用千兆交换机即可完成组网，组网及扩容方便，系统支持两种编解码硬件方案，既可实现备份又可以增加通道容量，而且支持不同时 延性能，此外，还支持多种分辨率的应用场景，可通过软件控制接入和输出多种分辨率，具备较好兼容性。It is understandable that the audio and video transmission system based on the IP network can use the switch group LAN, only need to develop the IP encoding and IP decoding node equipment and upper management software, compared with the original centralized processor, a series of collection, processing, control, and switching are required to be developed. The difficulty of development work such as, backplane, etc. is greatly reduced, which can effectively reduce project risks and reduce project development cycles. The IP network-based audio and video transmission system can complete the networking with a universal Gigabit switch. The networking and expansion are convenient. The system supports two encoding and decoding hardware solutions, which can achieve backup and increase channel capacity, and support different delay performance , In addition, it also supports application scenarios of multiple resolutions, and can access and output multiple resolutions through software control, with better compatibility.
可见，实施实施图5所示的IP网络的音视频传输方法，基于IP网络进行音视频信号的传输，分节点完成音视频信号在传输过程中各个阶段的处理工作，提高了音视频的传输系统的数据处理能力，进而能够传输超高清画质的音视频信号。此外，采用两个编码通道以及两个解码通道，既可以增加音视频传输系统的音视频流采集处理容量，又可以灵活选择不同通道或进行通道备份，提高可靠性。此外，检测原始音视频信号的显示参数是否符合预设的显示参数，有利于提高音视频传输的成功率。此外，可以根据指定输出参数进行图像处理，进而使得输出的目标音视频信号更符合用户需求，有利于提高用户粘度。It can be seen that the implementation of the audio and video transmission method of the IP network shown in Figure 5, the transmission of audio and video signals based on the IP network, the sub-nodes complete the processing of each stage of the audio and video signal in the transmission process, and improve the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals. In addition, the use of two encoding channels and two decoding channels can not only increase the audio and video stream acquisition and processing capacity of the audio and video transmission system, but also can flexibly select different channels or perform channel backups to improve reliability. In addition, detecting whether the display parameters of the original audio and video signals meet the preset display parameters is beneficial to improve the success rate of audio and video transmission. In addition, image processing can be performed according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
实施例3Example 3
如图6所示，图6本发明公开的一种基于IP网络的音视频传输系统的架构图，本实施例公开的基于IP网络的音视频传输系统可以包括：As shown in FIG. 6, FIG. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention. The audio and video transmission system based on an IP network disclosed in this embodiment may include:
IP编码节点601，用于采集原始音视频信号；IP编码节点601与IP网络的交换机603建立通讯连接；The IP encoding node 601 is used to collect original audio and video signals; the IP encoding node 601 establishes a communication connection with the switch 603 of the IP network;
IP编码节点601，还用于对原始音视频信号进行编码，以生成原始音视频信号对应的编码信号，编码信号为以太网数据；The IP encoding node 601 is also used to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, and the encoded signal is Ethernet data;
IP编码节点601，还用于通过交换机603将编码信号传输至指定的IP解码节点602；IP解码节点602与交换机603建立通讯连接；The IP encoding node 601 is also used to transmit the encoded signal to the designated IP decoding node 602 through the switch 603; the IP decoding node 602 establishes a communication connection with the switch 603;
本实施例中，IP编码节点601，还用于检测是否接收到音视频传输指令，该音视频传输指令包括目标终端的设备标识；若是，IP编码节点601从该设备标识对应的若干IP编码节点601中确定出网络状态最优的IP解码节点602为指定的IP解码节点602。为不同的终端分配不同的指定的IP解码节点602，合理分配网络资源，有利于提高音视频的传输速度。In this embodiment, the IP encoding node 601 is also used to detect whether an audio and video transmission instruction is received. The audio and video transmission instruction includes the device identification of the target terminal; if so, the IP encoding node 601 obtains a number of IP encoding nodes corresponding to the device identification. In 601, it is determined that the IP decoding node 602 with the best network status is the designated IP decoding node 602. Allocating different designated IP decoding nodes 602 to different terminals, and reasonably allocating network resources, is beneficial to improve the transmission speed of audio and video.
IP解码节点602，用于对编码信号进行解码，以获得编码信号对应的解码信号；The IP decoding node 602 is used to decode the encoded signal to obtain the decoded signal corresponding to the encoded signal;
IP解码节点602，还用于对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The IP decoding node 602 is also used to perform image processing on the decoded signal to obtain the target audio and video signal whose output parameter is the specified output parameter.
可见，实施实施图6所示的IP网络的音视频传输系统，基于IP网络进行音视频信号的传输，分节点完成音视频信号在传输过程中各个阶段的处理工作，提高了音视频的传输系统的数据处理能力，进而能够传输超高清画质的音视频信号。It can be seen that the implementation of the audio and video transmission system of the IP network shown in Figure 6 is based on the IP network for the transmission of audio and video signals. The sub-nodes complete the processing of the audio and video signals in each stage of the transmission process, which improves the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals.
实施例4Example 4
如图6所示，图6本发明公开的一种基于IP网络的音视频传输系统的架构图，本实施例所示的基于IP网络的音视频传输系统是在实施例3的基础上进行改进的，本实施例所示的基于IP网络的音视频传输系统中：As shown in FIG. 6, FIG. 6 is a structural diagram of an audio and video transmission system based on an IP network disclosed in the present invention. The audio and video transmission system based on an IP network shown in this embodiment is improved on the basis of Embodiment 3. Yes, in the audio and video transmission system based on the IP network shown in this embodiment:
IP编码节点601用于对原始音视频信号进行编码，以生成原始音视频信号对应的编码信号的方式具体为：The IP encoding node 601 is used to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal. The specific method is as follows:
IP编码节点601，用于将原始音视频信号划分成第一音视频子信号和第二音视频子信号；以及，对第一音视频子信号进行编码，以获得第一音视频子信号对应的第一编码信号；以及，对第二音视频子信号进行编码，以获得第二音视频子信号对应的第二编码信号；以及，根据第一编码信号和第二编码信号生成原始音视频信号对应的编码信号。The IP encoding node 601 is used to divide the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal; and to encode the first audio and video sub-signal to obtain the corresponding audio and video sub-signal. A first encoded signal; and, encoding a second audio and video sub-signal to obtain a second encoded signal corresponding to the second audio and video sub-signal; and generating an original audio and video signal corresponding to the first encoded signal and the second encoded signal The encoded signal.
IP解码节点602用于对编码信号进行解码，以获得编码信号对应的解码信号的方式具体为：The method for the IP decoding node 602 to decode the encoded signal to obtain the decoded signal corresponding to the encoded signal is specifically as follows:
IP解码节点602，用于将编码信号划分成第一编码子信号和第二编码子信号；以及，对第一编码子信号进行解码，以获得第一编码子信号对应的第一解码信号；以及，对第二编码子信号进行解码，以获得第二编码子信号对应的第二解码信号；以及，根据第一解码信号和第二解码信号获取编码信号对应的解码信号。The IP decoding node 602 is configured to divide the coded signal into a first coded sub-signal and a second coded sub-signal; and decode the first coded sub-signal to obtain a first decoded signal corresponding to the first coded sub-signal; and , Decoding the second encoded sub-signal to obtain a second decoded signal corresponding to the second encoded sub-signal; and obtaining a decoded signal corresponding to the encoded signal according to the first decoded signal and the second decoded signal.
作为一种可选的实施方式，IP编码节点601，还用于在将原始音视频信号划分成第一音视频信号和第二音频信号之前，检测原始音视频信号的显示参数是否符合预设的显示参数；IP编码节点601，具体用于在原始音视频信号的显示参数符合预设的显示参数时，将原始音视频信号划分成第一音视频信号和第二音频信号。此外，IP编码节点601，还用于在原始音视频信号的显示参数不符合预设的显示参数时，重新采集新的原始音视频信号。As an optional implementation manner, the IP encoding node 601 is also used to detect whether the display parameters of the original audio and video signal conform to the preset before dividing the original audio and video signal into the first audio and video signal and the second audio signal. Display parameters; IP encoding node 601, specifically used to divide the original audio and video signal into a first audio and video signal and a second audio signal when the display parameters of the original audio and video signal meet the preset display parameters. In addition, the IP encoding node 601 is also used to re-collect new original audio and video signals when the display parameters of the original audio and video signals do not meet the preset display parameters.
本实施方式中，IP编码节点对接口采集的原始音视频数据可以进行环出显示，从而检测输入信号是否正常和本地显示，即检测原始音视频信号的显示参数是否符合预设的显示参数，有利于提高音视频传输的成功率。In this embodiment, the IP encoding node can loop out and display the original audio and video data collected by the interface, thereby detecting whether the input signal is normal and locally displayed, that is, detecting whether the display parameters of the original audio and video signals meet the preset display parameters. Conducive to improving the success rate of audio and video transmission.
作为一种可选的实施方式，IP解码节点602用于对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号的方式具体为：As an optional implementation manner, the method for the IP decoding node 602 to perform image processing on the decoded signal to obtain the target audio and video signal whose output parameter is the specified output parameter is specifically as follows:
IP解码节点602，用于判断解码信号的输出参数是否与指定输出参数相匹配；以及，在解码信号的输出参数与指定输出参数不匹配时，根据解码信号的输出参数和指定输出参数确定出图像处理方式，图像处理方式包括图像切割、图像缩放、图像叠加和图像拼接中的至少一种；以及，根据图像处理方式对解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The IP decoding node 602 is used to determine whether the output parameters of the decoded signal match the specified output parameters; and, when the output parameters of the decoded signal do not match the specified output parameters, determine the image according to the output parameters of the decoded signal and the specified output parameters Processing method, the image processing method includes at least one of image cutting, image scaling, image superimposition and image splicing; and image processing is performed on the decoded signal according to the image processing method to obtain the target audio and video signal whose output parameter is the specified output parameter .
可见，实施本实施方式，可以根据指定输出参数进行图像处理，进而使得输出的目标音视频信号更符合用户需求，有利于提高用户粘度。It can be seen that the implementation of this embodiment can perform image processing according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
可见，实施实施例4所示的IP网络的音视频传输系统，基于IP网络进行音视频信号的传输，分节点完成音视频信号在传输过程中各个阶段的处理工作，提高了音视频的传输系统的数据处理能力，进而能够传输超高清画质的音视频信号。此外，采用两个编码通道以及两个解码通道，既可以增加音视频传输系统的音视频流采集处理容量，又可以灵活选择不同通道或进行通道备份，提高可靠性。此外，检测原始音视频信号的显示参数是否符合预设的显示参数，有利于提高音视频传输的成功率。此外，可以根据指定输出参数进行图像处理，进而使得输出的目标音视频信号更符合用户需求，有利于提高用户粘度。It can be seen that the audio and video transmission system of the IP network shown in Embodiment 4 is based on the IP network for audio and video signal transmission, and the sub-nodes complete the processing of each stage of the audio and video signal in the transmission process, which improves the audio and video transmission system The data processing capability of the, and then can transmit ultra-high-definition picture quality audio and video signals. In addition, the use of two encoding channels and two decoding channels can not only increase the audio and video stream acquisition and processing capacity of the audio and video transmission system, but also can flexibly select different channels or perform channel backups to improve reliability. In addition, detecting whether the display parameters of the original audio and video signals meet the preset display parameters is beneficial to improve the success rate of audio and video transmission. In addition, image processing can be performed according to the specified output parameters, so that the output target audio and video signals are more in line with user needs, which is beneficial to improve user viscosity.
显然，本发明的上述实施例仅仅是为清楚地说明本发明技术方案所作的举例，而并非是对本发明的具体实施方式的限定。凡在本发明权利要求书的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本发明权利要求的保护范围之内。Obviously, the above-mentioned embodiments of the present invention are merely examples to clearly illustrate the technical solutions of the present invention, and are not intended to limit the specific implementation manners of the present invention. Any modification, equivalent replacement and improvement made within the spirit and principle of the claims of the present invention shall be included in the protection scope of the claims of the present invention.

Claims (10)

  1. 一种基于IP网络的音视频传输方法，其特征在于，所述方法包括：An audio and video transmission method based on an IP network, characterized in that the method includes:
    IP编码节点采集原始音视频信号；所述IP编码节点与所述IP网络的交换机建立通讯连接；The IP encoding node collects original audio and video signals; the IP encoding node establishes a communication connection with the switch of the IP network;
    所述IP编码节点对所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号，所述编码信号为以太网数据；The IP encoding node encodes the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, where the encoded signal is Ethernet data;
    所述IP编码节点通过所述交换机将所述编码信号传输至指定的IP解码节点；所述IP解码节点与所述交换机建立通讯连接；The IP encoding node transmits the encoded signal to a designated IP decoding node through the switch; the IP decoding node establishes a communication connection with the switch;
    所述IP解码节点对所述编码信号进行解码，以获得所述编码信号对应的解码信号；The IP decoding node decodes the encoded signal to obtain a decoded signal corresponding to the encoded signal;
    所述IP解码节点对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
  2. 根据权利要求1所述的一种基于IP网络的音视频传输方法，其特征在于：An audio and video transmission method based on an IP network according to claim 1, characterized in that:
    所述IP编码节点对所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号，包括：The IP encoding node encoding the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal includes:
    所述IP编码节点将所述原始音视频信号划分成第一音视频子信号和第二音视频子信号；The IP encoding node divides the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal;
    所述IP编码节点对所述第一音视频子信号进行编码，以获得所述第一音视频子信号对应的第一编码信号；The IP encoding node encodes the first audio and video sub-signal to obtain a first encoded signal corresponding to the first audio and video sub-signal;
    所述IP编码节点对所述第二音视频子信号进行编码，以获得所述第二音视频子信号对应的第二编码信号；The IP encoding node encodes the second audio and video sub-signal to obtain a second encoded signal corresponding to the second audio and video sub-signal;
    所述IP编码节点根据所述第一编码信号和所述第二编码信号生成所述原始音视频信号对应的编码信号。The IP encoding node generates an encoded signal corresponding to the original audio and video signal according to the first encoded signal and the second encoded signal.
  3. 根据权利要求2所述的一种基于IP网络的音视频传输方法，其特征在于：An audio and video transmission method based on an IP network according to claim 2, characterized in that:
    所述IP编码节点将所述原始音视频信号划分成第一音视频信号和第二音频信号之前，所述方法还包括：Before the IP encoding node divides the original audio and video signal into a first audio and video signal and a second audio signal, the method further includes:
    所述IP编码节点检测所述原始音视频信号的显示参数是否符合预设的显示参数；The IP encoding node detects whether the display parameters of the original audio and video signal meet the preset display parameters;
    若是，执行所述IP编码节点将所述原始音视频信号划分成第一音视频信号和第二音频信号的步骤。If yes, perform the step of dividing the original audio and video signal into a first audio and video signal and a second audio signal by the IP encoding node.
  4. 根据权利要求1至3任一项所述的一种基于IP网络的音视频传输方法，其特征在于：An audio and video transmission method based on an IP network according to any one of claims 1 to 3, characterized in that:
    所述IP解码节点对所述编码信号进行解码，以获得所述编码信号对应的解码信号，包括：The decoding by the IP decoding node on the encoded signal to obtain the decoded signal corresponding to the encoded signal includes:
    所述IP解码节点将所述编码信号划分成第一编码子信号和第二编码子信号；The IP decoding node divides the coded signal into a first coded sub-signal and a second coded sub-signal;
    所述IP解码节点对所述第一编码子信号进行解码，以获得所述第一编码子信号对应的第一解码信号；The IP decoding node decodes the first coded sub-signal to obtain a first decoded signal corresponding to the first coded sub-signal;
    所述IP解码节点对所述第二编码子信号进行解码，以获得所述第二编码子信号对应的第二解码信号；The IP decoding node decodes the second coded sub-signal to obtain a second decoded signal corresponding to the second coded sub-signal;
    所述IP解码节点根据所述第一解码信号和所述第二解码信号获取所述编码信号对应的解码信号。The IP decoding node obtains the decoded signal corresponding to the encoded signal according to the first decoded signal and the second decoded signal.
  5. 根据权利要求1至4任一项所述的一种基于IP网络的音视频传输方法，其特征在于：An audio and video transmission method based on an IP network according to any one of claims 1 to 4, characterized in that:
    所述IP解码节点对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号，包括：The IP decoding node performs image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter, including:
    所述IP解码节点判断所述解码信号的输出参数是否与指定输出参数相匹配；The IP decoding node judges whether the output parameter of the decoded signal matches the specified output parameter;
    若否，所述IP解码节点根据所述解码信号的输出参数和所述指定输出参数确定出图像处理方式，所述图像处理方式包括图像切割、图像缩放、图像叠加和图像拼接中的至少一种；If not, the IP decoding node determines an image processing method according to the output parameters of the decoded signal and the specified output parameters, and the image processing method includes at least one of image cutting, image scaling, image superimposition, and image splicing ；
    所述IP解码节点根据所述图像处理方式对所述解码信号进行图像处理，以获得输出参数为所述指定输出参数的目标音视频信号。The IP decoding node performs image processing on the decoded signal according to the image processing mode to obtain a target audio and video signal whose output parameter is the designated output parameter.
  6. 一种基于IP网络的音视频传输系统，其特征在于，所述系统包括：An audio and video transmission system based on an IP network, characterized in that, the system includes:
    IP编码节点，用于采集原始音视频信号；所述IP编码节点与所述IP网络的交换机建立通讯连接；IP encoding node, used to collect original audio and video signals; the IP encoding node establishes a communication connection with the switch of the IP network;
    所述IP编码节点，还用于对所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号，所述编码信号为以太网数据；The IP encoding node is further configured to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal, and the encoded signal is Ethernet data;
    所述IP编码节点，还用于通过所述交换机将所述编码信号传输至指定的IP解码节点；所述IP解码节点与所述交换机建立通讯连接；The IP encoding node is further configured to transmit the encoded signal to a designated IP decoding node through the switch; the IP decoding node establishes a communication connection with the switch;
    所述IP解码节点，用于对所述编码信号进行解码，以获得所述编码信号对应的解码信号；The IP decoding node is configured to decode the encoded signal to obtain a decoded signal corresponding to the encoded signal;
    所述IP解码节点，还用于对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号。The IP decoding node is also used to perform image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter.
  7. 根据权利要求6所述的一种基于IP网络的音视频传输系统，其特征在于：An audio and video transmission system based on an IP network according to claim 6, characterized in that:
    所述IP编码节点用于对所述原始音视频信号进行编码，以生成所述原始音视频信号对应的编码信号的方式具体为：The method for the IP encoding node to encode the original audio and video signal to generate an encoded signal corresponding to the original audio and video signal is specifically as follows:
    所述IP编码节点，用于将所述原始音视频信号划分成第一音视频子信号和第二音视频子信号；以及，对所述第一音视频子信号进行编码，以获得所述第一音视频子信号对应的第一编码信号；以及，对所述第二音视频子信号进行编码，以获得所述第二音视频子信号对应的第二编码信号；以及，根据所述第一编码信号和所述第二编码信号生成所述原始音视频信号对应的编码信号。The IP encoding node is configured to divide the original audio and video signal into a first audio and video sub-signal and a second audio and video sub-signal; and, to encode the first audio and video sub-signal to obtain the first audio and video sub-signal. A first encoded signal corresponding to an audio and video sub-signal; and, encoding the second audio and video sub-signal to obtain a second encoded signal corresponding to the second audio and video sub-signal; and, according to the first The encoded signal and the second encoded signal generate an encoded signal corresponding to the original audio and video signal.
  8. 根据权利要求7所述的一种基于IP网络的音视频传输系统，其特征在于，An audio and video transmission system based on an IP network according to claim 7, characterized in that,
    所述IP编码节点，还用于在将所述原始音视频信号划分成第一音视频信号和第二音频信号之前，检测所述原始音视频信号的显示参数是否符合预设的显示参数；The IP encoding node is further configured to detect whether the display parameters of the original audio and video signal meet the preset display parameters before dividing the original audio and video signal into a first audio and video signal and a second audio signal;
    所述IP编码节点，具体用于在所述原始音视频信号的显示参数符合所述预设的显示参数时，将所述原始音视频信号划分成第一音视频信号和第二音频信号。The IP encoding node is specifically configured to divide the original audio and video signal into a first audio and video signal and a second audio signal when the display parameter of the original audio and video signal meets the preset display parameter.
  9. 根据权利要求6至8任一项所述的一种基于IP网络的音视频传输系统，其特征在于：An audio and video transmission system based on an IP network according to any one of claims 6 to 8, characterized in that:
    所述IP解码节点用于对所述编码信号进行解码，以获得所述编码信号对应的解码信号的方式具体为：The method for the IP decoding node to decode the encoded signal to obtain the decoded signal corresponding to the encoded signal is specifically as follows:
    所述IP解码节点，用于将所述编码信号划分成第一编码子信号和第二编码子信号；以及，对所述第一编码子信号进行解码，以获得所述第一编 码子信号对应的第一解码信号；以及，对所述第二编码子信号进行解码，以获得所述第二编码子信号对应的第二解码信号；以及，根据所述第一解码信号和所述第二解码信号获取所述编码信号对应的解码信号。The IP decoding node is configured to divide the coded signal into a first coded sub-signal and a second coded sub-signal; and, decode the first coded sub-signal to obtain the corresponding first coded sub-signal And, decode the second encoded sub-signal to obtain a second decoded signal corresponding to the second encoded sub-signal; and, according to the first decoded signal and the second decoded signal The signal obtains the decoded signal corresponding to the encoded signal.
  10. 根据权利要求6至9任一项所述的一种基于IP网络的音视频传输系统，其特征在于：An audio and video transmission system based on an IP network according to any one of claims 6 to 9, characterized in that:
    所述IP解码节点用于对所述解码信号进行图像处理，以获得输出参数为指定输出参数的目标音视频信号的方式具体为：The method for the IP decoding node to perform image processing on the decoded signal to obtain a target audio and video signal whose output parameter is a specified output parameter is specifically as follows:
    所述IP解码节点，用于判断所述解码信号的输出参数是否与指定输出参数相匹配；以及，在所述解码信号的输出参数与所述指定输出参数不匹配时，根据所述解码信号的输出参数和所述指定输出参数确定出图像处理方式，所述图像处理方式包括图像切割、图像缩放、图像叠加和图像拼接中的至少一种；以及，根据所述图像处理方式对所述解码信号进行图像处理，以获得输出参数为所述指定输出参数的目标音视频信号。The IP decoding node is used to determine whether the output parameter of the decoded signal matches a designated output parameter; and, when the output parameter of the decoded signal does not match the designated output parameter, according to the decoded signal The output parameters and the specified output parameters determine an image processing method, the image processing method including at least one of image cutting, image scaling, image superposition, and image splicing; and, according to the image processing method, the decoded signal is processed Image processing is performed to obtain a target audio and video signal whose output parameter is the specified output parameter.
PCT/CN2020/141741 2019-12-23 2020-12-30 Ip network-based audio/video transmission method and system WO2021129885A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911340161.4 2019-12-23
CN201911340161.4A CN111010616A (en) 2019-12-23 2019-12-23 Audio and video transmission method and system based on IP network

Publications (1)

Publication Number Publication Date
WO2021129885A1 true WO2021129885A1 (en) 2021-07-01

Family

ID=70117626

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/141741 WO2021129885A1 (en) 2019-12-23 2020-12-30 Ip network-based audio/video transmission method and system

Country Status (2)

Country Link
CN (1) CN111010616A (en)
WO (1) WO2021129885A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111010616A (en) * 2019-12-23 2020-04-14 威创集团股份有限公司 Audio and video transmission method and system based on IP network
CN111770316B (en) * 2020-07-22 2021-11-02 广州芯象科技有限公司 Audio and video encoder
CN112738428A (en) * 2020-12-28 2021-04-30 威创集团股份有限公司 Video signal stream conversion device and seat cooperation system
CN115988155B (en) * 2023-03-20 2023-08-18 广州美凯信息技术股份有限公司 Spliced display method and display system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130162754A1 (en) * 2003-03-10 2013-06-27 Meetrix Communication, Inc. Audio-video multi-participant conference systems using pstn and internet networks
CN104113705A (en) * 2013-04-16 2014-10-22 无锡思朗电子科技有限公司 Distributed matrix switching system
CN104935923A (en) * 2015-06-12 2015-09-23 广东威创视讯科技股份有限公司 Signal encoding method and system, and signal decoding method and system
CN104967791A (en) * 2015-07-07 2015-10-07 广州魅视电子科技有限公司 Distributed audio and video transmission control system
CN105516689A (en) * 2016-01-26 2016-04-20 深圳市维冠视界科技股份有限公司 Method and system for distributed tiled display
CN108134916A (en) * 2016-12-01 2018-06-08 北京视联动力国际信息技术有限公司 A kind of data processing method of 4K terminals and 4K terminals
CN109862364A (en) * 2019-01-25 2019-06-07 深圳市朗强科技有限公司 A kind of sending, receiving method and device of ultra high-definition video
CN111010616A (en) * 2019-12-23 2020-04-14 威创集团股份有限公司 Audio and video transmission method and system based on IP network

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104052959A (en) * 2013-03-12 2014-09-17 无锡思朗电子科技有限公司 A distributed splicing control display system based on network video nodes
CN104284098B (en) * 2013-07-01 2017-11-14 杭州海康威视数字技术股份有限公司 The processing method and system of video data
CN110545430A (en) * 2018-05-28 2019-12-06 北京松果电子有限公司 video transmission method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130162754A1 (en) * 2003-03-10 2013-06-27 Meetrix Communication, Inc. Audio-video multi-participant conference systems using pstn and internet networks
CN104113705A (en) * 2013-04-16 2014-10-22 无锡思朗电子科技有限公司 Distributed matrix switching system
CN104935923A (en) * 2015-06-12 2015-09-23 广东威创视讯科技股份有限公司 Signal encoding method and system, and signal decoding method and system
CN104967791A (en) * 2015-07-07 2015-10-07 广州魅视电子科技有限公司 Distributed audio and video transmission control system
CN105516689A (en) * 2016-01-26 2016-04-20 深圳市维冠视界科技股份有限公司 Method and system for distributed tiled display
CN108134916A (en) * 2016-12-01 2018-06-08 北京视联动力国际信息技术有限公司 A kind of data processing method of 4K terminals and 4K terminals
CN109862364A (en) * 2019-01-25 2019-06-07 深圳市朗强科技有限公司 A kind of sending, receiving method and device of ultra high-definition video
CN111010616A (en) * 2019-12-23 2020-04-14 威创集团股份有限公司 Audio and video transmission method and system based on IP network

Also Published As

Publication number Publication date
CN111010616A (en) 2020-04-14

Similar Documents

Publication Publication Date Title
WO2021129885A1 (en) Ip network-based audio/video transmission method and system
CN101727873B (en) Signal conversion apparatuses and display system
WO2017032081A1 (en) Audio and video playback device, data display method, and storage medium
WO2022011989A1 (en) Video coding system
CN208508938U (en) A kind of active redundancy(-ce) optical network backup system of embedded management function of attending a banquet
WO2017012517A1 (en) Hybrid physical coding sub-layer and method for transmitting and receiving data, and storage medium
CN110531950A (en) A kind of video card for supporting KVM to encode
TWI445374B (en) Remote management system and remote management method
CN214381223U (en) Screen sharing system based on network
CN201967045U (en) Video monitoring server
CN102546803A (en) Remote desktop communication method based on capability set
US9118947B2 (en) Multi-vision virtualization system and method
CN206274660U (en) A kind of processing system for video
CN104954748A (en) Video processing architecture
CN207399385U (en) A kind of bimodulus apparatus for processing multimedia data and system
CN105721836A (en) Multifunctional graphics card and data processing method of multifunctional graphics card
CN206922947U (en) A kind of cloud device
CN113038182B (en) Device and method for realizing video safety transmission through hardware coding and decoding technology
CN108540866A (en) A kind of video-splicing show under multi-channel video output system and method
CN114470745A (en) Cloud game implementation method, device and system based on SRT
CN110225289B (en) Conference terminal and interface signal conversion method
CN111787419A (en) Pluggable modular multifunctional video gateway
CN110806810A (en) Data control system based on KVM
CN215773352U (en) Encoder supporting de-interlacing processing
CN105120211A (en) Video data transmission method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20905584

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20905584

Country of ref document: EP

Kind code of ref document: A1