CN110062194A - A kind of processing method of audio, video data, device and device and storage medium - Google Patents
A kind of processing method of audio, video data, device and device and storage medium Download PDFInfo
- Publication number
- CN110062194A CN110062194A CN201910319090.3A CN201910319090A CN110062194A CN 110062194 A CN110062194 A CN 110062194A CN 201910319090 A CN201910319090 A CN 201910319090A CN 110062194 A CN110062194 A CN 110062194A
- Authority
- CN
- China
- Prior art keywords
- terminal
- audio
- video data
- poll
- node server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a kind of processing methods of audio, video data, device, and a kind of device and a kind of computer readable storage medium, wherein, which comprises first terminal is operated in response to the configuration of user, obtains the multiple configuration informations for being directed to multiple second terminals；First terminal stores multiple configuration informations into preset polling tasks list；The preset one or more poll threads of first terminal starting, and send the play instruction of audio, video data to node server according to the preset period using one or more poll threads, node server obtains audio, video data corresponding with play instruction according to play instruction, and audio, video data is returned to multiple second terminals, multiple second terminals play the audio, video data received according to multiple configuration informations.The embodiment of the present invention increases while showing the number of audio, video data, improves the efficiency of display audio, video data.
Description
Technical field
The present invention relates to view networking technology field, more particularly to a kind of processing method of audio, video data, device and
A kind of device and a kind of computer readable storage medium.
Background technique
It is a kind of dedicated network for being used for high-speed transfer HD video and specialized protocol based on ethernet hardware depending on networking,
It is the more advanced form of internet depending on networking, is a real-time network.
In video conference based on view networking, main meeting-place can show video conference by the video wall poll on 8 tunnels
In the part side of attending a meeting audio, video data.The video wall on 8 tunnels can be made of 4 daughter nucleus, and each daughter nucleus can receive 2 tunnels
Audio, video data, the video wall on 8 tunnels can show the audio, video data of 8 sides of attending a meeting simultaneously.
If showing the audio, video data of the excessive side of attending a meeting by the video wall poll on 8 tunnels, the video wall on 8 tunnels is needed
Poll is multiple, and the display efficiency of audio, video data is relatively low.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
Processing method, device and a kind of device of a kind of audio, video data to solve the above problems and a kind of computer-readable storage
Medium.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of processing method of audio, video data, the methods
It networks applied to view, includes first terminal, multiple second terminals and node server in the view networking, wherein the node
Server is communicated to connect with the first terminal and the multiple second terminal respectively；The described method includes: the first terminal
In response to the configuration operation of user, the multiple configuration informations for being directed to the multiple second terminal are obtained；The first terminal is by institute
Multiple configuration informations are stated to store into preset polling tasks list；The preset one or more polls of first terminal starting
Thread, and audio, video data is sent to the node server according to the preset period using one or more of poll threads
Play instruction, the node server obtains corresponding with play instruction audio, video data according to the play instruction,
And the audio, video data is returned to the multiple second terminal, the multiple second terminal is broadcast according to the multiple configuration information
Put the audio, video data received.
Optionally, the first terminal starts the step of preset one or more poll threads, comprising: described first eventually
End counts the quantity of multiple configuration informations described in the polling tasks list；The first terminal starts institute according to the quantity
State one or more poll threads.
Optionally, the step of first terminal starts one or more of poll threads according to the quantity, comprising:
The first terminal starts one poll thread when the quantity is less than or equal to preset terminal threshold value；Described
One terminal starts the multiple poll thread when quantity is greater than the terminal threshold value.
Optionally, it is described depending on networking further include multiple third terminals, the multiple third terminal includes the audio-video number
According to source terminal, the multiple configuration information includes the identification information of polling interval information and the source terminal.
Optionally, the play instruction includes the identification information of the source terminal；The multiple second terminal is according to institute
It states polling interval message loop and plays the audio, video data received.
The embodiment of the invention also discloses a kind of processing unit of audio, video data, the processing unit is applied to view connection
Net includes multiple second terminals and node server in view networking, wherein the node server respectively with the processing
Device and the communication connection of the multiple second terminal；The processing unit includes: acquisition module, for the configuration in response to user
Operation obtains the multiple configuration informations for being directed to the multiple second terminal；Memory module, for depositing the multiple configuration information
Storage is into preset polling tasks list；Starting module, for starting preset one or more poll threads；Sending module,
For sending audio, video data to the node server according to the preset period using one or more of poll threads
Play instruction, the node server obtain audio, video data corresponding with the play instruction according to the play instruction, and
The audio, video data is returned to the multiple second terminal, the multiple second terminal is played according to the multiple configuration information
The audio, video data received.
Optionally, the starting module, comprising: statistic submodule is more described in the polling tasks list for counting
The quantity of a configuration information；Promoter module, for starting one or more of poll threads according to the quantity.
Optionally, the promoter module, for starting institute when the quantity is less than or equal to preset terminal threshold value
State a poll thread；When quantity is greater than the terminal threshold value, start the multiple poll thread；It is described to further include depending on networking
Multiple third terminals, the multiple third terminal include the source terminal of the audio, video data, the multiple configuration information packet
Include the identification information of polling interval information and the source terminal；The play instruction includes the mark letter of the source terminal
Breath；The multiple second terminal plays the audio, video data received according to the polling interval message loop.
The embodiment of the invention also discloses a kind of devices, comprising: one or more processors；Be stored thereon with instruction
One or more machine readable medias, when being executed by one or more of processors, so that described device executes such as this hair
The processing method of audio, video data described in bright embodiment.
The embodiment of the invention also discloses the computer programs of a kind of computer readable storage medium, storage to handle
Device executes the processing method of audio, video data as described in the embodiments of the present invention.
The embodiment of the present invention includes following advantages:
The embodiment of the present invention is applied in view networking, may include first terminal, multiple second terminals and node depending on networking
Server, wherein node server can be communicated to connect with first terminal and multiple second terminals respectively.In video conference application
Under scene, first terminal can be the controlling terminal of video conference, and second terminal can be the video wall on 8 tunnels, node server
It can be video conference management server.
In an embodiment of the present invention, user can be second terminal input configuration in first terminal by configuring operation
Information, first terminal obtain configuration information in response to the configuration operation of user, configuration information are stored to preset polling tasks
In list.The preset one or more poll threads of first terminal starting, using one or more poll threads according to preset
Period sends the play instruction of audio, video data to node server, and node server is obtained according to play instruction and play instruction
Corresponding audio, video data, and audio, video data is returned to second terminal, second terminal connects according to the broadcasting of respective configuration information
The audio, video data received.
Technical solution in the embodiment of the present invention is applied under video conference application scene, can be the TV on multiple 8 tunnels
Wall inputs configuration information, and one or more poll threads send play instruction to video conference management server, so that multiple 8 tunnels
Video wall can work at the same time, for the video wall on only one 8 tunnel shows the audio, video data for the side of attending a meeting, increase
The number for showing audio, video data simultaneously improves the efficiency of display audio, video data.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of the invention；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；
Fig. 5 is a kind of step flow chart of the processing method embodiment of audio, video data of the embodiment of the present invention；
Fig. 6 is the designed holder composition of the polling method of the video wall on multiple 8 tunnels of one kind of the embodiment of the present invention；
Fig. 7 is the schematic illustration of the polling method of the video wall on multiple 8 tunnels of one kind of the embodiment of the present invention；
Fig. 8 is a kind of structural block diagram of the processing device embodiment of audio, video data of the embodiment of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
First video flow.It is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
(Circuit Switching) meets Streaming demand using Packet Switching depending on networking technology.Depending on skill of networking
Art has flexible, the simple and low price of packet switch, is provided simultaneously with the quality and safety assurance of circuit switching, realizes the whole network friendship
Change the seamless connection of formula virtual circuit and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).Metropolitan Area Network (MAN) can be divided on the whole depending on networking
(or national net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, the Bao Jun that Network Interface Module 201, CPU module 203, disk array module 204 are come in enters switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine module, are forwarded: 1) end if meeting the following conditions
It is less than that mouth sends caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, packet
Include the operation such as initialization, read-write to hard disk；CPU module 203 be mainly responsible for access switch, terminal (not shown) it
Between protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 304 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, may include two kinds of situations:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded:
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 308 is configured by CPU module 304, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
| DA | SA | Reserved | Payload | CRC |
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
With reference to Fig. 5, a kind of step process of the processing method embodiment of audio, video data of the embodiment of the present invention is shown
Figure, this method can be applied to view networking, view network in may include first terminal, multiple second terminals and node server,
Wherein, node server can be communicated to connect with first terminal and multiple second terminals respectively, this method can specifically include as
Lower step:
Step 501, first terminal is operated in response to the configuration of user, is obtained and is matched confidence for the multiple of multiple second terminals
Breath.
Multiple second terminals can be preset in embodiments of the present invention, and second terminal is for playing third in view networking
The audio, video data of terminal.The audio, video data of third terminal can be the audio, video data that third terminal is locally stored, can also
Think the collected audio, video data of third terminal.In video conference application scene, the audio, video data of third terminal can be with
For the collected real-time videoconference data in the side of attending a meeting.
Corresponding configuration information can be respectively configured for each second terminal in user, and in practical applications, configuration information can
To include the identification information of polling interval information and source terminal.Wherein, polling interval information can indicate that second terminal plays
The interval time of the audio, video data of multiple groups third terminal, for example, polling interval information is 1 minute, then second terminal is being shown
The audio, video data of next group of third terminal is shown after audio, video data 1 minute of current group third terminal.Source terminal
Identification information can indicate the identification information of the third terminal where audio, video data to be shown, which can be view
Networking number, physical address of network interface card etc. have any information of uniquely determining property, class of the embodiment of the present invention to identification information
Type, content, format etc. are not specifically limited.
Step 502, first terminal stores multiple configuration informations into preset polling tasks list.
A polling tasks list can be preset in first terminal, which is used to store the configuration of each second terminal
Information.One configuration information can be considered a polling tasks.That is, user is that how many a second terminals are configured with
Configuration information, then there are how many a polling tasks in polling tasks list.
Step 503, the preset one or more poll threads of first terminal starting, and utilize one or more poll threads
The play instruction of audio, video data is sent, to node server according to the preset period so that node server is according to play instruction
Audio, video data corresponding with play instruction is obtained, and returns to audio, video data to multiple second terminals, multiple second terminal roots
The audio, video data received is played according to multiple configuration informations.
In the embodiment of the present invention, first terminal can take by starting poll thread, and then using poll thread and node
Business device is communicated, to complete the task in polling tasks list.When first terminal starts one or more poll threads,
First terminal can first count the quantity of configuration information in polling tasks list, the number of the configuration information then obtained according to statistics
Amount starts one or more poll threads.In practical applications, if the quantity of configuration information is less than or waits in polling tasks list
In preset terminal threshold value, then first terminal can only start a poll thread；If configuration information in polling tasks list
Quantity is greater than preset terminal threshold value, then first terminal can star multiple poll threads.For example, preset terminal threshold value is 4,
The terminal threshold value indicates that a poll thread can only at most handle 4 polling tasks.When there are 4 or 4 in polling tasks list
When a configuration information below, first terminal can only start a poll thread, which can be responsible for processing
4 in polling tasks list or 4 polling tasks below.When in polling tasks list there are when 5 configuration informations, first
Terminal needs to start two poll threads, wherein and a poll thread is responsible for handling 4 polling tasks in polling tasks list,
Another poll thread is responsible for handling remaining 1 polling tasks in polling tasks list.When there are 10 in polling tasks list
When a configuration information, first terminal needs to start three poll threads, wherein a poll thread is responsible for handling polling tasks column
4 polling tasks in table, another poll thread are responsible for handling another 4 polling tasks in polling tasks list, another poll
Thread is responsible for handling remaining 2 polling tasks in polling tasks list.
After first terminal starts one or more poll threads, can use one or more poll threads of starting to
The play instruction of node server transmission audio, video data.In practical applications, poll thread can according to the preset period to
Node server sends play instruction, which can issue one or more configuration informations to poll thread for first terminal
Period.It may also be said that poll thread receive first terminal transmission a wave one or more configuration information after, Xiang Jiedian
Server sends play instruction.Poll thread receive first terminal transmission next wave one or more configuration information it
Afterwards, play instruction is sent again to node server.It should be noted that the wave configuration that first terminal is sent to poll thread
Information is the configuration information of the second terminal of playing audio-video data simultaneously.For example, first terminal is sent simultaneously to poll thread
The configuration information of second terminal Z1, Z2 and Z4, poll thread can be after receiving configuration information immediately to node server
Play instruction is sent, alternatively, poll thread can also be sent out in the rear of a period of time for receiving configuration information to node server
Send play instruction.
The play instruction that poll thread is sent to node server, the source that may include audio, video data to be played are whole
The identification information at end.In one preferred embodiment of the invention, play instruction can also include audio, video data to be played
The identification information of second terminal.The identification information of the second terminal of the audio, video data to be played can be carried in second terminal
In configuration information.For example, it includes identification information b2, the poll of second terminal Z2 that user, which is the configuration information of second terminal Z2 configuration,
The identification information b5 of interval information t2 and third terminal Z5.Poll thread sends play instruction to node server, which refers to
Order may include identification information b2 and identification information b5.Node server can obtain third terminal Z5's according to identification information b5
The audio, video data got from third terminal Z5 is back to further according to identification information b2 by audio, video data, node server
Two terminal Z2.Second terminal Z2 according to polling interval information t2 loop play third terminal Z5 audio, video data.
Based on a kind of above-mentioned related description of the processing method embodiment of audio, video data, a kind of multiple 8 tunnels are described below
The polling method of video wall the video wall on multiple 8 tunnels is set, to show as shown in fig. 6, in video conference application scene
Show the audio, video data for the side of attending a meeting.The poller module of the video wall on 8 tunnels can be set in the control application program of video conference,
The poller module of the video wall on 8 tunnels can control the polling procedure of the video wall on multiple 8 tunnels.In specific implementation process
In, it according to the video wall on multiple 8 tunnels of the condition settings such as the quantity for the side of attending a meeting, and can be every before the beginning of video conference
The video wall on a 8 tunnel specifies the terminal list of the side of attending a meeting to be polled, is then sent out using poll thread timing Xiang Huiguan server
The instruction for sending each daughter nucleus of the video wall on each 8 tunnel to show audio, video data, can pipe server can be according to instruction to each 8
Each daughter nucleus of the video wall on road returns to audio, video data to be shown.
As shown in fig. 7, needing successively to show 80 in the main meeting-place of video conference if there are 80 sides of attending a meeting in video conference
The video data of a side of attending a meeting, can configure the video wall on 58 tunnels for video conference, and the video wall poll on 8 tunnel of First is shown
The video data of preceding 1st to the 16th side of attending a meeting, the video wall poll on second 8 tunnel show the view of the 17th to the 32nd side of attending a meeting
Frequency evidence, the video wall poll on 8 tunnel of third platform show the video data of the 33rd to the 48th side of attending a meeting, the TV on the 4th 8 tunnels
Wall poll shows that the video data of the 49th to the 64th side of attending a meeting, the video wall poll on the 5th 8 tunnels show the 65th to the 80th
The video data for the side of attending a meeting.The poller module of the video wall on 8 tunnels can be the video wall on 8 tunnel of First, the TV on second 8 tunnel
The video wall of wall, the video wall on 8 tunnel of third platform and the 4th 8 tunnels starts poll thread 01, and poll thread 01 can be to meeting pipe clothes
Be engaged in device send instruction, with will pipe server to the video wall on 8 tunnel of First return the 1st to the 16th side of attending a meeting video counts
According to returning to the video data of the 17th to the 32nd side of attending a meeting to the video wall on second 8 tunnel, returned to the video wall on 8 tunnel of third platform
The video data for going back to the 33rd to the 48th side of attending a meeting returns to the view of the 49th to the 64th side of attending a meeting to the video wall on the 4th 8 tunnels
Frequency evidence.The poller module of the video wall on 8 tunnels can start poll thread 02, poll thread 02 for the video wall on the 5th 8 tunnels
Can Xiang Huiguan server send instruction, with will pipe server return to the 65th to the 80th ginseng to the video wall on the 5th 8 tunnel
The video data of meeting side.
The embodiment of the present invention is applied in view networking, may include first terminal, multiple second terminals and node depending on networking
Server, wherein node server can be communicated to connect with first terminal and multiple second terminals respectively.In video conference application
Under scene, first terminal can be the controlling terminal of video conference, and second terminal can be the video wall on 8 tunnels, node server
It can be video conference management server.
In an embodiment of the present invention, user can be second terminal input configuration in first terminal by configuring operation
Information, first terminal obtain configuration information in response to the configuration operation of user, configuration information are stored to preset polling tasks
In list.The preset one or more poll threads of first terminal starting, using one or more poll threads according to preset
Period sends the play instruction of audio, video data to node server, and node server is obtained according to play instruction and play instruction
Corresponding audio, video data, and audio, video data is returned to second terminal, second terminal connects according to the broadcasting of respective configuration information
The audio, video data received.
Technical solution in the embodiment of the present invention is applied under video conference application scene, can be the TV on multiple 8 tunnels
Wall inputs configuration information, and one or more poll threads send play instruction to video conference management server, so that multiple 8 tunnels
Video wall can work at the same time, for the video wall on only one 8 tunnel shows the audio, video data for the side of attending a meeting, increase
The number for showing audio, video data simultaneously improves the efficiency of display audio, video data.
In video conference application scene, the embodiment of the present invention does not need to be arranged in the control application program of video conference
Timer does not need the video data of the video wall poll side of attending a meeting using 8 tunnel of Timer Controlling, reduces the control of video conference
The operating pressure of application program processed.
Moreover, can star when executing polling tasks there are the video wall on 8 more tunnels in video conference application scene
Multiple poll threads, using multiple poll threads with can pipe server communicated, improve the controlling terminal of video conference
Parallel processing capability.
If the video wall on 8 tunnels can be arranged in sub-venue there are main meeting-place and sub-venue in video conference application scene, with
The audio, video data of the side of attending a meeting can also be shown in sub-venue.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 8, a kind of structural block diagram of the processing device embodiment of audio, video data of the embodiment of the present invention is shown,
The processing unit is applied to view networking, includes multiple second terminals and node server in the view networking, wherein the section
Point server is communicated to connect with the processing unit and the multiple second terminal respectively；The apparatus may include such as lower dies
Block:
Module 801 is obtained, for the configuration operation in response to user, obtains and matches for the multiple of the multiple second terminal
Confidence breath；Memory module 802, for storing the multiple configuration information into preset polling tasks list；Starting module
803, for starting preset one or more poll threads；Sending module 804, for utilizing one or more of poll lines
Journey sends the play instruction of audio, video data according to the preset period to the node server, and the node server is according to institute
It states play instruction and obtains corresponding with play instruction audio, video data, and return to the audio, video data to the multiple the
Two terminals, the multiple second terminal play the audio, video data received according to the multiple configuration information.
In one preferred embodiment of the invention, the starting module 803, comprising: statistic submodule 8031, for uniting
Count the quantity of multiple configuration informations described in the polling tasks list；Promoter module 8032, for being opened according to the quantity
Move one or more of poll threads.
In one preferred embodiment of the invention, the promoter module 8032, for being less than or waiting in the quantity
When preset terminal threshold value, start one poll thread；When quantity is greater than the terminal threshold value, start the multiple
Poll thread；Described depending on networking further includes multiple third terminals, and the multiple third terminal includes coming for the audio, video data
Source terminal, the multiple configuration information include the identification information of polling interval information and the source terminal；The play instruction
Identification information including the source terminal；The multiple second terminal is received according to polling interval message loop broadcasting
The audio, video data.
For the processing device embodiment of audio, video data, due to the processing method embodiment of itself and audio, video data
Substantially similar, so being described relatively simple, referring to the part explanation of the processing method embodiment of audio, video data in place of correlation
?.
The embodiment of the invention also provides a kind of devices, comprising:
One or more processors；With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors
When, so that described device executes the processing method of audio, video data as described in the embodiments of the present invention.
The embodiment of the invention also provides the computer programs of a kind of computer readable storage medium, storage to handle
Device executes the processing method of audio, video data as described in the embodiments of the present invention.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Above to a kind of processing method of audio, video data provided by the present invention, device and a kind of device and a kind of meter
Calculation machine readable storage medium storing program for executing is described in detail, specific case used herein to the principle of the present invention and embodiment into
Elaboration is gone, the above description of the embodiment is only used to help understand the method for the present invention and its core ideas；Meanwhile for this
The those skilled in the art in field, according to the thought of the present invention, there will be changes in the specific implementation manner and application range,
In conclusion the contents of this specification are not to be construed as limiting the invention.
Claims (10)
1. a kind of processing method of audio, video data, which is characterized in that the method is applied to view networking, described depending on wrapping in networking
Include first terminal, multiple second terminals and node server, wherein the node server respectively with the first terminal and institute
State multiple second terminal communication connections；The described method includes:
The first terminal is operated in response to the configuration of user, obtains the multiple configuration informations for being directed to the multiple second terminal；
The first terminal stores the multiple configuration information into preset polling tasks list；
The preset one or more poll threads of first terminal starting, and using one or more of poll threads according to
The preset period sends the play instruction of audio, video data to the node server, and the node server is according to the broadcasting
Instruction obtains audio, video data corresponding with the play instruction, and returns to the audio, video data to the multiple second end
End, the multiple second terminal play the audio, video data received according to the multiple configuration information.
2. the processing method of audio, video data according to claim 1, which is characterized in that the first terminal starting is default
One or more poll threads the step of, comprising:
The first terminal counts the quantity of multiple configuration informations described in the polling tasks list；
The first terminal starts one or more of poll threads according to the quantity.
3. the processing method of audio, video data according to claim 2, which is characterized in that the first terminal is according to
Quantity starts the step of one or more of poll threads, comprising:
The first terminal starts one poll thread when the quantity is less than or equal to preset terminal threshold value；
The first terminal starts the multiple poll thread when quantity is greater than the terminal threshold value.
4. the processing method of audio, video data according to claim 1, which is characterized in that it is described depending on networking further include multiple
Third terminal, the multiple third terminal include the source terminal of the audio, video data, and the multiple configuration information includes wheel
Ask the identification information of interval information and the source terminal.
5. the processing method of audio, video data according to claim 1, which is characterized in that the play instruction includes described
The identification information of source terminal；
The multiple second terminal plays the audio, video data received according to the polling interval message loop.
6. a kind of processing unit of audio, video data, which is characterized in that the processing unit is applied to view networking, the view networking
In include multiple second terminals and node server, wherein the node server respectively with the processing unit and described more
A second terminal communication connection；The processing unit includes:
Module is obtained, for the configuration operation in response to user, obtains the multiple configuration informations for being directed to the multiple second terminal；
Memory module, for storing the multiple configuration information into preset polling tasks list；
Starting module, for starting preset one or more poll threads；
Sending module, for being sent according to the preset period to the node server using one or more of poll threads
The play instruction of audio, video data, the node server obtain sound corresponding with the play instruction according to the play instruction
Video data, and the audio, video data is returned to the multiple second terminal, the multiple second terminal is according to the multiple
Configuration information plays the audio, video data received.
7. the processing unit of audio, video data according to claim 6, which is characterized in that the starting module, comprising:
Statistic submodule, for counting the quantity of multiple configuration informations described in the polling tasks list；
Promoter module, for starting one or more of poll threads according to the quantity.
8. the processing unit of audio, video data according to claim 7, which is characterized in that the promoter module is used for
When the quantity is less than or equal to preset terminal threshold value, start one poll thread；It is greater than the terminal in quantity
When threshold value, start the multiple poll thread；
Described depending on networking further includes multiple third terminals, and the multiple third terminal includes that the source of the audio, video data is whole
End, the multiple configuration information includes the identification information of polling interval information and the source terminal；
The play instruction includes the identification information of the source terminal；
The multiple second terminal plays the audio, video data received according to the polling interval message loop.
9. a kind of device characterized by comprising
One or more processors；With
One or more machine readable medias of instruction are stored thereon with, when being executed by one or more of processors, are made
Obtain the processing method for the audio, video data that described device is executed as described in any one of claims 1 to 5.
10. a kind of computer readable storage medium, which is characterized in that its computer program stored executes processor as weighed
Benefit require any one of 1 to 5 described in audio, video data processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910319090.3A CN110062194B (en) | 2019-04-19 | 2019-04-19 | Audio and video data processing method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910319090.3A CN110062194B (en) | 2019-04-19 | 2019-04-19 | Audio and video data processing method, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110062194A true CN110062194A (en) | 2019-07-26 |
| CN110062194B CN110062194B (en) | 2022-01-11 |
Family
ID=67319760
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910319090.3A Active CN110062194B (en) | 2019-04-19 | 2019-04-19 | Audio and video data processing method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110062194B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111711791A (en) * | 2020-06-12 | 2020-09-25 | 西安万像电子科技有限公司 | Data processing method and device |
| CN111988570A (en) * | 2020-08-25 | 2020-11-24 | 西安万像电子科技有限公司 | Image data display method and device and image data display system |
| CN113542370A (en) * | 2021-06-29 | 2021-10-22 | 北京达佳互联信息技术有限公司 | Activity broadcast information processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101783919A (en) * | 2009-12-10 | 2010-07-21 | 上海华平信息技术股份有限公司 | Round-robin method based on video conference |
| US20140152759A1 (en) * | 2009-12-15 | 2014-06-05 | A Big Blessed Family, Llc | Remote Servicing System |
| CN104254014A (en) * | 2014-09-25 | 2014-12-31 | 福建星网锐捷安防科技有限公司 | Video on-wall configuration method and system for analog TV wall |
| CN105208358A (en) * | 2015-11-04 | 2015-12-30 | 武汉微创光电股份有限公司 | Video monitoring system for video-wall configuration |
| CN107809609A (en) * | 2017-11-16 | 2018-03-16 | 王磊 | Video monitoring conference system based on touch apparatus |
| CN109640029A (en) * | 2018-11-16 | 2019-04-16 | 视联动力信息技术股份有限公司 | The method and apparatus that wall is shown on a kind of video flowing |
-
2019
- 2019-04-19 CN CN201910319090.3A patent/CN110062194B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101783919A (en) * | 2009-12-10 | 2010-07-21 | 上海华平信息技术股份有限公司 | Round-robin method based on video conference |
| US20140152759A1 (en) * | 2009-12-15 | 2014-06-05 | A Big Blessed Family, Llc | Remote Servicing System |
| CN104254014A (en) * | 2014-09-25 | 2014-12-31 | 福建星网锐捷安防科技有限公司 | Video on-wall configuration method and system for analog TV wall |
| CN105208358A (en) * | 2015-11-04 | 2015-12-30 | 武汉微创光电股份有限公司 | Video monitoring system for video-wall configuration |
| CN107809609A (en) * | 2017-11-16 | 2018-03-16 | 王磊 | Video monitoring conference system based on touch apparatus |
| CN109640029A (en) * | 2018-11-16 | 2019-04-16 | 视联动力信息技术股份有限公司 | The method and apparatus that wall is shown on a kind of video flowing |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111711791A (en) * | 2020-06-12 | 2020-09-25 | 西安万像电子科技有限公司 | Data processing method and device |
| CN111988570A (en) * | 2020-08-25 | 2020-11-24 | 西安万像电子科技有限公司 | Image data display method and device and image data display system |
| CN113542370A (en) * | 2021-06-29 | 2021-10-22 | 北京达佳互联信息技术有限公司 | Activity broadcast information processing method and device, electronic equipment and storage medium |
| CN113542370B (en) * | 2021-06-29 | 2023-11-03 | 北京达佳互联信息技术有限公司 | Method and device for processing active broadcast information, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110062194B (en) | 2022-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110233984A (en) | A kind of monitoring system and method based on view networking | |
| CN110267099A (en) | A kind of data transmission method and view networked terminals based on view networking | |
| CN109617956A (en) | A kind of data processing method and device | |
| CN109302472A (en) | A kind of view networked resources method for releasing and view networking share Platform Server | |
| CN110190973A (en) | A kind of presence detection method and device | |
| CN109150905A (en) | A kind of view networked resources method for releasing and view networking share Platform Server | |
| CN109120879A (en) | A kind of processing method and system of video conference | |
| CN110493513A (en) | A kind of camera control method and a kind of view networked system | |
| CN110062295A (en) | A kind of file resource acquisition methods and system | |
| CN110225083A (en) | Data push method and device based on view networking | |
| CN110049346A (en) | A kind of method and system of net cast | |
| CN110049273A (en) | A kind of meeting method for recording and transfer server based on view networking | |
| CN110062194A (en) | A kind of processing method of audio, video data, device and device and storage medium | |
| CN109491783A (en) | A kind of acquisition methods and system of memory usage | |
| CN109729184A (en) | A kind of method and apparatus of view networking service processing | |
| CN109347930A (en) | A kind of task processing method and device | |
| CN108989850A (en) | A kind of video playing control method and control system | |
| CN110022500A (en) | A kind of loss treating method and device | |
| CN110289974A (en) | A kind of processing method of data flow, system and device and storage medium | |
| CN110035249A (en) | A kind of video gets method and apparatus ready | |
| CN110287248A (en) | A kind of data read-write method and system | |
| CN109963107A (en) | A kind of display methods and system of audio, video data | |
| CN109121017A (en) | A kind of view intranet network method for evaluating quality and device | |
| CN109525635A (en) | A kind of acquisition methods and system of memory usage | |
| CN108881148A (en) | A kind of data capture method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |