CN110072126A

CN110072126A - Data request method, association turn server and computer readable storage medium

Info

Publication number: CN110072126A
Application number: CN201910209608.8A
Authority: CN
Inventors: 孙亮亮; 方小帅; 李云鹏; 沈军
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-03-19
Filing date: 2019-03-19
Publication date: 2019-07-30

Abstract

The present invention provides a kind of data request method, associations to turn server and computer readable storage medium, is related to regarding networking technology field.Association, which turns server, can receive the target data request that view networked server is sent, then, it is requested based on target data, the target data stream based on RTMP agreement is requested to destination server, finally, the target data stream received can be converted to the target based on view networking protocol and regard networking data stream, since the target is based on view networking protocol depending on networking data stream, therefore it can be transmitted in depending on networking, correspondingly, association turns server and is sent to the target after view networked server depending on networking data stream, the target can be sent to view networked terminals depending on networking data stream depending on networked server, so that user can be by watching the video based on RTMP agreement depending on networked terminals.

Description

Data request method, association turn server and computer readable storage medium

Technical field

The present invention relates to view networking technology fields, turn server and calculating more particularly to a kind of data request method, association Machine readable storage medium storing program for executing.

Background technique

Currently, real-time messages transport protocol (Real Time Messaging Protocol, RTMP) is worked as in transmission of video In be more and more widely used, the equipment carried out data transmission using RTMP agreement is more and more, for example, education record It broadcasts in system, recorded broadcast equipment is exactly using RTMP agreement come transmitting data stream.

In the prior art, since RTMP agreement is different from the transport protocol depending on using in networking, it is based on RTMP agreement Data just can not depending on networking in transmit, and then cause user can not by view networked terminals watch the view based on RTMP agreement Frequently.

Summary of the invention

In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind A kind of data request method for solving the above problems, association turn server and computer readable storage medium.

To solve the above-mentioned problems, the embodiment of the invention discloses a kind of data request method, this method is applied to view connection Association in net turns server, this method comprises:

Receive the target data request that view networked server is sent；The target video request is based on depending on networked server It is generated depending on the initial data requests that networked terminals are sent；

It is requested based on the target data, requests the number of targets based on real-time messages transport protocol RTMP to destination server According to stream；

Receive the target data stream that the destination server is sent；

The target data stream is converted into the target based on view networking protocol and regards networking data stream, and the target is regarded Networking data stream is sent to the view networked server, in order to which the target is regarded networking data stream by the view networked server It is sent to the view networked terminals.

Optionally, the target includes target video data packet and target audio data packet depending on networking data stream；

It is described that the target data stream is converted to the target view networking data stream based on view networking protocol, comprising:

Extract the video flowing and audio stream in the target data stream；

Based on the video flowing and audio stream, target video data packet and target audio data packet are obtained respectively, obtains institute State target view networking data stream.

Optionally, described to be requested based on the target data, real-time messages transport protocol is based on to destination server request The target data stream of RTMP, comprising:

It is requested according to the target data, determines the address of the destination server；

Based on the destination server address, Xiang Suoshu destination server sends stream request to create；

Receive and store the stream index number that the destination server returns；The stream index number is for identifying the number of targets According to stream；

Receive the target data stream that the destination server is sent；Each data packet in the target data stream is equal It is identified using the stream index number.

Optionally, the video flowing and audio stream extracted in the target data stream, comprising:

The target data stream is extracted from received data packet based on the stream index number；

According to the type of data packet each in the target data stream, the video flowing and sound in the target data stream are extracted Frequency flows.

Optionally, described to be based on the video flowing and audio stream, target video data packet and target sound frequency are obtained respectively According to packet, comprising:

The video flowing is decoded, obtains the original video data for including in the video flowing, and to the sound Frequency stream is decoded, and obtains the original audio data in the audio stream；

It is multiple video data block by the original video data cutting, and, it is by the original audio data cutting Multiple audio data blocks；

View networking packet header is added for each video data block, obtains target video data packet, and, it is each audio data Block addition view networking packet header, obtains target audio data packet.

It is optionally, described that the target is sent to the view networked server depending on networking data stream, comprising:

Continuously transmit M target video data packet；

After continuously transmitting the M target video data packet, N number of target audio data packet is continuously transmitted；

After continuously transmitting N number of target audio data packet, M target video data packet is continuously transmitted described in repetition The step of；Described M, N are the integer not less than 1.

Optionally, it is described by the original video data cutting be multiple video data block, comprising:

Obtain the Frame Properties of every frame video data in the original video data；

Using the frame video data that Frame Properties is key frame as the first frame video data of the video data block, and cut Point, obtain multiple video data block；The first frame video data of each video data block is key frame.

To solve the above-mentioned problems, the embodiment of the invention discloses a kind of associations for request of data to turn server, described Association turns server application in view networking, and the association turns server and includes:

First receiving module, the target data request sent for receiving view networked server；The target video request It is to regard the initial data requests that networked server is sent based on view networked terminals to generate；

Request module, for being requested based on the target data, to destination server request based on real-time messages transmission association Discuss the target data stream of RTMP；

Second receiving module, the target data stream sent for receiving the destination server；

Conversion module regards networking data stream for the target data stream to be converted to the target based on view networking protocol, And the target is sent to the view networked server depending on networking data stream, in order to which the view networked server is by the mesh Mark is sent to the view networked terminals depending on networking data stream.

The conversion module, comprising:

Extracting sub-module, for extracting video flowing and audio stream in the target data stream；

Acquisition submodule obtains target video data packet and target sound for being based on the video flowing and audio stream respectively Frequency data packet obtains the target view networking data stream.

Optionally, the request module, is used for:

Optionally, the extracting sub-module, is used for:

Optionally, the acquisition submodule, comprising:

Decoding unit obtains the original video data for including in the video flowing for being decoded to the video flowing, And the audio stream is decoded, obtain the original audio data in the audio stream；

Cutting unit is used to the original video data cutting be multiple video data block, and, by the original sound Frequency is multiple audio data blocks according to cutting；

Adding unit regards networking packet header for adding for each video data block, obtains target video data packet, and, View networking packet header is added for each audio data block, obtains target audio data packet.

Optionally, the conversion module, is used for:

Continuously transmit M target video data packet；

Optionally, the cutting unit, is used for:

To solve the above-mentioned problems, the embodiment of the invention discloses computer readable storage mediums, described computer-readable Computer program is stored on storage medium, is realized when the computer program is executed by processor such as above-mentioned data request method Step.

The embodiment of the present invention includes following advantages:

Association, which turns server, can receive the target data request that view networked server is sent, and then, be asked based on target data It asks, the target data stream based on RTMP agreement is requested to destination server, finally, the target data stream received can be converted For based on view networking protocol target regard networking data stream, due to the target view networking data stream be based on regard networking protocol, Therefore it can be transmitted in depending on networking, correspondingly, association turns server and the target is sent to view the Internet services depending on networking data stream After device, the target can be sent to view networked terminals depending on networking data stream depending on networked server, so that user can be with By watching the video based on RTMP agreement depending on networked terminals.

Detailed description of the invention

Fig. 1 is a kind of networking schematic diagram of view networking of the invention；

Fig. 2 is a kind of hardware structural diagram of node server of the invention；

Fig. 3 is a kind of hardware structural diagram of access switch of the invention；

Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；

Fig. 5 is a kind of step flow chart of data request method embodiment of the invention；

Fig. 6 is the step flow chart of another data request method embodiment of the invention；

A kind of block diagram for turning server for the association of request of data of Fig. 7 embodiment of the present invention.

Specific embodiment

In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.

It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.

Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or Computer realizes that high-definition quality video plays.

Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:

Depending on networking, applied portion of techniques is as described below:

Network technology (Network Technology)

Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type The seamless connection of road and data format.

Switching technology (Switching Technology)

Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.

Server technology (Server Technology)

It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.

Reservoir technology (Storage Technology)

The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.

Network security technology (Network Security Technology)

Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black The attack of visitor and virus, structural carefree secure network is provided for user.

It services innovative technology (Service Innovation Technology)

Business and transmission are fused together by unified video platform, whether single user, private user or a net The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type " Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".

Networking depending on networking is as described below:

It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class Type, but centralized control node is needed to control whole network in network on this basis.

Fig. 1 is a kind of networking schematic diagram of view networking of the invention, as shown in Figure 1, being divided into access net and metropolitan area depending on networking Net two parts.

The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases Even, and it can connect Ethernet.

Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal. Node server can directly be connected with access switch, can also directly be connected with terminal.

Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.

Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end Point, and belong to metropolitan area mesh portions.

Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.

It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.

Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.

Classify depending on networked devices

1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or National net, World Wide Web etc.) and access net.

1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).

The specific hardware structure of each access network equipment are as follows:

Node server:

Fig. 2 is a kind of hardware structural diagram of node server of the invention, as shown in Fig. 2, mainly connecing including network Mouth mold block 201, switching engine module 202, CPU module 203, disk array module 204；

Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet； And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown) Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table) Configuration, and, the configuration to disk array module 204.

Access switch:

Fig. 3 is a kind of hardware structural diagram of access switch of the invention, as shown in figure 3, mainly connecing including network Mouth mold block (downstream network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304；

Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met, It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet； If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier (stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full, Then abandon.

All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention:

If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1) It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；

If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded: 1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.

Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.

CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and, Configuration to rate control module 308.

Ethernet association turns gateway:

Fig. 4 is that a kind of Ethernet association of the invention turns the hardware structural diagram of gateway, as shown in figure 4, mainly including net Network interface module (downstream network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, pack buffer 407 and MAC adding module 409, MAC are deleted Except module 410.

Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410 (2byte), and enter corresponding receive and cache, otherwise abandon；

Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway SA, Ethernet length or frame type, and send.

The function that Ethernet association turns other modules in gateway is similar with access switch.

Terminal:

It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.

The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server. Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes Network Interface Module, switching engine module and CPU module are constituted.

2, networking data package definition is regarded

2.1 access network data package definitions

Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes, payload(PDU)、CRC。

As shown in the table, the data packet for accessing net mainly includes following sections:

DA

SA

Reserved

Payload

CRC

Wherein:

Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address, Seven, the 8th bytes are access net address；

Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；

Reserve bytes are made of 2 bytes；

The part payload has different length according to the type of different datagrams, is if it is various protocol packages 64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；

CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.

2.2 Metropolitan Area Network (MAN) packet definitions

The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.

(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into 0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN) Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.

As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:

DA

SA

Reserved

Label

Payload

CRC

That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position Set is between the reserve bytes and payload of data packet.

Based on the above-mentioned characteristic of view networking, one of the core concepts of the embodiments of the present invention is proposed, You Xiezhuan server will Target data stream based on RTMP is converted to the target based on view networking protocol and regards networking data stream, is then issued to view the Internet services Device so as to target can be sent to view networked terminals depending on networking data stream depending on networked server, and then uses view on-line customer The video based on RTMP agreement can be watched by view networked terminals.

Referring to Fig. 5, a kind of step flow chart of data request method embodiment of the invention is shown, this method is applied to Turn server depending on the association in networking, this method can specifically include following steps:

Step 501 receives the target data request that view networked server is sent.

In the embodiment of the present invention, target video request can be view networked server according to the first of view networked terminals transmission What beginning request of data generated.In practical application, at least one view networked terminals, view networking can have been managed depending on networked server Terminal can be set-top box (Set Top Box, STB), commonly referred to as box on set-top box or machine, be a connection television set and outer The equipment of portion's signal source, the digital signal of compression can be changed into television content by it, and be shown on a television set.It is general and Speech, set-top box can connect camera and microphone, can also be with for acquiring the multi-medium datas such as video data and audio data Television set is connected, for multi-medium datas such as playing video data and audio datas.When user wants to receive by view networked terminals When seeing the video based on RTMP agreement, initial data requests can be sent to view networked server by view networked terminals, depending on connection Network server can generate target data request after receiving the initial data requests according to the initial data requests, and It is sent to association and turns server, at this point, association, which turns server, can receive the target data request that view networked server is sent.

Step 502 is requested based on the target data, requests the target data based on RTMP agreement to destination server Stream.

In the embodiment of the present invention, the corresponding data flow of video that user wants viewing can be to be sent out by the destination server Cloth, further, association, which turns server, first to be requested according to the target data, determine the address of the destination server, then base In the address of the destination server, to destination server request target data flow, specifically, can wrap in target data request Video source number is included, video source number is used to indicate destination server, and correspondingly, association turns the available number of targets of server According to the video source number in request, corresponded to server corresponding with video source number is searched in table in preset numbered address Location, and the corresponding server address is determined as to the address of destination server.

Step 503 receives the target data stream that the destination server is sent.

In the embodiment of the present invention, association turns server to after destination server request target data flow, and destination server can Target data stream is sent with Xiang Xiezhuan server, correspondingly, association, which turns server, can receive the number of targets of destination server transmission According to stream.

The target data stream is converted to the target based on view networking protocol and regards networking data stream by step 504, and by institute It states target and is sent to the view networked server depending on networking data stream, network in order to which target described in the view networked server regards Data flow is sent to the view networked terminals.

In the embodiment of the present invention, the data flow of destination server is all based on the transmission of RTMP agreement.Due to its according to The transmission of RTMP agreement, therefore the data flow of the destination server can not be transmitted in depending on networking, and then cause user can not By watching the video based on RTMP agreement depending on networked terminals.In this step, association turns server for the target based on RTMP agreement Stream compression is changed to the target based on view networking protocol and regards networking data stream, and such target data stream can pass in depending on networking Defeated, correspondingly, association, which turns server, can be sent to view networked server depending on networking data stream for target, in order to regard the Internet services Target is sent to view networked terminals depending on networking data stream by device, so that user can be based on by watching depending on networked terminals The video of RTMP agreement.

In conclusion data request method provided in an embodiment of the present invention, association turns server and can receive view the Internet services Then the target data request that device is sent is requested based on target data, request the target based on RTMP agreement to destination server Data flow, finally, the target data stream received can be converted to the target based on view networking protocol regards networking data stream, by In the target depending on networking data stream be based on view networking protocol, therefore can view networking in transmit, correspondingly, association turn service After the target is sent to view networked server depending on networking data stream by device, the target can be regarded to networking number depending on networked server View networked terminals are sent to according to stream, so that user can be by watching the video based on RTMP agreement depending on networked terminals.

Referring to Fig. 6, the step flow chart of another data request method embodiment of the invention, this method application are shown In turning server depending on the association in networking, this method can specifically include following steps:

Step 601 receives the target data request that view networked server is sent.

Specifically, the implementation of this step is referred to above-mentioned steps 501, the embodiment of the present invention is not construed as limiting this.

Step 602 is requested based on the target data, is based on real-time messages transport protocol RTMP to destination server request Target data stream.

Specifically, this step can be realized by following sub-steps (1)~sub-step (4):

Sub-step (1): it is requested according to the target data, determines the address of the destination server.

Specifically, the address of the destination server can be the internet protocol address of destination server in this step, Specifically, can be after receiving the initial data requests that view networked terminals are sent, according to the initial number depending on networked server According to the video source number in request, corresponded to server corresponding with video source number is searched in table in preset numbered address Then location is inserted into the address as the address of destination server in initial data requests, obtain target data request, concurrently It gives association and turns server, correspondingly, association, which turns server, can directly request to extract the address of destination server from the target data, It certainly, can be after receiving the initial data requests that view networked terminals are sent, directly by primary data depending on networked server Request is requested as target data, and is sent to association and is turned server, and correspondingly, association, which turns server, first to be asked from the target data It asks middle acquisition video source to number, is corresponded to searching server corresponding with video source number in table in preset numbered address Location, and the corresponding server address is determined as to the address of destination server, the embodiment of the present invention is not construed as limiting this.

Wherein, the video source number in initial data requests can be user by regarding networked terminals to view networked server It is generated when sending initial data requests.It is exemplary, the menu for being directed to RTMP video source can be provided depending on networked terminals, it should It may include multiple options in menu, wherein the server of the corresponding offer RTMP data flow of each option, each offer The server of RTMP data flow can all correspond to a video source number.User can be by the option on selection menu, to trigger Sending initial data requests to view networked server depending on networked terminals correspondingly may include user in the initial data requests The corresponding video source number of the option of selection.

Sub-step (2): being based on the destination server address, and Xiang Suoshu destination server sends stream request to create.

In this step, which is used for destination server request data transfer stream, specifically, association turns server Stream request to create can be sent to the destination server, is spread with carrying out data using destination server address as destination address It is defeated, and then facilitate and receive target data stream in subsequent process.

Sub-step (3): the stream index number that the destination server returns is received and stored；The stream index number is for identifying The target data stream.

In practical application scene, association, which turns server, to be interacted simultaneously with multiple servers, may exist same When the case where receiving the data flow of multiple server transports, the problem of obscuring in order to avoid the data in data flow, this hair Destination server can be before Xiang Xiezhuan server sends target data stream in bright embodiment, and first Xiang Xiezhuan server returns to one Stream index number, so that association turns server and can accurately tell target data stream.Correspondingly, in this step, association turns server It can receive and store the stream index number.

Sub-step (4): the target data stream that the destination server is sent is received；It is every in the target data stream A data packet is identified using the stream index number.

In the embodiment of the present invention, after destination server can return to stream index number, Xiang Xiezhuan server sends target data Stream, correspondingly, association turn server after taking stream index number, so that it may the target data stream of destination server transmission is received, Wherein, each data packet in the target data stream is identified using the stream index number that destination server returns, in this way, association Turn server and pass through the stream index number that the data packet received uses, that is, can determine which data packet is to belong to target data stream , and then realize and accurately tell target data stream.

Video flowing and audio stream in step 603, the extraction target data stream.

Specifically, this step can be realized by following sub-steps (5)~sub-step (6):

Sub-step (5): the target data stream is extracted from received data packet based on the stream index number.

The data flow that multiple servers are sent may be received simultaneously since association turns server, association turns server and connects There may be the data packet that is sent by other servers in the data packet received, therefore, in this step, association turns server can be with Target data stream is extracted from received data packet based on stream index number, server is available to be used to identify specifically, association turns The data packet that matches of the stream index number that is returned with destination server of stream index number, and then obtain target data stream.

Sub-step (6): it according to the type of data packet each in the target data stream, extracts in the target data stream Video flowing and audio stream.

In practical application scene, the corresponding data flow of the video that user sees is often audio/video flow, that is, target data stream The audio/video flow being substantially made of video flowing and audio stream, correspondingly, in target data stream can comprising packets of audio data and Video data packet.Further, packets of audio data, which can carry, indicates that the type of the data packet is the mark of audio data, video counts Can carry according to packet indicates that the type of the data packet is the mark of video data, and therefore, in this step, association turns server can basis The mark of the identity type carried in data packet obtains in target data stream to obtain the data packet that type is video data Video flowing, and the data packet that type is audio data is obtained, obtain the audio stream in target data stream.

Step 604 is based on the video flowing and audio stream, obtains target video data packet and target audio data respectively Packet obtains the target view networking data stream.

Specifically, target regards networking data stream by target video data packet and target audio data packet group at this step can To be realized by following sub-steps (7)~sub-step (9):

Sub-step (7): being decoded the video flowing, obtains the original video data for including in the video flowing, with And the audio stream is decoded, obtain the original audio data in the audio stream.

Specifically, association turn server can be right based on the parameter for including in sequence parameter set SPS and picture parameter set PPS Video flowing is decoded, specifically, then the incoming default decoder of SPS and PPS can be based on these parameters using decoder Video flowing is decoded.Wherein, SPS and PPS, which can be destination server and be sent to assist in advance, turns server, to video When stream is decoded, the data in data packet each in video flowing in data volume can be parsed, and then obtain original video Data.Further, association, which turns server, can be decoded audio stream based on audio decoding techniques ACC, obtain original sound Frequency evidence.Wherein, when being decoded to audio stream, the data in data packet each in audio stream in data volume can be parsed Come, and then obtains original audio data.

In the embodiment of the present invention, by extracting target data stream for audio stream and video flowing, and by audio stream and Video flowing is respectively processed, and to obtain target view networking data stream, association is allowed to turn server simultaneously to audio stream and view Frequency stream carries out parallel processing, and then improves treatment effeciency.

Sub-step (8): being multiple video data block by the original video data cutting, and, by the original audio Data cutting is multiple audio data blocks.

Specifically, can first obtain every frame video counts in original video data when carrying out cutting to original video data According to Frame Properties, then, using Frame Properties be key frame frame video data as the first frame video data of video data block, go forward side by side Row cutting obtains multiple video data block, wherein the first frame video data of each video data block is key frame.Specifically, frame Attribute can one of for key frame, difference frame and two-way difference frame, specifically, association turn server can be to every frame video Data are parsed, and then determine whether the frame video data includes partial data needed for one frame image of display, if comprising, The Frame Properties for then determining the frame video data is key frame, correspondingly, can be using the frame video data as video data block First frame video data, that is, to be a cut-off progress cutting between the frame video data and former frame video data, in this way, The first frame video data that can make each video data block is key frame.In the embodiment of the present invention, by being to close by Frame Properties First frame video data of the frame video data of key frame as video data block, and carry out cutting, it is ensured that each video data The first frame video data of block is key frame, and then guarantees that subsequent process Union of Central Vision network termination is decoded with the video data block When broadcasting, normal play can be carried out based on the video data block.

Further, when carrying out cutting to original audio data, cutting can be carried out according to default size, for example, should Default size can be 1024 kilobytes, can be the audio number of multiple 1024 kbytes in size by the original audio data cutting According to block.

Sub-step (9): adding view networking packet header for each video data block, obtain target video data packet, and, it is every A audio data block addition view networking packet header, obtains target audio data packet.

In this step, this may include the contents such as MAC Address, the address VMS and protocol type depending on networking packet header.View connection The format of the content and each content that include in net packet header all meets view networking protocol.It is exemplary, it is assumed that have 100 Video data block obtains then can add view networking packet header respectively for each video data block in this 100 video data block To 100 target video data packets, further, it is assumed that have 70 audio data blocks, then can be this 70 audio datas Each audio data block in block adds view networking packet header respectively, obtains 70 target audio data packets.

The target is sent to the view networked server depending on networking data stream by step 605, in order to view networking The target is sent to the view networked terminals depending on networking data stream by server.

Specifically, can first continuously transmit M target video data packet in this step, then, M mesh is being continuously transmitted After marking video data packet, N number of target audio data packet is continuously transmitted, correspondingly, is continuously transmitting N number of target audio data packet Later, the step of continuously transmitting M target video data packet can be repeated.Wherein, M, N are the integer not less than 1, and M can To be greater than N.Exemplary, M can be that 3, N can be 2, and correspondingly, association, which turns server, can first continuously transmit 3 target video numbers According to packet, 2 target audio data packets are then continuously transmitted again, then, then continuously transmit 3 target video data packets, then, then 2 target audio data packets ... are continuously transmitted, until having sent all target audio data packet and target video data packet. In the embodiment of the present invention, since the data volume of target video data packet increases, pass through the transmission target video data packet of intermittent And target audio data packet, it can enable and receive target video data packet and target audio depending on networked terminals intermittent Data packet, and then convenient for being uniformly decoded broadcasting to target video data packet and target audio data packet depending on networked terminals, To guarantee the audio-video sound intermediate frequency and audio video synchronization that play out.

In conclusion data request method provided in an embodiment of the present invention, association turns server and can receive view the Internet services Then the target data request that device is sent is requested based on target data, request the target based on RTMP agreement to destination server Data flow is based on video flowing and audio stream, obtains respectively finally, the video flowing and audio stream in target data stream can be extracted Target video data packet and target audio data packet obtain target view networking data stream, in this way, by extracting target data stream For audio stream and video flowing, and by being respectively processed to audio stream and video flowing, to obtain target view networking data stream, make It must assist and turn server and parallel processing can be carried out to audio stream and video flowing simultaneously, and then improve treatment effeciency finally, can will Target is sent to the view networked server depending on networking data stream.Since the target is based on view networking protocol depending on networking data stream , therefore can be transmitted in depending on networking, correspondingly, association turns server and the target is sent to view networking clothes depending on networking data stream It is engaged in after device, the target can be sent to view networked terminals depending on networking data stream depending on networked server, so that user can By watching the video based on RTMP agreement depending on networked terminals.

It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented Necessary to example.

Referring to Fig. 7, a kind of block diagram for turning server for the association of request of data of the embodiment of the present invention is shown, specifically , which turns server 70 and may include:

First receiving module 701, the target data request sent for receiving view networked server；The target video is asked Seeking Truth regards what the initial data requests that networked server is sent based on view networked terminals generated；

Request module 702 is transmitted to destination server request based on real-time messages for being requested based on the target data The target data stream of agreement RTMP；

Second receiving module 703, the target data stream sent for receiving the destination server；

Conversion module 704 regards networking data for the target data stream to be converted to the target based on view networking protocol Stream, and is sent to the view networked server depending on networking data stream for the target, in order to which the view networked server is by institute It states target and is sent to the view networked terminals depending on networking data stream.

In conclusion a kind of association for request provided in an embodiment of the present invention turns server, association, which turns server, to be connect Then the target data request that rating networked server is sent is requested based on target data, be based on to destination server request The target data stream of RTMP agreement, finally, the target data stream received can be converted to the target based on view networking protocol Depending on networking data stream, since the target depending on networking data stream can be transmitted in depending on networking based on view networking protocol, Correspondingly, association turns after target view networking data stream is sent to and regards networked server by server, can be with depending on networked server The target is sent to view networked terminals depending on networking data stream, so that user can be based on by watching depending on networked terminals The video of RTMP agreement.

The conversion module, comprising:

Optionally, the request module, is used for:

Optionally, the extracting sub-module, is used for:

Optionally, the acquisition submodule, comprising:

Optionally, the conversion module, is used for:

Continuously transmit M target video data packet；

Optionally, the cutting unit, is used for:

In conclusion another association for request of data provided in an embodiment of the present invention turns server, association turns server It can receive the target data request that view networked server is sent then to request based on target data, be requested to destination server Based on the target data stream of RTMP agreement, finally, the video flowing and audio stream in target data stream can be extracted, it is based on video flowing And audio stream, target video data packet and target audio data packet are obtained respectively, target view networking data stream are obtained, in this way, logical It crosses and extracts target data stream for audio stream and video flowing, and by being respectively processed to audio stream and video flowing, to obtain Target regards networking data stream, allows association to turn server and carries out parallel processing to audio stream and video flowing simultaneously, and then improves Treatment effeciency is finally, can be sent to the view networked server depending on networking data stream for target.Since the target regards networking number According to stream be based on view networking protocol, therefore can view networking in transmit, correspondingly, association turn server by the target view networking Data flow is sent to after view networked server, the target can be sent to view networking depending on networking data stream depending on networked server Terminal, so that user can be by watching the video based on RTMP agreement depending on networked terminals.

For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.

The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium Calculation machine program, the computer program realize each process of above-mentioned data request method embodiment, and energy when being executed by processor Reach identical technical effect, to avoid repeating, which is not described herein again.Wherein, the computer readable storage medium, such as only Read memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc..All the embodiments in this specification are described in a progressive manner, each embodiment emphasis What is illustrated is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other.

It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.

The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.

These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.

Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.

Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, limited by sentence " including one ... " Element, it is not excluded that including identical being wanted in the process, method of the element, article or terminal device there is also other Element.

Server and computer readable storage medium are turned to a kind of data request method provided by the present invention, association above, It is described in detail, used herein a specific example illustrates the principle and implementation of the invention, the above reality The explanation for applying example is merely used to help understand method and its core concept of the invention；Meanwhile for the general technology of this field Personnel, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion this theory Bright book content should not be construed as limiting the invention.

Claims

1. a kind of data request method, which is characterized in that the method is applied to turn server, the method depending on the association in networking Include:

Receive the target data request that view networked server is sent；The target video request is that view networked server is based on view connection What the initial data requests that network termination is sent generated；

It is requested based on the target data, requests the target data based on real-time messages transport protocol RTMP to destination server Stream；

Receive the target data stream that the destination server is sent；

The target data stream is converted into the target based on view networking protocol and regards networking data stream, and the target is regarded and is networked Data flow is sent to the view networked server, in order to which the view networked server sends target view networking data stream To the view networked terminals.

2. the method according to claim 1, wherein the target includes target video data depending on networking data stream Packet and target audio data packet；

Extract the video flowing and audio stream in the target data stream；

Based on the video flowing and audio stream, target video data packet and target audio data packet are obtained respectively, obtains the mesh Mark view networking data stream.

3. according to the method described in claim 2, it is characterized in that, described requested based on the target data, to destination service Device requests the target data stream based on real-time messages transport protocol RTMP, comprising:

Receive and store the stream index number that the destination server returns；The stream index number is for identifying the target data Stream；

Receive the target data stream that the destination server is sent；Each data packet in the target data stream uses The stream index number is identified.

4. according to the method described in claim 3, it is characterized in that, the video flowing and sound extracted in the target data stream Frequency flows, comprising:

According to the type of data packet each in the target data stream, the video flowing and audio in the target data stream are extracted Stream.

5. according to the method described in claim 2, it is characterized in that, it is described be based on the video flowing and audio stream, obtain respectively Target video data packet and target audio data packet, comprising:

The video flowing is decoded, obtains the original video data for including in the video flowing, and to the audio stream It is decoded, obtains the original audio data in the audio stream；

It is multiple video data block by the original video data cutting, and, it is multiple by the original audio data cutting Audio data block；

View networking packet header is added for each video data block, obtains target video data packet, and, add for each audio data block Add view networking packet header, obtains target audio data packet.

6. according to the method described in claim 2, it is characterized in that, it is described the target is sent to depending on networking data stream it is described Depending on networked server, comprising:

Continuously transmit M target video data packet；

After continuously transmitting N number of target audio data packet, the step of M target video data packet is continuously transmitted described in repetition Suddenly；Described M, N are the integer not less than 1.

7. according to the method described in claim 5, it is characterized in that, it is described by the original video data cutting be multiple videos Data block, comprising:

Using the frame video data that Frame Properties is key frame as the first frame video data of the video data block, and cutting is carried out, Obtain multiple video data block；The first frame video data of each video data block is key frame.

8. a kind of association for request of data turns server, which is characterized in that the association turns server application in view networking, institute It states association and turns server and include:

First receiving module, the target data request sent for receiving view networked server；The target video request is view Networked server is generated based on the initial data requests that view networked terminals are sent；

Request module is based on real-time messages transport protocol to destination server request for requesting based on the target data The target data stream of RTMP；

Conversion module regards networking data stream for the target data stream to be converted to the target based on view networking protocol, and will The target is sent to the view networked server depending on networking data stream, regards the target depending on networked server in order to described Networking data stream is sent to the view networked terminals.

9. association according to claim 8 turns server, which is characterized in that the target includes target view depending on networking data stream Frequency data packet and target audio data packet；

The conversion module, comprising:

Acquisition submodule obtains target video data packet and target sound frequency for being based on the video flowing and audio stream respectively According to packet, the target view networking data stream is obtained.

10. association according to claim 9 turns server, which is characterized in that the request module is used for:

11. association according to claim 10 turns server, which is characterized in that the extracting sub-module is used for:

12. association according to claim 9 turns server, which is characterized in that the acquisition submodule, comprising:

Decoding unit obtains the original video data for including in the video flowing for being decoded to the video flowing, and The audio stream is decoded, the original audio data in the audio stream is obtained；

Cutting unit is used to the original video data cutting be multiple video data block, and, by the original audio number It is multiple audio data blocks according to cutting；

Adding unit regards networking packet header for adding for each video data block, obtains target video data packet, and, it is every A audio data block addition view networking packet header, obtains target audio data packet.

13. association according to claim 9 turns server, which is characterized in that the conversion module is used for:

Continuously transmit M target video data packet；

14. association according to claim 12 turns server, which is characterized in that the cutting unit is used for:

15. a kind of computer readable storage medium, which is characterized in that store computer journey on the computer readable storage medium Sequence, the data request method as described in any one of claims 1 to 7 is realized when the computer program is executed by processor Step.