CN110401682A - A kind of data push method and device - Google Patents
A kind of data push method and device Download PDFInfo
- Publication number
- CN110401682A CN110401682A CN201810372804.2A CN201810372804A CN110401682A CN 110401682 A CN110401682 A CN 110401682A CN 201810372804 A CN201810372804 A CN 201810372804A CN 110401682 A CN110401682 A CN 110401682A
- Authority
- CN
- China
- Prior art keywords
- gateway
- cascade
- http
- storage gateway
- cascade storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Abstract
The embodiment of the invention provides a kind of data push method and devices, wherein the method be applied to view networking in, comprising: view networking Content Management Platform receive upload to propelling data；Determine the gateway information of each cascade storage gateway；Multiple idle threads are called, the gateway information for being based respectively on each cascade storage gateway is established HTTP with each cascade storage gateway and connect；It is connect respectively according to the HTTP established with each cascade storage gateway, sends HTTP request to each cascade storage gateway parallel；Wherein, it is carried in the HTTP request described to propelling data.Data push method provided by the invention stores gateway to each cascade parallel by multiple HTTP connections and sends the efficiency for being able to ascend data flow to propelling data stream and pushing.
Description
Technical field
The present invention relates to view networking technology fields, more particularly to a kind of data push method and device.
Background technique
Each storage gateway cascade in Content Management Platform and network in network.Content Management Platform is mainly to storage
Gateway carries out the management and distribution of upgraded version, and carries out effectively unified management to video resource in each storage gateway.
In the prior art, when to storage gateway propelling data stream, FTP (File Transfer Protocol, text are used
Part transport protocol) carry out between storage gateway file transmission, to realize the interaction of file between web application server.This kind
Mode needs to dispose new ftp server in web application server, and recipient there is also with existing file body system
The problem of one management.
As it can be seen that there is an urgent need to those skilled in the art to provide one kind convenient, high efficiency between web application server at present
The scheme of ground progress file interaction.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
A kind of data push method and device to solve the above problems.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of data push methods, wherein the method application
In view networking in, comprising: view networking Content Management Platform receive upload to propelling data；Determine the net of each cascade storage gateway
Close information；Multiple idle threads are called, the gateway information and each cascade storage gateway of each cascade storage gateway are based respectively on
Establish HTTP connection；It connect according to the HTTP established with each cascade storage gateway, is stored parallel to each cascade respectively
Gateway sends HTTP request；Wherein, it is carried in the HTTP request described to propelling data.
Preferably, described to call multiple idle threads, be based respectively on the gateway information of each cascade storage gateway with it is each described
The step of cascade storage gateway establishes HTTP connection, comprising: inquiry is identical as identified cascade storage gateway from thread pool
The idle thread of quantity；Gateway, which is stored, for each cascade distributes an idle thread；Gateway is stored for each cascade, foundation is
The idle thread of the cascade storage gateway distribution, establishes and connect with the HTTP of the cascade storage gateway.
Preferably, the gateway information includes: Internet protocol address and port；It is described to store net for each cascade
It closes, according to the idle thread for being the cascade storage gateway distribution, establishes the step connecting with the HTTP of the cascade storage gateway
Suddenly, comprising: store gateway for each cascade, the Internet protocol address according to the cascade storage gateway searches the cascade
Store gateway；HTTP is established with the port of the cascade storage gateway to connect.
Preferably, the step of HTTP is connect is established in the port with the cascade storage gateway, comprising: Xiang Suoshu
The port of cascade storage gateway sends HTTP connection request, wherein proof of identity code is carried in the connection request；When
After receiving the port return proof of identity successful information, determine that being successfully established HTTP with the port connect；When receiving
After the port returns to proof of identity failure information, determine that failure is established in HTTP connection.
Preferably, it connect according to the HTTP established with each cascade storage gateway, is deposited parallel to each cascade respectively
Store up the step of gateway sends HTTP request, comprising: store gateway for each cascade, be arranged to cascade storage gateway and send
HTTP request request header；The request body of the HTTP request sent to the cascade storage gateway will be added to propelling data
In；It is connect by the HTTP established with the cascade storage gateway, sends the institute after being provided with to the cascade storage gateway
State HTTP request.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of data-pushing devices, wherein described device application
In view networking in, comprising: receiving module, for receives upload to propelling data；Determining module, for determining each cascade storage
The gateway information of gateway；Connection establishment module is based respectively on the gateway of each cascade storage gateway for calling multiple idle threads
Information is established HTTP with each cascade storage gateway and is connect；Sending module, for storing net according to each cascade respectively
The HTTP connection established is closed, sends HTTP request to each cascade storage gateway parallel；Wherein, it is carried in the HTTP request
Have described to propelling data.
Preferably, the connection establishment module includes: inquiry submodule, for the inquiry from thread pool and identified grade
The idle thread of the identical quantity of connection storage gateway；Distribution sub module distributes an idle line for storing gateway for each cascade
Journey；Setting up submodule, for storing gateway for each cascade, foundation is the idle thread of the cascade storage gateway distribution,
It establishes and is connect with the HTTP of the cascade storage gateway.
Preferably, the gateway information includes: Internet protocol address and port；The setting up submodule includes: to search
Unit, for storing gateway for each cascade, the Internet protocol address according to the cascade storage gateway searches the grade
Connection storage gateway；Port junction unit is connect for establishing HTTP with the port of the cascade storage gateway.
Preferably, the port junction unit is specifically used for: sending HTTP to the port of the cascade storage gateway
Connection request, wherein proof of identity code is carried in the connection request；Proof of identity success is returned when receiving the port
After information, determine that being successfully established HTTP with the port connect；After receiving the port return proof of identity failure information,
Determine that failure is established in HTTP connection.
Preferably, the sending module includes: request header setting submodule, for storing gateway for each cascade, if
Set the request header of the HTTP request sent to the cascade storage gateway；Body is requested to add submodule, being used for will be to propelling data
It is added into the request body for the HTTP request that the cascade storage gateway is sent；Request-to-send submodule, for by with institute
The HTTP connection that cascade storage gateway is established is stated, sends the HTTP request after being provided with to the cascade storage gateway.
Data-pushing scheme provided in an embodiment of the present invention stores gateway with each cascade respectively depending on networking Content Management Platform
HTTP connection is established, gateway is stored to each cascade parallel by multiple HTTP connections and sends to propelling data stream, be able to ascend number
According to the efficiency of stream push.Further, since storage gateway by existing upload interface data ready to receive, further will be wait push
In data sharing to web application server, without carrying out deployment variation to web application server, a large amount of people can be saved
Power resource.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of the invention；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；
Fig. 5 is a kind of step flow chart of according to embodiments of the present invention one data push method；
Fig. 6 is a kind of step flow chart of according to embodiments of the present invention two data push method；
Fig. 7 is a kind of structural block diagram of according to embodiments of the present invention three data-pushing device.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology
Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type
The seamless connection of road and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or
National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions
It is less than to send caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operation such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded:
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
| DA | SA | Reserved | Payload | CRC |
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic of view networking, the data-pushing side of the embodiment of the present invention being applied in view networking is proposed
Method.
Embodiment one
Referring to Fig. 5, a kind of step flow chart of data push method of the embodiment of the present invention one is shown, this method can be with
Applied in view networking, it can specifically include following steps:
Step 501: view networking Content Management Platform receive upload to propelling data.
It is the important milestone of network Development depending on networking, is the more advanced form of internet, is a real-time network, it can
It realizes the whole network HD video real-time Transmission that current internet cannot achieve, pushes numerous Internet applications to HD video,
High definition is face-to-face.It will finally realize that the world without distance, realizes that the distance of person to person in global range is the distance of a screen.
Depending on networking Content Management Platform primarily to view network storage gateway carry out a upgraded version management and
Video resource carries out an effectively unified management in distribution, and each view networking storage gateway.
It is that some very important multimedia content are accurately recorded depending on networking storage gateway, generates Streaming Media lattice
Formula file carries out data input and storage management, supports to storage resource on-demand playback.Realize the reproduction of important video and audio process
Optimization with resource is shared, enables various types of multimedia resources flexible Application on network.Meanwhile there is third depending on networking
Square file material uploads the function of management.Cascade storage gateway: Content Management Platform passes through the storage gateway of configuration management.
Multiple storage gateways are cascaded depending on networking Content Management Platform, each storage gateway connects a Web server, that is, net
Page server.Management service has at least one software on Web server.When software release upgrade, the upgrading of user's upload version
File specifically provides the upload interface of third party's material depending on networking Content Management Platform, uses to view networking Content Management Platform
Family passes through the interface to view networking Content Management Platform upload version upgrade file.It will be received depending on networking Content Management Platform
Edition upgrading file is used as to propelling data, is pushed to each cascade storage gateway.
Step 502: determining the gateway information of each cascade storage gateway.
Database is inquired depending on networking Content Management Platform, gets the storage information of all cascade storage gateways.Wherein, net
Closing information may include: Internet protocol address i.e. IP and port i.e. Port.
Step 503: calling multiple idle threads, the gateway information and each cascade for being based respectively on each cascade storage gateway store
Gateway establishes HTTP connection.
Start thread and execute push task, thread transfers to thread pool management.Per thread is built with a cascade storage gateway
Vertical HTTP connection.
Step 504: being connect respectively according to the HTTP established with each cascade storage gateway, parallel to each cascade storage gateway hair
Send HTTP request.
Wherein, it carries in HTTP request to propelling data.After propelling data is sent completely, release HTTP request connection
Resource, the occupied thread of HTTP request, which will be released, at this time becomes idle thread.
Depending on networking Content Management Platform by cascade storage gateway, cascade storage gateway service will be pushed to propelling data
Device, that is, Web server, at this point, then on achievable each Web server data it is shared, update.
Data push method provided in an embodiment of the present invention stores gateway with each cascade respectively depending on networking Content Management Platform
HTTP connection is established, gateway is stored to each cascade parallel by multiple HTTP connections and sends to propelling data stream, be able to ascend number
According to the efficiency of stream push.Further, since storage gateway by existing upload interface data ready to receive, further will be wait push
In data sharing to web application server, without carrying out deployment variation to web application server, a large amount of people can be saved
Power resource.
Embodiment two
Referring to Fig. 6, a kind of step flow chart of data push method of the embodiment of the present invention two is shown, this method can be with
Applied in view networking, it can specifically include following steps:
Step 601: view networking Content Management Platform receive upload to propelling data.
Third party's material is provided depending on networking Content Management Platform and uploads interface, and user can be networked by the upload interface to view
Content Management Platform is uploaded to propelling data.It wherein, can be update version document or multimedia resource etc. to propelling data.
Depending on the POST request mode propelling data of networking Content Management Platform simulation HTTP, it is advantageous that view networking and its WEB application
The framework of system, depending on networking Content Management Platform, there are the file management systems of oneself, and provide the upper of third party's material
Pass interface, make propelling data stream in this way, improve the reusability of code, at the same recipient file can be also included in it is existing
File management system.
Step 602: determining the gateway information of each cascade storage gateway.
Gateway information includes: Internet protocol address and port
By the gateway information of cascade storage gateway, cascade storage gateway and cascade storage gateway can be precisely determined
Can connectivity port, can establish HTTP with cascade storage gateway by the port and connect.
Step 603: the idle thread of quantity identical as identified cascade storage gateway is inquired from thread pool.
Management has multiple threads in thread pool, and part thread may be occupied, and part thread may be unoccupied, not by
The thread of occupancy is then idle thread.Multiple idle threads are inquired in the embodiment of the present invention.
Step 604: storing gateway for each cascade and distribute an idle thread.
Step 605: for each cascade store gateway, according to for cascade storage gateway distribution idle thread, establish and
The HTTP connection of cascade storage gateway.
When establishing HTTP with cascade gateway during specific implementation and connect, for each cascade storage gateway, foundation grade
The Internet protocol address of connection storage gateway searches cascade storage gateway；HTTP is established with the port of cascade storage gateway to connect
It connects.
When establishing HTTP with the port of cascade storage gateway depending on networking Content Management Platform and connect, firstly, to storage is cascaded
The port of gateway sends HTTP connection request；
Wherein, proof of identity code is carried in connection request；Cascade storage gateway is by proof of identity code in view networking
The identity for holding management platform is verified, and returns to correspondingly verification result.
Secondly, determining that being successfully established HTTP with port connect after receiving port return proof of identity successful information；When
After receiving port return proof of identity failure information, determine that failure is established in HTTP connection.
When determining that failure is established in HTTP connection, thread resources are discharged.
After establishing HTTP request with each cascade storage gateway, stored respectively according to each cascade depending on networking Content Management Platform
The HTTP connection that gateway is established, sends HTTP request to each storage gateway parallel, and the specific process for sending HTTP request is as follows
It is described.Step 606 to step 608 is the process sent to a cascade storage gateway to propelling data, in specific implementation process
In, it is sent parallel to each cascade storage gateway to propelling data depending on networking Content Management Platform.Gateway is stored to each cascade parallel
It sends to propelling data, is able to ascend data-pushing efficiency.
Step 606: storing gateway for each cascade, the request of the HTTP request sent to cascade storage gateway is set
Head.
The setting of progress HTTP request head includes the setting to fields such as form data type, time-out, piecemeal, cachings, also
Including obtaining input, output stream.Output stream for the description information to propelling data be written, to propelling data and relevant interior
Hold the information such as description, line of demarcation.Inlet flow is used to obtain the response of cascade storage gateway.Step 607: will be added to propelling data
Into the request body of the HTTP request sent to cascade storage gateway.
Content Management Platform splice POST request body, by output stream push to propelling data to the related of propelling data
Information stores gateway to cascade, to be pushed to the Web server of cascade storage gateway by cascade storage gateway.
Step 608: being connect by storing the HTTP that gateway is established with the cascade, set up to cascade storage gateway transmission
HTTP request after.
After the completion of propelling data push, input, output stream are closed, discharges HTTP connection resource, thread becomes after being released
For idle thread.
Data push method provided in an embodiment of the present invention stores gateway with each cascade respectively depending on networking Content Management Platform
HTTP connection is established, gateway is stored to each cascade parallel by multiple HTTP connections and sends to propelling data stream, be able to ascend number
According to the efficiency of stream push.Further, since storage gateway by existing upload interface data ready to receive, further will be wait push
In data sharing to web application server, without carrying out deployment variation to web application server, a large amount of people can be saved
Power resource.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Embodiment three
Referring to Fig. 7, a kind of structural block diagram of data-pushing device of the invention is shown, which can be applied to view connection
In net, following module can specifically include:
Receiving module 701, for receive upload to propelling data；Determining module 702, for determining each cascade storage net
The gateway information of pass；Connection establishment module 703 is based respectively on the net of each cascade storage gateway for calling multiple idle threads
Pass information is established HTTP with each cascade storage gateway and is connect；Sending module 704, for being deposited respectively according to each cascade
The HTTP connection that gateway is established is stored up, sends HTTP request to each cascade storage gateway parallel；Wherein, in the HTTP request
It carries described to propelling data.
Preferably, the connection establishment module 703 may include: inquiry submodule 7031, for inquiring from thread pool
The idle thread of quantity identical as identified cascade storage gateway；Distribution sub module 7032, for storing net for each cascade
Close one idle thread of distribution；Setting up submodule 7033 is stored for storing gateway for each cascade according to for the cascade
The idle thread of gateway distribution is established and is connect with the HTTP of the cascade storage gateway.
Preferably, the gateway information includes: Internet protocol address and port；The setting up submodule 7033 can wrap
Include: searching unit, for storing gateway for each cascade, the Internet protocol address according to the cascade storage gateway is searched
The cascade stores gateway；Port junction unit is connect for establishing HTTP with the port of the cascade storage gateway.
Preferably, the port junction unit is specifically used for: sending HTTP to the port of the cascade storage gateway
Connection request, wherein proof of identity code is carried in the connection request；Proof of identity success is returned when receiving the port
After information, determine that being successfully established HTTP with the port connect；After receiving the port return proof of identity failure information,
Determine that failure is established in HTTP connection.
Preferably, the sending module 704 may include: request header setting submodule 7041, for being directed to each cascade
Gateway is stored, the request header of the HTTP request sent to the cascade storage gateway is set；It requests body to add submodule 7042, uses
In the request body that will be added to the HTTP request sent to the cascade storage gateway to propelling data；Request-to-send submodule
7043, it connect for the HTTP by being established with the cascade storage gateway, is provided with to cascade storage gateway transmission
The HTTP request afterwards.
Data-pushing device provided in an embodiment of the present invention stores gateway with each cascade respectively depending on networking Content Management Platform
HTTP connection is established, gateway is stored to each cascade parallel by multiple HTTP connections and sends to propelling data stream, be able to ascend number
According to the efficiency of stream push.Further, since storage gateway by existing upload interface data ready to receive, further will be wait push
In data sharing to web application server, without carrying out deployment variation to web application server, a large amount of people can be saved
Power resource.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Method for pushing and device are pushed away to a kind of data provided by the present invention above, is described in detail, answers herein
With a specific example illustrates the principle and implementation of the invention, the explanation of above example is only intended to help to manage
Solve method and its core concept of the invention；At the same time, for those skilled in the art, according to the thought of the present invention, In
There will be changes in specific embodiment and application range, in conclusion the content of the present specification should not be construed as to this hair
Bright limitation.
Claims (10)
1. a kind of data push method, which is characterized in that the method is applied in view networking, comprising:
Depending on networking Content Management Platform reception upload to propelling data；
Determine the gateway information of each cascade storage gateway；
Multiple idle threads are called, the gateway information and each cascade storage gateway for being based respectively on each cascade storage gateway are established
HTTP connection；
It connect according to the HTTP established with each cascade storage gateway, is sent parallel to each cascade storage gateway respectively
HTTP request；Wherein, it is carried in the HTTP request described to propelling data.
2. being based respectively on each cascade the method according to claim 1, wherein described call multiple idle threads
The gateway information for storing gateway establishes the step of HTTP is connect with each cascade storage gateway, comprising:
The idle thread of quantity identical as identified cascade storage gateway is inquired from thread pool；
Gateway, which is stored, for each cascade distributes an idle thread；
Gateway is stored for each cascade, according to the idle thread for being the cascade storage gateway distribution, is established and the cascade
Store the HTTP connection of gateway.
3. according to the method described in claim 2, it is characterized in that, the gateway information includes: Internet protocol address and end
Mouthful；It is described to store gateway for each cascade, according to the idle thread for being the cascade storage gateway distribution, establish and the grade
The step of HTTP connection of connection storage gateway, comprising:
Gateway is stored for each cascade, the Internet protocol address according to the cascade storage gateway searches the cascade storage
Gateway；
HTTP is established with the port of the cascade storage gateway to connect.
4. according to the method described in claim 3, it is characterized in that, the port with the cascade storage gateway is established
The step of HTTP connection, comprising:
HTTP connection request is sent to the port of the cascade storage gateway, wherein carries body in the connection request
Part check code；
After receiving the port return proof of identity successful information, determine that being successfully established HTTP with the port connect；
After receiving the port return proof of identity failure information, determine that failure is established in HTTP connection.
5. the method according to claim 1, wherein storing what gateway was established according to each cascade respectively
HTTP connection stores the step of gateway sends HTTP request to each cascade parallel, comprising:
Gateway is stored for each cascade, the request header of the HTTP request sent to the cascade storage gateway is set；
It will be added to propelling data into the request body for the HTTP request that the cascade storage gateway is sent；
It is connect by the HTTP established with the cascade storage gateway, sends the institute after being provided with to the cascade storage gateway
State HTTP request.
6. a kind of data-pushing device, which is characterized in that described device is applied in view networking, comprising:
Receiving module, for receive upload to propelling data；
Determining module, for determining the gateway information of each cascade storage gateway；
Connection establishment module is based respectively on each gateway information for cascading storage gateway and each institute for calling multiple idle threads
It states cascade storage gateway and establishes HTTP connection；
Sending module, for being connect respectively according to the HTTP established with each cascade storage gateway, parallel to each cascade
It stores gateway and sends HTTP request；Wherein, it is carried in the HTTP request described to propelling data.
7. device according to claim 6, which is characterized in that the connection establishment module includes:
Submodule is inquired, for inquiring the idle thread of quantity identical as identified cascade storage gateway from thread pool；
Distribution sub module distributes an idle thread for storing gateway for each cascade；
Setting up submodule, for storing gateway for each cascade, foundation is the idle thread of the cascade storage gateway distribution,
It establishes and is connect with the HTTP of the cascade storage gateway.
8. device according to claim 7, which is characterized in that the gateway information includes: Internet protocol address and end
Mouthful；The setting up submodule includes:
Searching unit, for storing gateway for each cascade, the Internet protocol address according to the cascade storage gateway is looked into
Look for the cascade storage gateway；
Port junction unit is connect for establishing HTTP with the port of the cascade storage gateway.
9. device according to claim 8, which is characterized in that the port junction unit is specifically used for:
HTTP connection request is sent to the port of the cascade storage gateway, wherein carries body in the connection request
Part check code；
After receiving the port return proof of identity successful information, determine that being successfully established HTTP with the port connect；
After receiving the port return proof of identity failure information, determine that failure is established in HTTP connection.
10. device according to claim 6, which is characterized in that the sending module includes:
Submodule is arranged in request header, for storing gateway for each cascade, is arranged to described and cascades what storage gateway was sent
The request header of HTTP request；
Body is requested to add submodule, for the HTTP request sent to the cascade storage gateway will to be added to propelling data
It requests in body；
Request-to-send submodule stores net to the cascade for connecting by the HTTP established with the cascade storage gateway
Close the HTTP request sent after being provided with.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810372804.2A CN110401682B (en) | 2018-04-24 | 2018-04-24 | Data pushing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810372804.2A CN110401682B (en) | 2018-04-24 | 2018-04-24 | Data pushing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110401682A true CN110401682A (en) | 2019-11-01 |
| CN110401682B CN110401682B (en) | 2022-03-29 |
Family
ID=68320263
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810372804.2A Active CN110401682B (en) | 2018-04-24 | 2018-04-24 | Data pushing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110401682B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1735015A (en) * | 2004-08-03 | 2006-02-15 | 中兴通讯股份有限公司 | Method for transmitting data to browser that JAVA realizes WEB server active initiation |
| CN102945175A (en) * | 2012-11-09 | 2013-02-27 | 杭州易和网络有限公司 | Terminal software online upgrading system and method based on cloud computing environment |
| US9092347B2 (en) * | 2011-04-04 | 2015-07-28 | International Business Machines Corporation | Allocating cache for use as a dedicated local storage |
| CN106470144A (en) * | 2015-08-14 | 2017-03-01 | 中兴通讯股份有限公司 | A kind of message treatment method and device |
| CN107885507A (en) * | 2016-09-29 | 2018-04-06 | 上海华测导航技术股份有限公司 | A kind of method for improving receiver firmware upgrade efficiency |
-
2018
- 2018-04-24 CN CN201810372804.2A patent/CN110401682B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1735015A (en) * | 2004-08-03 | 2006-02-15 | 中兴通讯股份有限公司 | Method for transmitting data to browser that JAVA realizes WEB server active initiation |
| US9092347B2 (en) * | 2011-04-04 | 2015-07-28 | International Business Machines Corporation | Allocating cache for use as a dedicated local storage |
| CN102945175A (en) * | 2012-11-09 | 2013-02-27 | 杭州易和网络有限公司 | Terminal software online upgrading system and method based on cloud computing environment |
| CN106470144A (en) * | 2015-08-14 | 2017-03-01 | 中兴通讯股份有限公司 | A kind of message treatment method and device |
| CN107885507A (en) * | 2016-09-29 | 2018-04-06 | 上海华测导航技术股份有限公司 | A kind of method for improving receiver firmware upgrade efficiency |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110401682B (en) | 2022-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108063672B (en) | A kind of management method and device of video conference terminal | |
| CN108881799B (en) | A kind of system and method carrying out view networked video meeting | |
| CN107979760A (en) | The inspection method and device of a kind of live video | |
| CN109474715A (en) | A kind of resource allocation method and device based on view networking | |
| CN108234178B (en) | A kind of method and apparatus being managed collectively menu file | |
| CN109617956A (en) | A kind of data processing method and device | |
| CN109889420A (en) | Method and device for business processing | |
| CN110475090A (en) | A kind of method and system of Conference control | |
| CN109889779A (en) | A kind for the treatment of method and apparatus of packet out-ordering | |
| CN108965226A (en) | A kind of data capture method and device based on view networking | |
| CN109743526A (en) | A kind of communication connection method for building up and system based on view networking | |
| CN109743550A (en) | A kind of method and apparatus of monitoring data tune stream | |
| CN108307212A (en) | A kind of file order method and device | |
| CN109284265A (en) | A kind of date storage method and system | |
| CN109743555A (en) | A kind of information processing method and system based on view networking | |
| CN109151061A (en) | A kind of date storage method and device | |
| CN109491783A (en) | A kind of acquisition methods and system of memory usage | |
| CN109151519A (en) | A kind of configuration distribution method and system based on view networking | |
| CN110505077A (en) | A kind of method and apparatus of upgrading | |
| CN109819133A (en) | A kind of photo acquisition methods and device based on view networking | |
| CN109743360A (en) | A kind of information processing method and device | |
| CN109698790A (en) | A kind of storage method and system regarding networking data | |
| CN109067895A (en) | A kind of method and apparatus remotely controlled | |
| CN109361891A (en) | Method of data synchronization and system in a kind of classification meeting | |
| CN110049069A (en) | A kind of data capture method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Applicant after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Address before: 100000 Beijing Dongcheng District Qinglong Hutong 1 Song Hua Building A1103-1113 Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |