CN106169963B - The access method and system of service page, proxy server - Google Patents
The access method and system of service page, proxy server Download PDFInfo
- Publication number
- CN106169963B CN106169963B CN201610835920.4A CN201610835920A CN106169963B CN 106169963 B CN106169963 B CN 106169963B CN 201610835920 A CN201610835920 A CN 201610835920A CN 106169963 B CN106169963 B CN 106169963B
- Authority
- CN
- China
- Prior art keywords
- cluster
- service page
- url
- hadoop
- mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
- H04L41/0253—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols using browsers or web-pages for accessing management information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The present invention provides the access method and system, proxy server of a kind of service page, which comprises the acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;According to the port-mark of the mark of the cluster carried in the acquisition request of Hadoop service page and service type, Hadoop service page is obtained from corresponding cluster;URL in Hadoop service page is rewritten as to be able to carry out the URL of outside access;The Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment.Technical solution of the present invention, user can obtain Hadoop service page by headend equipment and proxy server, compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, not needing user has certain technical foundation, configuration of the user to SSH Tunnel process is established is saved, the complexity of access Hadoop service page is greatly reduced.
Description
[technical field]
The present invention relates to the access methods and system of network access technology field more particularly to a kind of service page, agency
Server.
[background technique]
Since (the Amazon Web Services of Amazon Web service in 2009;AWS Elastic MapReduce) is issued
Since, the processing service of Hadoop big data is provided using cloud computing platform becomes trend, provides the cloud meter of similar service in the industry
Calculating product has the day of Baidu to calculate platform, the E-MapReduce service of Ali's cloud, Kingsoft cloud trustship Hadoop service etc..Hadoop
The clear superiority of big data processing service includes low cost, elasticity is expansible, safety is easy-to-use, and user can be in virtual private cloud
(Virtual Private Cloud;VPC starting and management cluster inside the virtual cloud end office (EO) domain) constituted, that is, at one
The cluster of oneself is managed in customized logic isolation network, all cluster server nodes are at LAN environment,
It avoids leaking on public network cruelly, public network IP only is arranged in the server node for having external request i.e. Master node, it is hidden to reduce safety
Suffer from.
The processing service of the big datas such as Hadoop has respective Hadoop service page, Hadoop in corresponding cluster internal
Service page is the state and log information that user grasps operation operation, to provide very easily entrance for user.With
The Hadoop service page in cluster inside family access VPC generallys use two following methods: one is log on to cluster
The shortcomings that inside is accessed by the browser Lynx of textual form, this access mode is to be unable to exhibiting pictures, and can operate
Property is also poor;The second way is the server node with the public network IP i.e. Master in user's local server and cluster
Secure Shell (Secure SHell is established between node;SSH) protocol tunnel (Tunnel), abbreviation SSH Tunnel;Then straight
Connect the acquisition Hadoop service page from cluster.Wherein establishing SSH Tunnel, specific step is as follows: (1) order line or
SSH Client is created to the SSH Tunnel of the Master node of cluster, and sets local unappropriated port as source
Mouthful;(2) browser needs SOCKS proxy management plug-in unit, according to browser type can choose FoxyProxy or
SwitchySharp;(3) modification plug-in card configuration is acted on behalf of using the SOCKS that the first step creates;(4) it opens browser and accesses Hadoop
Service page.And the second way has more obvious advantage relative to first way, using also more extensive.
But the prior art user establish SSH Tunnel access Hadoop service page by way of, it is desirable that use
Family has certain technical foundation, and the configuration for establishing SSH Tunnel process is extremely complex, causes to access Hadoop service page
The process in face is also extremely complex.
[summary of the invention]
The present invention provides a kind of access method of service page and systems, proxy server, for reducing Hadoop clothes
The complexity of business page access.
The present invention provides a kind of access method of service page, which comprises
The acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;The Hadoop service page
The mark of the cluster where the Hadoop service page to be accessed and the port-mark of service type are carried in acquisition request;
According to the mark of the cluster and the port-mark of the service type, from the corresponding cluster described in acquisition
Hadoop service page;
It is rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
The Hadoop service page after rewriteeing URL is sent to the client of the user by the headend equipment.
Still optionally further, in method as described above, the Hadoop service page for the user that receiving front-end equipment is sent
Acquisition request after, according to the cluster mark and the service type port-mark, from the corresponding cluster
Before obtaining the Hadoop service page, further includes:
It is limited according to the access of the cluster, the identity of the user is authenticated;And determine that the user identity is recognized
Card passes through.
Still optionally further, it in method as described above, is limited according to the access of the cluster, to the identity of the user
It is authenticated, is specifically included:
It is limited according to the access of the cluster, identity request is sent to the client of the user by the headend equipment
Information;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
Still optionally further, in method as described above, according to the mark of the cluster and the port of the service type
Mark, the Hadoop service page is obtained from the corresponding cluster, is specifically included:
According to the mark of the cluster, the address of the cluster is obtained from Cluster Database;
According to the port-mark of the address of the cluster and the service type, to described in the corresponding collection pocket transmission
The acquisition request of Hadoop service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into
The URL of row outside access, specifically includes:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server pair
Plus the port-mark of the mark of the cluster and the service type in the Path of outer domain name, the URL to be rewritten.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into
The URL of row outside access, specifically includes:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including obtaining URL weight to be rewritten in the Hadoop service page by the way of regular expression matching
URL expression formula after writing;
The position Host of the URL expression formula is written into, in the URL expression formula in the external domain name of proxy server
Plus the port-mark of the mark of the cluster and the service type in Path.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into
The URL of row outside access, specifically includes:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
By the Host of URL to be rewritten described in the label be rewritten as the external domain name of proxy server, it is described to
Plus the port-mark of the mark of the cluster and the service type in the Path of the URL of rewriting.
The present invention also provides a kind of proxy server, the proxy server includes:
Receiving module, the acquisition request of the Hadoop service page of the user for the transmission of receiving front-end equipment;It is described
The mark kimonos of the cluster where the Hadoop service page to be accessed is carried in the acquisition request of Hadoop service page
The port-mark of service type;
Module is obtained, for according to the mark of the cluster and the port-mark of the service type, from corresponding described
The Hadoop service page is obtained in cluster;
URL rewriting module, for being rewritten as the URL in the Hadoop service page to be able to carry out outside access
URL;
Sending module, described in after sending rewriting URL to the client of the user by the headend equipment
Hadoop service page.
Still optionally further, in proxy server as described above, further includes:
Authentication module authenticates the identity of the user for being limited according to the access of the cluster;And really
The fixed user identity authentication passes through.
Still optionally further, in proxy server as described above, the authentication module is specifically used for:
It is limited according to the access of the cluster, identity request is sent to the client of the user by the headend equipment
Information;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
Still optionally further, in proxy server as described above, the acquisition module is specifically used for:
According to the mark of the cluster, the address of the cluster is obtained from the Cluster Database;
According to the port-mark of the address of the cluster and the service type, to described in the corresponding collection pocket transmission
The acquisition request of Hadoop service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server pair
Plus the port-mark of the mark of the cluster and the service type in the Path of outer domain name, the URL to be rewritten.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including obtaining URL weight to be rewritten in the Hadoop service page by the way of regular expression matching
URL expression formula after writing;
The position Host of the URL expression formula is written into, in the URL expression formula in the external domain name of proxy server
Plus the port-mark of the mark of the cluster and the service type in Path.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
By the Host of URL to be rewritten described in the label be rewritten as the external domain name of proxy server, it is described to
Plus the port-mark of the mark of the cluster and the service type in the Path of the URL of rewriting.
The present invention also provides a kind of access system of service page, the system comprises headend equipment and proxy server,
The headend equipment, the client communication with user are taken for receiving the user by the Hadoop that the client is sent
The acquisition request of the business page;The Hadoop service page to be accessed is carried in the acquisition request of the Hadoop service page
The mark of the cluster at place and the port-mark of service type;And the acquisition request of the Hadoop service page is solved
Analysis obtains the address of the proxy server inside website, and according to the address of the proxy server, by the Hadoop
The acquisition request of service page is forwarded to the proxy server;
The proxy server, and the corresponding cluster communication, according to the user's of headend equipment forwarding
The acquisition request of the Hadoop service page obtains the Hadoop service page, and in the Hadoop service page
URL be written over processing, and sent to the client of the user by the headend equipment rewrite URL after described in
Hadoop service page;The proxy server specifically uses proxy server as described above.
The access method and system of service page of the invention, proxy server, by by proxy server receiving front-end
The acquisition request of the Hadoop service page for the user that equipment is sent;According to what is carried in the acquisition request of Hadoop service page
The mark of cluster and the port-mark of service type obtain Hadoop service page from corresponding cluster;Hadoop is serviced
URL in the page is rewritten as being able to carry out the URL of outside access;It is sent by headend equipment to the client of user and rewrites URL
Hadoop service page afterwards.Using technical solution of the present invention, user can be obtained by headend equipment and proxy server
Hadoop service page, compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, no
It needs user to have certain technical foundation, saves configuration of the user to SSH Tunnel process is established, greatly reduce access
The complexity of Hadoop service page.And technical solution of the present invention, it is directly logged onto cluster internal with existing user,
It accesses Hadoop service page by the browser Lynx of textual form to compare, the Hadoop service page of user's access can be opened up
Diagram piece, and operability is also stronger.
[Detailed description of the invention]
Fig. 1 is the flow chart of the access method embodiment of service page of the invention.
Fig. 2 is the identity request page that a kind of proxy server provided in an embodiment of the present invention returns to user.
Hadoop service page after the rewriting URL that Fig. 3 shows for the client that the embodiment of the present invention provides a kind of user.
Fig. 4 is the structure chart of proxy server embodiment one of the invention.
Fig. 5 is the structure chart of proxy server embodiment two of the invention.
Fig. 6 is the structure chart of the access system embodiment of service page of the invention.
Fig. 7 is the exemplary diagram of the access system of service page of the invention.
[specific embodiment]
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments
The present invention is described in detail.
Fig. 1 is the flow chart of the access method embodiment of service page of the invention.As shown in Figure 1, the clothes of the present embodiment
The access method of the business page, can specifically include following steps:
100, the acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;
101, it is marked according to the port of the mark of the cluster carried in the acquisition request of Hadoop service page and service type
Know, Hadoop service page is obtained from corresponding cluster;
102, the URL in Hadoop service page is rewritten as being able to carry out the URL of outside access;
103, the Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment.
The executing subject of the access method of the service page of the present embodiment is proxy server.The agency service of the present embodiment
The front end (Front End) of website is arranged between equipment and group system in device.May include in the group system of the present embodiment
Multiple clusters (Cluster), the cluster in the present embodiment is specially Hadoop cluster.
Since the Hadoop service page of Hadoop cluster is the state and log information that user grasps operation operation, institute
It needs to access the Hadoop service page in actual operation with user.The access method of the service page of the present embodiment is used for
Hadoop service page is provided for user.For example, the Hadoop service page in the present embodiment is specifically as follows Yarn management page
Face or Hue administration page.
In the present embodiment, the acquisition request of the Hadoop service page for the user that headend equipment is sent is specifically as follows use
Family is sent to headend equipment by used client.It is taken in the acquisition request of Hadoop service page in the present embodiment
The mark of cluster where the band Hadoop service page to be accessed and the port-mark of service type;Such as the mark tool of cluster
Body can be general exclusive identification code (the Universally Unique Identifier of the cluster;UUID).Service type
Port-mark can be the port numbers of the service type.The acquisition request of the Hadoop service page of the present embodiment is specifically as follows
One obtains uniform resource locator (the Uniform Resoure Locator of the Hadoop service page;URL).It is following to use
The acquisition request of one Hadoop service page at family is following URL:
https://bmr.bce.baidu.com/476308c-5d5b-11e6-83c4-00e0ec261caa/8088/
cluster;
Wherein, bmr.bce.baidu.com is used for location proxy server, after headend equipment receives the request, solution
The URL is analysed, it, in this way can be by the Hadoop according to the IP address of the proxy server inside bmr.bce.baidu.com parsing
The acquisition request of service page is transmitted to proxy server, so that proxy server gets following URL sections therein:
f476308c-5d5b-11e6-83c4-00e0ec261caa/8088/Cluster。
Wherein 476308c-5d5b-11e6-83c4-00e0ec261caa is the UUID of cluster, and 8088 be service type
Port numbers;Cluster is the mark of cluster.
In the present embodiment, proxy server, which is equal to, to be arranged inside website, can be with any service in any one cluster
Device node is communicated, regardless of the server node is ordinary node or Master node.Therefore, in the present embodiment, agency
The mark for the cluster that server can also carry in the acquisition request according to Hadoop service page and the port mark of service type
Know, communicated with any server node in corresponding cluster, Hadoop service is obtained from the server node of cluster
The page.
Specifically, the step 101 of the present embodiment is " according to the mark of the cluster carried in the acquisition request of Hadoop service page
Know the port-mark with service type, Hadoop service page obtained from corresponding cluster ", it can specifically include following step
It is rapid:
(a1) according to the mark of cluster, the address of cluster is obtained from Cluster Database;
(a2) according to the port-mark of the address of cluster and service type, to corresponding collection pocket transmission Hadoop service page
Acquisition request;
(a3) the Hadoop service page that cluster is returned according to the acquisition request of the Hadoop service page is received.
In the present embodiment, company-data lab setting in the cluster, is stored with all of each cluster in the Cluster Database
Information, such as it is stored with the corresponding relationship of the mark of each cluster and the address of cluster, as the mark of cluster is specifically as follows
The address of the UUID of cluster, cluster are specifically as follows the IP address of cluster.Cluster is specifically can store in Cluster Database
UUID and cluster IP address between corresponding relationship.In this way, proxy server can be according to the UUID of cluster, from cluster number
According to the IP address for obtaining the cluster in library.Then according to the port-mark of the IP address of the cluster and service type, to corresponding
Server node in cluster sends the acquisition request of Hadoop service page.Server node in the cluster is according to this
The acquisition request of Hadoop service page obtains corresponding Hadoop service page, and returning to the proxy server should
Hadoop service page.
It is the Hadoop service page inside website since proxy server receives the Hadoop service page that cluster returns,
The URL of the Hadoop service page is specially internal address, due to the external user that user is the website, if directly will collection
The Hadoop service page that group returns is sent to user, and user also can not directly access the URL of the Hadoop service page.Cause
It needs for the URL in Hadoop service page to be rewritten as in this present embodiment to be able to carry out the URL of outside access;And pass through front end
Equipment sends the Hadoop service page after rewriteeing URL to the client of user.The finally obtained Hadoop service of user in this way
The page is only accessible significant service page.
The access method of the service page of the present embodiment passes through the user's that is sent by proxy server receiving front-end equipment
The acquisition request of Hadoop service page;According to the mark and service of the cluster carried in the acquisition request of Hadoop service page
The port-mark of type obtains Hadoop service page from corresponding cluster;URL in Hadoop service page is rewritten as
It is able to carry out the URL of outside access;The Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment
Face.Using the technical solution of the present embodiment, user can obtain Hadoop service page by headend equipment and proxy server,
Compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, do not need user have it is certain
Technical foundation saves configuration of the user to SSH Tunnel process is established, and greatly reduces access Hadoop service page
Complexity.And the technical solution of the present embodiment, it is directly logged onto cluster internal with existing user, passes through textual form
Browser Lynx access Hadoop service page is compared, and the Hadoop service page of user's access can be with exhibiting pictures, Er Qieke
Operability is also stronger.
Still optionally further, in " the Hadoop service for the user that receiving front-end equipment is sent of the step 100 of above-described embodiment
After the acquisition request of the page ", step 101 " according to the mark of the cluster carried in the acquisition request of Hadoop service page and
It can also include the following: basis before the port-mark of service type, from acquisition Hadoop service page in corresponding cluster "
The access of cluster limits, and authenticates to the identity of user;And determine that user identity authentication passes through.
Have public network access ability since Hadoop cluster internal has a server node, directly opens the server
The serve port user of node can access, but Hadoop primary service page, such as Yarn administration page, not mention
For user authentication function, if directly open, malicious user can steal user job information by modes such as IP exhaustions,
There can be very big security risk in this way, so in the prior art, the Hadoop service page of the Hadoop cluster inside VPC is logical
It often cannot directly be accessed by browser in user client, cluster internal can only be logged on to by user or is being locallyd create
The mode of SSH Tunnel accesses.In order to increase the safety of Hadoop service page, the technical solution of the present embodiment can be with
The access of cluster limits, and authenticates provided with the identity to user, to increase the safety of Hadoop service page.Such as generation
Reason server receive headend equipment transmission user Hadoop service page acquisition request after, proxy server to
During cluster requests corresponding Hadoop service page, it is found that the cluster is provided with access limitation, need to request
The identity of the user of Hadoop service page authenticates, and does not otherwise provide Hadoop service page, can only be when to the user's
Authentication passes through, and just can provide Hadoop service page to the user.User is in the username and password of cluster can be with
Cluster internal registration is directly logged in pass through before user.
Still optionally further, " being limited according to the access of cluster, to the identity of user in the technical solution of above-described embodiment
Authenticated ", it can specifically include following steps:
(b1) it is limited according to the access of cluster, identity request information is sent to the client of user by headend equipment;
(b2) username and password of user is received by headend equipment;
(b3) according to the mark of cluster, the subscriber identity information of cluster is obtained from Cluster Database;
(b4) user of user and password are authenticated according to the subscriber identity information of cluster.
Limitation is accessed when proxy server determines that the cluster has, identity is sent to the client of user by headend equipment
Solicited message;Such as return to user can be a webpage.For example, Fig. 2 is a kind of agency's clothes provided in an embodiment of the present invention
Business device returns to the identity request page of user.As shown in Fig. 2, the page shows that proxy server passes through headend equipment to user
The identity request information that sends of client, i.e. the input frame of username and password.User is used by inputting in the input frame
Then name in an account book and password are clicked and are determined, the username and password of user is just sent to proxy server by headend equipment.This
The Cluster Database of embodiment is used to store the subscriber identity information of each cluster, for example, each cluster all users user name
With corresponding password.
After proxy server receives the username and password of the user of headend equipment transmission, such as according to the mark of cluster
The UUID of cluster obtains the identity information of all users of the cluster from Cluster Database, then according to the cluster of acquisition
The identity information of all users verify the username and password of the user.Judge the identity information of all users of the cluster
In whether include the user name and corresponding password, if do not have in all subscriber identity informations of cluster the user name or should
The corresponding password of user name and the password that user inputs are inconsistent, then do not pass through to the subscriber authentication.Only when cluster
It include the user name in all subscriber identity informations, and the corresponding password of the user name is consistent with the password that user inputs,
The subscriber authentication is passed through.
It can be seen from the above, the proxy server of the present embodiment uses HTTPS+BA (Basic Authentication;Substantially
Authentication) mode guarantee only by certification and there is user's request of operating right can just be forwarded to pair cluster
The cluster answered, the username and password that the username and password of certification uses cluster server example to log in, services domain name and card
Book is configured in front end (FrontEnd;FE) in equipment.
Proxy server cannot be directly returned to user browser after obtaining Hadoop service page from purpose cluster,
It needs to parse Hadoop service page, will wherein all URL handle, so that treated Hadoop service page
In URL user be able to access that.Specifically, in the technical solution of above-described embodiment, step 102 " will be in Hadoop service page
URL be rewritten as being able to carry out the URL " of outside access, can specifically include following several situations:
The first situation, the Content-Type of Hadoop service page include JSON character string;Can specifically include as
Lower step:
(c1) judge whether the Content-Type of Hadoop service page includes JSON character string;If including executing step
Suddenly (c2);If not including, terminate;
(c2) whether judge in Hadoop service page including the URL to be rewritten in predefined list;If including executing
Step (c3);If not including, terminate;
(c3) by the Host of the URL to be rewritten of Hadoop service page be rewritten as the external domain name of proxy server, to
Plus the port-mark of the mark of cluster and service type in the Path of the URL of rewriting.
The principle that URL in Hadoop service page is rewritten, is that the Host of all URL will be replaced with proxy server
External domain name, will be plus the UUID of mark cluster and the port of service type in Path.It is as described in Table 1 a kind of heavy
Write example.
Table 1
As shown in table 1, the present embodiment, can be by http when doing the URL rewriting in Hadoop service page: //
8.8.8.8:8888/Cluster https can be replaced by: //bmr.bce.baidu.com/f476308c-5d5b-11e6-
83c4-00e0ec261caa/8888/Cluster;The browser of user terminal can continue the URL after access is rewritten in this way.Agency
Server will receive request, and find cluster address according to f476308c-5d5b-11e6-83c4-00e0ec261caa
8.8.8.8, then the destination server node of cluster is forwarded requests to.
Proxy server need to Hadoop service page parse obtain rewriting in need URL, according to the page
The difference of Content Type includes JSON character string in the present embodiment in different ways with page Content-Type
For.
Specifically, judge whether the Content-Type of Hadoop service page includes JSON character string;If including;For
The JSON page can be predefined to contain in a predefined list such as preDefinedList, this preDefinedList and be wanted
The prefix of the URL of rewriting, since proxy server is mainly the relevant service page of Hadoop acted on behalf of, so this
PreDefinedList can be enumerated, and so directly be written over the field string in preDefinedList list i.e.
Can, the principle specifically rewritten is that the Host of the URL to be rewritten of Hadoop service page is rewritten as to proxy server externally
Domain name, URL to be rewritten Path in plus cluster mark and service type port-mark.
Second situation, the Content-Type of Hadoop service page include JavaScript or CSS;It specifically can be with
Include the following steps:
(d1) judge whether the Content-Type of Hadoop service page includes JavaScript or CSS;If including,
It executes step (d2);If not including, terminate;
(d2) after obtaining the URL rewriting in Hadoop service page wait rewrite by the way of regular expression matching
URL expression formula;
(d3) by the position Host of the external domain name write-in URL expression formula of proxy server, in the Path of URL expression formula
In addition the mark of cluster and the port-mark of service type.
Unlike the first above-mentioned situation, in the second situation, with the Content- of Hadoop service page
Type is comprising for JavaScript or CSS.Specifically, judge Hadoop service page Content-Type whether include
JavaScript or CSS;If the URL in JavaScript type page is usually fixed including JavaScript or CSS
The code form of mode, the mode that regular expression matching can be used at this time are handled.Such as format " url s* (s*
(?: [" '] (? P<link>[^ " '] *) [" '] | (? P<link>S+)) " will be matched to code URL (" http: //
8.8.8.8:8888/Cluster "), and then available wherein URL to be rewritten;Then according to that proxy server is external
Domain name be written URL expression formula the position Host, in the Path of URL expression formula plus cluster mark and service type end
Mouth mark, is written over URL.That is the URL of each type is expressed to can be matched to a kind of regular expression
URL expression formula.Then according to this expression formula, URL wherein to be rewritten is rewritten according to the rewriting principle of URL.
Simultaneously in order to avoid all Hadoop service pages will carry out traversal processing to all regular expressions, in reality
Regular expression can be done according to the keyword of demand file and be classified on now, different files is only needed to be traversed in the page and can be used
The regular expression list arrived;
The third situation, the processing of html page;It can specifically include following steps:
(e1) judge whether Hadoop service page is html page;If so, executing step (e2);If not including, terminate;
(e2) obtain Hadoop service page in include URL to be rewritten label;
(e3) Host of the URL to be rewritten in label is rewritten as the external domain name of proxy server, URL to be rewritten
Path in plus cluster mark and service type port-mark.
If the Content Type in Hadoop service page contains the keyword in excludedList,
Keyword in excludedList has csv, image, stream, xml, xsl etc., and the page of these types does not have to process.
Except the other kinds of page all html page is used as to be handled, the meeting such as specific label, such as a, src in html page
Label comprising URL, in the present embodiment by all labels including URL all as URL that may be to be rewritten.List it is all can
It can include the label of URL, then parse the content of these labels in Hadoop service page, it will be to be rewritten in label
The Host of URL be rewritten as the external domain name of proxy server, URL to be rewritten Path in add cluster mark and service
The port-mark of type.There are also a kind of script element in html page, this element content can be with after getting
The JavaScript page is handled using same canonical processing mode, i.e., the processing of above-mentioned second situation.
It is rewritten as the URL in Hadoop service page to be able to carry out outside access using any one of the above mode
After URL, the Hadoop service page after rewriteeing URL can be sent to the client of user by headend equipment according to step 103
Face.Such as the Hadoop service page rewritten after URL that a kind of Fig. 3 client for providing user for the embodiment of the present invention is shown.
User can be directly according to the URL after the Hadoop service page access rewriting after rewriting URL in this way.
Fig. 4 is the structure chart of proxy server embodiment one of the invention.As shown in figure 4, the agency service of the present embodiment
Device can specifically include: receiving module 10 obtains module 11, URL rewriting module 12 and sending module 13.
The acquisition request of the Hadoop service page for the user that wherein receiving module 10 is sent for receiving front-end equipment;
The mark and service class of the cluster where the Hadoop service page to be accessed are carried in the acquisition request of Hadoop service page
The port-mark of type;Module 11 is obtained to be used for according to the collection in the acquisition request of the received Hadoop service page of receiving module 10
The mark of group and the port-mark of service type, obtain Hadoop service page from corresponding cluster;URL rewriting module 12 is used
URL in the Hadoop service page that will acquire the acquisition of module 11 is rewritten as being able to carry out the URL of outside access;Sending module
13 for sending the Hadoop service page after URL rewriting module 12 rewrites URL to the client of user by headend equipment.
The proxy server of the present embodiment, by using above-mentioned module realize service page access realization principle and
Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail,
Details are not described herein.
Fig. 5 is the structure chart of proxy server embodiment two of the invention.The proxy server of the present embodiment is in above-mentioned Fig. 4
It further can also include following technical solution on the basis of the technical solution of illustrated embodiment.As shown in figure 5, the present embodiment
Proxy server further include: authentication module 14.
Authentication module 14 is used to be limited according to the access of cluster, authenticates to the identity of user;And determine user
Authentication passes through.10 receiving front-end equipment of receiving module send user Hadoop service page acquisition request it
Afterwards, triggering authentication module 14 authenticates the identity of user.The identity of user can only be recognized when authentication module 14
After card passes through, it can just trigger and obtain in acquisition request of the module 11 according to the received Hadoop service page of receiving module 10
The mark of cluster and the port-mark of service type obtain Hadoop service page from corresponding cluster.
Still optionally further, in the proxy server of the present embodiment, 14 body of authentication module is used for:
It is limited according to the access of cluster, identity request information is sent to the client of user by headend equipment;
The username and password of user is received by headend equipment;
According to the mark of cluster, the subscriber identity information of cluster is obtained from Cluster Database;
The user of user and password are authenticated according to the subscriber identity information of cluster.
Still optionally further, it in the proxy server of the present embodiment, obtains module 11 and is specifically used for:
According to the mark of cluster, the address of cluster is obtained from Cluster Database;
According to the port-mark of the address of cluster and service type, to obtaining for corresponding collection pocket transmission Hadoop service page
Take request;
Receive the Hadoop service page that cluster is returned according to the acquisition request of Hadoop service page.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether the Content-Type of Hadoop service page includes JSON character string;
If including whether judging in Hadoop service page including the URL to be rewritten in predefined list;
If including, by the Host of the URL to be rewritten of Hadoop service page be rewritten as the external domain name of proxy server,
Plus the port-mark of the mark of cluster and service type in the Path of URL to be rewritten.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether the Content-Type of Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in Hadoop service page wait rewrite by the way of regular expression matching
URL expression formula;
It is added by the position Host of the external domain name write-in URL expression formula of proxy server, in the Path of URL expression formula
The mark of cluster and the port-mark of service type.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether Hadoop service page is html page;
If so, including the label of URL to be rewritten in acquisition Hadoop service page;
The Host of URL to be rewritten in label is rewritten as proxy server external domain name, URL to be rewritten
Plus the port-mark of the mark of cluster and service type in Path.
The proxy server of the present embodiment, by using above-mentioned module realize service page access realization principle and
Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail,
Details are not described herein.
Fig. 6 is the structure chart of the access system embodiment of service page of the invention.As shown in fig. 6, the clothes of the present embodiment
The access system of the business page, can specifically include: headend equipment 20 and proxy server 30.
The wherein client communication of headend equipment 20 and user is taken for receiving user by the Hadoop that client is sent
The acquisition request of the business page;The collection where the Hadoop service page to be accessed is carried in the acquisition request of Hadoop service page
The mark of group and the port-mark of service type;And the acquisition request of Hadoop service page is parsed, it obtains in website
The address of the proxy server 30 in portion, and according to the address of proxy server 30, the acquisition request of Hadoop service page is turned
It is sent to proxy server 30;
Proxy server 30 and corresponding cluster communication, according to the Hadoop service page for the user that headend equipment 20 forwards
Acquisition request, obtain Hadoop service page, and processing be written over to the URL in Hadoop service page, and before passing through
End equipment 20 sends the Hadoop service page after rewriteeing URL to the client of user;Specifically, the agency service of the present embodiment
Device 30 is specifically using the proxy server such as figure 4 above or embodiment illustrated in fig. 5.Also, the visit of the service page of the present embodiment
It asks system, the access of service page can be realized using above-mentioned related method embodiment, it in detail can be with reference to above-mentioned related implementation
The record of example, details are not described herein.
Fig. 7 is the exemplary diagram of the access system of service page of the invention.In the technical solution of above-mentioned embodiment illustrated in fig. 6
On the basis of, a kind of framework of service page access system is provided in the present embodiment, as shown in fig. 7, in the present embodiment, the framework
Multiple User can be supported simultaneously, such as in Fig. 7 for including User A31, User B32 and User C33, to include three
For a cluster Cluster A41, Cluster B42 and Cluster C43.Wherein User A31 accesses Cluster A41's
Service page, User B32 access the service page of the service page of Cluster B42, User C33 access Cluster C43.
According to the record of above-described embodiment, wherein the client communication of headend equipment FE equipment 50 and each User, receives the visitor of each User
The acquisition request for the Hadoop service page that family end is sent, and the Hadoop clothes after rewriteeing URL are sent to the client of each User
The business page.Proxy server is indicated using Proxy module 60 in the present embodiment.Proxy module 60 is located at headend equipment FE and sets
It, can be in multiple clusters of multiple users between standby 50 and cluster Cluster A41, Cluster B42 and Cluster C43
Service provide agency, user can directly by link by way of access Hadoop service page, after basic verification
The Hadoop service page of Hadoop cluster can be accessed.The proxy server Proxy module 60 of the present embodiment is responsible for real
The certification at current family, the rewriting of URL guarantee that request can reach proxy server, and how to support the same user not
Same cluster.
It should be noted that actually answered for including three User and three Cluster in the framework of the present embodiment
In, the quantity of User and the quantity of Cluster and with no restrictions.
It should be noted that if a user accesses multiple clusters, and being visited by the same browser in the present embodiment
When asking the identical service of different clusters, it may appear that the problem of session conflicts, user between cluster as long as switching over
Re-authentication is needed, because the service URL of the different clusters after processed has identical domain name, Cookie supports Path rank
Certification, conflict can be eliminated by the rewriting of Cookie Path.In the present embodiment, the access of service page shown in Fig. 7
The function of Proxy module 60 in system architecture is realized specifically can be with reference to above-mentioned Fig. 4 or the agency of embodiment illustrated in fig. 5 clothes
Business device.FE equipment 50 and Proxy module 60 in the access system architecture of service page shown in Fig. 7 constitute clothes shown in fig. 6
The access system of the business page, in detail can be with reference to the access system of the service page of above-mentioned embodiment illustrated in fig. 6.And shown in Fig. 7
Service page access system architecture in interact between each component and realize that the access of service page can refer to above-mentioned phase
The record of embodiment of the method is closed, details are not described herein.
In several embodiments provided by the present invention, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer
It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the present invention
The part steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. it is various
It can store the medium of program code.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.
Claims (15)
1. a kind of access method of service page, which is characterized in that the executing subject of the method is proxy server, the generation
Reason server is arranged between the headend equipment of website and group system, which comprises
The acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;The acquisition of the Hadoop service page
The mark of the cluster where the Hadoop service page to be accessed and the port-mark of service type are carried in request;
According to the mark of the cluster and the port-mark of the service type, from the corresponding cluster described in acquisition
Hadoop service page;
It is rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
The Hadoop service page after rewriteeing URL is sent to the client of the user by the headend equipment.
2. the method according to claim 1, wherein the Hadoop service page for the user that receiving front-end equipment is sent
After the acquisition request in face, according to the mark of the cluster and the port-mark of the service type, from the corresponding cluster
Before the middle acquisition Hadoop service page, the method also includes:
It is limited according to the access of the cluster, the identity of the user is authenticated;And determine that the user identity authentication is logical
It crosses.
3. according to the method described in claim 2, it is characterized in that, being limited according to the access of the cluster, to the user's
Identity is authenticated, and is specifically included:
It is limited according to the access of the cluster, identity request letter is sent to the client of the user by the headend equipment
Breath;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
4. the method according to claim 1, wherein according to the mark of the cluster and the end of the service type
Mouth mark, the Hadoop service page is obtained from the corresponding cluster, is specifically included:
According to the mark of the cluster, the address of the cluster is obtained from Cluster Database;
According to the port-mark of the address of the cluster and the service type, to Hadoop described in the corresponding collection pocket transmission
The acquisition request of service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
5. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page
It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including it is external that the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server
Domain name, the URL to be rewritten Path in plus the cluster mark and the service type port-mark.
6. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page
It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in the Hadoop service page wait rewrite by the way of regular expression matching
URL expression formula;
The position Host of the URL expression formula is written into, in the Path of the URL expression formula in the external domain name of proxy server
In addition the port-mark of the mark of the cluster and the service type.
7. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page
It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
The Host of URL to be rewritten described in the label is rewritten as the external domain name of proxy server, described wait rewrite
URL Path in plus the cluster mark and the service type port-mark.
8. a kind of proxy server, which is characterized in that the headend equipment and group system of website is arranged in the proxy server
Between, the proxy server includes:
Receiving module, the acquisition request of the Hadoop service page of the user for the transmission of receiving front-end equipment;The Hadoop
The mark and service type of the cluster where the Hadoop service page to be accessed are carried in the acquisition request of service page
Port-mark;
Module is obtained, for the port-mark identified with the service type according to the cluster, from the corresponding cluster
It is middle to obtain the Hadoop service page;
URL rewriting module, for being rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
Sending module, for sending the Hadoop after rewriteeing URL to the client of the user by the headend equipment
Service page.
9. proxy server according to claim 8, which is characterized in that the proxy server further include:
Authentication module authenticates the identity of the user for being limited according to the access of the cluster;And determine institute
User identity authentication is stated to pass through.
10. proxy server according to claim 9, which is characterized in that the authentication module is specifically used for:
It is limited according to the access of the cluster, identity request letter is sent to the client of the user by the headend equipment
Breath;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
11. proxy server according to claim 10, which is characterized in that the acquisition module is specifically used for:
According to the mark of the cluster, the address of the cluster is obtained from the Cluster Database;
According to the port-mark of the address of the cluster and the service type, to Hadoop described in the corresponding collection pocket transmission
The acquisition request of service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
12. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use
In:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including it is external that the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server
Domain name, the URL to be rewritten Path in plus the cluster mark and the service type port-mark.
13. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use
In:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in the Hadoop service page wait rewrite by the way of regular expression matching
URL expression formula;
The position Host of the URL expression formula is written into, in the Path of the URL expression formula in the external domain name of proxy server
In addition the port-mark of the mark of the cluster and the service type.
14. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use
In:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
The Host of URL to be rewritten described in the label is rewritten as the external domain name of proxy server, described wait rewrite
URL Path in plus the cluster mark and the service type port-mark.
15. a kind of access system of service page, which is characterized in that the system comprises headend equipment and proxy server, institutes
It states proxy server to be arranged between the headend equipment and group system, the headend equipment, the client communication with user,
For receiving the acquisition request for the Hadoop service page that the user is sent by the client;The Hadoop service page
The mark of the cluster where the Hadoop service page to be accessed and the port of service type are carried in the acquisition request in face
Mark;And the acquisition request of the Hadoop service page is parsed, obtain the proxy server inside website
Address, and according to the address of the proxy server, the acquisition request of the Hadoop service page is forwarded to the agency
Server;
The proxy server, with the corresponding cluster communication, described in the user forwarded according to the headend equipment
The acquisition request of Hadoop service page obtains the Hadoop service page, and to the URL in the Hadoop service page
Be written over processing, and sent to the client of the user by the headend equipment rewrite URL after described in
Hadoop service page;The proxy server, specifically using any proxy server of claim 8-14 as above.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610835920.4A CN106169963B (en) | 2016-09-20 | 2016-09-20 | The access method and system of service page, proxy server |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610835920.4A CN106169963B (en) | 2016-09-20 | 2016-09-20 | The access method and system of service page, proxy server |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106169963A CN106169963A (en) | 2016-11-30 |
CN106169963B true CN106169963B (en) | 2019-07-23 |
Family
ID=57376361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610835920.4A Active CN106169963B (en) | 2016-09-20 | 2016-09-20 | The access method and system of service page, proxy server |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106169963B (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107358069B (en) * | 2017-07-16 | 2019-12-10 | 塞纳德(北京)信息技术有限公司 | Permission management system based on Hue |
CN107818268A (en) * | 2017-11-15 | 2018-03-20 | 中国联合网络通信集团有限公司 | The access control method and server of big data platform |
CN111131492A (en) * | 2019-12-31 | 2020-05-08 | 中国联合网络通信集团有限公司 | Node access method and system |
CN111274591A (en) * | 2020-01-19 | 2020-06-12 | 北京百度网讯科技有限公司 | Method, device, electronic equipment and medium for accessing Kubernetes cluster |
CN111552987A (en) * | 2020-04-16 | 2020-08-18 | 重庆富民银行股份有限公司 | Page access authority control method |
CN111542001B (en) * | 2020-04-21 | 2022-02-11 | 厦门欧万物联科技有限公司 | Network system with distributed server clusters and construction method thereof |
CN111866124B (en) * | 2020-07-17 | 2022-06-24 | 北京金山云网络技术有限公司 | Method, device, server and machine-readable storage medium for accessing webpage |
CN113806008A (en) * | 2021-02-02 | 2021-12-17 | 北京沃东天骏信息技术有限公司 | Cluster access method and device, electronic equipment and readable storage medium |
CN113709259B (en) * | 2021-10-29 | 2022-03-25 | 天聚地合(苏州)数据股份有限公司 | Object access method and service system |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101938427A (en) * | 2010-09-27 | 2011-01-05 | 杭州华三通信技术有限公司 | Re-directing method and device in global load balance |
CN102624918A (en) * | 2012-03-30 | 2012-08-01 | 北京英富森信息技术有限公司 | Proxy access method based on URL (Uniform Resource Locator) rewriting technique |
CN103703745A (en) * | 2011-07-18 | 2014-04-02 | 阿尔卡特朗讯 | Method and apparatus for interconnecting a user agent to a cluster of servers |
CN104092735A (en) * | 2014-06-23 | 2014-10-08 | 吕志雪 | Cloud computing data access method and system based on binary tree |
CN105141632A (en) * | 2015-09-21 | 2015-12-09 | 北京百度网讯科技有限公司 | Method and device used for checking pages |
CN105939313A (en) * | 2015-09-01 | 2016-09-14 | 杭州迪普科技有限公司 | State code redirecting method and device |
CN107135242A (en) * | 2016-02-29 | 2017-09-05 | 阿里巴巴集团控股有限公司 | Mongodb clusters access method, apparatus and system |
-
2016
- 2016-09-20 CN CN201610835920.4A patent/CN106169963B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101938427A (en) * | 2010-09-27 | 2011-01-05 | 杭州华三通信技术有限公司 | Re-directing method and device in global load balance |
CN103703745A (en) * | 2011-07-18 | 2014-04-02 | 阿尔卡特朗讯 | Method and apparatus for interconnecting a user agent to a cluster of servers |
CN102624918A (en) * | 2012-03-30 | 2012-08-01 | 北京英富森信息技术有限公司 | Proxy access method based on URL (Uniform Resource Locator) rewriting technique |
CN104092735A (en) * | 2014-06-23 | 2014-10-08 | 吕志雪 | Cloud computing data access method and system based on binary tree |
CN105939313A (en) * | 2015-09-01 | 2016-09-14 | 杭州迪普科技有限公司 | State code redirecting method and device |
CN105141632A (en) * | 2015-09-21 | 2015-12-09 | 北京百度网讯科技有限公司 | Method and device used for checking pages |
CN107135242A (en) * | 2016-02-29 | 2017-09-05 | 阿里巴巴集团控股有限公司 | Mongodb clusters access method, apparatus and system |
Also Published As
Publication number | Publication date |
---|---|
CN106169963A (en) | 2016-11-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106169963B (en) | The access method and system of service page, proxy server | |
US11601398B2 (en) | Multiplexed data exchange portal interface in scalable data networks | |
US11394805B1 (en) | Automatic discovery of API information | |
CN109314704B (en) | Single sign-on and single sign-off functions for multi-tenant identity and data security management cloud services | |
US11050607B2 (en) | Proxy with a function as a service (FAAS) support | |
CN108259425A (en) | The determining method, apparatus and server of query-attack | |
US20140282464A1 (en) | Systems and methods for intercepting, processing, and protecting user data through web application pattern detection | |
US10187444B2 (en) | System and method of automatic generation and insertion of analytic tracking codes | |
WO2013143403A1 (en) | Method and system for accessing website | |
JP2019133700A (en) | System and method for website | |
US11902328B2 (en) | Network device identification | |
CN106161617A (en) | Reverse proxy method based on NODEJS, Reverse Proxy and system | |
CN106919634A (en) | Across the method and web browser of Application share data | |
CN106789227B (en) | A kind of internet behavior analysis method and internet behavior analytical equipment | |
US20160246994A1 (en) | Information collection apparatus and method | |
CN113507475B (en) | Cross-domain access method and device | |
US12072946B2 (en) | Optimizing scraping requests through browsing profiles | |
CN108287894A (en) | Data processing method, device, computing device and storage medium | |
CN108769189A (en) | The access method and equipment of cross-domain resource | |
CN109274705A (en) | Service providing method, apparatus and system based on user identity | |
US11138463B1 (en) | Unsupervised and supervised machine learning approaches to detecting bots and other types of browsers | |
CN109510799A (en) | Page display method, browser client, equipment and storage medium | |
CN107223329B (en) | A kind of dns resolution method, apparatus and network system | |
CN106888248B (en) | For obtaining the method and apparatus of user access activity information | |
EP3923157B1 (en) | Data stream processing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |