CN106169963B - The access method and system of service page, proxy server - Google Patents

The access method and system of service page, proxy server Download PDF

Info

Publication number
CN106169963B
CN106169963B CN201610835920.4A CN201610835920A CN106169963B CN 106169963 B CN106169963 B CN 106169963B CN 201610835920 A CN201610835920 A CN 201610835920A CN 106169963 B CN106169963 B CN 106169963B
Authority
CN
China
Prior art keywords
cluster
service page
url
hadoop
mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610835920.4A
Other languages
Chinese (zh)
Other versions
CN106169963A (en
Inventor
王倩
周恺
张发恩
肖远昊
王家兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201610835920.4A priority Critical patent/CN106169963B/en
Publication of CN106169963A publication Critical patent/CN106169963A/en
Application granted granted Critical
Publication of CN106169963B publication Critical patent/CN106169963B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/146Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/02Standardisation; Integration
    • H04L41/0246Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
    • H04L41/0253Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols using browsers or web-pages for accessing management information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Computer And Data Communications (AREA)

Abstract

The present invention provides the access method and system, proxy server of a kind of service page, which comprises the acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;According to the port-mark of the mark of the cluster carried in the acquisition request of Hadoop service page and service type, Hadoop service page is obtained from corresponding cluster;URL in Hadoop service page is rewritten as to be able to carry out the URL of outside access;The Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment.Technical solution of the present invention, user can obtain Hadoop service page by headend equipment and proxy server, compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, not needing user has certain technical foundation, configuration of the user to SSH Tunnel process is established is saved, the complexity of access Hadoop service page is greatly reduced.

Description

The access method and system of service page, proxy server
[technical field]
The present invention relates to the access methods and system of network access technology field more particularly to a kind of service page, agency Server.
[background technique]
Since (the Amazon Web Services of Amazon Web service in 2009;AWS Elastic MapReduce) is issued Since, the processing service of Hadoop big data is provided using cloud computing platform becomes trend, provides the cloud meter of similar service in the industry Calculating product has the day of Baidu to calculate platform, the E-MapReduce service of Ali's cloud, Kingsoft cloud trustship Hadoop service etc..Hadoop The clear superiority of big data processing service includes low cost, elasticity is expansible, safety is easy-to-use, and user can be in virtual private cloud (Virtual Private Cloud;VPC starting and management cluster inside the virtual cloud end office (EO) domain) constituted, that is, at one The cluster of oneself is managed in customized logic isolation network, all cluster server nodes are at LAN environment, It avoids leaking on public network cruelly, public network IP only is arranged in the server node for having external request i.e. Master node, it is hidden to reduce safety Suffer from.
The processing service of the big datas such as Hadoop has respective Hadoop service page, Hadoop in corresponding cluster internal Service page is the state and log information that user grasps operation operation, to provide very easily entrance for user.With The Hadoop service page in cluster inside family access VPC generallys use two following methods: one is log on to cluster The shortcomings that inside is accessed by the browser Lynx of textual form, this access mode is to be unable to exhibiting pictures, and can operate Property is also poor;The second way is the server node with the public network IP i.e. Master in user's local server and cluster Secure Shell (Secure SHell is established between node;SSH) protocol tunnel (Tunnel), abbreviation SSH Tunnel;Then straight Connect the acquisition Hadoop service page from cluster.Wherein establishing SSH Tunnel, specific step is as follows: (1) order line or SSH Client is created to the SSH Tunnel of the Master node of cluster, and sets local unappropriated port as source Mouthful;(2) browser needs SOCKS proxy management plug-in unit, according to browser type can choose FoxyProxy or SwitchySharp;(3) modification plug-in card configuration is acted on behalf of using the SOCKS that the first step creates;(4) it opens browser and accesses Hadoop Service page.And the second way has more obvious advantage relative to first way, using also more extensive.
But the prior art user establish SSH Tunnel access Hadoop service page by way of, it is desirable that use Family has certain technical foundation, and the configuration for establishing SSH Tunnel process is extremely complex, causes to access Hadoop service page The process in face is also extremely complex.
[summary of the invention]
The present invention provides a kind of access method of service page and systems, proxy server, for reducing Hadoop clothes The complexity of business page access.
The present invention provides a kind of access method of service page, which comprises
The acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;The Hadoop service page The mark of the cluster where the Hadoop service page to be accessed and the port-mark of service type are carried in acquisition request;
According to the mark of the cluster and the port-mark of the service type, from the corresponding cluster described in acquisition Hadoop service page;
It is rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
The Hadoop service page after rewriteeing URL is sent to the client of the user by the headend equipment.
Still optionally further, in method as described above, the Hadoop service page for the user that receiving front-end equipment is sent Acquisition request after, according to the cluster mark and the service type port-mark, from the corresponding cluster Before obtaining the Hadoop service page, further includes:
It is limited according to the access of the cluster, the identity of the user is authenticated;And determine that the user identity is recognized Card passes through.
Still optionally further, it in method as described above, is limited according to the access of the cluster, to the identity of the user It is authenticated, is specifically included:
It is limited according to the access of the cluster, identity request is sent to the client of the user by the headend equipment Information;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
Still optionally further, in method as described above, according to the mark of the cluster and the port of the service type Mark, the Hadoop service page is obtained from the corresponding cluster, is specifically included:
According to the mark of the cluster, the address of the cluster is obtained from Cluster Database;
According to the port-mark of the address of the cluster and the service type, to described in the corresponding collection pocket transmission The acquisition request of Hadoop service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into The URL of row outside access, specifically includes:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server pair Plus the port-mark of the mark of the cluster and the service type in the Path of outer domain name, the URL to be rewritten.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into The URL of row outside access, specifically includes:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including obtaining URL weight to be rewritten in the Hadoop service page by the way of regular expression matching URL expression formula after writing;
The position Host of the URL expression formula is written into, in the URL expression formula in the external domain name of proxy server Plus the port-mark of the mark of the cluster and the service type in Path.
Still optionally further, in method as described above, the URL in the Hadoop service page is rewritten as can be into The URL of row outside access, specifically includes:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
By the Host of URL to be rewritten described in the label be rewritten as the external domain name of proxy server, it is described to Plus the port-mark of the mark of the cluster and the service type in the Path of the URL of rewriting.
The present invention also provides a kind of proxy server, the proxy server includes:
Receiving module, the acquisition request of the Hadoop service page of the user for the transmission of receiving front-end equipment;It is described The mark kimonos of the cluster where the Hadoop service page to be accessed is carried in the acquisition request of Hadoop service page The port-mark of service type;
Module is obtained, for according to the mark of the cluster and the port-mark of the service type, from corresponding described The Hadoop service page is obtained in cluster;
URL rewriting module, for being rewritten as the URL in the Hadoop service page to be able to carry out outside access URL;
Sending module, described in after sending rewriting URL to the client of the user by the headend equipment Hadoop service page.
Still optionally further, in proxy server as described above, further includes:
Authentication module authenticates the identity of the user for being limited according to the access of the cluster;And really The fixed user identity authentication passes through.
Still optionally further, in proxy server as described above, the authentication module is specifically used for:
It is limited according to the access of the cluster, identity request is sent to the client of the user by the headend equipment Information;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
Still optionally further, in proxy server as described above, the acquisition module is specifically used for:
According to the mark of the cluster, the address of the cluster is obtained from the Cluster Database;
According to the port-mark of the address of the cluster and the service type, to described in the corresponding collection pocket transmission The acquisition request of Hadoop service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server pair Plus the port-mark of the mark of the cluster and the service type in the Path of outer domain name, the URL to be rewritten.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including obtaining URL weight to be rewritten in the Hadoop service page by the way of regular expression matching URL expression formula after writing;
The position Host of the URL expression formula is written into, in the URL expression formula in the external domain name of proxy server Plus the port-mark of the mark of the cluster and the service type in Path.
Still optionally further, in proxy server as described above, the URL rewriting module is specifically used for:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
By the Host of URL to be rewritten described in the label be rewritten as the external domain name of proxy server, it is described to Plus the port-mark of the mark of the cluster and the service type in the Path of the URL of rewriting.
The present invention also provides a kind of access system of service page, the system comprises headend equipment and proxy server, The headend equipment, the client communication with user are taken for receiving the user by the Hadoop that the client is sent The acquisition request of the business page;The Hadoop service page to be accessed is carried in the acquisition request of the Hadoop service page The mark of the cluster at place and the port-mark of service type;And the acquisition request of the Hadoop service page is solved Analysis obtains the address of the proxy server inside website, and according to the address of the proxy server, by the Hadoop The acquisition request of service page is forwarded to the proxy server;
The proxy server, and the corresponding cluster communication, according to the user's of headend equipment forwarding The acquisition request of the Hadoop service page obtains the Hadoop service page, and in the Hadoop service page URL be written over processing, and sent to the client of the user by the headend equipment rewrite URL after described in Hadoop service page;The proxy server specifically uses proxy server as described above.
The access method and system of service page of the invention, proxy server, by by proxy server receiving front-end The acquisition request of the Hadoop service page for the user that equipment is sent;According to what is carried in the acquisition request of Hadoop service page The mark of cluster and the port-mark of service type obtain Hadoop service page from corresponding cluster;Hadoop is serviced URL in the page is rewritten as being able to carry out the URL of outside access;It is sent by headend equipment to the client of user and rewrites URL Hadoop service page afterwards.Using technical solution of the present invention, user can be obtained by headend equipment and proxy server Hadoop service page, compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, no It needs user to have certain technical foundation, saves configuration of the user to SSH Tunnel process is established, greatly reduce access The complexity of Hadoop service page.And technical solution of the present invention, it is directly logged onto cluster internal with existing user, It accesses Hadoop service page by the browser Lynx of textual form to compare, the Hadoop service page of user's access can be opened up Diagram piece, and operability is also stronger.
[Detailed description of the invention]
Fig. 1 is the flow chart of the access method embodiment of service page of the invention.
Fig. 2 is the identity request page that a kind of proxy server provided in an embodiment of the present invention returns to user.
Hadoop service page after the rewriting URL that Fig. 3 shows for the client that the embodiment of the present invention provides a kind of user.
Fig. 4 is the structure chart of proxy server embodiment one of the invention.
Fig. 5 is the structure chart of proxy server embodiment two of the invention.
Fig. 6 is the structure chart of the access system embodiment of service page of the invention.
Fig. 7 is the exemplary diagram of the access system of service page of the invention.
[specific embodiment]
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments The present invention is described in detail.
Fig. 1 is the flow chart of the access method embodiment of service page of the invention.As shown in Figure 1, the clothes of the present embodiment The access method of the business page, can specifically include following steps:
100, the acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;
101, it is marked according to the port of the mark of the cluster carried in the acquisition request of Hadoop service page and service type Know, Hadoop service page is obtained from corresponding cluster;
102, the URL in Hadoop service page is rewritten as being able to carry out the URL of outside access;
103, the Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment.
The executing subject of the access method of the service page of the present embodiment is proxy server.The agency service of the present embodiment The front end (Front End) of website is arranged between equipment and group system in device.May include in the group system of the present embodiment Multiple clusters (Cluster), the cluster in the present embodiment is specially Hadoop cluster.
Since the Hadoop service page of Hadoop cluster is the state and log information that user grasps operation operation, institute It needs to access the Hadoop service page in actual operation with user.The access method of the service page of the present embodiment is used for Hadoop service page is provided for user.For example, the Hadoop service page in the present embodiment is specifically as follows Yarn management page Face or Hue administration page.
In the present embodiment, the acquisition request of the Hadoop service page for the user that headend equipment is sent is specifically as follows use Family is sent to headend equipment by used client.It is taken in the acquisition request of Hadoop service page in the present embodiment The mark of cluster where the band Hadoop service page to be accessed and the port-mark of service type;Such as the mark tool of cluster Body can be general exclusive identification code (the Universally Unique Identifier of the cluster;UUID).Service type Port-mark can be the port numbers of the service type.The acquisition request of the Hadoop service page of the present embodiment is specifically as follows One obtains uniform resource locator (the Uniform Resoure Locator of the Hadoop service page;URL).It is following to use The acquisition request of one Hadoop service page at family is following URL:
https://bmr.bce.baidu.com/476308c-5d5b-11e6-83c4-00e0ec261caa/8088/ cluster;
Wherein, bmr.bce.baidu.com is used for location proxy server, after headend equipment receives the request, solution The URL is analysed, it, in this way can be by the Hadoop according to the IP address of the proxy server inside bmr.bce.baidu.com parsing The acquisition request of service page is transmitted to proxy server, so that proxy server gets following URL sections therein:
f476308c-5d5b-11e6-83c4-00e0ec261caa/8088/Cluster。
Wherein 476308c-5d5b-11e6-83c4-00e0ec261caa is the UUID of cluster, and 8088 be service type Port numbers;Cluster is the mark of cluster.
In the present embodiment, proxy server, which is equal to, to be arranged inside website, can be with any service in any one cluster Device node is communicated, regardless of the server node is ordinary node or Master node.Therefore, in the present embodiment, agency The mark for the cluster that server can also carry in the acquisition request according to Hadoop service page and the port mark of service type Know, communicated with any server node in corresponding cluster, Hadoop service is obtained from the server node of cluster The page.
Specifically, the step 101 of the present embodiment is " according to the mark of the cluster carried in the acquisition request of Hadoop service page Know the port-mark with service type, Hadoop service page obtained from corresponding cluster ", it can specifically include following step It is rapid:
(a1) according to the mark of cluster, the address of cluster is obtained from Cluster Database;
(a2) according to the port-mark of the address of cluster and service type, to corresponding collection pocket transmission Hadoop service page Acquisition request;
(a3) the Hadoop service page that cluster is returned according to the acquisition request of the Hadoop service page is received.
In the present embodiment, company-data lab setting in the cluster, is stored with all of each cluster in the Cluster Database Information, such as it is stored with the corresponding relationship of the mark of each cluster and the address of cluster, as the mark of cluster is specifically as follows The address of the UUID of cluster, cluster are specifically as follows the IP address of cluster.Cluster is specifically can store in Cluster Database UUID and cluster IP address between corresponding relationship.In this way, proxy server can be according to the UUID of cluster, from cluster number According to the IP address for obtaining the cluster in library.Then according to the port-mark of the IP address of the cluster and service type, to corresponding Server node in cluster sends the acquisition request of Hadoop service page.Server node in the cluster is according to this The acquisition request of Hadoop service page obtains corresponding Hadoop service page, and returning to the proxy server should Hadoop service page.
It is the Hadoop service page inside website since proxy server receives the Hadoop service page that cluster returns, The URL of the Hadoop service page is specially internal address, due to the external user that user is the website, if directly will collection The Hadoop service page that group returns is sent to user, and user also can not directly access the URL of the Hadoop service page.Cause It needs for the URL in Hadoop service page to be rewritten as in this present embodiment to be able to carry out the URL of outside access;And pass through front end Equipment sends the Hadoop service page after rewriteeing URL to the client of user.The finally obtained Hadoop service of user in this way The page is only accessible significant service page.
The access method of the service page of the present embodiment passes through the user's that is sent by proxy server receiving front-end equipment The acquisition request of Hadoop service page;According to the mark and service of the cluster carried in the acquisition request of Hadoop service page The port-mark of type obtains Hadoop service page from corresponding cluster;URL in Hadoop service page is rewritten as It is able to carry out the URL of outside access;The Hadoop service page after rewriteeing URL is sent to the client of user by headend equipment Face.Using the technical solution of the present embodiment, user can obtain Hadoop service page by headend equipment and proxy server, Compared with the prior art is by way of establishing SSH Tunnel and accessing Hadoop service page, do not need user have it is certain Technical foundation saves configuration of the user to SSH Tunnel process is established, and greatly reduces access Hadoop service page Complexity.And the technical solution of the present embodiment, it is directly logged onto cluster internal with existing user, passes through textual form Browser Lynx access Hadoop service page is compared, and the Hadoop service page of user's access can be with exhibiting pictures, Er Qieke Operability is also stronger.
Still optionally further, in " the Hadoop service for the user that receiving front-end equipment is sent of the step 100 of above-described embodiment After the acquisition request of the page ", step 101 " according to the mark of the cluster carried in the acquisition request of Hadoop service page and It can also include the following: basis before the port-mark of service type, from acquisition Hadoop service page in corresponding cluster " The access of cluster limits, and authenticates to the identity of user;And determine that user identity authentication passes through.
Have public network access ability since Hadoop cluster internal has a server node, directly opens the server The serve port user of node can access, but Hadoop primary service page, such as Yarn administration page, not mention For user authentication function, if directly open, malicious user can steal user job information by modes such as IP exhaustions, There can be very big security risk in this way, so in the prior art, the Hadoop service page of the Hadoop cluster inside VPC is logical It often cannot directly be accessed by browser in user client, cluster internal can only be logged on to by user or is being locallyd create The mode of SSH Tunnel accesses.In order to increase the safety of Hadoop service page, the technical solution of the present embodiment can be with The access of cluster limits, and authenticates provided with the identity to user, to increase the safety of Hadoop service page.Such as generation Reason server receive headend equipment transmission user Hadoop service page acquisition request after, proxy server to During cluster requests corresponding Hadoop service page, it is found that the cluster is provided with access limitation, need to request The identity of the user of Hadoop service page authenticates, and does not otherwise provide Hadoop service page, can only be when to the user's Authentication passes through, and just can provide Hadoop service page to the user.User is in the username and password of cluster can be with Cluster internal registration is directly logged in pass through before user.
Still optionally further, " being limited according to the access of cluster, to the identity of user in the technical solution of above-described embodiment Authenticated ", it can specifically include following steps:
(b1) it is limited according to the access of cluster, identity request information is sent to the client of user by headend equipment;
(b2) username and password of user is received by headend equipment;
(b3) according to the mark of cluster, the subscriber identity information of cluster is obtained from Cluster Database;
(b4) user of user and password are authenticated according to the subscriber identity information of cluster.
Limitation is accessed when proxy server determines that the cluster has, identity is sent to the client of user by headend equipment Solicited message;Such as return to user can be a webpage.For example, Fig. 2 is a kind of agency's clothes provided in an embodiment of the present invention Business device returns to the identity request page of user.As shown in Fig. 2, the page shows that proxy server passes through headend equipment to user The identity request information that sends of client, i.e. the input frame of username and password.User is used by inputting in the input frame Then name in an account book and password are clicked and are determined, the username and password of user is just sent to proxy server by headend equipment.This The Cluster Database of embodiment is used to store the subscriber identity information of each cluster, for example, each cluster all users user name With corresponding password.
After proxy server receives the username and password of the user of headend equipment transmission, such as according to the mark of cluster The UUID of cluster obtains the identity information of all users of the cluster from Cluster Database, then according to the cluster of acquisition The identity information of all users verify the username and password of the user.Judge the identity information of all users of the cluster In whether include the user name and corresponding password, if do not have in all subscriber identity informations of cluster the user name or should The corresponding password of user name and the password that user inputs are inconsistent, then do not pass through to the subscriber authentication.Only when cluster It include the user name in all subscriber identity informations, and the corresponding password of the user name is consistent with the password that user inputs, The subscriber authentication is passed through.
It can be seen from the above, the proxy server of the present embodiment uses HTTPS+BA (Basic Authentication;Substantially Authentication) mode guarantee only by certification and there is user's request of operating right can just be forwarded to pair cluster The cluster answered, the username and password that the username and password of certification uses cluster server example to log in, services domain name and card Book is configured in front end (FrontEnd;FE) in equipment.
Proxy server cannot be directly returned to user browser after obtaining Hadoop service page from purpose cluster, It needs to parse Hadoop service page, will wherein all URL handle, so that treated Hadoop service page In URL user be able to access that.Specifically, in the technical solution of above-described embodiment, step 102 " will be in Hadoop service page URL be rewritten as being able to carry out the URL " of outside access, can specifically include following several situations:
The first situation, the Content-Type of Hadoop service page include JSON character string;Can specifically include as Lower step:
(c1) judge whether the Content-Type of Hadoop service page includes JSON character string;If including executing step Suddenly (c2);If not including, terminate;
(c2) whether judge in Hadoop service page including the URL to be rewritten in predefined list;If including executing Step (c3);If not including, terminate;
(c3) by the Host of the URL to be rewritten of Hadoop service page be rewritten as the external domain name of proxy server, to Plus the port-mark of the mark of cluster and service type in the Path of the URL of rewriting.
The principle that URL in Hadoop service page is rewritten, is that the Host of all URL will be replaced with proxy server External domain name, will be plus the UUID of mark cluster and the port of service type in Path.It is as described in Table 1 a kind of heavy Write example.
Table 1
As shown in table 1, the present embodiment, can be by http when doing the URL rewriting in Hadoop service page: // 8.8.8.8:8888/Cluster https can be replaced by: //bmr.bce.baidu.com/f476308c-5d5b-11e6- 83c4-00e0ec261caa/8888/Cluster;The browser of user terminal can continue the URL after access is rewritten in this way.Agency Server will receive request, and find cluster address according to f476308c-5d5b-11e6-83c4-00e0ec261caa 8.8.8.8, then the destination server node of cluster is forwarded requests to.
Proxy server need to Hadoop service page parse obtain rewriting in need URL, according to the page The difference of Content Type includes JSON character string in the present embodiment in different ways with page Content-Type For.
Specifically, judge whether the Content-Type of Hadoop service page includes JSON character string;If including;For The JSON page can be predefined to contain in a predefined list such as preDefinedList, this preDefinedList and be wanted The prefix of the URL of rewriting, since proxy server is mainly the relevant service page of Hadoop acted on behalf of, so this PreDefinedList can be enumerated, and so directly be written over the field string in preDefinedList list i.e. Can, the principle specifically rewritten is that the Host of the URL to be rewritten of Hadoop service page is rewritten as to proxy server externally Domain name, URL to be rewritten Path in plus cluster mark and service type port-mark.
Second situation, the Content-Type of Hadoop service page include JavaScript or CSS;It specifically can be with Include the following steps:
(d1) judge whether the Content-Type of Hadoop service page includes JavaScript or CSS;If including, It executes step (d2);If not including, terminate;
(d2) after obtaining the URL rewriting in Hadoop service page wait rewrite by the way of regular expression matching URL expression formula;
(d3) by the position Host of the external domain name write-in URL expression formula of proxy server, in the Path of URL expression formula In addition the mark of cluster and the port-mark of service type.
Unlike the first above-mentioned situation, in the second situation, with the Content- of Hadoop service page Type is comprising for JavaScript or CSS.Specifically, judge Hadoop service page Content-Type whether include JavaScript or CSS;If the URL in JavaScript type page is usually fixed including JavaScript or CSS The code form of mode, the mode that regular expression matching can be used at this time are handled.Such as format " url s* (s* (?: [" '] (? P<link>[^ " '] *) [" '] | (? P<link>S+)) " will be matched to code URL (" http: // 8.8.8.8:8888/Cluster "), and then available wherein URL to be rewritten;Then according to that proxy server is external Domain name be written URL expression formula the position Host, in the Path of URL expression formula plus cluster mark and service type end Mouth mark, is written over URL.That is the URL of each type is expressed to can be matched to a kind of regular expression URL expression formula.Then according to this expression formula, URL wherein to be rewritten is rewritten according to the rewriting principle of URL.
Simultaneously in order to avoid all Hadoop service pages will carry out traversal processing to all regular expressions, in reality Regular expression can be done according to the keyword of demand file and be classified on now, different files is only needed to be traversed in the page and can be used The regular expression list arrived;
The third situation, the processing of html page;It can specifically include following steps:
(e1) judge whether Hadoop service page is html page;If so, executing step (e2);If not including, terminate;
(e2) obtain Hadoop service page in include URL to be rewritten label;
(e3) Host of the URL to be rewritten in label is rewritten as the external domain name of proxy server, URL to be rewritten Path in plus cluster mark and service type port-mark.
If the Content Type in Hadoop service page contains the keyword in excludedList, Keyword in excludedList has csv, image, stream, xml, xsl etc., and the page of these types does not have to process. Except the other kinds of page all html page is used as to be handled, the meeting such as specific label, such as a, src in html page Label comprising URL, in the present embodiment by all labels including URL all as URL that may be to be rewritten.List it is all can It can include the label of URL, then parse the content of these labels in Hadoop service page, it will be to be rewritten in label The Host of URL be rewritten as the external domain name of proxy server, URL to be rewritten Path in add cluster mark and service The port-mark of type.There are also a kind of script element in html page, this element content can be with after getting The JavaScript page is handled using same canonical processing mode, i.e., the processing of above-mentioned second situation.
It is rewritten as the URL in Hadoop service page to be able to carry out outside access using any one of the above mode After URL, the Hadoop service page after rewriteeing URL can be sent to the client of user by headend equipment according to step 103 Face.Such as the Hadoop service page rewritten after URL that a kind of Fig. 3 client for providing user for the embodiment of the present invention is shown. User can be directly according to the URL after the Hadoop service page access rewriting after rewriting URL in this way.
Fig. 4 is the structure chart of proxy server embodiment one of the invention.As shown in figure 4, the agency service of the present embodiment Device can specifically include: receiving module 10 obtains module 11, URL rewriting module 12 and sending module 13.
The acquisition request of the Hadoop service page for the user that wherein receiving module 10 is sent for receiving front-end equipment; The mark and service class of the cluster where the Hadoop service page to be accessed are carried in the acquisition request of Hadoop service page The port-mark of type;Module 11 is obtained to be used for according to the collection in the acquisition request of the received Hadoop service page of receiving module 10 The mark of group and the port-mark of service type, obtain Hadoop service page from corresponding cluster;URL rewriting module 12 is used URL in the Hadoop service page that will acquire the acquisition of module 11 is rewritten as being able to carry out the URL of outside access;Sending module 13 for sending the Hadoop service page after URL rewriting module 12 rewrites URL to the client of user by headend equipment.
The proxy server of the present embodiment, by using above-mentioned module realize service page access realization principle and Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail, Details are not described herein.
Fig. 5 is the structure chart of proxy server embodiment two of the invention.The proxy server of the present embodiment is in above-mentioned Fig. 4 It further can also include following technical solution on the basis of the technical solution of illustrated embodiment.As shown in figure 5, the present embodiment Proxy server further include: authentication module 14.
Authentication module 14 is used to be limited according to the access of cluster, authenticates to the identity of user;And determine user Authentication passes through.10 receiving front-end equipment of receiving module send user Hadoop service page acquisition request it Afterwards, triggering authentication module 14 authenticates the identity of user.The identity of user can only be recognized when authentication module 14 After card passes through, it can just trigger and obtain in acquisition request of the module 11 according to the received Hadoop service page of receiving module 10 The mark of cluster and the port-mark of service type obtain Hadoop service page from corresponding cluster.
Still optionally further, in the proxy server of the present embodiment, 14 body of authentication module is used for:
It is limited according to the access of cluster, identity request information is sent to the client of user by headend equipment;
The username and password of user is received by headend equipment;
According to the mark of cluster, the subscriber identity information of cluster is obtained from Cluster Database;
The user of user and password are authenticated according to the subscriber identity information of cluster.
Still optionally further, it in the proxy server of the present embodiment, obtains module 11 and is specifically used for:
According to the mark of cluster, the address of cluster is obtained from Cluster Database;
According to the port-mark of the address of cluster and service type, to obtaining for corresponding collection pocket transmission Hadoop service page Take request;
Receive the Hadoop service page that cluster is returned according to the acquisition request of Hadoop service page.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether the Content-Type of Hadoop service page includes JSON character string;
If including whether judging in Hadoop service page including the URL to be rewritten in predefined list;
If including, by the Host of the URL to be rewritten of Hadoop service page be rewritten as the external domain name of proxy server, Plus the port-mark of the mark of cluster and service type in the Path of URL to be rewritten.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether the Content-Type of Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in Hadoop service page wait rewrite by the way of regular expression matching URL expression formula;
It is added by the position Host of the external domain name write-in URL expression formula of proxy server, in the Path of URL expression formula The mark of cluster and the port-mark of service type.
Still optionally further, in the proxy server of the present embodiment, URL rewriting module 12 is specifically used for:
Judge whether Hadoop service page is html page;
If so, including the label of URL to be rewritten in acquisition Hadoop service page;
The Host of URL to be rewritten in label is rewritten as proxy server external domain name, URL to be rewritten Plus the port-mark of the mark of cluster and service type in Path.
The proxy server of the present embodiment, by using above-mentioned module realize service page access realization principle and Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail, Details are not described herein.
Fig. 6 is the structure chart of the access system embodiment of service page of the invention.As shown in fig. 6, the clothes of the present embodiment The access system of the business page, can specifically include: headend equipment 20 and proxy server 30.
The wherein client communication of headend equipment 20 and user is taken for receiving user by the Hadoop that client is sent The acquisition request of the business page;The collection where the Hadoop service page to be accessed is carried in the acquisition request of Hadoop service page The mark of group and the port-mark of service type;And the acquisition request of Hadoop service page is parsed, it obtains in website The address of the proxy server 30 in portion, and according to the address of proxy server 30, the acquisition request of Hadoop service page is turned It is sent to proxy server 30;
Proxy server 30 and corresponding cluster communication, according to the Hadoop service page for the user that headend equipment 20 forwards Acquisition request, obtain Hadoop service page, and processing be written over to the URL in Hadoop service page, and before passing through End equipment 20 sends the Hadoop service page after rewriteeing URL to the client of user;Specifically, the agency service of the present embodiment Device 30 is specifically using the proxy server such as figure 4 above or embodiment illustrated in fig. 5.Also, the visit of the service page of the present embodiment It asks system, the access of service page can be realized using above-mentioned related method embodiment, it in detail can be with reference to above-mentioned related implementation The record of example, details are not described herein.
Fig. 7 is the exemplary diagram of the access system of service page of the invention.In the technical solution of above-mentioned embodiment illustrated in fig. 6 On the basis of, a kind of framework of service page access system is provided in the present embodiment, as shown in fig. 7, in the present embodiment, the framework Multiple User can be supported simultaneously, such as in Fig. 7 for including User A31, User B32 and User C33, to include three For a cluster Cluster A41, Cluster B42 and Cluster C43.Wherein User A31 accesses Cluster A41's Service page, User B32 access the service page of the service page of Cluster B42, User C33 access Cluster C43. According to the record of above-described embodiment, wherein the client communication of headend equipment FE equipment 50 and each User, receives the visitor of each User The acquisition request for the Hadoop service page that family end is sent, and the Hadoop clothes after rewriteeing URL are sent to the client of each User The business page.Proxy server is indicated using Proxy module 60 in the present embodiment.Proxy module 60 is located at headend equipment FE and sets It, can be in multiple clusters of multiple users between standby 50 and cluster Cluster A41, Cluster B42 and Cluster C43 Service provide agency, user can directly by link by way of access Hadoop service page, after basic verification The Hadoop service page of Hadoop cluster can be accessed.The proxy server Proxy module 60 of the present embodiment is responsible for real The certification at current family, the rewriting of URL guarantee that request can reach proxy server, and how to support the same user not Same cluster.
It should be noted that actually answered for including three User and three Cluster in the framework of the present embodiment In, the quantity of User and the quantity of Cluster and with no restrictions.
It should be noted that if a user accesses multiple clusters, and being visited by the same browser in the present embodiment When asking the identical service of different clusters, it may appear that the problem of session conflicts, user between cluster as long as switching over Re-authentication is needed, because the service URL of the different clusters after processed has identical domain name, Cookie supports Path rank Certification, conflict can be eliminated by the rewriting of Cookie Path.In the present embodiment, the access of service page shown in Fig. 7 The function of Proxy module 60 in system architecture is realized specifically can be with reference to above-mentioned Fig. 4 or the agency of embodiment illustrated in fig. 5 clothes Business device.FE equipment 50 and Proxy module 60 in the access system architecture of service page shown in Fig. 7 constitute clothes shown in fig. 6 The access system of the business page, in detail can be with reference to the access system of the service page of above-mentioned embodiment illustrated in fig. 6.And shown in Fig. 7 Service page access system architecture in interact between each component and realize that the access of service page can refer to above-mentioned phase The record of embodiment of the method is closed, details are not described herein.
In several embodiments provided by the present invention, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the present invention The part steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read- Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. it is various It can store the medium of program code.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.

Claims (15)

1. a kind of access method of service page, which is characterized in that the executing subject of the method is proxy server, the generation Reason server is arranged between the headend equipment of website and group system, which comprises
The acquisition request of the Hadoop service page for the user that receiving front-end equipment is sent;The acquisition of the Hadoop service page The mark of the cluster where the Hadoop service page to be accessed and the port-mark of service type are carried in request;
According to the mark of the cluster and the port-mark of the service type, from the corresponding cluster described in acquisition Hadoop service page;
It is rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
The Hadoop service page after rewriteeing URL is sent to the client of the user by the headend equipment.
2. the method according to claim 1, wherein the Hadoop service page for the user that receiving front-end equipment is sent After the acquisition request in face, according to the mark of the cluster and the port-mark of the service type, from the corresponding cluster Before the middle acquisition Hadoop service page, the method also includes:
It is limited according to the access of the cluster, the identity of the user is authenticated;And determine that the user identity authentication is logical It crosses.
3. according to the method described in claim 2, it is characterized in that, being limited according to the access of the cluster, to the user's Identity is authenticated, and is specifically included:
It is limited according to the access of the cluster, identity request letter is sent to the client of the user by the headend equipment Breath;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
4. the method according to claim 1, wherein according to the mark of the cluster and the end of the service type Mouth mark, the Hadoop service page is obtained from the corresponding cluster, is specifically included:
According to the mark of the cluster, the address of the cluster is obtained from Cluster Database;
According to the port-mark of the address of the cluster and the service type, to Hadoop described in the corresponding collection pocket transmission The acquisition request of service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
5. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including it is external that the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server Domain name, the URL to be rewritten Path in plus the cluster mark and the service type port-mark.
6. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in the Hadoop service page wait rewrite by the way of regular expression matching URL expression formula;
The position Host of the URL expression formula is written into, in the Path of the URL expression formula in the external domain name of proxy server In addition the port-mark of the mark of the cluster and the service type.
7. method according to claim 1 to 4, which is characterized in that by the URL weight in the Hadoop service page It is written as being able to carry out the URL of outside access, specifically include:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
The Host of URL to be rewritten described in the label is rewritten as the external domain name of proxy server, described wait rewrite URL Path in plus the cluster mark and the service type port-mark.
8. a kind of proxy server, which is characterized in that the headend equipment and group system of website is arranged in the proxy server Between, the proxy server includes:
Receiving module, the acquisition request of the Hadoop service page of the user for the transmission of receiving front-end equipment;The Hadoop The mark and service type of the cluster where the Hadoop service page to be accessed are carried in the acquisition request of service page Port-mark;
Module is obtained, for the port-mark identified with the service type according to the cluster, from the corresponding cluster It is middle to obtain the Hadoop service page;
URL rewriting module, for being rewritten as the URL in the Hadoop service page to be able to carry out the URL of outside access;
Sending module, for sending the Hadoop after rewriteeing URL to the client of the user by the headend equipment Service page.
9. proxy server according to claim 8, which is characterized in that the proxy server further include:
Authentication module authenticates the identity of the user for being limited according to the access of the cluster;And determine institute User identity authentication is stated to pass through.
10. proxy server according to claim 9, which is characterized in that the authentication module is specifically used for:
It is limited according to the access of the cluster, identity request letter is sent to the client of the user by the headend equipment Breath;
The username and password of the user is received by the headend equipment;
According to the mark of the cluster, the subscriber identity information of the cluster is obtained from Cluster Database;
The user of the user and password are authenticated according to the subscriber identity information of the cluster.
11. proxy server according to claim 10, which is characterized in that the acquisition module is specifically used for:
According to the mark of the cluster, the address of the cluster is obtained from the Cluster Database;
According to the port-mark of the address of the cluster and the service type, to Hadoop described in the corresponding collection pocket transmission The acquisition request of service page;
Receive the Hadoop service page that the cluster is returned according to the acquisition request of the Hadoop service page.
12. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use In:
Judge whether the Content-Type of the Hadoop service page includes JSON character string;
If including whether judging in the Hadoop service page including the URL to be rewritten in predefined list;
If including it is external that the Host of URL to be rewritten described in the Hadoop service page is rewritten as proxy server Domain name, the URL to be rewritten Path in plus the cluster mark and the service type port-mark.
13. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use In:
Judge whether the Content-Type of the Hadoop service page includes JavaScript or CSS;
If including after obtaining the URL rewriting in the Hadoop service page wait rewrite by the way of regular expression matching URL expression formula;
The position Host of the URL expression formula is written into, in the Path of the URL expression formula in the external domain name of proxy server In addition the port-mark of the mark of the cluster and the service type.
14. according to any proxy server of claim 8-11, which is characterized in that the URL rewriting module is specific to use In:
Judge whether the Hadoop service page is html page;
If so, obtain include in the Hadoop service page URL to be rewritten label;
The Host of URL to be rewritten described in the label is rewritten as the external domain name of proxy server, described wait rewrite URL Path in plus the cluster mark and the service type port-mark.
15. a kind of access system of service page, which is characterized in that the system comprises headend equipment and proxy server, institutes It states proxy server to be arranged between the headend equipment and group system, the headend equipment, the client communication with user, For receiving the acquisition request for the Hadoop service page that the user is sent by the client;The Hadoop service page The mark of the cluster where the Hadoop service page to be accessed and the port of service type are carried in the acquisition request in face Mark;And the acquisition request of the Hadoop service page is parsed, obtain the proxy server inside website Address, and according to the address of the proxy server, the acquisition request of the Hadoop service page is forwarded to the agency Server;
The proxy server, with the corresponding cluster communication, described in the user forwarded according to the headend equipment The acquisition request of Hadoop service page obtains the Hadoop service page, and to the URL in the Hadoop service page Be written over processing, and sent to the client of the user by the headend equipment rewrite URL after described in Hadoop service page;The proxy server, specifically using any proxy server of claim 8-14 as above.
CN201610835920.4A 2016-09-20 2016-09-20 The access method and system of service page, proxy server Active CN106169963B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610835920.4A CN106169963B (en) 2016-09-20 2016-09-20 The access method and system of service page, proxy server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610835920.4A CN106169963B (en) 2016-09-20 2016-09-20 The access method and system of service page, proxy server

Publications (2)

Publication Number Publication Date
CN106169963A CN106169963A (en) 2016-11-30
CN106169963B true CN106169963B (en) 2019-07-23

Family

ID=57376361

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610835920.4A Active CN106169963B (en) 2016-09-20 2016-09-20 The access method and system of service page, proxy server

Country Status (1)

Country Link
CN (1) CN106169963B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107358069B (en) * 2017-07-16 2019-12-10 塞纳德(北京)信息技术有限公司 Permission management system based on Hue
CN107818268A (en) * 2017-11-15 2018-03-20 中国联合网络通信集团有限公司 The access control method and server of big data platform
CN111131492A (en) * 2019-12-31 2020-05-08 中国联合网络通信集团有限公司 Node access method and system
CN111274591A (en) * 2020-01-19 2020-06-12 北京百度网讯科技有限公司 Method, device, electronic equipment and medium for accessing Kubernetes cluster
CN111552987A (en) * 2020-04-16 2020-08-18 重庆富民银行股份有限公司 Page access authority control method
CN111542001B (en) * 2020-04-21 2022-02-11 厦门欧万物联科技有限公司 Network system with distributed server clusters and construction method thereof
CN111866124B (en) * 2020-07-17 2022-06-24 北京金山云网络技术有限公司 Method, device, server and machine-readable storage medium for accessing webpage
CN113806008A (en) * 2021-02-02 2021-12-17 北京沃东天骏信息技术有限公司 Cluster access method and device, electronic equipment and readable storage medium
CN113709259B (en) * 2021-10-29 2022-03-25 天聚地合(苏州)数据股份有限公司 Object access method and service system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101938427A (en) * 2010-09-27 2011-01-05 杭州华三通信技术有限公司 Re-directing method and device in global load balance
CN102624918A (en) * 2012-03-30 2012-08-01 北京英富森信息技术有限公司 Proxy access method based on URL (Uniform Resource Locator) rewriting technique
CN103703745A (en) * 2011-07-18 2014-04-02 阿尔卡特朗讯 Method and apparatus for interconnecting a user agent to a cluster of servers
CN104092735A (en) * 2014-06-23 2014-10-08 吕志雪 Cloud computing data access method and system based on binary tree
CN105141632A (en) * 2015-09-21 2015-12-09 北京百度网讯科技有限公司 Method and device used for checking pages
CN105939313A (en) * 2015-09-01 2016-09-14 杭州迪普科技有限公司 State code redirecting method and device
CN107135242A (en) * 2016-02-29 2017-09-05 阿里巴巴集团控股有限公司 Mongodb clusters access method, apparatus and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101938427A (en) * 2010-09-27 2011-01-05 杭州华三通信技术有限公司 Re-directing method and device in global load balance
CN103703745A (en) * 2011-07-18 2014-04-02 阿尔卡特朗讯 Method and apparatus for interconnecting a user agent to a cluster of servers
CN102624918A (en) * 2012-03-30 2012-08-01 北京英富森信息技术有限公司 Proxy access method based on URL (Uniform Resource Locator) rewriting technique
CN104092735A (en) * 2014-06-23 2014-10-08 吕志雪 Cloud computing data access method and system based on binary tree
CN105939313A (en) * 2015-09-01 2016-09-14 杭州迪普科技有限公司 State code redirecting method and device
CN105141632A (en) * 2015-09-21 2015-12-09 北京百度网讯科技有限公司 Method and device used for checking pages
CN107135242A (en) * 2016-02-29 2017-09-05 阿里巴巴集团控股有限公司 Mongodb clusters access method, apparatus and system

Also Published As

Publication number Publication date
CN106169963A (en) 2016-11-30

Similar Documents

Publication Publication Date Title
CN106169963B (en) The access method and system of service page, proxy server
US11601398B2 (en) Multiplexed data exchange portal interface in scalable data networks
US11394805B1 (en) Automatic discovery of API information
CN109314704B (en) Single sign-on and single sign-off functions for multi-tenant identity and data security management cloud services
US11050607B2 (en) Proxy with a function as a service (FAAS) support
CN108259425A (en) The determining method, apparatus and server of query-attack
US20140282464A1 (en) Systems and methods for intercepting, processing, and protecting user data through web application pattern detection
US10187444B2 (en) System and method of automatic generation and insertion of analytic tracking codes
WO2013143403A1 (en) Method and system for accessing website
JP2019133700A (en) System and method for website
US11902328B2 (en) Network device identification
CN106161617A (en) Reverse proxy method based on NODEJS, Reverse Proxy and system
CN106919634A (en) Across the method and web browser of Application share data
CN106789227B (en) A kind of internet behavior analysis method and internet behavior analytical equipment
US20160246994A1 (en) Information collection apparatus and method
CN113507475B (en) Cross-domain access method and device
US12072946B2 (en) Optimizing scraping requests through browsing profiles
CN108287894A (en) Data processing method, device, computing device and storage medium
CN108769189A (en) The access method and equipment of cross-domain resource
CN109274705A (en) Service providing method, apparatus and system based on user identity
US11138463B1 (en) Unsupervised and supervised machine learning approaches to detecting bots and other types of browsers
CN109510799A (en) Page display method, browser client, equipment and storage medium
CN107223329B (en) A kind of dns resolution method, apparatus and network system
CN106888248B (en) For obtaining the method and apparatus of user access activity information
EP3923157B1 (en) Data stream processing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant