JP2014106745A - Web browsing history acquisition system and method, proxy server, and web browsing history acquisition program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire advertisement content information in a Web page while acquiring a Web browsing history on a proxy server.SOLUTION: A proxy server includes: Web browsing history acquisition means which, when a Web page is browsed via the proxy server, records a reception date on the proxy server and a URL into browsing history storage means and stores a received HTML into browsed content storage means as an HTML file; Web page analysis means which analyzes the HTML acquired by the Web browsing history acquisition means to acquire UTL information of an advertisement content; and Web browsing history analysis means which refers to the browsing history storage means to acquire history information having URL information of the advertisement content acquired by the Web page analysis means and records the acquired history information into advertisement distribution history storage means.

Description

  The present invention relates to a web browsing history acquisition system and method, a proxy server, and a web browsing history acquisition program for acquiring browsing history information of a web page browsed by a user, and in particular, an advertisement included when a user browses a web page The present invention relates to a Web browsing history acquisition system and method for acquiring information related to content in a proxy server, a proxy server, and a Web browsing history acquisition program.

  It is necessary to collect advertisement content information displayed during the user's Web browsing behavior in order to verify the advertisement effect of the advertisement content included in the Web page.

  As a system for acquiring browsing history information of a Web page browsed by a user, there is a system that acquires browsing history information by installing software that collects browsing history of a Web page on a PC (for example, see Patent Document 1).

  Moreover, when browsing a Web page via a proxy server, there is a system that collects Web browsing history information and analyzes packet information passing through the proxy server (see, for example, Patent Document 2).

JP 2009-289074 JP 2011-159102 A

  However, in the case of a method of acquiring browsing history information of a Web page at a user terminal as shown in Patent Document 1, advertisement content included in the Web page is acquired as part of the Web page. In order to extract the advertising content information included in the web page, it is necessary to extract the place where the advertisement is posted based on the acquired web browsing history data and acquire the advertising content, but in the user terminal When the advertisement information is extracted by the terminal, there is a problem that the load becomes high in a terminal having low processing performance. In addition, since the location where the advertisement content is posted differs from website to website, it is necessary to analyze the advertisement placement location for each web page, which causes a load due to analysis processing.

  Also, as disclosed in Patent Document 2, when analyzing packet information passing through a proxy server and collecting advertisement information, a proxy server having a high processing speed is required.

  From these, there is a need for a method for efficiently acquiring advertising content information while collecting Web browsing history.

  The present invention has been made in view of the above points, and a web browsing history acquisition system, method, and proxy capable of acquiring advertisement content information in a web page while performing web browsing history acquisition on a proxy server The purpose is to provide a server and Web browsing history acquisition program.

In order to solve the above problems, the present invention (Claim 1) is a Web browsing history acquisition system for acquiring browsing history information of a Web page browsed by a user,
The user terminal shall browse the web page via a proxy server,
The proxy server is
A means for analyzing the acquired HTML file of the content, extracting history information corresponding to the advertisement content, and storing the history information in the advertisement distribution history storage means;

Further, the present invention (Claim 2) is the proxy server,
A Web that records the received date and time and URL at the proxy server in the browsing history storage means when the Web page is browsed via the proxy server, and saves the received HTML as an HTML file in the browsing content storage means Browsing history acquisition means;
Web page analysis means for analyzing the HTML obtained by the Web browsing history acquisition means and acquiring UTL information of advertising content;
Web browsing history analysis means for referring to the browsing history storage means, acquiring history information having URL information of the advertisement content obtained by the Web page analysis means, and recording the history information in the advertisement distribution history storage means; .

Further, the present invention (Claim 3) is the Web browsing history analyzing means,
Means for storing history information received at the nearest time later than the reception date and time acquired by the web page analyzing means in the advertisement delivery history storage means as distribution history information of advertisement content included in the web page; Including.

  By using the present invention, it is possible to acquire advertisement content information in a Web page while acquiring a Web browsing history on a proxy server. In addition, since the proxy server can collect advertising content related to the Web page without analyzing the HTML of the Web page, the processing in the proxy server can be reduced.

It is a system configuration figure in a 1st embodiment of the present invention. It is an example of the web page in the 1st Embodiment of this invention. It is a figure which shows the communication condition on the proxy server in the 1st Embodiment of this invention. It is a block diagram of the proxy server in the 1st Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 shows a system configuration according to the first embodiment of the present invention.

  The user terminal 1 that is the collection target of the web browsing history connects to the Internet via the proxy server 2. At this time, the proxy server 2 has an extended function, and collects the web browsing history and the advertisement content browsing history when the user terminal 1 browses the web page via the proxy server 2, and They are stored in the browsing history storage unit 200 and the advertisement content information storage unit 300.

  FIG. 2 is an example of a Web page according to the first embodiment of the present invention.

  In the Web page, as shown in the figure, the advertisement content is configured to be displayed at various places. Each advertisement is often distributed by an advertisement distribution server of the same domain or an advertisement distribution server of another domain, and the advertisement content is acquired from the advertisement distribution server 3 each time it is displayed on the web browser of the user terminal 1. There is a format that does.

  When a web page request is made from the user terminal 1 to the proxy server 2, the proxy server 2 sends a web page request to the web server 4. In response to the web page request from the proxy server 2, the web page content is transmitted from the web server 4 to the proxy server 2. The proxy server 2 transmits the content of the Web page to the user terminal 1 so that the Web page is displayed on the browser of the user terminal 1. At this time, if the Web page content that arrives at the proxy server 2 from the Web server 4 is saved, the Web browsing history can be collected.

  FIG. 3 shows the communication status on the proxy server in the first embodiment of the present invention. The example in the figure shows the communication status on the proxy server 2 when a web page request / response is made. In the communication on the proxy server 2, a web page request is made to the web server 4. Thereafter, a web page response is made from the web server 4, but arrives at the proxy server 2 within a short time. For this reason, when acquiring the contents that make up a web page, after the web page request occurs, by checking the web content that passed in the peripheral time centering on the time when the corresponding web page arrived, the web page can be efficiently Configuration content can be obtained.

  FIG. 4 shows a configuration of the proxy server in the first exemplary embodiment of the present invention.

  In addition to the Web page request receiving unit 21, the Web page requesting unit 22, the Web page providing unit 23, and the Web page receiving unit 24, the proxy server 2 includes a Web page analysis unit 25, a Web browsing history acquisition unit as a proxy server extension function. 26, and a web browsing history analysis unit 27.

  The web browsing history acquisition unit 26 stores the content received by the web page receiving unit 24 in the web browsing history storage unit 200 as a web browsing history. At this time, it is assumed that received HTML, image data, and the like are stored as files in the browsing content storage DB 220, and the date / time, URL, referrer information at the time of reception, and local path information of the stored HTML or image data file are stored in the history information storage table 230. Record.

  In the Web page analysis unit 25, when HTML is included in the Web browsing history acquired by the Web browsing history acquisition unit 26, the HTML reception date / time information is acquired and the HTML is analyzed, and the Web page is analyzed. URL information of the advertisement placement location included in is acquired. When acquiring the URL information of the advertisement placement location, as the target advertisement content, the advertisement content is read from the advertisement distribution server 3 by a script or iframe (inline frame) in HTML of the Web page. In the case of such an advertisement, since the addresses of the Web server 4 for web pages and the advertisement distribution server 3 are different, the URL of the advertisement placement location can be acquired.

  The web browsing history analysis unit 27 refers to the browsing history information storage table 230 and extracts history information having a URL that matches the URL information of the advertisement acquired by the web page analysis unit 25. At this time, the history information received at the nearest time later than the reception date and time acquired by the Web page analysis unit 25 is used as the advertisement distribution history storage table as the distribution history information of the advertisement content included in the Web page. 210, the reception date / time of the Web page, the reception date / time of the advertisement content, the advertisement URL, the URL at the time of reception, referrer information, the local path information of the stored content, etc. are stored in the advertisement distribution history storage table 210. .

  When there are a plurality of user terminals 1 connected to the proxy server 2, the user is identified in the browsing history information storage table 230 and the advertisement distribution history storage table 210 so that the Web browsing history can be classified by user. Information may be described.

  Of the contents received by the web page receiving unit 24 in FIG. 4, only the contents useful as the web browsing history information and the advertisement distribution history information may be acquired by the web browsing history acquisition unit 26. For example, streaming content or the like may be excluded from acquisition targets. Furthermore, the acquisition target may be changed for each Web page, or may be managed using an acquisition target content management table or the like.

[Second Embodiment]
In this embodiment, an example in which advertisement distribution server information is considered will be described.

  The system configuration and the proxy server configuration in the present embodiment are the same as those in the first embodiment.

  A server that distributes advertisement content to a Web page is called an advertisement distribution server. Since the number of addresses of the advertisement distribution server 3 is only a finite number, the address information of the advertisement distribution server 3 can be stored as a DB. By utilizing the address information of the advertisement distribution server 3, it becomes possible to collect the advertisement information in the Web page more efficiently. In reality, since the advertisement distribution server 3 has only a manageable number of addresses, by creating a URL table of the advertisement distribution server 3 in advance, an advertisement can be obtained by referring to the URL table. You can get the URL of the place.

  Therefore, in the first embodiment described above, the Web page analysis unit 25 of the proxy server 2 acquires URL information from the advertisement placement location of the HTML acquired by the Web browsing history acquisition unit 26. When the address of the advertisement distribution server 3 is included in the analysis target HTML in the unit 25, the history information having the advertisement distribution server address is referred to from the vicinity of the reception date and time of the HTML in the browsing history information storage table 230 and received. By storing the history information at the closest time later than the date and time as the advertisement distribution history information in the advertisement distribution history storage table 230, it is possible to collect the advertisement content information posted in the web page. However, the above “closest time later than the reception date and time” is included in a certain time range. As the time range, the arrival time information from the advertisement distribution server 3 is collected and the average value is obtained, so that the average time range until the arrival of the advertisement content can be obtained.

  Note that the arrival time information from the advertisement distribution server 3 may vary depending on the time zone and the day of the week. Therefore, a mode value or an average value for each time zone or day of the week may be used.

[Third Embodiment]
The system configuration and the proxy server configuration in the present embodiment are the same as those in the first embodiment.

  In the above-described embodiment, only the distribution history of the advertisement content is stored. However, the Web page analysis unit 25 of the proxy server 2 acquires the position information of the advertisement placement location of each Web page as XPath, and distributes the advertisement. The XPath may be stored in the history storage table 230 together.

  As a result, it is possible to record at which position in the Web page the advertisement content to be posted has been distributed to the user terminal 1.

[Fourth Embodiment]
The system configuration and the proxy server configuration in the present embodiment are the same as those in the first embodiment.

  When a cache stored in the web browser of the user terminal 1 is viewed, a web page request is not generated for the proxy server 2, and thus the web page is not received on the proxy server 2. However, the advertisement content is requested to the advertisement distribution server 3 every time it is displayed on the web browser. In this case, the Web page is not received on the proxy server, but the advertisement content is received. Therefore, it is difficult to determine which Web page the advertisement content is for.

  Therefore, in the present embodiment, an example of a method for storing the advertisement distribution history when the user terminal 1 accesses the cache of the Web browser is shown.

  First, an extended function is added to the Web browser of the user terminal 1 to acquire whether a page transition event has occurred due to the browser cache. In the browser extension function, the URL of the transitioned Web page and the display completion date and time are acquired and transmitted to the proxy server extension function as transition information of the Web browser.

  In the proxy server extended function, the web browsing history analysis unit 26 analyzes the transition information of the web browser, and extracts browsing history information acquired around the display completion date and time. Among the browsing history information, the history information of the advertisement content distributed from the advertisement distribution server 3 is handled as the advertisement distribution history information.

  Note that Web browser transition information may be collected only when the browser cache is browsed for the extended functions of the Web browser. In addition, regarding the target Web page, if there is XPath information of the advertisement placement location, the URL information of the location defined by XPath may be acquired and stored as the advertisement URL information in the Web browser transition information. Based on the Web browser transition information transmitted to the proxy server, history information that matches advertisement URL information existing around the transition date and time may be handled as advertisement distribution history information.

  The present invention constructs the operation of each component of the proxy server 2 used as the above-mentioned Web browsing history acquisition device as a program and distributes it via a network, or is used as a Web browsing history acquisition device. It can be installed and executed on a computer.

  The present invention is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the claims.

1 User terminal 2 Proxy server 3 Advertisement distribution server 4 Web server 21 Web page request receiving unit 22 Web page requesting unit 23 Web page providing unit 24 Web page receiving unit 25 Web page analyzing unit 26 Web browsing history acquiring unit 27 Web browsing history analyzing Unit 200 Web browsing history storage unit 210 advertisement distribution history storage table 220 browsing content storage DB
230 browsing history information storage table 300 advertisement content information storage unit

Claims (8)

A web browsing history acquisition system that acquires browsing history information of web pages browsed by a user,
The user terminal shall browse the web page via a proxy server,
The proxy server is
A Web browsing history acquisition system comprising means for analyzing the acquired HTML file of the content, extracting history information corresponding to the advertisement content, and storing it in the advertisement distribution history storage means. The proxy server is
A Web that records the received date and time and URL at the proxy server in the browsing history storage means when the Web page is browsed via the proxy server, and saves the received HTML as an HTML file in the browsing content storage means Browsing history acquisition means;
Web page analysis means for analyzing the HTML obtained by the Web browsing history acquisition means and acquiring UTL information of advertising content;
Web browsing history analysis means for referring to the browsing history storage means, obtaining history information having URL information of the advertising content obtained by the Web page analysis means, and recording it in the advertisement distribution history storage means;
The web browsing history acquisition system according to claim 1, comprising: The web browsing history analysis means is:
Means for storing history information received at the nearest time later than the reception date and time acquired by the web page analyzing means in the advertisement delivery history storage means as distribution history information of advertisement content included in the web page; The web browsing history acquisition system according to claim 2, including the system. A web browsing history acquisition method for acquiring browsing history information of a web page viewed by a user,
In systems with user terminals, proxy servers, and web servers,
The user terminal shall browse the web page via the proxy server,
In the proxy server,
A Web browsing history acquisition method comprising: analyzing the acquired HTML file of the content, extracting history information corresponding to the advertisement content, and storing the history information in an advertisement distribution history storage unit. In the proxy server,
A Web that records the received date and time and URL at the proxy server in the browsing history storage means when the Web page is browsed via the proxy server, and saves the received HTML as an HTML file in the browsing content storage means Browsing history acquisition step;
Web page analysis step of acquiring the UTL information of the advertising content by analyzing the HTML obtained in the Web browsing history acquisition step;
Referencing the browsing history storage means, obtaining history information having URL information of the advertising content obtained in the Web page analysis step, and recording in the advertisement distribution history storage means, a Web browsing history analysis step;
The Web browsing history acquisition method according to claim 4, wherein: In the web browsing history analysis step,
The history information received at the closest time later than the reception date and time acquired in the Web page analysis step is stored in the advertisement distribution history storage means as distribution history information of advertisement content included in the Web page. 5. Web browsing history acquisition method according to 5. A proxy server in a system for obtaining browsing history information of a web page viewed by a user,
A Web that records the received date and time and URL at the proxy server in the browsing history storage means when the Web page is browsed via the proxy server, and saves the received HTML as an HTML file in the browsing content storage means Browsing history acquisition means;
Web page analysis means for analyzing the HTML obtained by the Web browsing history acquisition means and acquiring UTL information of advertising content;
Web browsing history analysis means for referring to the browsing history storage means, obtaining history information having URL information of the advertising content obtained by the Web page analysis means, and recording it in the advertisement distribution history storage means;
A proxy server. Computer
A Web browsing history acquisition program for functioning as each means constituting the proxy server according to claim 7.

Images