WO2001024057A2 - Outil de recherche automatique utilisant un serveur proxy - Google Patents

Outil de recherche automatique utilisant un serveur proxy Download PDF

Info

Publication number
WO2001024057A2
WO2001024057A2 PCT/US2000/026739 US0026739W WO0124057A2 WO 2001024057 A2 WO2001024057 A2 WO 2001024057A2 US 0026739 W US0026739 W US 0026739W WO 0124057 A2 WO0124057 A2 WO 0124057A2
Authority
WO
WIPO (PCT)
Prior art keywords
participant
research
website
proxy server
research method
Prior art date
Application number
PCT/US2000/026739
Other languages
English (en)
Other versions
WO2001024057A3 (fr
Inventor
Douglas King Van Duyne
James Anthony Landay
Mark Newman
Original Assignee
Netraker Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/407,802 external-priority patent/US6859784B1/en
Application filed by Netraker Corporation filed Critical Netraker Corporation
Priority to AU77313/00A priority Critical patent/AU7731300A/en
Publication of WO2001024057A2 publication Critical patent/WO2001024057A2/fr
Publication of WO2001024057A3 publication Critical patent/WO2001024057A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Definitions

  • the present invention relates generally to computer systems and more particularly to methods and apparatus for gathering research data for a website.
  • the explosion of the Internet has provided new business opportunities and markets for a broad spectrum of industries.
  • the Internet provides unprecedented opportunities for businesses to reach customers by providing a website that describes a business 's products or services.
  • the appeal of the website often can influence purchase decisions by a consumer.
  • the appeal is a measure of both the subject matter, the method of presentation and other intangible factors. If a 5 website includes content that is appealing to a consumer, the consumer is more likely to purchase the services or products advertised. Advertising has long been used in other media forms in order to attract purchasers.
  • the web is no different.
  • the success of a product or service on-line is generally measured in sales. However, reasons for closing a sale vary. Some sales will complete irrespective of the environment. Other customers may have to be convinced that the 0 product or service is both valuable and necessary.
  • the website can be a powerful tool in the persuasion process.
  • a website may be used to convey information, separate and apart from a sales environment. Success for an informational website may be measured in terms of the number of users that come to the website and the amount of time they stay. How long a user stays at a
  • 25 website can be influenced by the appeal of the website. Again, the appeal is a measure of both the content and the method of presentation.
  • a web page may include a request for feedback and provide users with an ability to send compliments and, more often, complaints back to the website sponsor. While these means are helpful, the information received may be biased or not representative of the general appeal of the website and therefore of little help to the website sponsor. Alternatively, a user may be asked to participate in a survey. Often, the surveys are long and unfocused. Just as with the feedback information, the information received can be biased or unreliable.
  • the invention provides a method for automatically gathering research data for a website and includes steps for identifying questions in a question set that are a measure of a research metric to be gathered for the website and embedding one or more instructions in a first question in the question set.
  • the instruction includes instructions to record participant response data using a proxy server disposed between the participant and the website.
  • the method includes initiating a research test including providing a first question in the question set to the participant and gathering response data as each question in the question set is answered by the participant.
  • aspects of the invention can include one or more of the following features.
  • the research data can be selected from usability, product and organizational research.
  • the gathering step can be performed without a permission of a website's sponsor.
  • the method can further include forming questions in a plurality of question sets that are a measure, respectively, of a plurality of research metrics to be gathered for the website and partitioning each question set into a plurality of subsets of questions.
  • the method can further include only presenting a subset of questions for each question set to each participant including gathering responses from each participant to the questions presented for each research metric and combining the participant's responses to produce a plurality of indexes, one for each of the research metrics. Only a subset of the questions for one or more question sets can be presented to each participant including gathering responses from each participant to the questions presented for each research metric and combining the participant's responses to produce a plurality of indexes, one for each of the research metrics.
  • the method can further include, at the participant's web browser, extracting the embedded instruction from the first question received and generating a request to load a page from the website including the embedded instruction, transmitting the request from the participant's web browser to the proxy server and enabling a recorder at the proxy server to record participant response data.
  • Included with the embedded instruction can be an IP address for the proxy server and a code designating the website.
  • the method can further include determining the IP address for the website from the code and forwarding the request to the website.
  • the method can further include receiving back from the website a page responsive to the request and forwarding the page to the participant's web browser.
  • a code Prior to forwarding the page to the participant's website, a code can be embedded in the page to measure a metric.
  • the code can include an engine for recording participant responses generated at the participant's web browser. The participant responses can be selected from the group of audio, video, gestural, facial, mouse, pen, joystick and keystroke responses.
  • the code can include an engine for capturing a screenshot of a user interface presented to the participant.
  • the method can further include embedding one or more instructions in a last question in the question set where the instruction causes a recording device to stop recording participant response data using the proxy server and to initiate the download of the gathered response data to a centralized research site for analysis.
  • the method can further include incentivizing a candidate to become a participant including identifying a reward to be given to a participant upon completion of participation in the research test.
  • the method can further include characterizing research participants into one or more types and customizing the reward for each participant type.
  • the method can further include storing historical results for the research metric and a representation of the website or portion of the website to which the metric pertains, determining that the website has changed, gathering new responses from participants to the questions presented for the research metric, combining the participant's responses to produce an index of the research metric for the changed website and comparing the indexes for the website against the changed website to measure a change of the research metric between the two.
  • the method can further include recording at the proxy server each page request received from a participant.
  • the method can further include recording at the proxy server each page received from the website prior to forwarding the page to the participant's web browser.
  • the method can further include recording participant response data at the proxy server and, after the research test has been completed by the participant, downloading the participant response data to a centralized research site for analysis.
  • the method can further include compiling answers to each question at the participant's computer and, after the research test has been completed by the participant, downloading the participant response data to a centralized research site for analysis.
  • the method can further include compiling answers to each question at the participant's computer, forwarding the participant responses to the proxy server for recording and, after the research test has been completed by the participant, downloading the participant response data to a centralized research site for analysis.
  • the participant response data can be analyzed including playing back the participant response data in real time.
  • the response data and a visualization of the website can be played back concurrently at a centralized research site to analyze of the response data.
  • the participant response data can be played back at a faster rate than a recording rate for the participant response data.
  • the faster rate can be twice the recoding rate.
  • the proxy server can be located at a Internet service provider accessed by the participant for linking to the website.
  • the proxy server can be located at a hosting server that couples the website to the Internet.
  • the participant can be coupled to the web site using a PDA and the proxy server can be located at a PDA proxy that is accessed by the participant for linking to the website.
  • the participant can be coupled to the web site using a PDA that includes a PDA proxy for linking the PDA to the Internet and the proxy server can be coupled between the PDA proxy and the Internet.
  • the participant can be coupled to the web site using a wireless telephone and the proxy server can be located at a WAP proxy that is accessed by the participant for linking to the website.
  • the participant can be coupled to the web site using a wireless telephone that includes a WAP proxy for linking the wireless telephone to the Internet and the proxy server can be coupled between the WAP proxy and the Internet.
  • aspects of the invention may include one or more of the following advantages.
  • Research can be automatically gathered from a website.
  • the research can include website marketing, usability, product and organizational research.
  • the research can be performed with or without the permission of the website sponsor.
  • User responses and interaction including audio and video can be recorded and analyzed to allow for easy resolution of usability problems.
  • FIG. 1 is a schematic block diagram of a web site research tool.
  • FIG. 2 is a flow diagram of a process for gathering research.
  • FIG. 3 is a flow diagram of a process, from the perspective of the participant, for gathering research.
  • FIG. 4 is a schematic block diagram for an Internet service provider based web site research tool.
  • FIG. 5 is a schematic block diagram of a hosting server based website research tool.
  • the system includes a proxy server 102, a client web server 104, a web browser 106, and a test server 108.
  • Web browser 106 is associated with a user's personal computer and allows access to a client web server site associated with the client web server 104.
  • client web server 104 Associated with the client web server 104 is an Internet protocol (IP) address.
  • IP Internet protocol
  • the IP address for the client web server 104 can be provided to or is otherwise known by proxy server 102.
  • An IP address for the proxy server 102 is provided or otherwise made known to the web browser 106 (user) and can be associated with the client web server IP address.
  • a user generates requests that are sent to proxy server 102 (to be forwarded to client web server 104) that include the IP address of the proxy server and a code for designating a particular client web server 104.
  • proxy server 102 can service plural client web servers 104, each designated by an associated code.
  • web browser 106 requests access to a page associated with the client's web site, located at client web server 104.
  • the 5 web browser generates a request/(activates a link) to the client web server 104 through proxy server 102. More particularly, the request includes a pointer to the client web server site through the proxy server IP address.
  • Proxy server 102 forwards or communicates the page request to the client web server 104.
  • Client web server 104 responds to the request providing, for example, a page of information, back to proxy server 102 for transmission back to the individual end user.
  • code may be inserted into the material returned from the client web server producing a modified page. The modified page is then provided to the web browser 106.
  • the modified page includes code for conducting research.
  • the code when inserted into the returned page, allows for research on a client's site without requiring the client site to insert any special code in their own web page.
  • Codes for conducting research 15 are described in greater detail in co-pending application entitled “Automated Research Tool", filed September 28, 1999 and assigned United States Patent Application serial number, 09/407,802, the contents of which are expressly incorporated herein by reference.
  • proxy server 102 includes a screening mechanism 110 for screening particular requests that are received from a web browser 106.
  • Screening mechanism 20 110 can include a screening list defining a criteria to screen requests. If a particular request satisfies the screening criteria, then proxy server 102 can invoke an associated action (depending on the criteria).
  • proxy server 102 inserts codes into requests to be forwarded to the client web server 104.
  • proxy server 102 uses the criteria to select which returned pages are to be modified. 25
  • either a special code or no code can be inserted in pages returned from the client web server for ultimate transfer to the web browser.
  • the code can be in the form of a recorder or other means for recording information associated with the actions of the user or web browser 106.
  • the code gathers and provides data to test server 108.
  • the data provided to test server 108 can be of the form of keystrokes, URLs associated with the pages that the web browser links to or other data.
  • proxy server 102 transforms each page request received prior to passing it on to an associated client web server 104.
  • the transformation may include the insertion of other information or request data to the client web server 104.
  • information can be appended to the request and returned to the web browser as part of the returned page.
  • a cookie can be appended to the request that is forwarded onto to the client web server. The cookie can in turn be attached to the returned page from the client web server 104 and forwarded in normal course through the proxy server 102 to the web browser 106.
  • test server 108 initiates a test by providing the IP address for a site to be reviewed to the web browser (user). Alternatively, the user may access the client server web site through a link on a web page or by other means. In each case, access to the client web server web site after this initiation is through proxy server 102.
  • the research gathering process begins when a first test question is sent to the user (204). In one implementation (the stand alone mode), the test questions can be provided by or through proxy server 102. In this configuration, the proxy server can initiate a research project upon receipt of a page request for the client web server' web site.
  • Test questions can be stored locally at proxy server 102 or alternatively can be stored remotely.
  • test server 108 can provide test questions either directly or indirectly (through proxy sever 102) to the user of web browser 106.
  • the test questions can be of the form of interrogatories concerning a particular web site or alternatively, can be an instruction for the user to perform a particular task at a particular web site (i.e., the client web server site).
  • the question includes an embedded instruction to the proxy sever 102, the client web server 104 or both.
  • the test question includes an embedded instruction directed to proxy server 102 to record information relating to the question.
  • the information recorded is input received from the web browser 106.
  • Client input including key strokes and URL's can be recorded as received by the proxy server 102.
  • actual web pages returned from the client web server are recorded.
  • other information including user parameters are recorded by proxy server 102.
  • the user parameters can include screen resolution, screen size and browser window size.
  • the question includes an embedded instruction to insert code into web pages returned by client web server 104.
  • the modified pages can be forwarded to the user.
  • the returned pages from the client web server 104 are modified to include code to detect keystrokes and other actions of the user executed when answering the question or performing the designated task.
  • the code can include instructions for recording the user input and forward the user input to the proxy server 102 or directly to the test server 108 as appropriate.
  • the code can include instructions to record audio, video (including facial, gestural, mouse, pen or joystick responses) or other user input.
  • the code can include instructions to measure the speed at which pages or other web based activities are performed at the user's computer.
  • Test server 108 can be of the form of a centralized research site that includes tools for constructing, gathering and analyzing research. Alternatively, test server 108 may only be used to gather research, leaving the construction and analysis operations to a third party.
  • the gathering of research includes the execution of a research project.
  • each research project includes a questionnaire.
  • the questionnaire defines a set of questions or tasks that are to be performed by the participants to the research project.
  • the questions are of the form of index questions and benchmark questions. Index questions gather information specific to a particular site and produce a measurable result, typically of the form of a numeric rating.
  • index refers to the rating assigned by the participants to a particular index category. The rating is measured through the responses received from the participants of the research project. Examples of categories of index questions are usability, site satisfaction, retention, brand value, service, content and community indexes. Usability is a measure of a web site's ease of use as judged by the site's visitors. Site satisfaction refers to the overall satisfaction of the website as judged by the site's visitors.
  • Retention is a measure of the likelihood that a site visitor will perform a predefined action.
  • Example of retention categories include likelihood the visitor will return to the website, use the product, tell friends or associates or purchase a product.
  • the brand value index category is a measure of the appeal of the website to a visitor. Distinguished from the satisfaction index, the brand value index is more of an assessment as to the promises made, or the marketing and images that are used in the website in marketing the product or service.
  • the service index is a measure of the satisfaction that the visitor finds as to whether or not the products or services that are being offered will accomplish the stated purpose and whether or not there is a belief that the offerings are in fact valuable.
  • the content index is a measure of the satisfaction of the visitor to the content presented on the site, that is, the information provided about the product or service.
  • the community index is a measure of the community impact for a website. Fostering a sense of information and idea sharing as well as the opportunity to develop mutual learning opportunities among a site's visitors and between visitors has been one of the hallmarks of currently successful sites. The community index attempts to measure the impact of the website from this unique perspective.
  • Benchmark questions gather information about the participant. Benchmarks can be used as screening factors to determine which candidates should be selected to be participants in a particular research project. For example, if the customer is seeking to get feedback for a particular site from people that live in the south, that are over the age of 60, then the responses to the benchmark questions can be used to screen in (or out) participants.
  • the categories of benchmark questions include audience identifier, lifestyle, demographics and computing environment. Audience identifier questions are used to identify some detail of the audience, other than demographics, that is tied to the likes and dislikes of a particular participant.
  • Lifestyle questions can be used to determine the background or lifestyle from the perspective of what is important to the particular participant.
  • Demographics questions can be used to screen for gender, age, country, language, education and other vital visitor statistics.
  • Computing environment questions can be used to screen for a participant's experience associated with a computer or with a particular computing environment as well as the participant's hardware, software or other computing experience.
  • the user is directed to go to a web site at the client web server 104 and the user generates, and the proxy server receives, a request for the site (206).
  • the web page requested by the web browser is returned to the web browser through the proxy server 102 as described above (208).
  • responses are recorded (either locally at the web browser or at the proxy server 102) for forwarding to the test server 108 (210).
  • Test server 108 can playback the questions, responses and the information gathered by the various recorders to evaluate the client web server's site.
  • the playback can include screen shots viewed by the user shown in real time. Alternatively, the playback can be accelerated (e.g., 2x or 4x normal rate) so that results can be gathered quickly.
  • the results can be aggregated, visualized graphically and submitted to a third party for automatic analysis.
  • the results can be analyzed graphically by comparing the retrieved data with an "expert" trace to determine where a user had difficulty in completing a task. Alternatively, results from users can be compared to determine deviation among the users.
  • a process 300 from the perspective of the participant is shown for gathering research.
  • the process begins with the receipt of an invitation (302).
  • the invitation can be sent directly to the candidate, or can be displayed on a website (where candidates are selected from website visitors).
  • the candidate links to the client web server via the proxy server (304).
  • the link is provided as part of the invitation and can be of the form of a URL.
  • the participant completes the research questions and tasks (if any) (306).
  • a participant is given a subset of a questions to answer in an index set.
  • the participant can be given a subset of the questions in each index set to answer.
  • the participant completes a benchmark question set(s) (308).
  • a participant is provided a subset of questions from each benchmark type. The test data and any recorded information is uploaded to the proxy server or directly to the test server (310). Thereafter, the participant can collect an identified reward (312) and the process ends.
  • the results received at test server 108 or proxy sever 102 can be interpreted in real time to determine a next question or instruction to generate/send to the user.
  • the proxy server can be located at an Internet service provider (ISP) for a user. This configuration is shown in Fig. 4.
  • ISP Internet service provider
  • a user's computing device 400 is coupled to the Internet 404 through server 402.
  • Server 402 can be of the form of a proxy server that includes all of the attributes of proxy server 102 described above.
  • Server 402 can include a screening mechanism for screening particular requests from users directed to a client web server's 406 web site, or alternatively can be used to perform research for all requests to a given web site. The research gathering can be performed without the knowledge or permission of the client web sever 406.
  • server 402 can provide research questions to the user or alternatively can be linked to a test server which in turn can provide the research materials.
  • the test server can interact directly with the user. Code included in page requests from the user can be used to initiate recording operations at server 402.
  • the user's computing device can be of the form of a personal digital assistant (PDA)
  • the PDA browser may be configured to link to a PDA proxy for access to the Internet.
  • the PDA proxy may translate requests received from the PDA and forward them on to the Internet.
  • the PDA proxy may format responses received from the Internet for linking back to the PDA.
  • the linking can be wireless or wired through a host computer.
  • the PDA proxy may include functionality that is similar to proxy sever 102. That is, the PDA proxy may include screening mechanisms and devices for conducting research for PDA users that access a particular client web sever web site.
  • the PDA proxy may in turn be coupled through a proxy server (e.g., an ISP as discussed above with regard to FIG. 4) to the Internet.
  • a proxy server e.g., an ISP as discussed above with regard to FIG. 4
  • the user ' s computing device 400 can be of the form of a wireless telephone and include a small screen version of a browser.
  • the browser may be configured to link to a wireless access protocol (WAP) proxy for access to the Internet.
  • WAP proxy is a specialized proxy that supports HDML for small screen devices.
  • the WAP proxy may translate requests received from the wireless telephone and forward them on to the Internet.
  • the WAP proxy may format responses received from the Internet for linking back to the wireless telephone.
  • the WAP proxy may include functionality that is similar to proxy sever 102. That is, the WAP proxy may include screening mechanisms and devices for conducting research for wireless telephone user's that access a particular client web sever web site.
  • the WAP proxy may in turn be coupled through a proxy server (e.g., an ISP as discussed above with regard to FIG. 4) to the Internet.
  • a proxy server e.g., an ISP as discussed above with regard to FIG. 4
  • the proxy server can be located at a hosting service (host) for a client web server. This configuration is shown in Fig. 5.
  • a user's computing device 500 is coupled to the Internet 502.
  • Client web server 506 is coupled to the Internet 502 through a hosting server 504.
  • Server 504 can be of the form of a proxy server that includes all of the attributes of proxy server 102 described above.
  • Server 504 can include a screening mechanism for screening particular requests from users directed to a client web server's 506 web site, or alternatively can be used to perform research for all requests to a given web site. The research gathering can be performed without the knowledge or permission of the client web sever 506.
  • server 504 can provide research questions to the user or alternatively can be linked to a test server which in turn can provide the research materials.
  • the test server can interact directly with the user. Code included in page requests from the user can be used to initiate recording operations at server 504.
  • a user is selected to be a participant in a research project by random selection from among the user's that visit a particular web site.
  • a selected participant is included in a single research project for the given site.
  • a user can be a participant in a global research project that monitor's the users feedback for more than one web site.
  • a user's web browser can be configured to always route requests to the Internet through proxy server 102.
  • whenever the user accesses a web site from a preselected group of web sites then research is gathered as described above. Alternatively, research can be gathered each time the user accesses the Internet.
  • the research can be of the form of diary events.
  • Test server 108 can include an invitation engine for selecting participants to be included in a research project.
  • the invitation engine can be used to locate participants.
  • Research participants may be provided by a user (e.g., the website owner provides the participants), selected from a list of participants (an approved list) or candidates can be randomly invited to join in the research.
  • a web site can include an invitation means.
  • the invitation means generates invitations to be sent to participants using a pop-up palette. Various forms of invitations are stored on the pop-up palette. The palette can be automatically initiated at various times to invite visitors to join in a research project.
  • Test server 108 can include various tools to construct research projects. Tools for constructing research projects are described in greater detail in copending application entitled "Automated Research Tool”.
  • a recorder is downloaded to a participant prior to commencing research questioning.
  • the system provides for multilevel screening and recording of the interaction of the users.
  • the recorder can be configured to record keystrokes, screen progression, audio and video at the participant's site.
  • the recorder can automatically bookmarks recordings. Recording can be initiated upon receipt of a command from the run-time module 104.
  • the recorder also can stop recording and upload, back to the run-time module 104, data retrieved on command (from the run-time module).
  • test server 108 includes an intelligence center to share customer intelligence and team management information. An example of an intelligence center is discussed in greater detail in copending application entitled "Automatic Research Tool".
  • each balloter is provided a subset of one or more index question sets as well as one set or more of benchmark questions.
  • Each balloter generates a number rating for a website page in one or more of the index sets. A single number can be used to summarize the usability, retention, etc., for the particular index.
  • the benchmark is a measure of the deviation from an Internet standard and provides a percentage in terms of the deviation for the particular user group. Correlations can be drawn by a correlation engine in the test server 108 between the benchmark data and the index data in order to provide the customers with more specific information.
  • the correlator engine can be used to provide a longitudinal measure of customer ratings.
  • a longitudinal customer ratings measurement we refer to the system's ability to gather information associated with the website over a period of time. Customer ratings can then be measured in a particular group over a particular time. The results can be gathered and built into a database and the database can be updated to provide a strategically sound result.
  • Various research tools can be invoked by the team members using the intelligence center.
  • tools include bug tracker, competition tester, site tester, performance measurer, tasker, action tracker, search services morale meter, organization tool, product tool and service tool.
  • Bug tracker can be used to ensure that a website is free from costly and embarrassing bugs.
  • the tracker can be invoked for one time operation or invoked on a regular basis to screen a customer's website.
  • Competition tester is a tool that can be used to invoke research on a competitors website.
  • a competitor's strengths and weaknesses can be measured and leveraged by the customer using the index data derived for a competitors site. Changes in the competitor's site can be monitored and correlation data derived reflecting changes in the usability of the competitor's site.
  • Site tester is a tool designed to automatically test a customer's site for common errors. In one implementation, tests are run for resolving domain names (DNS entries), missing pages, missing graphics, poor response and other common errors.
  • DNS entries domain names
  • Performance measurer provides diagnostic information for problems associated with performance for a particular site.
  • the tool provides performance measurement diagnostics as well as site screen capture and review features.
  • Tasker is a tool for performing task based research. Tasker allows the user the ability to set up tasks for a website including the identification of scenarios of entry and task research to see if different scenarios are being satisfied.
  • Action tracker is used to measure workflow for revisions or other tasks associated with the collaboration services.
  • the tracker can be used to track organizational issues and requests for problems for a particular customer and provides managed workflow for an organization.
  • Search services provide a comprehensive search option capability including search operators and dictionaries for ⁇ customer's website.
  • the search service tool can be inserted as a script in a customer's website. Once inserted, the service runs on a remote server, but provides search results to the website's visitors.
  • the search service delivers search results and queries users as to their satisfaction with the results.
  • the feedback can be used to tune the search engine response.
  • the website operator can use result statistics and performance ratings (feedback) to improve the user's website experience.
  • Morale meter is used to measure the morale for a team.
  • the morale meter provides a mechanism for team members to report their morale using one or more graphical indicators, so that managers and teammates can assess the morale of the team and take action as appropriate to boost team morale.
  • Organizational tool provides tools for polling employees of an organization and delivering aggregate team member assessments of company or project progress and organizational efficiencies.
  • Product tool provides a mechanism for engaging customers in an ongoing dialogue about company products.
  • the tool provides product designers and management better insight into their customers needs and desires and includes feedback on products and areas for improvement.
  • Service tool provides features similar to the product tool, but is directed to company services.
  • Research may be gathered about a customer's own website or alternatively, may be gathered about another website. Customer rating research can be run against a competitor's website. Customer rating information can be retrieved for the competitor's site by doing the same kinds of screening both based on index as well as benchmarks.
  • the particular site is identified and participants can be selected from the visitors to the customer's website or by other means. For example, a participant may be located at a customer's website and then, there afterwards, may be asked questions about a second or different site. A pop-up menu may be used at the site location to query a user as to whether or not a user may desire to be a participant in the study.
  • the present invention has been described in terms of specific embodiments, which are illustrative of the invention and not to be construed as limiting. Other embodiments are within the scope of the following claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Databases & Information Systems (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne un procédé et un appareil pour recueillir automatiquement des données à partir d'un site web. Le procédé consiste à identifier un ensemble de questions, qui se présentent comme une mesure de la métrique de recherche à recueillir pour le site web, et à enfouir une ou plusieurs instructions dans une première question faisant partie de l'ensemble de questions. L'invention comprend des instructions pour enregistrer des données relatives aux réponses des participants au moyen d'un serveur proxy placé entre le participant et le site web. Le procédé consiste à lancer un test de recherche, c'est-à-dire à soumettre au participant une première question faisant partie de l'ensemble de questions et recueillir les données de réponse à mesure que le participant répond à chacune des questions faisant partie de l'ensemble.
PCT/US2000/026739 1999-09-28 2000-09-28 Outil de recherche automatique utilisant un serveur proxy WO2001024057A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU77313/00A AU7731300A (en) 1999-09-28 2000-09-28 Automated research tool including proxy server

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US09/407,802 US6859784B1 (en) 1999-09-28 1999-09-28 Automated research tool
US09/407,802 1999-09-28
US53946400A 2000-03-30 2000-03-30
US09/539,464 2000-03-30

Publications (2)

Publication Number Publication Date
WO2001024057A2 true WO2001024057A2 (fr) 2001-04-05
WO2001024057A3 WO2001024057A3 (fr) 2003-12-04

Family

ID=27020013

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/026739 WO2001024057A2 (fr) 1999-09-28 2000-09-28 Outil de recherche automatique utilisant un serveur proxy

Country Status (2)

Country Link
AU (1) AU7731300A (fr)
WO (1) WO2001024057A2 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120131476A1 (en) * 2010-05-26 2012-05-24 Xperience Consulting, SL System and method for unmoderated remote user testing and card sorting
WO2012166036A3 (fr) * 2011-06-03 2013-02-21 Stocklassa Jan Système et procédé de suivi de personnes
US11068374B2 (en) 2010-05-26 2021-07-20 Userzoom Technologies, Inc. Generation, administration and analysis of user experience testing
US11348148B2 (en) 2010-05-26 2022-05-31 Userzoom Technologies, Inc. Systems and methods for an intelligent sourcing engine for study participants
US11494793B2 (en) 2010-05-26 2022-11-08 Userzoom Technologies, Inc. Systems and methods for the generation, administration and analysis of click testing
US11544135B2 (en) 2010-05-26 2023-01-03 Userzoom Technologies, Inc. Systems and methods for the analysis of user experience testing with AI acceleration
US11562013B2 (en) 2010-05-26 2023-01-24 Userzoom Technologies, Inc. Systems and methods for improvements to user experience testing
US11909100B2 (en) 2019-01-31 2024-02-20 Userzoom Technologies, Inc. Systems and methods for the analysis of user experience testing with AI acceleration
US11934475B2 (en) 2010-05-26 2024-03-19 Userzoom Technologies, Inc. Advanced analysis of online user experience studies

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998026571A2 (fr) * 1996-12-11 1998-06-18 At & T Corp. Procede et appareil de taxation sure et verifiable pour reseaux de communications
WO1998045793A1 (fr) * 1997-04-08 1998-10-15 Shopnow.Com Inc. Procede et systeme d'injection de code afin d'incorporer de maniere conditionnelle une composante d'interface utilisateur dans un document html
US5848396A (en) * 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
WO1999045489A1 (fr) * 1998-03-02 1999-09-10 Nfo Worldwide, Inc. Procede et appareil pour automatiser la conduite d'enquetes sur un systeme reseaute

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5848396A (en) * 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
WO1998026571A2 (fr) * 1996-12-11 1998-06-18 At & T Corp. Procede et appareil de taxation sure et verifiable pour reseaux de communications
WO1998045793A1 (fr) * 1997-04-08 1998-10-15 Shopnow.Com Inc. Procede et systeme d'injection de code afin d'incorporer de maniere conditionnelle une composante d'interface utilisateur dans un document html
WO1999045489A1 (fr) * 1998-03-02 1999-09-10 Nfo Worldwide, Inc. Procede et appareil pour automatiser la conduite d'enquetes sur un systeme reseaute

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BATINIC W: "How to make an internet-based survey" PROCEEDINGS SOFTSTAT. CONFERENCE ON THE SCIENTIFIC USE OF STATISTICAL SOFTWARE, XX, XX, 1997, pages 125-132, XP002109493 *
FRANKLIN M K ET AL: "Auditable metering with lightweight security" FINANCIAL CRYPTOGRAPHY. INTERNATIONAL CONFERENCE, XX, XX, 24 February 1997 (1997-02-24), pages 151-160, XP002065347 *

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11494793B2 (en) 2010-05-26 2022-11-08 Userzoom Technologies, Inc. Systems and methods for the generation, administration and analysis of click testing
US11544135B2 (en) 2010-05-26 2023-01-03 Userzoom Technologies, Inc. Systems and methods for the analysis of user experience testing with AI acceleration
US10691583B2 (en) 2010-05-26 2020-06-23 Userzoom Technologies, Inc. System and method for unmoderated remote user testing and card sorting
US11016877B2 (en) 2010-05-26 2021-05-25 Userzoom Technologies, Inc. Remote virtual code tracking of participant activities at a website
US11068374B2 (en) 2010-05-26 2021-07-20 Userzoom Technologies, Inc. Generation, administration and analysis of user experience testing
US11348148B2 (en) 2010-05-26 2022-05-31 Userzoom Technologies, Inc. Systems and methods for an intelligent sourcing engine for study participants
US11941039B2 (en) 2010-05-26 2024-03-26 Userzoom Technologies, Inc. Systems and methods for improvements to user experience testing
US11526428B2 (en) 2010-05-26 2022-12-13 Userzoom Technologies, Inc. System and method for unmoderated remote user testing and card sorting
US20120131476A1 (en) * 2010-05-26 2012-05-24 Xperience Consulting, SL System and method for unmoderated remote user testing and card sorting
US11562013B2 (en) 2010-05-26 2023-01-24 Userzoom Technologies, Inc. Systems and methods for improvements to user experience testing
US11704705B2 (en) 2010-05-26 2023-07-18 Userzoom Technologies Inc. Systems and methods for an intelligent sourcing engine for study participants
US11709754B2 (en) 2010-05-26 2023-07-25 Userzoom Technologies, Inc. Generation, administration and analysis of user experience testing
US11934475B2 (en) 2010-05-26 2024-03-19 Userzoom Technologies, Inc. Advanced analysis of online user experience studies
WO2012166036A3 (fr) * 2011-06-03 2013-02-21 Stocklassa Jan Système et procédé de suivi de personnes
US11909100B2 (en) 2019-01-31 2024-02-20 Userzoom Technologies, Inc. Systems and methods for the analysis of user experience testing with AI acceleration

Also Published As

Publication number Publication date
WO2001024057A3 (fr) 2003-12-04
AU7731300A (en) 2001-04-30

Similar Documents

Publication Publication Date Title
US6859784B1 (en) Automated research tool
US11016877B2 (en) Remote virtual code tracking of participant activities at a website
US6741967B1 (en) Full service research bureau and test center method and apparatus
US7181696B2 (en) System and method for performing market research studies on online content
Beasley Practical web analytics for user experience: How analytics can help you understand your users
Booth et al. A review of methodologies for analyzing websites
US20190123989A1 (en) Unmoderated remote user testing and card sorting
US20020152110A1 (en) Method and system for collecting market research data
EP3918561A1 (fr) Systèmes et procédés de génération, d'administration et d'analyse de tests d'expérience d'utilisateur
WO2001024057A2 (fr) Outil de recherche automatique utilisant un serveur proxy
US11709754B2 (en) Generation, administration and analysis of user experience testing
US20070083415A1 (en) Computerized internetwork system for automated training, management, and accounting of distributors
US11934475B2 (en) Advanced analysis of online user experience studies
US11494793B2 (en) Systems and methods for the generation, administration and analysis of click testing
US20080312985A1 (en) Computerized evaluation of user impressions of product artifacts
KR20090114281A (ko) 설문조사방법
Christov et al. Measuring brand awareness, campaign evaluation and web analytics
US20230090695A1 (en) Systems and methods for the generation and analysis of a user experience score
Hausmann et al. 12 Measuring brand awareness, campaign evaluation and web analytics
Heller Web analytics: functions, KPIs and reports in SMEs
Jansen et al. Website Analytics
Pagano Benefits and challenges of developing a public sector metrics program using commercial tools
KR20220035801A (ko) 테스트 서비스 제공 방법
Vassilopoulou A Usability Evaluation Technique for Retail Sites
KR20190139961A (ko) 마케터들 및 인플루언서들을 관리하는 방법 및 시스템

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP