FR3108995B3 - Apprentissage de renforcement pour l’ergonomie des sites Web - Google Patents

Apprentissage de renforcement pour l’ergonomie des sites Web Download PDF

Info

Publication number
FR3108995B3
FR3108995B3 FR2003313A FR2003313A FR3108995B3 FR 3108995 B3 FR3108995 B3 FR 3108995B3 FR 2003313 A FR2003313 A FR 2003313A FR 2003313 A FR2003313 A FR 2003313A FR 3108995 B3 FR3108995 B3 FR 3108995B3
Authority
FR
France
Prior art keywords
reinforcement learning
learning module
website
search
web server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR2003313A
Other languages
English (en)
Other versions
FR3108995A3 (fr
Inventor
Thierry Delahaye
David Renaudie
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amadeus SAS
Original Assignee
Amadeus SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Amadeus SAS filed Critical Amadeus SAS
Priority to FR2003313A priority Critical patent/FR3108995B3/fr
Priority to US17/204,469 priority patent/US20210312329A1/en
Priority to DE202021101389.3U priority patent/DE202021101389U1/de
Priority to CN202110359006.8A priority patent/CN113496421A/zh
Publication of FR3108995A3 publication Critical patent/FR3108995A3/fr
Application granted granted Critical
Publication of FR3108995B3 publication Critical patent/FR3108995B3/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0255—Targeted advertisements based on user history
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201—Market modelling; Market analysis; Collecting market data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0254—Targeted advertisements based on statistics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0269—Targeted advertisements based on user profile or attribute
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Item recommendations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0639—Item locations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/14—Travel agencies
    • G06Q50/40—

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • Databases & Information Systems (AREA)
  • Development Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Tourism & Hospitality (AREA)
  • Artificial Intelligence (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Game Theory and Decision Science (AREA)
  • Computational Linguistics (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Primary Health Care (AREA)
  • Human Resources & Organizations (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Probability & Statistics with Applications (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Transfer Between Computers (AREA)
  • Operations Research (AREA)

Abstract

Un système mis en œuvre par ordinateur est fourni pour construire et adapter dynamiquement un site de recherche hébergé par un serveur web. Un module d'apprentissage renforcé est couplé au serveur web et utilise un modèle d'apprentissage renforcé pour contrôler l'apparence et/ou la fonctionnalité du site web de recherche en générant des actions à envoyer au serveur web. Ces actions ont trait au contrôle d'une liste ordonnée de recommandations de voyage obtenue comme résultat de la recherche, qui est affichée par le site web de recherche. Le module d’apprentissage de renforcement est adapté pour recevoir des récompenses, qui sont générées par le site web de recherche sur la base des entrées de l'utilisateur ou par un simulateur d'utilisateur du site web en réponse à une ou plusieurs des actions générées par le module d’apprentissage de renforcement. Les récompenses adaptent le modèle d’apprentissage de renforcement du module d'apprentissage de renforcement. Le simulateur d'utilisateur du site web simule un comportement de saisie de l'utilisateur et alimente le module d’apprentissage de renforcement pour former le module d’apprentissage de renforcement. Figure pour l’abrégé : Fig. 1
FR2003313A 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web Active FR3108995B3 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
FR2003313A FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web
US17/204,469 US20210312329A1 (en) 2020-04-02 2021-03-17 Reinforcement learning for website ergonomics
DE202021101389.3U DE202021101389U1 (de) 2020-04-02 2021-03-18 Reinforcement Learning für Webseiten-Ergonomie
CN202110359006.8A CN113496421A (zh) 2020-04-02 2021-04-02 用于网站人体工程学的强化学习

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2003313 2020-04-02
FR2003313A FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web

Publications (2)

Publication Number Publication Date
FR3108995A3 FR3108995A3 (fr) 2021-10-08
FR3108995B3 true FR3108995B3 (fr) 2022-04-01

Family

ID=76969002

Family Applications (1)

Application Number Title Priority Date Filing Date
FR2003313A Active FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web

Country Status (4)

Country Link
US (1) US20210312329A1 (fr)
CN (1) CN113496421A (fr)
DE (1) DE202021101389U1 (fr)
FR (1) FR3108995B3 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114159828A (zh) * 2021-11-30 2022-03-11 高小红 一种超临界二氧化碳温控系统
CN115098906B (zh) * 2022-05-05 2023-04-07 哈尔滨工业大学 基于深度强化学习和系统可靠度的桥梁维修方法及系统
CN116630900B (zh) * 2023-07-21 2023-11-07 中铁第四勘察设计院集团有限公司 基于机器学习的客运站旅客流线识别方法、系统及设备
CN116966603B (zh) * 2023-09-22 2024-01-02 深圳云天畅想信息科技有限公司 云游戏多账户的托管方法、托管系统及计算机装置

Also Published As

Publication number Publication date
DE202021101389U1 (de) 2021-07-05
US20210312329A1 (en) 2021-10-07
FR3108995A3 (fr) 2021-10-08
CN113496421A (zh) 2021-10-12

Similar Documents

Publication Publication Date Title
FR3108995B3 (fr) Apprentissage de renforcement pour l’ergonomie des sites Web
Moussalli et al. Intelligent personal assistants: can they understand and be understood by accented L2 learners?
Eickmann et al. Designing learning
Trivedi ProblemPal: Generating autonomous practice content in real-time with voice commands and Amazon Alexa
Schiele Visitor studies: A short history
Farinazzo et al. An empirical approach for the evaluation of voice user interfaces
Yang et al. Introduction to the special issue on interactive sonification
Sales et al. A game for teaching children with disability in reading and writing in Portuguese using voice recognition and Kinect sensor
Pérez-Esteve et al. Activities to promote the self-learning of the effective communication student outcome
Chung Design of intelligent tutoring engine for u-learning service
Nokar Introduction to Nine Lessons for The Little Crooked House
De Rizzo Meneghetti et al. Application and Simulation of Computerized Adaptive Tests Through the Package catsim
Adesina iNOUN: architecture and usability of a chatbot for academic enquiries
Vlahopol Collaborative Learning–A Possible Approach of Learning in the Discipline of Study Musical Analysis
Achilleos COMPUTER SKILLS
Domnin et al. “PENZA DIOCESAN JOURNAL” AS A HISTORICAL SOURCE FOR THE STUDY OF THE STATE AND THE RUSSIAN ORTHODOX CHURCH
del Sagrado et al. USE OF A CONVERSATIONAL ENTITY TO REINFORCE LEARNING
Simoes Santos et al. Aprendendo Programacao Orientada a Objetos com uma Abordagem Ludica Baseada em Greenfoot e Robocode
Tsang et al. ASEE and service learning
Novikova et al. INNOVATIVE TECHNOLOGY IN EDUCATION: DIDACTICS AND LANGUAGE ENVIRONMENT CREATION
Gaidukova ON THE ISSUE OF THE EDUCATION SYSTEM IN THE REPUBLIC OF CAMERON
Martin et al. Why students should be encouraged to debate
Cyr et al. Web-based Smart Checklists for Guiding Performers of Safety-Critical Human-Intensive Processes
Walker Orr Enhancing Computer Science Education with Pair Programming and Problem Solving Studios
Valentinovna Piven AV Mentoring in the system of concepts of pedagogical science

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

PLFP Fee payment

Year of fee payment: 5