CN1755676B - 用于网络文档批处理索引的系统和方法 - Google Patents

用于网络文档批处理索引的系统和方法 Download PDF

Info

Publication number
CN1755676B
CN1755676B CN2005100847076A CN200510084707A CN1755676B CN 1755676 B CN1755676 B CN 1755676B CN 2005100847076 A CN2005100847076 A CN 2005100847076A CN 200510084707 A CN200510084707 A CN 200510084707A CN 1755676 B CN1755676 B CN 1755676B
Authority
CN
China
Prior art keywords
document
batch
request
web services
website
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2005100847076A
Other languages
English (en)
Chinese (zh)
Other versions
CN1755676A (zh
Inventor
D·J·李
D·梅耶宗
K·皮尔特能
M·尼古维斯-尼古斯库
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN1755676A publication Critical patent/CN1755676A/zh
Application granted granted Critical
Publication of CN1755676B publication Critical patent/CN1755676B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN2005100847076A 2004-09-30 2005-07-11 用于网络文档批处理索引的系统和方法 Expired - Fee Related CN1755676B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/956,891 US7644107B2 (en) 2004-09-30 2004-09-30 System and method for batched indexing of network documents
US10/956,891 2004-09-30

Publications (2)

Publication Number Publication Date
CN1755676A CN1755676A (zh) 2006-04-05
CN1755676B true CN1755676B (zh) 2013-01-23

Family

ID=35613902

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2005100847076A Expired - Fee Related CN1755676B (zh) 2004-09-30 2005-07-11 用于网络文档批处理索引的系统和方法

Country Status (5)

Country Link
US (1) US7644107B2 (de)
EP (1) EP1643388A1 (de)
JP (1) JP2006107446A (de)
KR (1) KR100971863B1 (de)
CN (1) CN1755676B (de)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7606793B2 (en) * 2004-09-27 2009-10-20 Microsoft Corporation System and method for scoping searches using index keys
US8458704B2 (en) * 2006-03-20 2013-06-04 American Express Travel Related Services Company, Inc. System and method for an improved merge utility
KR100790991B1 (ko) * 2006-03-22 2008-01-03 삼성전자주식회사 데이터베이스 관리 시스템을 이용하여 파일시스템의메타데이터를 관리하는 방법
US8108388B2 (en) * 2006-04-26 2012-01-31 Microsoft Corporation Significant change search alerts
US9348912B2 (en) * 2007-10-18 2016-05-24 Microsoft Technology Licensing, Llc Document length as a static relevance feature for ranking search results
US20090106221A1 (en) * 2007-10-18 2009-04-23 Microsoft Corporation Ranking and Providing Search Results Based In Part On A Number Of Click-Through Features
US8458727B2 (en) * 2007-11-05 2013-06-04 Microsoft Corporation Asynchronous client to server updates
US20090193406A1 (en) * 2008-01-29 2009-07-30 James Charles Williams Bulk Search Index Updates
US8812493B2 (en) * 2008-04-11 2014-08-19 Microsoft Corporation Search results ranking using editing distance and document information
US20090327295A1 (en) * 2008-06-25 2009-12-31 Microsoft Corporation Maintenance of exo-file system metadata on removable storage device
US8001462B1 (en) 2009-01-30 2011-08-16 Google Inc. Updating search engine document index based on calculated age of changed portions in a document
CN101510217B (zh) * 2009-03-09 2013-06-05 阿里巴巴集团控股有限公司 图像数据库中的图像更新方法、服务器及系统
US8738635B2 (en) 2010-06-01 2014-05-27 Microsoft Corporation Detection of junk in search result ranking
US8332408B1 (en) 2010-08-23 2012-12-11 Google Inc. Date-based web page annotation
EP2541473A1 (de) 2011-06-27 2013-01-02 Amadeus S.A.S. Verfahren und System für ein System zur Reservierung vor dem Einkaufen mit verbesserter Sucheffizienz
US9235620B2 (en) 2012-08-14 2016-01-12 Amadeus S.A.S. Updating cached database query results
US9495462B2 (en) 2012-01-27 2016-11-15 Microsoft Technology Licensing, Llc Re-ranking search results
AU2012378631A1 (en) * 2012-04-26 2014-11-13 Amadeus S.A.S. Database system using batch-oriented computation
JP5887236B2 (ja) * 2012-09-24 2016-03-16 株式会社日立ソリューションズ 業務文書処理装置、業務文書処理方法及び業務文書処理プログラム
US9229960B2 (en) 2013-02-11 2016-01-05 International Business Machines Corporation Database management delete efficiency
US20140244516A1 (en) 2013-02-25 2014-08-28 Carrier Iq, Inc. Mobile Wireless Customer Micro-Care Apparatus and Method
US20140244517A1 (en) * 2013-02-25 2014-08-28 Carrier Iq, Inc. Incremental Batch Method for Transforming Event-driven Metrics and Measures within a Map/Reduce Data Center
US9229968B2 (en) 2013-03-11 2016-01-05 Intenational Business Machines Corporation Management of searches in a database system
US9378234B2 (en) 2013-03-11 2016-06-28 International Business Machines Corporation Management of updates in a database system
WO2015196414A1 (en) 2014-06-26 2015-12-30 Google Inc. Batch-optimized render and fetch architecture
RU2638726C1 (ru) 2014-06-26 2017-12-15 Гугл Инк. Оптимизированный процесс воспроизведения браузера
EP3161662B1 (de) 2014-06-26 2024-01-31 Google LLC Optimiertes browserdarstellungsverfahren
US10324600B2 (en) 2015-07-27 2019-06-18 Adp, Llc Web page generation system
US10417317B2 (en) 2015-07-27 2019-09-17 Adp, Llc Web page profiler
US10742764B2 (en) 2015-07-27 2020-08-11 Adp, Llc Web page generation system
CN107784009A (zh) * 2016-08-29 2018-03-09 中兴通讯股份有限公司 数据查询、数据查询处理方法及装置
CN106484840A (zh) * 2016-09-30 2017-03-08 上海聚力传媒技术有限公司 自动更新垂直检索索引的方法和装置
US10652309B2 (en) * 2017-09-19 2020-05-12 FinancialForce.com, Inc. Mechanism to allow a messaging system to automatically switch to asynchronous operation due to high demand
JP7131357B2 (ja) 2018-12-12 2022-09-06 富士通株式会社 通信装置、通信方法、および通信プログラム
US11163792B2 (en) * 2019-05-29 2021-11-02 International Business Machines Corporation Work assignment in parallelized database synchronization
US11507786B2 (en) 2019-11-04 2022-11-22 FinancialForce.com, Inc. Dynamic generation of client-specific feature maps
CN111930702A (zh) * 2020-08-14 2020-11-13 工银科技有限公司 日志处理方法、装置、系统及介质
US11803518B2 (en) 2020-10-01 2023-10-31 Hewlett Packard Enterprise Development Lp Journals to record metadata changes in a storage system
CN112860649A (zh) * 2021-02-03 2021-05-28 深圳市木浪云数据有限公司 增量生成索引的方法、装置及系统
CN113434509B (zh) * 2021-07-02 2023-07-18 挂号网（杭州）科技有限公司 一种增量索引的更新方法、装置、存储介质及电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6038610A (en) * 1996-07-17 2000-03-14 Microsoft Corporation Storage of sitemaps at server sites for holding information regarding content
US6418452B1 (en) * 1999-11-03 2002-07-09 International Business Machines Corporation Network repository service directory for efficient web crawling
US6424966B1 (en) * 1998-06-30 2002-07-23 Microsoft Corporation Synchronizing crawler with notification source
US6631369B1 (en) * 1999-06-30 2003-10-07 Microsoft Corporation Method and system for incremental web crawling

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4819156A (en) * 1986-06-13 1989-04-04 International Business Machines Corporation Database index journaling for enhanced recovery
JPH04274533A (ja) * 1991-02-28 1992-09-30 Nec Corp データベース更新装置
US5855020A (en) 1996-02-21 1998-12-29 Infoseek Corporation Web scan process
US6415319B1 (en) * 1997-02-07 2002-07-02 Sun Microsystems, Inc. Intelligent network browser using incremental conceptual indexer
JPH10240757A (ja) * 1997-02-27 1998-09-11 Hitachi Ltd 協調分散検索システム
US5956722A (en) * 1997-09-23 1999-09-21 At&T Corp. Method for effective indexing of partially dynamic documents
US7010532B1 (en) * 1997-12-31 2006-03-07 International Business Machines Corporation Low overhead methods and apparatus for shared access storage devices
US6638314B1 (en) * 1998-06-26 2003-10-28 Microsoft Corporation Method of web crawling utilizing crawl numbers
CA2279119C (en) 1999-07-29 2004-10-19 Ibm Canada Limited-Ibm Canada Limitee Heuristic-based conditional data indexing
US6687698B1 (en) * 1999-10-18 2004-02-03 Fisher Rosemount Systems, Inc. Accessing and updating a configuration database from distributed physical locations within a process control system
JP3772606B2 (ja) * 1999-10-19 2006-05-10 株式会社日立製作所 電子文書管理方法及びシステム並びに記録媒体
US6418453B1 (en) * 1999-11-03 2002-07-09 International Business Machines Corporation Network repository service for efficient web crawling
US6785688B2 (en) 2000-11-21 2004-08-31 America Online, Inc. Internet streaming media workflow architecture
JP2003208434A (ja) * 2001-11-07 2003-07-25 Nec Corp 情報検索システム及びそれに用いる情報検索方法
US20040064442A1 (en) * 2002-09-27 2004-04-01 Popovitch Steven Gregory Incremental search engine
US7085755B2 (en) * 2002-11-07 2006-08-01 Thomson Global Resources Ag Electronic document repository management and access system
JP4299022B2 (ja) * 2003-02-28 2009-07-22 トヨタ自動車株式会社 コンテンツ検索用インデックス生成装置
US7552109B2 (en) * 2003-10-15 2009-06-23 International Business Machines Corporation System, method, and service for collaborative focused crawling of documents on a network
US7730012B2 (en) * 2004-06-25 2010-06-01 Apple Inc. Methods and systems for managing data
US8131674B2 (en) * 2004-06-25 2012-03-06 Apple Inc. Methods and systems for managing data
US7653617B2 (en) * 2005-08-29 2010-01-26 Google Inc. Mobile sitemaps

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6038610A (en) * 1996-07-17 2000-03-14 Microsoft Corporation Storage of sitemaps at server sites for holding information regarding content
US6424966B1 (en) * 1998-06-30 2002-07-23 Microsoft Corporation Synchronizing crawler with notification source
US6631369B1 (en) * 1999-06-30 2003-10-07 Microsoft Corporation Method and system for incremental web crawling
US6418452B1 (en) * 1999-11-03 2002-07-09 International Business Machines Corporation Network repository service directory for efficient web crawling

Also Published As

Publication number Publication date
EP1643388A1 (de) 2006-04-05
CN1755676A (zh) 2006-04-05
KR20060048655A (ko) 2006-05-18
US20060074911A1 (en) 2006-04-06
KR100971863B1 (ko) 2010-07-22
JP2006107446A (ja) 2006-04-20
US7644107B2 (en) 2010-01-05

Similar Documents

Publication Publication Date Title
CN1755676B (zh) 用于网络文档批处理索引的系统和方法
US9436719B2 (en) Updating an inverted index in a real time fashion
US8560569B2 (en) Method and apparatus for performing bulk file system attribute retrieval
US7801881B1 (en) Sitemap generating client for web crawler
US9002819B2 (en) Web crawler scheduler that utilizes sitemaps from websites
US6424966B1 (en) Synchronizing crawler with notification source
CN102164186B (zh) 一种实现云搜索服务的方法及系统
US20180276304A1 (en) Advanced computer implementation for crawling and/or detecting related electronically catalogued data using improved metadata processing
EP1027793B1 (de) System und verfahren zur kommunikation
US20070005652A1 (en) Apparatus and method for gathering of objectional web sites
WO2006132793A2 (en) Learning facts from semi-structured text
US20070198701A1 (en) System And Method For Tracking Contents Via Internet
CN102821133B (zh) Xbrl数据解析的方法及服务器
CN102761532A (zh) 网络视频的信息处理系统和方法
CN101477527A (zh) 一种检索多媒体资源的方法及装置
WO2001050352A1 (en) Method and apparatus for creating an index for a structured document based on a stylesheet
EP2400409A2 (de) System und Verfahren zum Einsammeln von Dokumenten
US20030220914A1 (en) Method for managing data in a network
US20050188380A1 (en) Cache control device, and method and computer program for the same
US20100037129A1 (en) Electronic Document Request/Supply Method Based on XML
JP4259858B2 (ja) Ｗｗｗサイト履歴検索装置及び方法並びにプログラム
JP4153596B2 (ja) コンテンツ連携システムおよびコンテンツ連携方法
US20010013042A1 (en) Information retrieval system and a computer product
KR100440927B1 (ko) 인터넷상의 웹 페이지를 갱신하는 방법 및 그 장치
KR100907095B1 (ko) 분산저장장치를 이용한 정보검색시스템 및 이를 이용한정보검색방법

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20060405

C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150504

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150504

Address after: Washington State

Patentee after: Micro soft technique license Co., Ltd

Address before: Washington State

Patentee before: Microsoft Corp.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130123

Termination date: 20170711

CF01 Termination of patent right due to non-payment of annual fee