WO2014052202A3 - Method and system for memory efficient, update optimized, transactional full-text index view maintenance - Google Patents

Method and system for memory efficient, update optimized, transactional full-text index view maintenance Download PDF

Info

Publication number
WO2014052202A3
WO2014052202A3 PCT/US2013/060969 US2013060969W WO2014052202A3 WO 2014052202 A3 WO2014052202 A3 WO 2014052202A3 US 2013060969 W US2013060969 W US 2013060969W WO 2014052202 A3 WO2014052202 A3 WO 2014052202A3
Authority
WO
WIPO (PCT)
Prior art keywords
transactional
full
text index
bitmap
index view
Prior art date
Application number
PCT/US2013/060969
Other languages
French (fr)
Other versions
WO2014052202A2 (en
Inventor
Edward C. BUECHE
Petr Pleshachkov
Shanshan Quan
Sheperd HUANG
Original Assignee
Emc Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Emc Corporation filed Critical Emc Corporation
Priority to EP13774548.5A priority Critical patent/EP2901316A2/en
Priority to CN201380050962.1A priority patent/CN104854582B/en
Publication of WO2014052202A2 publication Critical patent/WO2014052202A2/en
Publication of WO2014052202A3 publication Critical patent/WO2014052202A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/319—Inverted lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2237—Vectors, bitmaps or matrices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/328—Management therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

Methods and systems are directed to an update-optimized and memory-efficient method for transactional full-text index view maintenance. Embodiments include a method and system of reducing the overhead requirements of maintaining a transactional index view in the case of a large number of updates at any particular time. The method involves maintaining a single blacklist bitmap across updated transactional query views, applying the latest set of updates to the bitmap when a new view is required, and post-adjusting the bitmap when the transactional view is created to ensure that entries that should be visible have not been removed.
PCT/US2013/060969 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance WO2014052202A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13774548.5A EP2901316A2 (en) 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance
CN201380050962.1A CN104854582B (en) 2012-09-28 2013-09-20 Storage is efficient, updates the method and system of the affairs type full-text index view maintenance of optimization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/631,363 2012-09-28
US13/631,363 US9245003B2 (en) 2012-09-28 2012-09-28 Method and system for memory efficient, update optimized, transactional full-text index view maintenance

Publications (2)

Publication Number Publication Date
WO2014052202A2 WO2014052202A2 (en) 2014-04-03
WO2014052202A3 true WO2014052202A3 (en) 2014-10-09

Family

ID=49326845

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/060969 WO2014052202A2 (en) 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance

Country Status (4)

Country Link
US (1) US9245003B2 (en)
EP (1) EP2901316A2 (en)
CN (1) CN104854582B (en)
WO (1) WO2014052202A2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3052572A1 (en) 2013-10-04 2016-08-10 3M Innovative Properties Company Coatable composition, antistatic composition, antistatic articles, and methods of making the same
US9792315B2 (en) 2014-08-21 2017-10-17 Dropbox, Inc. Multi-user search system with methodology for bypassing instant indexing
US10409835B2 (en) * 2014-11-28 2019-09-10 Microsoft Technology Licensing, Llc Efficient data manipulation support
US9384226B1 (en) * 2015-01-30 2016-07-05 Dropbox, Inc. Personal content item searching system and method
US9183303B1 (en) 2015-01-30 2015-11-10 Dropbox, Inc. Personal content item searching system and method
US10614070B2 (en) 2015-10-27 2020-04-07 International Business Machines Corporation Preventing staleness in query results when using asynchronously updated indexes
CN107729371B (en) * 2017-09-12 2020-04-21 深圳先进技术研究院 Data index and query method, device, equipment and storage medium of blockchain
US10866926B2 (en) 2017-12-08 2020-12-15 Dropbox, Inc. Hybrid search interface
US11080257B2 (en) * 2019-05-13 2021-08-03 Snowflake Inc. Journaled tables in database systems

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229626A1 (en) * 2002-06-05 2003-12-11 Microsoft Corporation Performant and scalable merge strategy for text indexing
US20090094236A1 (en) * 2007-10-04 2009-04-09 Frank Renkes Selection of rows and values from indexes with updates
US20090164437A1 (en) * 2007-12-20 2009-06-25 Torbjornsen Oystein Method for dynamic updating of an index, and a search engine implementing the same

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4079282B2 (en) * 1997-03-21 2008-04-23 カナル プラス ソシエテ アノニム Broadcast / reception system and conditional access system therefor
TW200625111A (en) * 2004-12-17 2006-07-16 Hon Hai Prec Ind Co Ltd System and method for controling the serving to use the resource
CN100495400C (en) * 2006-09-01 2009-06-03 北大方正集团有限公司 An index online update method for a full-text retrieval system
JP2008146517A (en) * 2006-12-13 2008-06-26 Hitachi Ltd Data distribution system and index holding device
CN101295323B (en) * 2008-06-30 2011-11-02 腾讯科技（深圳）有限公司 Processing method and system for index updating
EP2482219B1 (en) * 2011-01-31 2015-10-14 BlackBerry Limited Blacklisting of frequently used gesture passwords
CN102184222B (en) * 2011-05-05 2012-11-14 杭州安恒信息技术有限公司 Quick searching method in large data volume storage
US8620924B2 (en) * 2012-03-06 2013-12-31 International Business Machines Corporation Refreshing a full-text search index in a partitioned database

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229626A1 (en) * 2002-06-05 2003-12-11 Microsoft Corporation Performant and scalable merge strategy for text indexing
US20090094236A1 (en) * 2007-10-04 2009-04-09 Frank Renkes Selection of rows and values from indexes with updates
US20090164437A1 (en) * 2007-12-20 2009-06-25 Torbjornsen Oystein Method for dynamic updating of an index, and a search engine implementing the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Inverted index - Wikipedia, the free encyclopedia", 11 September 2011 (2011-09-11), XP055130185, Retrieved from the Internet <URL:http://wayback.archive.org/web/20120911141849/https://en.wikipedia.org/wiki/Inverted_index> [retrieved on 20140718] *

Also Published As

Publication number Publication date
US20140095467A1 (en) 2014-04-03
WO2014052202A2 (en) 2014-04-03
US9245003B2 (en) 2016-01-26
EP2901316A2 (en) 2015-08-05
CN104854582B (en) 2019-03-01
CN104854582A (en) 2015-08-19

Similar Documents

Publication Publication Date Title
WO2014052202A3 (en) Method and system for memory efficient, update optimized, transactional full-text index view maintenance
EP3079078A4 (en) Multi-version concurrency control method in database, and database system
EP3077927A4 (en) Design and implementation of clustered in-memory database
EP3046031A4 (en) Power storage cell system, method for updating power storage cell system, and program
EP3077918A4 (en) Systems and methods for in-memory database search
EP3064874A4 (en) Refrigerator, refrigerator management system, and control method for refrigerator
EP3051432A4 (en) Semantic information acquisition method, keyword expansion method thereof, and search method and system
EP3069169A4 (en) Method and system for management of wireless beacon signals
EP3001734A4 (en) System, program and method for radio terminal to find access point
EP3080444A4 (en) System and method for reducing oscillation loads of wind turbine
EP3028490A4 (en) Frequency spectral management apparatus and method, geographical location database and secondary system apparatus
EP3134821A4 (en) System and method for parallel optimization of database query using cluster cache
EP2945212B8 (en) Fuel cell system and control method therefor
EP3031024A4 (en) Method and system for clustering similar items
EP3077930A4 (en) Systems and methods for hosting an in-memory database
EP2964003A4 (en) Method for manufacturing high frequency accelerator, high frequency accelerator, and circular accelerator system
EP3979360A4 (en) All-solid-state battery and method for producing same
EP3341865A4 (en) System and method for database query
MX382474B (en) SYSTEMS AND METHODS FOR THE MANAGEMENT OF WASTE ASSOCIATED WITH THE PROCESSING OF GUAYULE SHRUBS FOR RUBBER EXTRACTION.
EP3083365A4 (en) Communication system for guideway mounted vehicle and method of using the same
EP3058552A4 (en) Systems and methods for graphics process units power management
EP3090591A4 (en) Systems and methods for managing offload from one radio access network to another
EP3076479A4 (en) Antenna for use in wireless communication system and method for securing resonators to reflective plate
EP3044704A4 (en) Systems and methods for tuning multi-store systems to speed up big data query workload
EP3024166A4 (en) Communication system having synchronized units and synchronization method for units

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13774548

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2013774548

Country of ref document: EP