WO2014052202A3 - Method and system for memory efficient, update optimized, transactional full-text index view maintenance - Google Patents

Method and system for memory efficient, update optimized, transactional full-text index view maintenance Download PDF

Info

Publication number
WO2014052202A3
WO2014052202A3 PCT/US2013/060969 US2013060969W WO2014052202A3 WO 2014052202 A3 WO2014052202 A3 WO 2014052202A3 US 2013060969 W US2013060969 W US 2013060969W WO 2014052202 A3 WO2014052202 A3 WO 2014052202A3
Authority
WO
WIPO (PCT)
Prior art keywords
transactional
full
text index
bitmap
index view
Prior art date
Application number
PCT/US2013/060969
Other languages
French (fr)
Other versions
WO2014052202A2 (en
Inventor
Edward C. BUECHE
Petr Pleshachkov
Shanshan Quan
Sheperd HUANG
Original Assignee
Emc Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Emc Corporation filed Critical Emc Corporation
Priority to EP13774548.5A priority Critical patent/EP2901316A2/en
Priority to CN201380050962.1A priority patent/CN104854582B/en
Publication of WO2014052202A2 publication Critical patent/WO2014052202A2/en
Publication of WO2014052202A3 publication Critical patent/WO2014052202A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/319—Inverted lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2237—Vectors, bitmaps or matrices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • G06F16/316—Indexing structures
    • G06F16/328—Management therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

Methods and systems are directed to an update-optimized and memory-efficient method for transactional full-text index view maintenance. Embodiments include a method and system of reducing the overhead requirements of maintaining a transactional index view in the case of a large number of updates at any particular time. The method involves maintaining a single blacklist bitmap across updated transactional query views, applying the latest set of updates to the bitmap when a new view is required, and post-adjusting the bitmap when the transactional view is created to ensure that entries that should be visible have not been removed.
PCT/US2013/060969 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance WO2014052202A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13774548.5A EP2901316A2 (en) 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance
CN201380050962.1A CN104854582B (en) 2012-09-28 2013-09-20 Storage is efficient, updates the method and system of the affairs type full-text index view maintenance of optimization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/631,363 US9245003B2 (en) 2012-09-28 2012-09-28 Method and system for memory efficient, update optimized, transactional full-text index view maintenance
US13/631,363 2012-09-28

Publications (2)

Publication Number Publication Date
WO2014052202A2 WO2014052202A2 (en) 2014-04-03
WO2014052202A3 true WO2014052202A3 (en) 2014-10-09

Family

ID=49326845

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/060969 WO2014052202A2 (en) 2012-09-28 2013-09-20 Method and system for memory efficient, update optimized, transactional full-text index view maintenance

Country Status (4)

Country Link
US (1) US9245003B2 (en)
EP (1) EP2901316A2 (en)
CN (1) CN104854582B (en)
WO (1) WO2014052202A2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10400109B2 (en) 2013-10-04 2019-09-03 3M Innovative Properties Company Coatable composition, antistatic composition, antistatic articles, and methods of making the same
US9977810B2 (en) 2014-08-21 2018-05-22 Dropbox, Inc. Multi-user search system with methodology for personal searching
US10409835B2 (en) * 2014-11-28 2019-09-10 Microsoft Technology Licensing, Llc Efficient data manipulation support
US9384226B1 (en) 2015-01-30 2016-07-05 Dropbox, Inc. Personal content item searching system and method
US9183303B1 (en) 2015-01-30 2015-11-10 Dropbox, Inc. Personal content item searching system and method
US10614070B2 (en) 2015-10-27 2020-04-07 International Business Machines Corporation Preventing staleness in query results when using asynchronously updated indexes
CN107729371B (en) * 2017-09-12 2020-04-21 深圳先进技术研究院 Data index and query method, device, equipment and storage medium of blockchain
US10866926B2 (en) 2017-12-08 2020-12-15 Dropbox, Inc. Hybrid search interface
US11080257B2 (en) * 2019-05-13 2021-08-03 Snowflake Inc. Journaled tables in database systems

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229626A1 (en) * 2002-06-05 2003-12-11 Microsoft Corporation Performant and scalable merge strategy for text indexing
US20090094236A1 (en) * 2007-10-04 2009-04-09 Frank Renkes Selection of rows and values from indexes with updates
US20090164437A1 (en) * 2007-12-20 2009-06-25 Torbjornsen Oystein Method for dynamic updating of an index, and a search engine implementing the same

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL131949A (en) * 1997-03-21 2004-06-20 Canal Plus Sa Broadcast and reception system, and conditional access system therefor
TW200625111A (en) * 2004-12-17 2006-07-16 Hon Hai Prec Ind Co Ltd System and method for controling the serving to use the resource
CN100495400C (en) * 2006-09-01 2009-06-03 北大方正集团有限公司 An index online update method for a full-text retrieval system
JP2008146517A (en) * 2006-12-13 2008-06-26 Hitachi Ltd Data distribution system and index holding device
CN101295323B (en) * 2008-06-30 2011-11-02 腾讯科技（深圳）有限公司 Processing method and system for index updating
US8615793B2 (en) * 2011-01-31 2013-12-24 Blackberry Limited Blacklisting of frequently used gesture passwords
CN102184222B (en) * 2011-05-05 2012-11-14 杭州安恒信息技术有限公司 Quick searching method in large data volume storage
US8620924B2 (en) * 2012-03-06 2013-12-31 International Business Machines Corporation Refreshing a full-text search index in a partitioned database

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030229626A1 (en) * 2002-06-05 2003-12-11 Microsoft Corporation Performant and scalable merge strategy for text indexing
US20090094236A1 (en) * 2007-10-04 2009-04-09 Frank Renkes Selection of rows and values from indexes with updates
US20090164437A1 (en) * 2007-12-20 2009-06-25 Torbjornsen Oystein Method for dynamic updating of an index, and a search engine implementing the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Inverted index - Wikipedia, the free encyclopedia", 11 September 2011 (2011-09-11), XP055130185, Retrieved from the Internet <URL:http://wayback.archive.org/web/20120911141849/https://en.wikipedia.org/wiki/Inverted_index> [retrieved on 20140718] *

Also Published As

Publication number Publication date
WO2014052202A2 (en) 2014-04-03
CN104854582A (en) 2015-08-19
US9245003B2 (en) 2016-01-26
US20140095467A1 (en) 2014-04-03
CN104854582B (en) 2019-03-01
EP2901316A2 (en) 2015-08-05

Similar Documents

Publication Publication Date Title
WO2014052202A3 (en) Method and system for memory efficient, update optimized, transactional full-text index view maintenance
EP3079078A4 (en) Multi-version concurrency control method in database, and database system
EP3344755A4 (en) Pluripotent stem cell manufacturing system and method for producing induced pluripotent stem cells
EP3077927A4 (en) Design and implementation of clustered in-memory database
EP3046031A4 (en) Power storage cell system, method for updating power storage cell system, and program
EP3077918A4 (en) Systems and methods for in-memory database search
IL239717A0 (en) System and method for distributed database query engines
EP3069169A4 (en) Method and system for management of wireless beacon signals
EP3042312A4 (en) Low power eye tracking system and method
EP3001734A4 (en) System, program and method for radio terminal to find access point
GB2497467B (en) Execute at commit state update instructions, apparatus, methods and systems
EP3028490A4 (en) Frequency spectral management apparatus and method, geographical location database and secondary system apparatus
EP3026107A4 (en) Method for producing cell concentrate, and cell suspension treatment system
EP3033414A4 (en) Automated cell culture system and method
EP3341865A4 (en) System and method for database query
EP2945212B8 (en) Fuel cell system and control method therefor
EP3031024A4 (en) Method and system for clustering similar items
EP3077930A4 (en) Systems and methods for hosting an in-memory database
EP2964003A4 (en) Method for manufacturing high frequency accelerator, high frequency accelerator, and circular accelerator system
MX382474B (en) SYSTEMS AND METHODS FOR THE MANAGEMENT OF WASTE ASSOCIATED WITH THE PROCESSING OF GUAYULE SHRUBS FOR RUBBER EXTRACTION.
EP3979360A4 (en) All-solid-state battery and method for producing same
EP3058552A4 (en) Systems and methods for graphics process units power management
EP3090591A4 (en) Systems and methods for managing offload from one radio access network to another
EP3031905A4 (en) Method for producing pancreatic hormone-producing cell
EP3076479A4 (en) Antenna for use in wireless communication system and method for securing resonators to reflective plate

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13774548

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2013774548

Country of ref document: EP