US20170212899A1 - Method for searching related entities through entity co-occurrence - Google Patents

Method for searching related entities through entity co-occurrence Download PDF

Info

Publication number
US20170212899A1
US20170212899A1 US15/481,993 US201715481993A US2017212899A1 US 20170212899 A1 US20170212899 A1 US 20170212899A1 US 201715481993 A US201715481993 A US 201715481993A US 2017212899 A1 US2017212899 A1 US 2017212899A1
Authority
US
United States
Prior art keywords
entities
entity
computer
extracted
occurrence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/481,993
Inventor
Scott Lightner
Franz Weckesser
Sanjay BODDHU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qbase LLC
Original Assignee
Qbase LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qbase LLC filed Critical Qbase LLC
Priority to US15/481,993 priority Critical patent/US20170212899A1/en
Publication of US20170212899A1 publication Critical patent/US20170212899A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2457Query processing with adaptation to user needs
    • G06F16/24578Query processing with adaptation to user needs using ranking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/335Filtering based on additional data, e.g. user or group profiles
    • G06F17/3053
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/41Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/93Document management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • G06F17/30011
    • G06F17/30321
    • G06F17/30867

Definitions

  • the present disclosure relates generally to methods and systems for information retrieval, and more specifically to a method for searching for related entities using entity co-occurrence.
  • a well known search engine parses a set of search terms and returns a list of items (web pages in a typical search) that are sorted in some manner.
  • Most known approaches, to perform searches, are usually based on historical references of other users to build a search query database that may be eventually used to generate indexes based on keywords.
  • User search queries may include one or more entities identified by name or attributes that may be associated with the entity. Entities may also include organizations, people, location, date and/or time.
  • a search engine may return assorted results that may be about a mixture of different entities with the same name or similar names. The latter approach may lead the user to find a very large amount of documents that may not be relevant to what the user is actually interested.
  • the method may be employed in a search system that may include a client/server type architecture.
  • the search system may include a user interface for a search engine in communication with one or more server devices over a network connection.
  • the server device may include an entity indexed corpus of electronic data, an entity co-occurrence knowledge base database, and an entity extraction computer module.
  • the knowledge base may be built as an in-memory database and may also include other components such as one or more search controllers, multiple search nodes, collections of compressed data, and a disambiguation module.
  • One search controller may be selectively associated with one or more search nodes. Each search node may be capable of independently performing a fuzzy key search through a collection of compressed data and returning a set of scored results to its associated search controller.
  • a computer-implemented method comprises receiving, by an entity extraction computer, from a client computer a search query comprising one or more entities; comparing, by the entity extraction computer, each respective entity with one or more co-occurrences of the respective entity in a co-occurrence database; extracting, by the entity extraction computer, a subset of the one or more entities from the search query responsive to determining each respective entity of the subset exceeds a confidence score of the co-occurrence database based on a degree of certainty of co-occurrence of the entity with one or more related entities in an electronic data corpus according to the co-occurrence database; assigning, by the entity extraction computer, an index identifier (index ID) to each of the entities in the plurality of extracted entities; saving, by the entity extraction computer, the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; searching, by a search server computer, the entity indexed electronic data corpus to locate the plurality of
  • a system comprising one or more server computers having one or more processors executing computer readable instructions for a plurality of computer modules including: an entity extraction module configured to receive user input of search query parameters, the entity extraction module being further configured to: extract a plurality of entities from the search query parameters by comparing each entity in the plurality of extracted entities with an entity co-occurrence database that includes a confidence score indicative of a degree of certainty of co-occurrence of an extracted entity with one or more related entities in an electronic data corpus, assign an index identifier (index ID) to each of the entities in the plurality of extracted entities, save the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; and a search server module configured to search the entity indexed electronic data corpus to locate the plurality of extracted entities and identify index IDs of data records in which at least two of the plurality of extracted entities co-occur, the search server module being further configured to build a search result list
  • a non-transitory computer readable medium having stored thereon computer executable instructions comprising: receiving, by an entity extraction computer, user input of search query parameters; extracting, by the entity extraction computer, a plurality of entities from the search query parameters by comparing each entity in the plurality of extracted entities with an entity co-occurrence database that includes a confidence score indicative of a degree of certainty of co-occurrence of an extracted entity with one or more related entities in an electronic data corpus; assigning, by the entity extraction computer, an index identifier (index ID) to each of the entities in the plurality of extracted entities; saving, by the entity extraction computer, the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; searching, by a search server computer, the entity indexed electronic data corpus to locate the plurality of extracted entities and identify index IDs of data records in which at least two of the plurality of extracted entities co-occur; and building, by the search server computer,
  • Entity extraction refers to computer information processing methods for extracting electronic information such as names, places, and organizations.
  • Corpus refers to a collection, such as a computer database, of electronic data, including documents.
  • “Features” is any information which is at least partially derived from an electronic document.
  • Feature attribute refers to metadata associated with a feature; for example, location of a feature in a document, confidence score, among others.
  • Module refers to a computer hardware and/or software components suitable for carrying out at least one or more tasks.
  • Entity knowledge base refers to a computer database containing features/entities.
  • Query refers to a computer generated request to retrieve information from one or more suitable databases.
  • Topic refers to a set of thematic information which is at least partially derived from a corpus.
  • FIG. 1 is a block diagram illustrating an exemplary environment of a computer system in which one embodiment of the present disclosure may operate;
  • FIG. 2 is a flowchart illustrating a method for searching using entity co-occurrence, according to an embodiment
  • FIG. 3 is a flowchart illustrating an embodiment of a simple search where the search results returned by the system may include related entities of interest.
  • Embodiments of the present disclosure introduce a new search paradigm which grants users the ability to find entities of interest via entity co-occurrence.
  • An important component of this approach is an entity co-occurrence network captured in an entity indexed corpus of electronic data, which is continuously updated as new information is discovered.
  • embodiments of the present disclosure incorporate entity extraction and disambiguation, using an entity knowledge base. By exploiting the entity co-occurrence network and disambiguating entities extracted from search queries, the high relevance of search results is ensured so that users obtain precise and direct results containing only the documents with related entities of interest, as discussed in further detail in FIGS. 1-3 below.
  • FIG. 1 is a block diagram of a search system 100 in accordance with the present disclosure.
  • the search system 100 may include one or more client computing device comprising a processor executing software modules associated with the search system 100 , which may include graphical user interfaces 102 accessing a search engine 104 communicating search queries in the form of binary data with a server device 106 , over a network 108 .
  • the search system 100 may be implemented in a client-server computing architecture.
  • the search system 100 may be implemented using other computer architectures (e.g., a stand-alone computer, a mainframe system with terminals, an application service provider (ASP) model, a peer-to-peer model, and the like).
  • ASP application service provider
  • the network 108 may comprise any suitable hardware and software modules capable of communicating digital data between computing devices, such as a local area network, a wide area network, the Internet, a wireless network, a mobile phone network, and the like. As such, it should also be appreciated that the system 100 may be implemented over a single network 108 , or using a plurality of networks 108 .
  • a user's computing device 102 may access a search engine 104 , which may include software modules capable of transmitting search queries.
  • Search queries are parameters provided to the search engine 104 indicating the desired information to retrieve.
  • Search queries may be provided by a user or another software application in any suitable data format (e.g., integers, strings, complex objects) compatible with the search engine's 104 parsing and processing routines.
  • the search engine 104 may be a web-based tool that is accessible through the user's computing device 102 browser or other software application, and enables users or software applications to locate information on the World Wide Web.
  • the search engine 104 may be application software modules native to the system 100 , enabling users or applications to locate information within databases of the system 100 .
  • Server device 106 which may be implemented as a single server device 106 or in a distributed architecture across a plurality of server computers, may include an entity extraction module 110 , an entity co-occurrence knowledge base 112 , and an entity indexed corpus 114 .
  • Entity extraction module 110 may be a computer software and/or hardware module able to extract and disambiguate independent entities from a given set of queries such as a query string, structured data and the like.
  • Example of entities may include people, organizations, geographic locations, dates and/or time.
  • one or more feature recognition and extraction algorithms may be employed.
  • a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • entity co-occurrence knowledge base 112 may be built, but is not limited to, as an in-memory computer database (not shown) and may include other components (not shown), such as one or more search controllers, multiple search nodes, collections of compressed data, and a disambiguation computer module.
  • One search controller may be selectively associated with one or more search nodes.
  • Each search node may be capable of independently performing a fuzzy key search through a collection of compressed data and returning a set of scored results to its associated search controller.
  • Entity co-occurrence knowledge base 112 may include related entities based on features and ranked by a confidence score. Various methods for linking the features may be employed, which may essentially use a weighted model for determining which entity types are most important, which have more weight, and, based on confidence scores, determine how confident the extraction of the correct features has been performed.
  • Entity indexed corpus 114 may include data from a plurality of sources such as the Internet having a massive corpus or live corpus.
  • FIG. 2 is a flowchart illustrating a method 200 for searching related entities using entity co-occurrence that may be implemented in a search system 100 , such as the one described in FIG. 1 .
  • an entity indexed corpus 114 similar to that described by FIG. 1 may have been fed with data from a plurality of sources such as a massive corpus or live corpus of electronic data (e.g., the Internet, website, blog, word-processing file, plaintext file).
  • Entity indexed corpus 114 may include a plurality of indexed entities that may constantly update as new data is discovered.
  • method 200 may start when a user or software application of a computing device 102 provides one or more search queries containing one or more entities to a search engine 104 , in step 202 .
  • Search queries that were provided in step 202 may be processed by search system 100 , from one to n, at each time.
  • An example of a search query in step 202 may be a combination of keywords, such as a string, structured data, or other suitable data format.
  • the keywords of the search query may be entities that represent people, organizations, geographic locations, dates and/or times.
  • Search queries from step 202 may then be processed for entity extraction, in step 204 .
  • the entity extraction module 110 may process search queries from step 202 as entities and compare them all against entity co-occurrence knowledge base 112 to extract and disambiguate as many entities as possible.
  • one or more feature recognition and extraction algorithms may be employed.
  • a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • various methods for linking the features may be employed, which may essentially use a weighted model for determining which entity types are most important, which have more weight, and, based on confidence scores, determine how confident the extraction of the correct features has been performed.
  • an index ID which in some cases may be a number, may be assigned in step 206 to the extracted entities.
  • a search based on the entities index ID assigned in step 206 may be performed.
  • the extracted entities may be located within the entity indexed corpus 114 data by using standard indexing methods.
  • an entity association step 210 may follow.
  • all the data such as documents, videos, pictures, files or the like, where at least two extracted entities overlaps may be pulled from the entity indexed corpus 114 .
  • a list of potential results is built, sorted by relevance, and presented to the user as search results, step 212 . The list of results may then show only links to data where the user may find related entities of interest.
  • FIG. 3 is a particular example of a method 300 for searching related entities using entity co-occurrence, as discussed above in connection with FIG. 2 .
  • an entity indexed corpus 114 similar to that described by FIG. 1 may have been fed with data from a plurality of sources such as a massive corpus or live corpus (the Internet).
  • Entity indexed corpus 114 may include a plurality of indexed entities that may constantly update as new data is discovered.
  • a user may be looking for information regarding “jobs” at the company “Apple”.
  • the user may input one or more entities (e.g., search queries in step 302 ) through a user interface 102 which may be, but is not limited to, an interface with a search engine 104 , such as the one described in FIG. 1 .
  • the user may input a combination of entities such as “Apple+Jobs”.
  • the search engine 104 may generate search queries, step 302 , and send these queries to server device 106 to be processed.
  • entity extraction module 110 may perform an entity extraction step 304 from search queries input in step 302 .
  • Entity extraction module 110 may then process search queries that were input in step 302 , such as “Apple” and “Jobs”, as entities and compare them all against entity co-occurrence knowledge base 112 to extract and disambiguate as many entities as possible.
  • search queries such as “Apple” and “Jobs”
  • one or more feature recognition and extraction algorithms may be employed.
  • a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • a table 306 including entity and co-occurrences may be created.
  • Table 306 may then show the entity “apple” and its co-occurrences, which in this case, may be Apple and Jobs, Apple and Steve Jobs.
  • the table 306 may also include Apple and organization A which may have been found relevant because Organization A is doing business with Apple and generating “jobs” in said organization A. Other co-occurrences may be found with less importance.
  • Apple and Jobs may then have the highest score (1), thus listed at the top, then Apple and Steve Jobs may have the second highest score (0.8), and finally Apple and other organization A may be at the bottom list with the lowest score (0.3).
  • an index ID which in some cases may be a number, may be assigned in step 308 to the extracted entities.
  • Table 310 shows index IDs assigned to extracted entities. Table 310 then shows “Apple” with index ID 1 , “Jobs” with index ID 2 , “Steve Jobs” with index ID 3 , and “Organization A” with index ID 4 .
  • a search step 312 based on the entities index ID 308 may be performed.
  • the extracted entities such as “Apple”, “Jobs”, “Steve Jobs”, and “Organization A”, may be located within the entity indexed corpus 114 data by using standard indexing methods.
  • Entity association step 314 After locating extracted entities within the entity indexed corpus 114 , an entity association 314 step may follow.
  • Entity association step 314 all the data such as documents, videos, pictures, files or the like, where at least two extracted entities overlaps may be pulled from the entity indexed corpus 114 to build a list of links as search results (step 318 ).
  • table 316 shows how extracted entities may be associated to data in entity indexed corpus 114 .
  • documents 1 , 4 , 5 , 7 , 8 , and 10 show overlapping of two extracted entities, thus the links for these documents may be shown as search results in step 318 .
  • process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the steps in the foregoing embodiments may be performed in any order. Words such as “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods.
  • process flow diagrams may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged.
  • a process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.
  • Embodiments implemented in computer software may be implemented in software, firmware, middleware, microcode, hardware description languages, or any combination thereof.
  • a code segment or machine-executable instructions may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements.
  • a code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents.
  • Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.
  • the functions When implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable or processor-readable storage medium.
  • the steps of a method or algorithm disclosed here may be embodied in a processor-executable software module which may reside on a computer-readable or processor-readable storage medium.
  • a non-transitory computer-readable or processor-readable media includes both computer storage media and tangible storage media that facilitate transfer of a computer program from one place to another.
  • a non-transitory processor-readable storage media may be any available media that may be accessed by a computer.
  • non-transitory processor-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other tangible storage medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer or processor.
  • Disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
  • the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer-readable medium, which may be incorporated into a computer program product.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A method for searching for related entities using entity co-occurrence is disclosed. Embodiments of the method may be employed in any search system that may include at least one search engine, at least one entity co-occurrence knowledge base, an entity extraction module, and at least an entity indexed corpus. The method may extract and disambiguate entities from search queries by using an entity co-occurrence knowledge base, find extracted entities in an entity indexed corpus and finally present search results as related entities of interest.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 14/557,989, entitled “Method for Searching Related Entities Through Entity Co-Occurrence,” filed on Dec. 2, 2013, which claims a benefit of priority to U.S. Provisional Application 61/910,894, filed Dec. 2, 2013, entitled “Method for Searching Related Entities Through Entity Co-Occurrence,” each of which are incorporated herein by reference in their entirety for all purposes.
  • This application is related to U.S. patent application Ser. No. 14/557,794, entitled “METHOD FOR DISAMBIGUATED FEATURES IN UNSTRUCTURED TEXT,” filed Dec. 2, 2014, now U.S. Pat. No. 9,239,875 issued Jan. 19, 2016, U.S. patent application Ser. No. 14/558,300, entitled “EVENT DETECTION THROUGH TEXT ANALYSIS USING TRAINED EVENT TEMPLATE MODELS,” filed Dec. 2, 2014, now U.S. Pat. No. 9,177,254 issued Nov. 3, 2015, each of which are hereby incorporated by reference in their entirety.
  • TECHNICAL FIELD
  • The present disclosure relates generally to methods and systems for information retrieval, and more specifically to a method for searching for related entities using entity co-occurrence.
  • BACKGROUND
  • In the commercial context, a well known search engine parses a set of search terms and returns a list of items (web pages in a typical search) that are sorted in some manner. Most known approaches, to perform searches, are usually based on historical references of other users to build a search query database that may be eventually used to generate indexes based on keywords. User search queries may include one or more entities identified by name or attributes that may be associated with the entity. Entities may also include organizations, people, location, date and/or time. In a typical search, if a user is searching for information related to two particular organizations, a search engine may return assorted results that may be about a mixture of different entities with the same name or similar names. The latter approach may lead the user to find a very large amount of documents that may not be relevant to what the user is actually interested.
  • Thus, a need exists for a method for searching for related entities that may grant the user the ability to find related entities of interest.
  • SUMMARY
  • A method for searching for related entities using entity co-occurrence is disclosed. In one aspect of the present disclosure, the method may be employed in a search system that may include a client/server type architecture. In one embodiment, the search system may include a user interface for a search engine in communication with one or more server devices over a network connection. The server device may include an entity indexed corpus of electronic data, an entity co-occurrence knowledge base database, and an entity extraction computer module. The knowledge base may be built as an in-memory database and may also include other components such as one or more search controllers, multiple search nodes, collections of compressed data, and a disambiguation module. One search controller may be selectively associated with one or more search nodes. Each search node may be capable of independently performing a fuzzy key search through a collection of compressed data and returning a set of scored results to its associated search controller.
  • In one embodiment, a computer-implemented method comprises receiving, by an entity extraction computer, from a client computer a search query comprising one or more entities; comparing, by the entity extraction computer, each respective entity with one or more co-occurrences of the respective entity in a co-occurrence database; extracting, by the entity extraction computer, a subset of the one or more entities from the search query responsive to determining each respective entity of the subset exceeds a confidence score of the co-occurrence database based on a degree of certainty of co-occurrence of the entity with one or more related entities in an electronic data corpus according to the co-occurrence database; assigning, by the entity extraction computer, an index identifier (index ID) to each of the entities in the plurality of extracted entities; saving, by the entity extraction computer, the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; searching, by a search server computer, the entity indexed electronic data corpus to locate the plurality of extracted entities and identify index IDs of data records in which at least two of the plurality of extracted entities co-occur; and building, by the search server computer, a search result list having data records corresponding to the identified index IDs.
  • In one embodiment, a system comprising one or more server computers having one or more processors executing computer readable instructions for a plurality of computer modules including: an entity extraction module configured to receive user input of search query parameters, the entity extraction module being further configured to: extract a plurality of entities from the search query parameters by comparing each entity in the plurality of extracted entities with an entity co-occurrence database that includes a confidence score indicative of a degree of certainty of co-occurrence of an extracted entity with one or more related entities in an electronic data corpus, assign an index identifier (index ID) to each of the entities in the plurality of extracted entities, save the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; and a search server module configured to search the entity indexed electronic data corpus to locate the plurality of extracted entities and identify index IDs of data records in which at least two of the plurality of extracted entities co-occur, the search server module being further configured to build a search result list having data records corresponding to the identified index IDs.
  • In another embodiment, a non-transitory computer readable medium having stored thereon computer executable instructions comprising: receiving, by an entity extraction computer, user input of search query parameters; extracting, by the entity extraction computer, a plurality of entities from the search query parameters by comparing each entity in the plurality of extracted entities with an entity co-occurrence database that includes a confidence score indicative of a degree of certainty of co-occurrence of an extracted entity with one or more related entities in an electronic data corpus; assigning, by the entity extraction computer, an index identifier (index ID) to each of the entities in the plurality of extracted entities; saving, by the entity extraction computer, the index ID for each of the plurality of extracted entities in the electronic data corpus, the electronic data corpus being indexed by an index ID corresponding to each of the one or more related entities; searching, by a search server computer, the entity indexed electronic data corpus to locate the plurality of extracted entities and identify index IDs of data records in which at least two of the plurality of extracted entities co-occur; and building, by the search server computer, a search result list having data records corresponding to the identified index IDs.
  • Definitions
  • As used here, the following terms may have the following definitions:
  • “Entity extraction” refers to computer information processing methods for extracting electronic information such as names, places, and organizations.
  • “Corpus” refers to a collection, such as a computer database, of electronic data, including documents.
  • “Features” is any information which is at least partially derived from an electronic document.
  • “Feature attribute” refers to metadata associated with a feature; for example, location of a feature in a document, confidence score, among others.
  • “Module” refers to a computer hardware and/or software components suitable for carrying out at least one or more tasks.
  • “Fact” refers to objective relationships between features.
  • “Entity knowledge base” refers to a computer database containing features/entities.
  • “Query” refers to a computer generated request to retrieve information from one or more suitable databases.
  • “Topic” refers to a set of thematic information which is at least partially derived from a corpus.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present disclosure can be better understood by referring to the following figures. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the disclosure. In the figures, reference numerals designate corresponding parts throughout the different views.
  • FIG. 1 is a block diagram illustrating an exemplary environment of a computer system in which one embodiment of the present disclosure may operate;
  • FIG. 2 is a flowchart illustrating a method for searching using entity co-occurrence, according to an embodiment; and
  • FIG. 3 is a flowchart illustrating an embodiment of a simple search where the search results returned by the system may include related entities of interest.
  • DETAILED DESCRIPTION
  • The present disclosure is herein described in detail with reference to embodiments illustrated in the drawings, which form a part hereof. Other embodiments may be used and/or other changes may be made without departing from the spirit or scope of the present disclosure. The illustrative embodiments described in the detailed description are not meant to be limiting of the subject matter presented herein.
  • Reference will now be made to the exemplary embodiments illustrated in the drawings, and specific language will be used here to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended. Alterations and further modifications of the inventive features illustrated here, and additional applications of the principles of the inventions as illustrated here, which would occur to one skilled in the relevant art and having possession of this disclosure, are to be considered within the scope of the invention.
  • Embodiments of the present disclosure introduce a new search paradigm which grants users the ability to find entities of interest via entity co-occurrence. An important component of this approach is an entity co-occurrence network captured in an entity indexed corpus of electronic data, which is continuously updated as new information is discovered. Moreover, embodiments of the present disclosure incorporate entity extraction and disambiguation, using an entity knowledge base. By exploiting the entity co-occurrence network and disambiguating entities extracted from search queries, the high relevance of search results is ensured so that users obtain precise and direct results containing only the documents with related entities of interest, as discussed in further detail in FIGS. 1-3 below.
  • FIG. 1 is a block diagram of a search system 100 in accordance with the present disclosure. The search system 100 may include one or more client computing device comprising a processor executing software modules associated with the search system 100, which may include graphical user interfaces 102 accessing a search engine 104 communicating search queries in the form of binary data with a server device 106, over a network 108. In the exemplary embodiment, the search system 100 may be implemented in a client-server computing architecture. However, it should be appreciated that the search system 100 may be implemented using other computer architectures (e.g., a stand-alone computer, a mainframe system with terminals, an application service provider (ASP) model, a peer-to-peer model, and the like). The network 108 may comprise any suitable hardware and software modules capable of communicating digital data between computing devices, such as a local area network, a wide area network, the Internet, a wireless network, a mobile phone network, and the like. As such, it should also be appreciated that the system 100 may be implemented over a single network 108, or using a plurality of networks 108.
  • A user's computing device 102 may access a search engine 104, which may include software modules capable of transmitting search queries. Search queries are parameters provided to the search engine 104 indicating the desired information to retrieve. Search queries may be provided by a user or another software application in any suitable data format (e.g., integers, strings, complex objects) compatible with the search engine's 104 parsing and processing routines. In some embodiments, the search engine 104 may be a web-based tool that is accessible through the user's computing device 102 browser or other software application, and enables users or software applications to locate information on the World Wide Web. In some embodiments, the search engine 104 may be application software modules native to the system 100, enabling users or applications to locate information within databases of the system 100.
  • Server device 106, which may be implemented as a single server device 106 or in a distributed architecture across a plurality of server computers, may include an entity extraction module 110, an entity co-occurrence knowledge base 112, and an entity indexed corpus 114. Entity extraction module 110 may be a computer software and/or hardware module able to extract and disambiguate independent entities from a given set of queries such as a query string, structured data and the like. Example of entities may include people, organizations, geographic locations, dates and/or time. During the extraction, one or more feature recognition and extraction algorithms may be employed. Also, a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • According to various embodiments, entity co-occurrence knowledge base 112 may be built, but is not limited to, as an in-memory computer database (not shown) and may include other components (not shown), such as one or more search controllers, multiple search nodes, collections of compressed data, and a disambiguation computer module. One search controller may be selectively associated with one or more search nodes. Each search node may be capable of independently performing a fuzzy key search through a collection of compressed data and returning a set of scored results to its associated search controller.
  • Entity co-occurrence knowledge base 112 may include related entities based on features and ranked by a confidence score. Various methods for linking the features may be employed, which may essentially use a weighted model for determining which entity types are most important, which have more weight, and, based on confidence scores, determine how confident the extraction of the correct features has been performed. Entity indexed corpus 114 may include data from a plurality of sources such as the Internet having a massive corpus or live corpus.
  • FIG. 2 is a flowchart illustrating a method 200 for searching related entities using entity co-occurrence that may be implemented in a search system 100, such as the one described in FIG. 1. According to various embodiments, prior to start of method 200, an entity indexed corpus 114 similar to that described by FIG. 1 may have been fed with data from a plurality of sources such as a massive corpus or live corpus of electronic data (e.g., the Internet, website, blog, word-processing file, plaintext file). Entity indexed corpus 114 may include a plurality of indexed entities that may constantly update as new data is discovered.
  • In one embodiment, method 200 may start when a user or software application of a computing device 102 provides one or more search queries containing one or more entities to a search engine 104, in step 202. Search queries that were provided in step 202 may be processed by search system 100, from one to n, at each time. An example of a search query in step 202 may be a combination of keywords, such as a string, structured data, or other suitable data format. In this exemplary embodiment of FIG. 2, the keywords of the search query may be entities that represent people, organizations, geographic locations, dates and/or times.
  • Search queries from step 202 may then be processed for entity extraction, in step 204. In this step, the entity extraction module 110 may process search queries from step 202 as entities and compare them all against entity co-occurrence knowledge base 112 to extract and disambiguate as many entities as possible. During the extraction, one or more feature recognition and extraction algorithms may be employed. Also, a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • Furthermore, various methods for linking the features may be employed, which may essentially use a weighted model for determining which entity types are most important, which have more weight, and, based on confidence scores, determine how confident the extraction of the correct features has been performed. Once the entities are extracted and ranked based on confidence scores, an index ID, which in some cases may be a number, may be assigned in step 206 to the extracted entities.
  • Next, in step 208, a search based on the entities index ID assigned in step 206 may be performed. In the search step 208, the extracted entities may be located within the entity indexed corpus 114 data by using standard indexing methods. Once the extracted entities are located, an entity association step 210 may follow. In the entity association step 210, all the data such as documents, videos, pictures, files or the like, where at least two extracted entities overlaps may be pulled from the entity indexed corpus 114. Finally, a list of potential results is built, sorted by relevance, and presented to the user as search results, step 212. The list of results may then show only links to data where the user may find related entities of interest.
  • FIG. 3 is a particular example of a method 300 for searching related entities using entity co-occurrence, as discussed above in connection with FIG. 2. As described in FIG. 2, according to various embodiments, prior to the start of the method 300, an entity indexed corpus 114 similar to that described by FIG. 1, may have been fed with data from a plurality of sources such as a massive corpus or live corpus (the Internet). Entity indexed corpus 114 may include a plurality of indexed entities that may constantly update as new data is discovered.
  • In this example embodiment, a user may be looking for information regarding “jobs” at the company “Apple”. For this, the user may input one or more entities (e.g., search queries in step 302) through a user interface 102 which may be, but is not limited to, an interface with a search engine 104, such as the one described in FIG. 1. By a way of illustration and not by way of limitation, the user may input a combination of entities such as “Apple+Jobs”. Next, the search engine 104 may generate search queries, step 302, and send these queries to server device 106 to be processed. At server device 106, entity extraction module 110 may perform an entity extraction step 304 from search queries input in step 302.
  • Entity extraction module 110 may then process search queries that were input in step 302, such as “Apple” and “Jobs”, as entities and compare them all against entity co-occurrence knowledge base 112 to extract and disambiguate as many entities as possible. During the extraction, one or more feature recognition and extraction algorithms may be employed. Also, a score may be assigned to each extracted feature, indicating the level of certainty of the feature being correctly extracted with the correct attributes. Taking into account the feature attributes, the relative weight or relevance of each of the features may be determined. Additionally, the relevance of the association between features may be determined using a weighted scoring model.
  • Furthermore, various methods for linking the features may be employed, which may essentially use a weighted model for determining which entity types are most important, which have more weight, and, based on confidence scores, determine how confident the extraction of the correct features has been performed. As a result, a table 306 including entity and co-occurrences may be created. Table 306 may then show the entity “apple” and its co-occurrences, which in this case, may be Apple and Jobs, Apple and Steve Jobs. The table 306 may also include Apple and organization A which may have been found relevant because Organization A is doing business with Apple and generating “jobs” in said organization A. Other co-occurrences may be found with less importance. As such, Apple and Jobs may then have the highest score (1), thus listed at the top, then Apple and Steve Jobs may have the second highest score (0.8), and finally Apple and other organization A may be at the bottom list with the lowest score (0.3).
  • Once the entities are extracted and ranked based on confidence scores, an index ID, which in some cases may be a number, may be assigned in step 308 to the extracted entities. Table 310 shows index IDs assigned to extracted entities. Table 310 then shows “Apple” with index ID 1, “Jobs” with index ID 2, “Steve Jobs” with index ID 3, and “Organization A” with index ID 4.
  • Next, a search step 312 based on the entities index ID 308 may be performed. In the search step 312, the extracted entities such as “Apple”, “Jobs”, “Steve Jobs”, and “Organization A”, may be located within the entity indexed corpus 114 data by using standard indexing methods.
  • After locating extracted entities within the entity indexed corpus 114, an entity association 314 step may follow. In Entity association step 314, all the data such as documents, videos, pictures, files or the like, where at least two extracted entities overlaps may be pulled from the entity indexed corpus 114 to build a list of links as search results (step 318). By a way of illustration and not by way of limitation, table 316 shows how extracted entities may be associated to data in entity indexed corpus 114. In table 316, documents 1, 4, 5, 7, 8, and 10 show overlapping of two extracted entities, thus the links for these documents may be shown as search results in step 318.
  • While various aspects and embodiments have been disclosed, other aspects and embodiments are contemplated. The various aspects and embodiments disclosed are for purposes of illustration and are not intended to be limiting, with the true scope and spirit being indicated by the following claims.
  • The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the steps in the foregoing embodiments may be performed in any order. Words such as “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods. Although process flow diagrams may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.
  • The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed here may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
  • Embodiments implemented in computer software may be implemented in software, firmware, middleware, microcode, hardware description languages, or any combination thereof. A code segment or machine-executable instructions may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.
  • The actual software code or specialized control hardware used to implement these systems and methods is not limiting of the invention. Thus, the operation and behavior of the systems and methods were described without reference to the specific software code being understood that software and control hardware can be designed to implement the systems and methods based on the description here.
  • When implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable or processor-readable storage medium. The steps of a method or algorithm disclosed here may be embodied in a processor-executable software module which may reside on a computer-readable or processor-readable storage medium. A non-transitory computer-readable or processor-readable media includes both computer storage media and tangible storage media that facilitate transfer of a computer program from one place to another. A non-transitory processor-readable storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such non-transitory processor-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other tangible storage medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer or processor. Disk and disc, as used here, include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer-readable medium, which may be incorporated into a computer program product.
  • The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined here may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown here but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed here.

Claims (20)

What is claimed is:
1. A computer-implemented method comprising:
in response to receiving a search query comprising one or more entities from an end user device, comparing, by the entity extraction computer, each respective entity with one or more co-occurrences of the respective entity in a co-occurrence database;
extracting, by the entity extraction computer, a subset of the one or more entities from the search query responsive to determining each respective entity of the subset that exceeds a confidence score of the co-occurrence database based on a degree of certainty of co-occurrence of the entity with one or more related entities in an electronic data corpus according to the co-occurrence database;
assigning, by the entity extraction computer, a confidence score to each of the extracted entities, wherein the confidence score is assigned based on a level of certainty that each of the extracted entities is extracted based on one or more feature attributes associated to each of the extracted entities;
assigning, by the entity extraction computer, an index identifier (index ID) to each of the extracted entities based at least on the confidence scores of each of the extracted entities, wherein the index ID for each of the extracted entities in saved in the electronic data corpus;
identifying, by a search server computer, index IDs of a subset of entities from the extracted entities based on relatedness of index IDs in which at least two of the extracted entities co-occur within the electronic data corpus; and
generating, by the search server computer, a search result list having data records corresponding to the identified index IDs.
2. The computer-implemented method of claim 1, wherein the co-occurrence database comprises one or more entries for the one or more entities, and wherein each entry for the respective entity of the one or more entities contains a semantically-related entity that identifies the respective entity.
3. The computer-implemented method of claim 1, wherein the co-occurrence is an instance of an entity of the one or more entities identified by the semantically-related entity in the corpus of documents in the co-occurrence database, and wherein the semantically-related entity corresponds to a model indicating distinct entities.
4. The computer-implemented method of claim 1 further comprising:
sorting, by the search server computer, the search result list by relevance based on the confidence score; and
transmitting, by the search server computer, the sorted search result list to the end-user device.
5. The computer-implemented method of claim 1 further comprising:
ranking, by the entity extraction computer, the extracted entities based on the confidence score.
6. The computer-implemented method of claim 1 further comprising:
disambiguating, by the entity extraction computer, each of the entities of the extracted entities from one another based on relatedness of index IDs.
7. The computer-implemented method of claim 1, wherein each of the one or more entities is selected from the group consisting of a person, an organization, a geographic location, a date, and a time.
8. A system comprising:
a co-occurrence database;
an entity extraction computer comprising one or more processors executing computer readable instructions for a plurality of computer modules, wherein the entity extraction computer is configured to:
in response to receiving a search query comprising one or more entities from an end user device, compare each respective entity with one or more co-occurrences of the respective entity in a co-occurrence database;
extract a subset of the one or more entities from the search query responsive to determining each respective entity of the subset that exceeds a confidence score of the co-occurrence database based on a degree of certainty of co-occurrence of the entity with one or more related entities in an electronic data corpus according to the co-occurrence database;
assign a confidence score to each of the extracted entities, wherein the confidence score is assigned based on a level of certainty that each of the extracted entities is extracted based on one or more feature attributes associated to each of the extracted entities; and
assign an index identifier (index ID) to each of the extracted entities based at least on the confidence scores of each of the extracted entities, wherein the index ID for each of the extracted entities in saved in the electronic data corpus; and
a search server computer comprising one or more processors executing computer readable instructions for a plurality of computer modules, wherein the search server computer is configured to:
identify index IDs of a subset of entities from the extracted entities based on relatedness of index IDs in which at least two of the extracted entities co-occur within the electronic data corpus; and
generate a search result list having data records corresponding to the identified index IDs.
9. The system of claim 8, wherein the co-occurrence database comprises one or more entries for the one or more entities, and wherein each entry for the respective entity of the one or more entities contains a semantically-related entity that identifies the respective entity.
10. The system of claim 8, wherein the co-occurrence is an instance of an entity of the one or more entities identified by the semantically-related entity in the corpus of documents in the co-occurrence database, and wherein the semantically-related entity corresponds to a model indicating distinct entities.
11. The system of claim 8, wherein the entity extraction computer is further configured to:
sort the search result list by relevance based on the confidence score and transmit the sorted search result list to the end-user device.
12. The system of claim 8, wherein the entity extraction computer is further configured to rank the extracted entities based on the confidence score.
13. The system of claim 8, wherein the entity extraction computer is further configured to disambiguate each of the entities of the extracted entities from one another based on relatedness of index IDs.
14. The system of claim 8, wherein each of the one or more entities is selected from the group consisting of a person, an organization, a geographic location, a date, and a time.
15. A non-transitory computer readable medium having stored thereon computer executable instructions comprising:
in response to receiving a search query comprising one or more entities from an end user device, comparing, by the entity extraction computer, each respective entity with one or more co-occurrences of the respective entity in a co-occurrence database;
extracting, by the entity extraction computer, a subset of the one or more entities from the search query responsive to determining each respective entity of the subset that exceeds a confidence score of the co-occurrence database based on a degree of certainty of co-occurrence of the entity with one or more related entities in an electronic data corpus according to the co-occurrence database;
assigning, by the entity extraction computer, a confidence score to each of the extracted entities, wherein the confidence score is assigned based on a level of certainty that each of the extracted entities is extracted based on one or more feature attributes associated to each of the extracted entities;
assigning, by the entity extraction computer, an index identifier (index ID) to each of the extracted entities based at least on the confidence scores of each of the extracted entities, wherein the index ID for each of the extracted entities in saved in the electronic data corpus;
identifying, by a search server computer, index IDs of a subset of entities from the extracted entities based on relatedness of index IDs in which at least two of the extracted entities co-occur within the electronic data corpus; and
generating, by the search server computer, a search result list having data records corresponding to the identified index IDs.
16. The computer readable medium of claim 15, wherein the co-occurrence database comprises one or more entries for the one or more entities, and wherein each entry for the respective entity of the one or more entities contains a semantically-related entity that identifies the respective entity.
17. The computer readable medium of claim 15, wherein the co-occurrence is an instance of an entity of the one or more entities identified by the semantically-related entity in the corpus of documents in the co-occurrence database, and wherein the semantically-related entity corresponds to a model indicating distinct entities.
18. The computer readable medium of claim 15 further comprising:
sorting, by the search server computer, the search result list by relevance based on the confidence score; and
transmitting, by the search server computer, the sorted search result list to the end-user device.
19. The computer readable medium of claim 15 further comprising:
ranking, by the entity extraction computer, the extracted entities based on the confidence score.
20. The computer readable medium of claim 15 further comprising:
disambiguating, by the entity extraction computer, each of the entities of the extracted entities from one another based on relatedness of index IDs.
US15/481,993 2013-12-02 2017-04-07 Method for searching related entities through entity co-occurrence Abandoned US20170212899A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/481,993 US20170212899A1 (en) 2013-12-02 2017-04-07 Method for searching related entities through entity co-occurrence

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361910894P 2013-12-02 2013-12-02
US14/557,989 US9619571B2 (en) 2013-12-02 2014-12-02 Method for searching related entities through entity co-occurrence
US15/481,993 US20170212899A1 (en) 2013-12-02 2017-04-07 Method for searching related entities through entity co-occurrence

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/557,989 Continuation US9619571B2 (en) 2013-12-02 2014-12-02 Method for searching related entities through entity co-occurrence

Publications (1)

Publication Number Publication Date
US20170212899A1 true US20170212899A1 (en) 2017-07-27

Family

ID=53265544

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/557,989 Active US9619571B2 (en) 2013-12-02 2014-12-02 Method for searching related entities through entity co-occurrence
US15/481,993 Abandoned US20170212899A1 (en) 2013-12-02 2017-04-07 Method for searching related entities through entity co-occurrence

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/557,989 Active US9619571B2 (en) 2013-12-02 2014-12-02 Method for searching related entities through entity co-occurrence

Country Status (1)

Country Link
US (2) US9619571B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10678820B2 (en) 2018-04-12 2020-06-09 Abel BROWARNIK System and method for computerized semantic indexing and searching
US11120056B2 (en) 2016-09-02 2021-09-14 FutureVault Inc. Systems and methods for sharing documents
US11182395B2 (en) 2018-05-15 2021-11-23 International Business Machines Corporation Similarity matching systems and methods for record linkage
US11475074B2 (en) 2016-09-02 2022-10-18 FutureVault Inc. Real-time document filtering systems and methods

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9355152B2 (en) 2013-12-02 2016-05-31 Qbase, LLC Non-exclusionary search within in-memory databases
US10152478B2 (en) * 2015-06-07 2018-12-11 Apple Inc. Apparatus, system and method for string disambiguation and entity ranking
US9959354B2 (en) * 2015-06-23 2018-05-01 Google Llc Utilizing user co-search behavior to identify search queries seeking inappropriate content
US11113289B2 (en) * 2016-10-28 2021-09-07 Apple Inc. Blending learning models for search support
JP6839360B2 (en) * 2017-05-15 2021-03-10 富士通株式会社 Display program, display method and display device
CN108345702A (en) * 2018-04-10 2018-07-31 北京百度网讯科技有限公司 Entity recommends method and apparatus
US10861064B2 (en) 2018-06-12 2020-12-08 Exxonmobil Upstream Research Company Method and system for generating contradiction scores for petroleum geoscience entities within text using associative topic sentiment analysis
US11379526B2 (en) * 2019-02-08 2022-07-05 Intuit Inc. Disambiguation of massive graph databases
CN112307153B (en) * 2020-09-30 2022-06-10 杭州量知数据科技有限公司 Automatic construction method and device of industrial knowledge base and storage medium
CN112487214B (en) * 2020-12-23 2024-06-04 中译语通科技股份有限公司 Knowledge graph relation extraction method and system based on entity co-occurrence matrix

Family Cites Families (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5828843A (en) 1996-03-21 1998-10-27 Mpath Interactive, Inc. Object-oriented method for matching clients together with servers according to attributes included in join request
US6173298B1 (en) * 1996-09-17 2001-01-09 Asap, Ltd. Method and apparatus for implementing a dynamic collocation dictionary
US6178529B1 (en) 1997-11-03 2001-01-23 Microsoft Corporation Method and system for resource monitoring of disparate resources in a server cluster
US6353926B1 (en) 1998-07-15 2002-03-05 Microsoft Corporation Software update notification
US6266781B1 (en) 1998-07-20 2001-07-24 Academia Sinica Method and apparatus for providing failure detection and recovery with predetermined replication style for distributed applications in a network
US6338092B1 (en) 1998-09-24 2002-01-08 International Business Machines Corporation Method, system and computer program for replicating data in a distributed computed environment
US6959300B1 (en) 1998-12-10 2005-10-25 At&T Corp. Data compression method and apparatus
US7099898B1 (en) 1999-08-12 2006-08-29 International Business Machines Corporation Data access system
US6738759B1 (en) 2000-07-07 2004-05-18 Infoglide Corporation, Inc. System and method for performing similarity searching using pointer optimization
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US6832373B2 (en) 2000-11-17 2004-12-14 Bitfone Corporation System and method for updating and distributing information
US6691109B2 (en) 2001-03-22 2004-02-10 Turbo Worx, Inc. Method and apparatus for high-performance sequence comparison
GB2374687A (en) 2001-04-19 2002-10-23 Ibm Managing configuration changes in a data processing system
US7082478B2 (en) 2001-05-02 2006-07-25 Microsoft Corporation Logical semantic compression
US6961723B2 (en) 2001-05-04 2005-11-01 Sun Microsystems, Inc. System and method for determining relevancy of query responses in a distributed network search mechanism
US20030028869A1 (en) 2001-08-02 2003-02-06 Drake Daniel R. Method and computer program product for integrating non-redistributable software applications in a customer driven installable package
US6954456B2 (en) 2001-12-14 2005-10-11 At & T Corp. Method for content-aware redirection and content renaming
US6965900B2 (en) 2001-12-19 2005-11-15 X-Labs Holdings, Llc Method and apparatus for electronically extracting application specific multidimensional information from documents selected from a set of documents electronically extracted from a library of electronically searchable documents
US6829606B2 (en) 2002-02-14 2004-12-07 Infoglide Software Corporation Similarity search engine for use with relational databases
US7421478B1 (en) 2002-03-07 2008-09-02 Cisco Technology, Inc. Method and apparatus for exchanging heartbeat messages and configuration information between nodes operating in a master-slave configuration
US6817558B1 (en) 2002-04-23 2004-11-16 Uop Llc Parallel sizing, dosing and transfer assembly and method of use
US8015143B2 (en) 2002-05-22 2011-09-06 Estes Timothy W Knowledge discovery agent system and method
US7570262B2 (en) 2002-08-08 2009-08-04 Reuters Limited Method and system for displaying time-series data and correlated events derived from text mining
US7249312B2 (en) 2002-09-11 2007-07-24 Intelligent Results Attribute scoring for unstructured content
US7058846B1 (en) 2002-10-17 2006-06-06 Veritas Operating Corporation Cluster failover for storage management services
US20040205064A1 (en) 2003-04-11 2004-10-14 Nianjun Zhou Adaptive search employing entropy based quantitative information measurement
US7543174B1 (en) 2003-09-24 2009-06-02 Symantec Operating Corporation Providing high availability for an application by rapidly provisioning a node and failing over to the node
US9009153B2 (en) 2004-03-31 2015-04-14 Google Inc. Systems and methods for identifying a named entity
US7818615B2 (en) 2004-09-16 2010-10-19 Invensys Systems, Inc. Runtime failure management of redundantly deployed hosts of a supervisory process control data acquisition facility
US7403945B2 (en) 2004-11-01 2008-07-22 Sybase, Inc. Distributed database system providing data and space management methodology
US20060179026A1 (en) 2005-02-04 2006-08-10 Bechtel Michael E Knowledge discovery tool extraction and integration
US20060294071A1 (en) 2005-06-28 2006-12-28 Microsoft Corporation Facet extraction and user feedback for ranking improvement and personalization
US7630977B2 (en) 2005-06-29 2009-12-08 Xerox Corporation Categorization including dependencies between different category systems
US8386463B2 (en) 2005-07-14 2013-02-26 International Business Machines Corporation Method and apparatus for dynamically associating different query execution strategies with selective portions of a database table
CA2975694C (en) * 2005-07-15 2020-12-08 Indxit Systems, Inc. Systems and methods for data indexing and processing
US7681075B2 (en) 2006-05-02 2010-03-16 Open Invention Network Llc Method and system for providing high availability to distributed computer applications
US20070250501A1 (en) * 2005-09-27 2007-10-25 Grubb Michael L Search result delivery engine
US7447940B2 (en) 2005-11-15 2008-11-04 Bea Systems, Inc. System and method for providing singleton services in a cluster
US8341622B1 (en) 2005-12-15 2012-12-25 Crimson Corporation Systems and methods for efficiently using network bandwidth to deploy dependencies of a software package
US7899871B1 (en) 2006-01-23 2011-03-01 Clearwell Systems, Inc. Methods and systems for e-mail topic classification
US7519613B2 (en) 2006-02-28 2009-04-14 International Business Machines Corporation Method and system for generating threads of documents
US8726267B2 (en) 2006-03-24 2014-05-13 Red Hat, Inc. Sharing software certification and process metadata
US8190742B2 (en) 2006-04-25 2012-05-29 Hewlett-Packard Development Company, L.P. Distributed differential store with non-distributed objects and compression-enhancing data-object routing
US20070282959A1 (en) 2006-06-02 2007-12-06 Stern Donald S Message push with pull of information to a communications computing device
US8615800B2 (en) 2006-07-10 2013-12-24 Websense, Inc. System and method for analyzing web content
US7624118B2 (en) 2006-07-26 2009-11-24 Microsoft Corporation Data processing over very large databases
JP4922692B2 (en) 2006-07-28 2012-04-25 富士通株式会社 Search query creation device
US8122026B1 (en) 2006-10-20 2012-02-21 Google Inc. Finding and disambiguating references to entities on web pages
US7853611B2 (en) 2007-02-26 2010-12-14 International Business Machines Corporation System and method for deriving a hierarchical event based database having action triggers based on inferred probabilities
US8195655B2 (en) 2007-06-05 2012-06-05 Microsoft Corporation Finding related entity results for search queries
US8352455B2 (en) 2007-06-29 2013-01-08 Allvoices, Inc. Processing a content item with regard to an event and a location
US20090043792A1 (en) 2007-08-07 2009-02-12 Eric Lawrence Barsness Partial Compression of a Database Table Based on Historical Information
US10698886B2 (en) 2007-08-14 2020-06-30 John Nicholas And Kristin Gross Trust U/A/D Temporal based online search and advertising
GB2453174B (en) 2007-09-28 2011-12-07 Advanced Risc Mach Ltd Techniques for generating a trace stream for a data processing apparatus
KR100898339B1 (en) 2007-10-05 2009-05-20 한국전자통신연구원 Autonomous fault processing system in home network environments and operation method thereof
US8396838B2 (en) 2007-10-17 2013-03-12 Commvault Systems, Inc. Legal compliance, electronic discovery and electronic document handling of online and offline copies of data
US8375073B1 (en) 2007-11-12 2013-02-12 Google Inc. Identification and ranking of news stories of interest
US8294763B2 (en) 2007-12-14 2012-10-23 Sri International Method for building and extracting entity networks from video
US8326847B2 (en) 2008-03-22 2012-12-04 International Business Machines Corporation Graph search system and method for querying loosely integrated data
US20100077001A1 (en) 2008-03-27 2010-03-25 Claude Vogel Search system and method for serendipitous discoveries with faceted full-text classification
US8712926B2 (en) 2008-05-23 2014-04-29 International Business Machines Corporation Using rule induction to identify emerging trends in unstructured text streams
US8358308B2 (en) 2008-06-27 2013-01-22 Microsoft Corporation Using visual techniques to manipulate data
US8171547B2 (en) 2008-12-03 2012-05-01 Trend Micro Incorporated Method and system for real time classification of events in computer integrity system
US8874576B2 (en) 2009-02-27 2014-10-28 Microsoft Corporation Reporting including filling data gaps and handling uncategorized data
US20100235311A1 (en) 2009-03-13 2010-09-16 Microsoft Corporation Question and answer search
US8213725B2 (en) 2009-03-20 2012-07-03 Eastman Kodak Company Semantic event detection using cross-domain knowledge
US8161048B2 (en) 2009-04-24 2012-04-17 At&T Intellectual Property I, L.P. Database analysis using clusters
US8055933B2 (en) 2009-07-21 2011-11-08 International Business Machines Corporation Dynamic updating of failover policies for increased application availability
US9165034B2 (en) 2009-10-15 2015-10-20 Hewlett-Packard Development Company, L.P. Heterogeneous data source management
US8645372B2 (en) 2009-10-30 2014-02-04 Evri, Inc. Keyword-based search engine results using enhanced query strategies
US20110125764A1 (en) 2009-11-26 2011-05-26 International Business Machines Corporation Method and system for improved query expansion in faceted search
JP5576384B2 (en) 2010-01-29 2014-08-20 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Data processing device
US9710556B2 (en) 2010-03-01 2017-07-18 Vcvc Iii Llc Content recommendation based on collections of entities
US8595234B2 (en) 2010-05-17 2013-11-26 Wal-Mart Stores, Inc. Processing data feeds
US8429256B2 (en) 2010-05-28 2013-04-23 Red Hat, Inc. Systems and methods for generating cached representations of host package inventories in remote package repositories
US8345998B2 (en) 2010-08-10 2013-01-01 Xerox Corporation Compression scheme selection based on image data type and user selections
US8321443B2 (en) 2010-09-07 2012-11-27 International Business Machines Corporation Proxying open database connectivity (ODBC) calls
US20120102121A1 (en) 2010-10-25 2012-04-26 Yahoo! Inc. System and method for providing topic cluster based updates
US20120143875A1 (en) 2010-12-01 2012-06-07 Yahoo! Inc. Method and system for discovering dynamic relations among entities
US9245022B2 (en) * 2010-12-30 2016-01-26 Google Inc. Context-based person search
US8423522B2 (en) 2011-01-04 2013-04-16 International Business Machines Corporation Query-aware compression of join results
US20120246154A1 (en) 2011-03-23 2012-09-27 International Business Machines Corporation Aggregating search results based on associating data instances with knowledge base entities
KR20120134916A (en) 2011-06-03 2012-12-12 삼성전자주식회사 Storage device and data processing device for storage device
US20120310934A1 (en) 2011-06-03 2012-12-06 Thomas Peh Historic View on Column Tables Using a History Table
US20120323923A1 (en) * 2011-06-14 2012-12-20 Bank Of America Corporation Sorting Data in Limited Memory
US9104979B2 (en) 2011-06-16 2015-08-11 Microsoft Technology Licensing, Llc Entity recognition using probabilities for out-of-collection data
EP2727247B1 (en) 2011-06-30 2017-04-05 Openwave Mobility, Inc. Database compression system and method
US9032387B1 (en) 2011-10-04 2015-05-12 Amazon Technologies, Inc. Software distribution framework
SG11201402943WA (en) 2011-12-06 2014-07-30 Perception Partners Inc Text mining analysis and output system
US9026480B2 (en) 2011-12-21 2015-05-05 Telenav, Inc. Navigation system with point of interest classification mechanism and method of operation thereof
US9037579B2 (en) 2011-12-27 2015-05-19 Business Objects Software Ltd. Generating dynamic hierarchical facets from business intelligence artifacts
US10908792B2 (en) 2012-04-04 2021-02-02 Recorded Future, Inc. Interactive event-based information system
US20130290232A1 (en) 2012-04-30 2013-10-31 Mikalai Tsytsarau Identifying news events that cause a shift in sentiment
US8948789B2 (en) 2012-05-08 2015-02-03 Qualcomm Incorporated Inferring a context from crowd-sourced activity data
CA2865184C (en) 2012-05-15 2018-01-02 Whyz Technologies Limited Method and system relating to re-labelling multi-document clusters
US9703833B2 (en) 2012-11-30 2017-07-11 Sap Se Unification of search and analytics
US9542652B2 (en) 2013-02-28 2017-01-10 Microsoft Technology Licensing, Llc Posterior probability pursuit for entity disambiguation
US9104710B2 (en) 2013-03-15 2015-08-11 Src, Inc. Method for cross-domain feature correlation
US8977600B2 (en) 2013-05-24 2015-03-10 Software AG USA Inc. System and method for continuous analytics run against a combination of static and real-time data
US9734221B2 (en) 2013-09-12 2017-08-15 Sap Se In memory database warehouse
US9424294B2 (en) 2013-12-02 2016-08-23 Qbase, LLC Method for facet searching and search suggestions
US9201744B2 (en) 2013-12-02 2015-12-01 Qbase, LLC Fault tolerant architecture for distributed computing systems
US9025892B1 (en) 2013-12-02 2015-05-05 Qbase, LLC Data record compression with progressive and/or selective decomposition
US9223875B2 (en) 2013-12-02 2015-12-29 Qbase, LLC Real-time distributed in memory search architecture

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11120056B2 (en) 2016-09-02 2021-09-14 FutureVault Inc. Systems and methods for sharing documents
US11475074B2 (en) 2016-09-02 2022-10-18 FutureVault Inc. Real-time document filtering systems and methods
US10678820B2 (en) 2018-04-12 2020-06-09 Abel BROWARNIK System and method for computerized semantic indexing and searching
US11182395B2 (en) 2018-05-15 2021-11-23 International Business Machines Corporation Similarity matching systems and methods for record linkage

Also Published As

Publication number Publication date
US20150154306A1 (en) 2015-06-04
US9619571B2 (en) 2017-04-11

Similar Documents

Publication Publication Date Title
US9619571B2 (en) Method for searching related entities through entity co-occurrence
US9864808B2 (en) Knowledge-based entity detection and disambiguation
US9201931B2 (en) Method for obtaining search suggestions from fuzzy score matching and population frequencies
US11573996B2 (en) System and method for hierarchically organizing documents based on document portions
US9720944B2 (en) Method for facet searching and search suggestions
US9613166B2 (en) Search suggestions of related entities based on co-occurrence and/or fuzzy-score matching
US10261954B2 (en) Optimizing search result snippet selection
US9418128B2 (en) Linking documents with entities, actions and applications
US20160110446A1 (en) Method for disambiguated features in unstructured text
WO2015084759A1 (en) Systems and methods for in-memory database search
US20160034514A1 (en) Providing search results based on an identified user interest and relevance matching
WO2014054052A2 (en) Context based co-operative learning system and method for representing thematic relationships
CN115563313A (en) Knowledge graph-based document book semantic retrieval system
US20120239657A1 (en) Category classification processing device and method
WO2015084757A1 (en) Systems and methods for processing data stored in a database
US20160246794A1 (en) Method for entity-driven alerts based on disambiguated features
US20170075915A1 (en) Search suggestions using fuzzy-score matching and entity co-occurrence
US9547701B2 (en) Method of discovering and exploring feature knowledge
KR20150025532A (en) Data recommendation metod based on keywords

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION