US20160239504A1 - Method for entity enrichment of digital content to enable advanced search functionality in content management systems - Google Patents
Method for entity enrichment of digital content to enable advanced search functionality in content management systems Download PDFInfo
- Publication number
- US20160239504A1 US20160239504A1 US15/136,696 US201615136696A US2016239504A1 US 20160239504 A1 US20160239504 A1 US 20160239504A1 US 201615136696 A US201615136696 A US 201615136696A US 2016239504 A1 US2016239504 A1 US 2016239504A1
- Authority
- US
- United States
- Prior art keywords
- entity
- geographic
- data
- processor
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G06F17/3087—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
- G06F16/24565—Triggers; Constraints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24568—Data stream processing; Continuous queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/909—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9538—Presentation of query results
-
- G06F17/3056—
-
- G06F17/30997—
-
- G06K9/00476—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/42—Document-oriented image-based pattern recognition based on the type of document
- G06V30/422—Technical drawings; Geographical maps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/10—Recognition assisted with metadata
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Definitions
- the invention generally refers to search engines and content management. More specifically, extending a content management system's search engine technology to enable geotagging and named entities enrichment of digital content.
- SharePoint 2013® is a family of software products developed by Microsoft Corporation for collaboration, file sharing and web publishing.
- SharePoint 2013® may provide a user with a vast amount of content or information and it may become difficult for a user to find the most relevant information for a particular circumstance.
- SharePoint 2013® provides a search engine in order to assist users in finding the content that they need. A user may enter a keyword based search query and the search engine in SharePoint 2013® may return to the user a list of the most relevant results found within the context of the SharePoint 2013® platform once the content has been indexed.
- SharePoint 2013® does not provide out of the box functionality to automatically extract entities from documents. Particularly, it does not support geotagging content to extract geographic entities and resolve them to a geographic location. Also, SharePoint 2013 does not support entity tagging in order to identify, disambiguate and extract named entities, such as, organizations or people in a document.
- SharePoint 2013® search may be extended to enable effective geographic searches and other entity related searches, including entity-based search facets. Previous versions of SharePoint 2013® included “FAST Search” for SharePoint, from which it was possible to extend the content processing pipeline through sandboxed applications, but this was both slow and limited in the information it could access.
- SharePoint 2013® introduces a much more open API which makes it possible to add specialized linguistics such as concept extraction, relationship extraction, geotagging, summarization and as well as sophisticated text analytics. Thus, an opportunity exists to extend the capabilities of SharePoint 2013® search engine to enable geographic and other entity based searches.
- the system includes a computer processor operatively associated with a computer memory and one or more I/O device, in which the processor and memory are configured to operate one or more SharePoint 2013® processes.
- the system also includes another computer processor operatively associated with a computer memory and one or more I/O devices, in which the processor and memory are configured to host and provide processing for a geotagging web service.
- the SharePoint 2013® system may include a crawling component, a content processing component and a search indexing component in order to enable search of content.
- the content processing component in SharePoint 2013® search may extend its functionality by using the Content Enrichment Web Service (CEWS) feature.
- CEWS Content Enrichment Web Service
- the method involves crawling content from the different sources in order to obtain an array of crawled properties that are sent for content processing.
- a trigger condition may determine if crawled properties may benefit from additional processing in order to enrich the original content with additional geographic metadata properties. If the crawled properties don't benefit from additional processing the crawled properties may be mapped to managed processing and sent to a search index. If the crawled properties benefit from external web services processing, the CEWS may make a simple object access protocol (SOAP) request to a configurable endpoint using hypertext transfer protocol (HTTP) or any other web service call method.
- SOAP simple object access protocol
- HTTP hypertext transfer protocol
- An entity enrichment service may determine the type of content.
- the content is in an image format
- its metadata such as file location
- OCR optical character recognition
- the geotagging web service may identify geographic metadata and associate it with the content as managed properties. After the content has been geotagged, it may be sent to the indexing component.
- An additional search user interface may be added using either SharePoint 2013® web parts or by modifying the standard layout of SharePoint 2013® search with standard web development tools such as HTML, HTML 5, JavaScript and CSS among others.
- the search UI may assist a user in performing geographic search queries or displaying geographic search results using digital geographic features such as for example and without limitation, digital maps.
- the search UI can also be enhanced to perform faceted search using the additional enriched entities or their associated metadata.
- SharePoint 2013® search architecture involves a step of crawling and content processing in which components may be:
- FIG. 1 is a system architecture for tagging and entity enrichment of content in a content management system
- FIG. 2 is a process by which content is tagged and indexed for named and geographic entity searches.
- Geotagging refers to the process of extracting geographic entities from unstructured text files. Geotagging may include disambiguating the entity to a specific geographic place and appending geographic metadata such as geographic coordinates, geographic feature type and other metadata.
- Entity Tagging refers to the process of extracting named entities from unstructured text. Entity Tagging may include entity disambiguation, entity name normalization and appending entity metadata.
- Named Entity refers to a person, organization or topic.
- Geographic Entity refers to geographic location or geographic places.
- “Crawled Properties” refers to content management system metadata obtained from inspecting documents during crawls.
- FIG. 1 is a system architecture 100 for geotagging content in SharePoint 2013®.
- a Search index 124 is one of a number of key components in order to enable search in SharePoint 102 .
- Another key part of enabling search in SharePoint 2013® 102 may be content capturing in order to index the content.
- SharePoint 102 includes a crawler 104 component in order to enable content capturing.
- Crawler 104 may crawl through different content sources 106 adding a list of metadata properties to each content.
- content sources may include without limitation, SharePoint content, network file-share or user or intranet content.
- Crawler 104 may be configured perform the functions of connecting securely to a content source 106 , associating document from the sources to their metadata as crawled properties.
- the crawler 104 may be configured to full or incremental crawls to content. Examples of crawled properties may include for example and without limitation author, title, creation date among others.
- SharePoint 2013® includes a content processing 108 component.
- the content processing 108 component takes content from the crawler 104 and prepares it for indexing.
- Content processing 108 may involve stages of linguistic processing (language detection), parsing, entity extraction management, content-based file format detection, content processing error reporting, natural language processing and mapping crawled properties to managed properties among others.
- Content processing 108 may be extended by means of a content enrichment web service (CEWS 110 ).
- CEWS 110 may enable the enrichment of content processing 108 by allowing a web service callout 112 to call external web service to perform additional actions and enrich the crawled data properties.
- Web service callout 112 may be a standard simple object access protocol (SOAP) request or any other web service call method used to exchange structured information of the crawled data with an entity enrichment service 114 .
- Web service callout 112 may include trigger conditions configured in the content enrichment configuration object that control when to call an external web service for enrichment processing.
- Entity enrichment service 114 may also determine the document type of the crawled data in order to determine content that may come in the form of an image (scanned documents, pictures, etc.).
- the entity enrichment service 114 may send the location of the crawled document to an OCR processing engine 116 such as for example and without limitation an optical character recognition component or other image processing component.
- OCR processing engine 116 may then retrieve and process the image files and convert them to text files asynchronously.
- the OCR'd processed files 118 may subsequently be re-fed to crawler 104 in order to be crawled as text files and sent back to content processing 108 and proceed with the rest of the workflow.
- System architecture 100 may include an external geotagger web service 120 and a named entity tagger service 122 .
- Both geotagger web service 120 and named entity tagger service 122 may be a software module configured to function as a web service application provider and to respond to web service callout 112 .
- Geotagger web service 120 may use natural language processing entity extraction techniques, machine learning models and other techniques in order to identify and disambiguate geographic entities from crawled content. For example, geotagger web service 120 may disambiguate geographic entities by analyzing statistical co-occurrence of entities found in a gazetteer.
- Geotagger web service 120 may include a database of statistical co-occurring entities which may be linked against content found by crawler 104 .
- named entity tagger service 122 may be used to extract additional entities or text features such as organizations, people or topics.
- Geotagger web service 120 may analyze an array of managed properties sent as input properties by CEWS 110 and identify any geographic entities referred in text. Non-limiting examples of input properties may include: FileType, IsDocument, OriginalPath and body among others. Geotagger web service 120 may then geotag the text by creating or modifying managed properties with reference to each geographic entity found. Geotagger web service 120 may send modified or new managed properties to the entity enrichment service 114 where a conversion is made that maps the modified managed properties and returns them as output properties back to CEWS 110 . The same process may be used to interact with the named entity tagger service 122 for the extraction and entity tagging of other entities or text features such as organizations, people or topics.
- the properties are merged with the crawled file managed properties and sent to a search index 124 .
- search queries may also be performed using geographic or named entity features.
- a search UI 126 in SharePoint 2013® may include specific displays that may assist a user in performing a geographic based search as well as support enhanced displays of faceted search results.
- the search UI 126 may be a custom web part or may also be done by modifying the standard layout of SharePoint 2013® search with standard tools such as HTML, HTML 5, JavaScript and CSS.
- FIG. 2 is a flow chart 200 illustrating the process steps for tagging content for SharePoint 2013® search.
- the process may begin when the crawler component in SharePoint 2013® performs a crawl for content (step 202 ).
- the crawl may be a full crawl, wherein in another embodiment the crawl may be an incremental crawl.
- the crawler component may then feed crawled properties and metadata to the content processing (step 204 ).
- a determination is made to verify if the crawled content may include geographic or named entities.
- a trigger condition may be used.
- the trigger condition may contain a set of programmatic logic or rules which may determine if content may benefit from geotagging or entity tagging.
- the trigger condition evaluates to false crawled content may be associated with managed properties (step 206 ) and passed to the search index component (step 208 ). If the trigger condition evaluates to true the CEWS may send a web service callout (step 210 ) to an entity enrichment service.
- the entity enrichment service may analyze the content sent in order to determine if the content may be in an image format (scanned documents, pictures, etc.). Content found in an image format may be processed asynchronously by an OCR engine and sent back to be re-crawled by the crawling component as text files (step 212 ). If the content is not in image format, the content may be processed by a geotagging web service or a name entity tagger service (step 214 ).
- the web service may extract and disambiguate geographic or named entities referred in the content and enrich them with entity metadata.
- the identified entities and their metadata may be sent back as managed properties to the content processing component and associated with the content (step 216 ).
- the associated metadata may then be sent to the search index component (step 206 ).
- process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the steps in the foregoing embodiments may be performed in any order. Words such as “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods.
- process flow diagrams may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged.
- a process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.
- Embodiments implemented in computer software may be implemented in software, firmware, middleware, microcode, hardware description languages, or any combination thereof.
- a code segment or machine-executable instructions may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements.
- a code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents.
- Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.
- the functions When implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable or processor-readable storage medium.
- the steps of a method or algorithm disclosed here may be embodied in a processor-executable software module which may reside on a computer-readable or processor-readable storage medium.
- a non-transitory computer-readable or processor-readable media includes both computer storage media and tangible storage media that facilitate transfer of a computer program from one place to another.
- a non-transitory processor-readable storage media may be any available media that may be accessed by a computer.
- non-transitory processor-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other tangible storage medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer or processor.
- Disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
- the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer-readable medium, which may be incorporated into a computer program product.
- the functionality may be implemented within circuitry of a wireless signal processing circuit that may be suitable for use in a wireless receiver or mobile device.
- a wireless signal processing circuit may include circuits for accomplishing the signal measuring and calculating steps described in the various embodiments.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
- a processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- Remote Sensing (AREA)
- User Interface Of Digital Computer (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Disclosed is a system and method for extending search capabilities of contentment management systems, such as SharePoint 2013®, to enable geographic and name entity based searches. Geographic and named entity searches are enabled by a content enrichment web service. The content enrichment web service calls a geotagging or a named entity tagger web service application to tag crawled managed properties as input and return geographically or entity modified managed properties as output. The system associates one or more geographically and named entity modified managed properties with content and stores this information as metadata in a SharePoint 2013® search index. Thus, the search system allows users to identify a particular geographic entity the user is interested in finding, and to receive search results directly related to that geographic entity on SharePoint 2013®.
Description
- This application is a continuation of U.S. patent application Ser. No. 14/558,191, entitled “Method For Entity Enrichment Of Digital Content To Enable Advanced Search Functionality In Content Management Systems,” filed Dec. 2, 2014, which is claims a benefit of priority to U.S. Provisional Patent Application Ser. No. 61/947,652, entitled “Method For Entity Enrichment Of Digital Content To Enable Advanced Search Functionality In Content Management Systems,” filed Mar. 4, 2014, which hereby incorporated in its entirety herein for all purposes.
- This application is related to U.S. patent application Ser. No. 14/557,794, entitled “Method for Disambiguating Features in Unstructured Text,” filed Dec. 2, 2014; U.S. patent application Ser. No. 14/558,300, entitled “Event Detection Through Text Analysis Using Trained Event Template Models,” filed Dec. 2, 2014; and U.S. patent application Ser. No. 14/558,807, entitled “Method for Facet Searching and Search Suggestions,” filed Dec. 2, 2014; each of which are incorporated herein by reference in their entirety.
- The invention generally refers to search engines and content management. More specifically, extending a content management system's search engine technology to enable geotagging and named entities enrichment of digital content.
- Content management and document management systems for document versioning and collaborative project management are known. One non-limiting example may be Microsoft's Sharepoint 2013® software and application suite of tools. Microsoft SharePoint 2013® is a family of software products developed by Microsoft Corporation for collaboration, file sharing and web publishing. SharePoint 2013® may provide a user with a vast amount of content or information and it may become difficult for a user to find the most relevant information for a particular circumstance. To mitigate these issues SharePoint 2013® provides a search engine in order to assist users in finding the content that they need. A user may enter a keyword based search query and the search engine in SharePoint 2013® may return to the user a list of the most relevant results found within the context of the SharePoint 2013® platform once the content has been indexed.
- At times a user may desire to find content related to geographic entities in SharePoint 2013® or other type of entity such as organizations or people referred to within a document. SharePoint 2013® does not provide out of the box functionality to automatically extract entities from documents. Particularly, it does not support geotagging content to extract geographic entities and resolve them to a geographic location. Also, SharePoint 2013 does not support entity tagging in order to identify, disambiguate and extract named entities, such as, organizations or people in a document. However, SharePoint 2013® search may be extended to enable effective geographic searches and other entity related searches, including entity-based search facets. Previous versions of SharePoint 2013® included “FAST Search” for SharePoint, from which it was possible to extend the content processing pipeline through sandboxed applications, but this was both slow and limited in the information it could access.
- SharePoint 2013® introduces a much more open API which makes it possible to add specialized linguistics such as concept extraction, relationship extraction, geotagging, summarization and as well as sophisticated text analytics. Thus, an opportunity exists to extend the capabilities of SharePoint 2013® search engine to enable geographic and other entity based searches.
- Disclosed herein are systems and methods for enabling geographic entity-based searches in content management systems, like Microsoft's SharePoint 2013®. Embodiments describe a method which involves extending the SharePoint 2013® search architecture by adding a geographic tagging web service. The system includes a computer processor operatively associated with a computer memory and one or more I/O device, in which the processor and memory are configured to operate one or more SharePoint 2013® processes. The system also includes another computer processor operatively associated with a computer memory and one or more I/O devices, in which the processor and memory are configured to host and provide processing for a geotagging web service. The SharePoint 2013® system may include a crawling component, a content processing component and a search indexing component in order to enable search of content. The content processing component in SharePoint 2013® search may extend its functionality by using the Content Enrichment Web Service (CEWS) feature.
- The method involves crawling content from the different sources in order to obtain an array of crawled properties that are sent for content processing. During content processing, a trigger condition may determine if crawled properties may benefit from additional processing in order to enrich the original content with additional geographic metadata properties. If the crawled properties don't benefit from additional processing the crawled properties may be mapped to managed processing and sent to a search index. If the crawled properties benefit from external web services processing, the CEWS may make a simple object access protocol (SOAP) request to a configurable endpoint using hypertext transfer protocol (HTTP) or any other web service call method. An entity enrichment service may determine the type of content. If the content is in an image format, its metadata such as file location may be sent to an optical character recognition (OCR) engine so that the original document can be retrieved and processed asynchronously to convert to text and sent back to the crawl component to be re-crawled in text format. If the content is in text format the geotagging web service may identify geographic metadata and associate it with the content as managed properties. After the content has been geotagged, it may be sent to the indexing component.
- An additional search user interface (UI) may be added using either SharePoint 2013® web parts or by modifying the standard layout of SharePoint 2013® search with standard web development tools such as HTML, HTML 5, JavaScript and CSS among others. The search UI may assist a user in performing geographic search queries or displaying geographic search results using digital geographic features such as for example and without limitation, digital maps. The search UI can also be enhanced to perform faceted search using the additional enriched entities or their associated metadata.
- The present disclosure can be better understood by referring to the following figures. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the disclosure. In the figures, reference numerals designate corresponding parts throughout the different views.
- Content capture is essential for searches. SharePoint 2013® search architecture involves a step of crawling and content processing in which components may be:
-
FIG. 1 is a system architecture for tagging and entity enrichment of content in a content management system, and -
FIG. 2 is a process by which content is tagged and indexed for named and geographic entity searches. - The present disclosure is here described in detail with reference to embodiments illustrated in the drawings, which form a part here. Other embodiments may be used and/or other changes may be made without departing from the spirit or scope of the present disclosure. The illustrative embodiments described in the detailed description are not meant to be limiting of the subject matter presented here.
- As used here, the following terms may have the following definitions:
- “Geotagging” refers to the process of extracting geographic entities from unstructured text files. Geotagging may include disambiguating the entity to a specific geographic place and appending geographic metadata such as geographic coordinates, geographic feature type and other metadata.
- “Entity Tagging” refers to the process of extracting named entities from unstructured text. Entity Tagging may include entity disambiguation, entity name normalization and appending entity metadata.
- “Named Entity” refers to a person, organization or topic.
- “Geographic Entity” refers to geographic location or geographic places.
- “Crawled Properties” refers to content management system metadata obtained from inspecting documents during crawls.
- Reference will now be made to the exemplary embodiments illustrated in the drawings, and specific language will be used here to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended. Alterations and further modifications of the inventive features illustrated here, and additional applications of the principles of the inventions as illustrated here, which would occur to one skilled in the relevant art and having possession of this disclosure, are to be considered within the scope of the invention.
-
FIG. 1 is asystem architecture 100 for geotagging content in SharePoint 2013®. ASearch index 124 is one of a number of key components in order to enable search inSharePoint 102. Another key part of enabling search in SharePoint 2013® 102 may be content capturing in order to index the content.SharePoint 102 includes acrawler 104 component in order to enable content capturing. -
Crawler 104 may crawl throughdifferent content sources 106 adding a list of metadata properties to each content. Examples of content sources may include without limitation, SharePoint content, network file-share or user or intranet content.Crawler 104 may be configured perform the functions of connecting securely to acontent source 106, associating document from the sources to their metadata as crawled properties. Thecrawler 104 may be configured to full or incremental crawls to content. Examples of crawled properties may include for example and without limitation author, title, creation date among others. - SharePoint 2013® includes a
content processing 108 component. Thecontent processing 108 component takes content from thecrawler 104 and prepares it for indexing.Content processing 108 may involve stages of linguistic processing (language detection), parsing, entity extraction management, content-based file format detection, content processing error reporting, natural language processing and mapping crawled properties to managed properties among others. -
Content processing 108 may be extended by means of a content enrichment web service (CEWS 110).CEWS 110 may enable the enrichment ofcontent processing 108 by allowing aweb service callout 112 to call external web service to perform additional actions and enrich the crawled data properties.Web service callout 112 may be a standard simple object access protocol (SOAP) request or any other web service call method used to exchange structured information of the crawled data with anentity enrichment service 114.Web service callout 112 may include trigger conditions configured in the content enrichment configuration object that control when to call an external web service for enrichment processing.Entity enrichment service 114 may also determine the document type of the crawled data in order to determine content that may come in the form of an image (scanned documents, pictures, etc.). Whenever content in the form of an image is found theentity enrichment service 114 may send the location of the crawled document to anOCR processing engine 116 such as for example and without limitation an optical character recognition component or other image processing component.OCR processing engine 116 may then retrieve and process the image files and convert them to text files asynchronously. The OCR'd processedfiles 118 may subsequently be re-fed tocrawler 104 in order to be crawled as text files and sent back tocontent processing 108 and proceed with the rest of the workflow. -
System architecture 100 may include an externalgeotagger web service 120 and a namedentity tagger service 122. Bothgeotagger web service 120 and namedentity tagger service 122 may be a software module configured to function as a web service application provider and to respond toweb service callout 112.Geotagger web service 120 may use natural language processing entity extraction techniques, machine learning models and other techniques in order to identify and disambiguate geographic entities from crawled content. For example,geotagger web service 120 may disambiguate geographic entities by analyzing statistical co-occurrence of entities found in a gazetteer.Geotagger web service 120 may include a database of statistical co-occurring entities which may be linked against content found bycrawler 104. Following the same technique, namedentity tagger service 122 may be used to extract additional entities or text features such as organizations, people or topics. -
Geotagger web service 120 may analyze an array of managed properties sent as input properties byCEWS 110 and identify any geographic entities referred in text. Non-limiting examples of input properties may include: FileType, IsDocument, OriginalPath and body among others.Geotagger web service 120 may then geotag the text by creating or modifying managed properties with reference to each geographic entity found.Geotagger web service 120 may send modified or new managed properties to theentity enrichment service 114 where a conversion is made that maps the modified managed properties and returns them as output properties back toCEWS 110. The same process may be used to interact with the namedentity tagger service 122 for the extraction and entity tagging of other entities or text features such as organizations, people or topics. - After the augmented managed properties are returned by the
entity enrichment service 114 the properties are merged with the crawled file managed properties and sent to asearch index 124. - Once geographic and other entity tags have been associated with content and indexed, search queries may also be performed using geographic or named entity features. A
search UI 126 in SharePoint 2013® may include specific displays that may assist a user in performing a geographic based search as well as support enhanced displays of faceted search results. Thesearch UI 126 may be a custom web part or may also be done by modifying the standard layout of SharePoint 2013® search with standard tools such as HTML, HTML 5, JavaScript and CSS. -
FIG. 2 is aflow chart 200 illustrating the process steps for tagging content for SharePoint 2013® search. The process may begin when the crawler component in SharePoint 2013® performs a crawl for content (step 202). In one embodiment the crawl may be a full crawl, wherein in another embodiment the crawl may be an incremental crawl. The crawler component may then feed crawled properties and metadata to the content processing (step 204). A determination is made to verify if the crawled content may include geographic or named entities. For example and without limitation a trigger condition may be used. The trigger condition may contain a set of programmatic logic or rules which may determine if content may benefit from geotagging or entity tagging. If the trigger condition evaluates to false crawled content may be associated with managed properties (step 206) and passed to the search index component (step 208). If the trigger condition evaluates to true the CEWS may send a web service callout (step 210) to an entity enrichment service. The entity enrichment service may analyze the content sent in order to determine if the content may be in an image format (scanned documents, pictures, etc.). Content found in an image format may be processed asynchronously by an OCR engine and sent back to be re-crawled by the crawling component as text files (step 212). If the content is not in image format, the content may be processed by a geotagging web service or a name entity tagger service (step 214). The web service may extract and disambiguate geographic or named entities referred in the content and enrich them with entity metadata. The identified entities and their metadata may be sent back as managed properties to the content processing component and associated with the content (step 216). The associated metadata may then be sent to the search index component (step 206). - The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the steps in the foregoing embodiments may be performed in any order. Words such as “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods. Although process flow diagrams may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function.
- The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed here may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
- Embodiments implemented in computer software may be implemented in software, firmware, middleware, microcode, hardware description languages, or any combination thereof. A code segment or machine-executable instructions may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.
- The actual software code or specialized control hardware used to implement these systems and methods is not limiting of the invention. Thus, the operation and behavior of the systems and methods were described without reference to the specific software code being understood that software and control hardware can be designed to implement the systems and methods based on the description here.
- When implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable or processor-readable storage medium. The steps of a method or algorithm disclosed here may be embodied in a processor-executable software module which may reside on a computer-readable or processor-readable storage medium. A non-transitory computer-readable or processor-readable media includes both computer storage media and tangible storage media that facilitate transfer of a computer program from one place to another. A non-transitory processor-readable storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such non-transitory processor-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other tangible storage medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer or processor. Disk and disc, as used here, include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer-readable medium, which may be incorporated into a computer program product.
- When implemented in hardware, the functionality may be implemented within circuitry of a wireless signal processing circuit that may be suitable for use in a wireless receiver or mobile device. Such a wireless signal processing circuit may include circuits for accomplishing the signal measuring and calculating steps described in the various embodiments.
- The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
- Any reference to claim elements in the singular, for example, using the articles “a,” “an” or “the,” is not to be construed as limiting the element to the singular.
- The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined here may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown here but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed here.
Claims (11)
1. A method comprising:
in response to a processor determining that a portion of a data stream comprising content data is to be at least one of geo-tagged and entity-tagged:
generating, by the processor, geographic data associated with the content data in the portion of the data stream, and
updating, by the processor, metadata associated with the content data of the portion of the data stream, the metadata comprising the geographic data; and
in response to the processor determining that the portion of the data stream comprises image data:
executing, by the processor, an optical character recognition routine on the image data in the portion of the data stream,
generating, by the processor, text data based upon the optical character recognition routine performed on the image data,
identifying, by the processor, a portion of the text data containing geographic data, and
updating, by the processor, the geographic data in the metadata based upon the geographic data identified in the text data.
2. The method of claim 1 , further comprising fetching, by the processor, a file containing the image data from storage media associated with a source of the data stream of content data, upon determining that the portion of the data stream comprises the image data.
3. The method of claim 2 , wherein fetching the file from the storage further comprises:
receiving, by the processor, the file from a server of the source having a uniform resource location address associated with the metadata.
4. The method of claim 1 , wherein determining that the portion is to be at least one of geo-tagged and entity-tagged further comprises:
searching, by the processor, one or more portions of the content data of the data feed for a geographic entity; and
identifying, by the processor, the geographic entity in the portion of the content data.
5. The method of claim 1 , wherein generating the geographic data further comprises:
identifying, by the processor, a geographic entity in the portion.
6. The method of claim 5 , wherein identifying the geographic entity further comprises:
querying, by the processor, a database configured to store an entity record associated with a geographic entity, wherein the entity record comprises entity data that identifies the geographic entity in the text data; and
comparing, by the processor, the text data with the entity data.
7. The method of claim 6 , wherein the identifying the geographic entity comprises determining, by the processor, a number of co-occurrences of the geographic entity in a source of data, wherein a record of the geographic entity contains a co-occurrence count for the geographic entity.
8. The method of claim 6 , wherein the geographic entity is selected from a group consisting of a geographic location, a geographic coordinate, and a geographic feature.
9. The method of claim 6 , wherein the entity data identifies an entity selected from a group consisting of an organization, a person, and a topic.
10. The method of claim 1 , further comprising:
in response to not determining, by the processor, that the portion is to be at least one of geo-tagged and entity-tagged:
mapping, by the processor, the metadata to a set of managed properties associated with a search index.
11. The method of claim 10 , further comprising:
in response receiving, by the processor, an input from a user interface:
querying, by the processor, a database for a geographic entity via the search index in accordance with the input, wherein the database is hosted on a servers storing the content data.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/136,696 US20160239504A1 (en) | 2014-03-04 | 2016-04-22 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461947652P | 2014-03-04 | 2014-03-04 | |
US14/558,191 US9361317B2 (en) | 2014-03-04 | 2014-12-02 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
US15/136,696 US20160239504A1 (en) | 2014-03-04 | 2016-04-22 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/558,191 Continuation US9361317B2 (en) | 2014-03-04 | 2014-12-02 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160239504A1 true US20160239504A1 (en) | 2016-08-18 |
Family
ID=54017580
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/558,191 Active US9361317B2 (en) | 2014-03-04 | 2014-12-02 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
US15/136,696 Abandoned US20160239504A1 (en) | 2014-03-04 | 2016-04-22 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/558,191 Active US9361317B2 (en) | 2014-03-04 | 2014-12-02 | Method for entity enrichment of digital content to enable advanced search functionality in content management systems |
Country Status (1)
Country | Link |
---|---|
US (2) | US9361317B2 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6104956B2 (en) * | 2015-01-30 | 2017-03-29 | 株式会社Pfu | Image data processing server, system, method and program |
US10380200B2 (en) | 2016-05-31 | 2019-08-13 | At&T Intellectual Property I, L.P. | Method and apparatus for enriching metadata via a network |
CN106250443A (en) * | 2016-07-27 | 2016-12-21 | 福建富士通信息软件有限公司 | The method and system of data base's complex text inquiry are solved based on internal memory full-text search |
US10372830B2 (en) * | 2017-05-17 | 2019-08-06 | Adobe Inc. | Digital content translation techniques and systems |
US10984001B2 (en) * | 2019-02-08 | 2021-04-20 | Intuit Inc. | Graph database applications |
US11403356B2 (en) | 2019-04-16 | 2022-08-02 | International Business Machines Corporation | Personalizing a search of a search service |
US11403354B2 (en) | 2019-04-16 | 2022-08-02 | International Business Machines Corporation | Managing search queries of a search service |
US11244007B2 (en) | 2019-04-16 | 2022-02-08 | International Business Machines Corporation | Automatic adaption of a search configuration |
US11210352B2 (en) | 2019-04-16 | 2021-12-28 | International Business Machines Corporation | Automatic check of search configuration changes |
US10956430B2 (en) | 2019-04-16 | 2021-03-23 | International Business Machines Corporation | User-driven adaptation of rankings of navigation elements |
US11176134B2 (en) | 2019-04-16 | 2021-11-16 | International Business Machines Corporation | Navigation paths between content items |
US11436214B2 (en) | 2019-04-16 | 2022-09-06 | International Business Machines Corporation | Preventing search fraud |
CN110119694B (en) * | 2019-04-24 | 2021-03-12 | 北京百炼智能科技有限公司 | Picture processing method and device and computer readable storage medium |
CN110147350A (en) * | 2019-05-22 | 2019-08-20 | 深圳市网心科技有限公司 | File search method, device, electronic equipment and storage medium |
US11853452B2 (en) | 2021-11-05 | 2023-12-26 | International Business Machines Corporation | Keeping databases compliant with data protection regulations by sensing the presence of sensitive data and transferring the data to compliant geographies |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070140595A1 (en) * | 2005-12-16 | 2007-06-21 | Bret Taylor | Database assisted OCR for street scenes and other images |
US20080030690A1 (en) * | 2006-08-07 | 2008-02-07 | Yi-Ting Hsu | Projection Device with a Blower and a Nozzle disposed on a Bracket |
US20080163003A1 (en) * | 2006-12-29 | 2008-07-03 | Mudit Mehrotra | Method and System for Autonomic Target Testing |
US7519200B2 (en) * | 2005-05-09 | 2009-04-14 | Like.Com | System and method for enabling the use of captured images through recognition |
US20100104187A1 (en) * | 2008-10-24 | 2010-04-29 | Matt Broadbent | Personal navigation device and related method of adding tags to photos according to content of the photos and geographical information of where photos were taken |
US8265400B2 (en) * | 2010-06-18 | 2012-09-11 | Google Inc. | Identifying establishments in images |
US20130086072A1 (en) * | 2011-10-03 | 2013-04-04 | Xerox Corporation | Method and system for extracting and classifying geolocation information utilizing electronic social media |
US20140236882A1 (en) * | 2013-02-20 | 2014-08-21 | The Florida International University Board Of Trustees | Geolocating social media |
US8862589B2 (en) * | 2013-03-15 | 2014-10-14 | Geofeedia, Inc. | System and method for predicting a geographic origin of content and accuracy of geotags related to content obtained from social media and other content providers |
US9104915B2 (en) * | 2008-08-19 | 2015-08-11 | Digimarc Corporation | Methods and systems for content processing |
US9336240B2 (en) * | 2011-07-15 | 2016-05-10 | Apple Inc. | Geo-tagging digital images |
Family Cites Families (91)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5828843A (en) | 1996-03-21 | 1998-10-27 | Mpath Interactive, Inc. | Object-oriented method for matching clients together with servers according to attributes included in join request |
US6178529B1 (en) | 1997-11-03 | 2001-01-23 | Microsoft Corporation | Method and system for resource monitoring of disparate resources in a server cluster |
US6353926B1 (en) | 1998-07-15 | 2002-03-05 | Microsoft Corporation | Software update notification |
US6266781B1 (en) | 1998-07-20 | 2001-07-24 | Academia Sinica | Method and apparatus for providing failure detection and recovery with predetermined replication style for distributed applications in a network |
US6338092B1 (en) | 1998-09-24 | 2002-01-08 | International Business Machines Corporation | Method, system and computer program for replicating data in a distributed computed environment |
US6959300B1 (en) | 1998-12-10 | 2005-10-25 | At&T Corp. | Data compression method and apparatus |
US7099898B1 (en) | 1999-08-12 | 2006-08-29 | International Business Machines Corporation | Data access system |
US6738759B1 (en) | 2000-07-07 | 2004-05-18 | Infoglide Corporation, Inc. | System and method for performing similarity searching using pointer optimization |
US8692695B2 (en) | 2000-10-03 | 2014-04-08 | Realtime Data, Llc | Methods for encoding and decoding data |
US6832373B2 (en) | 2000-11-17 | 2004-12-14 | Bitfone Corporation | System and method for updating and distributing information |
US6691109B2 (en) | 2001-03-22 | 2004-02-10 | Turbo Worx, Inc. | Method and apparatus for high-performance sequence comparison |
GB2374687A (en) | 2001-04-19 | 2002-10-23 | Ibm | Managing configuration changes in a data processing system |
US7082478B2 (en) | 2001-05-02 | 2006-07-25 | Microsoft Corporation | Logical semantic compression |
US6961723B2 (en) | 2001-05-04 | 2005-11-01 | Sun Microsystems, Inc. | System and method for determining relevancy of query responses in a distributed network search mechanism |
US20030028869A1 (en) | 2001-08-02 | 2003-02-06 | Drake Daniel R. | Method and computer program product for integrating non-redistributable software applications in a customer driven installable package |
US6954456B2 (en) | 2001-12-14 | 2005-10-11 | At & T Corp. | Method for content-aware redirection and content renaming |
US6965900B2 (en) | 2001-12-19 | 2005-11-15 | X-Labs Holdings, Llc | Method and apparatus for electronically extracting application specific multidimensional information from documents selected from a set of documents electronically extracted from a library of electronically searchable documents |
US6829606B2 (en) | 2002-02-14 | 2004-12-07 | Infoglide Software Corporation | Similarity search engine for use with relational databases |
US7421478B1 (en) | 2002-03-07 | 2008-09-02 | Cisco Technology, Inc. | Method and apparatus for exchanging heartbeat messages and configuration information between nodes operating in a master-slave configuration |
US8015143B2 (en) | 2002-05-22 | 2011-09-06 | Estes Timothy W | Knowledge discovery agent system and method |
US7570262B2 (en) | 2002-08-08 | 2009-08-04 | Reuters Limited | Method and system for displaying time-series data and correlated events derived from text mining |
US7058846B1 (en) | 2002-10-17 | 2006-06-06 | Veritas Operating Corporation | Cluster failover for storage management services |
US20040205064A1 (en) | 2003-04-11 | 2004-10-14 | Nianjun Zhou | Adaptive search employing entropy based quantitative information measurement |
US7543174B1 (en) | 2003-09-24 | 2009-06-02 | Symantec Operating Corporation | Providing high availability for an application by rapidly provisioning a node and failing over to the node |
US9009153B2 (en) | 2004-03-31 | 2015-04-14 | Google Inc. | Systems and methods for identifying a named entity |
US7818615B2 (en) | 2004-09-16 | 2010-10-19 | Invensys Systems, Inc. | Runtime failure management of redundantly deployed hosts of a supervisory process control data acquisition facility |
US7403945B2 (en) | 2004-11-01 | 2008-07-22 | Sybase, Inc. | Distributed database system providing data and space management methodology |
US20060179026A1 (en) | 2005-02-04 | 2006-08-10 | Bechtel Michael E | Knowledge discovery tool extraction and integration |
US20060294071A1 (en) | 2005-06-28 | 2006-12-28 | Microsoft Corporation | Facet extraction and user feedback for ranking improvement and personalization |
US7630977B2 (en) | 2005-06-29 | 2009-12-08 | Xerox Corporation | Categorization including dependencies between different category systems |
US8386463B2 (en) | 2005-07-14 | 2013-02-26 | International Business Machines Corporation | Method and apparatus for dynamically associating different query execution strategies with selective portions of a database table |
US7681075B2 (en) | 2006-05-02 | 2010-03-16 | Open Invention Network Llc | Method and system for providing high availability to distributed computer applications |
US7447940B2 (en) | 2005-11-15 | 2008-11-04 | Bea Systems, Inc. | System and method for providing singleton services in a cluster |
US8341622B1 (en) | 2005-12-15 | 2012-12-25 | Crimson Corporation | Systems and methods for efficiently using network bandwidth to deploy dependencies of a software package |
US7899871B1 (en) | 2006-01-23 | 2011-03-01 | Clearwell Systems, Inc. | Methods and systems for e-mail topic classification |
US7519613B2 (en) | 2006-02-28 | 2009-04-14 | International Business Machines Corporation | Method and system for generating threads of documents |
US8726267B2 (en) | 2006-03-24 | 2014-05-13 | Red Hat, Inc. | Sharing software certification and process metadata |
US8190742B2 (en) | 2006-04-25 | 2012-05-29 | Hewlett-Packard Development Company, L.P. | Distributed differential store with non-distributed objects and compression-enhancing data-object routing |
US20070282959A1 (en) | 2006-06-02 | 2007-12-06 | Stern Donald S | Message push with pull of information to a communications computing device |
US8615800B2 (en) | 2006-07-10 | 2013-12-24 | Websense, Inc. | System and method for analyzing web content |
US7624118B2 (en) | 2006-07-26 | 2009-11-24 | Microsoft Corporation | Data processing over very large databases |
JP4922692B2 (en) | 2006-07-28 | 2012-04-25 | 富士通株式会社 | Search query creation device |
US8122026B1 (en) | 2006-10-20 | 2012-02-21 | Google Inc. | Finding and disambiguating references to entities on web pages |
US7853611B2 (en) | 2007-02-26 | 2010-12-14 | International Business Machines Corporation | System and method for deriving a hierarchical event based database having action triggers based on inferred probabilities |
US8195655B2 (en) | 2007-06-05 | 2012-06-05 | Microsoft Corporation | Finding related entity results for search queries |
US8352455B2 (en) | 2007-06-29 | 2013-01-08 | Allvoices, Inc. | Processing a content item with regard to an event and a location |
US20090043792A1 (en) | 2007-08-07 | 2009-02-12 | Eric Lawrence Barsness | Partial Compression of a Database Table Based on Historical Information |
US8442923B2 (en) | 2007-08-14 | 2013-05-14 | John Nicholas Gross | Temporal document trainer and method |
GB2453174B (en) | 2007-09-28 | 2011-12-07 | Advanced Risc Mach Ltd | Techniques for generating a trace stream for a data processing apparatus |
KR100898339B1 (en) | 2007-10-05 | 2009-05-20 | 한국전자통신연구원 | Autonomous fault processing system in home network environments and operation method thereof |
US8396838B2 (en) | 2007-10-17 | 2013-03-12 | Commvault Systems, Inc. | Legal compliance, electronic discovery and electronic document handling of online and offline copies of data |
US8375073B1 (en) | 2007-11-12 | 2013-02-12 | Google Inc. | Identification and ranking of news stories of interest |
US8294763B2 (en) | 2007-12-14 | 2012-10-23 | Sri International | Method for building and extracting entity networks from video |
US8326847B2 (en) | 2008-03-22 | 2012-12-04 | International Business Machines Corporation | Graph search system and method for querying loosely integrated data |
WO2009117835A1 (en) | 2008-03-27 | 2009-10-01 | Hotgrinds Canada | Search system and method for serendipitous discoveries with faceted full-text classification |
US8712926B2 (en) | 2008-05-23 | 2014-04-29 | International Business Machines Corporation | Using rule induction to identify emerging trends in unstructured text streams |
US8358308B2 (en) | 2008-06-27 | 2013-01-22 | Microsoft Corporation | Using visual techniques to manipulate data |
US8171547B2 (en) | 2008-12-03 | 2012-05-01 | Trend Micro Incorporated | Method and system for real time classification of events in computer integrity system |
US8874576B2 (en) | 2009-02-27 | 2014-10-28 | Microsoft Corporation | Reporting including filling data gaps and handling uncategorized data |
EP2406734A4 (en) * | 2009-03-11 | 2013-07-24 | Univ Hong Kong Baptist | Automatic and semi-automatic image classification, annotation and tagging through the use of image acquisition parameters and metadata |
US20100235311A1 (en) | 2009-03-13 | 2010-09-16 | Microsoft Corporation | Question and answer search |
US8213725B2 (en) | 2009-03-20 | 2012-07-03 | Eastman Kodak Company | Semantic event detection using cross-domain knowledge |
US8161048B2 (en) | 2009-04-24 | 2012-04-17 | At&T Intellectual Property I, L.P. | Database analysis using clusters |
US8055933B2 (en) | 2009-07-21 | 2011-11-08 | International Business Machines Corporation | Dynamic updating of failover policies for increased application availability |
WO2011046560A1 (en) | 2009-10-15 | 2011-04-21 | Hewlett-Packard Development Company, L.P. | Heterogeneous data source management |
WO2011053755A1 (en) | 2009-10-30 | 2011-05-05 | Evri, Inc. | Improving keyword-based search engine results using enhanced query strategies |
US20110125764A1 (en) | 2009-11-26 | 2011-05-26 | International Business Machines Corporation | Method and system for improved query expansion in faceted search |
JP5576384B2 (en) | 2010-01-29 | 2014-08-20 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Data processing device |
US8595234B2 (en) | 2010-05-17 | 2013-11-26 | Wal-Mart Stores, Inc. | Processing data feeds |
US8429256B2 (en) | 2010-05-28 | 2013-04-23 | Red Hat, Inc. | Systems and methods for generating cached representations of host package inventories in remote package repositories |
US8345998B2 (en) | 2010-08-10 | 2013-01-01 | Xerox Corporation | Compression scheme selection based on image data type and user selections |
US8321443B2 (en) | 2010-09-07 | 2012-11-27 | International Business Machines Corporation | Proxying open database connectivity (ODBC) calls |
US20120102121A1 (en) | 2010-10-25 | 2012-04-26 | Yahoo! Inc. | System and method for providing topic cluster based updates |
US20120143875A1 (en) | 2010-12-01 | 2012-06-07 | Yahoo! Inc. | Method and system for discovering dynamic relations among entities |
US8423522B2 (en) | 2011-01-04 | 2013-04-16 | International Business Machines Corporation | Query-aware compression of join results |
US20120246154A1 (en) | 2011-03-23 | 2012-09-27 | International Business Machines Corporation | Aggregating search results based on associating data instances with knowledge base entities |
KR20120134916A (en) | 2011-06-03 | 2012-12-12 | 삼성전자주식회사 | Storage device and data processing device for storage device |
US20120310934A1 (en) | 2011-06-03 | 2012-12-06 | Thomas Peh | Historic View on Column Tables Using a History Table |
US9104979B2 (en) | 2011-06-16 | 2015-08-11 | Microsoft Technology Licensing, Llc | Entity recognition using probabilities for out-of-collection data |
EP2727247B1 (en) | 2011-06-30 | 2017-04-05 | Openwave Mobility, Inc. | Database compression system and method |
WO2013108073A2 (en) | 2011-12-06 | 2013-07-25 | Perception Partners, Inc. | Text mining analysis and output system |
US9026480B2 (en) | 2011-12-21 | 2015-05-05 | Telenav, Inc. | Navigation system with point of interest classification mechanism and method of operation thereof |
US9037579B2 (en) | 2011-12-27 | 2015-05-19 | Business Objects Software Ltd. | Generating dynamic hierarchical facets from business intelligence artifacts |
US10908792B2 (en) | 2012-04-04 | 2021-02-02 | Recorded Future, Inc. | Interactive event-based information system |
US20130290232A1 (en) | 2012-04-30 | 2013-10-31 | Mikalai Tsytsarau | Identifying news events that cause a shift in sentiment |
US8948789B2 (en) | 2012-05-08 | 2015-02-03 | Qualcomm Incorporated | Inferring a context from crowd-sourced activity data |
WO2013170345A1 (en) | 2012-05-15 | 2013-11-21 | Whyz Technologies Limited | Method and system relating to re-labelling multi-document clusters |
US9703833B2 (en) | 2012-11-30 | 2017-07-11 | Sap Se | Unification of search and analytics |
US9542652B2 (en) | 2013-02-28 | 2017-01-10 | Microsoft Technology Licensing, Llc | Posterior probability pursuit for entity disambiguation |
US8977600B2 (en) | 2013-05-24 | 2015-03-10 | Software AG USA Inc. | System and method for continuous analytics run against a combination of static and real-time data |
US9734221B2 (en) | 2013-09-12 | 2017-08-15 | Sap Se | In memory database warehouse |
-
2014
- 2014-12-02 US US14/558,191 patent/US9361317B2/en active Active
-
2016
- 2016-04-22 US US15/136,696 patent/US20160239504A1/en not_active Abandoned
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7519200B2 (en) * | 2005-05-09 | 2009-04-14 | Like.Com | System and method for enabling the use of captured images through recognition |
US20070140595A1 (en) * | 2005-12-16 | 2007-06-21 | Bret Taylor | Database assisted OCR for street scenes and other images |
US20080030690A1 (en) * | 2006-08-07 | 2008-02-07 | Yi-Ting Hsu | Projection Device with a Blower and a Nozzle disposed on a Bracket |
US20080163003A1 (en) * | 2006-12-29 | 2008-07-03 | Mudit Mehrotra | Method and System for Autonomic Target Testing |
US9104915B2 (en) * | 2008-08-19 | 2015-08-11 | Digimarc Corporation | Methods and systems for content processing |
US20100104187A1 (en) * | 2008-10-24 | 2010-04-29 | Matt Broadbent | Personal navigation device and related method of adding tags to photos according to content of the photos and geographical information of where photos were taken |
US8265400B2 (en) * | 2010-06-18 | 2012-09-11 | Google Inc. | Identifying establishments in images |
US9336240B2 (en) * | 2011-07-15 | 2016-05-10 | Apple Inc. | Geo-tagging digital images |
US20130086072A1 (en) * | 2011-10-03 | 2013-04-04 | Xerox Corporation | Method and system for extracting and classifying geolocation information utilizing electronic social media |
US20140236882A1 (en) * | 2013-02-20 | 2014-08-21 | The Florida International University Board Of Trustees | Geolocating social media |
US8862589B2 (en) * | 2013-03-15 | 2014-10-14 | Geofeedia, Inc. | System and method for predicting a geographic origin of content and accuracy of geotags related to content obtained from social media and other content providers |
Also Published As
Publication number | Publication date |
---|---|
US20150254350A1 (en) | 2015-09-10 |
US9361317B2 (en) | 2016-06-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9361317B2 (en) | Method for entity enrichment of digital content to enable advanced search functionality in content management systems | |
US10817613B2 (en) | Access and management of entity-augmented content | |
US11580181B1 (en) | Query modification based on non-textual resource context | |
US9418128B2 (en) | Linking documents with entities, actions and applications | |
CA2932401A1 (en) | Systems and methods for in-memory database search | |
US9846720B2 (en) | System and method for refining search results | |
US20140006429A1 (en) | Generation of technical description of report from functional description of report | |
US9619571B2 (en) | Method for searching related entities through entity co-occurrence | |
US11354501B2 (en) | Definition retrieval and display | |
US11514124B2 (en) | Personalizing a search query using social media | |
US20140195532A1 (en) | Collecting digital assets to form a searchable repository | |
US20180341701A1 (en) | Data provenance system | |
US10452781B2 (en) | Data provenance system | |
US20220292160A1 (en) | Automated system and method for creating structured data objects for a media-based electronic document | |
US20170109442A1 (en) | Customizing a website string content specific to an industry | |
TWI682286B (en) | System for document searching using results of text analysis and natural language input | |
Kumar | Apache Solr search patterns | |
Chen et al. | An intelligent annotation-based image retrieval system based on RDF descriptions | |
US20160070765A1 (en) | Integrating search with application analysis | |
US20220156228A1 (en) | Data Tagging And Synchronisation System | |
Alam et al. | A data-driven score model to assess online news articles in event-based surveillance system | |
Beals | Stuck in the Middle: Developing Research Workflows for a Multi-Scale Text Analysis | |
JP6707410B2 (en) | Document search device, document search method, and computer program | |
US12026194B1 (en) | Query modification based on non-textual resource context | |
JP2008033386A (en) | Information processing provision system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |