US20050273468A1 - System and method for adaptive multi-cultural searching and matching of personal names - Google Patents

System and method for adaptive multi-cultural searching and matching of personal names Download PDF

Info

Publication number
US20050273468A1
US20050273468A1 US11188979 US18897905A US2005273468A1 US 20050273468 A1 US20050273468 A1 US 20050273468A1 US 11188979 US11188979 US 11188979 US 18897905 A US18897905 A US 18897905A US 2005273468 A1 US2005273468 A1 US 2005273468A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
name
input name
processing
method
based
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11188979
Inventor
John Hermansen
Leonard Shaefer
Heather McCallum-Bayliss
Richard Lutz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
Language Analysis Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30943Information retrieval; Database structures therefor ; File system structures therefor details of database functions independent of the retrieved data type
    • G06F17/30964Querying
    • G06F17/30979Query processing
    • G06F17/30985Query processing by using string matching techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/3061Information retrieval; Database structures therefor ; File system structures therefor of unstructured textual data
    • G06F17/30634Querying
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99936Pattern matching access
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99942Manipulating data structure, e.g. compression, compaction, compilation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99944Object-oriented database structure
    • Y10S707/99945Object-oriented database structure processing

Abstract

An automated name searching system incorporates an automatic name classifier and a multi-path architecture in which different algorithms are applied based on cultural identity of the query name. The name classifier operates with a preemptive list, analysis of morphological elements, length, and linguistic rules. A name regularizer produces a character based computational representation of the name. A pronunciation equivalent representation such as an IPA language representation, and language specific rules to generate name searching keys, are used in a first pass to eliminate database entries which are obviously not matches for the query name. The methods can also be implemented as a callable set of library routines including an intelligent preprocessor and a name evaluator that produces a score comparing a query name and database name, based on a variety of user-adjustable parameters. The user-controlled parameters permit tuning of the search methodologies for specific custom applications.

Description

  • This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/079,233, filed Mar. 25, 1998, the entire disclosure of which is incorporated herein by reference.
  • A portion of this disclosure contains material in which copyright is claimed by the applicant and/or others. The copyright owner has no objection to the copying of this material in the course of making copies of the application file or any patents that may issue on the application, but all other rights whatsoever in the copyrighted material are reserved.
  • FIELD OF THE INVENTION
  • The present invention relates generally to automatic data processing systems that search and retrieve records from a database based on matching of personal names, and to improved systems and methods for intelligently processing name comparisons.
  • BACKGROUND OF THE INVENTION
  • Information about individuals is often stored in a computer. Access to that information is most readily gained by using the name of the individual involved. The nature of names, however, their behavior and permutations, pose significant challenges to information retrieval. Names vary during one's life (e.g., through marriage or professional preparation); they take on different forms, depending on the formality of the situation (WILLIAM CARVER/BILLY CARVER); they may be spelled differently if recorded by someone other than the individual (PRICE/PRIES). To amplify the difficulties even more, naming conventions vary across cultures. It may not be appropriate to assume that the typical American name structure of single given name (first name), single middle name or initial followed by a surname (last name) applies in a database that contains names from all over the world, a situation that is usual in today's world of global technology and communication. Names from other cultures may have compound surnames or may be composed of only one name. Names written in writing systems other than Roman may be transcribed in a variety ways into the Roman alphabet because there is no single way to represent sounds that occur in another language but do not occur in English, causing significant differences in the spelling (KIM/GHIM).
  • Adequate information retrieval that is based on the name must anticipate the range and kinds of variation that can occur in names, both generally and in specific cultures. Other name search or information retrieval systems are generally unable to recognize or address the full range of variation in names. Some systems assume that names are static and search only for an exact match on the name. These systems cannot accommodate even the slightest spelling variations, initials or abbreviations (JOS. Z. BROWN/JOSEPH ZACHARY BROWNE). Other systems may use techniques or keys (such as Soundex or Soundex-like keys) that permit some minor spelling differences between names (DORSHER/DOERSHER) but these techniques generally fail to cope with significant variation (DOERSHER/DOESHER) or problems posed by names from non-Anglo cultures (ABDEL RAHMAN/ABDURRAMAN). If cultural differences are recognized, it is typically through use of equivalency lists or tables. Some of the more common variants can be accommodated in this way, but retrieval is then limited to those items on the list and cannot accommodate new representations or random variation or keying errors (GOMEZ/BOMEZ).
  • For a system to reach a level of adequacy for automatic name searching, it must therefore address a diverse set of issues related to name variation. Although spelling variations can often be addressed through character-matching techniques (e.g., SMITH/SMYTH), false-positive matches can result from traditional string or character comparisons when common morphological endings, such as OVICH, occur at the end of otherwise dissimilar names (e.g., ZELENOVICH/JOVANOVICH). Transcription from foreign writing systems to the Roman writing system poses additional spelling concerns. Different character sets, dialectal variations and sounds that are not represented in Roman alphabetic form at all contribute to the possibility of multiple, and often inconsistent, representations of the same name. A single Chinese character (ideogram) can be transcribed to produce numerous roman forms that have little or no resemblance to one another due to dialectal variations. For example, the character CHANG, JANG and ZHANG are different roman representations of the exact same Chinese name, as are the names WU, MHO and ENG. Similarly, a single Arabic name can result in transcriptions as diverse as KHADHAFI, CODOFFI, QATHAFI.
  • Character-based systems may also be confronted with significant retrieval problems caused by names with the same pronunciation but with divergent spellings. WOOSTER, WORCHESTER, and WUSTER may all share at least one identical pronunciation and yet show very different spellings. When name data are shared orally, the speaker's pronunciation, the listener's hearing (or mishearing) of the name and the speaker's expectations about the spelling of the name will impact the final written representation of a name. For example, a telephone reservationist may record a caller's name with a variety of phonetically correct spellings, which may not correspond (and may therefore not be matched to) an existing database record for that caller.
  • Another common cause of name variation, which creates retrieval difficulty for name search systems, is the inclusion or exclusion of name data. Depending on the data source, names may be formal such as THOMAS EDWARD WINTHROP III, or informal such as TOM WINTHROP. An ideal name search system would be capable of correlating these two names, even though only a portion of the full name is available. To predict the relationship among variant formats of names, the system must also be able to recognize what rules govern which elements can be deleted or included or changed in different cultures. MARIA DEL CARMEN BUSTOS SAENZ will become MARIA DEL CARMEN BUSTOS DE LOPEZ, if she marries JUAN ANTONIO LOPEZ GARCIA. Predicting the relationship between these names is fundamental to retrieval success.
  • In many name search applications, it is important to identify variant forms of a name that are considered legitimate and to link and preserve the variations; in others, it may be appropriate to establish one form of a name and to treat all other forms as errors. Even if the data base is cleaned:by linking variant forms and eliminating identifiable errors, users may search for names under yet more variations.
  • U.S. Pat. No. 5,040,218 to Vitale et al. discloses a voice synthesis system which attempts to identify the origin of a name to enhance pronunciation. The system first searches a dictionary for a name, and if the name is not found, uses grapheme and n-gram analysis to identify the name's likely origin. Similarly, U.S. Pat. No. 5,062,143 to Schmitt shows a system that identifies name origin using n-gram analysis.
  • U.S. Pat. No. 5,724,481 to Garberg et al. shows a method of matching proper names in a database using a phonemic representation.
  • U.S. Pat. No. 5,758,314 to McKenna shows an international database processing system. However, this system uses Soundex algorithms to process Unicode input for all cases, rather than providing a name searching system with culture-specific algorithms.
  • Design Patent D359,480 shows an IPA-based computer keyboard, but does not disclose any use of IPA for identifying data records.
  • The article “Identifying Source Languages: the Case of Proper Names” by Valencia and Yvon (1997) discloses statistical models for name searching based on n-gram comparisons. The article also discloses determination of the source language and the use of different statistical models for comparisons, based on the source language.
  • John Hermansen, a named inventor, authored a doctoral dissertation, “Automatic Name Searching in Large Data Bases of International Names” (1985) which explores the concept of cultural differences in names. The document suggests searching using different culturally specific algorithms, but discloses only a simple n-gram based algorithm.
  • The assignee has developed a software program known as PC-NAS. An early version of this program was incorporated into a government computer system more than one year before the priority date of this application. This early version performed name searching using a combination of n-gram distribution and positional properties, and included a limited name regularization algorithm as part of an Arabic processing algorithm. Its architecture included sets of algorithms applicable to different cultures, but no automatic classification of the cultural origin of a name.
  • U.S. Pat. No. 5,485,373 to Davis et al. discloses a text searching system which relies on a Unicode representation (not a phonetic alphabet). The Davis system may vary algorithms based on the language being searched, but has no name classifier. This system is not designed to search for proper names; comparisons are performed based on a Unicode representation, which is not a phonetic alphabet.
  • Other patents relating generally to computerized language analysis and processing include: U.S. Pat. No. 5,323,316 to Kadashevich et al.; U.S. Pat. No. 5,337,232 to Sakai et al.; U.S. Pat. No. 5,369,726 to Kroeker et al.; U.S. Pat. No. 5,369,727 to Nomura et al.; U.S. Pat. No. 5,371,676 to Heemels et al.; U.S. Pat. Nos. 5,375,176 and 5,425,110 to Spitz; U.S. Pat. No. 5,377,280 to Nakayama; U.S. Pat. No. 5,432,948 to Davis et al.; U.S. Pat. No. 5,434,777 to Luciw; U.S. Pat. No. 5,440,663 to Moese et al.; U.S. Pat. No. 5,457,770 to Miyazawa; U.S. Pat. No. 5,490,061 to Tolin et al.; U.S. Pat. No. 5,515,475 to Gupta et al.; U.S. Pat. No. 5,526,463 to Gillick et al.; and U.S. Pat. No. 5,548,507 to Martino et al.
  • None of these earlier systems provide a satisfactory system and method for multicultural name searching. Thus, the inventors believe there is a need for an improved system and method for searching name-based records and for determining the degree of similarity between two name representations.
  • SUMMARY OF THE INVENTION
  • Therefore, it is a general object of the present invention to provide a name searching system architecture with multiple processing options, which automatically selects and uses an appropriate cultural-specific set of algorithms to search for database names and evaluate their proximity to a query name.
  • Another broad object of the invention is to provide a system and method implementing multi-algorithm name searching strategies, where search processing differs based on one or more of: culture, ethnicity, distribution, and language.
  • Another more specific object of the invention is to provide an improved system and method for conducting searches using a combination of n-gram distribution and positional properties to identify matches.
  • A further object of the invention is to provide an improved cultural name classifier which leads to application of an appropriate set of name-regularizing linguistic rules that generate a standardized name based on stored cultural intelligence.
  • Yet another object of the invention is to provide an improved name classifier, incorporating a multi-step process, including preemptive lists, linguistic rules, n-gram analysis, and additional algorithms.
  • A further object of the invention is to provide an improved name searching system, incorporating segment-level pre-processing. Segmentation rules and syllabic stress rules contribute to a determination of where “white space” should appear in the name. Algorithms determine which graphemes are mapped to which phonemes (based on phonological, historical, and morphological principles).
  • Another significant object of the invention is to provide a name searching system and method incorporating an innovative key-searching system based on the International Phonetic Alphabet (IPA). This technique converts the query name to a plurality of IPA representations, which are then used to select matching keys in a first pass through the database.
  • A further object of the invention is to provide a name searching system and method that selectively uses sets of generic and language-specific spelling rules to infer possible phonological manifestations for personal names. A unique aspect of the comparison algorithm derives a scored match based on atomic phonological features.
  • Additional objects and advantages of the invention will be apparent upon review of the specification, including its drawings and appendices.
  • The present invention provides an improved automatic data processing system for searching names and an improved process for effectively searching and retrieving personal names in a database. It also provides a mechanism for a user to determine the distance between two names, i.e., how closely two personal names match.
  • In one aspect of the invention, “fuzzy logic” name searching and matching technology is provided to locate a target database record despite a lack of absolute identity between a query name and a record name.
  • In one preferred embodiment, a complete automated name searching system is provided, incorporating various advantageous features of the present invention. The automated search system incorporates an automatic name classifier, a multi-path architecture in which different algorithms are applied based on cultural identity of the name, name variant generation, query regularization and expansion, compensation for transpositions, affixes, and inversions, and sorting and filtering of output. The name classifier incorporates a preemptive list, analysis of morphological elements, length, and linguistic rules. The name regularizer produces a computer recognized form (character based computational representation) rather than a human recognizable form of the name. The software design uses a pronunciation equivalent (e.g. IPA) representation and language specific rules to generate name searching keys, which are used in a first pass to eliminate database entries which are obviously not matches for the name of interest.
  • In another preferred embodiment, the inventive search methodologies are implemented as Application Program Interfaces (APIs) that can be integrated into an existing program application or can be used to provide the foundation for a new program application that requires name matching capabilities. In API form, the features of the present invention may be selectively used in various combinations depending on the requirements of the particular application. A callable set of library routines include an intelligent preprocessor and a name evaluator that produces a score comparing a query name and database name, based on a variety of user-adjustable parameters. The user-controlled parameters permit tuning of the search methodologies for specific custom applications, so as to achieve desired levels of precision and recall for name searching in widely varying operational settings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of the structure of an improved name searching and comparison system according to the present invention;
  • FIG. 2 is a block diagram of the structure of a set of name searching tools which may be provided as one or more Application Programming Interfaces (APIs) for use in developing custom applications;
  • FIG. 3 is a block diagram showing the structure of a name ethnicity classifier according to the present invention;
  • FIG. 4 is a schematic diagram showing the structure and operation of a preferred embodiment of a linguistically informed decision processor used in the classifier of FIG. 3;
  • FIG. 5 shows a sample structure for data tables used in the linguistically informed decision processor of FIG. 4;
  • FIG. 6 is a flowchart showing a preferred embodiment of an Hispanic name searching process used in the invention;
  • FIG. 7 is a flowchart showing preferred operation of an Hispanic name preprocessor in the process of FIG. 6; and
  • FIG. 8 is a flowchart showing preferred operation of an Hispanic search engine in the process of FIG. 6.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • FIG. 1 shows a multi-algorithmic name search system 100 according to a first preferred embodiment of the present invention, in block schematic form. In this embodiment, system 100 sequentially performs three basic processes. First, system 100 selects a search strategy based on the cultural origin, distribution, language or ethnicity of the name in question and pre-processes the name to break it into its component parts for processing. Second, a subset of the available database records is selected, based on a culture-relevant key-indexing strategy. The objective of this subsetting process is to select a set of keys that are likely matches for the name in question. Finally, the records selected in the second process are subjected to a similarity measurement, using a complex algorithm tailored according to the selected search strategy, to evaluate and rank-order potential matches. Thus, system 100 adopts a search strategy that is specific to the ethnicity or cultural origin of the name to be matched and implements that strategy by performing a two-pass search with algorithms particularly adapted for searching those names.
  • Referring now to FIG. 1, system 100 comprises name classifier module 102, variant generation module 104, name reference library 106, name retrieval technology processing module 108, retrieval module 110, and precision filter and sorting module 112. System 100 has an input query 101 and an output 114. Processing of a query begins with evaluation of the searched name by name classifier module 102. Name classifier module 102 evaluates spelling, word segmentation, titles, prefixes and suffixes, and other identifiable features of the name to determine whether it falls into one of a predetermined set of identified cultural origins, including, for example, Chinese, Arabic, Hispanic, or Russian. Anglo names and names which do not fall into one of the predetermined set of special-case cultures are classified as “other” and processed according to a generic cultural algorithm. Appropriate pre-processing is also performed to segment the name appropriately (standardize the handling of spacing between name segments and the order of the segments) and identify apparent surnames, given names, honorifics, etc., that are part of the input name. The operation of the name classifier in this regard is unique and inventive. To determine the type of name, name classifier module 102 may use one or more of the following, depending on the observed characteristics of the name in question: a list of names which occur with high frequency in various cultures (used to preemptively type common names without extensive algorithmic processing), culture-specific linguistic rules in the form of a Titles, Affixes, and Qualifiers (TAQ) lookup table, n-gram based name typing, and name length. N-gram name typing according to the present invention may be performed as a digraph, trigraph or other n-gram analysis where both positional and distributional properties of the n-grams (e.g., digraphs and trigraphs) are used in the algorithm for making the type determination. Name classifier module 102 preferably operates according to the software design description in Appendix A, which forms a part of this specification.
  • FIG. 3 shows the software modules incorporated in name classifier module 102 in more detail. Name classifier module 102 incorporates a name classifier control module 302, a linguistically informed decision (LID) processor 304, a digraph distribution processor 306, and a final decision processor 308. Digraph distribution processor 306 incorporates digraph information processor 312 and digraph intermediate decision processor 314.
  • LID processor 304 incorporates linguistic information aggregator 308 and LID intermediate decision processor 310. LID aggregator 308 includes high frequency name processor 316, morphological processor 318, title/affix/qualifier (TAQ) processor 320, and ngram processor 322.
  • LID processor 304 accumulates and weighs factors from multiple knowledge sources to determine whether there is sufficient evidence to identify the input name as belonging to a particular ethnicity, e.g. Hispanic, Arabic, etc. Linguistic information aggregator 308 performs linguistic analysis, gathering information and scoring for the input name. In the preferred embodiment, linguistic information aggregator 308 generates scores from four data sources. High frequency name processor 316 accesses a high frequency name data store of names that occur frequently in particular cultures. A match with one of these names causes aggregator 308 to retrieve and record the culture associated with the name and a confidence score associated with that name. TAQ processor 320 breaks the name into particles and makes use of the information contained in those particles to match a list of titles, affixes, and qualifiers commonly used in names of various cultures, to help determine cultural affinity. The input name is segmented based on spaces in the name, and for each segment present in the input name, TAQ processor 320 determines whether that segment is a particle present in a TAQ data store. If so, TAQ processor 320 retrieves and records the culture, name field, and confidence score associated with that TAQ particle.
  • Morphological processor 318 processes morphological elements such as “−ovich” which suggest a particular cultural affinity. Morphological processor 318 determines whether morphemes in a morpheme data store are present in the input name by searching for matching substrings of the name segments in the input name. For each morpheme found in the input name, morphological processor 318 records the morpheme found, the culture, name field, and confidence level associated with that morpheme.
  • N-gram processor 322 searches the input name for strings of letters that occur with statistical significance in names with a given cultural affinity. For each n-gram present in an associated n-gram data store, n-gram processor 322 determines whether that n-gram is present in the input name. When a match is found, the processor records the n-gram found, the culture, name field, and score associated with that n-gram.
  • To avoid conflict between treatment of name segments and particles by the various processing modules operating on the input name, an order of precedence is established for processing. The order of precedence is preferably TAQ particle, morpheme, and then n-gram. That is, if a string of letters is identified as a TAQ particle, that string or any substring cannot also be identified as a morpheme or n-gram for that culture. If a string is identified as a morpheme, that string and its substrings cannot be considered as part of an n-gram for that culture. Locating the name among the high frequency names for a culture does not preclude morpheme or n-grams processing of the high frequency name, but if the confidence level in the high frequency match is high, further processing may not be necessary.
  • FIG. 4 is a schematic diagram showing the structure and operation of linguistically informed decision processor 304 in more detail. Linguistic information aggregator 308 collects necessary information from the input name 402 and name reference library 106, which includes the tables and other data used by linguistic information aggregator 308 (including high frequency name processor 316, morphological processor 318, title/affix/qualifier (TAQ) processor 320, and ngram processor 322, all shown in FIG. 3). A sample structure for these tables is shown in FIG. 5.
  • As shown in FIG. 4, processed information from linguistic information aggregator 308 passes to LID intermediate decision processor 310, where it is processed and the results passed to digraph distribution processor 306 or to final decision processor 308 (shown in FIG. 3).
  • LID intermediate decision processor 310 makes a preliminary decision about the cultural affinity of the name, based on the scoring information gathered by linguistic information aggregator 308. Processor 310 determines whether enough linguistic information has been gathered by LIA 308 to confidently determine that the input name belongs to one of the cultures identified by the system. Processor 310 accepts as input one aggregate LID score for each culture, as well as an aggregate LID score for “other.” For each score, processor 310 compares the score to a LID threshold for the appropriate culture. If the LID score for a culture exceeds the threshold for that culture, processor 310 returns a value of “true” for the indicated culture. A “true” value for a culture indicates that enough evidence has been gathered to confidently identify the name as belonging to that culture. A “false” value for a culture indicates that not enough evidence has been accumulated to suggest that the name belongs to that culture. Alternatively, processor 310 may return a value for each culture equal to the LID score minus the LID threshold for that culture; in this case, negative values correspond to “false” and positive values correspond to a “true” indication.
  • Names which are strongly associated with one culture based on the output of LID intermediate decision processor 310 will not be processed further to identify their cultural origin, i.e. digraph and other analysis will be skipped.
  • Assuming the name has not been definitely identified, the surname portion is processed by digraph distribution processor 306. Based on a statistical model derived from digraph distribution statistics for names within various cultures, processor 306 computes a likelihood that the input name has a particular cultural origin. The information gathered from LID and digraph processing is combined, along with any other available information on the person (such as country of birth), in final decision processor 308. The available factors are weighted according to their confidence level to maximize the likelihood of an accurate ethnic origin evaluation. The result is an output indicating the likely classification of the name.
  • Following name typing, the system executes name variant generation module 104, which pre-processes the names according to culture-specific rules to generate query regularizations, based on algorithms adapted specifically for the cultural origin of the name in question, as determined by the name classifier. Variant generation module 104 also generates query expansions, i.e., identifies expected variants of the name to enhance matching capability.
  • As noted above, preferably, specialized processing is provided for each of a variety of ethnic name origins. Appendices B and C, which form a part of this specification, are software design descriptions for preprocessing and search algorithms for Arabic and Hispanic type names, respectively. As an example of such processing, the Hispanic processing algorithm referenced in Appendix C will now be discussed in some detail. FIG. 6 is a flowchart showing a preferred embodiment of Hispanic name processing used in the present invention. The process begins in name classification in block 602 when the input name is identified as an Hispanic name. The name is then fed to Hispanic name preprocessor in block 604, and to the Hispanic search engine in block 606, which searches database 608. Then, an Hispanic sorter and filter are applied in block 610. The process produces sorted Hispanic search results as an output in block 612.
  • FIG. 7 is an expanded flowchart showing an operational process of the Hispanic name preprocessor, referenced in Block 604 of FIG. 6. The Hispanic name processor prepares a name which has been identified as Hispanic for processing by the Hispanic search engine by identifying name segments and determining their disposition, manipulating the name segments to generate additional query formats, determining name length and record gender, specifying the frequency character of each name segment, and generating search keys.
  • The process begins with a name length determiner operation on Block 702, which determines the length of the surname. Next, the name is processed by a Hispanic surname segmenter in block 704. This operation divides surnames exceeding a predetermined length (e.g. nine characters) into component segments to compensate for the fact that fixed size data fields often do not accommodate an entire Hispanic surname, leading data entry operators to conjoin name segments in a single field. Then, additional query records are generated for the separated segments and alias records are added for the separated surname segments. This process accesses a high frequency surname type data store to identify surname portions that should be separated. For example, this operation would separate “RAMIREZDELAPAZ” in the surname field into RAMIREZ DELA PAZ and “PEREZDELOPEZ” into PEREZ DE LOPEZ by finding the known surname components DE and DELA.
  • An Hispanic TAQ processor operates in Block 706 to scan the given name and surname for known titles, affixes, and qualifiers which do not have useful search value. TAQ elements such as DEL, DELA, DE, and SAN are then flagged to be either deleted, disregarded during matching operations, or removed. Delete means that the segment is disregarded for the remainder of the name search process and contributes marginal information to the filter process, but is not actually removed from the record. Disregard means the segment is disregarded in the remainder of the name search process but contributes to evaluation in the filter process. Remove means that a segment conjoined to the name stem is removed from the stem, and then flagged to be either deleted or disregarded as appropriate.
  • The Hispanic segment positioner in Block 708 operates to move any high frequency surname found in the given name field into the surname field. The name is then formatted by an Hispanic name formatter in Block 710 to generate additional name formats in case the record has more than two surname stems. Next, the name is processed by a segment position identifier in Block 712 to identify the relative position of each of the surname and given name stems. Hispanic names generally contain more than one stem in the given name and surname. In a given name, the leftmost name stem generally indicates gender; in a surname, the leftmost stem is the family name and the other stems are differentiators. Therefore, it is important to identify names that are out of position so that this may be corrected and their relevance appropriately evaluated during the search.
  • Next, the likely gender of the name is identified by a Hispanic gender identifier in Block 714. The gender identifier attempts to predict gender based on the gender marker of the leftmost given name segment, but may also rely on (or override the apparent gender) based on additional information such as a gender indicated as associated with the search name.
  • The name is processed by a frequency path director in Block 716 which directs a record for high frequency processing or low frequency processing depending on the presence or absence of high frequency surnames in the input name string.
  • In FIG. 8, the flow of operation of the Hispanic search engine 606 is shown in more detail. As described above, the frequency path director operates in block 716 and then determines in block 802 whether the surname contains all high frequency segments. If so, control passes to the high frequency processor in block 804. If not, control passes to the low frequency processor in block 806.
  • The high frequency processor operation begins in Block 808 with generation of keys for the given names. Then, in block 810, records are retrieved according to a high frequency surname matrix and the given name keys. Control then passes to filter and sorter 610 (shown in FIG. 5).
  • Low frequency processor operation begins in Block 812 where each low frequency surname segment is examined to identify related high frequency and low frequency surnames, in blocks 814 and 816. This processing loop continues until names related to the segments have been identified. A “relationship” to a high frequency surname is determined by digraph comparison. If the number of identical digraphs exceeds a specified threshold, the surname is deemed to be a mere spelling variant of the similar high frequency surname. If the surnames all relate to known high frequency names, control passes through block 818 to block 808 in the high frequency processor. If the surnames have mixed high and low frequency relationships, control passes through block 820 to block 808. If all surnames have low frequency, control passes through block 822 to block 824. In block 824, a year of birth range is determined for the name. Records are then retrieved based on name content (same or different), position of the name segments, the year of birth range, the record gender, and possibly additional restrictions based on the given name.
  • Referring again to FIG. 1, the typing and processing of names within the system is preferably informed by cultural information encoded in a name reference library 106. The factors included in name reference library 106 are identified in the database structures shown in Appendix D, which forms a part of this specification. Appendix E, which also forms a part of this specification, provides additional flowcharts and software descriptions for a preferred embodiment of name classifier module 102 and the Hispanic name search algorithms.
  • Significantly, as part of name regularization for the purpose of generating an index key for a first pass through the database, the present invention applies the International Phonetic Alphabet to generate index keys, rather than using a Soundex or another conventional key. The IPA algorithm, according to the present invention, generates keys by segmenting (e.g. syllabifying) the name in question and converting it to IPA representation. In this manner, the system generates a key or set of keys which identify a set of pronounced equivalents, rather than generating a key by letter similarity, as in the traditional Soundex method. Significantly, the system generates multiple keys in IPA representation for most names, since most names have multiple possible pronunciations. The system determines multiple possible pronunciations of the name, where applicable, and associates an IPA key with each possible pronunciation. Then, records matching any of the IPA keys for a name are then selected for further consideration and comparison.
  • To program the IPA conversion, a rule set is generated that relates spelling to sounds. A different rule set is preferably generated for each ethnic origin of name, since pronunciations of apparently similar names may vary significantly based on origin. To generate a rule set, preferably a database of single name elements is obtained, such as a census list. The names in the list may are then manually tagged for their ethnic origin A variety of sources may then be used to determine possible pronunciations. These sources include native speaker knowledge and textual information. The rules are written broadly so that the most plausible pronunciations will be captured with some certainty. Rules for languages not written in roman characters will necessarily take into account transcription variations. The rules are written in a predetermined notation which can be processed effectively by the system. A typical rule format is:
    sc/anything______le→[sk?]
    which is interpreted to mean that the letters sc preceded by anything and followed by the letters le can be pronounced as [s] or [sk], e.g. Muscle and Mosclin. The rules should also be written to account for predictable articulatory processes such as movement of the soft palate, which might lead to a slightly different pronunciation.
  • As an example of the advantages of matching on IPA, consider a query on.the name Lee. Converted to the IPA string [li], exact matches with numerous spelling variants are automatic, including Leigh and Li. Typical prior-art character based matches will fail to retrieve Leigh or Li, since the percentage of character overlap is minimal. Conversely, a standard index matching system such as Soundex will categorize Lee and Li identically, but will still miss Leigh, given the presenve of a salient letter (g), and will retrieve a large number of names of low relevance, including Lu, Liao, Low, Louie, Lahoya, and Lehew. The IPA analysis process is further described in Appendix F, which forms a part of this specification.
  • While the IPA key generation, according to the present invention, provides a significant functional advantage in many cases, it should be noted that it may not be desirable to apply IPA processing to all classes of names. For example, the inventors have found that names of Arabic and Chinese origin are better processed using custom regularization algorithms rather than by the generalized EPA approach, since names acknowledged as similar in these cultures are often quite distinct phonologically.
  • Following regularization and expansion, name retrieval technology processing module 108 is applied. These algorithms facilitate more complete retrieval, by compensating for transpositions; deleting affixes, where appropriate; and compensating for inverted surnames, deleted surnames and nicknames. Each of these algorithms uses stored information defining naming conventions for a particular culture in the manner described herein.
  • Next, retrieval module 110 is applied to the results of the preprocessing performed by name classifier 102, variant generation module 104, and retrieval technology module 108. Retrieval module 110 retrieves records matching the keys (IPA or other culture-specific keys) generated by the operation of the first three modules. These records are then provided to precision filter and sorting module 112, which compares each record to the query name to determine a similarity/equivalence measurement defining the “distance” between the query name and the record name. Precision filter and sorting module 112 may perform segment position comparisons, character comparisons, phonological similarity comparisons, structural similarity comparisons, phono-feature-distance comparisons, and/or n-gram comparisons.
  • The output 114 of precision filter and sorting module 112 is then provided to the user. The output preferably consists of a rank-ordered list of records in descending order of likelihood of matching the query name.
  • One preferred embodiment implementing many desirable features of the system shown in FIG. I is a standalone database search and retrieval program. In addition to including the features described above (and in further detail in the Appendices), this embodiment of the invention may preferably be implemented according to the disclosure in Appendices G, H, 1, and J, which form a part of this specification and are: a narrative description, technical plan, acceptance test, and source code listing respectively for a system demonstrating numerous features of the present invention.
  • Another desirable implementation of the invention is as a set of name searching tools which may be provided as one or more Application Programming Interfaces (APIs) for use in developing custom database management and searching applications. A flowchart for one embodiment of an API embodiment is shown in FIG. 2. Further detail of the implementation of this embodiment is provided in Appendices K (software design description), L (default parameters), M (developer's documentation) and N (source code listing), each of which forms a part of this specification. Operation of elements in the embodiment of FIG. 2 are generally similar to like operational features described with reference to FIG. 1.
  • As shown in FIG. 2, a preferred embodiment of an API-based name searching system 200 comprises name extraction tools 202 and name comparison tools 212. Name extraction tools 202 comprise Intelligent Search Data Generator (ISDG) 204 and associated intelligent search database 203, intelligent pre-processor 205, name classifier 206, name regularizer 208, and phonetic key generator 210. Name comparison tools 212 comprise name evaluator 214 and results manager 216, with scored name data 215 as an intermediate step. The system receives as an input name data 201, and provides ordered similar data 218 as an output from name comparison tools 212.
  • The output of ISDG 204 is search data 220, which is provided to data update and data access applications 222 and from there to the name comparison tools 212 as query and candidate search data 226. A names database with intelligent search data 224 is provided in association with data update and data access applications 222.
  • The embodiment of FIG. 2, like that described previously with reference to FIG. 1, implements a multifaceted approach to multicultural name searching. For example, in the Hispanic culture, an individual typically has a compound family name (e.g.,—Arantxa SANCHEZ VICARIO), the first of which (SANCHEZ) provides the more valuable identifying information. In contrast, although Portuguese names also typically have compound family names and look very similar to Hispanic names (e.g., Maria FERREIRA DOS SANTOS), the second family name (DOS SANTOS) provides the more valuable identifying information. If a single solution were proposed where, for example, the Last Name is considered the most important name, as in American names, Hispanic names would not be adequately accommodated.
  • The disclosed embodiment automatically applies whatever resources will adequately address the problem at hand, whether the variation is cross-cultural or arises from spelling variation, from transcription from other writing systems, from sound similarity, or from missing or additional information.
  • In operation, the user system supplies both a query name and a database name to the system. The system employs linguistic intelligence to separate the name into its integral components in intelligent pre-processor 205. Further linguistic intelligence is employed to compare the two names in name evaluator 214. The result of the comparison is a scored database name, scored name data 215. The scored name is passed to results manager 216, which collects and orders the names that are scored against a single query name. The final output is an ordered set of scored database names, ordered similar data 218.
  • The cornerstone of this embodiment is a programming library (functions and classes) that enables a developer to add fuzzy logic personal name searching to an application. For example, the developer may perform operations such.as “Give me the 10 closest names to ‘James Slesinger’ from my database”, or “Give me all the names from my database that match ‘John Wong’ with a degree of confidence of 0.9” or “Tell me the degree of similarity between ‘Paul Vanesann’ and ‘P Vanlesann’”. The system incorporates and uses a variety of linguistic techniques to achieve these results, in the manner described previously with respect to a standalone name searching system.
  • Users can enhance the functionality of the APIs by incorporating their business rules and data into the name comparison process. This embodiment provides fine granularity when comparing names. That is, names are scored and ranked more precisely, which is important when dealing with large volumes of data. The technology incorporates numerous parameters (to customize the user's search comparison).
  • From the user/developer perspective, the name search system is quite simple to utilize. A typical name search requires the use ofjust four classes (SNQueryParms, SNQueryNameData, SNEvalNameData, and SNResultsList). In addition, it is important to note that the extra code required to integrate this name search technology is minimal.
  • The API name search interface is simplified by the fact that it makes no assumptions about the data and how it is stored. The user provides the API with the query name as well as the names from the database as input 201. The library routine then presents names which are likely matches, and qualifies their degree of similarity. From the perspective of the developer, the tool is straightforward and easy to integrate.
  • Searches via the API embodiment are configurable by adjusting any of 43 parameters (see Appendix L for defaults). Each parameter controls some aspect of how two names are evaluated when determining if they are similar. Some of the more basic parameters set thresholds for determining how close two names must be to be considered a match. Other parameters control more complex processing, such as how to handle multi-segment names. In general, only a small set of parameters need to be adjusted by the developer, because reasonable defaults exist for each one.
  • The API embodiment also provides pre-defined packages of parameters, each tailored to a particular culture or ethnicity. For example, Hispanic names have certain characteristics such as compound surnames (e.g., TORRES DE LA CRUZ) that can cause problems when searching for Hispanic names using conventional, Anglo-centric methods. The Hispanic parameters package contains settings that address Hispanic-specific name issues. New cultural/ethnic parameter packages can be established and existing packages can be modified as desired.
  • The preferred embodiment uses a C++ object framework, so that users/developers can extend the existing product functionality to incorporate additional data elements in the scoring algorithm or create evaluation methods specific to their business or application needs. For example, a database might contain a Social Security number, in addition to given name and surname. Although the name search technology only compares name data, a developer can take advantage of class inheritance (a feature of C++), and easily subclass the program's SNEvalNameData and SNQueryNameData objects to include Social Security numbers or any other desired data element(s). These data elements can then be used in the methods that score evaluation names and determine which evaluation names are matches. In other words, record matching.can be performed using name data in conjunction with other available data element information.
  • Users/Developers can also provide custom methods for determining if an evaluation name matches a query name or not. The default method compares the average of the given name score and surname score to a user/developer supplied threshold value. However, a more complex method may be desired. For example, the business rules of an application might dictate that a name cannot be considered a match unless either the surname or given name is an exact match. By overriding the default method, the developer can easily implement this logic in just a few lines of code.
  • The functions provided in the API embodiment will now be described in more detail. The available functions include comparing a query name with one or more candidate names to produce an ordered list of candidate names with the highest probability of representing the same named person. This functionality is referenced as the name comparison tools 212. The basic name checking tool employs multiple evaluation techniques to evaluate and score two names. The name checking tool incorporates information regarding variations in spelling, discrepancy in the number of name segments (,amount of information included), exclusion of expected information, and positional information to establish a name score, which indicates the probability that the two names represent the same individual. The tool is controlled by a set of configurable parameters. The tool also manages and produces an ordered or unordered list of candidate names with the highest probability of representing the same named person, based on the developer defined criteria for establishing a set of results. Various culture specific callable modules are available as extensions to the name check tool, including a name classifier that culturally classifies name data, a name regularizer that levels variations in name data to a single representation, and a phonetic name key that represents name data based on phonetic similarity. Again, each of these tools and modules incorporates the methods and technology described above with reference to FIGS. 1 and 3-8.
  • The program also generates and stores intelligent search data for use in extracting relevant subsets of data from large data bases for further evaluation. These mechanisms will facilitate more efficient name searching while ensuring complete and accurate results. This functionality is referenced as the Name Extraction Tool(s). The disclosed embodiment provides users/developers with the capability to compare two names to determine the probability that they both represent the same named individual or to compare a single query name with a set of candidate names to determine which candidate names are most likely to represent the same named individual.
  • When a set of candidate names is evaluated, the APIs enable the user/developer to define the criteria for producing their own ordered list of results. The criteria for defining an ordered list of results include the following: the top X candidate names (i.e., the X candidate names scoring the highest probability that they represent the same named individual; e.g., the top ten candidate names); all candidate names whose name score exceeds a pre-defined name threshold (e.g., if the threshold=0, all candidate names will be returned in an ordered list); or the top X candidate names whose name score exceeds a pre-defined name threshold.
  • Name comparison tools 212 include a name evaluator 214, which employs multiple evaluation techniques to evaluate and score two names. Name evaluator 214 incorporates information regarding variations in spelling, inclusion of additional information, exclusion of expected information, and positional information in order to establish a name score, which indicates the probability that the two names represent the same individual. Name evaluator 214 is controlled by a set of configurable parameters. Results manager 216 uses the intermediate scoring information provided by name evaluator 214 to manage and produce an ordered list of candidate names with the highest probability of representing the same named person, based on the developer-defined criteria for establishing the results.
  • Name extraction tools 202 include an Intelligent Search Data Generator (ISDG) 204 which generates one or more search data values that facilitate extraction of relevant information from a data base for further comparative analysis. This tool is an important component of any search system that must search large volumes of data to locate similar name data, to the extent that it is not feasible to retrieve and evaluate every name record in a data base to determine its relevance to a query name. ISDG 204 provides a motivated method for retrieving all relevant information from a data base while reducing the amount of non-relevant information retrieved. This tool can provide significant performance improvements while also ensuring an accurate and complete name search. Various culture-specific tools are available as extensions to ISDG 204 to address specific issues such as the cultural classification of name data, performed by name classifier 206; leveling of variations in name data to a single representation, performed by name regularizer 208; and the representation of name data based on phonetic similarity, performed by phonetic key generator 210.
  • Thus, there has been disclosed an improved system and method, in multiple embodiments, for searching personal name databases, with maximum simplicity and ease of integration, maximum flexibility, and maximum extensibility.

Claims (39)

  1. 1-18. (canceled)
  2. 19. A method of providing an indication of whether an input name belongs to a particular culture, the method comprising:
    accessing an input name;
    accessing a classifying algorithm that is based on linguistic analysis of names in a particular culture;
    accessing another classifying algorithm, the other classifying algorithm being based on linguistic analysis of names in another culture;
    processing the input name using the classifying algorithm;
    processing the input name using the other classifying algorithm;
    providing an indication of whether the input name belongs to the particular culture based on the processing of the input name using the classifying algorithm; and
    providing an indication of whether the input name belongs to the other culture based on the processing of the input name using the other classifying algorithm.
  3. 20. The method of claim 19 further comprising:
    accessing a second classifying algorithm that is based on linguistic analysis of names in the particular culture; and
    processing the input name using the second classifying algorithm.
  4. 21. The method of claim 20 wherein providing the indication is further based on the processing of the input name using the second classifying algorithm.
  5. 22. The method of claim 20 wherein the classifying algorithm and the second classifying algorithm each relate to independent linguistic features.
  6. 23. The method of claim 20 wherein:
    processing the input name using the classifying algorithm comprises producing a result,
    processing the input name using the second classifying algorithm comprises producing a second result, and
    the method further comprises accumulating and weighing the result and the second result.
  7. 24. The method of claim 23 wherein accumulating and weighing the result and the second result comprises applying an order of precedence to the result and the second result.
  8. 25. The method of claim 19 wherein processing the input name using the classifying algorithm comprises producing a result.
  9. 26. The method of claim 25 wherein processing the input name using the classifying algorithm further comprises generating a confidence level for the result.
  10. 27. The method of claim 19 wherein providing the indication of whether the input name belongs to the particular culture comprises providing an indication of whether the input name belongs to a particular language.
  11. 28. The method of claim 19 wherein the classifying algorithm is orthographic based, and processing the input name comprises analyzing characters in the input name.
  12. 29. The method of claim 28 wherein processing the input name comprises analyzing an affix in the input name.
  13. 30. The method of claim 19 wherein processing the input name comprises comparing digrams in the input name to digrams present in names from the particular culture.
  14. 31. The method of claim 30 wherein processing the input name further comprises computing a likelihood that the input name belongs to the particular culture based on digram distribution statistics for names from the particular culture.
  15. 32. The method claim 31 wherein computing the likelihood is further based on digram position within the input name.
  16. 33. The method of claim 19 wherein the classifying algorithm is element based, and processing the input name comprises analyzing elements in the input name.
  17. 34. The method of claim 33 wherein processing the input name comprises analyzing a title in the input name.
  18. 35. The method of claim 33 wherein processing the input name comprises analyzing a qualifier in the input name.
  19. 36. The method of claim 19 wherein the classifying algorithm is semantic based, and processing the input name comprises analyzing meaning in the input name.
  20. 37. The method of claim 19 wherein the classifying algorithm is phonologically based, and processing the input name comprises analyzing a sound in the input name.
  21. 38. The method of claim 19 wherein the classifying algorithm is syntactic based, and processing the input name comprises analyzing an order of elements in the input name.
  22. 39. The method of claim 19 wherein providing the indication of whether the input name belongs to the particular culture comprises providing a non-binary indication of a degree to which the input name belongs to the particular culture.
  23. 40. The method of claim 19 wherein:
    the input name is a full name including a given name and a surname,
    accessing the input name comprises accessing the full name, and
    processing the input name comprises processing the full name.
  24. 41. The method of claim 19 wherein:
    the input name is a partial name,
    accessing the input name comprises accessing the partial name, and
    processing the input name comprises processing the partial name.
  25. 42. The method of claim 19 wherein processing the input name comprises comparing the input name to a high-frequency name in the particular culture.
  26. 43. The method of claim 19 wherein processing the input name comprises comparing a length of the input name to lengths of names in the particular culture.
  27. 44. The method of claim 19 wherein processing the input name comprises comparing the input name to a string of characters that occurs in names in the particular culture.
  28. 45. The method of claim 44 wherein the string of characters comprises a morpheme in the particular culture, and processing the input name comprises comparing the input name to the morpheme.
  29. 46. The method of claim 19 wherein providing the indication comprises providing a likelihood that the input name belongs to the particular culture.
  30. 47. The method of claim 19 wherein:
    providing the indication of whether the input name belongs to the particular culture comprises providing an indication that the input name does belong to the particular culture, and
    providing the indication of whether the input name belongs to the other culture comprises providing an indication that the input name does belong to the other culture.
  31. 48. The method of claim 19 wherein providing the indication comprises providing the indication to a user.
  32. 49. The method of claim 19 wherein providing the indication comprises providing the indication to another algorithm.
  33. 50. The method of claim 19 wherein accessing the classifying algorithm comprises accessing the classifying algorithm from among multiple algorithms, the multiple algorithms each being based on linguistic analysis of names in a different culture such that no two algorithms are based on the same culture.
  34. 51. The method of claim 19 wherein providing the indication comprises providing an indication that the input name belongs to the particular culture, and the method further comprises:
    accessing a stored name of the particular culture;
    selecting a comparing algorithm that is based on names in the particular culture;
    comparing the input name and the stored name using the comparing algorithm; and
    providing an indication of whether the input name matches the stored name based on the comparing of the input name and the stored name.
  35. 52. The method of claim 51 wherein selecting the comparing algorithm comprises selecting the comparing algorithm from among multiple comparing algorithms, each comparing algorithm being based on names in a different culture such that no two comparing algorithms are based on the same culture.
  36. 53. A method of providing an indication of whether an input name belongs to a particular culture, the method comprising:
    accessing an input name;
    accessing a classifying algorithm that is based on linguistic analysis of names in a particular culture, wherein the classifying algorithm is semantic based;
    processing the input name using the classifying algorithm, the processing including analyzing meaning in the input name; and
    providing an indication of whether the input name belongs to the particular culture based on the processing of the input name using the classifying algorithm.
  37. 54. A method of providing an indication of whether an input name belongs to a particular culture, the method comprising:
    accessing an input name;
    accessing a classifying algorithm that is based on linguistic analysis of names in a particular culture, wherein the classifying algorithm is phonologically based;
    processing the input name using the classifying algorithm, the processing including analyzing a sound in the input name; and
    providing an indication of whether the input name belongs to the particular culture based on the processing of the input name using the classifying algorithm.
  38. 55. A method of providing an indication of whether an input name belongs to a particular culture, the method comprising:
    accessing an input name;
    accessing a classifying algorithm that is based on linguistic analysis of names in a particular culture, wherein the classifying algorithm is based on morphemes;
    processing the input name using the classifying algorithm, the processing including comparing the input name to a morpheme from the particular culture; and
    providing an indication of whether the input name belongs to the particular culture based on the processing of the input name using the classifying algorithm.
  39. 56. An apparatus comprising a computer readable medium having instructions stored thereon that when executed by a machine result in at least the following:
    accessing an input name;
    accessing a classifying algorithm that is based on linguistic analysis of names in a particular culture;
    accessing another classifying algorithm, the other classifying algorithm being based on linguistic analysis of names in another culture;
    processing the input name using the classifying algorithm;
    processing the input name using the other classifying algorithm;
    providing an indication of whether the input name belongs to the particular culture based on the processing of the input name using the classifying algorithm; and
    providing an indication of whether the input name belongs to the other culture based on the processing of the input name using the other classifying algorithm.
US11188979 1998-03-25 2005-07-26 System and method for adaptive multi-cultural searching and matching of personal names Abandoned US20050273468A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US7923398 true 1998-03-25 1998-03-25
US09275766 US6963871B1 (en) 1998-03-25 1999-03-25 System and method for adaptive multi-cultural searching and matching of personal names
US11188979 US20050273468A1 (en) 1998-03-25 2005-07-26 System and method for adaptive multi-cultural searching and matching of personal names

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11188979 US20050273468A1 (en) 1998-03-25 2005-07-26 System and method for adaptive multi-cultural searching and matching of personal names

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09275766 Division US6963871B1 (en) 1998-03-25 1999-03-25 System and method for adaptive multi-cultural searching and matching of personal names

Publications (1)

Publication Number Publication Date
US20050273468A1 true true US20050273468A1 (en) 2005-12-08

Family

ID=35207107

Family Applications (4)

Application Number Title Priority Date Filing Date
US09275766 Expired - Fee Related US6963871B1 (en) 1998-03-25 1999-03-25 System and method for adaptive multi-cultural searching and matching of personal names
US10055178 Abandoned US20070005567A1 (en) 1998-03-25 2002-01-25 System and method for adaptive multi-cultural searching and matching of personal names
US11188979 Abandoned US20050273468A1 (en) 1998-03-25 2005-07-26 System and method for adaptive multi-cultural searching and matching of personal names
US12197119 Expired - Fee Related US8041560B2 (en) 1998-03-25 2008-08-22 System for adaptive multi-cultural searching and matching of personal names

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US09275766 Expired - Fee Related US6963871B1 (en) 1998-03-25 1999-03-25 System and method for adaptive multi-cultural searching and matching of personal names
US10055178 Abandoned US20070005567A1 (en) 1998-03-25 2002-01-25 System and method for adaptive multi-cultural searching and matching of personal names

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12197119 Expired - Fee Related US8041560B2 (en) 1998-03-25 2008-08-22 System for adaptive multi-cultural searching and matching of personal names

Country Status (1)

Country Link
US (4) US6963871B1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050119875A1 (en) * 1998-03-25 2005-06-02 Shaefer Leonard Jr. Identifying related names
US20050160460A1 (en) * 2002-03-27 2005-07-21 Nobuyuki Fujiwara Information processing apparatus and method
US20060089927A1 (en) * 2004-10-27 2006-04-27 Tildy, Llc Indexing and querying engines and methods of indexing and querying
US20070005567A1 (en) * 1998-03-25 2007-01-04 Hermansen John C System and method for adaptive multi-cultural searching and matching of personal names
US20070005586A1 (en) * 2004-03-30 2007-01-04 Shaefer Leonard A Jr Parsing culturally diverse names
US20070150279A1 (en) * 2005-12-27 2007-06-28 Oracle International Corporation Word matching with context sensitive character to sound correlating
US20070162445A1 (en) * 2005-11-23 2007-07-12 Dun And Bradstreet System and method for searching and matching data having ideogrammatic content
US20080319990A1 (en) * 2007-06-18 2008-12-25 Geographic Services, Inc. Geographic feature name search system
US20090089283A1 (en) * 2007-09-27 2009-04-02 International Business Machines Corporation Method and apparatus for assigning a cultural classification to a name using country-of-association information
US20090216689A1 (en) * 2008-01-24 2009-08-27 Dmitry Zelenko System and method for variant string matching
US20100153396A1 (en) * 2007-02-26 2010-06-17 Benson Margulies Name indexing for name matching systems
US20120330947A1 (en) * 2011-06-22 2012-12-27 Jostle Corporation Name-Search System and Method
US8812300B2 (en) 1998-03-25 2014-08-19 International Business Machines Corporation Identifying related names
US8855998B2 (en) 1998-03-25 2014-10-07 International Business Machines Corporation Parsing culturally diverse names

Families Citing this family (148)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6493698B1 (en) * 1999-07-26 2002-12-10 Intel Corporation String search scheme in a distributed architecture
US6785671B1 (en) * 1999-12-08 2004-08-31 Amazon.Com, Inc. System and method for locating web-based product offerings
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
JP3662519B2 (en) * 2000-07-13 2005-06-22 シャープ株式会社 The optical pick-up
US7089245B1 (en) 2001-08-31 2006-08-08 Bmc Software, Inc. Service desk data transfer interface
US20040002850A1 (en) * 2002-03-14 2004-01-01 Shaefer Leonard Arthur System and method for formulating reasonable spelling variations of a proper name
US8285537B2 (en) * 2003-01-31 2012-10-09 Comverse, Inc. Recognition of proper nouns using native-language pronunciation
US9411859B2 (en) 2009-12-14 2016-08-09 Lexisnexis Risk Solutions Fl Inc External linking based on hierarchical level weightings
US7657540B1 (en) 2003-02-04 2010-02-02 Seisint, Inc. Method and system for linking and delinking data records
US7783617B2 (en) * 2003-04-16 2010-08-24 Yahoo! Inc. Personals advertisement affinities in a networked computer system
US8423563B2 (en) * 2003-10-16 2013-04-16 Sybase, Inc. System and methodology for name searches
US20050147947A1 (en) * 2003-12-29 2005-07-07 Myfamily.Com, Inc. Genealogical investigation and documentation systems and methods
US8095567B2 (en) * 2003-12-29 2012-01-10 Myfamily.Com, Inc. Providing alternatives within a family tree systems and methods
US20060031239A1 (en) * 2004-07-12 2006-02-09 Koenig Daniel W Methods and apparatus for authenticating names
US20060031069A1 (en) * 2004-08-03 2006-02-09 Sony Corporation System and method for performing a grapheme-to-phoneme conversion
US8229737B2 (en) * 2004-11-23 2012-07-24 International Business Machines Corporation Name classifier technique
US20070005597A1 (en) * 2004-11-23 2007-01-04 Williams Charles K Name classifier algorithm
US20070038652A1 (en) * 2005-08-15 2007-02-15 Microsoft Corporation Data driven cultural customization
US20070174339A1 (en) * 2005-09-07 2007-07-26 Kolo Brian A System and method for determining personal genealogical relationships and geographical origins including a relative confidence
US20070218429A1 (en) * 2005-09-07 2007-09-20 Kolo Brian A System and method for determining personal genealogical relationships and geographical origins
KR101063607B1 (en) * 2005-10-14 2011-09-07 주식회사 현대오토넷 The navigation system and method has a name search function using voice recognition
US7805430B2 (en) * 2005-12-22 2010-09-28 Sap Ag Evaluation of name prefix and suffix during a search
US20060122903A1 (en) * 2006-02-25 2006-06-08 Medrano Guillermo A Cross-Cultural and Personality Support System and Method
US20070244911A1 (en) * 2006-03-21 2007-10-18 Dick Richard S Composite clinical data dictionary (C²D²)
US20070239735A1 (en) * 2006-04-05 2007-10-11 Glover Eric J Systems and methods for predicting if a query is a name
US7526486B2 (en) * 2006-05-22 2009-04-28 Initiate Systems, Inc. Method and system for indexing information about entities with respect to hierarchies
US7523108B2 (en) * 2006-06-07 2009-04-21 Platformation, Inc. Methods and apparatus for searching with awareness of geography and languages
US8356009B2 (en) 2006-09-15 2013-01-15 International Business Machines Corporation Implementation defined segments for relational database systems
US7698268B1 (en) 2006-09-15 2010-04-13 Initiate Systems, Inc. Method and system for filtering false positives
US7685093B1 (en) 2006-09-15 2010-03-23 Initiate Systems, Inc. Method and system for comparing attributes such as business names
US7627550B1 (en) * 2006-09-15 2009-12-01 Initiate Systems, Inc. Method and system for comparing attributes such as personal names
US9026514B2 (en) * 2006-10-13 2015-05-05 International Business Machines Corporation Method, apparatus and article for assigning a similarity measure to names
US8560403B2 (en) * 2006-10-18 2013-10-15 Left Bank Ventures, Llc System and method for demand driven collaborative procurement, logistics, and authenticity establishment of luxury commodities using virtual inventories
US7496568B2 (en) * 2006-11-30 2009-02-24 International Business Machines Corporation Efficient multifaceted search in information retrieval systems
US20080147588A1 (en) * 2006-12-14 2008-06-19 Dean Leffingwell Method for discovering data artifacts in an on-line data object
US20080147642A1 (en) * 2006-12-14 2008-06-19 Dean Leffingwell System for discovering data artifacts in an on-line data object
CN100489853C (en) 2006-12-28 2009-05-20 腾讯科技(深圳)有限公司 System and method for quickly inquiring about black and white name list
US8195448B2 (en) * 2006-12-28 2012-06-05 John Paisley Dargan Method and apparatus for predicting text
US8359339B2 (en) 2007-02-05 2013-01-22 International Business Machines Corporation Graphical user interface for configuration of an algorithm for the matching of data records
US8719027B2 (en) * 2007-02-28 2014-05-06 Microsoft Corporation Name synthesis
US7599921B2 (en) * 2007-03-02 2009-10-06 International Business Machines Corporation System and method for improved name matching using regularized name forms
US8515926B2 (en) * 2007-03-22 2013-08-20 International Business Machines Corporation Processing related data from information sources
WO2008121170A1 (en) 2007-03-29 2008-10-09 Initiate Systems, Inc. Method and system for parsing languages
WO2008121700A1 (en) 2007-03-29 2008-10-09 Initiate Systems, Inc. Method and system for managing entities
US8429220B2 (en) 2007-03-29 2013-04-23 International Business Machines Corporation Data exchange among data sources
US8423514B2 (en) 2007-03-29 2013-04-16 International Business Machines Corporation Service provisioning
US8433699B1 (en) * 2007-06-28 2013-04-30 Emc Corporation Object identity and addressability
US20110010214A1 (en) * 2007-06-29 2011-01-13 Carruth J Scott Method and system for project management
US8024347B2 (en) * 2007-09-27 2011-09-20 International Business Machines Corporation Method and apparatus for automatically differentiating between types of names stored in a data collection
EP2193415A4 (en) * 2007-09-28 2013-08-28 Ibm Method and system for analysis of a system for matching data records
US8713434B2 (en) 2007-09-28 2014-04-29 International Business Machines Corporation Indexing, relating and managing information about entities
US8861856B2 (en) 2007-09-28 2014-10-14 Abbyy Development Llc Model-based methods of document logical structure recognition in OCR systems
US8452132B2 (en) * 2008-09-23 2013-05-28 Abbyy Software Ltd. Automatic file name generation in OCR systems
US9413912B2 (en) 2012-10-26 2016-08-09 Abbyy Development Llc Scanning device having a bed cover including a pattern of repeated design elements
US8260049B2 (en) * 2007-09-28 2012-09-04 Abbyy Software Ltd. Model-based method of document logical structure recognition in OCR systems
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
WO2009089487A1 (en) * 2008-01-11 2009-07-16 Drubner Jeffrey M Method and system for uniquely identifying a person to the exclusion of all others
US7447996B1 (en) * 2008-02-28 2008-11-04 International Business Machines Corporation System for using gender analysis of names to assign avatars in instant messaging applications
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US8266168B2 (en) 2008-04-24 2012-09-11 Lexisnexis Risk & Information Analytics Group Inc. Database systems and methods for linking records and entity representations with sufficiently high confidence
US8645417B2 (en) * 2008-06-18 2014-02-04 Microsoft Corporation Name search using a ranking function
US8484211B2 (en) 2008-07-02 2013-07-09 Lexisnexis Risk Solutions Fl Inc. Batch entity representation identification using field match templates
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US9411877B2 (en) * 2008-09-03 2016-08-09 International Business Machines Corporation Entity-driven logic for improved name-searching in mixed-entity lists
US8712776B2 (en) 2008-09-29 2014-04-29 Apple Inc. Systems and methods for selective text to speech synthesis
US8583418B2 (en) * 2008-09-29 2013-11-12 Apple Inc. Systems and methods of detecting language and natural language strings for text to speech synthesis
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US8914359B2 (en) * 2008-12-30 2014-12-16 Microsoft Corporation Ranking documents with social tags
JP4735726B2 (en) * 2009-02-18 2011-07-27 ソニー株式会社 An information processing apparatus and method, and program
US8380507B2 (en) 2009-03-09 2013-02-19 Apple Inc. Systems and methods for determining the language to use for speech generated by a text to speech engine
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US20100312778A1 (en) * 2009-06-08 2010-12-09 Yumao Lu Predictive person name variants for web search
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
CN102985959A (en) * 2010-04-07 2013-03-20 麦克斯价值解决方案国际有限公司 Method and system for name pronunciation guide services
US8972930B2 (en) 2010-06-04 2015-03-03 Microsoft Corporation Generating text manipulation programs using input-output examples
US8799234B2 (en) * 2010-07-12 2014-08-05 Microsoft Corporation Semantic entity manipulation using input-output examples
US9613115B2 (en) 2010-07-12 2017-04-04 Microsoft Technology Licensing, Llc Generating programs based on input-output examples using converter modules
US9189505B2 (en) 2010-08-09 2015-11-17 Lexisnexis Risk Data Management, Inc. System of and method for entity representation splitting without the need for human interaction
JP5282773B2 (en) * 2010-08-27 2013-09-04 ブラザー工業株式会社 Data management applications and data management device
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US9607105B1 (en) * 2011-03-30 2017-03-28 Amazon Technologies, Inc. Content searching techniques
US20120278315A1 (en) * 2011-04-30 2012-11-01 Tibco Software Inc. Integrated phonetic matching methods and systems
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
JP2012256197A (en) * 2011-06-08 2012-12-27 Toshiba Corp Orthographical variant detection device and orthographical variant detection program
CN102223430A (en) * 2011-06-13 2011-10-19 深圳桑菲消费通信有限公司 Method for ranking and searching polyphones of contacts in mobile phone
US9471605B2 (en) * 2011-06-21 2016-10-18 International Business Machines Corporation Contact recommendation system for a user communication
US8676823B2 (en) * 2011-08-16 2014-03-18 National Student Clearinghouse Efficient student record matching
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US8996358B2 (en) 2012-05-25 2015-03-31 International Business Machines Corporation Entity variant generation and normalization
US9552335B2 (en) 2012-06-04 2017-01-24 Microsoft Technology Licensing, Llc Expedited techniques for generating string manipulation programs
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US10042926B1 (en) * 2012-10-15 2018-08-07 Facebook, Inc. User search based on family connections
US9229926B2 (en) 2012-12-03 2016-01-05 International Business Machines Corporation Determining similarity of unfielded names using feature assignments
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A3 (en) 2013-06-07 2015-01-29 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
JP2016521948A (en) 2013-06-13 2016-07-25 アップル インコーポレイテッド System and method for emergency call initiated by voice command
CN103472991A (en) * 2013-08-28 2013-12-25 华为技术有限公司 Method, equipment and system for adding contacts
US20150255069A1 (en) * 2014-03-04 2015-09-10 Amazon Technologies, Inc. Predicting pronunciation in speech recognition
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
EP3149728A1 (en) 2014-05-30 2017-04-05 Apple Inc. Multi-command single utterance input method
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9606986B2 (en) 2014-09-29 2017-03-28 Apple Inc. Integrated word N-gram and class M-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US9881004B2 (en) * 2015-05-01 2018-01-30 Cerner Innovation, Inc. Gender and name translation from a first to a second language
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US20170249383A1 (en) * 2016-02-26 2017-08-31 Workday, Inc. Systematic mass normalization of international titles
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
CN106201011A (en) * 2016-06-30 2016-12-07 北京奇虎科技有限公司 Communication information retrieval method and device and terminal equipment
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant

Citations (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5040218A (en) * 1988-11-23 1991-08-13 Digital Equipment Corporation Name pronounciation by synthesizer
US5062143A (en) * 1990-02-23 1991-10-29 Harris Corporation Trigram-based method of language identification
US5212730A (en) * 1991-07-01 1993-05-18 Texas Instruments Incorporated Voice recognition of proper names using text-derived recognition models
US5258909A (en) * 1989-08-31 1993-11-02 International Business Machines Corporation Method and apparatus for "wrong word" spelling error detection and correction
US5323316A (en) * 1991-02-01 1994-06-21 Wang Laboratories, Inc. Morphological analyzer
US5333317A (en) * 1989-12-22 1994-07-26 Bull Hn Information Systems Inc. Name resolution in a directory database
US5337232A (en) * 1989-03-02 1994-08-09 Nec Corporation Morpheme analysis device
US5369726A (en) * 1989-08-17 1994-11-29 Eliza Corporation Speech recognition circuitry employing nonlinear processing speech element modeling and phoneme estimation
US5369727A (en) * 1991-05-16 1994-11-29 Matsushita Electric Industrial Co., Ltd. Method of speech recognition with correlation of similarities
US5371676A (en) * 1991-07-23 1994-12-06 Oce-Nederland, B.V. Apparatus and method for determining data of compound words
US5375176A (en) * 1993-04-19 1994-12-20 Xerox Corporation Method and apparatus for automatic character type classification of European script documents
US5377280A (en) * 1993-04-19 1994-12-27 Xerox Corporation Method and apparatus for automatic language determination of European script documents
US5425110A (en) * 1993-04-19 1995-06-13 Xerox Corporation Method and apparatus for automatic language determination of Asian language documents
USD359480S (en) * 1993-12-07 1995-06-20 Top surface of a set of keys used for English and Japanese symbols based on International Phonetic Association coding in a keyboard configuration
US5432948A (en) * 1993-04-26 1995-07-11 Taligent, Inc. Object-oriented rule-based text input transliteration system
US5434777A (en) * 1992-05-27 1995-07-18 Apple Computer, Inc. Method and apparatus for processing natural language
US5440663A (en) * 1992-09-28 1995-08-08 International Business Machines Corporation Computer system for speech recognition
US5457770A (en) * 1993-08-19 1995-10-10 Kabushiki Kaisha Meidensha Speaker independent speech recognition system and method using neural network and/or DP matching technique
US5477451A (en) * 1991-07-25 1995-12-19 International Business Machines Corp. Method and system for natural language translation
US5485373A (en) * 1993-03-25 1996-01-16 Taligent, Inc. Language-sensitive text searching system with modified Boyer-Moore process
US5490061A (en) * 1987-02-05 1996-02-06 Toltran, Ltd. Improved translation system utilizing a morphological stripping process to reduce words to their root configuration to produce reduction of database size
US5515475A (en) * 1993-06-24 1996-05-07 Northern Telecom Limited Speech recognition method using a two-pass search
US5526463A (en) * 1990-06-22 1996-06-11 Dragon Systems, Inc. System for processing a succession of utterances spoken in continuous or discrete form
US5548507A (en) * 1994-03-14 1996-08-20 International Business Machines Corporation Language identification process using coded language words
US5644740A (en) * 1992-12-02 1997-07-01 Hitachi, Ltd. Method and apparatus for displaying items of information organized in a hierarchical structure
US5680511A (en) * 1995-06-07 1997-10-21 Dragon Systems, Inc. Systems and methods for word recognition
US5682524A (en) * 1995-05-26 1997-10-28 Starfish Software, Inc. Databank system with methods for efficiently storing non-uniform data records
US5724481A (en) * 1995-03-30 1998-03-03 Lucent Technologies Inc. Method for automatic speech recognition of arbitrary spoken words
US5758314A (en) * 1996-05-21 1998-05-26 Sybase, Inc. Client/server database system with methods for improved soundex processing in a heterogeneous language environment
US5819265A (en) * 1996-07-12 1998-10-06 International Business Machines Corporation Processing names in a text
US5832480A (en) * 1996-07-12 1998-11-03 International Business Machines Corporation Using canonical forms to develop a dictionary of names in a text
US5835912A (en) * 1997-03-13 1998-11-10 The United States Of America As Represented By The National Security Agency Method of efficiency and flexibility storing, retrieving, and modifying data in any language representation
US5870700A (en) * 1996-04-01 1999-02-09 Dts Software, Inc. Brazilian Portuguese grammar checker
US5873111A (en) * 1996-05-10 1999-02-16 Apple Computer, Inc. Method and system for collation in a processing system of a variety of distinct sets of information
US5920852A (en) * 1996-04-30 1999-07-06 Grannet Corporation Large memory storage and retrieval (LAMSTAR) network
US5963940A (en) * 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US6067520A (en) * 1995-12-29 2000-05-23 Lee And Li System and method of recognizing continuous mandarin speech utilizing chinese hidden markou models
US6243669B1 (en) * 1999-01-29 2001-06-05 Sony Corporation Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation
US6266642B1 (en) * 1999-01-29 2001-07-24 Sony Corporation Method and portable apparatus for performing spoken language translation
US6272464B1 (en) * 2000-03-27 2001-08-07 Lucent Technologies Inc. Method and apparatus for assembling a prediction list of name pronunciation variations for use during speech recognition
US6298343B1 (en) * 1997-12-29 2001-10-02 Inventec Corporation Methods for intelligent universal database search engines
US6311152B1 (en) * 1999-04-08 2001-10-30 Kent Ridge Digital Labs System for chinese tokenization and named entity recognition
US20020156902A1 (en) * 2001-04-13 2002-10-24 Crandall John Christopher Language and culture interface protocol
US6496793B1 (en) * 1993-04-21 2002-12-17 Borland Software Corporation System and methods for national language support with embedded locale-specific language driver identifiers
US6618697B1 (en) * 1999-05-14 2003-09-09 Justsystem Corporation Method for rule-based correction of spelling and grammar errors
US20040002850A1 (en) * 2002-03-14 2004-01-01 Shaefer Leonard Arthur System and method for formulating reasonable spelling variations of a proper name
US6735593B1 (en) * 1998-11-12 2004-05-11 Simon Guy Williams Systems and methods for storing data
US6757688B1 (en) * 2001-08-24 2004-06-29 Unisys Corporation Enhancement for multi-lingual record processing
US20050119875A1 (en) * 1998-03-25 2005-06-02 Shaefer Leonard Jr. Identifying related names
US7107206B1 (en) * 1999-11-17 2006-09-12 United Nations Language conversion system
US20070005567A1 (en) * 1998-03-25 2007-01-04 Hermansen John C System and method for adaptive multi-cultural searching and matching of personal names
US20070005578A1 (en) * 2004-11-23 2007-01-04 Patman Frankie E D Filtering extracted personal names
US20070005586A1 (en) * 2004-03-30 2007-01-04 Shaefer Leonard A Jr Parsing culturally diverse names
US7249013B2 (en) * 2002-03-11 2007-07-24 University Of Southern California Named entity translation

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5687366A (en) 1995-05-05 1997-11-11 Apple Computer, Inc. Crossing locale boundaries to provide services
US6038566A (en) 1996-12-04 2000-03-14 Tsai; Daniel E. Method and apparatus for navigation of relational databases on distributed networks
US6073090A (en) 1997-04-15 2000-06-06 Silicon Graphics, Inc. System and method for independently configuring international location and language
US6314469B1 (en) 1999-02-26 2001-11-06 I-Dns.Net International Pte Ltd Multi-language domain name service
JP2001076005A (en) 1999-06-30 2001-03-23 Hitachi Ltd Data base system
US7134084B1 (en) 2001-06-18 2006-11-07 Siebel Systems, Inc. Configuration of displays for targeted user communities
US20040111475A1 (en) 2002-12-06 2004-06-10 International Business Machines Corporation Method and apparatus for selectively identifying misspelled character strings in electronic communications
US7475010B2 (en) 2003-09-03 2009-01-06 Lingospot, Inc. Adaptive and scalable method for resolving natural language ambiguities
US20050147947A1 (en) 2003-12-29 2005-07-07 Myfamily.Com, Inc. Genealogical investigation and documentation systems and methods
US7636083B2 (en) 2004-02-20 2009-12-22 Tegic Communications, Inc. Method and apparatus for text input in various languages

Patent Citations (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5490061A (en) * 1987-02-05 1996-02-06 Toltran, Ltd. Improved translation system utilizing a morphological stripping process to reduce words to their root configuration to produce reduction of database size
US5040218A (en) * 1988-11-23 1991-08-13 Digital Equipment Corporation Name pronounciation by synthesizer
US5337232A (en) * 1989-03-02 1994-08-09 Nec Corporation Morpheme analysis device
US5369726A (en) * 1989-08-17 1994-11-29 Eliza Corporation Speech recognition circuitry employing nonlinear processing speech element modeling and phoneme estimation
US5258909A (en) * 1989-08-31 1993-11-02 International Business Machines Corporation Method and apparatus for "wrong word" spelling error detection and correction
US5333317A (en) * 1989-12-22 1994-07-26 Bull Hn Information Systems Inc. Name resolution in a directory database
US5062143A (en) * 1990-02-23 1991-10-29 Harris Corporation Trigram-based method of language identification
US5526463A (en) * 1990-06-22 1996-06-11 Dragon Systems, Inc. System for processing a succession of utterances spoken in continuous or discrete form
US5323316A (en) * 1991-02-01 1994-06-21 Wang Laboratories, Inc. Morphological analyzer
US5369727A (en) * 1991-05-16 1994-11-29 Matsushita Electric Industrial Co., Ltd. Method of speech recognition with correlation of similarities
US5212730A (en) * 1991-07-01 1993-05-18 Texas Instruments Incorporated Voice recognition of proper names using text-derived recognition models
US5371676A (en) * 1991-07-23 1994-12-06 Oce-Nederland, B.V. Apparatus and method for determining data of compound words
US5477451A (en) * 1991-07-25 1995-12-19 International Business Machines Corp. Method and system for natural language translation
US5434777A (en) * 1992-05-27 1995-07-18 Apple Computer, Inc. Method and apparatus for processing natural language
US5440663A (en) * 1992-09-28 1995-08-08 International Business Machines Corporation Computer system for speech recognition
US5644740A (en) * 1992-12-02 1997-07-01 Hitachi, Ltd. Method and apparatus for displaying items of information organized in a hierarchical structure
US5485373A (en) * 1993-03-25 1996-01-16 Taligent, Inc. Language-sensitive text searching system with modified Boyer-Moore process
US5425110A (en) * 1993-04-19 1995-06-13 Xerox Corporation Method and apparatus for automatic language determination of Asian language documents
US5377280A (en) * 1993-04-19 1994-12-27 Xerox Corporation Method and apparatus for automatic language determination of European script documents
US5375176A (en) * 1993-04-19 1994-12-20 Xerox Corporation Method and apparatus for automatic character type classification of European script documents
US6496793B1 (en) * 1993-04-21 2002-12-17 Borland Software Corporation System and methods for national language support with embedded locale-specific language driver identifiers
US5432948A (en) * 1993-04-26 1995-07-11 Taligent, Inc. Object-oriented rule-based text input transliteration system
US5515475A (en) * 1993-06-24 1996-05-07 Northern Telecom Limited Speech recognition method using a two-pass search
US5457770A (en) * 1993-08-19 1995-10-10 Kabushiki Kaisha Meidensha Speaker independent speech recognition system and method using neural network and/or DP matching technique
USD359480S (en) * 1993-12-07 1995-06-20 Top surface of a set of keys used for English and Japanese symbols based on International Phonetic Association coding in a keyboard configuration
US5548507A (en) * 1994-03-14 1996-08-20 International Business Machines Corporation Language identification process using coded language words
US5724481A (en) * 1995-03-30 1998-03-03 Lucent Technologies Inc. Method for automatic speech recognition of arbitrary spoken words
US5682524A (en) * 1995-05-26 1997-10-28 Starfish Software, Inc. Databank system with methods for efficiently storing non-uniform data records
US5680511A (en) * 1995-06-07 1997-10-21 Dragon Systems, Inc. Systems and methods for word recognition
US5963940A (en) * 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US6067520A (en) * 1995-12-29 2000-05-23 Lee And Li System and method of recognizing continuous mandarin speech utilizing chinese hidden markou models
US5870700A (en) * 1996-04-01 1999-02-09 Dts Software, Inc. Brazilian Portuguese grammar checker
US5920852A (en) * 1996-04-30 1999-07-06 Grannet Corporation Large memory storage and retrieval (LAMSTAR) network
US5873111A (en) * 1996-05-10 1999-02-16 Apple Computer, Inc. Method and system for collation in a processing system of a variety of distinct sets of information
US5758314A (en) * 1996-05-21 1998-05-26 Sybase, Inc. Client/server database system with methods for improved soundex processing in a heterogeneous language environment
US5819265A (en) * 1996-07-12 1998-10-06 International Business Machines Corporation Processing names in a text
US5832480A (en) * 1996-07-12 1998-11-03 International Business Machines Corporation Using canonical forms to develop a dictionary of names in a text
US5835912A (en) * 1997-03-13 1998-11-10 The United States Of America As Represented By The National Security Agency Method of efficiency and flexibility storing, retrieving, and modifying data in any language representation
US6298343B1 (en) * 1997-12-29 2001-10-02 Inventec Corporation Methods for intelligent universal database search engines
US20050119875A1 (en) * 1998-03-25 2005-06-02 Shaefer Leonard Jr. Identifying related names
US20070005567A1 (en) * 1998-03-25 2007-01-04 Hermansen John C System and method for adaptive multi-cultural searching and matching of personal names
US6735593B1 (en) * 1998-11-12 2004-05-11 Simon Guy Williams Systems and methods for storing data
US6243669B1 (en) * 1999-01-29 2001-06-05 Sony Corporation Method and apparatus for providing syntactic analysis and data structure for translation knowledge in example-based language translation
US6266642B1 (en) * 1999-01-29 2001-07-24 Sony Corporation Method and portable apparatus for performing spoken language translation
US6311152B1 (en) * 1999-04-08 2001-10-30 Kent Ridge Digital Labs System for chinese tokenization and named entity recognition
US6618697B1 (en) * 1999-05-14 2003-09-09 Justsystem Corporation Method for rule-based correction of spelling and grammar errors
US7107206B1 (en) * 1999-11-17 2006-09-12 United Nations Language conversion system
US6272464B1 (en) * 2000-03-27 2001-08-07 Lucent Technologies Inc. Method and apparatus for assembling a prediction list of name pronunciation variations for use during speech recognition
US20020156902A1 (en) * 2001-04-13 2002-10-24 Crandall John Christopher Language and culture interface protocol
US6757688B1 (en) * 2001-08-24 2004-06-29 Unisys Corporation Enhancement for multi-lingual record processing
US7249013B2 (en) * 2002-03-11 2007-07-24 University Of Southern California Named entity translation
US20040002850A1 (en) * 2002-03-14 2004-01-01 Shaefer Leonard Arthur System and method for formulating reasonable spelling variations of a proper name
US20070005586A1 (en) * 2004-03-30 2007-01-04 Shaefer Leonard A Jr Parsing culturally diverse names
US20070005578A1 (en) * 2004-11-23 2007-01-04 Patman Frankie E D Filtering extracted personal names

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080312909A1 (en) * 1998-03-25 2008-12-18 International Business Machines Corporation System for adaptive multi-cultural searching and matching of personal names
US8812300B2 (en) 1998-03-25 2014-08-19 International Business Machines Corporation Identifying related names
US8041560B2 (en) 1998-03-25 2011-10-18 International Business Machines Corporation System for adaptive multi-cultural searching and matching of personal names
US20070005567A1 (en) * 1998-03-25 2007-01-04 Hermansen John C System and method for adaptive multi-cultural searching and matching of personal names
US20050119875A1 (en) * 1998-03-25 2005-06-02 Shaefer Leonard Jr. Identifying related names
US8855998B2 (en) 1998-03-25 2014-10-07 International Business Machines Corporation Parsing culturally diverse names
US20050160460A1 (en) * 2002-03-27 2005-07-21 Nobuyuki Fujiwara Information processing apparatus and method
US8307391B2 (en) * 2002-03-27 2012-11-06 Sony Corporation Information processing apparatus and method
US20070005586A1 (en) * 2004-03-30 2007-01-04 Shaefer Leonard A Jr Parsing culturally diverse names
US7647294B2 (en) * 2004-10-27 2010-01-12 Fairbanks Jr William E Indexing and querying engines and methods of indexing and querying
US20060089927A1 (en) * 2004-10-27 2006-04-27 Tildy, Llc Indexing and querying engines and methods of indexing and querying
US20070162445A1 (en) * 2005-11-23 2007-07-12 Dun And Bradstreet System and method for searching and matching data having ideogrammatic content
US7584188B2 (en) * 2005-11-23 2009-09-01 Dun And Bradstreet System and method for searching and matching data having ideogrammatic content
US20070150279A1 (en) * 2005-12-27 2007-06-28 Oracle International Corporation Word matching with context sensitive character to sound correlating
US20100153396A1 (en) * 2007-02-26 2010-06-17 Benson Margulies Name indexing for name matching systems
US20080319990A1 (en) * 2007-06-18 2008-12-25 Geographic Services, Inc. Geographic feature name search system
US8015196B2 (en) 2007-06-18 2011-09-06 Geographic Services, Inc. Geographic feature name search system
US20090089283A1 (en) * 2007-09-27 2009-04-02 International Business Machines Corporation Method and apparatus for assigning a cultural classification to a name using country-of-association information
US7996403B2 (en) * 2007-09-27 2011-08-09 International Business Machines Corporation Method and apparatus for assigning a cultural classification to a name using country-of-association information
US20090216689A1 (en) * 2008-01-24 2009-08-27 Dmitry Zelenko System and method for variant string matching
US8209268B2 (en) * 2008-01-24 2012-06-26 Sra International, Inc. System and method for variant string matching
US20120330947A1 (en) * 2011-06-22 2012-12-27 Jostle Corporation Name-Search System and Method
US8706723B2 (en) * 2011-06-22 2014-04-22 Jostle Corporation Name-search system and method

Also Published As

Publication number Publication date Type
US6963871B1 (en) 2005-11-08 grant
US20080312909A1 (en) 2008-12-18 application
US8041560B2 (en) 2011-10-18 grant
US20070005567A1 (en) 2007-01-04 application

Similar Documents

Publication Publication Date Title
US6904560B1 (en) Identifying key images in a document in correspondence to document text
US5742816A (en) Method and apparatus for identifying textual documents and multi-mediafiles corresponding to a search topic
US5737734A (en) Query word relevance adjustment in a search of an information retrieval system
Kowalski Information retrieval systems: theory and implementation
US5724593A (en) Machine assisted translation tools
US6243713B1 (en) Multimedia document retrieval by application of multimedia queries to a unified index of multimedia data for a plurality of multimedia data types
US7509313B2 (en) System and method for processing a query
US7797265B2 (en) Document clustering that applies a locality sensitive hashing function to a feature vector to obtain a limited set of candidate clusters
US4972349A (en) Information retrieval system and method
US7496567B1 (en) System and method for document categorization
US5890103A (en) Method and apparatus for improved tokenization of natural language text
US6321192B1 (en) Adaptive learning method and system that matches keywords using a parsed keyword data structure having a hash index based on an unicode value
US6263333B1 (en) Method for searching non-tokenized text and tokenized text for matches against a keyword data structure
US6816830B1 (en) Finite state data structures with paths representing paired strings of tags and tag combinations
US20110137636A1 (en) Context aware back-transliteration and translation of names and common phrases using web resources
US6970881B1 (en) Concept-based method and system for dynamically analyzing unstructured information
US6415283B1 (en) Methods and apparatus for determining focal points of clusters in a tree structure
US5745745A (en) Text search method and apparatus for structured documents
US20080114725A1 (en) Method and System for High Performance Data Metatagging and Data Indexing Using Coprocessors
US8170867B2 (en) System for extracting information from a natural language text
US5794236A (en) Computer-based system for classifying documents into a hierarchy and linking the classifications to the hierarchy
US20040019601A1 (en) Creating taxonomies and training data for document categorization
Leser et al. What makes a gene name? Named entity recognition in the biomedical literature
US20120254143A1 (en) Natural language querying with cascaded conditional random fields
US4903206A (en) Spelling error correcting system

Legal Events

Date Code Title Description
AS Assignment

Owner name: LANGUAGE ANALYSIS SYSTEMS, INC., VIRGINIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HERMANSEN, JOHN CHRISTIAN;SHAEFER, JR., LEONARD ARTHUR;MCCALLUM-BAYLISS, HEATHER;AND OTHERS;REEL/FRAME:016813/0830

Effective date: 20000317

AS Assignment

Owner name: IBM CORPORATION, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LANGUAGE ANALYSIS SYSTEMS, INC.;REEL/FRAME:018532/0089

Effective date: 20060821