AU5091485A - Symbolic tokenizer for words and phrases - Google Patents

Symbolic tokenizer for words and phrases

Info

Publication number
AU5091485A
AU5091485A AU50914/85A AU5091485A AU5091485A AU 5091485 A AU5091485 A AU 5091485A AU 50914/85 A AU50914/85 A AU 50914/85A AU 5091485 A AU5091485 A AU 5091485A AU 5091485 A AU5091485 A AU 5091485A
Authority
AU
Australia
Prior art keywords
tokenizer
symbolic
phrases
words
symbolic tokenizer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
AU50914/85A
Inventor
Winther Dale Eugene
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Datran Corp
Original Assignee
DATRAN CORP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DATRAN CORP filed Critical DATRAN CORP
Publication of AU5091485A publication Critical patent/AU5091485A/en
Abandoned legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Machine Translation (AREA)
AU50914/85A 1984-11-08 1985-11-08 Symbolic tokenizer for words and phrases Abandoned AU5091485A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US66956284A 1984-11-08 1984-11-08
US669562 1984-11-08

Publications (1)

Publication Number Publication Date
AU5091485A true AU5091485A (en) 1986-06-03

Family

ID=24686822

Family Applications (1)

Application Number Title Priority Date Filing Date
AU50914/85A Abandoned AU5091485A (en) 1984-11-08 1985-11-08 Symbolic tokenizer for words and phrases

Country Status (3)

Country Link
EP (1) EP0201564A1 (en)
AU (1) AU5091485A (en)
WO (1) WO1986003039A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5754847A (en) * 1987-05-26 1998-05-19 Xerox Corporation Word/number and number/word mapping

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3309677A (en) * 1964-01-02 1967-03-14 Bunker Ramo Automatic information indexing
US4706212A (en) * 1971-08-31 1987-11-10 Toma Peter P Method using a programmed digital computer system for translation between natural languages
EP0079465A3 (en) * 1981-11-13 1985-01-23 International Business Machines Corporation Method for storing and accessing a relational data base
EP0160672A4 (en) * 1983-10-19 1986-05-12 Text Sciences Corp Method and apparatus for data compression.

Also Published As

Publication number Publication date
WO1986003039A1 (en) 1986-05-22
EP0201564A1 (en) 1986-11-20

Similar Documents

Publication Publication Date Title
AU4589489A (en) Injector
AU4222285A (en) Pyrrolobenzimidazoles
AU3839785A (en) Sammelpackung
AU4254685A (en) Arylhydroxamates
AU4668785A (en) Form-fill-seal-machine
AU4256585A (en) 1-heteroaryl-4-aryl-pyrazolin-5-ones
AU3840785A (en) 2-cyanobenzimidazoles and intermediates
AU4105285A (en) Tetrahydrofuran-2-ylmethylamines
AU3749685A (en) Induktionsmotor
AU4061285A (en) Schaltersicherungseinheit
AU4464289A (en) Nail guide and set
AU4118385A (en) Verbindungselement
AU552800B2 (en) Safe
GB8618876D0 (en) Speech aid
AU4271085A (en) Metallophosphoaluminates
AU4274285A (en) Cycloalkane-indene-carboximidamides
AU577394B2 (en) Circuitry for characterizing speech
AU5091485A (en) Symbolic tokenizer for words and phrases
AU4216685A (en) Aminocarnitines
AU4061585A (en) Automatisk fadolsaftapningsanlaeg
AU4001785A (en) Substituted isochromanes and oxepines
AU3884285A (en) Heibmangel
AU4271185A (en) Ferrophosphoaluminates
AU4163585A (en) Benzothiopyranones
AU4200785A (en) Diamino - 6 - halogeno - 5 - alkylthio-pyrimidines