EP3577571A4 - Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof - Google Patents

Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof Download PDF

Info

Publication number
EP3577571A4
EP3577571A4 EP18763492.8A EP18763492A EP3577571A4 EP 3577571 A4 EP3577571 A4 EP 3577571A4 EP 18763492 A EP18763492 A EP 18763492A EP 3577571 A4 EP3577571 A4 EP 3577571A4
Authority
EP
European Patent Office
Prior art keywords
electronic apparatus
language model
operation methods
recommendation word
providing recommendation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP18763492.8A
Other languages
German (de)
French (fr)
Other versions
EP3577571A1 (en
Inventor
Seung-hak YU
Nilesh Kulkarni
Hee-Jun Song
Hae-Jun Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority claimed from PCT/KR2018/001611 external-priority patent/WO2018164378A1/en
Publication of EP3577571A1 publication Critical patent/EP3577571A1/en
Publication of EP3577571A4 publication Critical patent/EP3577571A4/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3347—Query execution using vector based model
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G06F40/216—Parsing using statistical methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/274—Converting codes to words; Guess-ahead of partial word inputs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G06N5/022—Knowledge engineering; Knowledge acquisition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Algebra (AREA)
  • Human Computer Interaction (AREA)
  • Probability & Statistics with Applications (AREA)
  • Machine Translation (AREA)
EP18763492.8A 2017-03-09 2018-02-06 Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof Ceased EP3577571A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762469089P 2017-03-09 2017-03-09
KR1020170147922A KR102488338B1 (en) 2017-03-09 2017-11-08 Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof
PCT/KR2018/001611 WO2018164378A1 (en) 2017-03-09 2018-02-06 Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof

Publications (2)

Publication Number Publication Date
EP3577571A1 EP3577571A1 (en) 2019-12-11
EP3577571A4 true EP3577571A4 (en) 2020-02-26

Family

ID=63719251

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18763492.8A Ceased EP3577571A4 (en) 2017-03-09 2018-02-06 Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof

Country Status (3)

Country Link
EP (1) EP3577571A4 (en)
KR (1) KR102488338B1 (en)
CN (1) CN110168542B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102234155B1 (en) 2018-08-31 2021-03-30 주식회사 엘지화학 System and method for correcting current value of shunt resistor
US11741356B2 (en) * 2019-02-08 2023-08-29 Korea Advanced Institute Of Science & Technology Data processing apparatus by learning of neural network, data processing method by learning of neural network, and recording medium recording the data processing method
KR102331242B1 (en) * 2019-05-20 2021-11-25 에스케이텔레콤 주식회사 Memory network apparatus and deducing method using the same
CN110781690B (en) * 2019-10-31 2021-07-13 北京理工大学 Fusion and compression method of multi-source neural machine translation model
KR20210098247A (en) 2020-01-31 2021-08-10 삼성전자주식회사 Electronic device and operating method for the same
CN111597825B (en) * 2020-05-13 2021-07-23 北京字节跳动网络技术有限公司 Voice translation method and device, readable medium and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5410355B2 (en) * 2010-04-13 2014-02-05 富士フイルム株式会社 Matrix generation apparatus, method, program, and information processing apparatus
US9728184B2 (en) * 2013-06-18 2017-08-08 Microsoft Technology Licensing, Llc Restructuring deep neural network acoustic models
KR102167719B1 (en) * 2014-12-08 2020-10-19 삼성전자주식회사 Method and apparatus for training language model, method and apparatus for recognizing speech
KR102305584B1 (en) * 2015-01-19 2021-09-27 삼성전자주식회사 Method and apparatus for training language model, method and apparatus for recognizing language
CN104636317A (en) * 2015-03-09 2015-05-20 湘潭大学 Method for optimizing interactive projection measurement matrix based on feature value decomposition
JP6628350B2 (en) * 2015-05-11 2020-01-08 国立研究開発法人情報通信研究機構 Method for learning recurrent neural network, computer program therefor, and speech recognition device
CN106407211B (en) * 2015-07-30 2019-08-06 富士通株式会社 The method and apparatus classified to the semantic relation of entity word

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
GEOFFREY HINTON ET AL: "Distilling the Knowledge in a Neural Network", CORR (ARXIV), vol. 1503.02531v1, 9 March 2015 (2015-03-09), pages 1 - 9, XP055549014 *
HAKAN INAN ET AL: "Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling", 4 November 2016 (2016-11-04), XP055657987, Retrieved from the Internet <URL:https://arxiv.org/pdf/1611.01462v2.pdf> [retrieved on 20200115] *
JIAN XUE ET AL: "Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition", PROC. INTERSPEECH 2013, 25 August 2013 (2013-08-25), Lyon, France, pages 2365 - 2369, XP055193450, Retrieved from the Internet <URL:http://www.isca-speech.org/archive/archive_papers/interspeech_2013/i13_2365.pdf> [retrieved on 20150603] *
OFIR PRESS ET AL: "Using the Output Embedding to Improve Language Models", PROCEEDINGS OF THE 15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: VOLUME 2, SHORT PAPERS, 21 February 2017 (2017-02-21), Stroudsburg, PA, USA, pages 157 - 163, XP055657986, DOI: 10.18653/v1/E17-2025 *
PRABHAVALKAR ROHIT ET AL: "On the compression of recurrent neural networks with an application to LVCSR acoustic modeling for embedded speech recognition", 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), IEEE, 20 March 2016 (2016-03-20), pages 5970 - 5974, XP032901749, DOI: 10.1109/ICASSP.2016.7472823 *
SAINATH TARA N ET AL: "Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets", ICASSP, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING - PROCEEDINGS 1999 IEEE, IEEE, 26 May 2013 (2013-05-26), pages 6655 - 6659, XP032508392, ISSN: 1520-6149, ISBN: 978-0-7803-5041-0, [retrieved on 20131018], DOI: 10.1109/ICASSP.2013.6638949 *
See also references of WO2018164378A1 *

Also Published As

Publication number Publication date
CN110168542B (en) 2023-11-24
CN110168542A (en) 2019-08-23
KR20180103671A (en) 2018-09-19
EP3577571A1 (en) 2019-12-11
KR102488338B1 (en) 2023-01-13

Similar Documents

Publication Publication Date Title
EP3679492A4 (en) Methods and apparatus for efficiently implementing a fast-copyable database
EP3605352A4 (en) Short-link parsing method, apparatus and device
EP3623956A4 (en) Method and apparatus for obtaining recommendation information, and electronic device
EP3726476A4 (en) Object modeling movement method, apparatus and device
EP3683724A4 (en) Training method for image-text matching model, bidirectional search method, and related apparatus
EP3695597A4 (en) An apparatus, a method and a computer program for volumetric video
EP3577571A4 (en) Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof
EP3179473A4 (en) Training method and apparatus for language model, and device
AU2017310900C1 (en) Polar coding method, apparatus, and device
EP3579150A4 (en) Operation apparatus and method
EP3405947A4 (en) Method and apparatus for initiating an operation using voice data
EP3404556A4 (en) Information recommendation method and apparatus, and server
EP3346397A4 (en) Content recommendation method, apparatus and system
EP3726525A4 (en) Electronic device for analyzing meaning of speech, and operation method therefor
EP3351172A4 (en) Ear shape analysis method, ear shape analysis device, and method for generating ear shape model
EP3620940A4 (en) Dialogue generation method and apparatus, and electronic device
EP3819785A4 (en) Feature word determining method, apparatus, and server
EP3523726A4 (en) Database processing method, apparatus, and electronic device
EP3777319A4 (en) Apparatus, method and computer program
EP3523710A4 (en) Apparatus and method for providing sentence based on user input
EP3718032A4 (en) Customization method and apparatus
EP3539056A4 (en) Electronic apparatus and operation method thereof
EP3739571A4 (en) Speech synthesis method, speech synthesis device, and program
EP3732653A4 (en) An apparatus, a method and a computer program for volumetric video
EP3667517A4 (en) Natural language processing method and apparatus

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190904

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20200127

RIC1 Information provided on ipc code assigned before grant

Ipc: G06N 5/02 20060101ALI20200121BHEP

Ipc: G06F 17/16 20060101AFI20200121BHEP

Ipc: G06N 3/08 20060101ALI20200121BHEP

Ipc: G06F 40/284 20200101ALI20200121BHEP

Ipc: G06F 40/274 20200101ALI20200121BHEP

Ipc: G06N 3/04 20060101ALI20200121BHEP

Ipc: G06F 40/216 20200101ALI20200121BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20201209

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20230324