CN108369484B - 引导手写图输入的系统和方法 - Google Patents

引导手写图输入的系统和方法 Download PDF

Info

Publication number
CN108369484B
CN108369484B CN201680074443.2A CN201680074443A CN108369484B CN 108369484 B CN108369484 B CN 108369484B CN 201680074443 A CN201680074443 A CN 201680074443A CN 108369484 B CN108369484 B CN 108369484B
Authority
CN
China
Prior art keywords
text
hand
drawn
input
readable medium
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680074443.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN108369484A (zh
Inventor
罗宾·梅利南
罗曼·贝纳尔维茨
克莱尔·西多里
法比恩·里克
尼古拉斯·鲁西内
埃尔万·热斯坦
安东尼·劳伦斯
阿内·博诺
哈奥拉·埃拉古尼
西里尔·塞洛维奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Maxwell AG
Original Assignee
Maxwell AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Maxwell AG filed Critical Maxwell AG
Publication of CN108369484A publication Critical patent/CN108369484A/zh
Application granted granted Critical
Publication of CN108369484B publication Critical patent/CN108369484B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/171—Editing, e.g. inserting or deleting by use of digital ink
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G06V30/36—Matching; Classification
    • G06V30/387—Matching; Classification using human interaction, e.g. selection of the best displayed recognition candidate
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Discrimination (AREA)
CN201680074443.2A 2015-10-19 2016-10-18 引导手写图输入的系统和方法 Active CN108369484B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP15290270.6 2015-10-19
EP15290270 2015-10-19
US14/955,198 2015-12-01
US14/955,198 US10976918B2 (en) 2015-10-19 2015-12-01 System and method of guiding handwriting diagram input
PCT/EP2016/001723 WO2017067654A1 (en) 2015-10-19 2016-10-18 System and method of guiding handwriting diagram input

Publications (2)

Publication Number Publication Date
CN108369484A CN108369484A (zh) 2018-08-03
CN108369484B true CN108369484B (zh) 2021-07-27

Family

ID=54396796

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680074443.2A Active CN108369484B (zh) 2015-10-19 2016-10-18 引导手写图输入的系统和方法

Country Status (6)

Country Link
US (2) US10976918B2 (enExample)
EP (1) EP3365765B1 (enExample)
JP (1) JP7065023B2 (enExample)
KR (1) KR102392537B1 (enExample)
CN (1) CN108369484B (enExample)
WO (1) WO2017067654A1 (enExample)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8924335B1 (en) 2006-03-30 2014-12-30 Pegasystems Inc. Rule-based user interface conformance methods
US10469396B2 (en) 2014-10-10 2019-11-05 Pegasystems, Inc. Event processing with enhanced throughput
US11500535B2 (en) * 2015-10-29 2022-11-15 Lenovo (Singapore) Pte. Ltd. Two stroke quick input selection
US10698599B2 (en) * 2016-06-03 2020-06-30 Pegasystems, Inc. Connecting graphical shapes using gestures
US10402740B2 (en) * 2016-07-29 2019-09-03 Sap Se Natural interactive user interface using artificial intelligence and freeform input
JP6798555B2 (ja) * 2016-08-19 2020-12-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
CN114675774B (zh) 2016-09-23 2024-12-06 苹果公司 用于对文本进行注释的设备、方法和图形用户界面
US10970476B2 (en) * 2017-05-17 2021-04-06 Microsoft Technology Licensing, Llc Augmenting digital ink strokes
EP3593236B1 (en) 2017-06-02 2024-10-23 Apple Inc. Device, method, and graphical user interface for annotating content
US10679049B2 (en) * 2017-09-29 2020-06-09 Konica Minolta Laboratory U.S.A., Inc. Identifying hand drawn tables
US10761719B2 (en) * 2017-11-09 2020-09-01 Microsoft Technology Licensing, Llc User interface code generation based on free-hand input
US11023055B2 (en) 2018-06-01 2021-06-01 Apple Inc. Devices, methods, and graphical user interfaces for an electronic device interacting with a stylus
US11048488B2 (en) 2018-08-14 2021-06-29 Pegasystems, Inc. Software code optimizer and method
US11392659B2 (en) * 2019-02-28 2022-07-19 Adobe Inc. Utilizing machine learning models to generate experience driven search results based on digital canvas gesture inputs
CN114564113B (zh) 2019-05-06 2024-09-20 苹果公司 电子设备上的手写输入
EP3754537B1 (en) * 2019-06-20 2024-05-22 MyScript Processing text handwriting input in a free handwriting mode
EP3772015B1 (en) * 2019-07-31 2023-11-08 MyScript Text line extraction
JP6992795B2 (ja) * 2019-11-28 2022-01-13 ブラザー工業株式会社 図表作成プログラム、および図表作成機能を有する情報処理装置
US12393329B2 (en) * 2020-05-11 2025-08-19 Apple Inc. Interacting with handwritten content on an electronic device
US11567945B1 (en) 2020-08-27 2023-01-31 Pegasystems Inc. Customized digital content generation systems and methods
US11733861B2 (en) * 2020-11-20 2023-08-22 Trimble Inc. Interpreting inputs for three-dimensional virtual spaces from touchscreen interface gestures to improve user interface functionality
CN112711362B (zh) * 2020-12-24 2022-02-18 北京华宇信息技术有限公司 手绘流程图标准化生成方法及其装置
US12002134B2 (en) * 2021-01-08 2024-06-04 PwC Product Sales LLC Automated flow chart generation and visualization system
JP2022143788A (ja) * 2021-03-18 2022-10-03 株式会社リコー 表示装置、表示方法、プログラム
US11663761B2 (en) * 2021-08-25 2023-05-30 Sap Se Hand-drawn diagram recognition using visual arrow-relation detection
US12277308B2 (en) 2022-05-10 2025-04-15 Apple Inc. Interactions between an input device and an electronic device
AU2023201533B1 (en) * 2023-03-13 2024-04-18 Canva Pty Ltd Systems and methods for recognising hand-drawn shapes
CN116311261A (zh) * 2023-03-17 2023-06-23 重庆邮电大学 一种手绘括号图识别方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103399698A (zh) * 2013-07-31 2013-11-20 中国船舶重工集团公司第七〇九研究所 一种基于手绘草图和手势输入判断处理的笔式交互方法
CN104317421A (zh) * 2014-10-21 2015-01-28 苏州乐聚一堂电子科技有限公司 按键手写手机汉字输入法
CN104794107A (zh) * 2015-02-16 2015-07-22 北京道明科技有限公司 手写笔迹的编辑方法

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2749020B2 (ja) 1991-11-14 1998-05-13 日立ソフトウエアエンジニアリング株式会社 ダイアグラム認識システム
JP3388524B2 (ja) 1994-06-30 2003-03-24 カシオ計算機株式会社 イメージ入力装置
US20030215145A1 (en) 2002-05-14 2003-11-20 Microsoft Corporation Classification analysis of freeform digital ink input
US7079713B2 (en) * 2002-06-28 2006-07-18 Microsoft Corporation Method and system for displaying and linking ink objects with recognized text and objects
US20040090439A1 (en) * 2002-11-07 2004-05-13 Holger Dillner Recognition and interpretation of graphical and diagrammatic representations
US7848573B2 (en) * 2003-12-03 2010-12-07 Microsoft Corporation Scaled text replacement of ink
US20050273761A1 (en) 2004-06-07 2005-12-08 The Mathworks, Inc. Freehand system and method for creating, editing, and manipulating block diagrams
US7929767B2 (en) 2004-09-22 2011-04-19 Microsoft Corporation Analyzing subordinate sub-expressions in expression recognition
US7512273B2 (en) * 2004-10-21 2009-03-31 Microsoft Corporation Digital ink labeling
US7725493B2 (en) * 2007-03-23 2010-05-25 Palo Alto Research Center Incorporated Optimization method and process using tree searching operation and non-overlapping support constraint requirements
US8014607B2 (en) 2007-03-23 2011-09-06 Palo Alto Research Center Incorporated Method and apparatus for creating and editing node-link diagrams in pen computing systems
US8116570B2 (en) 2007-04-19 2012-02-14 Microsoft Corporation User interface for providing digital ink input and correcting recognition errors
US20100171754A1 (en) * 2009-01-07 2010-07-08 Microsoft Corporation Converting digital ink to shapes and text
US8718375B2 (en) * 2010-12-03 2014-05-06 Massachusetts Institute Of Technology Sketch recognition system
CN102750552B (zh) * 2012-06-18 2015-07-22 北京捷通华声语音技术有限公司 一种手写识别方法、系统及手写识别终端
KR101929301B1 (ko) * 2012-08-20 2019-03-12 삼성전자 주식회사 필기 제스처 인식을 통한 휴대단말의 기능 실행 제어 방법 및 장치
JP5342052B1 (ja) 2012-10-17 2013-11-13 株式会社東芝 電子機器および方法
JP2014081818A (ja) 2012-10-17 2014-05-08 Toshiba Tec Corp 商品販売データ処理装置および携帯端末
US9329726B2 (en) * 2012-10-26 2016-05-03 Qualcomm Incorporated System and method for capturing editable handwriting on a display
JP5377743B1 (ja) 2012-11-28 2013-12-25 株式会社東芝 電子機器および手書き文書処理方法
US20140210829A1 (en) * 2013-01-31 2014-07-31 Kabushiki Kaisha Toshiba Electronic apparatus and handwritten document processing method
WO2015087379A1 (ja) 2013-12-09 2015-06-18 株式会社 東芝 手書き文書情報を処理するための電子機器および方法
JP2015138494A (ja) * 2014-01-24 2015-07-30 株式会社東芝 電子機器および方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103399698A (zh) * 2013-07-31 2013-11-20 中国船舶重工集团公司第七〇九研究所 一种基于手绘草图和手势输入判断处理的笔式交互方法
CN104317421A (zh) * 2014-10-21 2015-01-28 苏州乐聚一堂电子科技有限公司 按键手写手机汉字输入法
CN104794107A (zh) * 2015-02-16 2015-07-22 北京道明科技有限公司 手写笔迹的编辑方法

Also Published As

Publication number Publication date
CN108369484A (zh) 2018-08-03
JP2018536926A (ja) 2018-12-13
KR102392537B1 (ko) 2022-04-28
WO2017067654A1 (en) 2017-04-27
US20170109032A1 (en) 2017-04-20
KR20180096590A (ko) 2018-08-29
US20210278965A1 (en) 2021-09-09
EP3365765A1 (en) 2018-08-29
US10976918B2 (en) 2021-04-13
US11740783B2 (en) 2023-08-29
JP7065023B2 (ja) 2022-05-11
EP3365765B1 (en) 2022-01-19

Similar Documents

Publication Publication Date Title
CN108369484B (zh) 引导手写图输入的系统和方法
US11157732B2 (en) System and method of handwriting recognition in diagrams
US11402991B2 (en) System and method for note taking with gestures
CN108700994B (zh) 用于数字墨水交互性的系统和方法
CN114365075B (zh) 用于选择图形对象的方法和对应装置
US20180114059A1 (en) System and method for managing digital ink typesetting
US11687618B2 (en) System and method for processing text handwriting in a free handwriting mode
JP2018536928A (ja) 手書きされた図コネクタの認識のためのシステム及び方法
CN108369637A (zh) 用于美化数字墨水的系统和方法
US11429259B2 (en) System and method for selecting and editing handwriting input elements
US20240231582A9 (en) Modifying digital content including typed and handwritten text
US12307189B2 (en) Completing typeset characters using handwritten strokes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant