KR102392537B1 - 핸드라이팅 다이어그램 입력을 안내하는 시스템 및 방법 - Google Patents

핸드라이팅 다이어그램 입력을 안내하는 시스템 및 방법 Download PDF

Info

Publication number
KR102392537B1
KR102392537B1 KR1020187014271A KR20187014271A KR102392537B1 KR 102392537 B1 KR102392537 B1 KR 102392537B1 KR 1020187014271 A KR1020187014271 A KR 1020187014271A KR 20187014271 A KR20187014271 A KR 20187014271A KR 102392537 B1 KR102392537 B1 KR 102392537B1
Authority
KR
South Korea
Prior art keywords
text
hand
diagram element
prompter
shape
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020187014271A
Other languages
English (en)
Korean (ko)
Other versions
KR20180096590A (ko
Inventor
로뱅 멜리낭
로맹 베드나로비츠
끌레르 시돌리
파비앙 릭
니꼴라 뤼생
에르완 제스땡
앙또니 로랑스
안느 보노
카울라 엘라구니
시릴 세로빅
Original Assignee
마이스크립트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이스크립트 filed Critical 마이스크립트
Publication of KR20180096590A publication Critical patent/KR20180096590A/ko
Application granted granted Critical
Publication of KR102392537B1 publication Critical patent/KR102392537B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/171—Editing, e.g. inserting or deleting by use of digital ink
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G06V30/36—Matching; Classification
    • G06V30/387—Matching; Classification using human interaction, e.g. selection of the best displayed recognition candidate
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Discrimination (AREA)
KR1020187014271A 2015-10-19 2016-10-18 핸드라이팅 다이어그램 입력을 안내하는 시스템 및 방법 Active KR102392537B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP15290270 2015-10-19
EP15290270.6 2015-10-19
US14/955,198 2015-12-01
US14/955,198 US10976918B2 (en) 2015-10-19 2015-12-01 System and method of guiding handwriting diagram input
PCT/EP2016/001723 WO2017067654A1 (en) 2015-10-19 2016-10-18 System and method of guiding handwriting diagram input

Publications (2)

Publication Number Publication Date
KR20180096590A KR20180096590A (ko) 2018-08-29
KR102392537B1 true KR102392537B1 (ko) 2022-04-28

Family

ID=54396796

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187014271A Active KR102392537B1 (ko) 2015-10-19 2016-10-18 핸드라이팅 다이어그램 입력을 안내하는 시스템 및 방법

Country Status (6)

Country Link
US (2) US10976918B2 (https=)
EP (1) EP3365765B1 (https=)
JP (1) JP7065023B2 (https=)
KR (1) KR102392537B1 (https=)
CN (1) CN108369484B (https=)
WO (1) WO2017067654A1 (https=)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8924335B1 (en) 2006-03-30 2014-12-30 Pegasystems Inc. Rule-based user interface conformance methods
US10469396B2 (en) 2014-10-10 2019-11-05 Pegasystems, Inc. Event processing with enhanced throughput
US11500535B2 (en) * 2015-10-29 2022-11-15 Lenovo (Singapore) Pte. Ltd. Two stroke quick input selection
US10698599B2 (en) * 2016-06-03 2020-06-30 Pegasystems, Inc. Connecting graphical shapes using gestures
US10402740B2 (en) * 2016-07-29 2019-09-03 Sap Se Natural interactive user interface using artificial intelligence and freeform input
WO2018034052A1 (ja) * 2016-08-19 2018-02-22 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US10860788B2 (en) 2016-09-23 2020-12-08 Apple Inc. Device, method, and graphical user interface for annotating text
US10970476B2 (en) * 2017-05-17 2021-04-06 Microsoft Technology Licensing, Llc Augmenting digital ink strokes
EP3593236B1 (en) 2017-06-02 2024-10-23 Apple Inc. Device, method, and graphical user interface for annotating content
US10679049B2 (en) * 2017-09-29 2020-06-09 Konica Minolta Laboratory U.S.A., Inc. Identifying hand drawn tables
US10761719B2 (en) * 2017-11-09 2020-09-01 Microsoft Technology Licensing, Llc User interface code generation based on free-hand input
US12340034B2 (en) 2018-06-01 2025-06-24 Apple Inc. Devices, methods, and graphical user interfaces for an electronic device interacting with a stylus
US11048488B2 (en) 2018-08-14 2021-06-29 Pegasystems, Inc. Software code optimizer and method
US11392659B2 (en) * 2019-02-28 2022-07-19 Adobe Inc. Utilizing machine learning models to generate experience driven search results based on digital canvas gesture inputs
US12093523B2 (en) 2019-05-06 2024-09-17 Apple Inc. Handwriting entry on an electronic device
EP3754537B1 (en) * 2019-06-20 2024-05-22 MyScript Processing text handwriting input in a free handwriting mode
EP3772015B1 (en) * 2019-07-31 2023-11-08 MyScript Text line extraction
US20240331428A1 (en) * 2019-07-31 2024-10-03 Myscript Parallel processing of extracted elements
JP6992795B2 (ja) * 2019-11-28 2022-01-13 ブラザー工業株式会社 図表作成プログラム、および図表作成機能を有する情報処理装置
US11656758B2 (en) 2020-05-11 2023-05-23 Apple Inc. Interacting with handwritten content on an electronic device
US11567945B1 (en) 2020-08-27 2023-01-31 Pegasystems Inc. Customized digital content generation systems and methods
US11733861B2 (en) * 2020-11-20 2023-08-22 Trimble Inc. Interpreting inputs for three-dimensional virtual spaces from touchscreen interface gestures to improve user interface functionality
CN112711362B (zh) * 2020-12-24 2022-02-18 北京华宇信息技术有限公司 手绘流程图标准化生成方法及其装置
WO2022147780A1 (en) * 2021-01-08 2022-07-14 Pricewaterhousecoopers Llp Automated flow chart generation and visualization system
JP2022143788A (ja) * 2021-03-18 2022-10-03 株式会社リコー 表示装置、表示方法、プログラム
US11663761B2 (en) * 2021-08-25 2023-05-30 Sap Se Hand-drawn diagram recognition using visual arrow-relation detection
WO2023220165A1 (en) 2022-05-10 2023-11-16 Apple Inc. Interactions between an input device and an electronic device
AU2023201533B1 (en) * 2023-03-13 2024-04-18 Canva Pty Ltd Systems and methods for recognising hand-drawn shapes
KR20260015246A (ko) * 2023-06-29 2026-02-02 소니그룹주식회사 라인워크 생성에 대한 예술적 주도된 접근법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135678A1 (en) 2003-12-03 2005-06-23 Microsoft Corporation Scaled text replacement of ink
US20080235211A1 (en) 2007-03-23 2008-09-25 Palo Alto Research Center Incorporated Optimization method and process using tree searching operation and non-overlapping support constraint requirements
US20100171754A1 (en) 2009-01-07 2010-07-08 Microsoft Corporation Converting digital ink to shapes and text
JP2014081818A (ja) 2012-10-17 2014-05-08 Toshiba Tec Corp 商品販売データ処理装置および携帯端末

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2749020B2 (ja) 1991-11-14 1998-05-13 日立ソフトウエアエンジニアリング株式会社 ダイアグラム認識システム
JP3388524B2 (ja) 1994-06-30 2003-03-24 カシオ計算機株式会社 イメージ入力装置
US20030215145A1 (en) 2002-05-14 2003-11-20 Microsoft Corporation Classification analysis of freeform digital ink input
US7079713B2 (en) * 2002-06-28 2006-07-18 Microsoft Corporation Method and system for displaying and linking ink objects with recognized text and objects
US20040090439A1 (en) * 2002-11-07 2004-05-13 Holger Dillner Recognition and interpretation of graphical and diagrammatic representations
US20050273761A1 (en) 2004-06-07 2005-12-08 The Mathworks, Inc. Freehand system and method for creating, editing, and manipulating block diagrams
US7929767B2 (en) 2004-09-22 2011-04-19 Microsoft Corporation Analyzing subordinate sub-expressions in expression recognition
US7512273B2 (en) * 2004-10-21 2009-03-31 Microsoft Corporation Digital ink labeling
US8014607B2 (en) 2007-03-23 2011-09-06 Palo Alto Research Center Incorporated Method and apparatus for creating and editing node-link diagrams in pen computing systems
US8116570B2 (en) 2007-04-19 2012-02-14 Microsoft Corporation User interface for providing digital ink input and correcting recognition errors
US8718375B2 (en) * 2010-12-03 2014-05-06 Massachusetts Institute Of Technology Sketch recognition system
CN102750552B (zh) * 2012-06-18 2015-07-22 北京捷通华声语音技术有限公司 一种手写识别方法、系统及手写识别终端
KR101929301B1 (ko) * 2012-08-20 2019-03-12 삼성전자 주식회사 필기 제스처 인식을 통한 휴대단말의 기능 실행 제어 방법 및 장치
JP5342052B1 (ja) 2012-10-17 2013-11-13 株式会社東芝 電子機器および方法
US9329726B2 (en) * 2012-10-26 2016-05-03 Qualcomm Incorporated System and method for capturing editable handwriting on a display
JP5377743B1 (ja) 2012-11-28 2013-12-25 株式会社東芝 電子機器および手書き文書処理方法
US20140210829A1 (en) * 2013-01-31 2014-07-31 Kabushiki Kaisha Toshiba Electronic apparatus and handwritten document processing method
CN103399698B (zh) * 2013-07-31 2016-08-24 中国船舶重工集团公司第七0九研究所 一种基于手绘草图和手势输入判断处理的笔式交互方法
JP6054547B2 (ja) 2013-12-09 2016-12-27 株式会社東芝 手書き文書情報を処理するための電子機器および方法
JP2015138494A (ja) * 2014-01-24 2015-07-30 株式会社東芝 電子機器および方法
CN104317421A (zh) * 2014-10-21 2015-01-28 苏州乐聚一堂电子科技有限公司 按键手写手机汉字输入法
CN104794107A (zh) * 2015-02-16 2015-07-22 北京道明科技有限公司 手写笔迹的编辑方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135678A1 (en) 2003-12-03 2005-06-23 Microsoft Corporation Scaled text replacement of ink
US20080235211A1 (en) 2007-03-23 2008-09-25 Palo Alto Research Center Incorporated Optimization method and process using tree searching operation and non-overlapping support constraint requirements
US20100171754A1 (en) 2009-01-07 2010-07-08 Microsoft Corporation Converting digital ink to shapes and text
JP2014081818A (ja) 2012-10-17 2014-05-08 Toshiba Tec Corp 商品販売データ処理装置および携帯端末

Also Published As

Publication number Publication date
US20170109032A1 (en) 2017-04-20
WO2017067654A1 (en) 2017-04-27
KR20180096590A (ko) 2018-08-29
JP7065023B2 (ja) 2022-05-11
CN108369484B (zh) 2021-07-27
CN108369484A (zh) 2018-08-03
US11740783B2 (en) 2023-08-29
EP3365765B1 (en) 2022-01-19
JP2018536926A (ja) 2018-12-13
EP3365765A1 (en) 2018-08-29
US20210278965A1 (en) 2021-09-09
US10976918B2 (en) 2021-04-13

Similar Documents

Publication Publication Date Title
US11740783B2 (en) System and method of guiding handwriting diagram input
US11157732B2 (en) System and method of handwriting recognition in diagrams
EP3828687B1 (en) Apparatus and method for note taking with gestures
US11687618B2 (en) System and method for processing text handwriting in a free handwriting mode
EP3555736B1 (en) System and method for management of handwritten diagram connectors
KR102428704B1 (ko) 핸드라이팅된 다이어그램 커넥터들의 인식을 위한 시스템 및 방법
US11429259B2 (en) System and method for selecting and editing handwriting input elements
US20240231582A9 (en) Modifying digital content including typed and handwritten text

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

A201 Request for examination
A302 Request for accelerated examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-OTH-PR1001 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 4