EP2381347B1 - Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm - Google Patents

Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm Download PDF

Info

Publication number
EP2381347B1
EP2381347B1 EP10004407.2A EP10004407A EP2381347B1 EP 2381347 B1 EP2381347 B1 EP 2381347B1 EP 10004407 A EP10004407 A EP 10004407A EP 2381347 B1 EP2381347 B1 EP 2381347B1
Authority
EP
European Patent Office
Prior art keywords
shape
touch screen
touch
user
automatically
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10004407.2A
Other languages
English (en)
French (fr)
Other versions
EP2381347A1 (de
Inventor
Fredrik Johansson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Mobile Communications Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Mobile Communications Inc filed Critical Sony Mobile Communications Inc
Priority to EP10004407.2A priority Critical patent/EP2381347B1/de
Priority to US13/090,900 priority patent/US20110267353A1/en
Publication of EP2381347A1 publication Critical patent/EP2381347A1/de
Application granted granted Critical
Publication of EP2381347B1 publication Critical patent/EP2381347B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Definitions

  • This invention relates to a method and a device for displaying an object having a predetermined information content on a touch screen.
  • a growing number of applications can be performed on these mobile devices.
  • One of these applications is for example creating a layout of a page, for example for an email, a document, a report, a photo album or an internet page.
  • the layout of such a page comprises several different objects, for example text, pictures, a video or an icon representing another object, for example a sound, which have to be arranged on the page.
  • an arrangement or layouting is performed for example by first selecting an object, for example adding an image or a text, and then adjusting and positioning this object and its layout properties.
  • US 2004/0119762 A1 relates to a method of free form pasting. At least one displayed content indicated by a user is selected and a location specified by a free form user input is determined. The selected content is pasted at the specified location in accordance with the free form user input.
  • US 2006/0073862 A1 relates to an image generation system.
  • This system comprises a shape recognition section which performs processing of matching an input shape input by a player using a touch panel display against a shape pattern provided in advance to recognize the input shape input by the player.
  • the shape recognition section calculates the similarity between angle data of the input shape and angle data of the shape pattern.
  • the shape recognition section determines that the input shape matches the specific shape pattern.
  • US 5,742,280 A relates to a handwritten graphic form inputting apparatus.
  • a graphic form relation determination device determines the correlation between the inputted graphic form inputted and graphic form candidates.
  • the graphic form determination device determines a most likely graphic form candidate from among the graphic form candidates in accordance with a result of a determination from the graphic form relation determination device.
  • EP 0 451 485 A2 relates to a form authoring toolkit for on-screen form design and filling on an interactive display.
  • a designer mode on-screen forms are created and in a user mode a user may fill information in corresponding form entries on the interactive display.
  • US 2007/180400 relates to the launching of an application inside a user-defined area on a touch screen.
  • this object is achieved by a method for displaying an object having a predetermined information content on the touch screen as defined in claim 1 and a device as defined in claim 8.
  • a method for displaying an object on a touch screen is provided.
  • the object is an object having a predetermined information content which has to be displayed on the touch screen.
  • a touch pattern of a user touching the touch screen is detected and based on the detected touch pattern a shape from a predetermined set of shapes is automatically selected.
  • the object to be displayed is adapted automatically to the selected shape and the adapted object having the selected shape is displayed on the touch screen at a position where the touch pattern was detected.
  • an object to be arranged on a screen for example a picture or a text
  • layouting is performed in a reversed approach by enabling the user to first select the coarse shape and position of the object to be displayed. Then, based on the touch pattern of the coarse shape an accurate shape, for example a circle, a rectangle or a square, is automatically selected. Then, the object to be displayed is automatically adapted to the selected shape and positioned on the touch screen at the position where the touch pattern was detected. This simplifies the layout process significantly as the user just has to provide the coarse shape for the object and the object is then automatically adapted and displayed according to this coarse specification.
  • the step of automatically selecting the shape from the predetermined set of shapes is performed by automatically selecting the shape from the predetermined set of shapes based on a best matching between the shape and the touch pattern. Therefore, different predetermined shapes can be used and can be intuitively accessed by the user.
  • the shape is automatically selected when a touch of the touch screen by the user is no longer detected. This may help to simplify the work flow of the layout process significantly.
  • the user wants to display an object on the touch screen, the user simply touches the screen and describes by moving a finger on the touch screen the coarse layout of the object to be displayed. Then the user lifts the finger from the touch screen and based on the previously made touch pattern a desired shape is automatically selected from the predetermined set of shapes.
  • a selecting box providing a selection for the object to be displayed in the automatically selected shape may be opened automatically to give the user the opportunity to select the object for the previously described shape. Then the selected object is automatically adapted to the selected shape and displayed on the touch screen as described above.
  • the selected shape When adapting the object to the selected shape, the selected shape is adapted to a size and an orientation according to the touch pattern and the adapted shape is automatically displayed as a placeholder having the adapted shape on the touch screen at the position where the touch pattern was detected.
  • the object to be displayed is then adapted to the shape.
  • the predetermined set of shapes may comprise for example a square, a rectangle, a circle, a polygon, and a rectangular polygon. However, each of these shapes may be varied in size and rotation. Therefore, the basic shapes are automatically adapted to the size and orientation according to the touch pattern provided by the user.
  • the user gets a direct feedback of the designed shape and may redraw the shape, resize the shape, or change the orientation of the shape before selecting and automatically adapting the object to be displayed to the adapted shape.
  • the object is automatically adapted to the adapted shape such that the object is displayed within the placeholder on the touch screen.
  • This may comprise further steps, for example resizing the object, rotating the object or trimming the object.
  • a type of the object is selected by the user from a plurality of available object types.
  • the information content of the object may be selected by the user from a plurality of available information contents.
  • the type of the object may comprise for example a text, a picture, a video or a sound.
  • the sound may be represented by an icon to be displayed in the layout representing the sound. Therefore, a layout of a page, for example for an email, an internet page or a photo album, can be designed and layout very easy and a lot of different objects can be arranged.
  • a device comprising a touch screen and a processing unit.
  • the touch screen is adapted to display an object having a predetermined information content on the touch screen and to detect a touch pattern of a user touching the touch screen.
  • the processing unit is adapted to select automatically a shape from a predetermined set of shapes based on the touch pattern, to adapt automatically the object to the selected shape, and to display the adapted object having the selected shape on the touch screen at a position where the touch pattern was detected.
  • the device may be adapted to perform the above-described method and comprises therefore the above-described advantages.
  • the device may be for example a mobile phone, a personal digital assistant, a mobile navigation system, a mobile media player or a mobile computer.
  • Fig. 1A shows a mobile device 1 comprising a touch screen 2 and a processing unit 3.
  • the processing unit 3 is inside the mobile device 1 and therefore shown with dashed lines.
  • the processing unit 3 is coupled to the touch screen 2.
  • the mobile device 1 comprises furthermore some press buttons 4 and may comprise some more components or elements (not shown), for example a battery, a microphone, a loudspeaker, a radio frequency receiver and transmitter and so on. However, these additional components or elements are not shown to simplify matters.
  • the touch screen 2 is adapted to display text and graphics. Furthermore, the touch screen is adapted to detect a touch pattern of a user touching the touch screen 2. The user may touch the touch screen 2 with a finger of the user or a stylus, for example a pen.
  • the touch screen 2 is coupled to the processing unit 3 and the processing unit 3 is adapted to receive the touch pattern detected by the touch screen 2 and to provide information to the touch screen 2 for displaying graphical or textual objects.
  • the processing unit 3 When the processing unit 3 is in a mode for designing a layout of a page, for example of a page of an email, a photo album or a report, the processing unit 3 displays initially for example a blank page on the touch screen 2. When the user wants to place and display an object on the page, the user simply has to touch the touch screen 2 and coarsely define a shape the object shall have on the page.
  • the processing unit 3 displays a default placeholder of a square with no rotation. This is shown in Figs. 1A and 1B .
  • Fig. 1A the user touches the touch screen 2 at the touch position 5.
  • the processing unit 3 analyzes the touch pattern which is in this case a simple touch at one point of the touch screen 2.
  • a predefined default shape of a square 6 is presented around the touching point 5 as shown in Fig. 1B .
  • Fig. 1B the user wants to add a square-shaped object.
  • a selection box 7 is presented to the user on the touch screen 2 giving the user the selection to add an object of a specific type, for example a text, a picture, a video or a sound.
  • the selection box 7 may be automatically displayed after the square-shaped placeholder is displayed on the touch screen 2 or may be displayed in response to the user touching the placeholder square 6.
  • the user selects for example "add text” and in another step (not shown) the user may enter a text or select an object containing text content stored in the mobile device 1.
  • the processing unit 3 adapts the text to the shape of the square 6.
  • Adapting the text to the shape 6 may for example comprise a resizing of the text or reformatting of the text.
  • Fig. 1D shows the result of the adapted text 8 displayed on the touch screen 2.
  • Figs. 2A - 2E show an embodiment of arranging an object on the touch screen 2.
  • the user touches the touch screen 2 at touching point 5 and describes coarsely a circumferential line 9 of a rotated rectangle by moving the user's finger on the touch screen 2.
  • the processing unit 3 analyzes the touch pattern 9 of the coarsely described rectangle 9 and automatically selects a shape from a predetermined set of shapes based on the touch pattern 9 and a best matching of the touch pattern 9 to one of the shapes from the predetermined set of shapes.
  • the predetermined set of shapes may comprise for example a rectangle, a circle, a polygon and a rectangular polygon. In this case, a rectangle is identified. Furthermore, a rotation angle of the rectangle is identified.
  • a center point of the rectangle is automatically determined.
  • the processing unit 3 displays a placeholder 10 in form of a rotated rectangle around a center point 11.
  • a selection box is displayed to the user for selecting the type of object to be inserted into the placeholder 10.
  • the user may for example select a text 12 content to be inserted into the placeholder 10.
  • the text 12 is rotated according to the rotation angle of the shape 10.
  • the text 12 may be adapted in size to match into the placeholder 10, or the placeholder 10 may be expanded automatically, e.g.
  • a picture 13 as the content to be inserted into the placeholder 10.
  • Fig. 2E shows the result.
  • the picture 13 is also rotated according to the rotation of the placeholder 10 and additionally the picture 13 is resized to fit into the shape 10. If necessary, the picture 13 is also trimmed to the size of the placeholder 10.
  • Figs. 3A - 3E show another example of another kind of shape for an object the user wants to display on the touch screen 2.
  • the user draws coarsely a circle where the user wants to place an object in a circle form. Starting from touching point 5 the user describes coarsely a circle 14.
  • the processing unit 3 automatically selects a circle shape 15 from the predetermined set of shapes and adapts the shape to the size and position of the coarsely drawn circle 14 from the user.
  • the result is shown in Fig. 3B as a placeholder 15 having a circular shape.
  • the user may add a text, a picture, a video or a sound to the placeholder 15.
  • a text 16 is added to the placeholder 15 to the placeholder 15
  • the result is shown in Fig. 3D .
  • the text 16 is rearranged such that the text 16 is displayed within the placeholder 15 on the touch screen 2. Therefore, a new word wrapping of the text 16 may be necessary, or the text 16 may be adapted to the placeholder 15 by other visual effects, for example a fish eye lens effect or other circular alignment effects.
  • the user may select to add a picture 17 as shown in Fig. 3E .
  • the picture 17 is automatically adapted by the processing unit 3 to the shape 15 such that the picture 17 is displayed within the placeholder 15 on the touch screen 2.
  • Figs. 4A - 4C show another example of adding objects to a layout on the touch screen 2.
  • the user defines three layout elements coarsely as placeholders for three different objects.
  • the user describes a rectangular 18, then the user describes a polygon 19, and then the user describes a rectangular 20.
  • the processing unit 3 selects an appropriate shape from a predetermined set of shapes, in this case a rectangular 21 corresponding to the user's rectangular 18, a polygon 22 corresponding to the user's polygon 19, and a rectangular 23 corresponding to the user's rectangular 20.
  • the rectangulars 21 and 23 and the polygon 22 are adapted in size and position to the touching patterns 18-20 provided by the user and are displayed as placeholders 21-23 on the touch screen 2 as shown in Fig. 4B .
  • objects are added to each of the placeholders 21-23. This may be accomplished by touching sequentially each of the placeholders 21-23 and selecting for each of the placeholders 21-23 a corresponding object, or the objects may be selected immediately after the user has coarsely defined the shape of each of the placeholders.
  • the objects are adapted automatically by the processing unit 3 to the placeholder shapes 21-23.
  • Fig. 4C shows the result. A picture 24 was added to placeholder 21, a text 25 was added to placeholder 22, and another picture 26 was added to placeholder 23.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Claims (9)

  1. Verfahren zum Anzeigen eines Objekts, welches einen vorgegebenen Informationsinhalt aufweist, auf einem Berührungsbildschirm, wobei das Verfahren die Schritte umfasst:
    - Erfassen eines Berührungsmusters (5; 9; 14; 18-20) eines Benutzers, welcher den Berührungsbildschirm (2) berührt,
    - automatisches Auswählen einer Form (6; 10; 15; 21-23) aus einer vorgegebenen Gruppe von Formen basierend auf dem Berührungsmuster (5; 9; 14; 18-20),
    - automatisches Anpassen der ausgewählten Form (6; 10; 15; 21-23) auf eine Größe und Ausrichtung gemäß dem Berührungsmuster (5; 9; 14; 18-20),
    - automatisches Anzeigen eines Platzhalters (6; 10; 15; 21-23), welcher die angepasste Form (6; 10; 15; 21-23) aufweist, auf dem Berührungsbildschirm (2) an der Position, wo das Berührungsmuster (5; 9; 14; 18-20) erfasst wurde,
    - Anpassen des anzuzeigenden Objekts (8; 12, 13; 16, 17; 24-26) an die angepasste Form (6; 10; 15; 21-23), und
    - Anzeigen des angepassten Objekts (8; 12, 13; 16, 17; 24-26), welches die ausgewählte Form (6; 10; 15; 21-23) aufweist, auf dem Berührungsbildschirm (2) an der Position, wo das Berührungsmuster (5; 9; 14; 18-20) erfasst wurde.
  2. Verfahren nach Anspruch 1, wobei der Schritt des automatischen Auswählens der Form (6; 10; 15; 21-23) aus der vorgegebenen Gruppe von Formen ein automatisches Auswählen der Form (6; 10; 15; 21-23) aus der vorgegebenen Gruppe von Formen basierend auf einer besten Übereinstimmung zwischen der Form (6; 10; 15; 21-23) und dem Berührungsmuster (5; 9; 14; 18-20) umfasst.
  3. Verfahren nach Anspruch 1 oder 2, wobei die Form (6; 10; 15; 21-23) automatisch ausgewählt wird, wenn eine Berührung des Berührungsbildschirms (2) durch den Benutzer nicht mehr erfasst wird.
  4. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Objekt (8; 12, 13; 16, 17; 24-26) automatisch an die angepasste Form (6; 10; 15; 21-23) derart angepasst wird, dass in dem Schritt des Anzeigens des Objekts (8; 12, 13; 16, 17; 24-26) das Objekt (8; 12, 13; 16, 17; 24-26) innerhalb des Platzhalters (6; 10; 15; 21-23) auf dem Berührungsbildschirm (2) angezeigt wird.
  5. Verfahren nach einem der vorhergehenden Ansprüche, ferner umfassend einen Schritt eines Auswählens eines Typs des Objekts (8; 12, 13; 16, 17; 24-26) und/oder des Informationsinhalts des Objekts (8; 12, 13; 16, 17; 24-26) durch den Benutzer aus mehreren verfügbaren Objekttypen bzw. Informationsinhalten.
  6. Verfahren nach Anspruch 5, wobei der Typ des Objekts (8; 12, 13; 16, 17; 24-26) einen Typ umfasst, welcher aus der Gruppe ausgewählt ist, welche Text (8; 12; 16; 25), ein Bild (13; 17; 24, 26), ein Video und einen Ton umfasst.
  7. Verfahren nach einem der vorhergehenden Ansprüche, wobei die vorgegebene Gruppe von Formen Formen umfasst, welche aus der Gruppe ausgewählt sind, welche ein Quadrat (6), ein Rechteck (11; 21, 23), einen Kreis (15), ein Polygon und ein rechteckiges Polygon (22) umfasst.
  8. Vorrichtung umfassend:
    einen Berührungsbildschirm (2), welcher ausgestaltet ist, ein Objekt (8; 12, 13; 16, 17; 24-26) mit einem vorgegebenen Informationsinhalt darauf anzuzeigen und ein Berührungsmuster (5; 9; 14; 18-20) von einer Benutzerberührung des Berührungsbildschirms (2) zu erfassen, und
    eine Verarbeitungseinheit (3), welche ausgestaltet ist,
    - automatisch eine Form (6; 10; 15; 21-23) aus einer vorgegebenen Gruppe von Formen basierend auf dem Berührungsmuster (5; 9; 14; 18-20) auszuwählen,
    - die ausgewählte Form (6; 10; 15; 21-23) auf eine Größe und Ausrichtung gemäß dem Berührungsmuster (5; 9; 14; 18-20) anzupassen,
    - einen Platzhalter (6; 10; 15; 21-23), welcher die angepasste Form (6; 10; 15; 21-23) aufweist, auf dem Berührungsbildschirm (2) an der Position, wo das Berührungsmuster (5; 9; 14; 18-20) erfasst wurde, anzuzeigen,
    - das anzuzeigende Objekt (8; 12, 13; 16, 17; 24-26) an die angepasste Form (6; 10; 15; 21-23) anzupassen, und
    - das angepasste Objekt (8; 12, 13; 16, 17; 24-26), welches die ausgewählte Form (6; 10; 15; 21-23) aufweist, auf dem Berührungsbildschirm (2) an der Position anzuzeigen, wo das Berührungsmuster (5; 9; 14; 18-20) erfasst wurde.
  9. Vorrichtung nach Anspruch 8, wobei die Vorrichtung (1) eine Vorrichtung umfasst, welche ausgewählt ist aus der Gruppe, welche ein Mobilfunktelefon, einen persönlichen digitalen Assistenten, ein mobiles Navigationssystem, eine mobile Medienabspielvorrichtung und einen mobilen Computer umfasst.
EP10004407.2A 2010-04-26 2010-04-26 Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm Active EP2381347B1 (de)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP10004407.2A EP2381347B1 (de) 2010-04-26 2010-04-26 Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm
US13/090,900 US20110267353A1 (en) 2010-04-26 2011-04-20 Method of Displaying an Object Having a Predetermined Information Content on a Touch Screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP10004407.2A EP2381347B1 (de) 2010-04-26 2010-04-26 Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm

Publications (2)

Publication Number Publication Date
EP2381347A1 EP2381347A1 (de) 2011-10-26
EP2381347B1 true EP2381347B1 (de) 2018-07-11

Family

ID=43005653

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10004407.2A Active EP2381347B1 (de) 2010-04-26 2010-04-26 Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm

Country Status (2)

Country Link
US (1) US20110267353A1 (de)
EP (1) EP2381347B1 (de)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130207901A1 (en) * 2012-02-10 2013-08-15 Nokia Corporation Virtual Created Input Object
CN102799367B (zh) * 2012-06-29 2015-05-13 鸿富锦精密工业（深圳）有限公司 电子设备及其触摸控制方法
KR20140108995A (ko) * 2013-03-04 2014-09-15 삼성전자주식회사 페이지의 일부 영역을 이용한 데이터 처리 방법 및 장치
US9639199B2 (en) 2013-06-07 2017-05-02 Samsung Electronics Co., Ltd. Method and device for controlling a user interface
EP2879047A3 (de) * 2013-11-28 2015-12-16 LG Electronics Inc. Mobiles Endgerät und Steuerungsverfahren dafür
CN104951234B (zh) * 2015-06-26 2018-03-27 语联网（武汉）信息技术有限公司 一种基于触屏终端的数据处理方法及系统
US20180329597A1 (en) 2017-05-15 2018-11-15 Microsoft Technology Licensing, Llc Ink Anchoring
US10318109B2 (en) 2017-06-09 2019-06-11 Microsoft Technology Licensing, Llc Emoji suggester and adapted user interface

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0451485A2 (de) * 1990-04-11 1991-10-16 International Business Machines Corporation Ein Werkzeugsatz zum Entwurf von Formularen
US5742280A (en) * 1993-12-28 1998-04-21 Nec Corporation Hand-written graphic form inputting apparatus
US20070180400A1 (en) * 2006-01-30 2007-08-02 Microsoft Corporation Controlling application windows in an operating systm

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2124505C (en) * 1993-07-21 2000-01-04 William A. S. Buxton User interface having simultaneously movable tools and cursor
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US6081816A (en) * 1998-03-18 2000-06-27 Microsoft Corporation Method for placing text around polygons and other constraints
US20040119762A1 (en) * 2002-12-24 2004-06-24 Fuji Xerox Co., Ltd. Systems and methods for freeform pasting
US20050034083A1 (en) * 2003-08-05 2005-02-10 Denny Jaeger Intuitive graphic user interface with universal tools
JP4610988B2 (ja) * 2004-09-30 2011-01-12 株式会社バンダイナムコゲームス プログラム、情報記憶媒体及び画像生成システム
US8161379B2 (en) * 2008-06-20 2012-04-17 Microsoft Corporation Fit and fill techniques for pictures
EP2228711A3 (de) * 2009-03-12 2014-06-04 Lg Electronics Inc. Mobiles Endgerät und Verfahren zur Bereitstellung einer Benutzerschnittstelle dafür
KR101559178B1 (ko) * 2009-04-08 2015-10-12 엘지전자 주식회사 명령어 입력 방법 및 이를 적용한 이동 통신 단말기

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0451485A2 (de) * 1990-04-11 1991-10-16 International Business Machines Corporation Ein Werkzeugsatz zum Entwurf von Formularen
US5742280A (en) * 1993-12-28 1998-04-21 Nec Corporation Hand-written graphic form inputting apparatus
US20070180400A1 (en) * 2006-01-30 2007-08-02 Microsoft Corporation Controlling application windows in an operating systm

Also Published As

Publication number Publication date
EP2381347A1 (de) 2011-10-26
US20110267353A1 (en) 2011-11-03

Similar Documents

Publication Publication Date Title
EP2381347B1 (de) Verfahren zur anzeige eines objekts mit einem vorher festgelegten informationsinhalt auf einem berührungsbildschirm
US9753626B2 (en) Method and device for providing content
US9417784B2 (en) Multi display apparatus and method of controlling display operation
US11550993B2 (en) Ink experience for images
US10133438B2 (en) User interface for augmented reality
US9448715B2 (en) Grouping of related graphical interface panels for interaction with a computing device
CN107103013B (zh) 移动终端及其控制方法
US9747010B2 (en) Electronic content visual comparison apparatus and method
GB2498228A (en) Providing open instance of first application on first device as corresponding open instance of related application on second device
EP2677501A2 (de) Vorrichtung und Verfahren zur Änderung von Bildern in einer elektronischen Vorrichtung
US20120133650A1 (en) Method and apparatus for providing dictionary function in portable terminal
EP3910452A1 (de) Verfahren zur anzeige und elektronische vorrichtung damit
CN105577913B (zh) 移动终端及其控制方法
EP3001294B1 (de) Tragbares endgerät und verfahren zur steuerung davon
KR20160064925A (ko) 필기 입력 장치 및 그 제어 방법
KR20210056338A (ko) 이미지들에 대한 다중 영역 검출
WO2013084522A1 (ja) 表示装置、表示装置の制御方法、制御プログラム、および記録媒体
US20160132478A1 (en) Method of displaying memo and device therefor
JP2011086050A (ja) 情報処理端末及びコンピュータプログラム
US20120131450A1 (en) Apparatus and method for providing electronic book service
JP6070116B2 (ja) 画像処理装置、画像処理システム、画像処理方法及びプログラム
KR102077203B1 (ko) 전자 장치 및 그 제어 방법
US9542094B2 (en) Method and apparatus for providing layout based on handwriting input
KR20120134054A (ko) 사용자 주석 처리 장치 및 그를 위한 전자책 서비스 시스템 및 방법
JP2013020558A (ja) コンテンツデータ表示装置、コンテンツデータ表示方法及びプログラム

Legal Events

Date Code Title Description
AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA ME RS

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120323

17Q First examination report despatched

Effective date: 20130822

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602010051755

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06F0003048000

Ipc: G06F0003048800

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/0488 20130101AFI20180118BHEP

INTG Intention to grant announced

Effective date: 20180205

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SONY MOBILE COMMUNICATIONS INC.

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1017582

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180715

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010051755

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1017582

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180711

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181111

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181011

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181012

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181011

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

REG Reference to a national code

Ref country code: CH

Ref legal event code: PK

Free format text: BERICHTIGUNGEN

RIC2 Information provided on ipc code assigned after grant

Ipc: G06F 3/0488 20130101AFI20180118BHEP

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010051755

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

26N No opposition filed

Effective date: 20190412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190430

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190426

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100426

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180711

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230321

Year of fee payment: 14

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230527

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240320

Year of fee payment: 15