WO1991009394A1 - Systeme orientationnel informatise de graphisme et coloriage - Google Patents

Systeme orientationnel informatise de graphisme et coloriage Download PDF

Info

Publication number
WO1991009394A1
WO1991009394A1 PCT/US1990/007130 US9007130W WO9109394A1 WO 1991009394 A1 WO1991009394 A1 WO 1991009394A1 US 9007130 W US9007130 W US 9007130W WO 9109394 A1 WO9109394 A1 WO 9109394A1
Authority
WO
WIPO (PCT)
Prior art keywords
graphics
draw
mouse
display screen
paint
Prior art date
Application number
PCT/US1990/007130
Other languages
English (en)
Inventor
J. Cambridge Vivien
Original Assignee
Automated Decisions, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Automated Decisions, Inc. filed Critical Automated Decisions, Inc.
Publication of WO1991009394A1 publication Critical patent/WO1991009394A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • G06F3/03544—Mice or pucks having dual sensing arrangement, e.g. two balls or two coils used to track rotation of the pointing device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/08—Cursor circuits

Definitions

  • the present invention relates to interactive information handling systems, and, more particularly, to a system for controlling computer display information, such as cursors, paintbrushes, pointers, pixel (digital) images, and graphics objects, by rotation and lateral movement of a handheld input device to edit or control the display information.
  • computer display information such as cursors, paintbrushes, pointers, pixel (digital) images, and graphics objects
  • Computer graphics paint and draw-graphics systems allow users to edit information on computer screens with "tools" which are controlled by manipulating a handheld • input device.
  • This interactive control of screen information is achieved through a mouse input subsystem which subsystem may be or may not be partially embedded in the paint or draw software program.
  • the mouse input subsystem the movement of a handheld input device is detected across a flat surface with mechanical, photosensitive, electro-magnetic, or electronic sensing mechanisms.
  • the handheld input device which may be, for example, a mouse, a hand-cursor/tablet, or a stylus/tablet, sends data related to the extent of movement to a mouse interface which interface computes information used to move cursors, pointers, paintbrushes, pixel image bit maps, or draw-graphics objects and transmits this information to the paint or draw-graphics software program.
  • a mouse interface which interface computes information used to move cursors, pointers, paintbrushes, pixel image bit maps, or draw-graphics objects and transmits this information to the paint or draw-graphics software program.
  • a mouse data entry system is generally illustrated in Figure 1 and allows a user to interactively enter data into a computer in an easy, natural manner.
  • a system typically comprises a handheld input device 10, a mouse interface, cursor driver circuitry for controlling the cursors, pointers, and/or graphics objects 12 on a display screen 14, and software for transmitting mouse parameters such as device location to application programs. Movement of the hand held input device 10 across a flat surface causes cursor 12 on display screen 14 to move or variables in a computer application program to change.
  • This data entry system allows a user to "point" on the display screen or to affect the execution of application programs.
  • the aforementioned "tool” is usually a paintbrush which moves across the computer display screen and edits the information displayed on the display screen and edits the information displayed on the display screen in accordance with the shape of the paintbrush and the present and previous positions of the paintbrush.
  • a typical paint system displays a paintbrush which has a certain, constant, shape such as a line or rectangle, which brush can be moved on the screen by moving the mouse across a flat surface.
  • the system edits the screen by altering the color or intensity value of pixels 16 (small colored or lighted elements that, together, make up the screen image) which pixels are positioned on what may be conceived to be the path along which the brush moved.
  • This path can be determined by creating straight or curved lines 18 from the tips of the brush image in the present position 20 to the tips of the brush image in a previous position 22 and defining the area 24 enclosed by the brush's present and previous images and the lines 18.
  • the brush may simply make an imprint at every position that it contacts. Paint systems usually allow the user to activate and deactivate the screen editing action of the paintbrush by pressing buttons on the mouse.
  • cursors or pointers are used to create, identify, move, or alter graphics objects on the computer screen.
  • graphics objects consist of graphics primitives, which primitives are usually lines, polylines, rectangles, circles, ellipses, and text.
  • draw- graphics systems use strategic, pertinent, information in the graphics primitives. For example, a polyline is totally described by its vertices and therefore, the draw-graphics system needs only to identify the vertices of the polyline to have a permanent representation of the polyline. Whenever the polyline needs to be moved or altered, the system simply moves or alters the polyline's vertices and uses the new vertices to draw the new polyline.
  • Draw-graphics systems use the mouse input subsystem to display a moving cursor on the screen and use the cursor and buttons on the mouse to create, select, and change objects. Once an object is selected, it can be moved along with or instead of the cursor, or its shape, that is, its vertices or other pertinent parameters, can change along with or instead of cursor movement.
  • Interactive paint and draw-graphics systems exist where graphics objects and text can be rotated indirectly by moving the movement sensitive device in a circular motion so that the cursor on the screen describes an arc around the center of the object.
  • the change in the orientation of the object is related to the change in the slope of a line connecting the cursor and the center of the rotating object, where the position of the cursor is related to the position of the movement sensitive device.
  • the operation of such a system is illustrated in Figure 3 and is described in U.S. Patent Nos. 4,661,810 and 4,745,405. Since these methods operate in an indirect fashion their effectiveness is sub-optimal.
  • these existing systems do not allow changes in the position of the graphics objects to take place simultaneously with rotating action. Indirect operation may also increase tediousness, and the current systems do not accommodate rotating cursors and paintbrushes, but rather the angular orientation of cursors and paintbrushes in present paint and draw- graphics systems is fixed during painting and cursor movement operations.
  • Rotating paintbrushes would enable users to create effects which can be created in the "real world” situation (i.e. with a real paintbrush on paper) and to more effectively and selectively edit the screen.
  • a need has thus arisen for an interactive graphics system which permits the user to rotate a paintbrush, cursor, pointer, or graphics object and interactively enter data into a computer by turning a handheld, movement sensitive device on a flat surface area.
  • Such a system must also provide for lateral movement, that is, changes in the position on the display screen, of paintbrush, cursor, pointer, or graphics objects (either simultaneously or non-simultaneously with turning motion) by moving the device laterally on the flat surface.
  • a computer paint system allows real time interactive control of the angular orientation of a paintbrush by turning a mouse, giving the user an option which is available in the "real world" situation for creating effects and for more flexible editing.
  • This aspect of the present invention can significantly improve the quality and ease of use of these systems, as well as the output which they create.
  • the system of the present invention allows lateral movement of the paintbrush by moving the mouse laterally.
  • a computer draw-graphics system allows angular orientation of a cursor, pointer, graphics object or pixel image on the display screen to be changed by turning the data input mouse. Therefore, the draw- graphics system allows the user to move graphics objects by rotating the mouse as well as moving it.
  • the draw- graphics system which allows movement and rotation of graphics objects and blocks of text can allow the user to perform this operation, move and rotate, in one step since the system of the present invention provides for the rotating action of manipulated objects by turning the mouse.
  • the present invention renders the draw-graphics system more powerful and easier to use.
  • the present invention further, allows the creation and altering of graphics objects by rotating the mouse as well as moving the mouse.
  • the angular orientation of a cursor, pointer, or some other form of graphics in the draw-graphic system can conveniently be used as an additional variable in interactive editing and data entry.
  • Figure 1 illustrates the operation of a typical mouse data entry system
  • Figure 2 illustrates the screen editing action of a paintbrush in a paint graphics system
  • Figure 3 illustrates a system for interactively rotating paint and draw-graphics tools and objects on a computer screen in interactive draw-graphics systems
  • Figure 4 illustrates the operation of the present orientational interactive graphics system
  • Figure 5 is a block diagram of a mouse input sub ⁇ system of the present orientational interactive graphics syste ;
  • FIG. 6 is a flowchart of the present interactive graphics system which embodies a paint graphics system
  • Figure 7 is a flowchart of the present interactive graphics system which embodies a draw-graphics system.
  • the mouse subsystem 40 is principally the system described in U.S. Patent Application Serial No. 07/416,142.
  • This mouse input subsystem 40 includes a movement sensitive device 42 which is sensitive to changes in its orientation as well as changes in its lateral position on a flat surface.
  • Device 42 is designed to sense changes in its orientation and may comprise, for example, a handheld mouse 44 which is moved over a flat surface such as a tablet 46, or the device 42 may include a stylus and tablet, or a hand- cursor and tablet.
  • the mouse subsystem 40 further includes a mouse interface 50 which may be hardware or software implemented, and functions to determine the angular orientation or changes therein of mouse 44 based on the output generated by mouse 44.
  • Determination of the angular orientation of the mouse 44 is preferably done through a search in a look ⁇ up-table 52 which contains precalculated values of change in angle vs. device output parameters, but it may be achieved by computations which may involve geometrical transformations.
  • Mouse interface 50 further functions to keep track of the angular orientation of mouse 44 as well as the lateral position of mouse 44; determine and keep track of the angular orientation of an object 56 on a computer display screen 58 associated with a computer 60 as well as the lateral position of the cursor 56 on the computer display screen 58; transmit to a cursor driver 64 the coordinates of the cursor 56 as well as its orientation on the computer display screen 58; and transmit to the graphics system the orientation of the hand-held device 44 and of the object 56 in addition to other mouse parameters such as position and button states.
  • the term "image" or "cursor" displayed on a display screen 58 will include cursor 56, 5 paintbrushes, pointers, graphics objects, pixel images, i and test.
  • Cursor driver 64 is capable of displaying an image on display screen 58 at variable orientations, which cursor driver 64 used a cursor bit map look-up-table 70
  • the cursor driver 64 obtains a bit map from the cursor bit may look-up-table 70 which corresponds to this angle (1
  • FIGS 6 and 7 Flowcharts of the draw-graphics and of the paint embodiments of the system of the present invention are illustrated in Figures 6 and 7 respectively.
  • the system 40 uses an 25 orientationally sensitive hand-held device to drive a rotating paintbrush or cursor.
  • the system 40 includes, in a main menu, options to create and change objects and to load, save, clear, and shut down.
  • the system accepts input from the mouse 44 at block 80 and determines at block 82 from this input if the state of the mouse 44 has changed, that is, if the mouse 44 has moved or turned, or if buttons have been pressed or released.
  • the system 40 determines a change in mouse 44 state, and it finds that no buttons were pressed, block 84, the system 40 checks at block 86 to see if there has been a change in the angular orientation of the mouse 44. If a change in the orientation of the mouse 44 is detected, the system 40 computes the change in the angular orientation at block 88 and updates the angle of the mouse at block 90 as well as the angle of the rotating object 56, block 92. At block 94, the current object image corresponding to the current object orientation is stored in a temporary buffer for the purpose of later erasing the current object image.
  • the system 40 uses the change in the object's orientation or the object's new orientation to transform the object and thereby obtain the image of the object which corresponds to the rotated object at block 96.
  • the system 40 may not transform and display the object until the move/rotate operation is complete, but rather the system 40 may transform and display a rotating box, convex hull, or some other simplified surrogate of the object.
  • the system 40 erases the surrogate image and uses the final orientation of the object to transform and display it.
  • the system 40 uses the mouse 44 input to determine any change in the lateral position of the mouse 44, and the system 40 updates the object's coordinates using the computed change in the lateral position of the mouse 44 device.
  • the system 40 erases the image of the object or its surrogate at block 100 and then places a new image on the screen which corresponds to the current location and angular orientation of the object or its surrogate at block 102.
  • the system 40 interprets any button action at block 104 and takes required action.
  • the system 40 may terminate the move/rotate operation and surrender control to the main menu of the system 40 or for continued move/rotate operations.
  • Block 88 computation of object angle, preferentially uses a look-up-table previously explained.
  • FIG. 7 A flowchart of the paint embodiment of the present invention is depicted in Figure 7, with emphasis on the paint aspect of the system.
  • the system 40 includes, in a main menu, options to change paint and paint brush attributes, load, save, clear, and shut down.
  • the system 40 accepts input from the movement sensitive device such as a mouse 44 at block 80 and determines at block 82 from this input if the state of the device has changed, that is, if the device has moved or turned, or if buttons have been pressed or released.
  • the movement sensitive device such as a mouse 44
  • the system 40 determines a change in device state, and it finds that no buttons were pressed, block 84, the system 40 checks at block 86 to see if there has been a change in the angular orientation of the mouse 44. If a change in the orientation of the mouse 44 is detected, the system 40 computes the change in the angular orientation at block 88 and updates the angle of the mouse 44 at block 90 as well as the angle of the rotating paintbrush 56, block 92. At block 94, the current paint brush bit mapped image corresponding to the current object orientation is stored in a temporary buffer for the purpose of later erasing the current paintbrush image.
  • the system 40 uses the change in the paintbrush's orientation or the paintbrush's new orientation to transform the object 56 and thereby obtain the image of the object 56 which corresponds to the rotated paintbrush at block 96.
  • the system 40 uses the mouse 44 input to determine any change in the lateral position of the mouse 44, and it updates the paintbrush's coordinates using the computed change in the lateral position of the mouse 44 at block 100.
  • the system 40 erases the image of the paintbrush at block 102 and then places a new image on the screen which corresponds to the current location and angular orientation of the paintbrush at block 103.
  • the system 40 uses the present and/or previous paintbrush positions and orientations to edit the computer display screen at block 107 according to the paintbrush and paint attributes.
  • the system 40 interprets any button action at block 104 and takes required action.
  • the system 40 may stop or start painting. If user input demands stop/start painting, then the system 40 activates or deactivates the paintbrush, depending on the present mode of the paintbrush. If user input did not demand stop/start painting, the system 40 may terminate the paint operation and surrender control to the main menu of the system 40 at block 106, or the system 40 moves to block 110 to reset paint and paintbrush attributes.
  • Blocks 88 and 96 computation of paintbrush angle and bit mapped image, preferentially use a look-up-tables as previously explained.
  • the present system provides for a display of a paintbrush, cursor, pointer, or graphics object which rotates as a mouse rotates, and the system therefore allows interactive painting and graphics data manipulation and editing where tools and graphics objects turn as the user turns the mouse and move laterally as the user moves the mouse laterally.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Un système (40) de manipulation et d'édition de données imagées affichées sur l'écran d'un ordinateur (58) en commandant les informations affichées telles que des curseurs (56), des pinceaux, des pointeurs, des images par points et des représentations graphiques, lesdites informations imagées étant commandées par rotation et mouvement latéral d'un dispositif d'entrée manuel (44) de façon que lesdites informations imagées (56) tournent en même temps que le dispositif manuel (44) tourne et que lesdites informations (56) se déplacent latéralement en même temps que le dispositif manuel (44) se déplace latéralement.
PCT/US1990/007130 1989-12-11 1990-12-10 Systeme orientationnel informatise de graphisme et coloriage WO1991009394A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US44868389A 1989-12-11 1989-12-11
US448,683 1989-12-11

Publications (1)

Publication Number Publication Date
WO1991009394A1 true WO1991009394A1 (fr) 1991-06-27

Family

ID=23781258

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1990/007130 WO1991009394A1 (fr) 1989-12-11 1990-12-10 Systeme orientationnel informatise de graphisme et coloriage

Country Status (3)

Country Link
EP (1) EP0457894A4 (fr)
JP (1) JPH05500872A (fr)
WO (1) WO1991009394A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0544509A2 (fr) * 1991-11-27 1993-06-02 Xerox Corporation Métaphore de filtre photographique pour le contrôle de logiciel de traitement d'images numériques

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4887230A (en) * 1987-02-18 1989-12-12 Hitachi, Ltd. Cursor display apparatus

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839838A (en) * 1987-03-30 1989-06-13 Labiche Mitchell Spatial input apparatus

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4887230A (en) * 1987-02-18 1989-12-12 Hitachi, Ltd. Cursor display apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MACINTOSH, MACPAINT" Apple Computer, inc. Cupertino, California 1983, see pages 10-26. *
See also references of EP0457894A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0544509A2 (fr) * 1991-11-27 1993-06-02 Xerox Corporation Métaphore de filtre photographique pour le contrôle de logiciel de traitement d'images numériques
EP0544509A3 (en) * 1991-11-27 1993-11-03 Xerox Corp Photographic filter metaphor for control of digital image processing software

Also Published As

Publication number Publication date
EP0457894A1 (fr) 1991-11-27
EP0457894A4 (en) 1993-01-07
JPH05500872A (ja) 1993-02-18

Similar Documents

Publication Publication Date Title
US5162781A (en) Orientational mouse computer input system
US5345543A (en) Method for manipulating objects on a computer display
US5583977A (en) Object-oriented curve manipulation system
US7480873B2 (en) Method and apparatus for manipulating two-dimensional windows within a three-dimensional display model
TWI507969B (zh) 遙控裝置、顯示系統與方法
AU769120B2 (en) Control of depth movement for visual display with layered screens
US6377240B1 (en) Drawing system using design guides
CN101404152B (zh) 信息显示装置
JPH0798769A (ja) 情報処理装置及びその画面編集方法
WO1998032107A1 (fr) Procede et appareil d'enseignement du dessin et de la peinture a coordination memorielle entre la main et l'oeil
JPH05258037A (ja) アイコンの移動および機能を制御する方法
JP3865681B2 (ja) 毛筆描画装置、毛筆描画プログラムおよび毛筆描画方法
EP0476809B1 (fr) Appareil de traitement d'images graphiques
US5636336A (en) Graphics processing unit for use with a stylus pen and tablet, and method therefore
JP2007257655A (ja) 描画装置および描画プログラム
US20020012013A1 (en) 3-dimensional model-processing apparatus, 3-dimensional model-processing method and program-providing medium
WO1991009394A1 (fr) Systeme orientationnel informatise de graphisme et coloriage
JP2003346171A (ja) 描画装置および描画プログラム
JP3647116B2 (ja) ウィンドウ階層表示方法及びそのシステム
JPH08263688A (ja) 手書き入力情報処理方法および装置
US6848082B1 (en) Reactor-based viewport clipping using arbitrary graphical entities
JPH08249500A (ja) ３次元図形の表示方法
Mukherjee Fundamentals of computer graphics and multimedia
JPH04304571A (ja) 画像処理装置
JPH08272994A (ja) 情報処理装置および情報処理方法

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IT LU NL SE

WWE Wipo information: entry into national phase

Ref document number: 1991901477

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1991901477

Country of ref document: EP

COP Corrected version of pamphlet

Free format text: PAGES 14 AND 15,CLAIMS,ADDED;PAGES 14 AND 15,AMENDED CLAIMS,REPLACED BY CORRECT PAGES 16 AND 17

NENP Non-entry into the national phase

Ref country code: CA

WWW Wipo information: withdrawn in national office

Ref document number: 1991901477

Country of ref document: EP