EP2663914A1 - Method of supporting multiple selections and interactive input system employing same - Google Patents
Method of supporting multiple selections and interactive input system employing sameInfo
- Publication number
- EP2663914A1 EP2663914A1 EP12734245.9A EP12734245A EP2663914A1 EP 2663914 A1 EP2663914 A1 EP 2663914A1 EP 12734245 A EP12734245 A EP 12734245A EP 2663914 A1 EP2663914 A1 EP 2663914A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- selection
- user
- input
- graphic object
- selections
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
Definitions
- the present invention relates generally to interactive input systems and in particular, to a method and apparatus for supporting multiple selections and an interactive input system employing same.
- Interactive input systems that allow users to inject input (i.e. digital ink, mouse events etc.) into an application program using an active pointer (e.g. a pointer that emits light, sound or other signal), a passive pointer (e.g. a finger, cylinder or other suitable object) or other suitable input device such as for example, a mouse or trackball, are known.
- active pointer e.g. a pointer that emits light, sound or other signal
- a passive pointer e.g. a finger, cylinder or other suitable object
- suitable input device such as for example, a mouse or trackball
- These interactive input systems include but are not limited to: touch systems comprising touch panels employing analog resistive or machine vision technology to register pointer input such as those disclosed in U.S. Patent Nos. 5,448,263; 6,141,000; 6,337,681 ; 6,747,636; 6,803,906; 7,232,986;
- touch systems comprising touch panels employing electromagnetic, capacitive, acoustic or other technologies to register pointer input
- laptop and tablet personal computers (PCs) personal digital assistants (PDAs) and other handheld devices; and other similar devices.
- PCs personal computers
- PDAs personal digital assistants
- U.S. Patent No. 6,803,906 to Morrison et al. discloses a touch system that employs machine vision to detect a pointer interaction with a touch surface on which a computer-generated image is presented.
- a rectangular bezel or frame surrounds the touch surface and supports digital cameras at its corners.
- the digital cameras have overlapping fields of view that encompass and look generally across the touch surface.
- the digital cameras acquire images from different vantages and generate image data.
- Image data acquired by the digital cameras is processed by on-board digital signal processors to determine if a pointer exists in the captured image data.
- the digital signal processors convey pointer characteristic data to a master controller, which in turn processes the pointer characteristic data to determine the location of the pointer in (x, y) coordinates relative to the touch surface using triangulation.
- the pointer coordinates are conveyed to a computer executing one or more application programs.
- the computer uses the pointer location data to update the computer-generated image that is presented on the touch surface. Pointer contacts on the touch surface can therefore be recorded as writing or used to control execution of an application program executed by the computer.
- Interactive systems such as those referred to above enable interactive presentations and collaborations.
- a presenter typically uses a pointer such as a finger or a pen, to select and manipulate displayed graphic objects.
- the user may add annotations, change colors or fill patterns of graphic objects; and/or move, rotate, enlarge, reduce and generally manipulate displayed graphic objects using certain gestures.
- Touch based interactive input systems are sometimes operated by multiple users for collaborative purposes.
- application programs for use with interactive input systems are typically designed with a single user in mind. For example, when two or more users operate a single interactive input system at the same time, a graphic object selected by a first user may be inadvertently de-selected, manipulated or even deleted by a second user making another selection. Such object selectivity may disrupt collaboration between the users.
- a method comprising receiving an input event associated with a first user ID, the input event being a command for selecting at least one graphic object; determining if a selection is currently associated with the first user ID; and if no selection is currently associated with the first user ID creating a first selection; associating the first selection with the first user ID; and including the selected at least one graphic object in the first selection.
- the method further comprises receiving an input associated with a second user ID, the input event being a command for selecting at least one graphic object, determining if a selection is currently associated with the second user ID and if no selection is currently associated with the second user ID, creating a second selection, associating the second selection with the second user ID and including the selected at least one graphic object in the second selection.
- the method further comprises if an existing selection is currently associated with the first user ID, and the input event is a command for creating a new selection, clearing the existing selection, creating the new selection and including the selected at least one graphic object in the new selection. If an existing selection is currently associated with the first user ID and the input event is not a command for creating a new selection, the method further comprises including the selected at least one graphic object in the existing selection.
- the first and/or second selection may be manipulatable only by an input source associated with the first user ID and/or the second user ID.
- the first and/or second selection may be one of resizing, moving and rotating.
- the at least one graphic object may be one of a shape object, text object, ink object and animation object.
- the first user ID may be based on an input ID and a surface ID.
- the method may further comprise altering a visual property of the at least one selected graphic object to indicate membership in the first and/or second selections.
- the altered visual properties of the first and second selections may be different.
- an interactive input system comprising at least one interactive surface; and processing structure in communication with the interactive surface and being configured to generate an input event associated with a first user ID, the input event being a command for selecting at least one graphic object shown on the interactive surface; determine if a selection is currently associated with the first user ID; and if no selection is currently associated with the first user ID create a first selection; associate the first selection with the first user ID; and include the selected at least one graphic object in the first selection.
- a non-transitory computer-readable medium having embodied thereon a computer program comprising instructions which, when executed by processing structure, carry out the steps of receiving an input event associated with a first user ID, the input event being a command for selecting at least one graphic object; determining if a selection is currently associated with the first user ID; and if no selection is currently associated with the first user ID creating a first selection; associating the first selection with the first user ID; and including the selected at least one graphic object in the first selection.
- an apparatus comprising processing structure; and memory storing program code, which when executed by the processing structure, causes the processing structure to direct the apparatus to in response to receiving an input event associated with a first user ID, the input event being a command for selecting at least one graphic object, determine if a selection is currently associated with the first user ID; and if no selection is currently associated with the first user ID create a first selection; associate the first selection with the first user ID; and include the selected at least one graphic object in the first selection.
- Figure 1 is a perspective view of an interactive input system
- Figure 2 is a block diagram of a software architecture used by the interactive input system of Figure 1 ;
- Figure 3 is an application program window presented by the interactive input system of Figure 1 ;
- Figure 4 is a flowchart showing the steps of a multiple selection support process used by the interactive input system of Figure 1 ;
- Figure 5 is the application program window of Figure 3, having been updated following multiple selections
- Figures 6 A and 6B illustrate another embodiment of an application program window presented by the interactive input system of Figure 1 , showing transfer of ownership of a selection;
- Figure 7 is the application program window of Figure 3, having been updated following multiple selections by two pointers of the same type;
- Figure 8 illustrates yet another embodiment of an application program window presented by the interactive input system of Figure 1.
- the method comprises receiving an input event associated with a first user ID, the input event being a command for selecting at least one graphic object; determining if a selection is currently associated with the first user ID; and if no selection is currently associated with the first user ID, creating a first selection, associating the first selection with the first user ID, and including the selected at least one graphic object in the first selection.
- Interactive input system 20 allows one or more users to inject input such as digital ink, mouse events, commands, etc. into an executing application program.
- interactive input system 20 comprises a two-dimensional (2D) interactive device in the form of an interactive whiteboard (IWB) 22 mounted on a vertical support surface such as for example, a wall surface or the like.
- IWB 22 comprises a generally planar, rectangular interactive surface 24 that is surrounded about its periphery by a bezel 26.
- An ultra-short-throw projector 34 such as that sold by SMART Technologies ULC of Calgary, Alberta, Canada under the name "SMART UX60", is also mounted on the support surface above the IWB 22 and projects an image, such as for example, a computer desktop, onto the interactive surface 24.
- the IWB 22 employs machine vision to detect one or more pointers brought into a region of interest in proximity with the interactive surface 24.
- the IWB 22 communicates with a general purpose computing device 28 executing one or more application programs via a universal serial bus (USB) cable 30 or other suitable wired or wireless communication link.
- Computing device 28 processes the output of the IWB 22 and adjusts image data that is output to the projector 34, if required, so that the image presented on the interactive surface 24 reflects pointer activity.
- the IWB 22, computing device 28 and projector 34 allow pointer activity proximate to the interactive surface 24 to be recorded as writing or drawing or used to control execution of one or more application programs executed by the computing device 28.
- the bezel 26 is mechanically fastened to the interactive surface 24 and comprises four bezel segments that extend along the edges of the interactive surface 24.
- the inwardly facing surface of each bezel segment comprises a single, longitudinally extending strip or band of retro-reflective material.
- the bezel segments are oriented so that their inwardly facing surfaces lie in a plane generally normal to the plane of the interactive surface 24.
- a tool tray 36 is affixed to the IWB 22 adjacent the bottom bezel segment using suitable fasteners such as for example, screws, clips, adhesive etc.
- the tool tray 36 comprises a housing having an upper surface configured to define a plurality of receptacles or slots.
- the receptacles are sized to receive one or more pen tools 38 as well as an eraser tool 40 that can be used to interact with the interactive surface 24.
- Control buttons are also provided on the upper surface of the tool tray housing to enable a user to control operation of the interactive input system 20. Further specifies of the tool tray 36 are described in U.S. Patent Application Publication No. 201 1/0169736 to Bolt et al., filed on February 19, 2010, and entitled "INTERACTIVE INPUT SYSTEM AND TOOL TRAY THEREFOR".
- Imaging assemblies are accommodated by the bezel 26, with each imaging assembly being positioned adjacent a different corner of the bezel.
- Each of the imaging assemblies comprises an image sensor and associated lens assembly.
- the lens has an IR pass/visible light blocking filter thereon and provides the image sensor with a field of view sufficiently large as to encompass the entire interactive surface 24.
- a digital signal processor (DSP) or other suitable processing device sends clock signals to the image sensor causing the image sensor to capture image frames at the desired frame rate.
- the DSP also causes an infrared (IR) light source to illuminate and flood the region of interest over the interactive surface 24 with IR illumination.
- IR infrared
- the image sensor sees the illumination reflected by the retro-reflective bands on the bezel segments and captures image frames comprising a continuous bright band.
- the pointer occludes reflected IR illumination and appears as a dark region interrupting the bright band in captured image frames.
- the imaging assemblies are oriented so that their fields of view overlap and look generally across the entire interactive surface 24.
- any pointer such as for example a user's finger 42, a cylinder or other suitable object, a pen tool 38 or an eraser tool 40 lifted from a receptacle of the tool tray 36, that is brought into proximity of the interactive surface 24 appears in the fields of view of the imaging assemblies and thus, is captured in image frames acquired by multiple imaging assemblies.
- the imaging assemblies convey pointer data to the computing device 28.
- the general purpose computing device 28 in this embodiment is a personal computer or other suitable processing device comprising, for example, a processing unit, system memory (volatile and/or non-volatile memory), other nonremovable or removable memory (e.g., a hard disk drive, RAM, ROM, EEPROM, CD-ROM, DVD, flash memory, etc.) and a system bus coupling the various computer components to the processing unit.
- the computing device 28 may also comprise networking capabilities using Ethernet, WiFi, and/or other suitable network format, to enable connection to shared or remote drives, one or more networked computers, or other networked devices.
- a keyboard and a mouse are also coupled to the general purpose computing device 28.
- the computing device 28 processes pointer data received from the imaging assemblies to reject pointer ambiguity by combining the pointer data detected by the imaging assemblies, and to compute the locations of pointers proximate the interactive surface 24 using well known triangulation. The computed pointer locations are then recorded as writing or drawing or used as one or more input commands to control execution of an application program as described above.
- the general purpose computing device 28 determines the pointer types (e.g., a pen tool, a finger or a palm) by using pointer type data received from the IWB 22.
- the pointer type data is generated for each pointer contact point by the DSP of least one of the imaging assemblies.
- the pointer type data is generated by differentiating a curve of growth derived from a horizontal intensity profile of pixels corresponding to each pointer tip in the captured image frames. Specifics of methods used to determine pointer type are described in U.S. Patent No. 7,532,206 to
- FIG. 2 shows the software architecture used by the interactive input system 20, and which is generally identified by reference numeral 100.
- the software architecture 100 comprises an input interface 102, and an application layer 104 comprising an application program.
- the input interface 102 is configured to receive input from various input sources generated from the input devices of the interactive input system 20.
- the input devices include the IWB 22, the mouse, and the keyboard.
- the input interface 102 processes each input received and generates an input event. In generating each input event, the input interface 102 generally detects the identity of the input received based on input characteristics, and assigns to each input event an input ID and a surface ID.
- the input ID identifies the input source. If the input originates from the mouse or the keyboard, the input ID identifies that input device. If the input is pointer input originating from the IWB 22, the input ID identifies the type of pointer, such as for example a pen tool, a finger or a palm. In this case, the surface ID identifies the interactive surface on which the pointer input is received. In this embodiment, IWB 22 comprises only a single interactive surface, namely interactive surface 24.
- the input interface 102 also associates each input event to a respective user ID.
- the user ID is assigned based on both the input ID and the surface ID. For example, a pen tool and a finger contacting the interactive surface 24 at the same time will be assigned different user IDs. As another example, two fingers contacting the interactive surface 24 at the same time will be assigned the same user ID, even though they have different contact coordinates.
- Figure 3 shows an application program window presented by the interactive input system 20 and displayed on the IWB 22, and which is generally referred to by reference numeral 114.
- Application program window 1 14 is a graphical user interface associated with application program which, in this embodiment, is the SMART NotebookTM offered by SMART Technologies ULC of Calgary, Alberta, Canada.
- application program window 1 14 comprises a drawing area 1 16 in which a plurality of graphic objects are displayed.
- the graphic objects displayed are shape objects 120A to 120D, digital ink objects 120E and 120F, and text objects 120G and 120H.
- Each of the graphic objects 120A to 120H is assigned a respective object ID by the application program.
- the set of object IDs has the form:
- Each of the graphic objects 120A to 120H displayed in the drawing area 116 of the application program window 1 14 is selectable through pointer input with the interactive surface 24.
- the application program creates a selection having a unique selection ID.
- Selected graphics objects are associated with the selection ID. This association has the form:
- a selection of one or more graphic objects 120A to 120H can be made by a user in a variety of ways.
- a single graphic object can be selected by clicking on or touching the graphic object using a pointer.
- One or more graphic objects can be selected by clicking on or touching graphic objects while holding down the SHIFT or CTRL key on a keyboard, or by using a marquee selection action.
- the marquee selection action involves positioning and holding down a pointer to create a transparent bounding box, and then expanding the box by moving the pointer to enclose the desired graphic objects. Lifting the pointer completes the selection of the enclosed graphic objects.
- one or more graphic objects can also be selected by drawing a shape encircling desired graphic objects, and then designating the shape as an enclosure of a group for selection.
- the graphic objects 120A to 120H may also be selected using gestures.
- one or more graphic objects may be selected by making a bracketing motion using pointers, such as two fingers or the inner palm edges of two hands, around the one or more graphic objects.
- one or more graphic objects may be simultaneously selected using a "grabbing" motion with all fingers of a hand.
- the interactive input system 20 utilizes a multiple selection support process, which is shown in Figure 4 and is generally referred to by reference numeral 130.
- the multiple selection support process 130 is carried out by the computing device 28.
- the input interface 102 comprises a SMART Board driver offered by SMART
- multiple selection support process 130 starts when the application program detects an input event for a given user ID, where the input event corresponds to a command for object selection (step 134). Upon detection of the selection input event, the application program obtains the user ID associated with the selection input event (step 136). The application program then determines if a selection ID is currently associated with the user ID (step 138). If no selection ID is currently associated with the user ID, the process proceeds to step 140.
- step 138 If it is determined at step 138 that a selection ID is currently associated with the user ID, the application program then determines if the input event further corresponds to a command for creating a new selection (step 142). If the selection event further corresponds to a command for creating a new selection, any existing selection ID associated with the user ID is deleted (step 144), and the process proceeds to step 140. If it is determined at step 142 that the input event does not further correspond to a command for creating a new selection, the process proceeds to step 146. [0046] At step 140, the application program creates a selection with a new selection ID and associates the selection ID with the user ID. The object IDs of any objects selected in the selection event are then associated with the new selection ID (step 146). The process 130 then ends.
- the application program allows multiple selections to be created either simultaneously or consecutively in any order. For example, a first user may complete the creation of a first selection using a finger and subsequently, a second user may create a second selection using a pen tool. Both selections will stay active, and regardless of the sequence in which they were created. Unlike prior art methods, the creation of a second selection does not deselect or cancel the first selection.
- the application program similarly allows multiple selections to be manipulated simultaneously or consecutively in any order.
- Figure 5 shows the application program window 1 14 updated after multiple selections have been created using the multiple selection support process 130.
- a first user 150 has made a selection 152 by drawing a marquee selection shape 154 enclosing the graphic objects 120A, 120C, 120E and 120G using a finger 156.
- the application program has associated each of the graphic objects 120A, 120C, 120E and 120G with a first selection ID, and has associated the first selection ID with the user ID associated with finger 156.
- a second user 160 has made a selection 162 by drawing a marquee selection shape 164 enclosing the graphic objects 120B, 120D, 120F and 120H using a pen tool 166. Accordingly, the application program has associated each of the graphic objects 120B, 120D, 120F and 120H with a second selection ID, and has associated the second selection ID with the user ID associated with pen tool 166.
- a visual property of each graphic object is altered to indicate membership in the selection.
- this alteration is in the form of an enclosing perimeter box such as box 158 having a handle.
- a user operating an input source associated with a given user ID can directly manipulate the selection associated with that user ID.
- Such manipulation may take the form of, for example, resizing, moving or rotating the selection or the graphic objects contained therein.
- users can also share common controls such as toolbars, menu-bars, 'Properties' tabs, context menus and the like, to indirectly manipulate their own selections (i.e. associated with their user ID) without affecting selections that belong to others (i.e. associated with other user IDs).
- Such indirect manipulation may take the form of, for example, selecting some text box objects in a selection, and then using a shared text formatting toolbar, to change the font of the text therein to bold, italic, or underlined font.
- each user may utilize a shared toolbar to change colors, fill patterns, line widths, delete objects, or the like - but only for the those objects belonging to selections associated with the user ID, without affecting the objects in selections associated with other user IDs.
- a shared toolbar to change colors, fill patterns, line widths, delete objects, or the like - but only for the those objects belonging to selections associated with the user ID, without affecting the objects in selections associated with other user IDs.
- the user ID associated with each pointer may be used to effectively identify the individual user utilizing the pointer.
- FIG. 6A shows an application program window 314 in which a user has made a selection 352 by drawing a shape 354 with a pen tool 356 encircling graphic objects 320A and 320B. Accordingly, the application program has associated each of the graphic objects 320A and 320B with a first selection ID of the selection 352, and has associated the selection ID of the selection 352 with the user ID of pen tool 356.
- FIG. 6B shows the application program window 314 updated after a user has contacted graphic object 320B using a finger 366. Following this action, the application program obtains the current selection ID of the selection 352 by querying the association table [object ID, selection ID].
- object ID and selection ID are equivalent to the reference numerals used to represent the graphic objects and selections in the above paragraphs and in Figure 6. Querying the association table [object ID, selection ID] retrieves the entry:
- the ownership of the graphic object is thereby transferred by the update.
- the ability to transfer ownership is a configurable feature that may be toggled on or off.
- a single user may create two or more selections simultaneously.
- Figure 7 shows the application program window 114 updated after selections have been made by a single user operating two similar pointers.
- the two pointers are the index fingers 256 and 266 of the user's left and right hands, respectively.
- the user has made a selection 252 by drawing a marquee selection shape 254 enclosing the graphic objects 120A, 120C, 120E and 120G using finger 256, and has made a selection 262 by drawing a marquee selection shape 264 enclosing the graphic objects 120B, 120D, 120F and 120H using finger 266.
- fingers 256 and 266 are pointers of the same type, and therefore have the same user ID, the selection events resulting from contacts made by fingers 256 and 266 are distinguishable by the IWB 22 due to the different contact locations of each pointer. Accordingly, each selection is assigned a unique selection ID, but are both associated with a common user ID, as each pointer has the same user ID.
- the IWB comprises a single interactive surface
- the IWB may alternatively be partitioned into two or more interactive surfaces.
- Figure 8 shows another embodiment of an application program window presented by the interactive input system 20, and which is generally referred to by reference numeral 414.
- Application program window 414 is a graphical user interface associated with the application program which, in this embodiment, is SMART NotebookTM offered by SMART Technologies ULC of Calgary, Alberta, Canada.
- Application program window 414 is displayed on an IWB 422 comprising two interactive surfaces 424 A and 424B.
- the input interface 102 processes input received from both interactive surfaces 424A and 424B of the IWB 422 and generates input events. In generating each input event, it provides the input ID and the surface ID. The surface ID uniquely identifies the interactive surface 424A or 424B on which the input is received. As will be understood, by assigning a respective surface ID to input received on each interactive surface 424A and 424B, the same input source (e.g. a finger) may be used to generate input on both interactive surfaces 424 A and 424B.
- the same input source e.g. a finger
- a user has made a selection 452 by drawing a marquee selection shape 454 enclosing the graphic objects 420A and 420B using a finger 456, and has made a selection 462 by drawing a marquee selection shape 464 enclosing the graphic objects 420C and 420D using the same finger 456.
- the interactive input system may alternatively comprise two or more separate interactive whiteboards (IWBs) connected by a network.
- IWBs interactive whiteboards
- an input interface is in communication with all IWBs, and processes input received from the IWBs and generates input events.
- the input interface assigns to each input event a user ID, and a surface ID where the surface ID corresponds to the interactive surface associated with the respective IWB.
- other devices such as, for example, slates and tablets, each having an interactive surface may be brought into communication with a host IWB, and may each be assigned a unique surface ID.
- the application program may comprise program modules including routines, programs, object components, data structures, and the like, and may be embodied as computer readable program code stored on a non-transitory computer readable medium.
- the computer readable medium is any data storage device that can store data. Examples of computer readable media include for example read-only memory, random-access memory, CD-ROMs, magnetic tape, USB keys, flash drives and optical data storage devices.
- the computer readable program code can also be distributed over a network including coupled computer systems so that the computer readable program code is stored and executed in a distributed fashion.
- the general purpose computing device distinguishes between different pointer types by differentiating the curve of growth of the pointer tip.
- each pen tool comprises an IR light emitter at its tip that emits IR light modulated with a unique pattern.
- a user ID is then assigned to each pen tool according to its IR light pattern.
- each selection is associated with a user ID based on both the surface ID and input ID (identifying the pointer type)
- each selection may alternatively be directly associated with a user.
- touch detecting technologies such as DiamondTouchTM available from Circle Twelve Inc. of Framingham, Massachusetts, U.S.A., may be used to identify each user that operates an interactive whiteboard during multiple user applications.
- each selection may be made visually distinctive.
- selections may be color coded in chronological order of creation.
- a first created selection may be a semitransparent shade of red, a second selection yellow, a third selection green, etc.
- each user ID is assigned a particular color
- Individual selections that are associated with the user ID may thus be assigned shades of the particular color assigned to the user (e.g., shades of green, for a user assigned the color green). This allows all users to learn which selections are associated with particular user IDs.
- [0072] Technologies such as DiamondTouchTM transmit signals through antennas that are in electrical communication with the interactive surface of an IWB.
- the signals are capacitively coupled through both the users and the chairs on which they sit (or pads on which users stand, specialized slippers or shoes, electronic bracelets, etc.) to dedicated receivers.
- the receivers identify the coordinates of the touch surface each user is touching. This information can then be dealt with by the input interface 102 in a similar way as input received on the IWB.
- [selection ID, user ID] associations directly map each selection to a particular user (rather than to a particular input source). This allows each user to independently manipulate his/her own selection as described above, without relying on the particularities of the input source used.
- each identified user is assigned a particular color (e.g., green).
- Individual selections that are associated with that user may thus be assigned shades of the particular color assigned to the user (e.g., shades of green, for a user assigned the color green). This allows all users to learn which selections are associated with particular users.
- each selection may have a displayed label associated therewith.
- a legend indicating either user IDs or identified users, and their assigned colors may optionally be displayed at a corner of the interactive surface.
- assigning colors to selections for conveying information related to chronology, ownership, size, and the like are possible.
- the color, border, line thickness, transparency, shape or other visual properties of a selection or objects contained therein may be varied to distinguish one selection from another.
- selections may alternatively be created with
- a CTRL-A command (achieved by pressing both the 'CTRL' key and the 'A' key on a keyboard) creates a selection that includes all objects in an application window owned by the virtual user ID.
- selections owned by the virtual user ID may be cleared by the actions of any other input source. For example, a single-click or double-click event from a mouse on a clear area (workspace or drawing area) clears the selection owned by the virtual user ID.
- the ability to transfer ownership of selections allows enables any desired input source to own a selection containing all objects on application (created by pressing CTRL-A).
- an input source e.g., a mouse
- a 'clear all' command or button for all selections may be provided.
- one or more designated input sources e.g., a mouse
- any selection tool may be allowed to clear all selections by right- clicking or double-clicking on a clear workspace. An exception may be made for selections that are actively being manipulated.
- certain inputs from any input source e.g., a right-click
- the application program is the SMART NotebookTM
- the application program may alternatively be an operating system software, a drawing package, a web browser, a word processor, a dialog window, a graphic container or a graphical user interface forming part of another software application.
- the graphic objects include shape objects, digital ink objects, and text objects
- the graphic objects may alternatively include other graphic objects, such as animation objects such as a FlashTM object or a movie clip.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161431853P | 2011-01-12 | 2011-01-12 | |
PCT/CA2012/000027 WO2012094741A1 (en) | 2011-01-12 | 2012-01-12 | Method of supporting multiple selections and interactive input system employing same |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2663914A1 true EP2663914A1 (en) | 2013-11-20 |
EP2663914A4 EP2663914A4 (en) | 2014-08-06 |
Family
ID=46506723
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12734245.9A Withdrawn EP2663914A4 (en) | 2011-01-12 | 2012-01-12 | Method of supporting multiple selections and interactive input system employing same |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP2663914A4 (en) |
CA (1) | CA2823809C (en) |
WO (1) | WO2012094741A1 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050183035A1 (en) * | 2003-11-20 | 2005-08-18 | Ringel Meredith J. | Conflict resolution for graphic multi-user interface |
US20090225040A1 (en) * | 2008-03-04 | 2009-09-10 | Microsoft Corporation | Central resource for variable orientation user interface |
US20100079369A1 (en) * | 2008-09-30 | 2010-04-01 | Microsoft Corporation | Using Physical Objects in Conjunction with an Interactive Surface |
US20100205190A1 (en) * | 2009-02-09 | 2010-08-12 | Microsoft Corporation | Surface-based collaborative search |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5659693A (en) * | 1992-08-27 | 1997-08-19 | Starfish Software, Inc. | User interface with individually configurable panel interface for use in a computer system |
US6057836A (en) * | 1997-04-01 | 2000-05-02 | Microsoft Corporation | System and method for resizing and rearranging a composite toolbar by direct manipulation |
US6803906B1 (en) * | 2000-07-05 | 2004-10-12 | Smart Technologies, Inc. | Passive touch system and method of detecting user input |
US6624831B1 (en) * | 2000-10-17 | 2003-09-23 | Microsoft Corporation | System and process for generating a dynamically adjustable toolbar |
US7532206B2 (en) * | 2003-03-11 | 2009-05-12 | Smart Technologies Ulc | System and method for differentiating between pointers used to contact touch surface |
US7343567B2 (en) * | 2003-04-25 | 2008-03-11 | Microsoft Corporation | System and method for providing dynamic user information in an interactive display |
-
2012
- 2012-01-12 EP EP12734245.9A patent/EP2663914A4/en not_active Withdrawn
- 2012-01-12 WO PCT/CA2012/000027 patent/WO2012094741A1/en active Application Filing
- 2012-01-12 CA CA2823809A patent/CA2823809C/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050183035A1 (en) * | 2003-11-20 | 2005-08-18 | Ringel Meredith J. | Conflict resolution for graphic multi-user interface |
US20090225040A1 (en) * | 2008-03-04 | 2009-09-10 | Microsoft Corporation | Central resource for variable orientation user interface |
US20100079369A1 (en) * | 2008-09-30 | 2010-04-01 | Microsoft Corporation | Using Physical Objects in Conjunction with an Interactive Surface |
US20100205190A1 (en) * | 2009-02-09 | 2010-08-12 | Microsoft Corporation | Surface-based collaborative search |
Non-Patent Citations (1)
Title |
---|
See also references of WO2012094741A1 * |
Also Published As
Publication number | Publication date |
---|---|
EP2663914A4 (en) | 2014-08-06 |
CA2823809C (en) | 2018-03-27 |
WO2012094741A1 (en) | 2012-07-19 |
CA2823809A1 (en) | 2012-07-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9261987B2 (en) | Method of supporting multiple selections and interactive input system employing same | |
US20130191768A1 (en) | Method for manipulating a graphical object and an interactive input system employing the same | |
JP5237847B2 (en) | Gesture recognition method and touch system incorporating the same | |
US9665259B2 (en) | Interactive digital displays | |
US20120176308A1 (en) | Method for supporting multiple menus and interactive input system employing same | |
CA2830491C (en) | Manipulating graphical objects in a multi-touch interactive system | |
US8810509B2 (en) | Interfacing with a computing application using a multi-digit sensor | |
US20160342779A1 (en) | System and method for universal user interface configurations | |
US20110298722A1 (en) | Interactive input system and method | |
US20110298708A1 (en) | Virtual Touch Interface | |
US8972891B2 (en) | Method for handling objects representing annotations on an interactive input system and interactive input system executing the method | |
JP2001265523A (en) | Information input/output system, information input/ output method and program storage medium | |
US20150242179A1 (en) | Augmented peripheral content using mobile device | |
US9542040B2 (en) | Method for detection and rejection of pointer contacts in interactive input systems | |
CA2823809C (en) | Method of supporting multiple selections and interactive input system employing same | |
Hahne et al. | Multi-touch focus+ context sketch-based interaction | |
Quigley et al. | Face-to-face collaborative interfaces |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130729 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20140703 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 3/048 20130101ALI20140629BHEP Ipc: G06F 3/0484 20130101ALI20140629BHEP Ipc: G06F 3/0488 20130101AFI20140629BHEP |
|
17Q | First examination report despatched |
Effective date: 20160523 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20180809 |