WO2013153551A1

WO2013153551A1 - Stylus and digitizer for 3d manipulation of virtual objects

Info

Publication number: WO2013153551A1
Application number: PCT/IL2013/050315
Authority: WO
Inventors: Moran Amidan
Original assignee: N-Trig Ltd.
Priority date: 2012-04-08
Filing date: 2013-04-08
Publication date: 2013-10-17

Abstract

A digitizer system for communicating 3D information to a host computer, the digitizer system including a stylus, a digitizer sensor, circuitry for processing input received by the digitizer sensor and for determining 2D coordinates of the stylus responsive to the input received and a processing unit. The stylus includes at least one sensor for sensing input from a user in 1D and a transmitting unit for transmitting at least one signal, the signal including information sensed from the at least one sensor in the stylus. The digitizer sensor is operable to receive the at least one signal transmitted by the stylus at a location over which the stylus interacts with the digitizer sensor. The processing unit decodes the information sensed from the at least one sensor and computes 3D coordinates responsive to the 2D coordinates sensed by the digitizer sensor and the 1D information sensed by the stylus.

Description

STYLUS AND DIGITIZER FOR 3D MANIPULATION OF VIRTUAL OBJECTS

RELATED APPLICATION/S

This application claims the benefit of priority under 35 USC § 119(e) of U.S. Provisional Patent Application No. 61/621,523 filed April 8, 2012, the content of which is incorporated herein by reference in its entirety.

FIELD AND BACKGROUND OF THE INVENTION

The present invention, in some embodiments thereof, relates to a stylus operated with a digitizer system and, more particularly, but not exclusively, to 3D manipulation of virtual objects using a stylus operated with a digitizer system.

Digitizer systems are commonly used as input devices for a variety of electronic products and applications. A touch-screen is a digitizer system that is integrated with an electronic display screen. Typically digitizer systems allow a user to provide free style input with a finger and/or stylus. Some digitizer systems are intended as a general replacement for a mouse as the primary pointing and navigation device for computers.

Touch-screens are often used for operating portable devices, such as Personal Digital Assistants (PDA), tablet Personal Computers (PCs), wireless flat panel displays (FPD) screens, laptop computers, smart phones and other devices. Touch-screens are particularly useful as input devices for graphic-oriented applications such as Computer Aid Design (CAD) applications, graphic design applications and/or game applications. A finger or stylus can often be used to select, manipulate, activate and/or create objects on the screen in an intuitive manner.

U.S. Patent Application Publication No. 2012268410 entitled "Working with 3D Objects," the contents of which are incorporated herein by reference discloses a computer implemented method for modifying representation of a 3D object displayed on a touch sensitive screen with a finger or pointing device. It is disclosed that a predefined gesture input including movement of a finger or pointing device in proximity to a surface of the display is detected and distances between the finger or pointing device and a surface of the display are monitored. The representation of the 3D object is modified according to the gesture input including the distances between the finger or pointing device and the surface of the display. International Patent Application Publication No. 2011/154950 entitled "Object Orientation Detection with a Digitizer," assigned to N-Trig, the content of which is hereby incorporated by reference, describes a digitizer system that tracks position and orientation of stylus with respect to a sensing surface of the digitizer system. The stylus transmits signals from a plurality of different locations and the digitizer system tracks projected locations of the signals on the digitizer sensor and determines a geometric orientation of the stylus based on a geometric relationship between the projected locations.

U.S. Patent Application Publication No. 2010/0155153 entitled "Digitizer, Stylus and Method of Synchronization Therewith," assigned to N-Trig Ltd., the contents of which is incorporated herein by reference, describes a method for operating a digitizer with an autonomous asynchronous stylus. Typically the stylus is a self-powered stylus, e.g. battery operated stylus that transmits signal bursts at a defined rate. It is described that the signal burst transmitted by the stylus can be modulated to encode information such as identification information for identifying the stylus, pressure applied on a tip of the stylus and an operational mode of the stylus.

US Patent No. 7,843,439, entitled "Touch Detection for a Digitizer," assigned to N-Trig Ltd., the contents of which is incorporated herein by reference, describes a detector for detecting both an electromagnetic stylus emitting a signal and interaction with finger touch. The detector typically includes a digitizer sensor with a grid of sensing conductive lines for sensing location of an electromagnetic stylus and a finger. The detector is capable of detecting simultaneous occurrences of multiple styluses and/or multiple finger touches. SUMMARY OF THE INVENTION

According to an aspect of some embodiments of the present invention there is provided a stylus operated with a digitizer system that can be used to perform 3D manipulation of an object displayed on a touch-screen and/or to provide 3D information to an application running on an associated electronic device. According to some embodiments of the present invention, the stylus emits a signal for tracking its 2D position over the digitizer and also transmits encoded information, both of which are received and processed by the digitizer system. According to some embodiments of the present invention, the tracking position together with the encoded information serves as input to an electronic device for manipulating a displayed object in 3D. In some exemplary embodiments, tracked position of one or more fingers in conjunction with encoded information provided by the stylus serves as input to the electronic device for manipulating the displayed object in 3D. According to some embodiments of the present invention, the encoded information provided by the stylus is responsive to output from one or more sensors included on the stylus that are operable to sense input provided by a user holding the stylus.

According to an aspect of some embodiments of the present invention there is provided a digitizer system for communicating 3D information to a host computer, the digitizer system including: a stylus that includes: at least one sensor for sensing input from a user in ID; and a transmitting unit for transmitting at least one signal, the signal including information sensed from the at least one sensor in the stylus; a digitizer sensor operable to receive the at least one signal transmitted by the stylus at a location over which the stylus interacts with the digitizer sensor; circuitry for processing input received by the digitizer sensor and for determining 2D coordinates responsive to the input received; and processing unit operative to decode the information sensed from the at least one sensor and operative to compute 3D coordinates responsive to the 2D coordinates sensed by the digitizer sensor and the ID information sensed by the stylus.

Optionally, the stylus includes an encoder for encoding the information sensed in the at least one signal transmitted by the stylus.

Optionally, the at least one signal transmitted by the stylus includes a first signal operable to be used by the digitizer system to sense the 2D coordinates and a second signal including the information sensed from the at least one sensor in the stylus.

Optionally, the at least one sensor is a scroll wheel that is operated by a user using the stylus.

Optionally, the at least one sensor is a touch-slide positioned on a housing of the stylus and operated by a user using the stylus.

Optionally, the stylus includes at least one switch for activating/deactivating sensing or transmitting the information sensed with the at least one sensor.

Optionally, the at least one sensor is a pressure sensor for sensing pressure exerted on a tip of the stylus. Optionally, the stylus includes a switch operated by a user for switching between operating the pressure sensor for differentiating between touch and hover of the stylus and for operating the pressure sensor for sensing pressure exerted on a tip of the stylus for providing the ID information sensed by the stylus.

Optionally, the at least one sensor includes at least one IR transceiver for sensing a height of the stylus above the digitizer sensor.

Optionally, the at least one sensor includes at least one sonar transceiver for sensing a height of the stylus above the digitizer sensor.

Optionally, the at least one sensor is operative to provide indication regarding tilt or rotation of the stylus.

According to an aspect of some embodiments of the present invention there is provided a method for communicating 3D information to a host computer, the method including: sensing a position of a stylus interacting over a digitizer sensor in two dimensions with a digitizer sensor; sensing input for providing instructions in one other dimension with at least one sensor included in the stylus, the sensor providing output; defining 3D information based on the 2D position sensed with the digitizer sensor and the output from the sensor included in the stylus; and providing the 3D information to the host computer.

Optionally, the method includes: transmitting at least one signal from the stylus to the digitizer sensor; and encoding output from the at least one sensor in the at least one signal transmitted from the stylus.

Optionally, the method includes transmitting at least two signals from the stylus to the digitizer sensor, wherein the two signals include a first signal operable to be used by the digitizer system to sense the 2D coordinates and a second signal including the information sensed from the at least one sensor in the stylus.

Optionally, the stylus includes at least one switch for activating/deactivating sensing or transmitting the information sensed with the at least one sensor. Optionally, the at least one sensor is a pressure sensor for sensing pressure exerted on a tip of the stylus.

Optionally, the stylus includes a switch operated by a user for switching between operating the pressure sensor to differentiate between touch and hover of the stylus and for operating the pressure sensor for sensing pressure exerted on a tip of the stylus for providing information in the one other dimension.

Optionally, the input in one other dimension is determined responsive to tilt or rotate degree of the stylus.

According to an aspect of some embodiments of the present invention there is provided a method for communicating 3D information to a host computer, the method including: sensing a position of a stylus interacting over a digitizer sensor in two dimensions with a digitizer sensor; sensing input for providing instructions in one other dimension, wherein the input is transmitted by the stylus; defining 3D information based on the 2D position sensed with the digitizer sensor and the input transmitted by the stylus; and providing the 3D information to the host computer.

Optionally, the input transmitted by the stylus is input from at least one of a gyroscope, piezoelectric sensor or tilt sensor.

Optionally, the input transmitted by the stylus is input provided by at least two transmitting elements that are displaced from each other and wherein the input provided can be used to detect a tilt or rotation of the stylus.

Unless otherwise defined, all technical and/or scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention pertains. Although methods and materials similar or equivalent to those described herein can be used in the practice or testing of embodiments of the invention, exemplary methods and/or materials are described below. In case of conflict, the patent specification, including definitions, will prevail. In addition, the materials, methods, and examples are illustrative only and are not intended to be necessarily limiting. BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments of the invention are herein described, by way of example only, with reference to the accompanying drawings. With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of embodiments of the invention. In this regard, the description taken with the drawings makes apparent to those skilled in the art how embodiments of the invention may be practiced.

In the drawings:

FIG. 1A is a simplified block diagram of a known digitizer system that can be operated with a stylus;

FIG. IB is a simplified block diagram of a known signal transmitting stylus that is operated with a digitizer system;

FIGs. 2A and 2B are simplified block diagrams of two exemplary styluses that detect height of a tip of the stylus over a digitizer sensor in accordance with some embodiments of the present invention;

FIG. 3 is a simplified block diagram of an exemplary stylus that includes a scroll wheel for receiving 3D commands from a user in accordance with some embodiments of the present invention;

FIG. 4 is a simplified block diagram of an exemplary stylus that includes a touch slide for receiving 3D commands from a user in accordance with some embodiments of the present invention;

FIG. 5 is a simplified block diagram of an exemplary stylus that includes a button for activating use of a tip detector for providing 3D commands from a user in accordance with some embodiments of the present invention;

FIG. 6 is a simplified flow chart of an exemplary method for 3D manipulation of virtual objects with a stylus and digitizer system in accordance with some embodiments of the present invention; and

FIG. 7 is a simplified block diagram of an exemplary digitizer system that can be operated with a stylus in accordance with some embodiments of the present invention. DESCRIPTION OF SPECIFIC EMBODIMENTS OF THE INVENTION

According to an aspect of some embodiments of the present invention, there is provided a stylus operated with digitizer system that provides 3D input to an electronic device associated with the digitizer system. Traditionally, digitizer systems have been used to provide 2D input that can be used for selecting, activating, moving and/or manipulating dimensions of a virtual object displayed on a display of the electronic device. The 2D information is typically provided by tracking position of a stylus, finger or game piece on a digitizer sensing plane. According to some embodiments of the present invention, there is provided a stylus operated with a digitizer sensor that can also transmit additional information to expand control and/or manipulation of virtual object to 3D. According to some embodiments of the present invention, the information in the third dimension, e.g. the information in addition to tracking position on sensing plane is transmitted to the digitizer by the stylus as encoded data.

In some exemplary embodiment, the stylus includes a sensor for sensing height of a tip of the stylus above the sensing plane and the encoded information is output from the sensor of the stylus. Optionally, the sensor includes one or more of an InfraRed (IR) sensor and/or sonic sensor embedded in the stylus. Alternatively, the stylus includes an additional signal source such as a LED whose output is detected by one or more receivers positioned on the digitizer sensor. Optionally, height of the stylus above the digitizer sensor is determined based upon the light received from the stylus.

In some exemplary embodiments, the stylus includes one or more buttons or controls that can be manipulated by a user holding the stylus to indicate a desired input in the third dimension. Optionally, the control is in the form of a scroll wheel or a touch slide positioned on a housing of the stylus so that a user can access it. For example a user scrolling or sliding toward the tip may be interpreted in a CAD program as a desire to reduce a height or depth of an object while scrolling or sliding away from the tip may be interpreted in a desire to increase a depth of an object. Optionally, different applications may interpret input from the stylus in a different manner. In some exemplary embodiments, the stylus includes a pressure sensor associated with the tip of the stylus for detecting pressure applied by the user on the stylus tip by the user and output from the pressure sensor is used to indicate a desired input in the third dimension.

For purposes of better understanding some embodiments of the present invention, as illustrated in FIG. 2-7 of the drawings, reference is first made to the construction and operation of a known digitizer system operated with a stylus as illustrated in FIG. 1A and to the construction and operation of a known stylus operating with a digitizer system as illustrated in FIG. IB. Digitizer system 200 may be suitable for any computing device that can be operated with stylus and/or fingertip input from a user to the device, e.g. mobile and/or desktop and/or tabletop computing devices that include, for example, FPD screens. Examples of such devices include Tablet PCs, pen enabled lap-top computers, tabletop computer, PDAs or any hand held devices such as palm pilots and mobile phones, or other devices that facilitate electronic gaming.

Digitizer system 200 includes a sensor 226 constructed with patterned arrangement of conductive lines, which is optionally transparent, and which is typically overlaid on a FPD 245. Typically, sensor 226 is a grid based sensor including at set of horizontal conductive lines 221 and a set of vertical conductive lines 218. Sensor 226 can typically detect and/or track position of one or more styluses 244 and/or fingertips 246 interacting with sensor 226.

Typically, stylus 244 detected by sensor 226 emits a signal that is picked up by one or more conductive lines 218 and 221. Stylus 244 can be an active stylus that self- generates a transmitting signal with or without receiving a triggering signal from digitizer system 200 or from another source, or a passive stylus that includes a resonator arrangement that is activated in response to receiving a trigger signal from digitizer system 200 or from another source. Optionally, in active styluses the transmitting signal is formed from signal bursts transmitted at a pre-defined frequency or pattern. The signal bursts may be a modulated signal that includes encoded information regarding an operational state of the stylus. Typically, stylus 244 emits a signal at and/or near its writing tip so that a position of the writing tip can be detected and tracked by digitizer system 200.

Fingertip interaction with sensor 226 is often detected using a mutual capacitance sensing method. The change in capacitance at one or more junctions 42 in sensor 226 is detected by triggering one or more parallel conductive lines, e.g. one or more of conductive lines 218 or 221 and detecting signals crossing by virtue of the capacitance to crossing lines. Typically, the presence of a finger decreases the amplitude of the coupled signal by 5-30% and thereby can be detected. Typically, the procedure for detection includes triggering each conductive line along one axis of the sensor, optionally one line at a time, and while sampling signals on all conductive lines along the other axis. This triggering and detecting procedure is typically repeated until all the lines in the active axis have been triggered and interaction in all junction 42 points has been detected.

Typically, circuitry for operating sensor 226 is provided on one or more PCB(s) 230 positioned on or in the vicinity of sensor 226. One or more ICs (Integrated Circuits) 216 positioned on PCB(s) 230 are electrically connected to conductive lines 218 or 221 in the grid. It is appreciated that only a few connections 32 between conductive lines 218 and 221 ICs 216 are shown for clarity purposes. Typically, ICs 216 function to process the signals received from conductive lines 218 and 221 and to sample the sensor's output into a digital representation. The digital output signal is forwarded to a digital unit 220, e.g. digital IC unit also on PCB 230, for further digital processing. Typically, ICs 216 and digital unit 220 are also used to generate and/or transmit a signal to one or more conductive lines 216 and 221.

Digital unit 220 together with ICs 216 serves as a controller of digitizer system 200 and/or has functionality of a controller and/or processor. Typically, digital unit 220 together with ICs 216 includes memory and/or memory capability. Output from the digitizer system 200, e.g. calculated position and/or tracking information are typically reported to host computer 222 via interface 224. Optionally, output from digitizer system 200 is further processed by host computer 222 or an application running on host computer 222. Typically host computer 222 is integral to an electronic device.

Digitizer system 200 used to detect stylus and/or fingertip location may be, for example, similar to digitizer systems described in incorporated U.S. Patent No. 6,690,156, U.S. Patent No. 7,292,229 and/or U.S. Patent No. 7,372,455. According to some embodiments of the present invention, digitizer system 200 is an exemplary digitizer system that can be modified to support 3D manipulation of virtual objects. It will also be appreciated that other digitizer systems and/or touch screens can be similarly modified in accordance with some embodiments of the present disclosure, depending on their construction.

Reference is now made to FIG. IB showing a simplified block diagram of a known signal transmitting stylus that is operated with a digitizer system. A stylus 244 generates pulses of energy and transmits the pulses of energy with a signal generator included in controller 333 and/or transmitting unit 384. Optionally, controller 333 and/or and transmitting unit 384 generates one or more AC signal bursts, e.g. a train of pulses (signal bursts). Optionally, the AC pulses have a frequency content selected between 20-40 KHz. Typically, controller 333 generates pulses having frequency other than the frequencies typically used to detect fingertip touch on digitizer sensor 226. Optionally, specific time slots for fingertip touch detection and stylus detection are defined to avoid close frequencies. Typically, stylus 244 is powered by power source 387. Typically, power source 387 includes one or more batteries, e.g. 4A alkaline battery. Optionally, tip 363 of stylus 244 is operative as an antenna and/or an electric dipole of transmission unit 384. For example, one output of transmitting unit 384 is electrically connected to stylus tip 363 (typically constructed from a conductive material) while the other end is electrically connected to a frame 311 (which likewise includes an area of conductive material) surrounding tip 363. An electric field, synchronized to a generated signal pulse, is formed in a small gap located between tip 363 and frame 311 at an end of tip 363 extending outside housing 311. Optionally, stylus 244 is a pressure sensitive stylus that transmits information regarding contact pressure applied to tip 363. Typically, a tip pressure sensor 335 senses contact pressure applied to tip 363 and based on the sensed contact pressure level, the pulse generated by pulse generator 363 is altered and/or defined. Optionally, output from tip pressure sensor 335 is encoded on pulse generated by controller 333. One or more encoding methods selected from Amplitude Shift Keying (ASK), Phase Shift Keying (PSK) and Frequency Shift Keying (FSK) are typically used to encode information. Optionally, the encoded information is transmitted over a plurality of transmission cycles. For example one bit of encoded information is transmitted per transmission cycle.

Stylus 244 may be, for example, similar to styluses described in incorporated US Patent Application Publication No. 20080128180 and/or in incorporated International Patent Application Publication No. 2011/154950. Optionally, stylus 244 may be similar to styluses described in US Patent Application Publication No. 2010-0155153-A1 entitled "Digitizer, Stylus and Method of Synchronization Therewith," US Patent Application Publication No. 2010-0051356-A1 entitled "Pressure Sensitive Stylus for a Digitizer," and/or 2009-0078476-A1 entitled "Method for Identifying Changes in Signal Frequencies Emitted by a Stylus Interacting with a Digitizer Sensor" all of which are incorporated herein by reference in their entirety and for all purposes.

According to some embodiments of the present invention, stylus 244 is an exemplary stylus that can be modified to support 3D manipulation of virtual objects. It will also be appreciated that other styluses known in the art can be similarly modified in accordance with some embodiments of the present depending on their construction.

Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not necessarily limited in its application to the details of construction and the arrangement of the components and/or methods set forth in the following description and/or illustrated in the drawings and/or the Examples. The invention is capable of other embodiments or of being practiced or carried out in various ways.

Reference is now made to FIGS. 2A and 2B showing a simplified block diagram of an exemplary stylus that detects a height of a tip of the stylus over a digitizer sensor in accordance with some embodiments of the present invention. According to some embodiments of the present invention, a stylus includes a sonar sensor 321 (FIG. 2A) or IR sensor 341 (FIG. 2B) for sensing a height of the stylus over a surface on which it is interacting, e.g. sensor 226. Referring now to FIG. 2A, according to some embodiments of the present invention, a sonar sensor 321, e.g. a sonar transceiver is positioned within and/or on a housing 311 of stylus 305. Optionally, sonar sensor 321 operates in an ultrasound range. Optionally sonar transceiver 321 is positioned on or near a tip pressure sensor 335 of stylus 305 and/or proximal to a writing tip and/or a pointing tip 363 of stylus 305. Typically, sonar sensor 321 emits a sonar signal, and measures the time difference between emitting the sonar signal and receiving an echo of the sonar signal. The present inventor has found that although multiple echo signals may be received by the transceiver, the first echo signal is likely to be received from the nearest point on a surface over which stylus 305 interacts, which indicates a height of sonar sensor 321 over the surface, e.g. the digitizer sensor. Optionally, stylus 305 includes a plurality of sonar sensors 321 that can be used to improve height detection of stylus 305.

Referring now to FIG. 2B, according to some embodiments of the present invention, an IR sensor 341, e.g. an IR transceiver is used in a similar manner. According to some embodiments of the present invention IR sensor 341 is positioned on housing 311 of a stylus 306 so that a line of sight can be established between IR sensor 341 and a surface over which stylus 306 is interacting. Typically, IR sensor 341 is positioned in an area of housing 311 that is not expected to be obstructed by a user handing the stylus. In some embodiments, stylus 306 may be designed such that when the stylus is held by a user, sensor 341 is exposed and has a line of sight to the digitizer. Typically, when using an IR sensor 341, an IR wave is emitted and an intensity of the reflected light can be used as an indication of a height of IR sensor 341 over the surface, e.g. the digitizer sensor. In some exemplary embodiments, IR sensor 341 is integrated on an end of tip 363 that extends out from housing 311. Optionally, stylus 306 includes a plurality of IR sensors so that at least one IR sensor 341 has an unobstructed line of sight and can be used for detecting height. Optionally, output from the plurality of IR sensors that are displaced from one another is used to determine height of stylus 306 with more accuracy.

According to some embodiments of the present invention, output from sonar sensor 321 or IR sensor 341 providing information regarding a height of the stylus is received by a controlling and/or processing unit 333 and information received is encoded in a signal transmitted by a transmitting unit 384. Typically, transmitting unit 384 also transmits a signal that is used by the receiving digitizer system for detecting 2D position of the stylus on a digitizing surface. Typically, the height information is transmitted by transmitting unit 384 in a manner that is similar to a manner in which other information, such as ID, pressure or button information, is typically transmitted by known styluses. According to some embodiments of the present invention, the signal transmitted by transmitting unit 384 is picked up and processed by a digitizer system.

According to some embodiments of the present invention, stylus 305 and/or 306 additionally include one or more buttons 377 positioned on housing 311 from which a user can select to activate and deactivate transmission of output from sonar sensor 321 and/or IR sensor 341. Alternatively, height information as sensed by sonar sensor 321 and/or IR sensor 341 is transmitted continuously and/or is always transmitted.

According to some embodiments of the present invention, the height as detected by stylus 305 or stylus 306 is tracked and used to alter a height and/or depth of a 3D object displayed on a touch-screen on which stylus 305 is interacting. Optionally the height as detected by stylus 305 or stylus 306 is used to manipulate moving an object in and/or out of the sensing plane. Optionally, the height as detected by stylus 305 or stylus 306 is used to alter other parameters associated with an object displayed on a touch-screen, e.g. weight of the object, temperature of the object. Optionally, the manner in which the height is detected by stylus 305 or stylus 306 is used by an application depends on the application running on the associated electronic device, e.g. different applications can use the height information in different ways. Typically, stylus 305 and stylus 306 are powered by a powering unit 387, e.g. with one or more batteries.

Reference is now made to FIG. 3 showing a simplified block diagram of an exemplary stylus that includes a scroll wheel for receiving 3D commands from a user in accordance with some embodiments of the present invention. According to some embodiments of the present invention, 3D information may be provided with a control added to the stylus, such as a wheel 389 placed on a housing 311 of stylus 307. In some exemplary embodiments, scroll wheel 389 is similar to a scroll wheel commonly used on a mouse. Typically, scroll wheel 389 is integrated with a sensor 391 that detects rotation of scroll wheel 389, e.g. direction and angle of rotation. Optionally, a user can provide instructions for manipulating a third dimension of a virtual object by scrolling wheel 389. Optionally, scrolling the wheel in one direction can be used to indicate a desire to increase a depth value of an object, while scrolling it in the other direction can be used to indicate a desire to decrease a depth value of an object. Optionally, scrolling can be used to indicate a desire to rotate an object in and/or out of a plane of the touch screen. Optionally, the extent or rate of the rotating is used to indicate an extent or rate of the change in depth or height. Optionally, scrolling can be used to indicate other commands and/or a function of scroll wheel 389 can be defined by an application running on the electronic device. According to some embodiments of the present invention, operation of scroll wheel 389 and/or sensor 391 is controlled by controller 333 and the output detected from scroll wheel 389 is transmitted with a transmitting unit 384 of stylus 307. Optionally, output from scroll wheel 389 and/or sensor 391 is transmitted, e.g. with transmitting unit 384 to an associated digitizer system in a manner that is similar to a manner in which other information, such as ID, pressure or button information, is typically transmitted with known styluses.

Reference is now made to FIG. 4 showing a simplified block diagram of an exemplary stylus that includes a touch slide for receiving 3D commands or indications from a user in accordance with some embodiments of the present invention. According to some embodiments of the present invention, a stylus 309 includes touch slide 379 operated by sliding a finger along touch-sensitive area of slide 379. Typically, touch slide 379 is positioned on housing 311 of stylus 309 so that a user can slide a finger, e.g. a thumb over touch slide 379 to indicate a command or other input. In some exemplary embodiments, sliding a finger towards tip 363 of stylus 309 indicates a desire to decrease a depth value or height of an object displayed on an associated touch-screen, while sliding a finger away from a tip indicates a desire to increase a depth value or height of the object. Optionally, the extent or rate of the sliding is used to indicate an extent or rate of the change in depth or height. Optionally, touch slide 379 can be used to indicate other commands that can be defined by an application running on the electronic device. According to some embodiments of the present invention, operation of touch slide 379 is controlled by controller 333 and output detected from touch slide 379 is transmitted by transmitting unit 384 of stylus 307. Optionally, output from touch slide 379 is transmitted, e.g. by transmitting unit 384 to an associated digitizer system in a manner that is similar to a manner in which other information, such as ID, pressure or button information, is typically transmitted with known styluses.

FIG. 5 is a simplified block diagram of an exemplary stylus that includes a button for activating use of a tip detector for providing 3D commands from a user in accordance with some embodiments of the present invention. According to some embodiments of the present invention, a stylus 310 includes a button and/or switch 377 that can be activated when a user desires to provide 3D information with stylus 310. Typically, stylus 310 includes tip pressure sensor 335 for sensing a pen-down state and/or a touch state of tip 363, e.g. to differentiate between the pen-down state and a pen-up (hover) state, and to sense the amount of pressure exerted by a user on the stylus against a rigid plane such as the digitizer. According to some embodiments of the present invention, in response to activating button 377, tip pressure sensor 335 is used instead to specifically sense instructions from a user for manipulating a third dimension of a virtual object displayed on an associated touch screen. Optionally, button 377 is a toggle button that can be used to toggle between using tip pressure sensor 335 for 3D manipulation and using tip pressure sensor 335 for differentiating between touch state and hover state of stylus 310 during a standard operation of stylus 310. In some exemplary embodiments, a magnitude of the pressure applied on tip 363 is related to a desired change in depth or height of the virtual object displayed on the touch-screen. Alternatively, output from tip pressure sensor 335 is used to indicate other instructions for 3D manipulation of virtual objects displayed the touch-screen. Optionally, to manipulate a virtual object displayed on the touch-screen in 3D, a user first selects the virtual object by touching the virtual object with tip 363 in a standard mode of stylus 310. Optionally, once selected, a user activates button 377 and applies pressure on tip 363 to obtain a desired 3D effect. Optionally, a user applies pressure on tip 363 while also moving stylus 310 over a plane of the touch-screen to obtain a desired 3D effect. Optionally, pressure applied on the housing of the stylus is sensed and used to provide indication that a user desires to provide 3D instructions with the stylus, e.g. a double tap on the housing indicates a user's desire to provide 3D instructions with the stylus. Optionally, a location at which pressure is applied on the housing, e.g. near the tip or near the tail end of the stylus is detected and used to indicate a user' s desire to switch to a mode for providing 3D instructions. Optionally, the location at which pressure is applied on the housing, e.g. near the tip or near the tail end of the stylus is interpreted as a 3D command. Optionally, the area of the stylus at which the user holds the stylus, e.g., near the tip or near the tail end of the stylus may indicate a user' s desire to switch to a mode for providing 3D instructions, or may be interpreted as a 3D command.

Optionally, a stylus includes one or more sensors from which tilt and/or rotation and/or other manipulation can be determined and a user may provide instructions for manipulating a virtual object in a third dimension by tilting and/or rotating the sensor. Tilt or rotation may be sensed by the stylus and/or by the digitizer based on output emitted by the stylus, for example as described in incorporated International Patent Application Publication No. 2011/154950. Alternatively, one or more sensors, e.g. cameras, gyroscope, and/or piezoelectric sensor are used to detect a 3D gesture performed by the stylus for manipulating a virtual object in a third dimension Optionally, the stylus includes distinct parts thereon, such as parts having distinct color that can be easily located.

Reference is now made to FIG. 6 showing a simplified flow chart of an exemplary method for 3D manipulation of virtual objects with a stylus and digitizer system in accordance with some embodiments of the present invention. According to some embodiments of the present invention, a stylus is used in conjunction with a digitizer system, and touch and/or hover 2D location indication of the stylus relatively to the sensor is determined (block 300). Typically, the 2D location relates to one or more grid junctions of the sensor, to which the stylus is closest. According to some embodiments of the present invention, additional information for manipulating an object displayed in an associated electronic display in 3D is received by sensor 226 from an interacting stylus (block 304). Optionally, the additional information relates to the distance between the stylus and the sensor. According to some embodiments of the present invention, the additional information and optionally the 2D information are transferred to the host computer (block 308). The additional information and optionally the 2D information may be used by the host computer or by an application executed by the computer as 3D information (block 312). The information may be used, for example to set the location of the virtual object within an application, to set a property of the virtual object such as depth, or the like.

Reference is now made to FIG. 7 showing a simplified block diagram of an exemplary digitizer system that can be operated with a stylus in accordance with some embodiments of the present invention. According to some embodiments of the present invention, digitizer system 201 digitizer system 201 is similar in some respects to digitizer system 200 (FIG. 1) and in addition includes dedicated circuitry for supporting a stylus 350 that provides information for manipulating an object displayed on an FPD 245. Optionally, stylus 350 is selected from one of stylus 305, stylus 306 and stylus 310 described herein. According to some embodiments of the present invention, digital unit 220 includes a 3D command processor 261 for determining 3D coordinates and/or 3D commands based on input received from stylus 350. Typically, a 3D command processor 261 is operable to identify when 3D input is received from stylus 350 and to translate input received from stylus 350 to input that can be used by host computer 222. In some exemplary embodiments, a height of stylus 350 over sensor 226 is determined, e.g. calculated and reported to host computer 222 together with 2D coordinates of stylus 350 at all times, and whether or not it is used depends on the active application or applications. Optionally, changes in heights of stylus 350 are reported to host computer 222. In other exemplary embodiments, the heights may be determined only in certain modes which are selected by the user. Optionally, a user may activate a 3D mode by activating a button 377 and/or by performing a pre-defined gesture with stylus 350 and/or a fingertip concurrently interacting with the digitizer system 201. Typically, exiting a 3D mode and/or deactivating a 3D mode may be initiated in a similar manner.

In some exemplary embodiments, stylus 350 transmits at least one signal that provides information that can be picked up by sensor 226 and used as a third dimension. Optionally, the at least one signal can also be used by digitizer system 201 for locating a position of tip 363 of stylus 350 in relation to the grid of sensor 226. Typically, position of tip 363 of stylus 350 in relation to the grid of sensor 226 provides information in 2D, e.g. is used to manipulate the virtual object in 2D. In some exemplary embodiments, the signal transmitted by stylus 350 is encoded with the information sensed in the third dimension. Optionally, 3D command processor 261 decodes the information transmitted by stylus 350 and translates the information to information that can be reported to host computer 222. Optionally, a first signal burst is transmitted for locating the position of tip 363 of stylus 350 in relation to the grid of sensor 226 and an additional signal burst(s) is transmitted for providing the information in the third dimension.

According to some embodiments of the present invention, the 3D coordinates and/or 3D command is reported to host computer 222 and used by an application 265 that supports 3D manipulation. Typically, 3D information reported to host computer 222 may be used by the operating system of host computer 222 and/or with any application executed by the host computer 222. Optionally, 3D information is used in a design or drawing application. Optionally in a design or drawing application, a user may select an object, move the object in 3D and/or change a dimension of the object. Optionally 3D information is used in spreadsheet applications or the like. Optionally, in spreadsheet applications, input from stylus 350 is used construct graphs and/or to provide data from which the graph is constructed. The terms "comprises", "comprising", "includes", "including", "having" and their conjugates mean "including but not limited to".

The term "consisting of means "including and limited to".

It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination or as suitable in any other described embodiment of the invention. Certain features described in the context of various embodiments are not to be considered essential features of those embodiments, unless the embodiment is inoperative without those elements.

Claims

WHAT IS CLAIMED IS:

1. A digitizer system for communicating 3D information to a host computer, the digitizer system comprising:

a stylus comprising:

at least one sensor for sensing input from a user in ID; and a transmitting unit for transmitting at least one signal, the signal including information sensed from the at least one sensor in the stylus;

a digitizer sensor operable to receive the at least one signal transmitted by the stylus at a location over which the stylus interacts with the digitizer sensor;

circuitry for processing input received by the digitizer sensor and for determining 2D coordinates responsive to the input received; and

processing unit operative to decode the information sensed from the at least one sensor and operative to compute 3D coordinates responsive to the 2D coordinates sensed by the digitizer sensor and the ID information sensed by the stylus.

2. The digitizer system according to claim 1, wherein the stylus includes an encoder for encoding the information sensed in the at least one signal transmitted by the stylus.

3. The digitizer system according to claim 1 or claim 2, wherein the at least one signal transmitted by the stylus includes a first signal operable to be used by the digitizer system to sense the 2D coordinates and a second signal including the information sensed from the at least one sensor in the stylus.

4. The digitizer system according to any one of claims 1-3, wherein the at least one sensor is a scroll wheel that is operated by a user using the stylus.

5. The digitizer system according to any one of claims 1-4, wherein the at least one sensor is a touch-slide positioned on a housing of the stylus and operated by a user using the stylus.

6. The digitizer system according to any one of claims 1-5, wherein the stylus includes at least one switch for activating/deactivating sensing or transmitting the information sensed with the at least one sensor.

7. The digitizer system according to any one of claims 1-6, wherein the at least one sensor is a pressure sensor for sensing pressure exerted on a tip of the stylus.

8. The digitizer system according to claim 7, wherein the stylus includes a switch operated by a user for switching between operating the pressure sensor for differentiating between touch and hover of the stylus and for operating the pressure sensor for sensing pressure exerted on a tip of the stylus for providing the ID information sensed by the stylus.

9. The digitizer system according to any one of claims 1-6, wherein the at least one sensor includes at least one IR transceiver for sensing a height of the stylus above the digitizer sensor.

10. The digitizer system according to any one of claims 1-6, wherein the at least one sensor includes at least one sonar transceiver for sensing a height of the stylus above the digitizer sensor.

11. The digitizer system according to any one of claims 1-10, wherein the at least one sensor is operative to provide indication regarding tilt or rotation of the stylus.

12. A method for communicating 3D information to a host computer, the method comprising:

sensing a position of a stylus interacting over a digitizer sensor in two dimensions with a digitizer sensor;

sensing input for providing instructions in one other dimension with at least one sensor included in the stylus, the sensor providing output;

defining 3D information based on the 2D position sensed with the digitizer sensor and the output from the sensor included in the stylus; and providing the 3D information to the host computer.

13. The method according to claim 12, comprising:

transmitting at least one signal from the stylus to the digitizer sensor; and encoding output from the at least one sensor in the at least one signal transmitted from the stylus.

14. The method according to claim 12 or claim 13, comprising transmitting at least two signals from the stylus to the digitizer sensor, wherein the two signals include a first signal operable to be used by the digitizer system to sense the 2D coordinates and a second signal including the information sensed from the at least one sensor in the stylus.

15. The method according to any one of claims 12-14, wherein the at least one sensor is a scroll wheel that is operated by a user using the stylus.

16. The method according to any one of claims 12-15, wherein the at least one sensor is a touch-slide positioned on a housing of the stylus and operated by a user using the stylus.

17. The method according to any one of claims 12-16, wherein the stylus includes at least one switch for activating/deactivating sensing or transmitting the information sensed with the at least one sensor.

18. The method according to any one of claims 12-17, wherein the at least one sensor is a pressure sensor for sensing pressure exerted on a tip of the stylus.

19. The method according to claim 18, wherein the stylus includes a switch operated by a user for switching between operating the pressure sensor to differentiate between touch and hover of the stylus and for operating the pressure sensor for sensing pressure exerted on a tip of the stylus for providing information in the one other dimension.

20. The method according to any one of claims 12-17, wherein the at least one sensor includes at least one IR transceiver for sensing a height of the stylus above the digitizer sensor.

21. The method according to any one of claim 12-17, wherein the at least one sensor includes at least one sonar transceiver for sensing a height of the stylus above the digitizer sensor.

22. The method according to any one of claims 12-17, wherein the input in one other dimension is determined responsive to tilt or rotate degree of the stylus.

23. A method for communicating 3D information to a host computer, the method comprising:

sensing input for providing instructions in one other dimension, wherein the input is transmitted by the stylus;

defining 3D information based on the 2D position sensed with the digitizer sensor and the input transmitted by the stylus; and

providing the 3D information to the host computer.

24. The method according to claim 23, wherein the input transmitted by the stylus is input from at least one of a gyroscope, piezoelectric sensor or tilt sensor.

25. The method according to claim 23 or claim 24, wherein the input transmitted by the stylus is input provided by at least two transmitting elements that are displaced from each other and wherein the input provided can be used to detect a tilt or rotation of the stylus.