AU4179499A - Input unit, method for using the same and input system - Google Patents

Input unit, method for using the same and input system Download PDF

Info

Publication number
AU4179499A
AU4179499A AU41794/99A AU4179499A AU4179499A AU 4179499 A AU4179499 A AU 4179499A AU 41794/99 A AU41794/99 A AU 41794/99A AU 4179499 A AU4179499 A AU 4179499A AU 4179499 A AU4179499 A AU 4179499A
Authority
AU
Australia
Prior art keywords
input unit
image
function
images
inputting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
AU41794/99A
Other versions
AU758036B2 (en
Inventor
Petter Ericson
Christer Fahraeus
Ola Hugosson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anoto Group AB
Original Assignee
C Technologies AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE9801535A external-priority patent/SE511855C2/en
Priority claimed from SE9803455A external-priority patent/SE513940C2/en
Application filed by C Technologies AB filed Critical C Technologies AB
Publication of AU4179499A publication Critical patent/AU4179499A/en
Application granted granted Critical
Publication of AU758036B2 publication Critical patent/AU758036B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/142Image acquisition using hand-held instruments; Constructional details of the instruments
    • G06V30/1423Image acquisition using hand-held instruments; Constructional details of the instruments the instrument generating sequences of position coordinates corresponding to handwriting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • G06F3/0317Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Image Input (AREA)
  • Position Input By Displaying (AREA)
  • Character Input (AREA)
  • Facsimile Scanning Arrangements (AREA)

Description

WO99/60468 PCT/SE99/00718 1 INPUT UNIT, METHOD FOR USING THE SAME AND INPUT SYSTEM Field of the Invention The present invention relates to an input unit hav ing a mouse function and at least one inputting function, which input unit comprises image-recording means for pro viding the inputting function. The invention also relates 5 to a method for providing a mouse function and at least one inputting function with the aid of an input unit, as well as an input system having a mouse function and at least one inputting function. Background of the Invention Today, personal computers are usually equipped with 10 a computer mouse, which is used for positioning a cursor on the computer screen. The positioning is carried out by the user passing the mouse over a surface, the hand move ment thus indicating how the mouse should be positioned. The mouse generates positioning signals indicating how 15 the mouse is being moved and thus how the cursor should be moved. For this purpose, the mouse usually has a track ball, which turns as a result of friction against the surface when the mouse is passed over the same and which in this connection drives position sensors which in turn 20 generate the positioning signals. Normally, the mouse can also be used for providing instructions to the computer by the intermediary of one or more buttons on which the user clicks. However, when the term "mouse function" is used below it only refers to the function of positioning 25 a cursor or the like. To input text and images into a computer a hand-held scanner is sometimes used, which images the text or image which is to be input with the aid of a light-sensitive sensor. The scanner can only image a very limited text/ 30 image area at one time. Consequently, in order to record one or several words or a whole image, the scanner must be passed over the text/image and several sub-images must WO99/60468 PCT/SE99/00718 2 be recorded. Usually, the scanner has some kind of posi tion sensor which determines how these sub-images should be stored in the computer to enable the creation of a composite image therefrom. 5 It is known to combine a mouse function and an inputting function in a casing which is connected with a single flex to a computer. US 4,906,843, for example, shows a combined mouse, optical scanner, and digitising pad. In the mouse mode, 10 a track ball is used, which drives two position sensors, which generate the positioning signals. In the scanner mode, a CCD line sensor as well as the position sensors are used for inputting characters or graphical informa tion to the computer. 15 US 5,355,146 shows a similar input unit with a com bined mouse function and scanner function, which also utilises a track ball and a CCD line sensor. EP 0 782 321 shows yet another input unit having a mouse function and scanner function. In this case, too, 20 a track ball is used for the mouse function but instead of the line sensor, use is made of an area sensor which is capable of imaging a document in a single step and which thus need not be moved across the document. This is said to have the advantage that no software is requir 25 ed for correlating image data with position data. US 5,633,489 shows a combined mouse and barcode reader, where the mouse function is provided by means of a track ball and the barcode reader comprises a laser diode which generates a laser beam emitted from the 30 underside of the mouse and a photo detector which detects the varying intensity of the reflected light. All these known input units have a rather complicat ed mechanical design with moving parts and many sensors. Moreover, they only provide limited synergies between the 35 functions combined in one and the same casing.
WO 99/60468 PCT/SE99/00718 3 Summary of the Invention It is thus an object of the present invention to provide an input unit having a mouse function and at least one inputting function as well as a method for providing the mouse function and the inputting function 5 with the aid of the input unit, which input unit and which method reduce the above-mentioned deficiencies. This object is achieved by an input unit according to claim 1, a method according to claim 19, and an input system according to claim 24. Preferred embodiments are 10 stated in claims 2-18 and claims 20-23 respectively. An input unit according to the invention thus comprises image-recording means for providing said inputting function, with the image-recording means also being used to provide the mouse function. 15 Instead of using the image-recording means for only one of these functions, according to the present inven tion they are used to provide both the mouse function and the inputting function, whereby improved integration of these functions is achieved. Furthermore, the track ball 20 can be omitted and both functions can be based on the same sensor technology so that the signals for both func tions can be handled by the same hardware and/or soft ware. Thereby, real integration of the two functions is obtained rather than the two simply being brought toge 25 ther in the same casing as in the prior art. In addition, it becomes possible to provide an input unit without mov ing parts, which is advantageous from the point of view of durability and manufacturing. As will be evident below, it is also possible to provide an input unit which 30 requires neither special position-determination means nor additional aids in the form of a raster or the like. In this context, it should be noted that in this patent specification the term inputting function refers to a function whereby the user can input information to a 35 receiver for storing and processing in the same, unlike WO99/60468 PCT/SE99/00718 4 the mouse function which is used for positioning pur poses. Furthermore, it should be noted that the mouse func tion can be used for positioning a cursor or the like in 5 a plane or in space. More specifically, the input unit is advantageously adapted to emit positioning signals for providing the mouse function, as well as inputting signals for provid ing said inputting function, the positioning signals as 10 well as the inputting signals being based on images recorded by means of the image-recording means. The posi tioning signals can be used for controlling a cursor on a computer screen, while the inputting signals can contain information which is to be input to the computer. 15 The positioning signals and the inputting signals can be emitted as electrical signals on leads, as IR sig nals, as radio signals, or in some other suitable way. Naturally, the input unit can also emit signals other than the positioning signals and the inputting signals, 20 e.g. instruction signals based on clickings. The receiver of the signals can be a computer or some other input unit to which positioning information and/or other information is to be input. The input unit is especially suitable for use with small portable computers where it is desirable 25 to have few, but versatile, accessories. The image-recording means may comprise a first image-recording unit for providing the mouse function and a second image-recording unit for providing the inputting function. This may be particularly advantageous if diffe 30 rent image-recording characteristics are desired for the two functions, e.g. if different foci are desired for the image-recording. For example, when using the mouse func tion one may wish to be able to move the input unit across a surface in the same way as one would move a tra 35 ditional mouse, and when using the inputting function one may wish to be able to use the input unit as a camera for imaging objects located at a distance from the unit. In WO99/60468 PCT/SE99/00718 5 this case, the different image-recording units can be provided with different lens means with different foci. The image-recording units can, for example, be located on different sides of the input unit, but have shared hard 5 ware and software. Alternatively, the image-recording means may com prise an image-recording unit which is used for providing both the mouse function and the inputting function. This embodiment is advantageous because it requires fewer com 10 ponents in the input unit and only one beam path. The image-recording units may comprise any type of sensor which can be used for recording an image but should preferably be a light-sensitive sensor with a two dimensional sensor surface, a so-called area sensor. 15 In a less complex embodiment of the input unit, both the positioning signals and the inputting signals may essentially consist of the actual images recorded by the image-recording means. In this case, essentially all pro cessing of the images takes place in the receiver of the 20 signals, e.g. in a computer. If so, the latter must have software for processing the signals in a suitable manner. Such software may already be stored in the computer or may, for example, be included in the input unit according to the invention and be transferred to the receiver when 25 the input unit is in use. The receiver of the signals from the input unit must be capable of determining whether the signals are intend ed as positioning signals or as inputting signals so that it will know how to process the signals. For this pur 30 pose, the input unit is adapted to output the positioning signals and the inputting signals in such a way that the receiver can identify whether it is receiving positioning signals or inputting signals. For example, the input unit may use different protocols for the different signals. 35 Suitably, the input unit should also know whether the user wishes to use the mouse function or the input ting function so that it will know how the images record- WO99/60468 PCT/SE99/00718 6 ed by the image recorder should be processed. For this purpose, the input unit preferably comprises switching means, e.g. a button, which are adapted to switch the input unit between its different functions when acted 5 upon by the user. Preferably, at least for the mouse function, the image-recording means are adapted to record a plurality of images in such a way that the contents of each image overlap the contents of the previous image, if any. This 10 can be achieved by recording the images with sufficiently high frequency in relation to the expected speed of move ment. By virtue of the fact that the images overlap, their relative positions are determined and there is no need to use special position-determination means. 15 Once the images have been recorded the subsequent processing can take place either in image-processing means in the input unit or in the receiver of the sig nals from the input unit. The advantages of processing at least the inputting signals in the input unit are that, 20 in this way, the input unit can be used as a stand-alone unit without being connected to an adjacent receiver, that information which has been input can be shown directly on a display on the input unit so that the user can check that the information recorded really is the 25 information he intended to record, and that the informa tion can be transferred in a more compressed format to the receiver. Furthermore, the input unit can be connect ed to any receiver that supports a mouse with no special software being required in the receiver for processing 30 the images. Thus, the input unit advantageously comprises image processing means used for both the mouse function and the inputting function. These image-processing means may com prise a processing unit operating according to different 35 program modules depending upon which function of the input unit is being used.
WO99/60468 PCT/SE99/00718 7 Moreover, for processing the images in the input unit, the input unit advantageously comprises means for determining the relative position of the images with the aid of the partially overlapping contents. The means for 5 determining the relative position of the images may be included in the shared image-processing means and be implemented by means of software. If the mouse function is used for linear positioning only, it is sufficient to determine the relative position 10 of the images horizontally. However, if it is to be used for two-dimensional positioning, the relative position must be determined both horizontally and vertically. In an advantageous embodiment, the input unit com prises means for generating the positioning signals on 15 the basis of the relative position of the images. The positioning signals can, for example, be composed of one or more vectors indicating how the input unit has been moved between the recording of two images, or of one or more positioning coordinates. The means for generating 20 the positioning signals can also be included in the shared image-processing means and be implemented by means of software. The input unit is advantageously hand-held so that it can be carried everywhere. This technology thus 25 enables the user to have a personal mouse and input unit with stored personal settings and personal information. In a particularly advantageous embodiment, the input unit also comprises a transmitter for wireless connection of the input unit to a receiver, which further facili 30 tates the use of the input unit. The Bluetooth standard can advantageously be used for this purpose. Advantageously, the inputting function comprises a scanner function so that the input unit can be used for recording text and/or images. 35 The inputting function can also comprise a camera function, wherein the image-recording means are utilised WO99/60468 PCT/SE99/00718 8 for imaging objects located at a distance from the input unit. The inputting function can also comprise a function for inputting handwritten/drawn, i.e. hand-generated 5 information. Each of the scanner function, the camera function, and the handwriting/drawing function can be the only inputting function or one of several inputting func tions. The input unit can thus have a plurality of func 10 tions, all of which are based on images which are record ed by the image-recording means and which are processed efficiently by means of shared hardware and software. According to a second aspect to the invention, it relates to a method for providing a mouse function and 15 at least one inputting function with the aid of an input unit, comprising the steps of detecting which of said functions is desired; recording at least one image with the aid of the input unit; and processing said at least one image in different ways depending upon which of said 20 functions is desired. The advantages of the method according to the inven tion are evident from the above description of the input unit according to the invention. According to a third aspect of the invention, it 25 relates to an input system having a mouse function and at least one inputting function, comprising image-recording means for recording images and image-processing means for processing the images recorded by the image-recording means for providing the mouse function and said at least 30 one inputting function, the image-recording means being located in a first casing and the image-processing means being located in a second casing. Accordingly, the input system comprises the case where the image-recording means are located in an input 35 unit and the image-processing means are located in a com puter or other receiver to which the input unit is con nected and to which it transmits recorded images. Every- WO99/60468 PCT/SE99/00718 9 thing that has been stated above with respect to the image-recording means and the processing of the images recorded by the image-recording means also applies to the input system. Brief Description of the Drawings 5 The present invention will now be described in more detail by way of an embodiment with reference to the accompanying drawings, in which Fig. 1 schematically shows an embodiment of an input unit according to the invention; 10 Fig. 2 is a block diagram of the electronic cir cuitry in an embodiment of an input unit according to the invention; Fig. 3 is a flowchart of the mouse function; Fig. 4 is a flowchart of the handwriting/drawing 15 function; Fig. 5 schematically shows how a surface is imaged in connection with the inputting of handwritten informa tion; Fig. 6 shows how the handwritten input can be shown 20 on a display; Fig. 7 is a flowchart of the scanner function; Figs 8a-8c schematically show how text is recorded in the scanner mode; and Fig. 9 is a flowchart of the camera function. Description of a Preferred Embodiment 25 The following is a description of an embodiment of an input unit according to the invention having a mouse function, a scanner function, a camera function, as well as a function for inputting handwritten/drawn informa tion. Design of the Unit 30 Fig. 1 shows the design of the input unit accord ing to this embodiment. The unit has a casing 1 having approximately the same shape as a conventional high lighter pen. One short side of the casing has a window 2, WO99/60468 PCT/SE99/00718 10 by the intermediary of which images are recorded for the various image-based functions of the input unit. The casing 1 essentially contains an optics part 3, an electronic circuitry part 4, and a power supply 5. 5 The optics part 3 comprises a light-emitting diode 6, a lens system 7, and an image-recording means in the form of a light-sensitive sensor 8, which constitutes the interface with the electronic circuitry part 4. The task of the LED 6 is to illuminate a surface 10 which is currently located under the window. A diffuser 9 is mounted in front of the LED 6 for diffusing the light. The lens system 7 has the task of projecting an image of the surface located under the window 2 on the light-sensitive sensor 8 as accurately as possible. The 15 lens system is displaceable between two positions, the second of which is indicated by dashed lines. The first position is used when images are to be recorded of a surface located directly below the window of the input unit and is primarily intended for the mouse function, 20 the scanner function, and the handwriting/drawing func tion. The second position is used when images are to be recorded of objects located at a distance from the input unit and is primarily intended for the camera function, but can also be used for the other functions. 25 In this example, the light-sensitive sensor 8 com prises a two-dimensional, square CCD unit (CCD = charge coupled device) with a built-in A/D converter. Such sen sors are commercially available. The sensor 8 is mounted at a small angle to the window 2 and on its own circuit 30 board 11. The power supply to the input unit is obtained from a battery 12 which is mounted in a separate compartment 13 in the casing. The block diagram in Fig. 2 schematically shows the 35 electronic circuitry part 4. This comprises a processor 20, which by the intermediary of a bus 21 is connected to a ROM 22, in which the programs of the processor are WO99/60468 PCT/SE99/00718 11 stored, to a read/write memory 23, which constitutes the working memory of the processor and in which the images from the sensor are stored, to a control logic unit 24, as well as to the sensor 8 and the LED 6. The processor 5 20, the bus 21, the memories 22 and 23, the control logic unit 24, as well as associated software together consti tute image-processing means. The control logic unit 24 is in turn connected to a number of peripheral units, comprising a display 25, 10 which is mounted in the casing, a radio transceiver 26 for transferring information to/from an external compu ter, buttons 27, by means of which the user can control the input unit and specifically adjust the input unit between the mouse function, the scanner function, the 15 camera function, and the handwriting/drawing function, buttons 27' corresponding to the clicking buttons on a traditional mouse, a tracer LED 28 which emits a light beam, making it easier for the user to know which infor mation he is inputting, as well as an indicator 29, e.g. 20 an LED, indicating when the pen is ready to be used. Con trol signals to the memories, the sensor 8, and the peri pheral units are generated in the control logic unit 24. The control logic also handles generation and prioritisa tion of interrupts to the processor. The buttons 27 and 25 27', the radio transceiver 26, the display 25, the tracer LED 28, and the LED 6 are accessed by the processor writ ing and reading in a register in the control logic unit 24. The buttons 27 and 27' generate interrupts to the processor 20 when they are activated. Operation of the Unit 30 The various functions of the input unit, viz. the mouse function, the scanner function, the handwriting/ drawing function, and the camera function, will now be described. All of these functions are based on images which are recorded with the aid of the sensor 8. When the 35 first three functions are used, a plurality of images are recorded in such a way that the contents of each image WO99/60468 PCT/SE99/00718 12 partially overlap the contents of the previous image, if any. As the images are being recorded, the relative posi tion of the images is determined, i.e. the position which affords the best possible correspondence between their 5 contents. Subsequently, the processing is carried out depending upon the function selected by the user. When recording the images, the input unit can be passed over a surface with the window 2 in contact with the same, or be held at a small or at a larger distance from the surface 10 depending upon the setting of the lens system. The sur face need not be plane. For example, it could be a sheet of paper with text on it, a wall covered with patterned wallpaper, or a bowl of sweets. What is important is that images with varying contents can be recorded so that the 15 relative positions of the images can be determined with the aid of the contents of the images. The Mouse Function First, suppose that the user wishes to use the input unit as a mouse. In this case, he sets the unit to the mouse function with the aid of the buttons 27, whereupon 20 the input unit starts operating in the mouse mode, and logs into the computer for which the input unit is to operate as a mouse. Subsequently, the user directs the window 2 of the input unit at a patterned surface, e.g. a mouse pad. He presses one of the buttons 27 to activate 25 the input unit, whereupon the processor 20 commands the LED 6 to begin generating strobe pulses at a predeter mined frequency, suitably at least 50 Hz. Subsequently, the user passes the input unit over the surface in the same way as if it were a traditional mouse, whereupon 30 images with partially overlapping contents are recorded by the sensor 8 and are stored in the read/write memory 23. The images are stored as images, i.e. with the aid of a plurality of pixels, each having a grey scale value in a range from white to black. 35 The flowchart in Fig. 3 shows in more detail how the input unit operates when the mouse function is used. In WO99/60468 PCT/SE99/00718 13 step 300, a starting image is recorded. In step 301, the next image is recorded. The contents of this image par tially overlap the contents of the previous image. As soon as an image has been recorded in step 301, 5 the process begins of determining how it overlaps the previous image both vertically and horizontally, step 302, i.e. in which relative position the best match is obtained between the contents of the images. For this purpose, every possible overlap position between the 10 images is examined, at the pixel level, and an overlap measurement is determined as follows: 1) For each overlapping pixel position, the grey scale values of the two relevant pixels are added up if the latter are not white. Such a pixel position in which 15 none of the pixels are white is designated a plus position. 2) The grey scale sums for all the plus positions are added up. 3) The neighbours of each pixel position are exa 20 mined. If an overlapping pixel position is not a neigh bour of a plus position and consists of a pixel which is white and a pixel position which is not white, the grey scale value of the non-white pixel is subtracted, pos sibly multiplied by a constant, from the sum in point 2). 25 4) The overlap position providing the highest overlap measurement as stated above is selected. Our Swedish patent application No. 9704924-1 and the corresponding U.S. application No. 024,641 describe an alternative way of matching the images in order to 30 find the best overlap position. The content of these applications is herewith incorporated by reference. As soon as the best overlap position between the current image and the previous image has been determined, the previous image is discarded, whereupon the current 35 image becomes the previous image in relation to the next image recorded.
WO99/60468 PCTISE99/00718 14 By determining the relative position of the two images a movement vector is obtained, which indicates how far and in which direction the input unit has been moved between the recording of the two images. Subsequently, a 5 positioning signal, which includes this movement vector, is transmitted, step 303, by the radio transceiver 26 to the computer for which the input unit is operating as a mouse. The computer uses the movement vector for posi tioning the cursor on its screen. Subsequently, the flow 10 returns to step 301. In order to increase the speed, the steps can partly be carried out in parallel, e.g. by starting the recording of the next image while the rela tive position of the current and the previous image is being determined. 15 In the mouse mode, the buttons 27' can be used as clicking buttons for inputting instructions to the com puter. The Handwriting and Drawing Function Next, suppose that the user wishes to input hand written text to his computer. In this case, with the aid 20 of the buttons 27, he sets the input unit to the hand writing function, whereupon the input unit starts to ope rate in the handwriting mode. When the user subsequently activates the input unit, the processor 20 commands the LED 6 to begin generating strobe pulses at the predeter 25 mined frequency. Subsequently, the user "writes" the text he wishes to input with the input unit directed at the selected surface, whereupon the sensor 8 records images with partially overlapping contents and stores them in the read/write memory 23. The tracer LED 28 successively 30 indicates the path of movement on the surface by means of a luminous spot to give the user an idea of the movement. The text is input one character at a time. Between each character, the user indicates that an information unit has been input, for example by releasing the activating 35 button 27 for a short time or by not moving the input unit for a short time.
WO99/60468 PCT/SE99/00718 15 Fig. 4 illustrates in more detail how the input unit operates in the handwriting and drawing mode. The first three steps correspond to those carried out in the mouse mode. When the input unit is activated, a starting image 5 is recorded, step 400. The next image, whose contents overlap the previous image, is recorded, step 401, and their relative position is determined, step 402, with the aid of the overlapping contents, whereby a movement vec tor is obtained. 10 Subsequently, the processor 20 determines whether the inputting of an information unit is complete or not, step 403. If not, the flow returns to step 401 and the next image is recorded. If the inputting is complete, the processor 20 reads the movement vectors determined for 15 the information unit in question to an ICR module which identifies which character the movement vectors repre sent, step 404. Subsequently, the identified character is stored in character-coded format in the memory, step 405, and the input unit indicates that it is ready to input a 20 new information unit, step 406. The inputted and identified character is preferably transferred to a computer in character-coded format by the intermediary of the radio transmitter 26 and is shown directly on the computer screen. If the input unit is 25 used as a stand-alone unit, the character can be shown on the display 25 instead. Fig. 5 schematically shows how images with overlap ping contents are recorded when the input unit is moved in a path of movement forming the letter "R". For the 30 sake of simplicity, the contents of the images are not shown in Fig.5. If, instead, the user indicates that the drawing function is to be used, only steps 400-403 are imple mented. Fig. 6 shows how an inputted letter R can be 35 reproduced on the display of the input unit or the com puter on the basis of the relative positions of the images in Fig. 5 determined by the input unit when the WO99/60468 PCT/SE99/00718 16 drawing function is used. In this case, a "drawn image" of the recorded character is shown with the aid of the movement vectors, not an interpreted character. Obvious ly, arbitrary drawn figures and characters can be input 5 to the input unit or a computer in this manner. The Scanner Function Now, suppose that the user wishes to use the input unit for recording predefined text on an information carrier, e.g. a sheet of paper, a newspaper, or a book. In this case, he sets the input unit to the scanner func 10 tion with the aid of the buttons 27, whereupon the input unit starts operating in the scanner mode. Subsequently, he directs the input unit at the sheet of paper with the text in the location where he wishes to begin recording text, activates the input unit with the 15 aid of the buttons 27, and passes it over the text which is to be recorded, following the text in the same manner as when one reads the text. The tracer LED 28 emits a light beam which makes it easier to follow the lines. When the user activates the input unit, the processor 20 20 commands the LED 6 to record images in the same way as described above with respect to the mouse function. When the user has passed the input unit over the selected text or has come to the end of a line of characters, he lifts the unit off the sheet of paper and releases the activat 25 ing button, whereupon the processor 20 turns off the LED 6. The flowchart in Fig. 7 illustrates in more detail how the input unit operates in this mode. In step 700, a starting image is recorded. In step 701, a new image 30 is recorded whose contents overlap that of the previous image. In step 702, the best overlap position for the current image and the previous image is determined in the same way as described above with respect to the mouse function. In this position, the images are put together 35 into a whole composite image, step 703. In step 704, the input unit detects whether the inputting of characters is WO99/60468 PCT/SE99/00718 17 complete. If not, the flow returns to step 701. If the user has released the activating button, indicating that the inputting is complete, the whole composite image is fed as an input signal to an OCR software which identi 5 fies and interprets the characters in the image, step 705. The identified and interpreted characters are obtained in a predetermined character-coded format, e.g. ASCII code, as output signals from the OCR software. They are stored in the read/write memory in a memory area for 10 interpreted characters. When the character identification and storing in character-coded format are finished, the processor activates the indicator 29 to inform the user that it is ready to record a new character sequence, step 706. 15 The interpreted characters can be transferred to a computer or other receiver in character-coded format with the aid of the radio transceiver 26. The above steps are thus carried out by the proces sor 20 with the aid of the associated units and suitable 20 software. Such software can be created by the skilled person with the aid of the above instructions if it is not commercially available. Figs 8a-8c illustrate how the input unit operates when the character sequence "Flygande backasiner" is 25 recorded. Fig. 8a shows the text on a sheet of paper. Fig. 8b shows the images which are being recorded with the aid of the sensor. As can be seen from this Figure, the contents of the images partially overlap. For exam ple, the letter 1 appears completely in image No. 1 and 30 partially in image No. 2. The degree of overlapping depends on the traction speed, i.e. the speed with which the user passes the input unit over the text in relation to the frequency with which the contents of the sensor 8 are read out. Fig. Sc shows what the whole composite 35 image looks like. It should be noted that the image is still stored in the form of pixels. When the method has been carried out, the text "Flygande bickasiner" is stor- WO 99/60468 PCT/SE99/00718 18 ed in the read/write memory 23 of the input unit as ASCII code. The Camera Function Next, assume that the user wishes to record an image of an object located at a distance from the input unit. 5 The "object" could, for example, be three-dimensional or it could be an image in a book. In this case, the user sets the input unit to the camera function with the aid of the buttons 27, whereupon the input unit begins to operate in the camera mode and the position of the lens 10 system 7 changes to a position suitable for recording images located at a distance from the input unit. Subse quently, the user activates the input unit, whereupon the processor begins to read images from the sensor 8. The read images can be shown either on the display 25 of the 15 input unit or on a computer to which the input unit is connected and to which the images are transferred as they are recorded by the intermediary of the radio transceiver 26. When the user is satisfied with the appearance of the image, he presses one of the buttons 27, which then 20 records an image of the object. When the image of the object has been recorded, the user can command the input unit to show the recorded image on the display 25 or to transfer the image to the computer by the intermediary of the radio transceiver 26. 25 The flowchart in Fig. 9 illustrates how the input unit is adapted to operate in the camera mode. In step 901, the extent of the image is indicated on the display 25 of the input unit. When the user is satisfied with the appearance of the image, he presses the button 27, 30 whereupon the image is frozen and recorded in a buffer memory in step 902. The image is recorded with the aid of a plurality of pixels, which can either have grey scale values from white to black or have colour values. The user can then choose whether or not he wishes to keep the 35 current image. If the user decides to keep the image, the process continues along the solid line to step 903, in WO 99/60468 PCT/SE99/00718 19 which the image is stored in the memory 23. When the image has been stored, the unit indicates, in step 904, that it is ready to record a new image. If the user does not wish to keep the image, the process continues, from 5 step 902, along the dashed line back to step 901 in order for a new image to be recorded. Alternative Embodiments The above embodiment is described by way of example only. An input unit according to the invention need not comprise all of the functions listed above. It is pos 10 sible to combine the mouse function with one or more of the scanner function, the camera function, the handwrit ing function, or other inputting functions. In the embodiment described above, all processing of recorded information takes place in the input unit. This 15 is not essential. All of the above measures except for the actual image-recording can be carried out with the aid of image-processing means in an external computer or in some other external unit to which the images are transferred. 20 In the embodiment described above, the recording of images is carried out by means of a single light-sensi tive sensor. However, it is also possible to arrange a second light-sensitive sensor, for instance, in the other end of the casing. In this case, it is possible to use 25 one end with the first sensor for the mouse function and the other end with the second sensor for one of the inputting functions. It is not completely essential for the images to be recorded with overlapping contents in the mouse mode, the 30 handwriting mode and the drawing mode. In these modes, a special substrate with position indications can be used instead. For example, the positions can be written as coordinates, which are read and interpreted for providing positioning signals for a cursor or movement indications 35 enabling the reproduction of a drawn image or a drawn character. However, this has the drawback of requiring WO99/60468 PCT/SE99/00718 20 a special substrate as well as software for interpreting the position indications.

Claims (24)

1. An input unit having a mouse function and at 5 least one inputting function, comprising image-recording means (8) for providing said inputting function, c h a r a c t e r i s e d in that the image-recording means (8) are also used for providing the mouse function.
2. An input unit according to claim 1, wherein the 10 input unit is adapted to emit positioning signals for providing the mouse function, and inputting signals for providing said inputting function, both the positioning signals and the inputting signals being based upon images recorded with the aid of said image-recording means (8). 15
3. An input unit according to claim 1 or 2, wherein the image-recording means (8) comprise a first image recording unit for providing the mouse function and a second image-recording unit for providing the inputting function. 20
4. An input unit according to claim 1 or 2, wherein the image-recording means (8) comprise an image-recording unit which is used for providing both the mouse function and the inputting function.
5. An input unit according to any one of the preced 25 ing claims, wherein the image-recording means comprise at least one area sensor.
6. An input unit according to any one of claims 2-5, wherein both the positioning signals and the inputting signals are essentially composed of said images. 30
7. An input unit according to any one of claims 2-6, wherein the input unit is adapted to output the position ing signals and the inputting signals in a way that enables a receiver to identify whether it is receiving the positioning signals or the inputting signals. 35
8. An input unit according to any one of the pre ceding claims, further comprising switching means (27), WO99/60468 PCT/SE99/00718 22 which, when acted upon by a user, are adapted to switch the input unit between its different functions.
9. An input unit according to any one of the pre ceding claims, wherein the image-recording means (8), at 5 least with respect to the mouse function, are adapted to record a plurality of images in such a way that the con tent of each image overlaps the content of the previous image.
10. An input unit according to any one of the pre 10 ceding claims, further comprising image-processing means (20-24) which are used for both the mouse function and the inputting function.
11. An input unit according to claim 9 or 10, fur ther comprising means (20-24) for determining the rela 15 tive position of the images with the aid of the partially overlapping contents.
12. An input unit according to claim 11, wherein the means (20-24) for determining the relative position of the images are adapted to determine the relative position 20 of the images horizontally as well as vertically.
13. An input unit according to claim 11 or 12, fur ther comprising means (20-24) for generating the posi tioning signals on the basis of the relative position of the images. 25
14. An input unit according to any one of the pre ceding claims, which input unit is hand-held.
15. An input unit according to any one of the pre ceding claims, further comprising a transmitter (26) for wireless connection of the input unit to a receiver. 30
16. An input unit according to any one of the pre ceding claims, wherein said at least one inputting func tion comprises a scanner function.
17. An input unit according to any one of the pre ceding claims, wherein said inputting function comprises 35 a camera function for imaging objects located at a dis tance from the input unit. WO99/60468 PCT/SE99/00718 23
18. An input unit according to any one of the pre ceding claims, wherein said inputting function comprises a function for inputting handwritten/drawn information.
19. A method for providing a mouse function and at 5 least one inputting function with the aid of an input unit, comprising the steps of detecting which of said functions is desired; recording at least one image with the aid of the input unit; and 10 processing said at least one image in different ways depending upon which of said functions is desired.
20. A method according to claim 19, which, when the mouse function is desired, further comprises the steps of recording at least two images with partially over 15 lapping contents; determining the relative position of the images both horizontally and vertically; determining a positioning signal on the basis of the relative posi tion of the images; and using the positioning signal for controlling a cursor on a computer screen. 20
21. A method according to claim 19 or 20, in which the inputting function is a character-inputting function and which, when the character-inputting function is desired, further comprises the steps of recording a plurality of images with partially over 25 lapping contents, which images together image the charac ters with are to be input; putting the images together both horizontally and vertically into a composite image; identifying characters in the composite image; interpret ing the identified characters; and storing the characters 30 in character-coded format.
22. A method according to any one of claims 19-21, in which the inputting function is a function for input ting handwritten/drawn information and which, when the handwriting/drawing function is desired, further com 35 prises the steps of recording a plurality of images with partially over lapping contents; determining the relative position of WO99/60468 PCT/SE99/00718 24 the images both horizontally and vertically; and deter mining the movement of the input unit on the basis of the relative position of the images.
23. A method according to claim 22, further compris 5 ing the step of interpreting which character the movement of the input unit represents and storing this character in character-coded format.
24. An input system having a mouse function and at least one inputting function, comprising image-recording 10 means (8) for recording images and image-processing means (20-24) for processing the images recorded by the image recording means for providing the mouse function and said at least one inputting function, the image-recording means being located in a first casing and the image-pro 15 cessing means being located in a second casing.
AU41794/99A 1998-04-30 1999-04-30 Input unit, method for using the same and input system Ceased AU758036B2 (en)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
SE9801535 1998-04-30
SE9801535A SE511855C2 (en) 1998-04-30 1998-04-30 Handwritten character recording device for characters, symbols, graphs, calligraphy
US9132398P 1998-06-30 1998-06-30
US60/091323 1998-06-30
SE9803455A SE513940C2 (en) 1998-04-30 1998-10-09 Unit and input system with mouse function and input function and ways to use the unit
SE9803455 1998-10-09
US10578098P 1998-10-27 1998-10-27
US60/105780 1998-10-27
PCT/SE1999/000718 WO1999060468A1 (en) 1998-04-30 1999-04-30 Input unit, method for using the same and input system

Publications (2)

Publication Number Publication Date
AU4179499A true AU4179499A (en) 1999-12-06
AU758036B2 AU758036B2 (en) 2003-03-13

Family

ID=27484809

Family Applications (1)

Application Number Title Priority Date Filing Date
AU41794/99A Ceased AU758036B2 (en) 1998-04-30 1999-04-30 Input unit, method for using the same and input system

Country Status (9)

Country Link
EP (1) EP1073944A1 (en)
JP (1) JP2002516428A (en)
KR (1) KR20010052282A (en)
CN (1) CN1152296C (en)
AU (1) AU758036B2 (en)
BR (1) BR9910083A (en)
CA (1) CA2331073A1 (en)
IL (1) IL139104A0 (en)
WO (1) WO1999060468A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE0000939L (en) * 2000-02-18 2001-08-19 Anoto Ab Inenhetsarrangemang
DE10004965C2 (en) * 2000-02-04 2003-08-21 Bosch Gmbh Robert Device for the manual operation of devices in a vehicle
US6952497B1 (en) 2000-02-16 2005-10-04 Telefonaktiebolaget L M Ericsson (Publ) Method and system for electronically recording transactions and performing security function
DE60103038T2 (en) 2000-02-16 2004-09-02 Telefonaktiebolaget Lm Ericsson (Publ) PEN PRINTER
US6839623B1 (en) 2000-02-16 2005-01-04 Telefonaktiebolaget Lm Ericsson (Publ) Positioning applications for an electronic reading device
US6832116B1 (en) 2000-02-16 2004-12-14 Telefonaktiebolaget L M Ericsson (Publ) Method and system for controlling an electronic utility device using an electronic reading device
US6813396B1 (en) 2000-02-16 2004-11-02 Telefonatiebolaget L.M. Ericsson (Publ) Method for sharing information between electronic reading devices
AU3374901A (en) * 2000-02-16 2001-08-27 Telefonaktiebolaget Lm Ericsson (Publ) Specially formatted paper based applications of a mobile phone
US6611259B1 (en) 2000-02-16 2003-08-26 Telefonaktiebolaget Lm Ericsson (Publ) System and method for operating an electronic reading device user interface
US6885878B1 (en) 2000-02-16 2005-04-26 Telefonaktiebolaget L M Ericsson (Publ) Method and system for using an electronic reading device as a general application input and navigation interface
US6693623B1 (en) 2000-02-16 2004-02-17 Telefonaktiebolaget Lm Ericsson (Publ) Measuring applications for an electronic reading device
WO2001061450A2 (en) * 2000-02-16 2001-08-23 Telefonaktiebolaget Lm Ericsson (Publ) A system and method for operating an electronic reading device user interface
US6593908B1 (en) 2000-02-16 2003-07-15 Telefonaktiebolaget Lm Ericsson (Publ) Method and system for using an electronic reading device on non-paper devices
US7054487B2 (en) 2000-02-18 2006-05-30 Anoto Ip Lic Handelsbolag Controlling and electronic device
US6992655B2 (en) 2000-02-18 2006-01-31 Anoto Ab Input unit arrangement
US6839453B1 (en) 2000-05-16 2005-01-04 The Upper Deck Company, Llc Method and apparatus for authenticating unique items such as sports memorabilia
DE10034284A1 (en) * 2000-07-14 2002-01-24 Siemens Ag Input device for handwriting recognition for an electronic information and communication system and method for acquiring input data
KR20030017924A (en) * 2001-08-25 2003-03-04 윤덕기 A pan type wireless beem mouse
KR100461769B1 (en) * 2001-10-31 2004-12-14 삼성전자주식회사 Stylus with exterior-type camera lens module and portable telephone therewith
JP2004086462A (en) * 2002-08-26 2004-03-18 Taizo Saito Pen type computer input device
TWI236289B (en) 2004-08-11 2005-07-11 Pixart Imaging Inc Interactive device capable of improving image processing
US9024880B2 (en) 2004-08-11 2015-05-05 Pixart Imaging Inc. Interactive system capable of improving image processing
CN2738325Y (en) * 2004-10-15 2005-11-02 段西京 Photoelectrical pen type mouse
WO2006107245A1 (en) * 2005-04-05 2006-10-12 Lk Innovatronic Method to control a display
US7996589B2 (en) 2005-04-22 2011-08-09 Microsoft Corporation Auto-suggest lists and handwritten input
KR100854650B1 (en) * 2007-02-08 2008-08-27 (주) 아이.에스.브이. Optical pen mouse capable of magnifying displayed object and method of magnifying displayed object using the same
US8054512B2 (en) 2007-07-30 2011-11-08 Palo Alto Research Center Incorporated System and method for maintaining paper and electronic calendars
CN107037891A (en) * 2015-08-19 2017-08-11 原建桥 A kind of combined type computer mouse

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4797544A (en) * 1986-07-23 1989-01-10 Montgomery James R Optical scanner including position sensors
US4804949A (en) * 1987-03-20 1989-02-14 Everex Ti Corporation Hand-held optical scanner and computer mouse

Also Published As

Publication number Publication date
CN1152296C (en) 2004-06-02
AU758036B2 (en) 2003-03-13
BR9910083A (en) 2000-12-26
JP2002516428A (en) 2002-06-04
IL139104A0 (en) 2001-11-25
KR20010052282A (en) 2001-06-25
WO1999060468A1 (en) 1999-11-25
CN1303495A (en) 2001-07-11
EP1073944A1 (en) 2001-02-07
CA2331073A1 (en) 1999-11-25

Similar Documents

Publication Publication Date Title
US6906699B1 (en) Input unit, method for using the same and input system
AU758036B2 (en) Input unit, method for using the same and input system
JP3641485B2 (en) Recording method and apparatus
US6985643B1 (en) Device and method for recording hand-written information
US6992655B2 (en) Input unit arrangement
AU758514B2 (en) Control device and method of controlling an object
EP1073945B1 (en) Device and method for recording hand-written information
US6715686B1 (en) Device for recording information in different modes
AU758236B2 (en) Device for recording information in different modes
MXPA00010541A (en) Input unit, method for using the same and input system
SE513940C2 (en) Unit and input system with mouse function and input function and ways to use the unit
MXPA00010548A (en) Device and method for recording hand-written information
WO1999060515A1 (en) Device for recording information in different modes
JPS6019284A (en) Manual figure and character reading device
JP2004145461A (en) Writing implement
SE511855C2 (en) Handwritten character recording device for characters, symbols, graphs, calligraphy

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)