Hand held electronic pen device, a system and a method for recording a motion pattern of the tip of a pen device, a computer program product and element
Field of the Invention
The present invention relates to a hand-held electronic pen device, and more particularly to a hand-held electronic pen device for recording a motion pattern of the tip of the device.
Description of the prior art
US-A-5 434 371 discloses a method and system for recording and collecting of motions in a handheld instrument. It utilizes a handheld device having accelerometers for monitoring various directions. The system utilizes a processing circuit for processing acceleration signals, and an analog-to-digital converter to convert the signals into digital code. Conversion software is utilized to decode or translate the hand motions into recognizable patterns, which are displayed on a screen display.
The system in US-A-5 434 371 functions by recording changes in velocity on a time continuum and discriminating when the instrument is in contact with or in close proximity to the planar surface on which the user is working. The method and system is described with reference to two-dimensional formations of patterns on a two- dimensional surface such as a writing surface, but may be used to trace or form three-dimensional surfaces. A solution to the latter is not described in further detail. However, US-A-5 587 558 discloses a coordinate input device for manual character input and two- or three- dimensional coordinate input for a computer. The coordinate input device comprises an acceleration detecting means for detecting accelerations in three independent dimensions, of
a pen, an incline direction detecting means for detecting the attitude or rotation of the pen, and coordinate operation means for determining the spatial coordinates at the tip of the pen. It is desirable for a user utilizing a prior art hand-held instrument according to US-A-5 434 371 in combination with a coordinate input device for manual character input according to US-A-5 587 558 to record written characters or three-dimensional surfaces when the surface or object being traced is in motion. For example, the user holds a paper on which he is working or a three- dimensional object to be traced when the user goes by train, car, walks etc. With this prior art instrument, the motion will be detrimental to the resulting recorded motion pattern, because the instrument will lose its orientation when the surface is moved. Consequently, the recorded motion pattern is probably unusable.
Summary of the Invention The ob ect of the invention is to provide an improved hand-held electronic pen device for recording a motion pattern of the tip of the device, when the device is in contact with or in close proximity to a fixed surface or a surface in motion on which the user is working. In order to achieve said object the invention provides an electronic device, comprising a main device having a motion pattern recorder adapted to record a motion pattern of the tip of a pen device, and a separate device configured to determine the spatial coordinates at a reference point of the separate device, including communication means for transmitting the spatial coordinates for the reference point to the main device, wherein the main device further comprises a receiver for receiving said spatial coordinates from the separate device, and a data processor configured to determine and
record the motion pattern of the tip of the pen device in relation to the coordinates and the orientation of the coordinate system of the reference point.
Another aspect of the invention is a system for recording a motion pattern of the tip of a pen device, including an electronic device with a main device having a motion pattern recorder adapted to record a motion pattern of the tip of the pen device, wherein the electronic device further comprises a separate device configured to determine the spatial coordinates at a reference point of said separate device, and communication means for transmitting said spatial coordinates for the reference point to a host device, the main device comprises an electronic device configured to determine the spatial coordinates at the tip of the pen, and communication means for transmitting spatial coordinates for the tip of the pen to the host device, and the host device comprises a receiver for receiving said spatial coordinates from the separate device and the main device, and a data processor configured to determine the motion pattern of the tip of the pen device in relation to the coordinates and the orientation of the coordinate system of the reference point. The invention also provides a method of recording a motion pattern of the tip of a pen device, wherein the spatial coordinates are determined at a reference point of a separate device of the pen device, the spatial coordinates for the reference point are transmitted to a main device of the pen device, the spatial coordinates are received from the separate device, and the motion pattern of the tip of the pen device is determined in relation to the coordinates and the
orientation of the coordinate system of the reference point .
An advantage of the method and the hand-held electronic device according to the invention is that the surface can be moved during the recording of the pattern without having an affect on the recorded pattern.
Brief Description of the Drawings
An illustrative embodiment, advantages and features of the invention will now be described with reference to the accompanying drawing, in which
FIG 1 is a schematical view of a hand-held pen device according to a first embodiment of the invention.
Detailed Description of the Invention
Referring to FIG 1 in the drawings, there is shown a first embodiment of a hand-held electronic pen device for recording a motion pattern of the tip of the device, when the device is in contact with or in close proximity to a fixed surface or a surface in motion on which the user is working .
The electronic device or pen device comprises a main device 1 with a housing 2 and an exchangeable tip 3, and a separate device 4 with a housing or cap 2 ' . The main device 1 has a motion pattern recorder comprising a first acceleration detector 5 for detecting the three dimensional acceleration of the pen device in a first point, a second acceleration detector 51 for detecting the three dimensional acceleration of the pen device in a second point. A data processor 6 with a memory 7 is operatively connected to the acceleration detectors 5 and 5' and is configured to determine the motion pattern of the tip 3 of the pen device based on a comparison of the determined three dimensional accelerations of the pen device in said first and second point. Further, a
communication device 8 is included in the housing 2 and connected to the processor 6 for communication of data with the separate device 4 as well as a host device, such as a host computer described later. The main device is powered by for example a battery 9.
The separate device 4 comprises third and fourth acceleration detectors 10 anf 10' for detecting the three dimensional acceleration of a reference point of the separate device 4 and the orientation of the coordinate system of the reference point, and communication means or device 11 and memory 12 for transmitting data based on the detected three dimensional accelerations representing the spatial coordinates for the reference point and the orientation of the coordinate system to the main device 1. The acceleration detector 10, communication device 11, and memory 12 are operatively connected and supplied by battery power 13.
The receiver of the communication device 8 receives signals including data representing the spatial coordinates and the orientation of the coordinate system from the separate device 4, and the data processor 6 is configured to determine and record the motion pattern of the tip of the pen device in relation to the coordinates and the orientation of the coordinate system of the reference point .
In an alternative embodiment of the electronic pen device according to the invention, the orientation of the coordinate system of the reference point is not determined in the separate device 4, but in the main device 1. The separate device 4 is, thus, less complex in this embodiment .
In an alternative embodiment of the main device 1 the motion pattern recorder comprises an inclination detector instead of the second acceleration detector for detecting the inclination of said pen device, and the data processor
is thus configured to determine the motion pattern of the tip of the pen device based on the determined three dimensional acceleration and the inclination.
In still another alternative embodiment of the invention the motion pattern recorder comprises a combined three-dimensional accelerator and inclination or tilt detector instead of the second acceleration detector for detecting the inclination of said pen device, and the data processor is thus configured to determine the motion pattern of the tip of the pen device based on the combined determined three dimensional acceleration and inclination.
According to the method of the invention a motion pattern of the tip of a pen device is recorded when a character (s) or picture is drawn by a user by determining the spatial coordinates at the reference point, i.e the separate device 4 of the pen device, transmitting the spatial coordinates for the reference point to the main device 1 of the pen device via preferably a wireless communication link, such as radio, GSM, ultra sonic, IR (infra red), or Bluetooth communications. Then, the motion pattern of the tip of the pen device is determined by the processor 6 in relation to the coordinates of the reference point .
Data representation corresponding to the motion pattern is recorded or stored in the internal memory 7 of the main device 1 for later transmission to a host device, The host device is for example a computer with a display, on which the motion pattern can be illustrated. In this case the computer is loaded with computer software for displaying three-dimension motion patterns recorded by the electronic pen device according to the invention. Other optional host devices or remote electronic devices for receiving and/or displaying of the patterns are printers, copying machines, or other electronic pen devices according to the invention.
In this embodiment of the pen device, the separate device is a removable cap and comprises a clip 14 for attachment to a surface such as a paper or other writing surface. An alternative embodiment of the separate device has a magnet as attachment means for attachment to for example a whiteboard etc. Other alternative attachment means for attachment to various materials and surfaces are possible within the scope of the invention.
Additionally, the separate device comprises a tip detector 15 adapted to detect the presence of the tip 3 in the cap 2 ' . In this embodiment the maim device 1 has a guide pin 15 for engagement with an inside groove 16 of the cap 2 ' , wherein a calibration initiation signal is generated for calibration of the motion pattern recorder in the pen device.
In this embodiment of the electronic pen device according to the invention the tip is an exchangeable tip, including a pencil tip, or a pen tip, or a rolling ball or a felt tip. Alternative embodiments of the pen device are provided with fixed tips.
Further, the main device comprises an activator, such as switch or a push button operatively connected to the processor, configured to generate a signal indicating that the motion pattern to be recorded is an erasing operation. Thus, the electronic device is adapted to record a three dimensional motion pattern, such as the contour of a sculpture etc., for creation of a digital representation of the three dimensional surface. Additionally, the motion pattern is a route corresponding to the movement of the pen device carried by a user.
Alternatively, the data processor is configured to identify a signature of a recorded pattern with a unique identification number of the electronic device.
The electronic pen device is provided with a finger- print input device connected to the data processor for
identification of a user of the pen device in an alternative embodiment.
The pen device comprises an activator configured to activate a recording of a current inclination of the pen device in relation to said reference point.
In still another embodiment of the invention the exchangeable tip is a scalpel blade and the pen device is used as a device for recording the hand motion of a surgeon during an operation. The recorded motion pattern is transmitted to a host computer with software for further processing of the recorded data in order to display the hand motion of the surgeon on the computer display for education purpose.
A wireless computer mouse is another application of the electronic pen device according to the invention. In this embodiment the electronic device is adapted to define an area within which the mouse can be moved to move a cursor on a display of a computer communicating with the mouse. The area is defined by for example a click on the mouse in each corner of the defined area. The computer receives the coordinates defining the area from the mouse. Then, when the mouse is moved within the defined area, detected coordinates are translated into corresponding coordinates for the cursor on the display and the cursor is moved accordingly.
An additional embodiment of the electronic pen device according to the invention is a pointing device for pointing on virtual objects in a virtual reality.
As an option, the pen device comprises an activator such as a switch or push button operatively connected to the processor of the main device 1 to activate a recording of first spatial coordinates at the tip of the pen device, and second spatial coordinates at the tip of the pen device for determining the distance between the first and second spatial coordinates.
In order to start the recording of a motion pattern, when the device is in contact with or in close proximity to a fixed surface or a surface in motion on which the user is working, the main device 1 is provided with a pressure sensor located at the tip 3. The pressure sensor is operatively connected to the processor 6 and generates a start signal for the processor to start recording a motion pattern when the tip is in contact with a surface.
Alternatively, the pen device comprises a sound detecting device connected to the data processor 6, wherein the sound detecting device is adapted to generate a start signal for the data processor in response to sound generated when the tip touches the surface.
In still another alternative of the pen device it comprises a photo detecting device connected to the data processor, wherein the sound detecting device is adapted to generate a signal for the data processor when the tip touches the surface and the photo detecting device is covered. The electronic pen device according to the invention can operate as a stand-alone unit or as a part of a system. A system for recording a motion pattern of the tip of the pen device according the invention comprises also a host device having a receiver for receiving spatial coordinates from the separate device and the main device of the pen device, and a data processor configured to determine the motion pattern of the tip of the pen device in relation to the coordinates of the reference point.
It is to be understood that even though numerous characteristics and features of the present invention have been set forth in the description, together with details of the function of the invention, the disclosure is illustrative only and changes may be made in detail within the scope of the invention defined by the following claims.