CN102135823A - Intelligent electronic handwriting pen - Google Patents

Intelligent electronic handwriting pen Download PDF

Info

Publication number
CN102135823A
CN102135823A CN2011101087780A CN201110108778A CN102135823A CN 102135823 A CN102135823 A CN 102135823A CN 2011101087780 A CN2011101087780 A CN 2011101087780A CN 201110108778 A CN201110108778 A CN 201110108778A CN 102135823 A CN102135823 A CN 102135823A
Authority
CN
China
Prior art keywords
writing pencil
module
smart electronics
smart
main control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011101087780A
Other languages
Chinese (zh)
Inventor
金连文
陶大鹏
李辰成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN2011101087780A priority Critical patent/CN102135823A/en
Publication of CN102135823A publication Critical patent/CN102135823A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides an intelligent electronic handwriting pen which comprises a hardware system and a software system; the hardware comprises a main control module, a triaxial acceleration sensor, an angular acceleration sensor, an A/D (Analog to Digital) converter and a wireless transmission module, and the connection of the hardware system is realized by using a double-bus structure, wherein a control bus is used for transmitting the control signals of the main control module and other modules, and a data bus is in charge of transmitting data between modules; the wireless transmission module is in wireless connection with an external intelligent device; the software system comprises an internal software module arranged on the main control module and an external software module arranged on the external intelligent device; the internal software module and the external software module are mutually connected through a wireless communication protocol so as to realize receiving and identify the handwriting operation performed through the hardware system by the user.

Description

A kind of smart electronics writing pencil
Technical field
The invention belongs to pattern-recognition and field of artificial intelligence, particularly human interface device.
Background technology
Traditional writing pencil be rely on writing pencil on the resistance screen, to produce pressure and on screen output pattern, the option of on-screen menu also needs writing pencil to select on screen and can realize.At present a lot of smart mobile phones adopt capacitance plates, though can conveniently use the finger input signal, still the form of pen is more effective for Chinese and hieroglyphic input.But there is following distinct disadvantage in institute's employing writing pencil of various kinds of equipment touch-screen at present: (1) is selected for all kinds of shortcuts in the software, mainly be to select to finish by menu, two-layer so above menu is selected very trouble, even the selection of one deck menu also is dry; (2) the man-machine input for shortcut realizes seeming powerless, because keyboard is not available easily for most handheld devices, even some high-end devices is furnished with keyboard, except the inconvenience on carrying, in the time of people's while operation keyboard and input pen, need work in series, switching back and forth to make user experience to have a greatly reduced quality in addition.
Summary of the invention
The objective of the invention is to overcome the shortcoming and defect of above-mentioned man-machine interaction, the characteristics of motion by a research two ends, design a kind of cooperation smart machine (the proprietary human-computer interaction device who comprises mobile phone, palm PC, panel computer, laptop computer and have touch-screen)---smart electronics writing pencil, it has kept the traditional handwriting pen and has realized the convenience that icon is imported at all kinds of touch-screens; The function of the simultaneously creationary shortcut of having realized having only keyboard just to have (Macintosh); The hand disability personage is provided a kind of brand-new man-machine interaction mode; Has certain amusement function.
Purpose of the present invention is achieved through the following technical solutions:
A kind of smart electronics writing pencil, comprise hardware system and software systems, described hardware comprises main control module, 3-axis acceleration sensor, angular acceleration transducer, A/D converter, wireless transmitter module, and adopt dual-bus structure to realize the connection of hardware system, wherein control bus is used to transmit the control signal of main control module and other modules, data bus is responsible for transmitting the data between each module, described wireless transmitter module is realized the wireless connections with external smart equipment, described software systems comprise the in house software module that is arranged on the main control module, and the external software module that is arranged on external smart equipment, described in house software module and external software module interconnect by wireless communication protocol, realize receiving and identifying the user by hand-written operation that hardware system carried out.
Smart electronics writing pencil of the present invention comprises the hardware components software section of unifying, software section is divided into the outer module (residing in mobile phone or smart machine inside such as palm PC or panel computer) of machine inner module (residing in smart electronics writing pencil of the present invention inside) and machine, and the two cooperatively interacts hardware and software and finish the function of smart pen jointly.
The present invention compared with prior art has following advantage:
(1) patent of the present invention is by this rule of motion of research hand exercise control smart electronics writing pencil of the present invention, propose a kind of brand-new intelligent input equipment, utilized the function of the shortcut (Macintosh) that this equipment can creative realize having only keyboard just to have; This meets the design of ergonomics to continue to adopt the traditional handwriting pen to import icon on touch-screen on this basis.
(2) by rotating and rocking penholder, realize man-machine interaction, this operation itself possesses certain recreational, with the athletic posture of pen with human-computer interaction technology is creationary combines, makes uninteresting input become interesting and novel.
(3) need hand to dress sensor or utilize the Gesture Recognition of video identification technology to compare with emerging: used palm of emerging Gesture Recognition and articulations digitorum manus motion are subjected to the restriction (such as the whether deformity etc. of the flexibility of finger, hand) of physical endurance; Institute's wearable sensors needs more freedom and precision, needs hand to make the comparison extravagant act simultaneously; In addition because the mode of dressing can increase the incompatible sense of hand.And smart electronics writing pencil technology of the present invention is not owing to go to discern gesture, innovation go to discern penholder position motion conditions, thereby not high for the hand physiological requirement; Pattern-recognition stage principal character comprises that sensor sends 3-axis acceleration/angular acceleration of obtaining through pre-service etc. back in addition, thereby the degree of freedom and the accuracy requirement meeting of sensor decreased than gesture identification; The profile of smart electronics writing pencil of the present invention and the shape differentiation of traditional pen are little, can not increase the incompatibility sense of hand.
(4) compare with the existing electronic equipment that acceleration transducer is installed in mouse or pen: thus existing in mouse or pen the installation acceleration transducer electronic equipment its mainly carry out integration acquisition displacement information by the acceleration information that acceleration transducer is collected, this mode is because the accuracy limitations of sensor requires the electronic equipment displacement to want enough big; And the output result of this equipment is strict to initial position, angle and post exercise position, angle, and this has just limited the widespread use of this kind equipment; And primitive character that smart electronics writing pencil of the present invention adopts and primitive character to the transform characteristics of time promptly based on three shaft angle acceleration, angular velocity, angle character and the acceleration of installation site and pen multidimensional features such as angle with respect to the gravity direction projection, utilizing in the pattern-recognition feature extracting methods to seek on this basis (describes as Fig. 4 based on several AD HOC, be not defined as this 4 quasi-mode) optimal characteristics, carry out pattern-recognition on this basis, thereby intelligent handwriting application prospect of the present invention is better.
(5) compare with emerging localization by ultrasonic identification record pen: emerging localization by ultrasonic identification record pen needs pen to write on paper, generally can not be used for touch panel device; This equipment detects nib in the displacement of writing a place by Doppler effect, carries out corresponding pattern-recognition then and then identifies literal and symbol; This pen needs very high sensor displacement accuracy, thereby cost is very high, in addition pen is just seemed powerless in three-dimensional motion conditions.And smart electronics writing pencil of the present invention keep touch-screen with the traditional handwriting pen on the design basis of writing words on the touch-screen, innovation pass through the writing pencil tip of the brushstyle of a writing or painting broken away from touch-screen the time athletic posture discern; Recognition feature comprises that sensor sends 3-axis acceleration/angular acceleration of obtaining through pre-service etc. back to; The price of acceleration transducer of the present invention and angular acceleration transducer is very cheap, measures acceleration, angular acceleration precision and satisfies application fully; Since can discern pen in the rotation of solid space, motion conditions such as rock, thereby usable range is broad more.
(6) along with the improving constantly of machine learning techniques, by the recognizer of update software machine inner module part, many complicated more smart electronics writing pencils actions of the present invention are with identified, thereby the availability of this smart pen can constantly be upgraded.
(7) cost is low, is convenient to popularize: along with popularizing and the intrinsic Moore's Law of electronic equipment of acceleration sensor chip, the manufacturing cost of equipment can be controlled.
Description of drawings
Fig. 1 is the schematic appearance of smart electronics writing pencil of the present invention.
Fig. 2 is the inner structure synoptic diagram of smart electronics writing pencil of the present invention.
Fig. 3 is a smart electronics writing pencil hardware composition frame chart of the present invention.
Fig. 4 is 4 kinds of athletic posture synoptic diagram of smart electronics writing pencil of the present invention
Fig. 5 is the in house software module process flow diagram of smart electronics writing pencil of the present invention
Fig. 6 is the external software module module process flow diagram of smart electronics writing pencil of the present invention.
Embodiment
Below in conjunction with accompanying drawing the present invention is done further concrete description, but embodiments of the present invention are not limited thereto.
Fig. 1 shows a kind of face shaping of the present invention, and from appearance, patent of the present invention there is no too big difference with the common writing pencil that general writing pen or portable equipment are equipped with.It mainly contains the tip of the brushstyle of a writing or painting and penholder two parts are formed.The present invention also can make the form of the cap for brush separately in addition, directly is enclosed within the end of original traditional handwriting pen, finishes same function.
A kind of inner structure design of smart electronics writing pencil of the present invention as shown in Figure 2, its a kind of hardware group becomes principle as shown in Figure 3, comprises that main control module 1,3-axis acceleration sensor 2, angular-rate sensor 3(are not shown), A/D converter 4, wireless transmitter module 5, power module 6, working station indicator 7 and switch 8.Hardware system adopts dual-bus structure, and control bus is used to transmit the control signal for main control module 1, wireless transmitter module 5, power module 6 etc., and data bus is responsible for the data between the transport module.Main control module 1 is the core of total system, the main control flow with hardware inside of obtaining of being responsible for sensing data, to compress through A/D converter 4 data converted and pre-service such as coding after deliver to wireless transmitter module 5, and accept the control signal that control bus transmits; Acceleration transducer 2 is responsible for measuring with respect to the variation of the static weight acceleration of primitive axis line position on three degree of freedom and the dynamic acceleration that rocks penholder formation; Angular-rate sensor 3 is responsible for measuring penholder and is rotated formed angular acceleration; The analog signal conversion that A/D converter 4 is responsible for degree of will speed up sensor 2 and angular-rate sensor 3 is a digital signal; Wireless transmitter module 5 is responsible for setting up the Radio Link of smart electronics writing pencil and external smart equipment, will send to host computer through pretreated sensor informations such as main control module 1 compression and codings and carry out follow-up processing; Needed power supply when power module 6 is responsible for providing operate as normal to entire circuit.
Action principle of the present invention is: degree of will speed up sensor 2 is installed in the two ends of smart electronics writing pencil of the present invention, forms sensor array.Angular acceleration transducer 3 is installed on the rotation direction of smart electronics writing pencil of the present invention.When smart electronics writing pencil of the present invention did not contact touch-screen, hand was done regular motion, at this moment can drive smart electronics writing pencil motion of the present invention.When the smart electronics writing pencil tilts, utilize the variation of acceleration transducer 2 measurements with respect to static weight acceleration on the three degree of freedom of original axial location, can know the pitch angle of current location easily; When the smart electronics writing pencil clocklike rocks, utilize acceleration transducer 2 to measure three dynamic accelerations, can obtain the motion state of current smart electronics writing pencil; When the smart electronics writing pencil rotates, utilize the angle measuring principle of angular-rate sensor 3.Can obtain the angular acceleration information of current smart pen, this angular acceleration information be carried out an integration for the time can obtain current angular velocity of rotation.According to installation site, the quantity of acceleration transducer 2 and angular-rate sensor 3, just can realize acceleration, the angular acceleration information of one or multiaxis.Respectively these information are handled, carried out corresponding pattern-recognition, just can obtain the motion conditions of pen, and the situation of different classes of pen motion can corresponding different input instructions, and then realize the man-machine interaction of various complexity.
Fig. 4 has described the simple motion situation that a few class smart electronics writing pencils can be discerned.Wherein imaginary plane is that the hand-written tip of the brushstyle of a writing or painting of smart electronics of the present invention leaves when being with the touch-screen smart machine, with the approximately parallel imaginary plane of movement locus.Wherein (a) describes is smart electronics writing pencil of the present invention along its axis clockwise or be rotated counterclockwise; What (b) describe is that the smart electronics writing pencil tip of the brushstyle of a writing or painting of the present invention moves in a circle imaginary plane that its track became and smart machine situation at an angle; (c) describe be smart electronics writing pencil axis of the present invention and smart machine at an angle, do the situation of pendular movement along run-on point O; (d) describe be smart electronics writing pencil axis of the present invention and smart machine at an angle, situation about moving reciprocatingly along its axis.The simple combination of these a few type games situations can generate more complicated smart electronics writing pencil sports category.
Workflow of the present invention is with reference to figure 5, Fig. 6.The concrete course of work of in house software module is: finish self check after 1. powering on, system carries out the software and hardware initialization, report each several part duty; 2. judge whether system is normal, if undesiredly change end over to; 3. set up smart electronics writing pencil of the present invention and the Radio Link that has the touch-screen smart machine; 4. judge whether Radio Link is normal; 5. main control module reads acceleration transducer and angular acceleration transducer data; 6. main control module obtains acceleration and angular acceleration transducer data and compresses and pre-service such as coding; 7. after main control module will be launched with wireless transmitter module through pretreated sensing data, get back to step 4..
In the common resident smart machine of external software module, detailed process is: carry out module self check and initialization after 1. starting software; 2. judge whether external software module module is working properly, if undesired then return and enter step behind the failure message and 9. finish; 3. judge whether Radio Link is working properly, if 9. the undesired step that enters finishes after returning failure message; 4. read the acceleration transducer and the angular acceleration transducer data that transmit in the Radio Link; 5. these data are decoded and decompressed pre-service and joining day information such as laggard capable filtering; 6. pretreated data are carried out feature extraction, 7. the splicing of multiple sensor data characteristics is merged; 8. feature is carried out pattern-recognition, obtains the classification of motions situation of smart electronics writing pencil of the present invention, smart machine is sent instruction after, get back to step 4..

Claims (10)

1. smart electronics writing pencil, it is characterized in that: comprise hardware system and software systems, described hardware comprises main control module, 3-axis acceleration sensor, angular acceleration transducer, A/D converter, wireless transmitter module, and adopt dual-bus structure to realize the connection of hardware system, wherein control bus is used to transmit the control signal of main control module and other modules, data bus is responsible for transmitting the data between each module, described wireless transmitter module is realized the wireless connections with external smart equipment, described software systems comprise the in house software module that is arranged on the main control module, and the external software module that is arranged on external smart equipment, described in house software module and external software module interconnect by wireless communication protocol, realize receiving and identifying the user by hand-written operation that hardware system carried out.
2. smart electronics writing pencil according to claim 1, it is characterized in that described main control module is responsible for obtaining of 3-axis acceleration sensor and angular acceleration transducer, and the control flow of hardware system inside, and to compress from the A/D converter data and encode after send to wireless sending module, and accept the control signal that control bus transmits.
3. smart electronics writing pencil according to claim 1 is characterized in that described 3-axis acceleration sensor is responsible for measuring smart electronics writing pencil current state with respect to the variation of the static weight acceleration of initial baseline face on three degree of freedom and rock the dynamic acceleration that penholder forms.
4. smart electronics writing pencil according to claim 1 is characterized in that described angular-rate sensor is responsible for measuring the angular acceleration that the rotation of smart electronics writing pencil penholder is produced.
5. smart electronics writing pencil according to claim 1 is characterized in that it is digital signal that described A/D converter is responsible for the analog signal conversion that degree of will speed up sensor and angular-rate sensor collected.
6. smart electronics writing pencil according to claim 1, it is characterized in that described wireless transmitter module is responsible for setting up the Radio Link of smart electronics writing pencil and other peripheral smart machines, will carry out follow-up processing through the external software module that pretreated acceleration informations such as main control module compression and coding send to external smart equipment.
7. smart electronics writing pencil according to claim 1 is characterized in that described in house software module finishes obtaining and sending and carry out control corresponding for main control module and other modules for the data of 3-axis acceleration sensor and angular acceleration transducer.
8. smart electronics writing pencil according to claim 1 is characterized in that described external software module finishes the reception of 3-axis acceleration sensor and angular acceleration transducer data, and carries out the subsequent treatment that the writing pencil motion feature extracts and athletic posture is discerned.
9. smart electronics writing pencil according to claim 8 is characterized in that described feature extraction differentiates the space for seeking new pattern on the basis of sending the 3-axis acceleration/angular acceleration that obtains through pre-service at 3-axis acceleration sensor and angular acceleration transducer back to.
10. smart electronics writing pencil according to claim 8 is characterized in that described athletic posture identification obtains final classification results by the mode of machine learning.
CN2011101087780A 2011-04-28 2011-04-28 Intelligent electronic handwriting pen Pending CN102135823A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011101087780A CN102135823A (en) 2011-04-28 2011-04-28 Intelligent electronic handwriting pen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011101087780A CN102135823A (en) 2011-04-28 2011-04-28 Intelligent electronic handwriting pen

Publications (1)

Publication Number Publication Date
CN102135823A true CN102135823A (en) 2011-07-27

Family

ID=44295626

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011101087780A Pending CN102135823A (en) 2011-04-28 2011-04-28 Intelligent electronic handwriting pen

Country Status (1)

Country Link
CN (1) CN102135823A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576900A (en) * 2013-11-14 2014-02-12 沈阳工业大学 Writing and drawing and menu selecting seamless linking method based on multi-parameter information of pen
CN103645848A (en) * 2013-12-13 2014-03-19 广东小天才科技有限公司 Ultrasonic wave based terminal control method and device
CN104636042A (en) * 2015-02-12 2015-05-20 联想(北京)有限公司 Information processing device and method
CN105856910A (en) * 2016-05-19 2016-08-17 福州富应成智能科技有限公司 Implementation method of environment light judgment based on smart pen
EP3147815A1 (en) 2015-09-23 2017-03-29 Politechnika Gdanska A system for hand-written signature and verification of its authenticity
CN108469912A (en) * 2018-02-01 2018-08-31 华北电力大学 A kind of character input method and system
CN110109599A (en) * 2018-02-01 2019-08-09 矽统科技股份有限公司 The interactive approach of user and stylus, categorizing system and stylus product
US11287903B2 (en) 2018-02-01 2022-03-29 Silicon Integrated Systems Corp. User interaction method based on stylus, system for classifying tap events on stylus, and stylus product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1818839A (en) * 2005-09-14 2006-08-16 王学永 Numeric stored handwritting pen
CN201097327Y (en) * 2007-09-30 2008-08-06 西北工业大学 Wireless computer control pen
CN101853380A (en) * 2010-06-18 2010-10-06 华南理工大学 Rotary characteristic extraction method based on gesture identification of acceleration sensor
CN201689394U (en) * 2010-06-03 2010-12-29 中国人民解放军第二炮兵工程学院 Stylus based on multi-sensor fusion

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1818839A (en) * 2005-09-14 2006-08-16 王学永 Numeric stored handwritting pen
CN201097327Y (en) * 2007-09-30 2008-08-06 西北工业大学 Wireless computer control pen
CN201689394U (en) * 2010-06-03 2010-12-29 中国人民解放军第二炮兵工程学院 Stylus based on multi-sensor fusion
CN101853380A (en) * 2010-06-18 2010-10-06 华南理工大学 Rotary characteristic extraction method based on gesture identification of acceleration sensor

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576900A (en) * 2013-11-14 2014-02-12 沈阳工业大学 Writing and drawing and menu selecting seamless linking method based on multi-parameter information of pen
CN103576900B (en) * 2013-11-14 2016-09-14 沈阳工业大学 Seamless link method chosen by Writing-painting based on a multi-parameter information and menu
CN103645848A (en) * 2013-12-13 2014-03-19 广东小天才科技有限公司 Ultrasonic wave based terminal control method and device
CN103645848B (en) * 2013-12-13 2016-08-24 广东小天才科技有限公司 A kind of terminal control method based on ultrasound wave and terminal control mechanism
CN104636042A (en) * 2015-02-12 2015-05-20 联想(北京)有限公司 Information processing device and method
EP3147815A1 (en) 2015-09-23 2017-03-29 Politechnika Gdanska A system for hand-written signature and verification of its authenticity
CN105856910A (en) * 2016-05-19 2016-08-17 福州富应成智能科技有限公司 Implementation method of environment light judgment based on smart pen
CN105856910B (en) * 2016-05-19 2018-02-13 福州富应成智能科技有限公司 The implementation method that ambient light based on smart pen judges
CN108469912A (en) * 2018-02-01 2018-08-31 华北电力大学 A kind of character input method and system
CN110109599A (en) * 2018-02-01 2019-08-09 矽统科技股份有限公司 The interactive approach of user and stylus, categorizing system and stylus product
US11287903B2 (en) 2018-02-01 2022-03-29 Silicon Integrated Systems Corp. User interaction method based on stylus, system for classifying tap events on stylus, and stylus product

Similar Documents

Publication Publication Date Title
CN102135823A (en) Intelligent electronic handwriting pen
US11243617B2 (en) Multi-function stylus with sensor controller
CN103257711B (en) space gesture input method
KR100630806B1 (en) Command input method using motion recognition device
CN101430614B (en) Planar and spatial writing system, and method thereof
CN102478959A (en) Control system and method for electronic device
CN101346684B (en) A hand-held electronic equipment
CN104090649A (en) Intelligent watchband and operating control method thereof
CN103703495A (en) Remote control device, information processing method and system
CN103109462A (en) Wearable motion sensing computing interface
CN102314230B (en) Input device of electronic equipment and character input method
CN101122836A (en) Movement sensing device
CN101114260A (en) Intelligent demonstration equipment used for electric document demonstration
CN101937277A (en) Writing type electronic input/output device
CN106774839A (en) A kind of intelligence wearing key board unit and its input method
CN102902376A (en) Wireless mouse employing multiple sensors
CN202177871U (en) Intelligent electronic handwriting pen
US8310447B2 (en) Pointing device housed in a writing device
CN202533877U (en) Electronic stylus
CN115686264B (en) False touch prevention method and equipment
WO2019042414A1 (en) Active pen and method for controlling cursor of mobile terminal by using same
CN101692197B (en) MEMS accelerometer based intelligent handwriting system and identification method thereof
CN201374041Y (en) Remote control device of multifunctional intelligent terminal
KR20160039961A (en) Motion interface device for recogniging user motion
CN105573478A (en) Input control method and device of portable equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20110727