CN106484151A - Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology - Google Patents
Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology Download PDFInfo
- Publication number
- CN106484151A CN106484151A CN201610863524.2A CN201610863524A CN106484151A CN 106484151 A CN106484151 A CN 106484151A CN 201610863524 A CN201610863524 A CN 201610863524A CN 106484151 A CN106484151 A CN 106484151A
- Authority
- CN
- China
- Prior art keywords
- micro
- smart pen
- artificial intelligence
- coded graphics
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/142—Image acquisition using hand-held instruments; Constructional details of the instruments
- G06V30/1423—Image acquisition using hand-held instruments; Constructional details of the instruments the instrument generating sequences of position coordinates corresponding to handwriting
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
- Character Discrimination (AREA)
Abstract
The invention discloses a kind of based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology and control method, the system includes：The micro- figure of coded graphics group, for serving as connection medium of the user writing Content Transformation for digital information, the Intelligent hardware for gathering image can be absorbed, recognized and be decoded to the micro- figure of coded graphics group；Smart pen, for while user completes to write, the micro- figure of useful coded graphics group is filtered out from the image of writing medium, the micro- figure of coded graphics group is identified obtaining handwriting trace information, and handwriting trace information is wirelessly sent to sync response terminal；Sync response terminal, for storing and managing the handwriting trace information for receiving, is rebuild, shown and is played to handwriting trace information in sync response terminal, and carries out big data analysis and artificial intelligence judgement to which.The present invention realizes the content on bearing medium and digitized document, picture, audio frequency, the mutual mapping of video content.
Description
Technical field
The present invention relates to human-computer interaction technique field, more particularly to a kind of based on micro- diagram data collection and artificial intelligence technology
Smart pen system and control method.
Background technology
Currently, the processing method for handwritten content to be input to electronic equipment and reproduce has been suggested.
The solution of one quasi-representative is：By the tool portion for carrying out handwriting input, (electronic touch pen or finger are touched
Touch, the electrical screen such as capacitance plate and touch screens), for recognize handwritten content pattern-recognition part, for determine handwritten content with
The whether consistent judgment part of ownership goal, for determine hand-written operate the software for whether retaining control to arrange, for will be hand-written
Physical storage device that the model that content is rebuild in the electronic device is stored etc. constitutes.This kind equipment above-mentioned can only be in screen
On write, the content for being retained also only has e-file, and needs to compare screen, confirmation and selection screen feedback when writing
Content, reduce the efficiency of writing of user, and user must constantly see screen, reduce the use body of user
Test, bigger particularly with the students in middle and primary schools' eyesight injury still in the body development phase.
Another kind of typical solution is：Existing ultrasonic wave input method, usually motion track is graphical, to which
When motion track is processed further, due to the bending of handwriting tracks, this input technology is also needed for common letter or Chinese character
Technology of identification complicated further is wanted, could by handwriting tracks electronization, and not be really to reduce completely, simultaneously for some
Non-legible figure, electronic then relatively difficult.Increase infrared generating unit in this kind of input method, one kind of structure is virtual
Input system, including the information receiving end for obtaining input information, the operating side for operating input, the operation planar being input into, institute
Stating operating side includes to produce the ultrasonic wave generating unit of ultrasonic wave and produces the infrared generating unit of infrared signal, described information
Receiving terminal includes the ultrasonic wave receiving unit of the ultrasonic wave for receiving ultrasonic wave generating unit generation, receives the infrared generation
The infrared receiver of infrared signal and carry out being input into the control unit of control that unit is produced, the operation planar passes through institute
State control unit and input area is defined, when the input area carries out input operation, the ultrasonic wave occurs for the operating side
Unit sends ultrasonic wave, and the ultrasonic wave receiving unit receives the ultrasonic wave, and the infrared generating unit sends infrared signal,
The infrared receiver determines the original position of the operating side after receiving the infrared signal, described control unit is according to connecing
The ultrasonic wave of receipts obtains the position of the place input area of the operating side and completes input.This kind of input method needs will carry out defeated
The setting position of the infrared generating unit of the operation planar for entering, the ultrasonic wave generating unit for producing ultrasonic wave and generation infrared signal
Fixing, and the easy moving operation plane of user, particularly when operation planar is multipage paper (such as training book, homework book),
Often turn over one page to be intended to retighten, in-convenience in use and have impact on Consumer's Experience.And also have another drawback, this it is integrated with
The region area that ultrasound unit, the device of infrared unit or equipment can be used for handwriting input is smaller, have impact on many of user
Scene is used, therefore is difficult to popularize.And, above-mentioned various ways are required for user often to watch screen comparing or check,
Have impact on user experience.Above-mentioned various ways are in gathered data, due to not enough facilitating, it is difficult to gather more data, special
It is not that dynamic data is more difficult to hold.
Content of the invention
The technical problem to be solved in the present invention is, for the defect for being difficult to obtain in prior art writing track data, to carry
For a kind of smart pen system and control method gathered based on micro- diagram data with artificial intelligence technology.
The technical solution adopted for the present invention to solve the technical problems is：
The present invention provides a kind of smart pen system gathered with artificial intelligence technology based on micro- diagram data, including coded graphics
Micro- figure, smart pen and sync response terminal is organized, wherein：
The micro- figure of coded graphics group, is arranged on writing medium, for serving as user writing Content Transformation for digital information
Connection medium, gather image Intelligent hardware the micro- figure of coded graphics group can be absorbed, recognized and be decoded；
Smart pen, for while user completes to write, gathers the image of writing medium by smart pen, from writing Jie
The micro- figure of useful coded graphics group is filtered out in the image of matter, and the micro- figure of coded graphics group is identified obtaining handwriting trace letter
Breath, and handwriting trace information is wirelessly sent to sync response terminal；
Sync response terminal, for storing and managing the handwriting trace information for receiving, to book in sync response terminal
Write trace information to be rebuild, shown and played, and big data analysis and artificial intelligence judgement is carried out to which.
Further, the micro- figure of the coded graphics group of the present invention includes mode arranged below：
Micro- figure is laid on the printed article made in traditionally on paper, class paper medium and based on traditionally on paper, class paper delivery medium；
The film for being covered with micro- figure is pasted on touch screen, flat board, mobile phone screen or on traditional blackboard, blank.
Further, the shape and size of the micro- figure of the coded graphics group of the present invention all can be according to using scene and using need
Ask and be adjusted, including mode arranged below：
Orthohexagonal 22 decimal coded figures；27 8 scale coding figures of non-regular hexagonal；25 of rectangle
Hexadecimal code figure.
Further, the smart pen of the present invention includes the conventional pen for being integrated with Intelligent hardware collector, and the Intelligent hardware is adopted
Storage is used for the function of making conventional pen have smart pen, including gathering the image of writing medium, sieves from the image of writing medium
The micro- figure of useful coded graphics group is selected, the micro- figure of coded graphics group is identified handwriting trace information is obtained, and rail will be write
Mark information is wirelessly sent to sync response terminal.
Further, the smart pen of the present invention is included with lower module：
Camera, for obtaining image during user writing；
Sound pick-up outfit, for obtaining the information of audio input；
USB interface：For the user behavior data for collecting is input to terminal device by wire transmission, and can be
Lithium cell charging in smart pen；
Lithium battery：For powering for smart pen；
RAM：Random access memory, can be wiped to the storage content in smart pen and be changed；
Master cpu：For data collection and analysis process being carried out to electric signal, and be sent to end by radio transmission apparatus
End equipment；
Pressure sensor and A/D conversion：Both use cooperatively, and hand-written nib is pressed of user starts pressure sensor generation
Electric signal, the electric signal of generation acts on the receiving terminal of camera makes camera start working, and micro- figure is scanned, subsequently
The mapping table that is set up in tangible media by A/D conversion equipment, makes picture export on the electronic display screen by mapping relations；
Ceramic antenna and bluetooth module：Bluetooth equipment connects smart pen and terminal electronic device, using short-distance transmission
Ceramic antenna carries out input operation to the data that collects；
Buzzer and status display LED：For sending alerting signal, as the mark of status display.
Further, synchronizing mode to handwriting trace in the sync response terminal of the present invention includes：
Handwriting trace is rebuild, shown and is played by traditional equipment with electronic curtain；
Handwriting trace is rebuild, shown and is played by VR, AR or MR equipment.
The present invention provides a kind of control method gathered with the smart pen system of artificial intelligence technology, bag based on micro- diagram data
Include following steps：
S1, the shape and size of the micro- figure of setting, and the system of micro- figure is selected, different answering is made by micro- figure Software for producing
With the micro- figure of required coded graphics group, carry out printing after layering is superimposed with e-file；
S2, micro- figure of printing is laid on writing medium, write using smart pen, when the handwriting input end of smart pen
Nib produces pressure feedback to pressure sensor when touching input media, the pressure of handwriting input can be passed through by pressure sensor
Sensor processes and passes to CPU, CPU receiving data and camera is transformed to working condition by resting state after processing, and makes shooting
Head is scanned to micro- figure；
S3, camera are started working, and gather picture by certain frame per second, and CPU carries out image procossing and filters out useful
Micro- figure simultaneously forms the mapping data of handwriting trace, together with pressure mapping data, is sent to by data wire or radio communication
Terminal processes；
S4, sync response terminal show after allowing the vestige that writes to be rebuild in terminal device according to the data for receiving
Existing, broadcasting, if while start sound pick-up outfit, meeting is by the sound that records in the lump from terminal in playing process in gatherer process
Equipment is exported.
Further, the method for carrying out image procossing the step of the present invention in S3 is specially：
Camera scanning obtains picture, and picture is pre-processed, and carries out level refinement to picture and vertically refine；Sentence
Breaking and whether meet characteristic area, if not meeting, reacquiring camera picture；If meeting, the characteristic area to identifying carries out feature
Extract, block and system is recognized, is obtained each attribute information and maps out digit groups.
Further, the frame per second for gathering picture the step of the present invention in S3 is 90-120 frame/second.
The beneficial effect comprise that：The smart pen gathered based on micro- diagram data with artificial intelligence technology of the present invention
System, can facilitate hand-written manuscript to be converted to digitized electronic document, it is also possible to will be revealable for visual tradition picture and text mapping
Digitized content, realizes the content on bearing medium and digitized document, picture, audio frequency, the mutual mapping of video content.
Description of the drawings
Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing：
Fig. 1 is the coded graphics group use environment figure of the embodiment of the present invention；
Fig. 2 is the decoding process figure of the embodiment of the present invention.
Specific embodiment
In order that the objects, technical solutions and advantages of the present invention become more apparent, below in conjunction with drawings and Examples, right
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only in order to explain the present invention, not
For limiting the present invention.
The embodiment of the present invention based on micro- diagram data collection and artificial intelligence technology smart pen system, including coded graphics
Micro- figure, smart pen and sync response terminal is organized, wherein：
The micro- figure of coded graphics group, is arranged on writing medium, for serving as user writing Content Transformation for digital information
Connection medium, gather image Intelligent hardware the micro- figure of coded graphics group can be absorbed, recognized and be decoded；
Smart pen, for while user completes to write, gathers the image of writing medium by smart pen, from writing Jie
The micro- figure of useful coded graphics group is filtered out in the image of matter, and the micro- figure of coded graphics group is identified obtaining handwriting trace letter
Breath, and handwriting trace information is wirelessly sent to sync response terminal；
Sync response terminal, for storing and managing the handwriting trace information for receiving, to book in sync response terminal
Write trace information to be rebuild, shown and played, and big data analysis and artificial intelligence judgement is carried out to which.
The micro- figure of coded graphics group includes mode arranged below：
Micro- figure is laid on the printed article made in traditionally on paper, class paper medium and based on traditionally on paper, class paper delivery medium；
The film for being covered with micro- figure is pasted on touch screen, flat board, mobile phone screen or on traditional blackboard, blank.
The shape and size of the micro- figure of coded graphics group all can according to being adjusted using scene and use demand, including with
Lower set-up mode：
Orthohexagonal 22 decimal coded figures；27 8 scale coding figures of non-regular hexagonal；25 of rectangle
Hexadecimal code figure.
Smart pen includes the conventional pen for being integrated with Intelligent hardware collector, and the Intelligent hardware collector is used for having conventional pen
There is the function of smart pen, including the image of writing medium is gathered, useful coded graphics is filtered out from the image of writing medium
Micro- figure is organized, the micro- figure of coded graphics group is identified handwriting trace information is obtained, and handwriting trace information is passed through wireless side
Formula is sent to sync response terminal.
Smart pen is included with lower module：
Camera, for obtaining image during user writing；
Sound pick-up outfit, for obtaining the information of audio input；
USB interface：For the user behavior data for collecting is input to terminal device by wire transmission, and can be
Lithium cell charging in smart pen；
Lithium battery：For powering for smart pen；
RAM：Random access memory, can be wiped to the storage content in smart pen and be changed；
Master cpu：For data collection and analysis process being carried out to electric signal, and be sent to end by radio transmission apparatus
End equipment；
Pressure sensor and A/D conversion：Both use cooperatively, and hand-written nib is pressed of user starts pressure sensor generation
Electric signal, the electric signal of generation acts on the receiving terminal of camera makes camera start working, and micro- figure is scanned, subsequently
The mapping table that is set up in tangible media by A/D conversion equipment, makes picture export on the electronic display screen by mapping relations；
Ceramic antenna and bluetooth module：Bluetooth equipment connects smart pen and terminal electronic device, using short-distance transmission
Ceramic antenna carries out input operation to the data that collects；
Buzzer and status display LED：For sending alerting signal, as the mark of status display.
Mode is synchronized to handwriting trace in sync response terminal includes：
Handwriting trace is rebuild, shown and is played by traditional equipment with electronic curtain；
Handwriting trace is rebuild, shown and is played by VR, AR or MR equipment.
As shown in figure 1, the smart pen system based on the collection of micro- diagram data and artificial intelligence technology of the embodiment of the present invention
Control method, comprises the following steps：
S1, the shape and size of the micro- figure of setting, and the system of micro- figure is selected, different answering is made by micro- figure Software for producing
With the micro- figure of required coded graphics group, carry out printing after layering is superimposed with e-file；
S2, micro- figure of printing is laid on writing medium, write using smart pen, when the handwriting input end of smart pen
Nib produces pressure feedback to pressure sensor when touching input media, the pressure of handwriting input can be passed through by pressure sensor
Sensor processes and passes to CPU, CPU receiving data and camera is transformed to working condition by resting state after processing, and makes shooting
Head is scanned to micro- figure；
S3, camera are started working, and gather picture by certain frame per second, and CPU carries out image procossing and filters out useful
Micro- figure simultaneously forms the mapping data of handwriting trace, together with pressure mapping data, is sent to by data wire or radio communication
Terminal processes；
S4, sync response terminal show after allowing the vestige that writes to be rebuild in terminal device according to the data for receiving
Existing, broadcasting, if while start sound pick-up outfit, meeting is by the sound that records in the lump from terminal in playing process in gatherer process
Equipment is exported.
As shown in Fig. 2 the method for carrying out image procossing in step S3 is specially：
Camera scanning obtains picture, and picture is pre-processed, and carries out level refinement to picture and vertically refine；Sentence
Breaking and whether meet characteristic area, if not meeting, reacquiring camera picture；If meeting, the characteristic area to identifying carries out feature
Extract, block and system is recognized, is obtained each attribute information and maps out digit groups.
In another specific embodiment of the present invention, it is related to a kind of hand-written digitized process recording mode, audiovisual and listens
Interaction mode is write, more particularly to a kind of big data record and analysis, motion to status informations such as handwriting tracks, dynamics, times
The process tracking record of track, and with the big data that collects hand-written process is digitized rebuilding with reproduction, to hand-written
Input result (word, symbol, figure etc.) carry out electronization rebuild with reproduce, to audio-visual content carry out dictate feedback method and
Data Analysis Services system.
The purpose of the system has three aspects：
First aspect：The printed article made in traditionally on paper, class paper medium and based on traditionally on paper, class paper delivery medium is (such as
Papery notebook, homework book, exercise this etc.) upper laying micro- figure such as (print or printing), when using above-mentioned be integrated with pen or
When the smart pen of refill for ball-point pen is write thereon, written trace can be digitized, and can other information of synchronous typing when writing
(recording, write start and end time etc.) when for example explaining when writing.
Second aspect：The film for being covered with micro- figure is pasted on the screens such as touch screen, flat board, mobile phone or on traditional blackboard, blank,
Or the micro- figure that discovers almost is difficult to the screen of touch screen, flat board, mobile phone transfer vision, conventional ink pen is integrated with using above-mentioned
Or the smart pen of entity nib is when writing, written trace (track) is digitized and is shown by computer equipment on demand, and can
Other information when synchronous typing can be write (recording, write start and end time etc.) when for example explaining when writing.
The third aspect：The printed article made in traditionally on paper, class paper medium and based on traditionally on paper, class paper delivery medium is (such as
Papery notebook, homework book, exercise this etc.) upper laying micro- figure such as (print or printing), when using above-mentioned be integrated with pen or
When the smart pen of refill for ball-point pen or entity nib maps the region of VR, AR, MR and traditional media content and is identified to which, can
Play VR, AR, MR and traditional media content and directly write using smart pen and answer, artificial intelligence evaluating system can be to making
Answer result and carry out judge and correct errors.
(1) Intelligent hardware for printing or printing, transfer and can be collected image on the medium for being available for writing is absorbed, is known
Micro- figure not with decoding；
A kind of coded graphics group for carrying out image recognition and its coded system, the coded graphics group are provided in the present embodiment
Micrographics shape may act as the new connection medium that user's handwritten content is converted to digital information, computer equipment processes medium
On micro- figure group after, annexation is corresponded to by mapping table, the information of this micrographics group connection can be carried out recording, be extracted,
Reconstruction etc. is processed to realize man-machine interaction.While also can achieve to need in the digitlization being connected existing content on printed article with which
Hold and mapped (including one-to-one, one-to-many, many-to-one connection).
In order to meet the use demand of user as far as possible, the micrographics shape of this coded graphics group and size all can be according to making
It is adjusted with scene and use demand.
The a certain example of this coded graphics group micro- figure a certain system under hexagon and rectangular shape is given respectively.
What regular hexagon example was given is 22 decimal coded figures
What non-regular hexagonal example was given is 27 8 scale coding figures
What rectangular example was given is 25 hexadecimal code figures
As follows to the laying of the micro- figure of coded graphics group and positioning mode when being drawn using computer application software：In computer
When intending printing on electronic paper by micro- for coded graphics group artwork in application software, outwards clockwise from electronic paper center
The spiral laying micro- figure of coded graphics group, starting simulation print point are the micro- figure of coded graphics group of this page of paper center distribution.
(2) Intelligent hardware for being integrated with interchangeable conventional ink pen, entity nib and gathering user writing content is adopted
Storage；
For gathering the Intelligent hardware group of user's handwritten content, including handwritten instruments corollary apparatus, positioning and track following
Device, completes handwriting input mark, IMAQ identification.
Pressure-activated pressure sensor nib applied when hand-written by user, the telecommunications sent by pressure sensor
Number start camera on the inside of pen carries out surface sweeping identification to the micro- figure that lays above paper, and is changed electricity by A/D
Pressure signal is converted into data signal, and the data signal of output can be 8,10,12,14 and 16 etc., and these are counted
Word signal corresponds to coding and builds mapping table, thus can show written trace after treatment in the electronic device.
(3) for processing the software systems of the image for collecting and user writing information；
For recognition coding graphical set, the identification of coded graphics group is aided in by providing one group of mask.
Mask graph is according to the specific coded graphics group that will be identified with image procossing, and adopts and coded graphics
The corresponding figure of the image mapping flag elementary cell arrangement mode of group, the arrangement of mask internal image mapping flag elementary cell with
The image mapping flag elementary cell arrangement of the internal corresponding region of coded graphics group is consistent, all image mapping flag elementary cells
It is represented as very, in parsing, the correspondence image mapping of the mask that will meet specification and the coded graphics group that will be parsed
Mark elementary cell is carried out and computing.
The specification of medium is determined according to use demand, and the specification of different use environment media is different, especially side
Length differs.When the length of side of medium is not the integral multiple of the length of side of coded graphics group, not complete in the module of medium edge laying
Whole, it is impossible to be known otherwise using conventional mask, it is incomplete coded graphics group that this scene is paper periphery, this enforcement
Example provides two kinds of RMs.
The first, can determine four angles of paper and the midpoint on each side in laying, using this eight points as anchor point,
Due to the presence for having these anchor points, incomplete coded graphics group can be laid in media edge region, not complete for these
Reorganization code graphical set does not need mask to be completely covered and is identified, it is only necessary to calculate the imperfect coded graphics group by algorithm
Imperfect coded graphics group can be identified with the distance between two nearest anchor points.
Second, as masked areas exceed incomplete coded graphics group A, therefore, mask can be recognized not
The subregion of complete graphical set adjacent pattern group B, is to determine in its corresponding numeral represents due to the information of B, can
To determine the information of A by the information of determination B.
The embodiment of the present invention makes to realize the mapping of 1, digital information and traditional sucrose with the following method；2nd, the two of content write by pen
Dimension is rebuild.
(4) driving equipment and the responder of real-time synchronization are realized.
Either the vestige of writing end is projected to terminal electronic device still by the track method of operation of positioning end from end
Play out in the electronic equipment of end, it is necessary in traditionally on paper, class papery, touch on flat board or printed article and lay one layer of micro- figure, so
The data transfer for obtaining the written trace mapping on micro- figure afterwards with the camera scanning that inlays in smart pen is set to terminal electronic
Standby upper process could be realized.
Signal sending end：This is the transmission medium that a kind of combination bluetooth module and ceramic antenna are formed.This radio installation
The information transfer of the written trace mapping on traditionally on paper, class papery, tactile flat board or printed article can be set to terminal electronic
Standby upper process is simultaneously shown or is played.By bluetooth connection smart pen and terminal device, then will be in reality through ceramic antenna
Handwriting trace mapping data transfer in body medium is shown to terminal device reduction.This is a kind of nothing for being capable of real-time Transmission
Line equipment, its function as the communications being entered into the data syn-chronization such as the vestige of user writing in terminal device.
Responder：Using response of the partial pressure type buzzer to current operation, status display LED which contains can be to current
Operation is judged that LED includes the state representation combination of three kinds of color compositions of red, green, blue.
For example, play VR, AR, MR and traditional media content and directly write using smart pen answer when, artificial intelligence
Energy evaluating system can carry out judge to result of answering and correct errors, if result is correct, then LED can give a green light expression result correctly,
Otherwise then LED can send out a warning and represent result mistake；Start recording when LED light blue lamp then represents, in recording process, letter can be started
Number send by record transfer voice to terminal electronic device, finally can play in the electronic equipments such as computer, mobile phone, ipad.
In the embodiment of the present invention, print or be printed on paper or class paper medium using shop fixtures mode, set by conversion
Standby, the coding micrographics on printing or being printed on paper or class paper delivery medium is can recognize that, when hand-written mapped mode is applied to, can be led to
Crossing computer carries out 2-d reconstruction and uses.When digital content mapped mode is applied to, can be by corresponding numeral on the paper
Change content to show by other forms.
Step one：By micro- figure Software for producing system, square, regular hexagon, non-regular hexagonal and its size is selected, then
8 systems, 10 systems, 16 systems are selected, the coded image group required for different application can be made, can enter with other e-files
Print after row layering superposition or printing is used.
Step 2, produces pressure when handwriting input end nib touches input bearing medium and touches pressure sensor,
Pressure sensor can be by the pressure of handwriting input by camera after sensor processes and passes to CPU, CPU receiving data and process
Working condition is transformed to by resting state, makes camera be scanned micro- figure.
Step 3, camera are started working, and gather picture by certain frame per second (90-120 frame/second), and CPU is carried out at image
Manage and filter out useful micro- figure and trajectory map data are formed, together with pressure mapping data, by data wire or wireless
Communication is sent to terminal processes.
Step 4：The picture signal of collection is input to terminal electronic device by signal sending end, allows the vestige that writes at end
Manifest after being rebuild in end equipment, play, if while start recording arrangement in gatherer process, can be by playing process
The sound of recording is exported from terminal device in the lump.
As shown in Fig. 2 the decoding process figure of the embodiment of the present invention is given, in order to introduce the solution of the micro- figure of this coded graphics group
Code method.
Being embodied as flow process is：This coding/decoding method is identified to the micro- figure of coded graphics group using image processing techniques.When
After camera obtains picture with certain rate scanning, CPU is pre-processed to picture, through horizontal and vertical process it
Characteristic area to coded graphics group judges afterwards；If characteristic area is identified, segmentation extraction is carried out to characteristic area, is otherwise adopted
Processed with next pictures；The characteristic area being partitioned into is identified using mask, the result output that will identify that.
The functional analysis of the vitals that smart pen is equipped with：
USB interface：The interface has two important purposes, and one is that the user behavior data for collecting is passed through wire transmission
Be input to terminal device, two be to the lithium cell charging in smart pen.
Lithium battery：The power supply for using is lithium ion battery, and which can be charged, and current lithium ion battery has become
For main flow.
RAM：Random access memory, can be wiped to the storage content in smart pen and be changed.
Master cpu：Carry out data collection and analysis process, and be sent to terminal by radio transmission apparatus setting to electric signal
Standby.
Nand Flash：It is one kind of internal memory, various data datas can be stored.
Pressure sensor and A/D conversion：Both use cooperatively, and hand-written nib is pressed of user starts pressure sensor generation
Electric signal, the electric signal of generation acts on the receiving terminal of camera makes camera start working, and to being laid on traditionally on paper, class
Micro- figure on papery, printed article etc. is scanned, the mapping table that is subsequently set up in tangible media by A/D conversion equipment, passes through
Mapping relations make picture export on the electronic display screen.
Ceramic antenna and bluetooth module：Bluetooth equipment connects smart pen and terminal electronic device, using short-distance transmission
Ceramic antenna carries out input operation to the data that collects.
Buzzer and status display LED：Using partial pressure type buzzer, in partial pressure type buzzer, contain light emitting diode
(LED) LED of three kinds of different colours, respectively three color of red, green, blue can be set as the mark of status display.
It is simultaneously direct to can play VR, AR, MR and traditional media content that the LED of redness and green is generally used for artificial intelligence
Write judge of answering to correct errors using smart pen, when result is correct, LED is green state, while buzzer can send " just answering
Sound really ", and LED is red status when result mistake, buzzer can send the sound of " erroneous answers "；Blue LED
Often bright state is generally kept during recorded voice, and before recording, buzzer has prompt tone." recording starts " represents and can open
Begin to record, buzzer and the parallel use of LED two states improve can the efficiency of smart pen.
The invention has the beneficial effects as follows：Hand-written manuscript can be facilitated to be converted to digitized electronic document, it is also possible to can
Map revealable digitized content depending on traditional picture and text, realize content on bearing medium and digitized document, picture, audio frequency,
The mutual mapping of video content.
For example when being used for the routine work record educational application scenarios such as scene and study coach, examination, integrated use is existing
For the multidisciplinary science and technology such as image technique, photoelectric technology, printing technology, database technology, to traditionally on paper notebook, account
Originally, training book and paper etc. carry out upgrading, and gather hand-written record of the people in papery, white silk by intelligent hardware devices
Practise, read the data of the generations such as annotation, answer so as to digital information is converted into for content storage management, big data analysis, people
Work intelligent operation sentences the demand that the many-side such as volume, artificial intelligence study coach is used, can also be by the printed article of traditional class paper delivery medium
Transformation is digitized, form displaying, substitution are represented with the vision (sense of hearing, tactile) that meets the face (four limbs) of people to information
Sense, virtualized multiple demand.
It should be appreciated that for those of ordinary skills, can be improved according to the above description or be converted,
And all these modifications and variations should all belong to the protection domain of claims of the present invention.
Claims (9)
1. a kind of based on micro- diagram data collection and artificial intelligence technology smart pen system, it is characterised in that including coded graphics
Micro- figure, smart pen and sync response terminal is organized, wherein：
The micro- figure of coded graphics group, is arranged on writing medium, for serving as company of the user writing Content Transformation for digital information
Medium is connect, the Intelligent hardware for gathering image can be absorbed, recognized and be decoded to the micro- figure of coded graphics group；
Smart pen, for, while user completes to write, gathering the image of writing medium, from writing medium by smart pen
The micro- figure of useful coded graphics group is filtered out in image, and the micro- figure of coded graphics group is identified obtaining handwriting trace information, and
Handwriting trace information is wirelessly sent to sync response terminal；
Sync response terminal, for storing and managing the handwriting trace information for receiving, to writing rail in sync response terminal
Mark information is rebuild, shown and is played, and carries out big data analysis and artificial intelligence judgement to which.
2. according to claim 1 based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology, its feature exists
In the micro- figure of coded graphics group includes mode arranged below：
Micro- figure is laid on the printed article made in traditionally on paper, class paper medium and based on traditionally on paper, class paper delivery medium；
The film for being covered with micro- figure is pasted on touch screen, flat board, mobile phone screen or on traditional blackboard, blank.
3. according to claim 1 based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology, its feature exists
In the shape and size of the micro- figure of coded graphics group all can be according to being adjusted using scene and use demand, including to divide into
Put mode：
Orthohexagonal 22 decimal coded figures；27 8 scale coding figures of non-regular hexagonal；25 16 of rectangle
Scale coding figure.
4. according to claim 1 based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology, its feature exists
In smart pen includes the conventional pen for being integrated with Intelligent hardware collector, and the Intelligent hardware collector is used for making conventional pen have intelligence
The function of energy pen, including gathering the image of writing medium, filters out useful coded graphics group micro- from the image of writing medium
Figure, is identified obtaining handwriting trace information to the micro- figure of coded graphics group, and handwriting trace information is wirelessly sent out
Give sync response terminal.
5. according to claim 1 based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology, its feature exists
In smart pen is included with lower module：
Camera, for obtaining image during user writing；
Sound pick-up outfit, for obtaining the information of audio input；
USB interface：For the user behavior data for collecting is input to terminal device by wire transmission, and can be intelligence
Lithium cell charging in pen；
Lithium battery：For powering for smart pen；
RAM：Random access memory, can be wiped to the storage content in smart pen and be changed；
Master cpu：For data collection and analysis process is carried out to electric signal, and be sent to terminal by radio transmission apparatus and set
Standby；
Pressure sensor and A/D conversion：Both use cooperatively, and hand-written nib is pressed of user starts pressure sensor generation telecommunications
Number, the electric signal of generation acts on the receiving terminal of camera makes camera start working, and micro- figure is scanned, and subsequently passes through
The mapping table that A/D conversion equipment is set up in tangible media, makes picture export on the electronic display screen by mapping relations；
Ceramic antenna and bluetooth module：Bluetooth equipment connects smart pen and terminal electronic device, using the pottery of short-distance transmission
The data that antenna pair is collected carry out input operation；
Buzzer and status display LED：For sending alerting signal, as the mark of status display.
6. according to claim 1 based on the collection of micro- diagram data and the smart pen system of artificial intelligence technology, its feature exists
In synchronizing mode to handwriting trace in sync response terminal includes：
Handwriting trace is rebuild, shown and is played by traditional equipment with electronic curtain；
Handwriting trace is rebuild, shown and is played by VR, AR or MR equipment.
7. a kind of based on micro- diagram data collection and artificial intelligence technology smart pen system control method, it is characterised in that bag
Include following steps：
S1, the shape and size of the micro- figure of setting, and the system of micro- figure is selected, different application institutes are made by micro- figure Software for producing
The micro- figure of the coded graphics group of needs, carries out printing after layering is superimposed with e-file；
S2, micro- figure of printing is laid on writing medium, write using smart pen, when the handwriting input end nib of smart pen
Pressure feedback is produced when touching input media to pressure sensor, pressure sensor can be by the pressure of handwriting input through sensing
Device processes and passes to CPU, CPU receiving data and camera is transformed to working condition by resting state after processing, and makes camera pair
Micro- figure is scanned；
S3, camera are started working, and gather picture by certain frame per second, and CPU carries out image procossing and filters out useful micro- figure
And the mapping data of handwriting trace are formed, together with pressure mapping data, terminal is sent to by data wire or radio communication
Process；
S4, sync response terminal allow the vestige that writes to manifest after being rebuild in terminal device, broadcast according to the data for receiving
Put, if while starting sound pick-up outfit, meeting is by the sound that records in the lump from terminal device in playing process in gatherer process
Output.
8. according to claim 7 based on micro- diagram data collection and artificial intelligence technology smart pen system controlling party
Method, it is characterised in that the method for carrying out image procossing in step S3 is specially：
Camera scanning obtains picture, and picture is pre-processed, and carries out level refinement to picture and vertically refine；Judgement is
No meet characteristic area, if not meeting, reacquire camera picture；If meeting, the characteristic area to identifying carries out feature extraction,
Identification block and system, obtain each attribute information and map out digit groups.
9. according to claim 7 based on micro- diagram data collection and artificial intelligence technology smart pen system controlling party
Method, it is characterised in that the frame per second for gathering picture in step S3 is 90-120 frame/second.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610863524.2A CN106484151A (en) | 2016-09-29 | 2016-09-29 | Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610863524.2A CN106484151A (en) | 2016-09-29 | 2016-09-29 | Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106484151A true CN106484151A (en) | 2017-03-08 |
Family
ID=58268971
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610863524.2A Pending CN106484151A (en) | 2016-09-29 | 2016-09-29 | Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106484151A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107364256A (en) * | 2017-06-26 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of smart pen, intelligent learning system and its method of work |
| CN107765900A (en) * | 2017-10-30 | 2018-03-06 | 广州视源电子科技股份有限公司 | Intelligent pen, control method, device, equipment and storage medium of intelligent pen |
| CN107944441A (en) * | 2017-12-15 | 2018-04-20 | 郑州科技学院 | A kind of scanning-type translation pen |
| CN108551575A (en) * | 2018-06-25 | 2018-09-18 | 汉字造梦（武汉）文化传播有限公司 | A kind of glyphomancy interactive experience system and method |
| CN110135228A (en) * | 2018-09-29 | 2019-08-16 | 广东小天才科技有限公司 | Dictation proficiency evaluation method and wearable device |
| CN110348427A (en) * | 2019-07-23 | 2019-10-18 | 湖南纸云互动智能科技有限公司 | A kind of face hand-written input system and method based on Image Acquisition |
| CN110658929A (en) * | 2019-09-10 | 2020-01-07 | 伊睿特科技(北京)有限公司 | Control method and device for intelligent pen |
| CN110874150A (en) * | 2018-08-29 | 2020-03-10 | 朱莞儿 | Intelligent base plate, writing information collecting method and writing information processing method |
| CN110992000A (en) * | 2019-12-04 | 2020-04-10 | 广州云蝶科技有限公司 | Method for managing backlog based on dot matrix paper pen technology |
| CN112567321A (en) * | 2018-08-08 | 2021-03-26 | 三星电子株式会社 | Electronic device comprising an electronic pen and method of controlling a communication connection between an electronic device and an electronic pen |
| CN112578917A (en) * | 2020-05-23 | 2021-03-30 | 卓德善 | Note recording system and method linked with panoramic video |
| CN112839201A (en) * | 2020-12-26 | 2021-05-25 | 贵州树精英教育科技有限责任公司 | Method for acquiring writing data by adopting intelligent pen |
| CN113176834A (en) * | 2021-03-15 | 2021-07-27 | 华能国际电力股份有限公司上海石洞口第一电厂 | Screen writing system |
| CN113238670A (en) * | 2021-05-08 | 2021-08-10 | 广州宏途教育网络科技有限公司 | Internet of things-based intelligent pen control implementation method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103576989A (en) * | 2013-11-01 | 2014-02-12 | 北京汉神科创文化发展有限公司 | Writing based human-computer interaction display system and method |
| CN104932717A (en) * | 2015-05-24 | 2015-09-23 | 田雪松 | Dot matrix digital pen |
| CN204808237U (en) * | 2015-05-24 | 2015-11-25 | 北京拓思德科技有限公司 | Audio frequency dot matrix digital pen |
| CN105678239A (en) * | 2015-12-31 | 2016-06-15 | 田雪松 | Text identification method based on lattice |
-
2016
- 2016-09-29 CN CN201610863524.2A patent/CN106484151A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103576989A (en) * | 2013-11-01 | 2014-02-12 | 北京汉神科创文化发展有限公司 | Writing based human-computer interaction display system and method |
| CN104932717A (en) * | 2015-05-24 | 2015-09-23 | 田雪松 | Dot matrix digital pen |
| CN204808237U (en) * | 2015-05-24 | 2015-11-25 | 北京拓思德科技有限公司 | Audio frequency dot matrix digital pen |
| CN105678239A (en) * | 2015-12-31 | 2016-06-15 | 田雪松 | Text identification method based on lattice |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107364256A (en) * | 2017-06-26 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of smart pen, intelligent learning system and its method of work |
| CN107364256B (en) * | 2017-06-26 | 2020-04-10 | 上海斐讯数据通信技术有限公司 | Intelligent pen, intelligent learning system and working method thereof |
| CN107765900A (en) * | 2017-10-30 | 2018-03-06 | 广州视源电子科技股份有限公司 | Intelligent pen, control method, device, equipment and storage medium of intelligent pen |
| CN107944441A (en) * | 2017-12-15 | 2018-04-20 | 郑州科技学院 | A kind of scanning-type translation pen |
| CN107944441B (en) * | 2017-12-15 | 2020-09-08 | 郑州科技学院 | Scanning type translation pen |
| CN108551575A (en) * | 2018-06-25 | 2018-09-18 | 汉字造梦（武汉）文化传播有限公司 | A kind of glyphomancy interactive experience system and method |
| CN112567321A (en) * | 2018-08-08 | 2021-03-26 | 三星电子株式会社 | Electronic device comprising an electronic pen and method of controlling a communication connection between an electronic device and an electronic pen |
| US11989365B2 (en) | 2018-08-08 | 2024-05-21 | Samsung Electronics Co., Ltd. | Electronic device including electronic pen and method of controlling communication connection between electronic device and electronic pen |
| CN110874150A (en) * | 2018-08-29 | 2020-03-10 | 朱莞儿 | Intelligent base plate, writing information collecting method and writing information processing method |
| CN110135228A (en) * | 2018-09-29 | 2019-08-16 | 广东小天才科技有限公司 | Dictation proficiency evaluation method and wearable device |
| CN110135228B (en) * | 2018-09-29 | 2021-07-23 | 广东小天才科技有限公司 | Dictation proficiency evaluation method and wearable device |
| CN110348427A (en) * | 2019-07-23 | 2019-10-18 | 湖南纸云互动智能科技有限公司 | A kind of face hand-written input system and method based on Image Acquisition |
| CN110658929B (en) * | 2019-09-10 | 2022-11-04 | 伊睿特科技(北京)有限公司 | Control method and device for intelligent pen |
| CN110658929A (en) * | 2019-09-10 | 2020-01-07 | 伊睿特科技(北京)有限公司 | Control method and device for intelligent pen |
| CN110992000A (en) * | 2019-12-04 | 2020-04-10 | 广州云蝶科技有限公司 | Method for managing backlog based on dot matrix paper pen technology |
| CN110992000B (en) * | 2019-12-04 | 2023-04-14 | 广州云蝶科技有限公司 | Method for managing backlogs based on dot matrix paper and pen technology |
| CN112578917A (en) * | 2020-05-23 | 2021-03-30 | 卓德善 | Note recording system and method linked with panoramic video |
| CN112839201A (en) * | 2020-12-26 | 2021-05-25 | 贵州树精英教育科技有限责任公司 | Method for acquiring writing data by adopting intelligent pen |
| CN113176834A (en) * | 2021-03-15 | 2021-07-27 | 华能国际电力股份有限公司上海石洞口第一电厂 | Screen writing system |
| CN113238670A (en) * | 2021-05-08 | 2021-08-10 | 广州宏途教育网络科技有限公司 | Internet of things-based intelligent pen control implementation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106484151A (en) | Based on the collection of micro- diagram data and smart pen system and the control method of artificial intelligence technology | |
| CN106778720A (en) | A kind of system and method rebuild to hand-written digitized process record and electronization | |
| CN102067153B (en) | Multi-modal learning system | |
| CN102707817B (en) | Laser inscription system | |
| CN109509375A (en) | A kind of comprehensive screen blackboard system of intelligence and its control method of recorded broadcast one | |
| CN206516113U (en) | A kind of intelligent electronic white board black board teaching system | |
| CN102906677A (en) | Handwriting input board and information processing system using a handwriting input board | |
| CN103617642B (en) | A kind of digital book drawing method and device | |
| CN202758328U (en) | Nanometer interactive electronic white board | |
| CN107783718A (en) | A kind of online assignment hand-written based on papery/examination input method and device | |
| CN110796065A (en) | Calligraphy practicing scoring method and system based on image recognition and computer readable medium | |
| CN201820211U (en) | Internet-of-things-based electronic identification system | |
| CN109166358A (en) | A kind of multi-modal tutoring system based on Internet of Things | |
| KR101700317B1 (en) | System, method and computer readable recording medium for managing an education using a smart pen based on a dot code | |
| CN110853424A (en) | Voice learning method, device and system with visual recognition | |
| CN203490852U (en) | Terminal for electronic teaching | |
| CN104898881A (en) | Novel electronic notebook device | |
| CN110349458A (en) | A kind of paper cloud interaction interactive system | |
| CN208834516U (en) | A kind of point-of-reading system convenient to use | |
| CN106650651A (en) | Signature photographing system | |
| CN209216157U (en) | A kind of intelligent sharing blackboard for education, a kind of writing implement and a kind of display panel | |
| CN206259052U (en) | A kind of Multifunctional English studying device | |
| CN106327932A (en) | Intelligent education teaching management control system based on internet | |
| CN203102642U (en) | Cloud electronic school bag | |
| CN209543191U (en) | A kind of multifunctional application remote training all-in-one machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170308 |
|
| RJ01 | Rejection of invention patent application after publication |