CN1975804A - Education robot with character-learning and writing function and character recognizing method thereof - Google Patents

Education robot with character-learning and writing function and character recognizing method thereof Download PDF

Info

Publication number
CN1975804A
CN1975804A CN 200610124243 CN200610124243A CN1975804A CN 1975804 A CN1975804 A CN 1975804A CN 200610124243 CN200610124243 CN 200610124243 CN 200610124243 A CN200610124243 A CN 200610124243A CN 1975804 A CN1975804 A CN 1975804A
Authority
CN
China
Prior art keywords
writing
literal
image
robot
embedded system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200610124243
Other languages
Chinese (zh)
Other versions
CN100559422C (en
Inventor
金连文
龙腾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CNB2006101242431A priority Critical patent/CN100559422C/en
Publication of CN1975804A publication Critical patent/CN1975804A/en
Application granted granted Critical
Publication of CN100559422C publication Critical patent/CN100559422C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Electrically Operated Instructional Devices (AREA)
  • Character Discrimination (AREA)

Abstract

The invention provides an educational robust that can recognize words and write words, as well as a words recognition method. The educational robust includes robust main body, which has inner embedded system, and outside devices, which includes cameras that is connected with the embedded system to record images of word materials, and the screen to show words and correct writing steps.

Description

Possess read, the educational robot and the character recognition method thereof of writing function
Technical field
The invention belongs to embedded system, pattern-recognition and field of artificial intelligence, particularly relate to a kind of detection cutting and identification disposal route of handwriting image, and a kind of intelligent evaluation method of handwriting.
Background technology
In the process of Chinese-character writing teaching, the quality assessment of Chinese-character writing is usually all by manually finishing.The user especially child after having write Chinese character, need to write timely to estimate the method for its writing Chinese characters is corrected or passed judgment on, user's learning Chinese characters is write more fast effectively, also can be allowed the user write out more standard Chinese character more attractive in appearance.Yet the role who passes judgment on is normally played the part of by the head of a family or teacher, can take the head of a family or teachers' valuable time like this.Help the user learning writing Chinese characters if can design a kind of robot, in time provide and estimate and instruct, so just can save a lot of times, allow the user simultaneously under the situation that does not have the head of a family and teacher, also can learn by oneself Chinese-character writing well for the head of a family and teacher.The present invention is just for this purpose of design, and the crowd who writes for learning Chinese characters provides a kind of Chinese-character writing educational robot that can read, write.
Summary of the invention
The objective of the invention is provides a kind of personal Chinese character of novelty to write educational robot for the crowd of learning Chinese characters, by with the interactive learning of robot, improved the interest and the efficient of user's learning Chinese characters greatly.
Another object of the present invention is to provide a kind of character recognition method of educational robot.
In order to realize goal of the invention one, the technical scheme of employing is as follows:
A kind of possess read, the educational robot of writing function, comprise robot body, described robot body inside is provided with embedded system, the outside surface of robot body be provided with the absorbed writing words material that is connected with embedded system respectively image camera head and show the literal that is comprised in the image that embedded system identified and rise and correctly write the display screen of step.
The educational robot of reading, write of the present invention is caught Chinese character that the user writes by the camera head that is connected with embedded system and it is discerned and the intelligent writing evaluation automatically on paper, guides user is the Chinese character of normalized written better, and the correct method of energy real time demonstration writing Chinese characters.
In the technique scheme, described robot body also is provided with the pronunciation that is used to play the literal that embedded system discerns, correctly writes step and to the loudspeaker of the evaluation of the literal discerned.
Embedded system of the present invention is provided with the software systems that can discern writing words automatically.The literal that this system software is comprised in can the image to camera head picked-up is discerned, and correctly writing of the literal of preserving in conjunction with its database estimate the literal of identification, and can drive loudspeaker the correct Writing method of its literal of discerning, evaluation result and this literal is play.
In order to realize goal of the invention two, the technical scheme of employing is as follows:
A kind of character recognition method of educational robot, finish as follows:
(1) catches robot image in front in real time by the camera head that is connected with embedded system, and detect whether there is the paper of having write literal in the present image in real time;
(2) when detecting the image that contains literal, with the text detection of writing in the image with cut out;
(3) adopt the method for gradient feature identification off line literal that the Chinese character image that cuts out is carried out literal identification.
The character recognition method of educational robot of the present invention also comprises a kind of automatic evaluation method of writing, the steps include: to judge the Chinese character of user writing according to the result that literal is discerned, if recognition result surpass a constant apart from mark, then evaluation result is defective, otherwise according to recognition result provide corresponding evaluation result apart from mark, more little apart from mark, evaluation result is high more, described evaluation result shows by display screen, or passes through loudspeaker plays.Comparing in literal and the stored grapholect of lane database storehouse that recognition result passes through to be discerned, and sets deviation Changshu of a comparison, surpass this Changshu, be evaluated as defective, and the like.
Described character recognition method, robot also can show the Chinese character that identifies on display screen, and go out the correct Writing method of this Chinese character in animation display according to stroke order in real time, simultaneously the Chinese character that identifies are read out by loudspeaker is bright.And can write evaluation to the Chinese character of user writing with voice, the method that guides user is correctly write.
Ultimate principle of the present invention is: the gray scale difference of Chinese character handwriting that the user writes on blank sheet of paper and blank sheet of paper background is apparent in view, by the image that captures is carried out histogram equalization, after the binary conversion treatment, person's handwriting promptly becomes black picture element, black picture element projection by level and vertical direction again, find out the rectangular extent of person's handwriting, written handwriting is cut out, the method by Chinese Character Recognition identifies person's handwriting then.If the coupling mark of recognition result is better, then think and write effectively, provide evaluation score then, otherwise think write defective.After drawing evaluation, demonstrate evaluation result by LCDs, and demonstrate correct Writing method, simultaneously result and the innovative approach of notifying the user to estimate by loudspeaker.
Advantage of the present invention and beneficial effect are: adopt the user, the more interested robot of child image particularly, in conjunction with embedded system, pattern-recognition and artificial intelligence technology, start user's learning interest, can save simultaneously the teacher and the head of a family in the time of teaching on student's writing Chinese characters, also can allow the Chinese-character writing learner under the situation that does not have teacher or parental guidance, oneself learns writing Chinese characters, estimate the method and the custom of correcting own writing Chinese characters with guidance program by writing of in time providing of robot, more standard and Chinese character attractive in appearance write out in association.
Description of drawings
Fig. 1 is a system architecture synoptic diagram of the present invention;
Fig. 2 is a systematic functional structrue block diagram of the present invention.
Embodiment
The present invention is described further below in conjunction with accompanying drawing, implement the used equipment of the present invention and can adopt ARM9 series embedded system, the Linux embedded OS is installed in this system, with touch LCD display explicit user graphical interfaces, with Webcam camera and ventional loudspeakers, adopt the C language to work out all kinds of identification handling procedures, just can implement the present invention preferably.
Structural representation of the present invention as shown in Figure 1, comprise robot body, Webcam camera 1 is set on the nose of robot, the face of robot is provided with loudspeaker 2, and the belly of robot is provided with LCDs 3, and robot interior is provided with the embedded system (not marking among the figure) that the Linux embedded OS is installed, embedded system also is equipped with and realizes related software essential to the invention, embedded system connects upward Webcam camera 1, loudspeaker 2 and LCDs 3.
Systematic functional structrue block diagram of the present invention as shown in Figure 2.Seizure program by built-in system software is caught in real time to the image that Webcam camera 1 photographed, and when the grey level histogram of the image that captures just has two peaks, thinks that then the user will be placed in face of the robot with the blank sheet of paper of Chinese character.Because the Chinese character handwriting that the user writes on blank sheet of paper and the gray scale difference of blank sheet of paper background are apparent in view, by after the image that captures being carried out binary conversion treatment, the Chinese-character writing person's handwriting promptly becomes black picture element, black picture element projection by level and vertical direction again, find out the rectangular extent of person's handwriting, written handwriting is cut out, and the method by Chinese Character Recognition identifies person's handwriting then.If the coupling mark of recognition result is better, think then and write effectively that provide evaluation score then, the coupling mark is high more, then evaluation score is then good more, otherwise think write defective.After drawing evaluation, demonstrate evaluation result by LCDs 3, and animation display goes out correct Writing method, result and the innovative approach of notifying the user to estimate by loudspeaker 2 simultaneously.When the user on LCDs 3 during writing Chinese characters, catch the person's handwriting of user writing Chinese character by the inductor of LCDs 3, the template characteristic vector that its method by dynamic time warping DTW is come out to the stroke direction eigenvector that obtains and training in advance carries out the Elastic forming board coupling, calculate matching similarity, provide evaluation score according to similarity degree, similarity degree is high more, and evaluation score is high more.

Claims (6)

1, a kind of possess read, the educational robot of writing function, comprise robot body, it is characterized in that, described robot body inside is provided with embedded system, the outside surface of robot body be provided with the absorbed writing words material that is connected with embedded system respectively image camera head and show the literal that is comprised in the image that embedded system identified and rise and correctly write the display screen of step.
2, educational robot according to claim 1 is characterized in that described robot body also is provided with the pronunciation that is used to play the literal that embedded system discerns, correctly writes step and to the loudspeaker of the evaluation of the literal discerned.
3, educational robot according to claim 1 and 2 is characterized in that described embedded system is provided with the software systems that can discern writing words automatically.
4, a kind of character recognition method of educational robot is characterized in that finishing as follows:
(1) catches robot image in front in real time by the camera head that is connected with embedded system, and detect whether there is the paper of having write literal in the present image in real time;
(2) when detecting the image that contains literal, with the text detection of writing in the image with cut out;
(3) adopt the method for gradient feature identification off line literal that the Chinese character image that cuts out is carried out literal identification.
5, character recognition method according to claim 4, it is characterized in that also comprising a kind of automatic evaluation method of writing, the steps include: to judge the Chinese character of user writing according to the result that literal is discerned, if recognition result surpass a constant apart from mark, then evaluation result is defective, otherwise provides corresponding evaluation result according to recognition result apart from mark, more little apart from mark, evaluation result is high more, and described evaluation result shows by display screen, or passes through loudspeaker plays.
6, character recognition method according to claim 4, it is characterized in that described robot also can show the Chinese character that identifies on display screen, and go out the correct Writing method of this Chinese character in animation display according to stroke order in real time, simultaneously the Chinese character that identifies is read out by loudspeaker is bright.
CNB2006101242431A 2006-12-15 2006-12-15 Possess read, the character recognition method of the educational robot of writing function Expired - Fee Related CN100559422C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006101242431A CN100559422C (en) 2006-12-15 2006-12-15 Possess read, the character recognition method of the educational robot of writing function

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006101242431A CN100559422C (en) 2006-12-15 2006-12-15 Possess read, the character recognition method of the educational robot of writing function

Publications (2)

Publication Number Publication Date
CN1975804A true CN1975804A (en) 2007-06-06
CN100559422C CN100559422C (en) 2009-11-11

Family

ID=38125846

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006101242431A Expired - Fee Related CN100559422C (en) 2006-12-15 2006-12-15 Possess read, the character recognition method of the educational robot of writing function

Country Status (1)

Country Link
CN (1) CN100559422C (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102077260A (en) * 2008-06-27 2011-05-25 悠进机器人股份公司 Interactive learning system using robot and method of operating the same in child education
CN102708727A (en) * 2012-05-18 2012-10-03 苏州佰思迈信息咨询有限公司 Chinese character teaching software
CN103605973A (en) * 2013-10-25 2014-02-26 四川长虹电器股份有限公司 Image character detection and identification method
CN108399813A (en) * 2018-05-04 2018-08-14 广东小天才科技有限公司 Study coach method and system, robot and handwriting equipment based on robot
CN108428378A (en) * 2018-05-24 2018-08-21 牡丹江师范学院 Multi-functional elementary Chinese aiding device
CN108436918A (en) * 2018-06-12 2018-08-24 芜湖乐创电子科技有限公司 A kind of real-time operation robot based on automatic writing system identification
CN108648519A (en) * 2018-05-11 2018-10-12 尤辉煌 A kind of English multimedia teaching apparatus
CN109062404A (en) * 2018-07-20 2018-12-21 东北大学 A kind of interactive system and method applied to intelligent children's early learning machine
CN109366502A (en) * 2018-12-17 2019-02-22 广东誉丰教育科技有限公司 A kind of network interactive educational method and robot based on artificial intelligence

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097783A (en) * 2016-06-24 2016-11-09 苏州美丽澄电子技术有限公司 Private tutor robot with private tutor's teaching board

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102077260B (en) * 2008-06-27 2014-04-09 悠进机器人股份公司 Interactive learning system using robot and method of operating same in child education
CN102077260A (en) * 2008-06-27 2011-05-25 悠进机器人股份公司 Interactive learning system using robot and method of operating the same in child education
CN102708727A (en) * 2012-05-18 2012-10-03 苏州佰思迈信息咨询有限公司 Chinese character teaching software
CN103605973A (en) * 2013-10-25 2014-02-26 四川长虹电器股份有限公司 Image character detection and identification method
CN103605973B (en) * 2013-10-25 2017-03-01 四川长虹电器股份有限公司 A kind of image character detection and identification method
CN108399813A (en) * 2018-05-04 2018-08-14 广东小天才科技有限公司 Study coach method and system, robot and handwriting equipment based on robot
CN108399813B (en) * 2018-05-04 2021-06-01 广东小天才科技有限公司 Robot-based learning tutoring method and system, robot and handwriting equipment
CN108648519A (en) * 2018-05-11 2018-10-12 尤辉煌 A kind of English multimedia teaching apparatus
CN108428378A (en) * 2018-05-24 2018-08-21 牡丹江师范学院 Multi-functional elementary Chinese aiding device
CN108436918A (en) * 2018-06-12 2018-08-24 芜湖乐创电子科技有限公司 A kind of real-time operation robot based on automatic writing system identification
CN109062404A (en) * 2018-07-20 2018-12-21 东北大学 A kind of interactive system and method applied to intelligent children's early learning machine
CN109062404B (en) * 2018-07-20 2020-03-24 东北大学 Interaction system and method applied to intelligent early education machine for children
CN109366502A (en) * 2018-12-17 2019-02-22 广东誉丰教育科技有限公司 A kind of network interactive educational method and robot based on artificial intelligence

Also Published As

Publication number Publication date
CN100559422C (en) 2009-11-11

Similar Documents

Publication Publication Date Title
CN100559422C (en) Possess read, the character recognition method of the educational robot of writing function
CN109192204B (en) Voice control method based on intelligent equipment camera and intelligent equipment
CN108648757B (en) Analysis method based on multi-dimensional classroom information
CN111881310B (en) Chinese character hard-stroke writing intelligent guidance and scoring method and guidance scoring system
CN109165552B (en) Gesture recognition method and system based on human body key points and memory
CN106228982B (en) A kind of interactive learning system and exchange method based on education services robot
CN200979755Y (en) An educational robot with the reading and writing function
CN110956138B (en) Auxiliary learning method based on home education equipment and home education equipment
CN109062404B (en) Interaction system and method applied to intelligent early education machine for children
CN112183238B (en) Remote education attention detection method and system
CN109590986B (en) Robot teaching method, intelligent robot and storage medium
CN110427977B (en) Detection method for classroom interaction behavior
CN109376612B (en) Method and system for assisting positioning learning based on gestures
CN110085068A (en) A kind of study coach method and device based on image recognition
CN111415537A (en) Symbol-labeling-based word listening system for primary and secondary school students
WO2020073403A1 (en) Silent voice input identification method, computing apparatus, and computer-readable medium
CN110765814A (en) Blackboard writing behavior recognition method and device and camera
CN111242045A (en) Automatic operation exercise right and wrong indication method and system
CN110555375A (en) Method for identifying filling information of answer sheet
CN111325853A (en) Remote tutoring system and method based on augmented reality glasses
CN116403218B (en) Online and offline hybrid teaching management system based on remote audio/video interaction
CN111078010B (en) Man-machine interaction method and device, terminal equipment and readable storage medium
CN110465952A (en) A method of robot Chinese-character writing and study based on Track Imitation
CN114519887A (en) Deep learning-based face turning detection method for students in primary and middle school classrooms
JP6396813B2 (en) Program, apparatus and method for estimating learning items spent on learning from learning video

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091111

Termination date: 20141215

EXPY Termination of patent right or utility model