KR102013919B1 - Method for Learning Management for Handwriting with Immediate Feedback using Multi-sensory and the Recorded Media of the Handwriting Learning Management Program read by Computer - Google Patents

Abstract

The present invention is a program for learning to write the correct writing, more specifically, in the process of writing the user directly with the touch pen or finger on the touch screen screen to perform the writing, accompanied by visual, auditory, tactile stimulation A learning management method and a program that executes the learning method to perform correct writing by providing various sensory information with specific and immediate feedback on the letters used by the touch pen or the user's finger. A recording medium readable by

Description

Method for learning management for handwriting with instant feedback using multi-sensory stimulus and a computer-readable recording medium recording handwriting learning management program therefor {Method for Learning Management for Handwriting with Immediate Feedback using Multi-sensory and the Recorded Media of the Handwriting Learning Management Program read by Computer}

The present invention is a program for learning to write the correct writing, more specifically, in the process of writing the touch pen or the user directly with the finger on the touch screen screen to perform the writing accompanied by visual, auditory, tactile stimulation A learning management method and a program that executes the learning method to perform correct writing by providing various sensory information with specific and immediate feedback on the letters used by the touch pen or the user's finger. A recording medium readable by

As the use of digital devices such as computers, smart phones, and smart pads is becoming more common, the trend of creating various documents through text input using a keyboard or a keypad is becoming more common.

As the character input environment using a keyboard or a keypad is becoming more common, the frequency and quantity of students taking notes using handwriting are also decreasing, which causes students' handwriting handwriting to be significantly worse than in the past.

Contrary to the current situation in which the spread of personal digital devices is rapidly expanding, on the other hand, interest in analog hobbies such as handwriting is also spreading. Interest in calligraphy is also on the rise.

Particularly, in the case of Hangul, due to the character characteristics consisting of initial, neutral, and final characters, not only the shape of the consonants or vowels is accurately written, but also the size and position of the consonants or vowels according to each position of the initial, neutral and final It is necessary to write the letters properly, and these characteristics are more restrictive factors in improving handwriting handwriting ability compared to the English alphabet.

Various learning materials and learning tools have been developed for writing writing training. In the early days, written writing training materials were generally printed on plain paper and the strokes of the letters were indicated by arrows or numbers, so that the user could learn by overwriting the printed letters according to the stroke order.

Then, there is an example (Korean Patent No. 10-0674308, published on January 24, 2007.) of the writing board board in order to feel a three-dimensional feeling, in this case it is concave in the center of the letter according to the stroke of the letter A guide is provided for users who dig a groove to write letters along the groove.

In addition, due to the development of information technology and multimedia technology, handwriting learning programs using an online letter writing system or a touch screen have been implemented, but they also provide only a guide on the information of the alphabetical order of letters.

In fact, correct handwriting is the act of expressing characters by expressing lines and points in the correct order and direction using writing means to form shapes and shapes in appropriate proportions and forms. Therefore, the handwriting writing learning program should compose the content so that the user can learn the elements such as the order of the letters, the ratio of the forms, the unity of the forms, and the writing direction.

As mentioned above, the existing handwriting writing learning program has the same shape as an input tool such as a finger or a touch pen on the letter shape displayed on the screen, for example, Korean Patent Registration No. 10-1502706 (August 13, 2015). It is only the practice of writing letters by overlapping or by looking at the shape of a single word, and it can be corrected and improved even if the user draws an abnormally long stroke or writes with an irregular stroke interval. Since there is no specific feedback, there is a problem in that there are limitations in improving handwriting ability, improving spelling learning ability, and correcting writing in writing.

The Hangul writing practice textbook provided by Korean Patent Registration No. 10-1612393 (Announcement on April 14, 2016) related to the improvement of Hangul writing ability is a consonant that is guided through a certain pattern of Hangul consonants that constitute the initial or finality. Write in the notation area or consonant notation, write Korean vowels that constitute the neutral at the vowel notation position guided through a certain pattern, and write patterns for consonant notation or vowel notation guidance By transforming each step, it is configured to improve the handwriting skills of the practitioners step by step so that the handwriting balances the position and size of the initial, neutral, and final. It is desirable that the character of the user (practice) who displays the target character and the pen touch input requires the font pattern. Scores (determining the position and size of each step, and whether the accuracy requirements for position and size are met above a predetermined criterion against the position and size of each phased font pattern presented and each position and size of the actually entered initial / neutral / final) Is a simple add-on that provides a simple result feedback as an add-on, and provides immediate feedback that guides the user through the process of writing to make writing more visually comfortable and readable. Because of this lack of quality, users are left with activities that end up writing in low-quality forms, and through these learning management methods or learning management programs, it is difficult for learners to have the opportunity to write more advanced forms of writing. To maintain the effectiveness of the calibration Awesome there is a problem.

Republic of Korea Patent No. 10-0674308 (January 24, 2007.) Republic of Korea Patent No. 10-1502706 (announced on March 13, 2015) Republic of Korea Patent No. 10-1612393 (announced on April 14, 2016)

The present invention has been proposed to solve the problems of the prior art, when the user (learner) recognizes the type of the text input through the input means such as a touch screen or touch pad, all elements constituting the form of the text It recognizes the accuracy of each element such as stroke start point, continuity, length, direction, angle, end point, etc., and provides instant feedback for each element to the user who is writing. In addition, the handwriting writing learning management that recognizes the interval, ratio, and connection point between strokes in the final result of the user's written letters, measures the accuracy of each element, and then provides the final feedback to the user. Methods, and such handwriting learning management methods can be performed on a computer or mobile device. To provide a program to ensure that there is a main object of the invention.

On the other hand, the visual, auditory and tactile sensation as or with specific feedback on the letters used by the touch pen or the user's finger together with the feedback of each element that is immediately provided to the user who is writing. It is a particularly specific and characteristic object of the present invention to provide a variety of sensory information such as stimuli (eg, tactile sensations such as sand, gravel, chocolate, pudding tactile sensations, etc.).

In addition, by not only writing the words but also by providing the sound of the words and words containing the words with the picture, this allows the user to not only learn to write handwriting, but also connect the words and the sounds of the words and write them correctly. Its purpose is to provide a learning management method that allows spelling learning to be done in parallel.

It is also an object of the present invention to provide a computer program that enables such a handwriting writing management method to be performed on a computer or a mobile device.

Handwriting writing learning management method according to an embodiment of the present invention for achieving the above object,

When the handwriting writing learning management dedicated program installed in a user terminal including a computer or a mobile device is executed, the terminal control unit and the program execution unit may be executed.

A learning management program execution initialization step of initiating execution of the handwriting writing learning management program;

A learning target selection step of providing a learning target selection screen for selecting a plurality of learning target groups (eg, drawing, writing a word, and writing a word) including a writing to a display unit of a user terminal;

When one learning goal (eg, drawing, writing, or writing words) is selected on the learning goal selection screen on the user terminal, a writing question which should be provided to achieve the selected learning goal is generated or selected by the question generator. A writing problem outputting step of outputting through the display unit of the user terminal; And

A writing answer input step of inputting a writing answer by a touch pen or a user's finger touch on the user terminal; And

As the step performed during the progress of the writing answer input step,

Recognition step of the writing answer to recognize the writing of the writing answer inputted while the writing answer is input by recognizing the starting point, the continuity of the line, the end of the stroke through the text recognition unit;

An instantaneous evaluation of the accuracy of the recognized text to instantly evaluate the accuracy for each of the accuracy evaluation elements with respect to the text recognized in the text recognition step through an immediate evaluation unit; And

Immediate feedback according to the result of the instant evaluation in the accuracy of the recognition text accuracy is calculated through the sensory stimulus output unit while the user inputs the text by the touch pen or the user's finger touch, and various tactile sensations calculated through the sensory stimulus output unit Is provided as a handwriting writing learning management method characterized in that the step of providing an immediate feedback using a tactile sense of providing a touch pen or a user's finger that is being touched by the user terminal.

Furthermore, according to the present invention, multi-sensory information including visual stimuli and auditory stimuli is simultaneously provided to the user who is proceeding with writing, with specific and immediate tactile feedback on letters written by the touch pen or the user's finger. Sensory stimulation).

Here, it is preferable to further include a step of receiving the user's unique information in the learning management program execution initialization step, because it can continue to practice according to the learner's learning progress. In addition, the user ID may be input from which user unique information registered in advance may be checked.

In addition, as the learning target group selected in the learning target selection step, line drawing, letter writing including types of letters and fonts, word writing, and the like may be selected. Particularly, in the case of line drawing and single writing, the letters of the initial stage may be selected. It can be used effectively for learning or writing corrections (word correction), and can help with spelling in the case of word writing.

In addition, in the writing problem outputting step, the type of problem may be selected or determined first, and the selection type may include, for example, 'overlap writing', 'reporting writing', 'listening and writing', 'writing with only a starting point'. Types of problems are possible. Here, in the stage in which the writing problem is output through the user terminal, the problem types such as 'overlap write', 'report follow write', and 'write only when the starting point is provided' may be solved through the (touch) screen of the user terminal. In the case of the 'listening and writing' type used in spelling learning, the problem may be output through the speaker of the user terminal.

Here, the start point of the stroke of the text input from the user terminal, the continuity of the stroke (length), the direction, Evaluation elements such as angles, end points, etc. may be immediately included as accuracy evaluation elements, and various other evaluation elements may be optionally used.

On the other hand, according to an additional embodiment of the present invention, after the user runs out of the letter through the final evaluation unit may further comprise a comprehensive evaluation step of the result to provide a result feedback by evaluating the overall accuracy of the result, In this case, in order to comprehensively evaluate the accuracy of the recognized text in the writing result of the user, the evaluation factors such as the stroke, the distance between the strokes, the ratio, and the connection point may be included as the comprehensive accuracy evaluation factor. Furthermore, by analyzing the evaluation data derived from the result of the comprehensive evaluation step to provide an embodiment including a comprehensive data analysis step for determining and presenting the frequency and learning achievement for each error type shown in the learning process to provide the next learning goal of the user It is more desirable to be able to utilize it in setting.

The handwriting writing and spelling learning management method with instant feedback utilizing the multi-sensory stimulus according to the present invention as described above, and the learning management program therefor have the following effects.

Through the present invention, the user (learner) can accurately identify what factors are lacking at the level of his handwriting through immediate sensory feedback, and further enable the user (learner) to perform immediate improvement on these shortcomings. It provides a visually comfortable, readable, balanced effect.

In addition, through the present invention, the user (learner) receives visual, auditory, and tactile feedback to improve his or her handwriting writing habit from the moment of drawing a stroke to writing the piece to the moment of completing both the letter and the word. As a result, efficient and specific writing practice is possible in a short period of time, and feedback through various sensory stimuli (e.g. sand, gravel, chocolate, pudding, etc.) that are distinguished from each other is effective, not tedious learning. This makes it possible to learn writing skills that are very effective for ADHD and early childhood and early school age children.

Thanks to the characteristics of the present invention, children who are in the basic character acquisition period or learners who learn letters in other countries can develop writing ability and spelling ability by effectively practicing writing without a teacher or a leader.

Paradoxically, the interest of handwriting, such as calligraphy, is increasing so that the interest rate of fountain pen is rising as the general society's interest in analog culture increases in the flow of the digital age. The present invention, which provides sophisticated feedback on, can be utilized as a means of hobby, leisure, and learning for pretty and correct writing for general students or adult users.

를 직접 손으로 쓰려고 하면 어떻게 써야하는지를 모르는 반문맹이 발생하고 있다. 디지털 환경에서 벗어날 수 없는 현대 상황에서 일본 역시 대량의 한자뿐만 아니라 히라가나, 가타카나 등 형태와 획순이 복잡한 여러 문자를 사용하고 있어 글씨 쓰기를 통한 문자 학습이 필요하게 되는데, 본 발명의 경우에 다양한 컴퓨터 웹 프로그램, 모바일 어플 프로그램 등을 통하여 다양한 문자에 대하여 실용화하여 해외 국가들의 문자 쓰기 학습 도구에 대한 요구를 충족시킬 수도 있다.On the other hand, with the spread of writing using computers or digital devices, keyboards have become a substitute for writing. In this era, the use of characters in the digital environment relying on the Pinyin input function has spread in China.

If you try to write by hand, anti-literacy is happening that you do not know how to write. In the modern situation that cannot escape from the digital environment, Japan uses not only a large number of Chinese characters but also various letters such as hiragana and katakana, which are complicated in form and stroke order, and thus, it is necessary to learn letters through writing. Through the program, the mobile application program, etc., various types of texts can be put into practical use to satisfy the demand for writing tools of foreign countries.

1A and 1B are configuration diagrams of a user terminal (computer or mobile device) on which a program for executing a handwriting writing learning management method according to an embodiment of the present invention is executed.
FIG. 2 is a diagram illustrating a network including a user terminal (computer or mobile device) of FIG. 1.
Figure 3a is a flow diagram showing a handwriting writing learning management method according to an embodiment of the present invention.
FIG. 3B is a flowchart illustrating an embodiment in which a result comprehensive evaluation step S150 and a training data comprehensive analysis step S160 are added to the flowchart of FIG. 3A.
3C is a flowchart showing an embodiment in which the sensory environment selection step S115 is added to the flowchart of FIG. 3A.
FIG. 3D is a flowchart illustrating an embodiment of automatically selecting and outputting a sensory environment base corresponding to an image of a problem in a writing problem output step S130 without a sensory environment selection step in the flowchart of FIG. 3C.
4 is a diagram illustrating a state in which a sensory environment selection step S115 shown in the flowchart of FIG. 3C is displayed on a user terminal.
5 and 6A to 6C illustrate a writing answer input step S140 constituting a preferred embodiment of the present invention, in which various senses calculated through the sensory stimulus output unit 138 while a writing answer is input to the user terminal. A diagram illustrating a state provided to a user through.
7A to 7C are views illustrating a configuration of a touch pad for providing various tactile sensations calculated through the sensory stimulus output unit to a user's finger being touched by the user terminal according to a preferred embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

1A and 1B, a user terminal 100 according to an exemplary embodiment of the present invention is a program in which a learning management program for performing an input unit 110, a terminal control unit 120, and a handwriting writing learning management method is executed. The execution unit 130, the display unit 140, and the storage unit 150 are included. In this case, in another embodiment of the present invention shown in FIG. 2, the user terminal 100 may further include a communication unit 160 for accessing the external server 300 and the database 400 through the Internet network. .

In this way, the program execution unit 130 of the handwriting writing learning management program executed in the user terminal 100 has a program module type of the user connection unit 131, the sensory environment selection unit 132, the learning target selection unit 133, and a problem. The questionnaire 134, the sensory environment display unit 135, the letter recognition unit 136, the immediate evaluation unit 137, the sensory stimulus output unit 138, and the final evaluation unit 139 may be provided.

According to an embodiment of the present invention, a method of managing handwriting writing with immediate feedback utilizing multi-sensory stimuli is shown in FIGS. 1A and 1B and a flowchart of the method is shown. As illustrated in

When the handwriting writing learning management dedicated program installed in the user terminal 100 including a computer or a mobile device is executed, the terminal controller 120 and the program execution unit 130 are executed.

Learning management program execution initialization step (S110) of initiating execution of the handwriting writing learning management program;

A learning target selection step (S120) of providing a learning target selection screen for selecting a plurality of learning target groups including a single writing (eg, drawing, writing a word, and writing a word) to the display unit 140 of the user terminal;

When a learning goal (eg, drawing, writing, or writing words) is selected on the learning goal selection screen on the user terminal, the question creation unit 134 generates a writing problem to be provided to achieve the selected learning goal. Or a writing problem outputting step (S130) of selecting and outputting through the display unit 140 of the user terminal; And

A writing answer input step (S140) in which a writing answer is input to the user terminal by a touch pen or a finger touch of the user; And

As the step performed during the progress of the writing answer input step (S140),

A writing recognition step of the writing answer that recognizes the writing of the writing answer inputted while the writing answer is input through the writing recognition unit 136 and recognizes the end point, the persistence of the line, and the end of the stroke (S141);

An instantaneous accuracy evaluation step (S142) of the recognition text for instantly evaluating the accuracy for each of the accuracy evaluation elements for the letters recognized in the letter recognition step (S141) through the immediate evaluation unit (137); And

Immediate feedback according to the result of the immediate evaluation in the accuracy of the recognition text (S142) is calculated through the sensory stimulus output unit 138 while the user is inputting the text by the touch pen or the finger touch, and the sensory stimulus As a handwriting writing learning management method characterized in that an immediate feedback providing step (S143) using a tactile sense of providing various touch sensations calculated through the output unit 138 to a user's touch pen or a user's finger is performed. Is provided.

Furthermore, according to a preferred embodiment of the present invention, multi-sensory information including visual stimuli and auditory stimuli, together with specific and immediate tactile feedback of a letter written by a touch pen or a user's finger, is given to the user who is writing. At the same time (multisensory stimuli: for example, visually embodying the spreading of sand that appears in the passage of a finger on the sand while writing on a beach, and audible sounds such as 'cracking' sand friction and waves) It is more preferable to implement.

Here, the learning management program execution initialization step (S110), it is preferable to further include the step of receiving the unique information of the user, in which the user ID to check the user unique information registered in advance may be received. .

In addition, as the learning target group selected in the learning target selection step (S120), a line drawing, a writing including a type of a letter and a typeface, a word writing, and the like may be selected. It can be used effectively for learning letter-level or writing-type correction (step-correction) of step, and can help with spelling in the case of word writing.

In addition, in the writing problem output step (S130), the type of problem may be selected or determined first. As the selection type, for example, 'overlap writing', 'reporting writing', 'listening and writing', and 'starting point' are provided. Type of problem is possible. Here, the type of problem such as 'write on overlap', 'write on report', 'write only in the starting point provided', etc. in the step in which the writing problem is output through the user terminal is selected from the display unit 140 of the user terminal 100. For example, a problem may be output through the image output unit 142 which may be provided in the form of a (touch) screen, and in the case of the 'listening and writing' type used in spelling learning, the display unit 140 of the user terminal 100. ), For example, a problem may be output through the voice output unit 141, which may be provided in the form of a speaker.

Here, the start point of the stroke of the text input from the user terminal, the continuity of the stroke (length) while the user writes the text in order to evaluate the instantaneous accuracy of the recognized text in the step of evaluating the accuracy of the recognition text (S142) Evaluation elements such as direction, angle, end point, etc. may be immediately included as accuracy evaluation elements, and various other evaluation elements may be optionally used.

In addition, the various tactile sensations calculated through the sensory stimulus output unit 138 in the immediate feedback providing step S143 are provided to the touch pen or the user's finger through the tactile output unit 143 of the user terminal 100. As shown in FIG. 1A, the tactile output unit 143 may be configured to be included in the touch screen TS when the screen has a touch input function. In contrast, the tactile output unit 143 is illustrated in FIG. 1B. As described above, it may be configured to be additionally included in the touch pad TP constituting the input unit 110, and an exemplary configuration and operation of the sensory stimulus output unit 138 and the tactile output unit 143 will be described later. Let's do it.

Meanwhile, according to a further embodiment of the present invention as illustrated in FIG. 3A, after the user runs out of letters, the final evaluation unit 139 evaluates the overall accuracy of the result and provides a result feedback. Comprehensive evaluation step (S150) may be additionally included, in this case, the evaluation of strokes, strokes, connection points, etc. between strokes and strokes to comprehensively evaluate the accuracy of the recognized letters in the user's writing results Element may be included as a comprehensive accuracy assessment element.

Furthermore, as shown in FIG. 3A, the analysis of the evaluation data derived in the result evaluation step S150 further analyzes the learning data synthesis analysis step S160 which determines and presents the frequency and learning achievement for each error type shown in the learning process. It is more desirable to provide an embodiment that includes to be used to set the next learning goal of the user. In particular, in order to perform such a learning data comprehensive analysis step (S160), it is configured to be connected to the external server 300 and the database 400 through the communication unit 160 and the Internet network 200 in order to analyze the necessary evaluation data. (See FIG. 2).

On the other hand, the writing problem output step (S130) constituting the present invention, the accuracy of the recognition text recognition step (S142), the instant feedback providing step using the tactile (S143), etc. learning according to the user's writing development level It is necessary to save the form and sound by classifying the letters according to the number of strokes written in the words so that the writing can be done by selecting the contents.Then, the words consisting of basic consonants and vowels are sequentially selected according to the development of each language. It is necessary to classify and store shapes and sounds, and also to store and utilize picture images or sounds / music (visual and audio data of content required for problem questions) including words, and to evaluate accuracy of recognition text. It is necessary to store the evaluation elements for The content of sensory feedback output that is output when judged and the sensory feedback output that should be output when judged to be an error condition (tactile output such as vibration, roughness texture, temperature, visual output such as blue or red lamps, "Ding dong dang" or As shown in FIGS. 1A and 1B, the storage unit 150 constituting the user terminal 100 may be used as a means for storing the "audible output" such as a "beep" sound. In addition, the evaluation necessary in the comprehensive analysis of learning data (S160) to determine and present the frequency and learning achievement for each error type shown in the external storage and update or learning process of some data stored in the storage unit 150 as described above. The external server 300 and the database 400 shown in FIG. 2 may be utilized through the communication unit 160 and the internet network 200 for storing and analyzing data.

As another embodiment of the present invention, when installed and executed in a user terminal including a computer or a mobile device, handwriting writing installed in the user terminal 100 including a computer or a mobile device is performed through a terminal control unit and a program execution unit of the user terminal. Learning management program execution initialization step (S110) for initializing the execution of the handwriting writing learning management program through the terminal control unit 120 and the program execution unit 130 when the learning management dedicated program is executed; A learning target selection step (S120) of providing a learning target selection screen for selecting a plurality of learning target groups including a single writing (eg, drawing, writing a word, and writing a word) to the display unit 140 of the user terminal; When a learning goal (eg, drawing, writing, or writing words) is selected on the learning goal selection screen on the user terminal, the question creation unit 134 generates a writing problem to be provided to achieve the selected learning goal. Or a writing problem outputting step (S130) of selecting and outputting through the display unit 140 of the user terminal; And a writing answer input step S140 in which a writing answer is input to the user terminal by a touch pen or a user's finger touch. In addition, as a step performed during the progress of the writing answer input step (S140), the text of the writing answer inputted while the writing answer is input is recognized through the letter recognition unit 136 by recognizing the starting point, the continuity of the line, and the end of the stroke. Writing recognition step of the answer to write (S141); An instantaneous accuracy evaluation step (S142) of the recognition text for instantly evaluating the accuracy for each of the accuracy evaluation elements for the letters recognized in the letter recognition step (S141) through the immediate evaluation unit (137); And calculating, through the sensory stimulus output unit 138, the user while inputting letters by a touch pen or a finger touch, as soon as the user inputs letters by a touch pen or a finger touch. The handwriting writing learning management program programmed to perform an immediate feedback providing step (S143) using a tactile sense of providing various touch sensations calculated through the stimulus output unit 138 to a user's finger or a touch pen touched on the user terminal is recorded. It provides a computer-readable recording medium. Even in this embodiment, after the user runs out of letters, the final evaluation unit 139 may further include a result comprehensive evaluation step (S150) for providing a result feedback by evaluating the overall accuracy of the result.

In the above-described embodiments (an embodiment of the handwriting writing learning management method and a computer-readable recording medium in which the handwriting writing management program is recorded), the user has a question in the writing problem output step of step S130. A process of selecting and outputting a sensory environment base for setting a basic touch (texture or temperature of a material) for an area in which handwriting is input by a touch pen or a finger touch as a corresponding answer ('130a' in FIG. 3C and FIG. 3D). '130b') is preferably performed together, the sensory environment selection step of inducing the user's selection as shown in the screen configuration of the user terminal 100 illustrated in FIG. S115 is additionally included in advance of the writing problem output step S130 (FIG. 3C and FIG. 3D, before the 'learning target selection step S120'). It is illustrated as being, but may be executed after the 'learning goal selection step (S120)'), and in the writing problem output step (S130), the basic touch of the area for inputting handwriting to the selected sensory environment base (texture or temperature of the material) Not only can be configured as an embodiment to output through the tactile output unit 143 (S130a), as shown in the flow chart of Figure 3d writing problem output step without a separate sensory environment selection step (S130) An embodiment of automatically selecting and outputting a sensory environment base corresponding to an image of a question (eg, “texture and low temperature touch” sensory environment base in the case of a word winter problem) in response to an image in question (S130b) It can be configured as. Here, the sensory environment base, which is selected by the user or automatically determined to correspond to the image in question and is output, is not limited to the basic touch of the area for inputting handwriting, but an image image corresponding to the problem (see FIGS. 6A to 6C). Alternatively, background music may be provided.

As described above, when outputting the sensory environment base as the basic touch (texture or temperature of the material) of the area in which the handwriting is input in the writing problem output step (S130), it provides immediate feedback using the tactile sense during the writing response input step (S140). Step S143 proceeds (S143a) using the tactile sense corresponding to the selected sensory environment base (see FIGS. 3C and 3D).

As illustrated in FIG. 5, the basic touch (texture or temperature of the material) of the area for inputting handwriting is input from the user terminal while the user writes, for example, when the touch of "sand" is output to the sensory environment base. Instant accuracy is assessed using factors such as the start point of the stroke, continuity of the stroke (length), direction, angle, end point, etc., and if it is evaluated as normal, the set normal touch (soft, warm sand) Tactile touch) is output as immediate feedback, but if it reaches an area that is evaluated as an error state during the writing process (blue oval section in FIG. 5; error state that occurs because the second stroke is relatively large compared to the length of the first stroke). ), The set error sensation (the touch distinct from the normal sensation; for example, the feel of coarse sand) is immediate. As a feedback, the touch is output by the sensory stimulus output unit 138 while the user is inputting letters by a touch pen or a finger touch, and then touched through the tactile output unit 143 corresponding to the display unit 140 of the user terminal 100. Is delivered to the pen or user's finger. However, in the case of using the touch pen, the temperature sensation is not transmitted directly to the user. If necessary, the touch pen may be visually expressed by attaching an indicator having a color sensor according to the temperature sensor and temperature. .

Of course, in addition to the tactile sense, the visual feedback performed by changing the color or brightness of the input area shown in writing or pattern drawing of a general touch screen may be basically provided, and separately, the normal state judged while the user is inputting the text. Alternatively, visual feedback can be provided to selectively display different colored lights (blue 'B' lights or red 'R' lights), depending on whether there is an error condition, as well as "Ding dong" or "Ding". Acoustic feedback may also be provided, and thus the present invention enables the provision of various multisensory feedback.

While the steps described above are performed through the handwriting writing learning management method and management program, problems ('Q') and answers ('A') appearing in the user terminal 100 on which the program is executed, and immediate feedback are provided accordingly. Specific examples of the statuses are shown in FIGS. 6A to 6C. 6A and 6B illustrate a state in which immediate feedback using tactile sense is provided through the touch screen TS of the user terminal 100 (see configuration diagram of the embodiment of FIG. 1A), and illustrated in FIG. 6C. In the illustrated example, instant feedback using the tactile sense is provided through the touch pad TP of the user terminal 100 (refer to the configuration of the embodiment of FIG. 1B).

Hereinafter, a configuration of a specific application example for allowing immediate feedback using tactile sense to be transmitted to the touch pen or the user's finger through the display unit 140 of the user terminal 100 will be described.

First, the tactile output unit 143 of the display unit 140 of the user terminal 100 of FIG. 1B shows a state in which immediate feedback using the tactile sense shown in FIG. 6C is provided through the touch screen TS of the user terminal 100. The specific application example illustrated in FIG. 7A may be used to implement the through the touch pad TP.

The function of a general touch pad (TP) is a component that is responsible for the function of the input unit 110 in the user terminal, which is utilized in a laptop (Laptop Computer), etc., but the present invention is performed in a laptop having a screen that does not include a touch function. In this case, such a touch pad may be used as a tool (input means) for the user to follow a word displayed on the screen and questioned as a problem. Furthermore, immediate feedback using a tactile sense may also be output through the touch pad.

In the case of a touch pad including such a tactile output function, a linear actuator that performs linear movement under the touch surface of the touch pad and a Peltier element for temperature expression are developed by a recently developed taptic system technology (an advanced version of haptic technology). Devices have been developed to allow haptic feedback to be implemented.

In the case of the "Touch Surface for Simulating Materials" invention, for example, published in US 20150109215 A1 (published on April 23, 2015) by Apple Inc., a method of simulating a material using a system and contact surface is disclosed. The touch device TP-2 includes one or more contact surfaces TP-3, one or more actuators TP-6, or one or more temperature control devices TP-4, and one, as shown in FIG. 7A. The control unit TP-9 includes the above-described control unit TP-9, and the control unit TP-9 generates an tactile feel of the texture of the material with respect to at least a part of the touch surface TP-2. Alternatively, the temperature control device TP-4 can be controlled.

The hardware configuration of the actuator TP-6 and the temperature regulating device TP-4 described below is a configuration corresponding to the tactile output unit 143 described in the preferred embodiment of the present invention, and the control unit TP-. Control through 9 may be understood as a configuration corresponding to the sensory stimulus output 138 described in the preferred embodiment of the present invention.

FIG. 7A shows a cross-sectional view of an exemplary system, wherein as shown, the touch device TP is part of a touch device system, including one or more temperature control devices TP-4 (eg, one or more Peltier elements), Temperature sensors TP-5, actuators TP-6 (one or more electric actuators), and touch sensors TP-7 (one or more position sensors, force sensors, capacitive sensors, and / or touches) Sensors capable of detecting one or more characteristics of the device), drive circuit TP-8, control unit TP-9 (one or more processing units), touch sensing circuit TP-10, and / or substrate TP-. 11) (eg, one or more printed circuit boards). The touch device TP illustrated in the diagram of FIG. 7A represents a touch pad. However, this is only one example and in various embodiments the touch device may be any touch surface without departing from the scope of the present invention, which may be a track pad, touch screen, button member, and / or any other. Kind of touch surface. In addition, the touch surface TP-2 may include a chemical vapor deposited diamond material layer TP-3. Such a diamond material layer can provide excellent wear resistance, very high thermal conductivity, good mechanical strength, and broadband light transparency.

Control used in the present invention includes the step of using the actuator TP-6 to move vertically and / or horizontally to vibrate at least a portion of the touch surface TP-2, the vibration being a tactile feel of the texture. Enable simulation For example, a rough surface allows the texture to be simulated by producing a stronger vibration than that in the smooth simulation of the surface.

In this case, one or more characteristics of the touch input via one or more touch sensors TP-7, such as position sensors, force sensors, capacitive sensors, and / or other sensors (problems addressed in the case of the present invention). Touch along the letters) and can be configured to generate vibrations that simulate, for example, sand particles or particles on the wood surface as a response (feedback).

Another control used in the present invention includes the use of a thermostat TP-4 that controls the temperature of at least a portion of the contact surface TP-2, which thermostat TP-4 At least one Peltier device may be included, and the tactile sensation of the thermal conductivity of the temperature control material may be simulated. For example, the glass surface can be controlled to have a temperature of relatively cold metal material and / or relatively warm wood material. In some cases, temperature control may be performed using data from one or more temperature sensors TP-5 that sense the temperature of the touch surface. In this case, the thermostat TP-4 may be adjusted based on the data to adjust the temperature of the touch surface TP-2.

As shown in the block diagram of FIG. 7B, the drive circuit TP-8 may be communicatively coupled to the actuator 106 and / or the temperature regulating device 104. The sensing circuit TP-10 may be coupled to the touch sensor TP-7 and / or the temperature sensor TP-5. The control unit TP-9 is connected to the driving circuit TP-8 and / or the sensing circuit TP-10 to receive data from the touch sensor TP-7 and / or the temperature sensor TP-5. Can be communicatively coupled. The control unit TP-9, the driving circuit TP-8, and the sensing circuit TP-10 may be mounted on the substrate TP-11 as shown in FIG. 7A.

The control unit TP-9 can control the actuator TP-6 and / or the thermostat TP-4 to simulate one or more materials.

The control unit TP-9 may provide control such that the vibration caused by the actuator TP-6 changes over time, which in some cases is detected by the touch sensor TP-7. Can be changed based on one or more contacts (touches) made. For example, vibration provided by the actuator TP-6 for simulating particles of sand material in response to a touch sensor TP-7 that detects movement through a touch pen or the finger of a user (learner). Control it to increase.

On the other hand, the thermostat TP-4 may be operable to control the temperature of the touch surface TP-2 of the touch device (eg, increase decrease and / or maintain temperature, etc.). Such control may be achieved by heating, cooling, sinking and dissipating heat, or by spreading heat, activating a fan, or other cooling mechanism. Such temperature control can simulate the touch of the thermal conductivity of the material. The temperature control device TP-4 may control the temperature of the touch surface TP-2 of the entire or part of the touch surface TP-2 of the touch device.

However, in some cases, the use of the actuator TP-6 may generate undesirable heat, for example, the temperature of the touch surface TP-2 is increased by an actuator that generates heat during operation. . For example, it may cause a problem that the temperature of the touch surface is increased warmer than the temperature of the cement surface in order to generate enough vibration to simulate the feel of the cement. In order to improve the additional heating caused by this vibration, the touch surface is cooled (or heated) by one or more temperature cooling devices in some cases to prevent the simulation of the texture from causing the contact surface to have different temperature characteristics than usual. Buried or heat dissipated or diffused).

In addition, in order to perform the texture simulation and the temperature simulation by the other vibration at the boundary (the boundary between the normal state and the error state) as in the present invention, temperature control considering the temperature increase due to the increase of vibration should be considered. For example, when the touch pen or the user's finger is set to provide a soft and warm touch to the user's finger in the normal state area and then to provide a rough and cold touch in the error state, the touch pen or the user's finger moves from the normal state area to the error state area. This increases the vibrations of the actuators underneath the area to provide a rougher texture of the surface. Additional cooling is provided to provide a cooler temperature sensation, given the natural temperature increase caused by the heat generated by the effects of this increase in vibrations. Setting should be taken into account.

In order to implement an embodiment according to the present invention, the touch surface may include a plurality of regions, each of which is controlled by simulation of one or more materials. For example, as shown in the bottom view of FIG. 7C, the touch device may include one or more control lines. It includes a plurality of regions Rg connected to the CL. The control line CL may be connected to the thermostat TP-4, and may operate to control the temperature of the region Rg according to the instruction of the thermostat TP-4. In other cases, each of the regions Rg includes an actuator TP-6 and the control line CL controls the actuator TP-6 to control each actuator TP-6 for a particular region. Is connected to the drive circuit TP-8.

In another example, region Rg may each include one or more thermostats TP-4, temperature sensors TP-5, actuators TP-6 and / or touch sensors TP-7. Thereby, the control line CL is connected to one or more driving circuits TP-8 and / or sensing circuits TP-11, so that the control unit TP-9 independently vibrates in each region Rg. And / or temperature control.

Although the present invention described above has been described in detail through the preferred embodiments, the present invention is not limited to the content of these embodiments. Those skilled in the art to which the present invention pertains may partially modify or improve the various present invention within the scope of the appended claims, although not shown in the examples, all of which are technical scope of the present invention. Belonging to would be too self explanatory. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

100: user terminal
110: input unit
120: terminal control unit
130: program execution unit
140: display unit
150: storage unit
131: user connection
132: sensory environment selection unit
133: learning target selection unit
134: question questions
135: sensory environment display unit
136: text recognition unit
137: Immediate Evaluation
138: sensory stimulation output unit
139: final evaluation

Claims (19)

delete When the handwriting writing learning management dedicated program installed in the user terminal 100 including a computer or a mobile device is executed, the terminal controller 120 and the program execution unit 130 are executed.
Learning management program execution initialization step (S110) of initiating execution of the handwriting writing learning management program;
A learning target selection step (S120) of providing a learning target selection screen for selecting a plurality of learning target groups including writing to the display unit 140 of the user terminal;
When one learning goal is selected in the learning goal selection screen in the user terminal, a writing problem which is to be provided to achieve the selected learning goal is generated or selected by the question question unit 134 and output through the display unit 140 of the user terminal. Writing problem output step (S130); And
A writing answer input step (S140) in which a writing answer is input to the user terminal by a touch pen or a finger touch of the user; And
As the step performed during the progress of the writing answer input step (S140),
A writing recognition step of the writing answer that recognizes the writing of the writing answer inputted while the writing answer is input through the writing recognition unit 136 and recognizes the end point, the persistence of the line, and the end of the stroke (S141);
An instantaneous accuracy evaluation step (S142) of the recognition text for instantly evaluating the accuracy for each of the accuracy evaluation elements for the letters recognized in the letter recognition step (S141) through the immediate evaluation unit (137); And
The sensory stimulus output while the user is inputting letters by touch pen or finger touch based on the sensory environment base according to the user's selection according to the result of the instant evaluation in the accuracy evaluation step (S142) of the recognition text. The instant feedback providing step (S143) using the tactile senses calculated through the unit 138 and provided to the touch pen or the user's finger which are various touches calculated through the sensory stimulus output unit 138 is performed. And
In the instant feedback providing step (S143), the user is proceeding with writing on the display unit 140 of the user terminal, which is calculated through the sensory stimulus output unit 138 for letters written by a touch pen or a user's finger used for writing. While specific and immediate tactile feedback is directly provided through the tactile output unit 143, specific and immediate visual feedback is directly provided through the image output unit 142 of the display unit 140 of the user terminal. Audio feedback is provided through the voice output unit 141, and
The sensory stimulus output unit 138 calculates tactile feedback of at least one of roughness texture and temperature,
The tactile output unit 143 is configured to be included together with the image output unit 142 in the display unit 140 including a touch screen TS having a touch input function.
Immediately assessing the accuracy of the recognized text (S142) In order to evaluate the immediate accuracy of the recognized text in the user's writing while the writing point of the stroke input from the user terminal, the continuity of the stroke, length, direction, angle And an evaluation element of an end point as an immediate accuracy evaluation element. The method of claim 2,
Handwriting writing learning management method with immediate feedback, characterized in that further comprising the step of receiving the user's unique information in the learning management program execution initialization step (S110). The method of claim 2,
The learning target group selected in the learning target selection step (S120) is a handwriting writing learning management method with instant feedback, characterized in that the line writing, writing, including the type of letters and fonts, word writing is selected. The method of claim 2,
In the writing problem output step (S130), the type of problem may be selected or determined first, and as the selection type, 'write on overlap', 'write on report', 'listen on write', 'write in a state where only a starting point is provided' Problem type of handwriting writing learning management method with instant feedback, characterized in that provided. delete The method of claim 2,
A process of selecting and outputting a sensory environment base for setting a basic touch on an area where a handwriting is input by a touch pen or a finger touch as an answer corresponding to a question that a user answered in the writing problem output step (S130) Handwriting writing learning management method with immediate feedback, characterized in that to be performed. The method of claim 7, wherein
In addition to the sensory environment selection step (S115) prior to the writing problem output step (S130) for inducing a user's selection for the selection of the sensory environment base, and in the writing problem output step (S130) selected The handwriting writing learning management method with immediate feedback, characterized in that the output through the tactile output unit 143 (S130a) as a basic tactile sense of the area for inputting the handwriting. The method of claim 7, wherein
And selecting and outputting the sensory environment base so as to automatically select and output the sensory environment base corresponding to the image of the question presented in the writing problem output step (S130) (S130b). How to manage learning handwriting writing. delete delete The method of claim 2,
After the user has finished writing, the final evaluation unit 139 further evaluates the overall accuracy of the result, and further includes a result comprehensive evaluation step (S150) for providing a result feedback. How to manage learning handwriting writing. The method of claim 12,
Immediate feedback, characterized in that it further comprises a learning data comprehensive analysis step (S160) for analyzing the evaluation data derived in the result of the comprehensive evaluation step (S150) to determine the frequency and learning achievement for each error type presented in the learning process. Handwriting writing learning management method provided. delete delete delete delete delete delete

Images