KR102101496B1 - Ar-based writing practice method and program - Google Patents

Abstract

The present invention relates to an AR-based writing practice method capable of practicing writing through the terminal. AR-based writing practice method according to an embodiment of the present invention, the server recognizes one or more words in the image or image input through the terminal; A step in which a server selects a word in which the font of the word falls within a reference range among the recognized words, and selects at least one of an image, video, or AR image corresponding to the selected word; And a server augmenting at least one of the selected image, video, or AR image to the input image or image to display it on the terminal, and displaying it on one side of the word.

Description

AR-based writing practice method and program {AR-BASED WRITING PRACTICE METHOD AND PROGRAM}

The present invention relates to a writing and writing practice method and program, and more particularly, to an AR-based writing and writing practice method and program capable of practicing writing and writing through an application.

In general, as children learn language, they begin to speak and learn to write while writing.

At this time, most parents experience difficulties in educating children because they think writing is boring and difficult.

As such, it is necessary to make children feel interested in practicing writing, but even today, as smart devices are popularized, a method of practicing writing using smart devices has not been suggested.

In addition, as devices such as computers, notebooks, and smartphones become popular, the frequency of people writing decreases, which causes great difficulties when people have to write.

There is a method of buying and practicing a hagwon or a book in the past, but in the case of a hagwon, there is a problem that a certain time limit and travel time are consumed, and a desired curriculum or textbook must be followed. There is a problem that only the writing is required and the contents in the book must be purchased in a lump, and the writing space suggested in the book is limited and the storage is inconvenient.

In addition, there is a disadvantage that if you practice writing through the practice book, you will not receive feedback.

Therefore, there is a need for a method for practicing writing through a smart device that has become popular with most people in recent years.

The technology that is the background of the present invention is disclosed in Korean Utility Model Publication 2000-0020756, etc., but a fundamental solution to the above-mentioned problem has not been proposed.

The present invention for solving the problems as described above is AR-based that receives an image written by a user through a terminal installed in the terminal, checks whether the handwriting is properly performed, and then displays an AR image such as a specific character to the terminal Can provide writing method and program of writing.

In addition, the present invention can provide an AR-based writing practice method and program that outputs a sample image through a terminal and allows a user to practice writing by viewing words or sentences included in the sample image.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

An AR-based writing practice method according to an embodiment of the present invention for solving the above-described problem is a method performed by a server, comprising: recognizing one or more words in an image or image input through a terminal; Determining whether the similarity of the font of the recognized word falls within a reference range by comparing the font of the recognized word with a reference font; If the similarity falls within a reference range, selecting at least one of an image, a video, or an AR video corresponding to the recognized word; Displaying at least one of the selected image, video, or AR image to the terminal, including displaying on one side of the corresponding word, wherein the reference font is a specific font selected from the terminal as a reference font, and The similarity includes two or more grades divided according to the degree of matching between the reference font and the font, and when the server receives a sample request from the terminal, the terminal receives a word or sentence to be provided with a sample, and the It is characterized in that the reference font is applied to the input word or sentence and displayed on the terminal.

Further, the selecting step may include selecting at least one of an image, a video, or an AR video corresponding to the selected word from a database of a server, or selecting at least one of an image, video, or AR video searched through an external server. It is characterized by.

In addition, the display step is characterized in that at least one of the selected image, video or AR image is augmented to the input image or image to be displayed on the terminal.

In addition, the similarity of the fonts can be selected by the user, including two or more grades divided according to the degree of matching between the reference font and the font.

In addition, after the display step, when the sound output button is selected from the terminal, the server outputs the sound of the word to the terminal, and when the voice output button is selected, the server outputs the voice stored in the AR image to the terminal. It may further include.

In addition, when the evaluation mode is selected, the server recognizes two or more words from one or more images or images received from the terminal, compares each recognized word with a reference font, assigns a score, and sends each to the terminal. The score is displayed, but the reference font is a specific font selected from the terminal as a reference font.

In addition, when the sample output signal is received from the terminal, the server prints the sample through an external printer connected to the terminal.

In addition, the server compares each recognized word with a reference font to give a score to store the given score and the given time, calculate the average score for each day, and display the score trend for each day by the terminal.

In addition, the server selects a word in which the font of the word does not fall within the reference range among the recognized words, and inputs at least one of a predetermined specific image, video, AR image, or an image in which the reference font is applied to the word. It is characterized in that it is augmented to an image or image and displayed on the terminal, but is displayed on one side of the corresponding word.

In addition, the AR-based writing practice method according to an embodiment of the present invention for solving the above-described problem is a method performed by the terminal, the recognition unit recognizes one or more words in the image or image taken through the shooting unit To do; Determining whether the similarity of the font of the recognized word falls within a reference range by comparing the font of the recognized word with a reference font; If the selection unit falls within the reference range, selecting at least one of an image, a video, or an AR video corresponding to the recognized word; Displaying at least one of the selected image, video or AR video to the terminal, including the step of displaying on one side of the word, the reference font is a specific font selected from the terminal as a reference font, the The similarity of the fonts includes two or more grades divided according to the degree of matching of the reference fonts and the fonts, and when the sample request is received, the terminal receives a word or sentence to be provided with a sample, and the received word or It is characterized in that the reference font is applied to the sentence and displayed on the terminal.

delete

delete

delete

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method may be further provided.

The AR-based writing practice program according to another embodiment of the present invention is combined with a hardware computer to execute the above-mentioned AR-based writing practice method and stored in a medium.

According to the present invention as described above, by practicing writing by using a smart device, there is an effect that mobility and autonomy are improved and feedback can be received according to the practice.

In addition, according to the present invention, when it is determined that the font of a word is properly written, an AR image such as a character is displayed to induce children's interest in writing.

In addition, according to the present invention, there is an effect that can practice a variety of fonts by displaying and writing accurately written samples.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 and 2 are schematic diagrams of an AR-based writing practice method according to an embodiment of the present invention.
3 is a flowchart of an AR-based writing practice method according to an embodiment of the present invention.
Figure 4 is an exemplary view illustrating the selection of a specific font and similarity according to an embodiment of the present invention.
Figure 5 is an exemplary diagram illustrating the output of the sound or voice according to an embodiment of the present invention.
6 is an exemplary view illustrating that a score is given to several letters according to an embodiment of the present invention.
7 and 8 are exemplary diagrams illustrating displaying a sample with a terminal according to an embodiment of the present invention.
9 is an exemplary view illustrating output of a sample to an external printer according to an embodiment of the present invention.
10 is an exemplary diagram illustrating displaying a score trend for each day according to an embodiment of the present invention.
11 is a block diagram of an AR-based writing practice method according to an embodiment of the present invention.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, only the present embodiments allow the disclosure of the present invention to be complete, and are common in the technical field to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein, “comprises” and / or “comprising” does not exclude the presence or addition of one or more other components other than the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and “and / or” includes each and every combination of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings commonly understood by those skilled in the art to which the present invention pertains. In addition, terms defined in the commonly used dictionary are not ideally or excessively interpreted unless explicitly defined.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Prior to the description, the meaning of terms used in the present specification will be briefly described. However, it should be noted that the description of terms is intended to aid understanding of the present specification, and is not used to limit the technical spirit of the present invention unless explicitly described as a limitation of the present invention.

In the present invention, augmenting an image, a video, or an AR (Augmented Reality) image to an input image or image and displaying it on the terminal is an augmented image, a video, or an AR image over the image being captured, and a camera (shooting unit) Find the “origin” to launch AR with image recognition method, spatial recognition method, object recognition method, and image, video, general image, 3D modeling, 3D modeling image, web page around the origin (somewhere around the image, space, etc.) , SNS and so on.

1 and 2 are schematic diagrams of an AR-based writing practice method according to an embodiment of the present invention.

1 and 2, the AR-based writing practice method according to an embodiment of the present invention takes a writing or writing by the user through the terminal 300, and the captured image or image server 100 ).

Then, the server 100 recognizes one or more words from an image or image input through the terminal 300.

At this time, an image or image that has already been taken through the photographing unit of the terminal 300 may be transmitted, or an image photographed through the photographing unit of the terminal 300 may be received and recognized in real time.

The server 100 determines whether the font of the recognized word belongs to the reference range, and if it falls within the reference range, selects at least one 500 of the image, video, or AR image corresponding to the word to determine the terminal 300 ).

The server 100 stores at least one 500 of an image, a video, or an AR video corresponding to various words in a database.

In the case of children, if the educational program is boring, the educational effect can be significantly reduced. Therefore, the AR-based writing practice according to an embodiment of the present invention causes children to be interested by displaying at least one 500 of an image, a video, or an AR image corresponding to the recognized word, thereby causing the children to write various letters. It is effective to write and practice.

In addition, it is possible to cause interest by using images and AR images 500 as various animals and characters preferred by children.

For example, in more detail, in FIG. 2, the server 100 recognizes the word “cat” from an image or image input through the terminal 300, and through this, the terminal 100 displays the AR image 500 corresponding to the cat ( 300). At this time, the AR image 500 may be seen as an image on the drawing, but may actually have movement.

At this time, at least one of the image, the video, or the AR image 500 may include a file implemented in the form of an image such as a general image, a 3D image, or a moving 3D image.

At this time, the word "cat" located on the right side was recognized by the server 100, and it is determined that the font of the word falls within the reference range, and the cat's AR image 500 is displayed through the terminal 300.

However, the word "cat" located on the left is not recognized by the server 100 itself, or it is determined that the font of the word does not fall within the reference range, and thus the cat's AR image 500 is not displayed.

If the standard range is set too high, beginners may have difficulty in learning, and if it is set too low, the level of difficulty for intermediate and advanced learners may decrease, so it can be set based on a specific font depending on the user. It can also be set according to the user's writing skill by setting it as several grades.

3 is a flowchart of an AR-based writing practice method according to an embodiment of the present invention.

Referring to Figure 3 will be described with respect to the AR-based writing practice method according to an embodiment of the present invention.

First, the server 100 recognizes one or more words from an image or image input through the terminal 300. (Step S510)

At this time, the words included in the image are handwritten by the user.

In addition, the server 100 recognizing a word means recognizing a word included in an input image or image.

In addition, one or more words may be included in the image or image, or a sentence may be included. The server 100 recognizes a word from an image or image input through the terminal 300, and may recognize a plurality of words or words included in a sentence.

Therefore, preferably, the server 100 may store various recognizable words in a database.

At this time, since the server 100 may not include a word in the image or image input through the terminal 300, or the word written by the user may be less than the word recognition standard of the server 100, the terminal If the word is not recognized in the image or image input through the 300, a rewriting or re-shooting request message may be displayed through the terminal 300.

Next, in step S510, when the font of the word recognized in step S510 falls within the reference range, the server 100 selects at least one of 500, an image, a video, or an AR image corresponding to the word. (Step S520)

Next to step S510, the server 100 selects a word in which the font of the word belongs to the reference range among words recognized in step S510, and selects at least one of 500, an image, a video, or an AR image corresponding to the selected word do. (Step S520)

Preferably, the server 100 does not select and display at least one of an image, a video, or an AR image because the word is recognized, but determines whether the font of the word falls within a preset reference range. It will judge whether it was written properly.

Then, the server 100 determines whether the font of the word falls within a preset reference range, and when it is determined that the word is properly written, selects at least one of an image, video, or AR image corresponding to the word 500 do.

In this case, the server 100 may select at least one of the image, video, or AR image 500 corresponding to the word, or select at least one of the image, video, or AR image 500 corresponding to the meaning of the word. It might be.

For example, when words such as cats, dogs, buses, taxis, trains, airplanes, etc. are recognized, at least one of the images, videos, or AR images corresponding to the word is selected.

At this time, the AR image 500 of various cartoons and animation characters may be selected so as to cause interest of children.

In more detail, the server 100 compares the font of the recognized word with the reference font, and when the similarity of the font falls within the reference range, at least one of the image, video, or AR image corresponding to the word (500) ).

Preferably, in step S520, the server 100 selects a word in which the font of the word falls within the reference range among the recognized words, and the server 100 includes at least an image, video, or AR image corresponding to the selected word. It may include the step of selecting one 500 from the database of the server 100, or selecting at least one 500 of the image, video, or AR image searched through the external server 100.

Since the number of words recognized in step S510 may be two or more, a step of selecting a word belonging to a reference range from among several words is performed.

Further, at least one of the images, videos, or AR images corresponding to the word 500 may be selected, and at least one of the images, videos, or AR images stored in the database of the server 100 may be selected, but on the net. Since at least one of the images, videos, or AR images of 500 may be utilized, if necessary, at least one of the images, videos, or AR images searched through the external server 100 is selected through a search process. Through the step, at least one of an external image, a video, or an AR video 500 may be selected.

Next to step S520, the server 100 augments and displays at least one of the image, video, or AR image selected in step S520 on the image or image input through the terminal 300. (Step S530)

At this time, the server 100 displays at least one of the image, video, or AR video 500 on one side of the word.

For example, if the word is not recognized as shown in the left word of FIG. 2 or the font of the word does not fall within the reference range, nothing is displayed, and the word is recognized as the right word and the font of the word falls within the reference range. If it is, it can be seen that the AR image 500 corresponding to the "cat" is selected and displayed on the terminal 300.

In addition, the server 100 may further include the step of analyzing the recognized word to select the language of the word and the server 100 displaying the word in a specific language input from the terminal 300.

Accordingly, the server 100 may recognize and select the language of the word even if the word is written in a language other than the language currently being used.

For example, when English is selected as a specific language, the word "cat" is displayed together with the English word "CAT", so that the user can practice word practice in other languages together with writing practice. .

In addition, in the AR-based writing practice method according to another embodiment of the present invention, the server selects a word in which the font of the word does not fall within a reference range among the recognized words, and a predetermined specific image, video, AR image Alternatively, at least one of the images to which the reference font is applied to the word is augmented to the input image or image and displayed on the terminal, but may further include displaying on one side of the word.

Therefore, the user can receive feedback on the handwritten text properly and feedback on the handwritten text.

At this time, the predetermined specific image, video, or AR video means an image, video, or AR video that conveys the meaning that the text written by the user does not fall within the standard range of the standard font.

In addition, in the AR-based writing practice method according to another embodiment of the present invention, the server translates the recognized word into a preset language to generate a translation word, and the server inputs the translation word into the image Or it is augmented in the image and displayed on the terminal, but displaying on one side of the word, and providing a translation word.

And, the step of providing the translated word is characterized in that the server applies a reference font to the translated word and displays it by applying a shadow effect.

Therefore, the user can input words in the native language, and translate into a specific language desired by the user, and practice writing together with studying the language.

For example, if the word "CAT" is entered and Korean is set as the translation language, it means that the translation word "cat" is provided.

4 is an exemplary diagram illustrating the selection of similarity with a specific font according to an embodiment of the present invention.

Referring to FIG. 4, the AR-based writing practice method according to an embodiment of the present invention further includes a step in which the server 100 selects a specific font from the terminal 300 as a reference font, and the AR image ( The step of selecting 500) includes: if the word recognition is successful, the server 100 compares the font of the recognized word with the reference font, and determines whether the similarity of the font falls within the reference range; And when the server 100 is within the reference range, selecting at least one of an image, a video, or an AR image 500 corresponding to the recognized word.

In addition, in the receiving step, the server 100 receives a specific font from the terminal 300 as a reference font, selects the font similarity, and the font similarity includes two or more grades, and the determining step is performed. When the word recognition is successful, the server 100 compares the font of the recognized word with the reference font, and determines whether the similarity of the font falls within the reference range of the selected similarity.

For example, since the user may attempt to perform writing practice based on a specific font, a specific font may be designated as a standard font.

In addition, the user can select and practice the font similarity according to his or her writing skill.

For example, if one degree of similarity is specified, it is too difficult for beginners, and the difficulty of learning may drop due to difficulty of intermediate or advanced users, so that the similarity of fonts can be selected according to the level of the user.

At this time, fonts generally used may be applied, such as archery, raised, rolled, and clear Gothic.

In addition, the font similarity may be set to 100% of the font perfectly matching the reference font to include two or more steps below it.

For example, the similarity grade includes: a first step that matches 90 to 100% of the reference font, a second step that matches 80 to 90%, a third step that matches 70 to 80%, a fourth step that matches 60 to 70%, It may be composed of a fifth step that matches 50-60%.

5 is an exemplary diagram illustrating outputting a sound or voice according to an embodiment of the present invention.

Referring to FIG. 5, in the AR-based writing practice method according to an embodiment of the present invention, when the tone output button 310 is selected from the terminal 300, the server 100 performs the tone reading of the word 300 ), And when the voice output button 320 is selected, the server 100 may include outputting the voice stored in the AR image 500 to the terminal 300.

After the step S530, the server 100 displays at least one of the image, video, or AR image corresponding to the word 500 as the terminal 300, and outputs a voice output button 310 or voice to the terminal 300. The button 320 can be displayed.

At this time, the output of the solo sound means to output the pronunciation of the word. In addition, the voice output outputs a voice corresponding to the word, and may be an onomatopoeia of the word, or a voice of a character that the word means.

For example, when children's favorite character's name is written and recognized as a word, the name of the corresponding character may be output by selecting the sound output button 310, or a voice of the character may be output. .

Therefore, there is an effect of allowing children to listen to a variety of sounds and be interested in addition to simply hearing the pronunciation of words.

6 is an exemplary view illustrating that points are given to several letters according to an embodiment of the present invention.

Referring to FIG. 6, an AR-based writing practice method according to an embodiment of the present invention includes: the server 100 recognizing two or more words from one or more images or images received from the terminal 300; And a step in which the server 100 compares each recognized word with a reference font to give a score, and displays each score with the terminal 300.

The server 100 recognizes two or more words from one or more images or images received from the terminal 300, compares each word with a reference font, assigns a score, and displays each score with the terminal 300 You can proceed to the evaluation mode.

Also, the server 100 may select a specific font from the terminal 300 as a reference font before proceeding to the step.

In FIG. 6, a font is selected as a reference font, and five words are detected in an image in which five words are written, and each word is compared with a reference font to give a score, and each score is scored by the terminal 300. I am displaying it.

In this evaluation mode, the user can write several words to evaluate which word is the most accurately written, and write with other users to compare scores with each other.

7 and 8 are exemplary diagrams illustrating displaying a sample with a terminal according to an embodiment of the present invention.

7 and 8, in the AR-based writing practice method according to an embodiment of the present invention, the server 100 receives a sample 390 request from the terminal 300 and provides a sample 390 And receiving a word or sentence to be received, and providing a sample 390 for the server 100 to display the terminal 300 by applying a reference font to the received word or sentence.

And, the step of providing the sample 390 is characterized in that the server 100 displays the sample 390 to the terminal 300 by applying a shadow effect, but displays it overlaying the real-time shooting screen of the terminal 300. Is done.

7 and 8 are exemplary diagrams illustrating that the user is writing the word “cat” on the paper 900 while viewing the sample 390 (330, word: cat) displayed on the terminal 300. At this time, the user's hand is not shown in the representation of the drawing, only the pen 910 is shown.

Referring to FIG. 7, a sample 390 is provided on the screen of the terminal 300 on the left side, and an example in which a user sees the sample 390 on the right side and writes a word with a pen 910 on the paper 900 Doing.

In this way, the user can directly see what the right writing is through the sample 390 provided through the screen of the terminal 300 and practice writing.

And, referring to FIG. 8, the user grips the terminal 300 with the left hand and writes the word “cat” with the pen 910 on the paper 900 while photographing the handwriting scene with the terminal 300 Doing. At this time, the word "cat" is displayed on the screen of the terminal 300 with the shadow effect applied, and the user writes on the paper 900 while looking at the word on the screen of the terminal 300. On the drawing, "high" is currently written, and "cat" is shown as being displayed as a sample 390 to which a shading effect is applied.

Therefore, the user can practice writing by using the sample 390 displayed as a shadow effect through the screen of the terminal 300, so that he can practice writing more accurately.

Accordingly, the user may practice writing while holding the terminal with one hand, or may practice writing after having mounted on a means such as a cradle.

9 is an exemplary diagram illustrating output of a sample to an external printer according to an embodiment of the present invention.

Referring to FIG. 9, in the AR-based writing practice method according to an embodiment of the present invention, when the server 100 receives a sample 390 output signal from the terminal 300, it is connected to the terminal 300 And printing the sample 390 through an external printer 700.

When the user wants to practice writing by directly printing a sample 390 (330, word or sentence) that he or she wants to practice writing in, the server 100 outputs a sample 390 output signal from the terminal 300. Upon reception, the sample 390 is printed through the external printer 700 connected to the terminal 300.

10 is an exemplary diagram illustrating displaying a score trend for each day according to an embodiment of the present invention.

Referring to FIG. 10, in the AR-based writing practice method according to an embodiment of the present invention, the server 100 compares each of the recognized words with a reference font to assign a score to the score and the given score The time is stored, the average score for each day is calculated, and the score trend for each day is displayed on the terminal 300.

The server 100 compares each recognized word with a reference font, assigns a score, stores the assigned score and the given time, calculates the average score for each day, and displays the score trend for each day by the terminal 300 Make sure that you can see if your writing practice is working properly.

In addition, the server 100 selects words that are lower than the average score from among the recognized and scored words, and displays the vowels or consonants commonly included in the words in the order of the terminal 300 in the proportion order. do.

Therefore, there is an effect that allows the user to grasp a specific vowel or consonant vulnerable to writing.

As described above, the AR-based writing practice method according to the embodiment of the present invention, by displaying at least one (500) of an image, a video, or an AR image 500 to write writing practice that can be boring to children, the children practice writing. It has the effect of making you feel interesting.

In addition, students, adults, and foreigners who need to practice writing can have fun writing practice, and the difficulty can be adjusted according to their writing skills, which is effective for a wide range of users.

11 is a block diagram of an AR-based writing practice terminal according to an embodiment of the present invention.

The method for practicing AR-based writing based on the server 100 has been described with reference to FIGS. 1 to 10 above. Hereinafter, an embodiment of the AR-based writing practice method for implementing the AR-based writing practice method in the terminal 300 itself, without going through the server 100, as the terminal 300 is a subject, will be described.

In addition, since detailed contents of the embodiment have been described with reference to FIGS. 1 to 10, redundant descriptions will be omitted.

Accordingly, the embodiments described with reference to the server as a subject through FIGS. 1 to 10 can be applied to the embodiments described below by changing the subject to a terminal.

The AR-based writing practice terminal 300 according to an embodiment of the present invention includes a recognition unit 330, a selection unit 340, and a display unit 350.

The recognition unit 330 recognizes one or more words from an image or image photographed through the photographing unit.

The selection unit 340 selects a word in which the font of the word falls within a reference range among the recognized words, and selects at least one of 500, an image, a video, or an AR image corresponding to the selected word.

The display unit 350 augments at least one of the selected image, video, or AR image to the image or image input from the photographing unit and displays it on the terminal 300, but displays it on one side of the word. Is done.

In addition, the AR-based writing practice terminal 300 according to an embodiment of the present invention further includes components for implementing an AR-based writing practice method mainly having the terminal 300 described below. You can.

In addition, the AR-based writing practice method according to an embodiment of the present invention, the terminal may be implemented as a program, an application installed on the terminal.

AR-based writing practice method according to another embodiment of the present invention, the recognition unit 330 of the terminal 300 recognizes one or more words from an image or image photographed through the recording unit, the terminal 300 The selecting unit 340 selects a word in which the font of the word belongs to a reference range among the recognized words, and selects at least one 500 of an image, a video, or an AR image corresponding to the selected word, the terminal ( The display unit 350 of 300) augments at least one of the selected image, video, or AR image 500 to the image or image photographed through the photographing unit and displays it on the terminal 300, but displays it on one side of the word. It includes the steps.

In the selecting step, the selecting unit 340 of the terminal 300 selects a word in which the font of the word falls within a reference range among the recognized words, and the selecting unit 340 of the terminal 300 is the At least one of images, videos, or AR images corresponding to the selected word 500 is selected from the storage unit 370 of the terminal 300, or at least one of images, videos, or AR images searched through the external server 100. And selecting one 500.

In another embodiment, the selecting unit 340 of the terminal 300 further includes the step of selecting a specific font as a reference font, and the step of selecting the AR image 500 includes the terminal 300 when the word recognition is successful. The determining unit 360 compares the font of the recognized word with the reference font, determining whether the similarity of the font falls within the reference range, and the selection unit 340 of the terminal 300 within the reference range If it belongs, the step of selecting at least one of the image, video or AR image corresponding to the recognized word (500).

In addition, in the selecting step, the selection unit 340 of the terminal 300 receives a specific font as a reference font, and selects a font similarity, wherein the font similarity includes two or more grades.

And, in the determining, if the word recognition is successful, the determination unit 360 of the terminal 300 compares the font of the recognized word with the reference font, and the similarity of the font is the reference of the selected similarity. It is to determine whether it is within range.

In another embodiment, when the tone output button 310 of the terminal 300 is selected, the terminal 300 outputs the tone of the word, and when the voice output button 320 is selected, the terminal 300 displays the AR The method may further include outputting the voice stored in the image 500.

In another embodiment, the recognition unit 330 of the terminal 300 recognizes two or more words from one or more images or images input through the photographing unit, and the determination unit 360 of the terminal 300 recognizes the Comparing each word with a reference font, assigning a score, displaying each score, and at least one of images, videos, or AR images corresponding to each word having a reference score exceeded the reference score (500) ) May be selected and displayed.

In another embodiment, the terminal 300 receives the sample 390 request, and receives a word or sentence to receive the sample 390, the display unit 350 of the terminal 300 receives the input word, or The method further includes providing a sample 390 for displaying and applying a reference font to the sentence.

At this time, the display unit 350 of the terminal 300 displays the sample 390 including a shadow effect, but is characterized by overlaying the display on the real-time shooting screen of the terminal 300.

In addition, when the terminal 300 receives the sample 390 output signal, the method may further include printing the sample 390 through an external printer 700 connected to the terminal 300.

In another embodiment, the determination unit 360 of the terminal 300 compares each recognized word with a reference font to give a score to store the given score and the given time, and calculates an average score for each day And, it characterized in that the display unit 350 of the terminal 300 displays the score trend for each day.

In addition, the AR-based writing practice method according to another embodiment of the present invention may be implemented through the following methods.

In the AR-based writing practice method according to another embodiment of the present invention, the translation unit of the terminal translates the recognized word into a preset language to generate a translation word, and the display unit of the terminal displays the translation word as the photographing unit Augmented to the image or image input through the display to the terminal, but includes the step of displaying on one side of the word.

In addition, when the terminal receives the sample request, the display unit of the terminal may further include a sample providing step of applying a reference font to the translated word and displaying the shadow effect.

The AR-based writing practice method according to an embodiment of the present invention described above may be implemented as a program (or terminal) to be executed in combination with a hardware server, and stored in a medium.

The above-described program is C, C ++, JAVA, machine language, etc., in which a processor (CPU) of the computer can be read through a device interface of the computer in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in the computer language of the. Such code may include functional code related to a function defining functions required to execute the above methods, and control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, the code may further include a memory reference-related code as to which location (address address) of the computer's internal or external memory should be referred to additional information or media necessary for the computer's processor to perform the functions. have. Also, when the processor of the computer needs to communicate with any other computer or server in the remote to execute the functions, the code can be used to communicate with any other computer or server in the remote using the communication module of the computer. It may further include a communication-related code for whether to communicate, what information or media to transmit and receive during communication, and the like.

The storage medium refers to a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the program may be stored in various recording media on various servers that the computer can access or various recording media on the user's computer. In addition, the medium may be distributed over a computer system connected through a network to store computer-readable codes in a distributed manner.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, a software module executed by hardware, or a combination thereof. The software modules may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer readable recording medium well known in the art.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but a person skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing its technical spirit or essential features. You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all respects and not restrictive.

100: server
300: terminal 310: the tone output button
320: voice output button 330: recognition unit
340: selection unit 350: display unit
360: judgment unit 370: storage unit
380: translation section 390: sample
500: AR image 700: External printer
900: paper 910: pen

Claims (15)

In a way that is performed by the server,
Recognizing one or more words from the image or image input through the terminal;
Determining whether the similarity of the font of the recognized word falls within a reference range by comparing the font of the recognized word with a reference font;
If the similarity falls within a reference range, selecting at least one of an image, a video, or an AR video corresponding to the recognized word;
Displaying at least one of the selected image, video or AR video to the terminal, including the step of displaying on one side of the word,
The reference font is a specific font selected from the terminal as a reference font,
The similarity of the fonts includes two or more grades divided according to the degree of matching between the reference font and the font,
The server,
When a sample request is received from the terminal, a word or sentence to be provided with a sample is received from the terminal, and the reference font is applied to the received word or sentence to display on the terminal. How to practice writing.
According to claim 1,
The step of selecting,
AR-based writing, characterized in that at least one of the image, video, or AR image corresponding to the selected word is selected from the database of the server or at least one of the image, video, or AR image searched through an external server. How to practice writing.
According to claim 1,
The display step,
AR at least one of the selected image, video or AR video, characterized in that augmented to the input video or image, characterized in that displayed on the terminal, AR-based writing practice method.
According to claim 1,
The similarity of the fonts can be selected from the user, including two or more grades divided according to the degree of matching between the reference font and the font, AR-based writing practice method.
According to claim 1,
Following the display step,
Further comprising the step of outputting the voice of the word to the terminal when the voice output button is selected from the terminal, and when the voice output button is selected, the server outputs the voice stored in the AR image to the terminal, AR-based writing. How to practice writing.
According to claim 1,
The server,
When the evaluation mode is selected, two or more words are recognized in one or more images or images received from the terminal, the scores are compared by comparing the recognized words with a reference font, and each score is displayed by the terminal. The reference font is a specific font selected from the terminal as a reference font, AR-based writing practice.
delete delete According to claim 1,
The server,
When a sample output signal is received from the terminal, the sample is printed through an external printer connected to the terminal, AR-based writing practice method.
According to claim 1,
The server,
AR-based writing writing practice by comparing each recognized word with a reference font to assign a score to store the given score and the given time, calculate the average score for each day, and display the score trend for each day on the terminal Way.
According to claim 1,
The server,
Select a word that does not fall within the reference range among the recognized words, and augment at least one of a predetermined specific image, video, AR image, or an image in which the reference font is applied to the word to the input image or image. Characterized in that the display on the terminal, but displayed on one side of the word, AR-based writing practice method.
delete delete In a method performed by the terminal,
Recognizing unit recognizes one or more words in the image or image photographed through the photographing unit;
Determining whether the similarity of the font of the recognized word falls within a reference range by comparing the font of the recognized word with a reference font;
If the selection unit falls within the reference range, selecting at least one of an image, a video, or an AR video corresponding to the recognized word;
Displaying at least one of the selected image, video or AR video to the terminal, the display unit, including the step of displaying on one side of the word,
The reference font is a specific font selected from the terminal as a reference font,
The similarity of the fonts includes two or more grades divided according to the degree of matching between the reference font and the font,
The terminal,
When a sample request is received, a word or sentence to be provided with a sample is input, and the reference font is applied to the inputted word or sentence to be displayed on the terminal.
An AR-based writing practice program stored in a medium to execute the method of any one of claims 1 to 6, 9 to 11, in combination with a computer that is hardware.

Images