KR102438029B1 - Method and system for coding education based on augmented reality - Google Patents

Abstract

Augmented reality-based coding education providing system according to one technical aspect of the present invention, a coding teaching aid that can be operated by a user to display a predetermined coding formula, and image recognition for the image data for the coding teaching tool, the coding Extracting the user code from the equation, generating a driving code corresponding to the user code, and if the generated driving code matches any coding education content, it includes a user terminal that provides augmented reality content related to the coding education content.

Description

Augmented reality-based coding education providing method and system {METHOD AND SYSTEM FOR CODING EDUCATION BASED ON AUGMENTED REALITY}

The present invention relates to a method and system for providing coding education based on augmented reality.

With the development of video technology, various attempts are being made to increase educational efficiency by applying technologies such as augmented reality in the education system.

A conventional augmented reality-based education system has been disclosed in Korean Patent Application Laid-Open No. 10-2019-0124045, etc., and in the case of this prior art, a specific content is displayed through a marker or a QR Code by using the corresponding marker or QR Code. When it comes to recognizing, the form of showing dominates.

In the case of such a prior art, since a marker or a QR code is essential, there are disadvantages such as a lowering of educational interest in educational contents in which various combinations are possible.

In particular, in the case of low-age users such as infants and elementary school students, various augmented reality, etc. are being developed for the efficiency and interest of education. Designated instruction such as changing graphics, animation, sound, and music was mainly used, and accordingly, there is a limit in generating interest and there are limitations in that educational performance is not high.

Korean Patent Publication No. 10-2019-0124045

One technical aspect of the present invention is to solve the problems of the prior art, and by processing the coding formula expressed in the coding teaching aid by the user as image processing, and driving the robot to correspond to the coding formula, the robot is It is to provide a method and system for providing augmented reality-based coding education that can easily understand the coding formula through and provide a three-dimensional sense of learning.

One technical aspect of the present invention is augmented reality-based coding education that can have an intuitive and immediate learning effect on the coding equation by reflecting and displaying the augmented reality object corresponding to the coding equation expressed in the coding teaching by the user. To provide a method and system for providing.

The above objects and various advantages of the present invention will become more apparent from preferred embodiments of the present invention by those skilled in the art.

One technical aspect of the present invention provides an augmented reality-based coding education providing system. The augmented reality-based coding education providing system performs image recognition on the image data for the coding teaching aid and the coding teaching aid that is manipulated by the user to display a predetermined coding equation, and extracts the user code from the coding equation and and a user terminal that generates a driving code corresponding to the user code, and provides augmented reality content associated with the corresponding coding education content when the generated driving code matches any coding education content.

In one embodiment, the coding aid is a coding board having a plurality of coding slots corresponding to the coding blocks, a plurality of coding boards capable of being seated in the coding slots and displaying any one of a plurality of instructions and including a factor slot therein. It may include a plurality of printing cards capable of being seated in the block and the printing slot, and displaying any one of a constant, a variable, and a logical value.

In an embodiment, the user terminal performs image recognition on the image data, and extracts the object related to the coding teaching aid from the recognized image data, and stores the image recognition processing unit for extracting the user code, coding education content and a coding content management unit that generates the driving code corresponding to the user code when the user code is correct, and the user code and It may include an augmented reality manager that generates at least one associated augmented reality object, and projects and displays the generated at least one augmented reality object on an image.

In one embodiment, the image recognition processing unit, an image recognition module for extracting an object for at least one coding block displayed in the coding teaching aid from the image data, commands and factors for each of the extracted at least one coding block It may include a code object extraction module for extracting and a user code extraction module for generating a user code using the commands and arguments extracted from the code object extraction module.

In one embodiment, the user terminal manages the learning results and history for the coding education content of the user, and selects a learning process that the user is weak in, and drives a software simulation that can intensively repeat the coding content. It may further include a learning activity management unit to provide.

Another technical aspect of the present invention provides an augmented reality-based coding education providing system. The augmented reality-based coding education providing system extracts the user code from the coding formula by performing image recognition on the image data for the coding teaching aid and the coding teaching aid that can be manipulated by the user to display a predetermined coding equation, and and a user terminal that generates a drive code corresponding to the user code, and a robot that receives the drive code from the user terminal and performs a specific operation related to the drive code.

In an embodiment, the user terminal performs image recognition on the image data, and extracts the object related to the coding teaching aid from the recognized image data, and stores the image recognition processing unit for extracting the user code, coding education content The user code is scored by checking which coding education content the extracted user code corresponds to, and when the user code is correct, the coding content management unit that generates the driving code corresponding to the user code and the robot are linked It may include a robot interlocking unit for wirelessly transmitting the driving code to the robot.

In one embodiment, the image recognition processing unit, an image recognition module for extracting an object for at least one coding block displayed in the coding teaching aid from the image data, commands and factors for each of the extracted at least one coding block It may include a code object extraction module for extracting and a user code extraction module for generating a user code using the commands and arguments extracted from the code object extraction module.

In an embodiment, the user terminal may further include an augmented reality manager that generates at least one augmented reality object associated with the driving code, and projects and displays the generated at least one augmented reality object on an image. .

Another technical aspect of the present invention provides a method for providing coding education based on augmented reality. The augmented reality-based coding education providing method is a method of providing augmented reality-based coding education to a user using a coding aid and a robot that can be manipulated by the user to display a predetermined coding formula, Obtaining image data for a predetermined coding equation, performing image recognition on the image data to extract a user code from the coding equation, generating a driving code corresponding to the user code, and the generated When the driving code matches any coding education content, providing augmented reality content related to the coding education content.

In an embodiment, the augmented reality-based coding education providing method may further include controlling the robot to perform a specific operation related to the driving code by providing the driving code to the robot.

In one embodiment, the coding aid is a coding board having a plurality of coding slots corresponding to the coding blocks, a plurality of coding boards capable of being seated in the coding slots and displaying any one of a plurality of instructions and including a factor slot therein. It may include a plurality of printing cards capable of being seated in the block and the printing slot, and displaying any one of a constant, a variable, and a logical value.

In one embodiment, the step of extracting the user code from the coding formula, extracting an object for at least one coding block displayed in the coding teaching aid from the image data, each of the extracted at least one coding block It may include extracting a command and a factor for , and generating a user code using the command and factor extracted from the code object extraction module.

In one embodiment, the generating of the driving code corresponding to the user code comprises the steps of storing coding education content, checking which coding education content the extracted user code corresponds to, and scoring the user code; When the user code is correct, the method may include generating the driving code corresponding to the corresponding user code.

In one embodiment, the augmented reality-based coding education providing method manages the learning results and history for the coding education content of the user, and selects a learning process that the user is weak in, and provides the user with coding education for the learning process. The method may further include repeatedly providing content.

The means for solving the above-described problems do not enumerate all the features of the present invention. Various means for solving the problems of the present invention may be understood in more detail with reference to specific embodiments in the following detailed description.

According to one embodiment of the present invention, by processing the coding equation expressed in the coding teaching aid by the user as image processing, and driving the robot to correspond to the coding equation, it is easy to understand the coding equation through the robot and to develop a three-dimensional sense of learning. effect that can be provided.

According to an embodiment of the present invention, by reflecting and displaying the augmented reality object corresponding to the coding equation expressed in the coding teaching by the user, there is an effect that can have an intuitive and immediate learning effect with respect to the coding equation.

1 is a diagram illustrating a system for providing coding education based on augmented reality according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of the coding board shown in FIG. 1 .
FIG. 3 is a diagram illustrating an example of a coding block applied to the coding board shown in FIG. 2 .
FIG. 4 is a diagram illustrating an example of instructions applied to the coding block shown in FIG. 3 .
FIG. 5 is a diagram illustrating an example of an acceptance card applied to the coding block shown in FIG. 3 .
6 is a block diagram illustrating an example of the user terminal shown in FIG. 1 .
7 is a block diagram illustrating an example of the image recognition processing unit shown in FIG. 6 .
8 is a block diagram illustrating an example of the coding content management unit shown in FIG. 6 .
9 is a block diagram illustrating an example of the augmented reality management unit shown in FIG. 6 .
FIG. 10 is a block diagram illustrating an example of the robot shown in FIG. 1 .
FIG. 11 is a block diagram illustrating an example of the server shown in FIG. 1 .
12 is a flowchart illustrating a method for providing coding education based on augmented reality according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

However, the embodiment of the present invention may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. In addition, the embodiments of the present invention are provided in order to more completely explain the present invention to those of ordinary skill in the art.

Although various flowcharts are disclosed to describe the embodiments of the present invention, this is for convenience of description of each step, and each step is not necessarily performed according to the order of the flowchart. That is, each step in the flowchart may be performed simultaneously with each other, performed in an order according to the flowchart, or may be performed in an order opposite to the order in the flowchart.

In addition, in order to describe a system according to the present invention below, various components constituting the system and sub-components thereof are described. These components and sub-components thereof may be implemented in various forms, such as hardware, software, or a combination thereof. For example, each element may be implemented as an electronic configuration for performing a corresponding function, or may be software itself operable in an electronic system or implemented as a functional element of such software. Alternatively, it may be implemented with an electronic configuration and corresponding driving software.

1 is a diagram illustrating a system for providing coding education based on augmented reality according to an embodiment of the present invention.

Referring to FIG. 1 , the augmented reality-based coding education providing system may include a coding teaching aid 10 , a user terminal 100 , a robot 200 , and a server 300 .

The coding tool 10 is a tool that can be operated by a user to display a predetermined coding formula.

The coding aid 10 may include a coding board 11 and a plurality of coding blocks 13 . The coding board 11 and the coding block 13 may be implemented non-electronically, thereby increasing ease of use, storability, and price competitiveness.

A specific example of the coding aid 10 will be described in more detail below with reference to FIGS. 2 to 5 .

The user terminal 100 is an electronic device including a camera, a memory, a display, a central processing unit, and the like. The user terminal 100 may be implemented by installing application software in an electronic device such as a smart phone or a tablet personal computer (PC), or may be implemented as a dedicated electronic device.

The user terminal 100 may take an image for the coding aid manipulated by the user, and determine whether the coding formula created by the user corresponds to the coding education content based on the image processing therefor.

The user terminal 100 performs image recognition on the image data for the coding teaching aid, extracts the user code from the coding formula, generates a driving code corresponding to the user code, and the generated driving code corresponds to which coding education content. If it matches, augmented reality content related to the corresponding coding education content can be provided.

The user terminal 100 may show an augmented reality image related to the coding formula created by the user, or request the robot 200 to cause the robot 200 located near the user to perform an operation corresponding to the coding formula.

Therefore, since the user sees the augmented reality image corresponding to the coding equation created by the user or checks the robot moving in the same manner as the coding equation, the user can understand the coding equation in a three-dimensional sense. Accordingly, the learning effect of the user is increased, and in particular, the user of a low age may have an effect of increasing the interest in education.

In one embodiment, the user terminal 100 may perform image recognition on the image data for the coding aid 10 to extract the user code from the coding formula and generate a driving code corresponding to the user code. The user terminal 100 may wirelessly transmit the driving code to the robot 200, and the robot 200 may operate according to the user's coding formula by operating according to the driving code.

The user terminal 100 may be provided with new educational content or related application programs in conjunction with the server 300 .

The robot 200 in the present invention collectively refers to a wireless driving device capable of operating according to a driving code. Accordingly, the robot 200 in the present invention encompasses various driving devices such as the drone 21 in addition to the toy robot 23 .

The server 300 may provide coding education content to the user terminal 100 . The server 300 may provide application software to the user terminal 100 .

Hereinafter, an augmented reality-based coding education providing system will be described in more detail with reference to FIGS. 2 to 11 .

FIG. 2 is a diagram illustrating an example of the coding board shown in FIG. 1 , and FIG. 3 is a diagram illustrating an example of a coding block applied to the coding board shown in FIG. 2 .

FIG. 4 is a diagram illustrating an example of instructions applied to the coding block illustrated in FIG. 3 , and FIG. 5 is a diagram illustrating an example of an argument card applied to the coding block illustrated in FIG. 3 .

2 to 5 , the coding aid 10 may include a coding board 11 , a coding block 13 and a printing card 16 .

The coding board 11 includes a plurality of coding slots 12 corresponding to the coding blocks 13 .

The coding slot 12 may be implemented in various ways. For example, the coding slot 12 may have a cavity corresponding to the shape of the coding block 13 so that the coding block 13 is seated. As another example, the coding slot 12 and the coding block 13 may be magnetically attracted to each other and seated. Alternatively, the coding slot 12 may be displayed as a graphic image in the shape of the coding block 13 .

A plurality of coding blocks 13 are provided, and one coding block 13 can be seated in one coding slot 12 .

The coding block 13 may include an instruction 14 and an argument slot 15 .

Since the command 14 may be implemented as various commands such as use of an item, jump, movement, rotation, etc., the command 14 is not particularly limited in the present invention.

The instruction 14 may also indicate a predetermined function used in a programming language, for example, a loop statement or a conditional statement.

The printing card 16 may be seated in the printing slot 15 . This can be understood with reference to the contents described above with reference to the coding slot 12 and the coding block 13 .

The printing card 16 can display any one of constants, variables, and logical values.

As described above, the user can create a predetermined coding formula by arranging the coding block 13 and the printing card 16 on the coding board 11 . The user terminal 100 may provide various functions for coding education to the user based on image recognition with respect to the coding board 11 operated by the user.

Hereinafter, the user terminal 100 will be described in more detail with reference to FIGS. 6 to 9 .

6 is a block diagram illustrating an example of the user terminal shown in FIG. 1 .

Referring to FIG. 6 , the user terminal 100 includes an image recognition processing unit 110 , a coding content management unit 120 , an augmented reality management unit 130 , a learning activity management unit 140 , a server interworking unit 150 , and a robot interworking unit. 160 and a control unit 170 may be included. According to the embodiment, it is obvious that some of the respective components constituting the user terminal 100 may be omitted or may be integrated.

The image recognition processing unit 110 may perform image recognition on the image data for the coding teaching aid, and extract the user code by extracting the object related to the coding teaching tool from the recognized image data.

For example, the image recognition processing unit 110 may be implemented by applying an Oriented FAST and Rotated BRIEF (ORB) algorithm that uses a FAST Corner Detection algorithm that extracts feature points of an object fast and a BRIEF algorithm that generates a fast descriptor. In addition, comparison in the matching stage can be smoothly implemented by using descriptor data sorting and OpenCV Feature Detection & Matching function to improve speed reduction when comparing a large number of feature points.

The coding content management unit 120 may store coding education content. The coding content management unit 120 may receive the coding education content from the server 300 .

The coding content management unit 120 may score the user code by checking whether the user code extracted from the image recognition processing unit 110 corresponds to which coding education content.

When the user code is correct as a scoring result, the coding content management unit 120 may generate a driving code corresponding to the corresponding user code.

In an embodiment, the coding education content may include educational content such as a video in relation to a specific user code. The coding education content may also include a specific driving code that matches 1:1 with a specific user code. The coding content management unit 120 mutually verifies the video being played (educational content) and the user code, and if they match, extracts the driving code that matches the user code 1:1 and transmits it wirelessly to the robot 200 can do.

For example, when 'the robot rotates after going straight' as educational content, a user code related thereto may be related to 'going straight-rotation'. Also, suppose that the driving code for the robot can be implemented as a practical control signal for 'going straight-rotating' the corresponding robot. A user can create a coding expression while watching the educational content, and thus the user-created coding expression is related to the robot's movement in the educational content. The coding content management unit 120 examines whether the user code generated by the image recognition processing unit 110 is 'straight-rotation', and if it corresponds to that, a driving code for 'straight-rotation' of the robot to the robot 200 is provided. can provide

The augmented reality management unit 130 may generate at least one augmented reality object associated with the driving code extracted from the image recognition processing unit 110 , and project and display the generated at least one augmented reality object on an image.

For example, when 'the robot rotates after going straight' as educational content, a user code related thereto may be related to 'going straight-rotation'. Users can create coding expressions while viewing educational content. The coding content management unit 120 may review whether the user code generated by the image recognition processing unit 110 is 'straight-rotation', and if it corresponds to it, it may notify the augmented reality management unit 130 of this. The augmented reality management unit 130 may display the augmented reality object corresponding to the user code 'straight-turn' through the user terminal 100 . In the above example, the augmented reality management unit 130 may generate 'go straight display - rotate display' as augmented reality and project it to educational content and display it.

On the other hand, although the above-described example has been described as an example of projecting an augmented reality object onto educational content, this is exemplary, and various modifications are possible, such as projecting and displaying the augmented reality object on the image itself captured by the actual camera.

The learning activity management unit 140 may manage the learning activity for the user's coding education content.

As an example, the learning activity management unit 140 may manage a learning result and history of the user's coding education content, select a learning process that the user is weak in, and provide it to the coding content management unit. Accordingly, the learning activity management unit 140 may provide a software simulation drive so that the user selects a weak learning process and repeatedly provides the coding education content for the learning process to the user.

The server interworking unit 150 may communicate with the server 300 . The server interworking unit 150 may communicate with the server 300 to provide or update coding education content to the user terminal 100 . The server interworking unit 150 may provide a learning result and history for the user's coding education content to the server 300 in cooperation with the learning activity management unit 140 .

The robot interlocking unit 160 is capable of interworking with the robot through wireless communication. The robot interworking unit 160 may receive a driving code for the robot from the coding content management unit 120 and transmit it to the robot wirelessly.

The robot interlocking unit 160 may detect which robot exists within a range capable of wireless communication, and check whether the robot is in an effective state for operation, and the like. The robot interlocking unit 160 may provide the detected robot and its state to the coding content management unit 120 to identify a drivable robot in the coding content management unit 120 .

The controller 170 may control each component of the user terminal 100 to operate in correlation with each other.

7 is a block diagram illustrating an example of the image recognition processing unit shown in FIG. 6 .

Referring to FIG. 7 , the image recognition processing unit 110 may include an image recognition module 111 , a code object extraction module 112 , and a user code extraction module 113 .

The image recognition module 111 may extract an object for at least one coding block displayed in the coding teaching tool from the image data. The image recognition module 111 extracts an object for the entire coding block included in the coding teaching tool (10).

The code object extraction module 112 may extract commands and factors for each of the extracted coding blocks. The code object extraction module 112 may extract the command by performing image recognition on the location of the command of the coding block 11 . The code object extraction module 112 may extract a command by performing image recognition with respect to the position of the factor of the coding block 11 .

The user code extraction module 113 may generate a user code by using the commands and arguments extracted from the code object extraction module 112 .

8 is a block diagram illustrating an example of the coding content management unit shown in FIG. 6 .

Referring to FIG. 8 , the coding content management unit 120 may include a coding content storage module 121 , a user code scoring module 121 , and a driving code sending module 123 .

The coding content storage module 121 stores coding education content. The coding content storage module 121 may receive or update coding education content from the server 300 .

The user code scoring module 121 may score the user code by checking which coding education content the extracted user code corresponds to.

When the driving code sending module 123 user code is correct, it is possible to generate a driving code corresponding to the corresponding user code.

9 is a block diagram illustrating an example of the augmented reality management unit shown in FIG. 6 .

The augmented reality manager 130 may include an AR object generation module 131 , an AR image matching module 132 , and a coding content interworking module 133 .

The AR object creation module 131 may create an AR object. The AR object generation module 131 may generate at least one augmented reality object associated with the user code.

The AR image matching module 132 may project and display the AR object generated by the AR object generation module 131 on an image.

As an example, the AR image matching module 132 may project and display an AR object on an image with respect to a screen currently being captured by the camera of the user terminal 100 .

As another example, the coding content interworking module 133 may cooperate with the coding content management unit 120 to obtain a coded content video and provide it to the AR image matching module 132 . The AR image matching module 132 may project and display the AR object on the image with respect to the coding content video provided from the coding content interworking module 133 .

FIG. 10 is a block diagram illustrating an example of the robot shown in FIG. 1 .

Referring to FIG. 10 , the robot 200 may include a user terminal interworking unit 210 , a control unit 220 , and a driving unit 230 .

The user terminal interworking unit 210 may generate wireless communication with the user terminal 100 . The user terminal interworking unit 210 may inform the user terminal 100 that the robot 300 is in an operable state by interworking with the user terminal 100 .

When the user terminal interworking unit 210 receives the driving code from the user terminal 100 , it may provide it to the control unit 220 .

The controller 220 may control each component constituting the robot 200 to operate in correlation with each other.

When the control unit 220 receives the driving code from the user terminal interworking unit 210 , the control unit 220 may control the driving unit 230 so that the robot 30 operates a specific operation related to the corresponding driving code.

FIG. 11 is a block diagram illustrating an example of the server shown in FIG. 1 .

Referring to FIG. 11 , the server 300 may include a user terminal interworking unit 310 , a content management unit 320 , a user learning management unit 330 , and a control unit 340 .

The user terminal interworking unit 310 may communicate with the user terminal 100 . The user terminal interworking unit 210 may interwork with the server interworking unit 150 of the user terminal 100 .

The content management unit 320 may provide or update the coding content to the user terminal 100 .

The user learning management unit 330 may share the learning result and history of the user's coding education content by interworking with the learning activity management unit 140 of the user terminal 100 .

The controller 340 may control each component constituting the server 300 to operate in correlation with each other.

In the above, an augmented reality-based coding education providing system according to an embodiment of the present invention has been described with reference to FIGS. 1 to 11 .

Hereinafter, a method for providing coding education based on augmented reality according to an embodiment of the present invention will be described with reference to FIG. 12 .

Since the augmented reality-based coding education providing method to be described below is performed based on the augmented reality-based coding education providing system, it can be easily understood with reference to the description described above with reference to FIGS. 1 to 11 .

12 is a flowchart illustrating a method for providing coding education based on augmented reality according to an embodiment of the present invention.

The coding aid 10 may be operated by the user to display a predetermined coding formula (S1211).

The user terminal 100 may obtain image data for the displayed predetermined coding formula (S1021).

The user terminal 100 may perform image recognition on image data to extract a user code from a coding equation (S1022).

The user terminal 100 may generate a driving code corresponding to the user code (S1023) and provide the driving code to the robot 200 (S1024).

The robot 200 may perform a specific operation related to the driving code (S1031).

The coding aid 10, as described above with reference to FIGS. 2 to 5, a coding board having a plurality of coding slots corresponding to the coding blocks, can be seated in the coding slots and display any one of a plurality of instructions and A plurality of coding blocks including a factor slot therein and a plurality of factor cards capable of being seated in the factor slot and displaying any one of a constant, a variable, and a logical value may be included.

The user terminal 100 may generate at least one augmented reality object associated with the driving code, and project and display the generated at least one augmented reality object on an image (S1025).

The user terminal 100 may manage the learning results and history of the user's coding education content, select a learning process that the user is weak in, and repeatedly provide the coding education content for the learning process to the user.

In one embodiment for step S1022, the user terminal 100, extracting an object for at least one coding block displayed in the coding teaching aid from the image data, the extracted instruction for each of the at least one coding block and The operation may include extracting a factor and generating a user code using the command and the factor extracted from the code object extraction module.

In an embodiment for step S1023, the user terminal 100 stores the coding education content, checking which coding education content the extracted user code corresponds to, and scoring the user code, and the user code If is correct, the operation may include generating the driving code corresponding to the corresponding user code.

The present invention described above is not limited by the above-described embodiments and the accompanying drawings, but is limited by the claims described below, and the configuration of the present invention may vary within the scope without departing from the technical spirit of the present invention. Those of ordinary skill in the art to which the present invention pertains can easily recognize that it can be changed and modified.

10: Coding Parish
11: coding board 12: coding slot
13: coding block 14: instruction
15: printing slot 16: printing card
100: user terminal
110: image recognition processing unit 120: coding content management unit
130: augmented reality management unit 140: learning activity management unit
150: server interlocking unit 160: robot interlocking unit
170: control unit
200: robot
210: user terminal interworking unit 220: server interworking unit
230: driving unit 240: control unit
300 : server
310: content management unit 320: user learning management unit
330: user terminal interlocking unit 340: robot object interlocking unit
350: control unit

Claims (15)

a coding aid operated by a user to display a predetermined coding formula and implemented non-electronically; and
Taking an image with respect to the coding tool, recognizing the coding formula in the coding tool based on image recognition for the captured image data, and extracting the commands and factors for each coding block from the recognized coding formula, the coding formula a user terminal for extracting a user code from and generating a driving code corresponding to the user code, and providing augmented reality content related to the corresponding coding education content when the generated driving code matches the coding education content; including,
The coding parish is,
a coding board having a plurality of coding slots having cavities corresponding to the shape of the coding block so that the coding block is seated;
a plurality of coding blocks capable of being seated in the coding slot, the coding blocks representing instructions, and including an argument slot therein; and
A plurality of printing cards capable of being seated in the printing slot and displaying any one of a constant, a variable, and a logical value;
The plurality of instructions displayed in the plurality of coding blocks,
a first command including the use, jump, movement and rotation of the item for the augmented reality object; and
a second instruction for displaying a loop or conditional statement used in a programming language;
The coding block representing the first instruction includes the argument slot,
The coding block displaying the second instruction replaces the argument slot to display a description of the loop or conditional statement,
Augmented reality-based coding education providing system.
delete According to claim 1, wherein the user terminal,
an image recognition processing unit for performing image recognition on the image data and extracting the user code by extracting an object related to the coding teaching aid from the recognized image data;
A coding content management unit that stores the coding education content, checks which coding education content the extracted user code corresponds to, scores the user code, and generates the driving code corresponding to the user code if the user code is correct ; and
an augmented reality management unit that generates at least one augmented reality object associated with the user code, and projects and displays the generated at least one augmented reality object on an image;
Augmented reality-based coding education providing system that includes.
The method of claim 3, wherein the image recognition processing unit
an image recognition module for extracting an object for at least one coding block displayed in the coding teaching aid from the image data;
a code object extraction module for extracting commands and arguments for each of the extracted at least one coding block; and
a user code extraction module for generating a user code using the commands and arguments extracted from the code object extraction module;
Augmented reality-based coding education providing system that includes.
According to claim 3, wherein the user terminal,
a learning activity management unit that manages the learning results and history of the user's coding education content, and provides a software simulation drive that enables the user to select a weak learning process and repeat the coding content intensively;
Augmented reality-based coding education providing system further comprising a.
a coding aid operated by a user to display a predetermined coding formula and implemented non-electronically; and
Taking an image with respect to the coding tool, recognizing the coding formula in the coding tool based on image recognition for the captured image data, and extracting the commands and factors for each coding block from the recognized coding formula, the coding formula a user terminal for extracting a user code from and generating a driving code corresponding to the user code, and providing augmented reality content related to the corresponding coding education content when the generated driving code matches the coding education content; and
a robot receiving the driving code from the user terminal and performing a specific operation determined by the driving code;
including,
The coding parish is,
a coding board having a plurality of coding slots having cavities corresponding to the shape of the coding block so that the coding block is seated;
a plurality of coding blocks capable of being seated in the coding slot, the coding blocks representing instructions, and including an argument slot therein; and
A plurality of printing cards capable of being seated in the printing slot and displaying any one of a constant, a variable, and a logical value;
The plurality of instructions displayed in the plurality of coding blocks,
a first instruction comprising use, jump, move and rotate of an item for the robot; and
a second instruction for displaying a loop or conditional statement used in a programming language;
The coding block representing the first instruction includes the argument slot,
The coding block displaying the second instruction replaces the argument slot to display a description of the loop or conditional statement,
Augmented reality-based coding education providing system.
The method of claim 6, wherein the user terminal,
an image recognition processing unit for performing image recognition on the image data and extracting the user code by extracting an object related to the coding teaching aid from the recognized image data;
A coding content management unit that stores the coding education content, checks which coding education content the extracted user code corresponds to, scores the user code, and generates the driving code corresponding to the user code if the user code is correct ; and
a robot linkage unit for wirelessly transmitting the driving code to the robot in conjunction with the robot;
Augmented reality-based coding education providing system that includes.
The method of claim 7, wherein the image recognition processing unit
an image recognition module for extracting an object for at least one coding block displayed in the coding teaching aid from the image data;
a code object extraction module for extracting commands and arguments for each of the extracted at least one coding block; and
a user code extraction module for generating a user code using the commands and arguments extracted from the code object extraction module;
Augmented reality-based coding education providing system that includes.
The method of claim 7, wherein the user terminal,
an augmented reality management unit for generating at least one augmented reality object associated with the driving code, and projecting and displaying the generated at least one augmented reality object on an image;
Augmented reality-based coding education providing system further comprising a.

delete delete delete delete delete delete

Images