WO2022075817A1

WO2022075817A1 - Remote robot coding education system

Info

Publication number: WO2022075817A1
Application number: PCT/KR2021/013941
Authority: WO
Inventors: 박충현; 이길호
Original assignee: 주식회사 로보닉스
Priority date: 2020-10-08
Filing date: 2021-10-08
Publication date: 2022-04-14
Also published as: KR20220047149A; KR102290951B1

Abstract

The present invention relates to a non-contact remote robot coding education system for creating control commands (programs) that enable students receiving non-contact online classes in each household to control robots located at distanced spaces such as classrooms or auditoriums, and remotely controlling the robots by transmitting the control commands through a teacher terminal located in the same space as that of the robots.

Description

Remote Robot Coding Training System

The present invention relates to a remote robot coding education system, and more particularly, students receiving non-face-to-face online classes at each home write a control command (program) to control a robot located in a spaced apart space such as a classroom or auditorium, It relates to a non-face-to-face remote robot coding education system that remotely controls a robot by transmitting a control command through a teacher terminal located in the same space as the robot.

Coding is a process of making 'code', the language of a program for performing a specific purpose, and it can improve comprehension and creativity, so the need for coding education in elementary and secondary schools is increasing.

Recently, an educational robot equipped with a microchip is used to make coding more interesting and easier for children. In the sense that such an educational robot needs to write a coding program to control it, it was still difficult for students to learn the programming language.

In order to solve the difficulties of coding education, a programming language designed to build programs in a language called EPL (Education programming language) has been proposed. An example of EPL is block coding. Block coding is a programming language that can control the movement of a robot using pre-made blocks, rather than writing a program using a computer program directly.

Patent Publication No. 10-2018-0013487 discloses an educational robot system for controlling a robot by arranging a coding block on a coding board. The above publication patent has the advantage that students can easily access the program because the robot can be intuitively controlled using a coding block. However, the disclosed patent is a method in which the coding board transmits an algorithm to the robot through a short-distance communication module such as RFID.

An object of the present invention is to provide a remote robot coding education system that allows students to code at home and operate a robot located in a school classroom or auditorium with a coded control command.

An object of the present invention is to provide a non-face-to-face robot coding education system that can control robots located in a classroom or auditorium under the leadership of a teacher using a smartphone or computer at home or outside, even if students do not go to school.

In one aspect the invention provides

A plurality of student terminals running the robot education application;

A plurality of real robots located in a separate indoor space or an external space spaced apart from the student terminal;

A teacher terminal that executes the robot education application, is located in the same space as the plurality of real robots, and can be connected to the real robot through a local area network; and

A server that receives the real robot control command written in the plurality of student terminals through a wired/wireless telecommunication network, and transmits the control command to the teacher terminal through a wired/wireless communication network,

The teacher terminal relates to a remote robot coding education system, characterized in that it transmits the control command received from the server to a plurality of real robots through a local area network.

The remote robot coding education system of the present invention operates a robot located in a school classroom or auditorium with block coding written by students at home, and it can be captured and transmitted to students in real time, so even if students do not go to school, the robot is led by a teacher. Coding practice training can be performed.

The remote robot coding education system of the present invention receives the coding written in the student terminal at each home or outside place from the server, and does not directly transmit it to a plurality of robots, but through a teacher terminal located in the same space (classroom, etc.) as the robot. It can be efficiently transmitted to dogs. That is, since the teacher terminal is accessing the server in real time, the server can easily transmit information to the teacher terminal's internal IP address. A cumbersome process is required.

In addition, in order to control robots such as drones, the UDP/IP method, which can transmit information (including control commands) faster than the TCP/IP method, is advantageous. It is convenient and efficient for the server to transmit information to the robot by UDP/IP method rather than to transmit information to the robot by UDP/IP through the teacher terminal connected to the robot through the local area network.

The present invention can search the internal IP address of each robot connected to the router (local area network) through the teacher terminal located in the same space as the robot (classroom, etc.) You can control the simulation or flight of

The remote robot coding education system of the present invention can simulate a virtual robot on a 3D screen with the coding written by network-connected students, so that incorrect coding can be checked in advance, and accidents, mistakes and robot use can be minimized during robot movement. can

1 is a block diagram of a remote robot coding education system of the present invention.

FIG. 2 is a block diagram of a student terminal, FIG. 3 is a robot, FIG. 4 is a block diagram of a teacher terminal, and FIG. 5 is a block diagram of a server.

6 is an execution screen of an application displayed on a teacher terminal, and FIG. 7 is an execution screen of an application displayed on a student terminal.

8 shows a display screen executed when the real robot search module is driven in the teacher terminal.

9 is an example of a screen in which coding is performed in a student terminal.

10 is an example of a screen in which an operation situation such as flight of a real robot is recorded in real time in the teacher terminal.

Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings. However, the scope of the present invention is not limited to the description or drawings of the following embodiments. That is, the terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In addition, terms such as "comprises" or "have" described in this specification are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or the It should be understood that the existence or addition of the above other features or numbers, steps, operations, components, parts or combinations thereof is not precluded in advance.

In addition, terms such as "unit", "group", and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software.

1 is a block diagram of a remote robot coding education system of the present invention, FIG. 2 is a student terminal, FIG. 3 is a robot, FIG. 4 is a block diagram of a teacher terminal, FIG. 5 is a block diagram of a server, and FIG. 6 is a teacher terminal. It is an execution screen of the displayed application, FIG. 7 is an execution screen of the application displayed on the student terminal, FIG. 8 is a display screen executed when the real robot search module is driven in the teacher terminal, and FIG. 9 is coding in the student terminal This is an example of a screen in progress, and FIG. 10 is an example of a screen for real-time recording of operating conditions such as flight of a real robot in the teacher terminal.

Referring to FIG. 1 , the remote robot coding education system of the present invention includes a plurality of student terminals 10 , a real robot 20 , a teacher terminal 30 , and a server 40 .

The robot includes a communication unit, a control unit (microchip), a driving unit (operation execution module), and the like, and includes instruments and devices that can be driven through a remote control command. For example, the robot may be a drone, a traveling robot, a work machine, or the like. Hereinafter, a drone will be used as an example to describe a remote robot coding education system.

The student terminal 10 and the teacher terminal 30 are terminals capable of online access, including mobile and personal PCs, for example, smartphones, tablet PCs, slate PCs, notebook computers, digital broadcasting terminals, PDA, and PMP. , any personal terminal capable of communicating with external devices such as navigation, etc. may be applicable.

The student terminal 10 and the teacher terminal 30 download and execute the robot education application provided by the server.

Referring to FIG. 1 , the student terminal 10 is located in a place (eg, each student's home) separated from the school or classroom.

The real robot 20 and the teacher terminal 30 may be located in an indoor space such as a classroom or auditorium of a school or an external space connectable to a router (local area network) (hereinafter, collectively referred to as an auditorium).

The teacher terminal 30 is located in the same place as the robot, and may be a teacher who conducts an actual robot coding class or an administrator (support) who supports it.

Referring to FIG. 1 , the student terminal 10 and the teacher terminal 30 may be connected to the server through a wired/wireless communication network. The wired/wireless communication network may include a wired mobile communication network, a wireless Internet network (LTE, 4G, 5G), and a short-distance wireless communication network such as Wi-Fi.

The real robot 20 and the teacher terminal 30 are connected to the Internet network through a router (local area network) installed in the auditorium, and can be assigned an internal IP address.

Referring to FIG. 2 , the student terminal 10 may include a processor 11 , a DB 12 , a communication unit 13 , a display unit 14 , and a block coding writing module 15 .

Referring to FIG. 3 , the real robot 20 includes, but is not limited to, a communication module 21 , a sensor module 22 , a control module 23 , and a driving module 24 .

Referring to FIG. 4 , the teacher terminal 30 includes a processor 31 , a DB 32 , a communication unit 33 , a display unit 34 , a real robot search module 35 , a control command transmission module 36 and It may include a real-time imaging and transmission module 37 .

Referring to FIG. 5 , the server 40 may include a processor 41 , a DB 42 , a communication unit 43 , a block coding providing module 44 , a simulation module 45 , and a robot operation module 46 . can

The educational system of the present invention may be conducted in the form of a game. For example, the teacher terminal 30 may open a robot coding training room on the application execution screen, and in this case, the type and number of robots to be used, the number of students to participate, and the like may be set.

A student (or a teacher) participating in the opened robot coding training room may select a virtual robot 50 matching any one of the plurality of real robots on the application execution screen.

Referring to FIGS. 2 and 7 , a virtual robot is displayed at the bottom of the display unit 14 of the student terminal 10 , and it is possible to show whether the virtual robot is selected for a specific student.

2 and 7 , the display unit 14 of the student terminal 10 displays a student and a teacher currently participating in the room ROOM, and a robot matching the teacher and the student (eg, robot 1). A button 141 that is called and displayed from the DB 12, a real-time chat window 142, and a button 143 that retrieves and displays the status (battery, posture, location) of the connected real robot from the DB 32 will be displayed. can

In addition, at the upper left of the display unit 14 of the student terminal, there is a display window that informs what state the current main screen represents (eg, whether the simulation 144 or the actual flight 145).

4 and 6 , the display unit 34 of the teacher terminal 30 displays a teacher and a student currently participating in the room ROOM, and a robot matching the student and the teacher (eg, robot 1). A button 341 that is retrieved and displayed from the DB 32, a real-time chat window 342, and a button 343 that retrieves and displays the state (battery, posture, position) of the real robot matched to the teacher terminal from the DB 32 ) may be displayed.

The display unit 34 of the teacher terminal 30 may display a button 344 for searching for a real robot located in an auditorium, etc., and a photographing button 345 for photographing a flight of the real robot.

In addition, at the upper left of the display unit 34 of the message terminal, there is a display window that informs what state the current main screen represents (eg, whether it is the simulation 346 or the actual flight 347 ).

2, 4, 8 and 9 , the plurality of student terminals or teacher terminals may write control commands for operating real drones and virtual drones selected on an application execution screen by block coding.

The block

coding writing modules

15 and 36 of the student terminal 10 or the teacher terminal 30 block commands (takeoff, XYZ axis movement, rotation, standby, synchronization, landing, etc.) in block coding display unit (147, 349) can be displayed, and the student can perform coding in the center of the display screen by dragging the command of the display unit (147, 349).

9 shows that block coding is in progress in the student terminal, and FIG. 8 shows that the block coding content of a specific student whose coding has been completed is displayed on the teacher terminal.

8 and 9 , in the present invention, in order to maximize the swarm flight effect, it is necessary to check the flight path of the other party and then code. can be checked

At the lower right of the display unit 14 of the student terminal, a button 146 (Ready) indicating that coding is completed may be displayed.

Referring to FIGS. 2 and 8 , the teacher terminal may search for a real drone accessible to the local area network and transmit whether the connection is made to the server.

For example, the robot is designed to respond to specific information (ID, serial information) to the Req packet command of UDP communication, and the real robot search module 35 of the teacher terminal uses the search button ( 344) is clicked, UDP transmits a request packet to the addresses other than the terminal IP address to the internal IP network, stores the internal IP address received from the responding robot in the DB, and the robot connected to the internal WIFI network The list can be grasped, and it can be transmitted to the server 40 .

Referring to FIG. 8, the real robot search module 35 displays whether the real drone is connected to the local area network and the confirmed internal IP address through a pop-up, and the virtual robot 50 on the display for the robot whose IP address is confirmed. can change the color of

Referring to FIG. 9 , the color of the virtual robot 50 may be changed for the robot whose IP address is also confirmed on the display unit of the student terminal.

The real robot may be a known robot capable of traveling or flying by receiving a block coding control command. The real robot may be a commercially available indoor flying drone. The virtual robot in the present invention means a robot driven online.

Referring to FIG. 4 , the real robot may include a communication module 21 , a sensor module 22 , a control module 23 , and a driving module 24 .

The communication module 21 communicates with the teacher terminal 30 . For example, the teacher terminal 30 may transmit a control command to the robot 20 using a UDP/IP communication channel method.

The sensor module 22 may include at least one sensor that transmits a position signal. For example, the sensor module 22 transmits/receives a signal to transmit the size, inclination, position of a feature point, etc. of a marker located on the floor of an indoor classroom to the control module, and the control module 23 is a robot in the room. You can create coordinates.

When the control module 23 receives a control command from the teacher terminal (block coding written in the student terminal), it can generate a control algorithm from the block coding and control the robot's operation according to the generated algorithm.

The driving module 24 may include a motor, a wheel, a propeller, a direction control device, etc. operated by a driving signal of the control module 23 .

The communication module 21 , the sensor module 22 , the control module 23 , and the driving module 24 may use known modules.

The real robot may further include a battery and a camera that takes an image in a specific direction according to a user setting.

1 and 5, the server receives the real robot control command written in the plurality of student terminals through a wired/wireless telecommunication network, and transmits the control command to the teacher terminal through the wired/wireless communication network.

The block coding providing module 44 of the server 40 searches for and finds a project corresponding to the corresponding class stage from the logged-in student/teacher information DB or receives a request for a project corresponding to the corresponding class stage from the teacher terminal, by project The block coding DB 423 may transmit a block matching the project to the student and teacher terminals.

In the simulation module 45 of the server 40, when the button 146 informing that block coding is completed is clicked from all student terminals participating in the class, and the simulation start (START) button 348 is clicked in the teacher terminal, By processing the block coding command received from the student terminal, the flight path (posture, speed, position) of the virtual robot corresponding to each command is calculated.

The simulation module 45 calculates a new flight path by putting the block coding control command received from the student terminal, reading the current virtual robot coordinates, and block coding control commands (posture, movement, and movement values) for each step into the robot control algorithm. and displaying a virtual robot to which a new flight path (posture, position, and speed) is applied on a 3D screen.

In the real robot operation module 46 of the server, a button 146 informing that block coding is completed is clicked from all student terminals participating in the class, and in the teacher terminal (in the same room as the real drone, in the same internal network) When the actual flight start (START) button 348 is clicked, the block coding control command received from the student terminal may be transmitted to the teacher terminal through the communication network.

The robot operation module 46 may receive a block coding control command for controlling the corresponding real robot from each student terminal, and transmit it to the teacher terminal in batch or sequentially. Information including block coding control commands between the server and the teacher terminal may be transmitted in a message transmission/reception method (ex: RPC) in a commercial GameNetwork (ex: SmartFox, Poton).

The control command transmission module 37 of the teacher terminal 30 transmits block coding control commands for a plurality of robots received from the server 40 to a plurality of real robots in batches or sequentially through a local area network (Wi-Fi). can A method of transmitting information from the teacher terminal to the real robot may be a UDP/IP protocol method.

The control command transmission module 37 receives a block coding control command for a plurality of robots from the server 40, matches the internal IP of each real robot with a block coding control command, and transmits the matched information to UDP/ It may include the step of transmitting to the robot in an IP manner.

As shown in FIG. 10 , the real-time shooting and transmission module 38 of the teacher terminal 30 may capture real-time operating conditions such as flight of the real robot with a camera and transmit it to the server. The server may transmit the captured image to the plurality of student terminals in real time.

In the above, the preferred embodiment of the present invention has been described in detail as an example, but this description merely describes and discloses an exemplary embodiment of the present invention. Those skilled in the art will readily recognize that various changes, modifications and variations can be made from the foregoing description and accompanying drawings without departing from the scope and spirit of the invention.

Claims

A plurality of student terminals running the robot education application;

A plurality of real robots located in a separate indoor space or an external space spaced apart from the student terminal;

A teacher terminal that executes the robot education application, is located in the same space as the plurality of real robots, and can be connected to the real robot through a local area network; and

A server that receives the real robot control command written in the plurality of student terminals through a wired/wireless telecommunication network, and transmits the control command to the teacher terminal through a wired/wireless communication network,

The teacher terminal is a remote robot coding education system, characterized in that for transmitting the control command received from the server to a plurality of real robots through a local area network.
The remote robot coding education system according to claim 1, wherein the teacher terminal or the plurality of student terminals selects a virtual robot that matches any one of the plurality of robots on the application execution screen.
The remote robot coding education system according to claim 2, wherein the plurality of student terminals write control commands for operating the real robot and the virtual robot selected on the application execution screen by block coding.
The remote robot coding education system according to claim 1, wherein the teacher terminal searches for a real robot that can be connected to the local area network, and transmits the connection status to the server.
[Claim 2] The remote robot coding education system according to claim 1, wherein the teacher terminal captures the real robot's operation status with a camera in real time and transmits it to a server, and the server transmits the real robot operation situation to the plurality of student terminals in real time.
According to claim 2, wherein the server receives a control command from the student terminal, processing the robot operation module, the remote robot coding education system, characterized in that calculating the posture and path of the real robot and the virtual robot according to time .
The method of claim 6, wherein the server provides a 3D execution screen for simulation to the teacher terminal and the student terminal, and applies the robot posture and path according to time to the virtual robot and displays it on the 3D execution screen Remote Robot Coding Training System.