KR20220146785A - Coding Education System through Artificial Intelligence and Robot - Google Patents

Abstract

The present invention relates to a coding education system through artificial intelligence and robots. A coding robot comprises: an embedded system with an OS capable of coding education on the robot platform and operating the robot at the same time; hardware for a robot drive unit regarding the drive of the robot, a lift unit, an arm unit, a hand unit, a camera unit, and a sensor unit; a method of integrating and providing a block-type graphic programming method and a method using a programming language for coding education; modules that can add robot-related hardware and software as needed from the basic module; software modules for artificial intelligence functions such as robot vision and recognition; a cloud server for speeding up and mass-producing intelligent functions of the internal robot system; smartphones, tablets, computers for software development and remote monitoring; and a coding robot service server to support and manage software resources of coding robots.

Description

Coding Education System through Artificial Intelligence and Robot

The present invention is a coding education system through artificial intelligence and robots, which are core technologies of the 4th industry.

It is a technology related to an artificial intelligence coding education robot suitable for coding education for people.

The Fourth Industrial Revolution is predicted to be the biggest revolution in human history since it was proposed at the World Economic Forum held in Davos in 2016.

It is an international concern.

In addition, almost all areas related to our lives, such as smartphones, automobiles, and home appliances, which will constitute the 4th industry

In the future hyper-connected era based on the Internet of Things (IoT), where there is already software in

The importance of SW is growing.

In response to this, in order to lead the future 4th industry globally, the UK has started coding education in 2014, and the US

is President Obama's "

With the advocacy of “computer science for all”, we are dedicated to coding education, and are

There is a trend in Korea to include coding education in regular education competitively.

In the case of Korea, in 2015, through the ‘Plan for nurturing talents for a software-oriented society’,

It plans to strengthen software education from elementary school to university.

According to the necessity of such coding education, various and step-by-step coding education platforms are required.

Coding education using robots increases learners' interest and interest in class activities in the development and application of integrated education programs.

It is effective in enhancing creative disposition through various learning experiences and improving basic scientific knowledge about robots.

It has been shown to have a high educational effect on the use of computers.

Therefore, there is an urgent need for a coding robot for coding education through artificial intelligence and robots, which are core technologies of the 4th industry.

The present invention is a modular coding education robot system that integrates artificial intelligence and robots, which are core technologies of the 4th industry.

It is to provide an artificial intelligence coding education robot suitable for coding education for people.

The present invention is to solve a problem that cannot be solved by conventional techniques.

A coding robot that integrates coding education, robot education, and artificial intelligence education is needed, but existing similar products and inventions do not

cannot provide

Existing coding education is based on microcontrollers or does not have multimedia functions such as cameras or microphones.

It does not include deep learning, artificial intelligence, cloud, mechanical robot functions, etc.

Education is impossible, and experiential education about relevance to the future 4th industry is impossible.

Another robot education company, Robotis and RoboRobo's product line consists of motion using a microcontroller.

In the case of RoboRobo and Provo products, it is still in rudimentary education without robot vision function or artificial intelligence function.

As a microcontroller-based education, only rudimentary robot movements are taught, and intelligent functions are not implemented in themselves.

Only the impossible basic education is possible.

The foreign company Lego's Minestorm also uses a microcontroller and has a sensor recognition function, but image processing and

Intelligent actions such as deep learning are impossible.

In the case of the foreign company Evollve's Ozobot, a small robot using a microcontroller,

The level of coding education that follows is possible.

In the case of an interactive coding education product (Albert) in Korea, it is input into the robot using a card and the processing result is displayed as sound, etc.

It can be shown, but there is no visual function using a camera, artificial intelligence connection function, etc.

There is a big difference from the coding education robot.

The intelligent coding education robot of the present invention has a camera and a microphone while there is no big difference in price with existing educational equipment.

The convergence and connection of the 4th industry by strengthening the learning function through the connection of multimedia such as online cloud and artificial intelligence, etc.

A differentiated coding school that offers coding education, robot education, and artificial intelligence education that can provide step-by-step education for formation

It is a land robot and an invention to solve it.

The present invention in configuring a coding robot for coding education through artificial intelligence and robots,

An embedded system with an OS that can teach coding on the robot's platform and operate the robot at the same time,

Regarding the operation of the robot, it consists of a robot driving part, a lift part, an arm part, a hand part, a camera part, a sensor part, etc.

A method of integrating and providing a block-type graphic programming method and a method using a programming language for coding education;

Modules that can add robot-related hardware and software as needed from the basic module,

Software modules for artificial intelligence functions such as robot vision and recognition,

Cloud server for speeding up and mass-producing the intelligent function of the internal robot system,

Smartphone tablet computer for software development and remote monitoring;

Coding robot service server for support and management of software resources of coding robot,

It relates to a coding robot composed of

In the present invention, in order to configure a coding robot for coding education through artificial intelligence and robots,

Using an embedded system with an OS that can teach coding on the robot's platform and operate the robot at the same time

do.

For this purpose, a low-cost OS platform such as the Raspberry Pi is used.

With respect to the driving of the robot, it consists of a robot driving unit, a lift unit, an arm unit, a hand unit, a camera unit, a sensor unit, and the like.

A method of using block-type graphic programming methods and software modules using programming languages for coding education.

use the law

For this, for example, as a programming language, Python-based coding education SW module development, it is modularized into functions in a platform-independent, interpreter-type, object-oriented, dynamically typed interactive language, and a block-type graphic program.

By modularizing intelligent functions using the scratch-based coding education software module, which is a programming method, students can

make it easy to use.

The hardware and software related to the robot are modularized into a hardware module and a software module, and the basic module

It uses a modular approach that can be added accordingly.

For this, focusing on the platform module, the visual part, the sensor part, the listening part, the driving part, the robot arm part, the robot hand part, the lift part, etc.

It consists of hardware-software modularization.

It makes it easy to utilize software modules for AI functions.

To this end, by importing the PiCamera library by developing a vision coding module based on camera and image recognition algorithm,

It enables input and modularizes the image processing function provided by OpenCV to implement the Python-based library module.

forgiving,

Deep learning using Tensor Flow provided by Google for developing artificial intelligence cloud-connected coding modules

Python application programming interface (API) is used for modules that can use and machine learning techniques.

A cloud server is used to speed up and mass-produce the intelligent functions of the internal robot system.

Smartphones and tablets are used for software development and remote monitoring.

The server for coding robot service is used for the support and management of the coding robot's software resources and service management.

The coding education robot of the present invention can be used as equipment for coding education, which is a national task from elementary, middle, high school to adults.

All.

In addition, by creatively developing the coding of the robot and the results of its implementation in the robot,

It can act as a bot, game robot, service robot, etc.

It is used as a textbook for college education by college students, and is used as a teaching aid for classes such as robots, embedded systems, artificial intelligence, and multimedia.

can do.

In particular, advanced AI functions such as deep learning and robot vision can be practiced and utilized.

By developing a library of intelligent modules that do not exist in existing coding tools, we go beyond simple coding to create robot vision.

By adding artificial intelligence libraries such as recognition functions and deep learning, it is possible to provide artificial intelligence coding education in the 4th industry both in name and reality.

make it

In addition, it includes intelligent modules such as vision recognition function or deep learning and automatically connects it with the robot platform to learn

By having students code based on a robot, they can learn the latest cutting-edge AI functions while doubling their interest.

These robots can be used for home use and contribute to the development of the robot industry by serving as information home intelligent home appliances.

have.

In addition, as a robot that is used for both coding education and service robots, it will strengthen national competitiveness in related fields in the global market.

can see

A coding robot for coding education through artificial intelligence and robots of the present invention will be described with drawings.

1 is a block diagram of a coding robot of the present invention. The coding robot control unit built into the coding robot is largely divided into an intelligent unit, a driving unit,

divided into communication departments.

The intelligence unit is a part that operates the intelligence of the robot, and the visual unit connected to the camera and the sensor connected to the sensor

West, the listening part connected to the microphone, the ignition part connected to the speaker, and objects connected to them to make intelligent judgment

An object recognition unit for recognizing the environment, an environment recognition unit for recognizing and moving or judging the environment, and voice recognition and voice recognition

It is composed of a voice processing unit for intelligent processing in utterance.

The driving unit is a driving unit responsible for movement by the wheels of the lower part of the robot, raising or lowering the key of the robot to a high position or low

The role of the lift part to recognize or process the object in the position, the robot arm part to operate the robot's arm, and the robot's hand

It is composed of a hand part that is

The communication unit is connected to the intelligent unit and the driving unit, and a smart terminal such as a smart phone,

It communicates with the service server for software management of Ding Robot, and the cloud for various intelligent functions and high-speed processing.

The smart terminal is a smart phone tablet computer for software development of the coding robot and remote monitoring of the robot.

use it

The service server is a server for supporting and managing software resources of the coding robot.

2 is a block diagram showing the coding robot system of the present invention. The drive part is at the bottom end, and the lift part is above it.

and a vision part and a robot arm robot hand part are attached thereon. The platform of the coding robot is a smart terminal,

The service server communicates with the cloud.

3 is an example of implementing the coding robot system of the present invention. It is a result of partially implementing the function of FIG. 2 .

4 shows the platform of the coding robot system.

Using an embedded system with an OS that can teach coding on the robot's platform and operate the robot at the same time

do.

For this purpose, a low-cost OS platform such as Raspberry Pi is used as shown in FIG. 4 .

The Raspberry Pi platform provides a computing environment similar to a general desktop by simply connecting a keyboard, mouse, and monitor.

There is an advantage of being able to train coding on the bot itself.

OS uses Linux OS to connect a monitor through HDMI and uses SD memory as secondary memory,

It utilizes Ethernet communication and uses an extended WiFi module through USB for wireless communication.

In addition, multimedia and sensors using the built-in camera module, microphone module, speaker module and various sensor modules

Utilize the actuator data input/output function.

5 shows a connection state for coding robot training. The result of configuring the coding robot platform with Raspberry Pi is

All. The Raspberry Pi is a small, low-cost platform, but it is directly connected to the monitor, mouse and keyboard, and wired and wireless networks.

connected to the router, etc.

For coding education, the block-type graphic programming coding method and the coding method using a programming language are integrated and provided.

All.

6 is an example of a coding education environment using Python, which is an example of a programming language.

In the case of coding using a programming language,

For example, the Python-based coding education SW module is platform-independent, interpreter-type, object-oriented, and dynamic typing.

(dynamically typed) Since it is an interactive language, it is modularized into functions using its characteristics.

Python is a programming language that anyone can use as a scripter type (Programming language for everyone), and it is a language with great advantages for beginner coding education.

By simplifying the various intelligent functions of the present invention, students can use the functions to easily activate video and artificial intelligence functions.

make it available

Various functions of the intelligence unit are processed using Pythn-based OpenCV library, image processing and robot vision processing, and intelligent

To enable object recognition.

It is modularized to enable deep learning processing using Tensorflow for the object recognition unit and the environment recognition unit voice processing unit.

Users can easily use image recognition, voice recognition, and deep learning functions.

7 is an example of a coding process using Scratch, which is a block-type graphic programming tool.

For block-type graphic coding,

Smart using scratch-based coding education SW module development to create modules

By modularizing the functions, students can use them easily. In addition to the existing Scratch module, the Raspberry Pi

By adding modules related to motion and robot motion, camera image recognition, and deep learning processing, it is possible to code the robot motion.

All.

Block-type graphic coding provides various functions of the intelligence unit by modularizing them into blocks, so elementary, middle and high school students or beginners of coding

Even in the case of , it provides an excellent function that can take and utilize the blocked module.

Use modules that can add robot-related hardware and software as needed from the basic module. hardware

A-software integration module takes the method of adding to the basic module.

To this end, the basic module consists of a visual part, a sensor part, and an environment recognition part connected thereto among the intelligence parts of the coding robot control part.

The driving unit is composed of a driving unit, a communication unit, and the like. It is integrated with hardware such as drive base, camera, and sensor.

is composed

If a voice processing function is added here, the hardware of the microphone and speaker, the voice processing unit of the intelligence unit, and the speech unit of the listening unit are included.

Included hardware-software modules are added.

If a lift function is added here, the lift hardware and the lift part of the coding robot control unit are integrated and added.

If a robot arm and a robot hand are added here, the hardware of the robot arm and hand, and the robot hand part and the robot arm part of the driving part

The software is integrated and added.

It makes it easy to utilize software modules for AI functions.

Artificial intelligence is largely related to the visual function, which is the object recognition part and the environment recognition part, and for this, a camera and image recognition algorithm are used.

is constructed using For example, to configure the visual part, the camera is a PiCamera attached to the Raspberry Pi and a corresponding

can be used by importing the library. Also, in order to implement the image processing algorithm, OpenCV provides

is configured by importing the image processing library and utilizing it in Python.

The artificial intelligence function uses the connected library of various clouds. For example, Google's TensorFlow

Flow) to compose a module that can use deep learning and machine learning techniques.

A cloud server is used to speed up and mass-produce the intelligent functions of the internal robot system. For example, deep in artificial intelligence

As for learning, you can use deep learning and machine learning techniques using Tensor Flow provided by Google.

Configure the existing module as an application using Python.

For example, for the speech recognition function, a deep learning neural network is used to use the Cloud Speeech API provided by Google.

It uses an algorithm and consists of functions that support 80 languages around the world. Also a syntactic parser, Link

It is constructed using a syntax analyzer such as Grammar Parser. Link Grammar Parser parses the results expressed in sentences.

It is divided into phrase units by enemy parsing, and from the result of division of phrase units, the verb is first separated from the verb phrase (VP), and the

It is composed of a function to interpret commands by dividing the noun phrases (NP) corresponding to the writing down and focusing on the arguments.

Claims (1)

In composing a coding robot for coding education through artificial intelligence and robots,
Embedded system with an OS that can teach coding on the robot's platform and can operate the robot at the same time;
With respect to the driving of the robot, hardware includes a robot driving unit, a lift unit, an arm unit, a hand unit, a camera unit, a sensor unit, and the like;
A method for integrating and providing a block-type graphic programming method and a method using a programming language for coding education;
Modules that can add robot-related hardware and software as needed from the basic module;
software modules for artificial intelligence functions such as robot vision and recognition;
Cloud server for speeding up and massing the intelligent functions of the internal robot system;
Smartphone tablet computer for software development and remote monitoring; and
A coding robot including a coding robot service server for supporting and managing software resources of the coding robot.