KR20210001412A - System and method for providing learning service - Google Patents

Abstract

According to the present invention, disclosed are a learning service system and a method thereof. According to one aspect of the present invention, a terminal device includes: a communication part communicating with a learning service server through a communication network; a photographing part obtaining a workbook page image by photographing a workbook containing units and at least one question on each page; an output part; and a control part dividing the workbook page image obtained through the photographing part into a plurality of areas, thereby extracting a page and unit information area and a question number area, extracting a page number, unit and question numbers by performing OCR processing with respect to the page and unit information area and the question number area, transmitting a question solution information request signal including the page number, the unit and the question numbers to the learning service server through the communication part, and outputting question solution information received from the learning service server through the output part. The question solution information can be augmented reality question solution content including answer and explanation data.

Description

Learning service system and method {SYSTEM AND METHOD FOR PROVIDING LEARNING SERVICE}

The present invention relates to a learning service system and method, and more particularly, by analyzing a problem book page image to extract a page number, a unit, and a question number, and extract the answer and explanation data corresponding to the extracted page number, unit and question number. It relates to a learning service system and method capable of outputting an augmented reality image.

When students or test takers study, read and understand or memorize the contents to be studied, solve the problem book corresponding to the contents to check the study contents, and organize the wrong contents in an incorrect answer notebook to refer to the next study. The method is generally used a lot.

Each study method has its strengths and weaknesses, but the disadvantage of the above method is that it must be performed only by reading the explanations of all problems with the eyes, so the ability to leave a long memory in the user's memory is lower than that of using all audiovisual methods. It takes a lot of time and effort to write notes.

On the other hand, in order to learn using both audio-visual and audiovisual, the method of listening to a lecture through a school or academy is the best, but this method cannot be taken at a time desired by the user, and the user must match the timetable of the school or academy. There is a disadvantage of being inconvenient in that you have to visit a school or academy.

Recently, a lot of lectures through the Internet are active, but in this method, users can not only listen to the part they want to listen to while solving problems, but the entire part must be listened to regardless of the part that the user wants. In order to view the video, it was inconvenient to play the video and then move the playback bar to find the desired part.

Accordingly, when a learner solves a problem book, there is a need for technology development for a learning service that can easily provide answers and explanation data for problems requiring problem solving information.

As a prior art related to the present invention, there is Korean Patent Application Publication No. 2010-0014019.

The present invention was conceived to improve the above problems, and an object of the present invention is to extract a page number, a unit and a problem number by analyzing a problem book page image captured by a learner's terminal device, and extract the extracted page number and unit. And it is to provide a learning service system and method capable of outputting the answer and commentary data corresponding to the problem number as an augmented reality image.

The problem to be solved by the present invention is not limited to the problem(s) mentioned above, and another problem(s) not mentioned will be clearly understood by those skilled in the art from the following description.

A terminal device according to an aspect of the present invention includes a communication unit that communicates with a learning service server through a communication network, a photographing unit for obtaining an image of a problem book page by photographing a problem book in which a unit and at least one problem are displayed for each page, By dividing the problem book page image acquired through the photographing unit into a plurality of areas, extracting the page and unit information area and the problem number area, and performing OCR processing on the page and unit information area and the problem number area, the page number, Extracts the unit and problem number, transmits a problem solving information request signal including the page number, unit, and problem number to the learning service server through the communication unit, and outputs the problem solving information received from the learning service server. Including a control unit outputting through the unit, the problem solving information may be problem solving augmented reality content including an answer and explanation data.

In the present invention, the controller may execute the problem solving augmented reality content, and output an augmented reality image for transmitting the answer and explanation data together with the obtained problem book page image through the output unit.

A learning service server according to another aspect of the present invention includes a communication unit that communicates with a terminal device through a communication network, a problem solving DB in which answers and explanation data for each unit and problem number are stored, and problem solving from the terminal device through the communication unit. When an information request signal is received, a control unit for extracting a corresponding answer and explanation data from the problem solving DB and providing the extracted answer and explanation data to the terminal device through the communication unit.

In the present invention, the control unit may generate a problem solving augmented reality content including the extracted answer and commentary data and provide it to the terminal device.

In the present invention, the control unit, when receiving a problem solving information request signal including a page number, a unit and a problem number from the terminal device, the answer corresponding to the page number, the unit and the problem number from the problem solving DB And the explanatory data may be extracted and provided to the terminal device.

In the present invention, the control unit, when receiving a problem solving request signal including a problem book page image from the terminal device, divides the problem book page image into a plurality of areas, and separates the page and unit information area and the problem number area. Extract, and perform OCR processing on the page and unit information area and question number area to extract page number, unit and question number, and answer and comment corresponding to the page number, unit, and question number from the problem solving DB Data can be extracted and provided to the terminal device.

A learning service method according to another aspect of the present invention includes the step of obtaining, by a terminal device, an image of a problem book page by photographing a problem book in which a unit and at least one problem are displayed for each page, and the terminal device Dividing into a plurality of areas and extracting a page and unit information area and a problem number area, the terminal device performing OCR processing on the page and unit information area and problem number area to obtain a page number, unit, and problem number Extracting, by the terminal device, transmitting a problem solving information request signal including the page number, unit, and problem number to a learning service server, wherein the learning service server includes the page number, unit, and problem number And acquiring and providing the corresponding answer and commentary data to the terminal device, and outputting the answer and commentary data by the terminal device.

In the present invention, in the step of outputting the answer and commentary data, the terminal device may output the answer and commentary data as an augmented reality image.

In a learning service method according to another aspect of the present invention, a terminal device acquires a problem book page image by photographing a problem book in which a unit and at least one problem are displayed for each page, and problem solving including the obtained problem book page image. Transmitting an information request signal to a learning service server, the learning service server dividing the problem book page image into a plurality of regions, and extracting a page and unit information region and a problem number region, the learning service server, Extracting a page number, a unit, and a question number by performing OCR processing on the page and unit information area and the question number area, the learning service server, answer and commentary data corresponding to the page number, unit and question number Acquiring and providing it to the terminal device, and outputting the answer and commentary data by the terminal device.

In the present invention, in the step of outputting the answer and commentary data, the terminal device may output the answer and commentary data as an augmented reality image.

According to the present invention, by analyzing a problem book page image captured by a learner's terminal device, extracting the page number, unit, and problem number, and outputting the answer and explanation data corresponding to the extracted page number, unit and problem number, Can provide personalized learning.

In addition, according to the present invention, since problem solving information for a problem in the problem book is provided as an augmented reality image, there is an advantage that offline learning and online learning through printed materials can be linked.

Meanwhile, the effects of the present invention are not limited to the above-mentioned effects, and various effects may be included within a range that will be apparent to a person skilled in the art from the contents to be described below.

1 is a diagram illustrating a learning service system according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a terminal device according to an embodiment of the present invention.
3 is a functional block diagram for explaining the function of the control unit shown in FIG. 2.
4 is an exemplary diagram for explaining an image of a problem collection page according to an embodiment of the present invention.
5 is a block diagram showing the configuration of a learning service server according to an embodiment of the present invention.
6 is a diagram illustrating a method of providing a learning service according to an embodiment of the present invention.

Hereinafter, a learning service system and method according to an embodiment of the present invention will be described with reference to the accompanying drawings. In this process, the thickness of the lines or the size of components shown in the drawings may be exaggerated for clarity and convenience of description.

In addition, terms to be described later are terms defined in consideration of functions in the present invention and may vary according to the intention or custom of users or operators. Therefore, definitions of these terms should be made based on the contents throughout the present specification.

In addition, the implementation described herein may be implemented in, for example, a method or process, an apparatus, a software program, a data stream or a signal. Although discussed only in the context of a single form of implementation (eg, only as a method), the implementation of the discussed features may also be implemented in other forms (eg, an apparatus or program). The device may be implemented with appropriate hardware, software and firmware. The method may be implemented in an apparatus such as a processor, which generally refers to a processing device including, for example, a computer, microprocessor, integrated circuit or programmable logic device, or the like. Processors also include communication devices such as computers, cell phones, personal digital assistants ("PDAs") and other devices that facilitate communication of information between end-users.

1 is a diagram illustrating a learning service system according to an embodiment of the present invention.

1, a learning service system according to an embodiment of the present invention includes a terminal device 100 and a learning service server 200 for photographing a problem book 10 in which a unit and at least one problem are printed for each page. Include. In this case, the terminal device 100 and the learning service server 200 may communicate with each other through a communication network.

The problem book 10 may be a document in which a unit and at least one problem are printed for each page, as shown in FIG. 4A.

The learner may take a picture of each page using the photographing unit 130 of the terminal device 100 in order to receive problem solving information including answers to the problems of the problem book 10 and explanation data. At this time, the photographed image may be referred to as a problem book page image, and the problem book page image includes a page unit information area 410 and a problem information area 420 in which the page number and unit name are displayed as shown in FIG. 4A. Can include. The problem information area 420 may include at least one problem area 430, and each problem area 430 may include a problem number area 432 in which a problem number is displayed and a problem display area 434 in which a problem is displayed. .

The terminal device 100 divides the problem book page image acquired through the photographing unit 130 into a plurality of areas, extracts the page and unit information area and the problem number area, and extracts the page and unit information area and the problem number area. The OCR process is performed to extract the page number, the unit and the problem number, and transmits a problem solving information request signal including the page number, the unit and the problem number to the learning service server 200.

The terminal device 100 outputs problem solving information including an answer and commentary data received from the learning service server 200. In this case, the problem solving information may be problem solving augmented reality contents including an answer and explanation data, and the terminal device 100 may execute problem solving augmented reality contents. The terminal device 100 executes the problem solving augmented reality content to output the image of the problem book 10 by augmenting and outputting a virtual object, for example, a 3D graphic model on the image of the problem book page image captured by the photographing unit 130. Based on the augmented reality service can be provided.

A detailed description of the terminal device 100 will be referred to FIG. 2.

When the learning service server 200 receives a problem solving information request signal including a page number, a unit, and a problem number from the terminal device 100, the terminal device 100 obtains the answer and explanation data corresponding to the page number, the unit, and the problem number. Provided to the device 100. At this time, the learning service server 200 may generate a problem solving augmented reality content including an answer and an explanation data and provide it to the terminal device 100.

A detailed description of the learning service server 200 will be made with reference to FIG. 5.

FIG. 2 is a block diagram showing the configuration of a terminal device according to an embodiment of the present invention, FIG. 3 is a functional block diagram for explaining the function of a control unit shown in FIG. 2, and FIG. 4 is a block diagram showing the configuration of a terminal device according to an embodiment of the present invention. This is an example diagram for explaining the image of the problem book page.

Referring to FIG. 2, a terminal device 100 according to an embodiment of the present invention includes a communication unit 110, a storage unit 120, a photographing unit 130, an output unit 140, and a control unit 150. .

The communication unit 110 is a configuration for communication with the learning service server 200 through a communication network, and may transmit and receive various information such as a problem book page image acquired through the photographing unit 130. In this case, the communication unit 110 may be implemented in various forms such as a short-range communication module, a wireless communication module, a mobile communication module, and a wired communication module.

The storage unit 120 is a component that stores data related to the operation of the terminal device 100. Here, the storage unit 120 may use a known storage medium, and for example, any one or more of known storage media such as ROM, PROM, EPROM, EEPROM, and RAM may be used. In particular, the storage unit 120 drives the photographing unit 130 to obtain a problem book page image, analyzes the problem book page image to extract a page number, a unit, and a problem number, and the extracted page number, unit, and problem number A problem-solving application that can output problem-solving information including an answer corresponding to and explanation data may be stored.

The photographing unit 130 photographs a problem book to obtain a problem book page image, and transmits the obtained problem book page image to the controller 150. The photographing unit 130 may be, for example, a camera. The photographing unit 21 may perform an automatic photographing command by a recognition program of the problem solving application.

The output unit 140 is a component that displays various information related to the operation of the terminal device 100. In particular, when the problem solving application is executed, the output unit 140 may display a problem book page image obtained through the photographing unit, and may display problem solving information received through the communication unit. The output unit 140 may also operate as an input unit for receiving information from a user.

The control unit 150 divides the problem book page image obtained through the photographing unit 130 into a plurality of areas, extracts the page and unit information area and the problem number area, and provides OCR for the page and unit information area and the problem number area. The processing is performed to extract the page number, unit, and problem number, and transmits a problem solving information request signal including the page number, unit and problem number to the learning service server 200 through the communication unit 110, and the learning service server The problem solving information received from 200 is output through the output unit 130. At this time, the problem solving information may include an answer and explanation data. In addition, the problem solving information may be problem solving augmented reality content including an answer and explanation data. In this case, the controller 150 renders a virtual object that transmits the problem solving information, for example, a 3D graphic model, and the output unit 140 ) Can be printed.

On the other hand, when the problem book 10 is an offline book, when the problem book 10 is opened and photographed, an image with inclination or distortion may be obtained. Accordingly, the control unit 150 may perform preprocessing such as noise removal before dividing the problem book page image into a plurality of regions. For example, the control unit 150 detects blurring and edges. By performing pre-processing such as binarization and morphology operation, noise of the problem book page image can be removed.

As shown in FIG. 3, the control unit 150 includes a page and unit recognition unit 152, a problem number recognition unit 154, and a problem solving information request processing unit 156.

The page and unit recognition unit 152 divides the problem book page image, extracts a page and unit information area, and performs OCR processing on the page and unit information area to extract a page number and unit name.

Specifically, the page and unit recognition unit 152 extracts a page and unit information area containing information on the page number and unit name by applying an image segmentation technique from the entire problem book page image. Here, image segmentation is a technology that separates one image for each object of interest, and the page and unit recognition unit 152 is based on information previously learned through a neural network model of a machine learning algorithm, The page where the unit name is displayed and the unit information area can be extracted. In this case, the neural network model may include various neural network models such as Mobile Net and Shuffle Net.

When the page and unit information area is extracted, the page and unit recognition unit 152 extracts the text contained in the page and unit information area through OCR processing on the page and unit information area, and the characters constituting the extracted text and By identifying numbers, etc., page numbers and unit names can be extracted.

For example, a case where the page number and the unit name are extracted from the problem book page image as shown in FIG. 4A will be described. The page and unit recognition unit 152 may extract the page and unit information area 410 as shown in FIG. 4B by using the neural network model. When OCR processing is performed on the page and unit information area 410, the unit name of "1. Number of cases" and the page number of "007" may be extracted.

The problem number recognition unit 154 divides the problem book page image, extracts at least one problem area, and extracts a problem number area in which the problem number is displayed in each problem area using multiple object detection. The problem number is extracted by performing OCR processing on the problem number area.

Specifically, the problem number recognition unit 154 applies an image segmentation technique from the entire problem book page image to extract at least one problem area having information on the problem number and problem content. In this case, the problem number recognition unit 154 may extract at least one problem region from an image of a problem book page based on information previously learned through a neural network model of a machine learning algorithm. In this case, the neural network model may include various neural network models such as Mobile Net and Shuffle Net.

When at least one problem area is extracted, the problem number recognition unit 154 applies a multi-object detection technique to the problem area to extract a problem number area in which the problem number is displayed. Here, object detection is a technology that detects the existence and location of an object of interest in an image, and the problem number recognition unit 154 is based on information previously learned through a neural network model of a machine learning algorithm, The problem number area in which the problem number is displayed can be extracted from. In this case, the neural network model may include various neural network models such as Mobile Net and Shuffle Net.

When the problem number area is extracted, the problem number recognition unit 154 extracts the text included in the problem number area through OCR processing on the problem number area, and identifies letters and numbers constituting the extracted text, and Can be extracted.

For example, a case of extracting a problem number using the problem collection page image as shown in FIG. 4A will be described. The problem number recognition unit 154 may extract a plurality of problem number regions 432 as shown in FIG. 4C by using the neural network model. When OCR processing is performed on the problem number area 410, the problem number of "0045" can be extracted.

The problem solving information request processing unit 156 transmits a problem solving information request signal including a page number, a unit, and a problem number to the learning service server 200 through the communication unit 110. At this time, when a plurality of problem numbers are extracted from one page, the problem solving information request processing unit 156 includes the plurality of problem numbers in the problem solving information request signal, or problems one by one in order from lowest to highest. It can be transmitted by including it in the solution information request signal. In addition, when a plurality of problem numbers are extracted from one page, the problem solving information request processing unit 156 outputs the extracted problem numbers to the output unit 140, and the problem number selected by the learner is sent to the problem solving information request signal. You can also include and send.

The problem solving information request processing unit 156 outputs the problem solving information received from the learning service server 200 through the output unit 140 in response to the problem solving information request. At this time, the problem solving information may include an answer and explanation data. In addition, the problem solving information may be problem solving augmented reality content including an answer and explanation data.

When the problem solving information is an augmented reality content, the problem solving information request processing unit 156 executes the augmented reality content received from the learning service server 200 and transmits the problem solving information to the image acquired through the photographing unit 130 A virtual object, for example, a 3D graphic model may be augmented and output to the output unit 130.

The control unit 150 may include at least one operation unit, wherein the operation unit is a general-purpose central operation unit (CPU), a programmable device element (CPLD, FPGA) implemented for a specific purpose, and a custom semiconductor operation. It can be a device (ASIC) or a microcontroller chip.

On the other hand, the terminal device 100 configured as described above includes a photographing unit 130 and an output unit 140, and as a terminal on which an application is installed and executed, it is possible to take an image of a test paper and can be applied to various wired and wireless environments. It may be an electronic device. For example, the terminal device 100 includes a PDA (Personal Digital Assistant), a smart phone, a cellular phone, a PCS (Personal Communication Service) phone, a GSM (Global System for Mobile) phone, a W-CDMA (Wideband CDMA) phone, and a CDMA-2000. Phones and MBS (Mobile Broadband System) phones are included. Herein, the terminal device 100 may represent a small portable device, but in the case of including a camcorder or a laptop computer, it may be referred to as a mobile communication terminal, and thus the embodiment of the present invention will not be particularly limited thereto.

5 is a block diagram showing the configuration of a learning service server according to an embodiment of the present invention.

Referring to FIG. 5, a learning service server 200 according to an embodiment of the present invention includes a communication unit 210, a problem solving DB 220, and a control unit 230.

The communication unit 210 receives a problem solving information request signal from the terminal device 100 and provides the problem solving information to the terminal device 100.

In the problem solving DB 220, answers and explanation data for the unit and question number are stored for each page. In this case, the problem solving DB 200 may store a matching relationship between a page number, a unit, and an answer corresponding to the question number and explanation data. To this end, the problem solving DB 220 may be a relational database, but an embodiment of the present invention may not be limited thereto.

In addition, the problem solving information stored in the problem solving DB 220 may include information on a virtual object that is rendered in the augmented reality content and transmits the problem solving information in an audio or text format. For example, it may include information on a 3D character who teaches a problem solving method.

When the control unit 230 receives a problem solving information request signal including a page number, unit, and problem number from the terminal device 100 through the communication unit 210, the corresponding answer and explanation data are extracted from the problem solving DB 220 Thus, it is provided to the terminal device 100 through the communication unit 210. In this case, the controller 230 may generate a problem solving augmented reality content including an answer and explanatory data and provide it to the terminal device 100.

In addition, when a plurality of problem numbers are included in the problem solving information request signal, the controller 230 may extract the corresponding answer and explanation data from lowest to highest, and sequentially provide them to the terminal device 100.

This control unit 230 is a component that controls the operation of various components of the learning service server 200, and may include at least one computing device, wherein the computing device is a general-purpose central computing unit (CPU), a specific It may be a programmable device device (CPLD, FPGA), an application-specific semiconductor processing unit (ASIC), or a microcontroller chip implemented suitably for the purpose.

6 is a diagram illustrating a learning service method according to an embodiment of the present invention.

Referring to FIG. 6, the terminal device 100 acquires a problem book page image by photographing a problem book in which a unit and at least one problem are displayed for each page (S610).

When step S610 is performed, the terminal device 100 divides the problem book page image into a plurality of areas, extracts the page and unit information area (S620), and performs OCR processing on the page and unit information area, The unit is extracted (S630). In this case, the terminal device 100 may extract a page and a unit information area using an image segmentation technique.

When step S640 is performed, the terminal device 100 divides the problem book page image into a plurality of areas, extracts the problem number area (S640), and extracts the problem number by performing OCR processing on the problem number area (S650). ). In this case, the terminal device 100 may extract the problem number area using image segmentation technology and object detection technology.

Meanwhile, in the present embodiment, after extracting the page number and the unit, it has been described that the problem number is extracted, but after the problem number is extracted, the page number and the unit may be extracted.

When step S650 is performed, the terminal device 100 transmits a problem solving information request signal including a page number, a unit, and a problem number to the learning service server 200 (S660).

Then, the learning service server 200 acquires problem solving information corresponding to the page number, the unit, and the problem number (S670), and transmits it to the terminal device 100 (S680). Here, the problem solving information may include an answer and explanation data.

When step S680 is performed, the terminal device 100 outputs the problem solving information as an augmented reality image (S690). That is, when the problem solving information is an augmented reality content, the terminal device 100 executes the augmented reality content received from the learning service server 200 and transmits the problem solving information to the image acquired through the photographing unit, for example, , 3D graphic models can be augmented and output.

Meanwhile, in an embodiment of the present invention, the terminal device 100 requests problem solving information from the learning service server 200 by extracting the page number, unit, and problem number from the problem book page image, and the learning service server 200 It has been described that the solution information is provided to the terminal device 100, but in another embodiment, the terminal device 100 transmits the problem book page image to the learning service server 200, and the learning service server 200 The page number, unit, and problem number may be extracted, and problem solving information may be provided to the terminal device 100.

In another embodiment of the present invention, the terminal device 100 acquires a problem book page image through the photographing unit 130 and transmits a problem solving information request signal including the obtained problem book page image through the communication unit 110. It is transmitted to the server 200.

The learning service server 200 divides the problem book page image into a plurality of areas, extracts the page and unit information area and the problem number area, and performs OCR processing on the page and unit information area and the problem number area, The unit and the problem number are extracted, and the corresponding answer and explanation data are extracted from the problem solving DB and provided to the terminal device 100 through the communication unit 210. At this time, the learning service server 200 may generate a problem solving augmented reality content including an answer and an explanation data and provide it to the terminal device 100.

The terminal device 100 outputs the problem solving information received from the learning service server 200 through the output unit 140. At this time, the problem solving information may include an answer and explanation data. In addition, the problem solving information may be problem solving augmented reality content including an answer and explanation data. In this case, the terminal device 100 may render and output a virtual object that transmits problem solving information, for example, a 3D graphic model. have.

As described above, in the learning service system and method according to an embodiment of the present invention, a page number, a unit, and a problem number are extracted by analyzing a problem book page image captured by a learner's terminal device, and the extracted page number and unit And by outputting the answer and commentary data corresponding to the question number, it is possible to provide personalized learning.

In addition, according to the learning service system and method according to an embodiment of the present invention, since problem solving information on the problem in the problem book is provided as an augmented reality image, it is advantageous in that offline learning and online learning through printed matter can be linked. have.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is only illustrative, and those of ordinary skill in the field to which the technology pertains, various modifications and other equivalent embodiments are possible. I will understand.

Therefore, the true technical protection scope of the present invention should be determined by the following claims.

100: terminal device
110, 210: Ministry of Communication
120: storage
130: photographing department
140: output
150, 230: control unit
152: page and unit recognition unit
154: problem number recognition unit
156: Problem solving information request processing unit
200: service server
220: Problem solving DB

Claims (10)

A communication unit that communicates with the learning service server through a communication network;
A photographing unit that photographs a problem book in which a unit and at least one problem are displayed for each page, and obtains a problem book page image;
Output section; And
By dividing the problem book page image acquired through the photographing unit into a plurality of areas, extracting the page and unit information area and the problem number area, and performing OCR processing on the page and unit information area and the problem number area, the page number, Extracts the unit and problem number, transmits a problem solving information request signal including the page number, unit, and problem number to the learning service server through the communication unit, and outputs the problem solving information received from the learning service server. Including a control unit to output through the unit,
The terminal device, wherein the problem solving information is a problem solving augmented reality content including an answer and explanation data.
The method of claim 1,
The control unit,
A terminal device, characterized in that, by executing the problem solving augmented reality content, outputting an augmented reality image for transmitting the answer and commentary data together with the acquired problem book page image through the output unit.
A communication unit that communicates with a terminal device through a communication network;
Problem solving DB storing answer and explanation data for each unit and question number; And
When a problem solving information request signal is received from the terminal device through the communication unit, a control unit that extracts the corresponding answer and explanation data from the problem solving DB and provides it to the terminal device through the communication unit
Learning service server comprising a.
The method of claim 3,
The control unit,
A learning service server, characterized in that the problem solving augmented reality content including the extracted answer and explanation data is generated and provided to the terminal device.
The method of claim 3,
The control unit,
When receiving a problem solving information request signal including a page number, a unit, and a problem number from the terminal device, the terminal device extracts the answer and explanation data corresponding to the page number, unit, and question number from the problem solving DB. Learning service server, characterized in that provided to.
The method of claim 3,
The control unit,
When a problem solving request signal including a problem book page image is received from the terminal device, the problem book page image is divided into a plurality of areas to extract a page and unit information area and a problem number area, and the page and unit information area Extracts page number, unit, and question number by performing OCR processing on the problem number area and extracts answer and explanation data corresponding to the page number, unit, and question number from the problem solving DB and provides it to the terminal device. Learning service server, characterized in that to.
Obtaining, by the terminal device, an image of a problem book page by photographing a problem book in which a unit and at least one problem are displayed for each page;
Dividing, by the terminal device, the problem book page image into a plurality of areas, and extracting a page and unit information area and a problem number area;
Extracting, by the terminal device, a page number, a unit, and a problem number by performing OCR processing on the page and unit information area and the problem number area;
Transmitting, by the terminal device, a problem solving information request signal including the page number, unit, and problem number to a learning service server;
Obtaining, by the learning service server, an answer and explanation data corresponding to the page number, unit, and question number, and providing it to the terminal device; And
The terminal device outputting the answer and commentary data
Learning service method comprising a.
The method of claim 7,
In the step of outputting the answer and commentary data,
The terminal device is a learning service method, characterized in that outputting the answer and the commentary data as an augmented reality image.
Obtaining a problem book page image by photographing a problem book in which a unit and at least one problem are displayed for each page, and transmitting a problem solving information request signal including the obtained problem book page image to a learning service server;
Dividing, by the learning service server, the problem book page image into a plurality of areas, and extracting a page and unit information area and a problem number area;
Extracting, by the learning service server, a page number, a unit, and a question number by performing OCR processing on the page and unit information area and the problem number area;
Obtaining, by the learning service server, an answer and explanation data corresponding to the page number, unit, and question number, and providing it to the terminal device; And
The terminal device outputting the answer and commentary data
Learning service method comprising a.
The method of claim 9,
In the step of outputting the answer and commentary data,
The terminal device is a learning service method, characterized in that outputting the answer and the commentary data as an augmented reality image.

Images