WO2017082647A1

WO2017082647A1 - Push message-based writing and voice information transfer and playback method, and system therefor

Info

Publication number: WO2017082647A1
Application number: PCT/KR2016/012913
Authority: WO
Inventors: 채규국
Original assignee: 채규국; (주) 스마트웨어
Priority date: 2015-11-11
Filing date: 2016-11-10
Publication date: 2017-05-18
Also published as: KR101640574B1

Abstract

The present invention relates to a push message-based writing and voice information transfer and playback method, and a system therefor. More specifically, the present invention is for synchronizing timeline information corresponding to time information with writing information and additional voice information so as to provide school tests and the college scholastic ability test, language learning, past test questions and explanations and to provide 1:1 customized help coaching, thereby enabling synchronized information to be exchanged between learners and learning supervisors in the form of push messages and thus enabling 1:1 learning to be performed at a convenient time and location.

Description

Ｐｕｓｈ Message-based writing and voice information delivery and playback, and its system

The present invention relates to a push message-based writing and voice information transmission and playback method, and a system thereof, and more specifically, to provide SAT, language learning, past questions, commentary, and 1: 1 personalized help coaching. By synchronizing the writing information and additional voice information to the timeline information corresponding to the time information, the learner and the leader can be exchanged in the form of a push message, allowing 1: 1 learning progress at a convenient time and place regardless of place and time. Push message-based writing and voice information delivery and playback method, and the system for this purpose.

Patent application No. 10-2012-0062666 corresponding to the prior art 1 write-use counting electronic pen, the nib, the nib of the thickness can be changed and replaceable; 3-axis sensor unit for recognizing the position information and the operation direction; A memory chip for digitizing and storing the recognized information; And a transmitter for transmitting the stored information.

In addition, the character data input device of the mobile communication terminal using the electronic pen of Patent Application No. 10-2000-0012326 and the method corresponding to the prior art 2 is an electronic pen in the information input window during the write operation using the user's electronic pen A coordinate recognizing unit recognizing the coordinates of the location; A character recognition unit receiving a signal output from the coordinate recognition unit to recognize a character; A key input unit receiving a control signal by a user; A memory unit for storing data; A data conversion unit converting the characters recognized by the character recognition unit into voice data or text data and storing the converted data in a memory unit; And controlling an operation of each part of the system according to a control signal input through the key input part, and selecting one of text data or voice data of a type suitable for a receiver from each address of the memory part when a user's transmission command is input. Microcomputer to transmit through the transceiver; Characterized in that configured to include.

Hangul handwriting online character recognition apparatus and method thereof of Korean Patent Application No. 10-1993-0031606 corresponding to the prior art 3, in particular, the recognition of handwritten Korean characters and the phoneme It relates to a Hangul handwriting online recognition system and method that can be adapted to the connection between writing habits between the character input unit for receiving Hangul data from the user; A preprocessor which removes noise and unnecessary parts from data input through the character input unit and extracts only representative points; A recognition dictionary including information on each phoneme of the initial, neutral, and final characters forming a letter and a linking phoneme formed by a combination thereof; It includes a recognition control unit for recognizing the characters connected between the elements by searching the recognition dictionary for the representative points processed by the preprocessor.

However, in the prior arts 1 to 3, it corresponds to a technique for minimizing the error of the coordinates and the shape of the letters and input, and does not process the voice signal together, and furthermore, for educational purposes based on 1: 1 matching. It is a simple avoidance design technique that cannot be provided.

Meanwhile, in the conventional mobile SNS app service, text, picture and voice information can be transmitted by processing push messages in separate file formats. However, the push message checker has been inconvenient to check the contents by clicking the file corresponding to each information individually.

Accordingly, in the technical field, when solving problems of the conventional mobile SNS app service and providing it for educational purposes, the conversation contents transmitted and received in the Push message dialog window for SNS are recorded in the form of writing and voice information in order. When it is clicked, the voice and written contents are provided in timeline, and it is expected to deliver much timed explanation contents with much less capacity than the video, and to suggest the communication method optimized for the mobile environment in particular.

[Related Technical Documents]

1.Write Compatibility Counting the stylus (Patent Application No. 10-2012-0062666)

2. A input module and the method of letter data using electronic pen for mobile phone using a electronic pen (Patent Application No. 10-2000-0012326)

3. Hangul handwriting online character recognition device and method (APPARATUS AND METHOD TO ON-LINE RECOGNIZE HANGUEL OF WRITING STYLE) (Patent Application No. 10-1993-0031606)

The present invention is to solve the above problems, as well as mathematics learning, promoting the expansion of 1: 1 personalized coaching services to enhance the learning capacity in reading guidance, reading Korean language reading, Chinese language instruction, vocabulary, comparative learning, etc. To provide push message-based writing and voice information delivery and reproduction, and a system for contributing to reinforcement.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

Push message-based writing and voice information delivery and playback method according to an embodiment of the present invention to achieve the above object, the coaching request learning terminal 80 coaches the web server 40 via the network 70 After the installation of the 'coaching learning request app' for the first access to perform a 'member registration' for learning, automatically moves to the login window after the registration process according to the automatic access to the web server 40 according to the coaching learning request app execution A first step of performing a payment completion by selecting a learning product when initial login is completed in a closed state; When the coaching request learning terminal 80 performs the learning progress setting on the web server 40, when purchasing the package learning product among the learning products in the first step, the subject-specific progress setting process is provided from the web server 40. In the first step, when purchasing the term-based learning product among the learning products, the process of setting the monthly progress is provided from the web server 40, and both the package learning product and the term-learning product are setting the progress from the web server 40 to the end and the class member. A second step of receiving a course; When the coaching request learning terminal 80 is provided with the diagnostic test information and the ten-minute test information stored in the DB server 10 on the web server 40, and performs the test, in the case of the diagnostic test, the diagnostic test at the start of the first learning for each interruption member. (10 questions or less), in the case of a ten-minute test, a 1: 1 custom ten-minute test according to the preset progress and learning schedule of the learner operating the coaching request learning terminal 80, push to the coaching learning request app After sending the message in the form of a learner to configure the screen to watch the ten minutes test, provides a function corresponding to scraping, sharing, correct answer input, confirmation by the coaching learning request app, when providing the scraps by subject / To be scrap by unit, to share by SNS when providing sharing, to provide the multiple choice / short answer automatic scoring function when providing the correct answer, and enter the correct answer when providing confirmation In the case of clicking the OK button, it automatically moves to the next problem, and if it is the last problem, it provides the function of changing to the submit button. A third step of providing a web server 40 with my location, nationwide top percentage, item type analysis, and supportable university analysis; When the coaching request learning terminal 80 receives the learner's input for the self-directed learning menu in the coaching learning request app, the list is ranked in the most recent order from the web server 40 for the self-learning process. When selected by the learner, it provides a dialogue window that supports learning and chatting for problem solving, and the answer and commentary is displayed in the dialogue window as a detailed course of self-directed learning. A fourth step of providing a "video" as a function of requesting and matching help coaching and learning as a function of "help coaching" and a problem solving video being played; When the coaching request learning terminal 80 selects the help coaching function in the self-directed learning process in the coaching learning request app, the coaching learning is provided from the web server 40 through the network 70, and the learner incorrectly answers the help coaching process. A fifth step of requesting a question about an unknown part using a learning digital pen 80a, which is a text or a smart pen, by clicking on the “pen” icon at the bottom of the dialog when a question is asked; And the web server 40 when answering the incorrect problem question during the self-directed learning process of the fourth step, and the coach terminal 90 when answering the incorrect problem question during the help coaching process of the fifth step. A sixth step of extracting helpful data stored in the media server 50 and the file server 60 and transferring the data to the coaching request learning terminal 80 through the network 70; The fifth step may include: a fifth step in which the coaching request learning terminal 80 performs short-range wireless communication pairing with respect to the learning digital pen 80a; The learning digital pen 80a extracts writing information and analyzes a movement path onto the learning paper note 80b when the learner's writing to the learning paper note 80b, which is an offline note, simultaneously receives an additional voice signal. In this case, voice information is extracted, and timeline information is generated during the information extraction process, and the writing information (voice) is transmitted to the coaching request learning terminal 80 in real time through a short range wireless communication method together with the writing information (including voice information). Step 5-2 for providing an experience such as viewing a video using the timeline information and also implementing the handwriting order of the learner using the timeline information; A fifth to third coaching request learning terminal 80 receiving write information (including voice information) and timeline information and transmitting the same to the web server 40 through the network 70; A fifth step in which the web server 40 stores write information (including voice information) in one coaching request information unit in the DB server 10 in the order of the time flow of the timeline information; And 5-5-5 that the push server 20 transmits a coaching request message for one coaching request information unit stored in the DB server 10 to the pre-designated coach terminal 90 in the form of a push message via the network 70. step; Characterized in that it comprises a.

At this time, after step 5-5, when the WAS server 30 determines that an input for the coaching request message has occurred on the coach terminal implementing the coaching request message in the form of a push message on the touch screen, the web server 40 ) Receives an acknowledgment ack signal from the coach terminal 90 through the network 70, and writes information (including voice information) in accordance with the order of timeline information in accordance with the receipt of the acknowledgment ack signal. Step 5-6 of transmitting through network 70 to 90; It characterized in that it further comprises.

In addition, after the fifth step 6-6, the coach terminal 90 time writing information including the typeface, font size, and text color input to the learning paper note 80b by the learning digital pen 80a on the touch screen. A fifth to seventh step of controlling to be implemented in units of line information, and controlling to output the voice information to the voice output unit in synchronization with the write information according to the timeline information unit when there is a voice signal input at the same time; It characterized in that it further comprises.

Further, after the fifth to seventh steps, a fifth to eighth step in which the coach terminal 90 implementing write information (including voice information) performs the short-range wireless communication pairing with the coaching digital pen 90a; The coaching digital pen 90a extracts the writing information and analyzes the movement path on the coaching paper note 90b and simultaneously extracts the voice information, and together with the timeline information about the writing information and the voice information, the coach terminal ( A fifth step of transmitting in real time through a short range wireless communication method in step 90); A fifth step of the coach terminal 90 receiving the writing information, the voice information, and the timeline information in the ninth step and transmitting the received information to the web server 40 through the network 70; The fifth web server 40 stores the write information and the voice information as one 'coaching provision information unit' in the DB server 10 in the order of the time flow of the timeline information under the control of the WAS server 30. -11 steps; And a fifth step of the push server 20 transmitting a coaching providing message for one coaching providing information unit stored in the DB server 10 to the coaching request learning terminal 80 in the form of a push message; It characterized in that it further comprises.

In addition, after the step 5-12, when the WAS server 30 determines that an input for the coaching provision message has occurred on the coaching request learning terminal 80 implementing the coaching provision message in the form of a push message on a touch screen. The web server 40 receives the acknowledgment ack signal from the coaching request learning terminal 80 through the network 70, and in accordance with the receipt of the acknowledgment ack signal, the coaching provision information unit is arranged in the order of the time flow of the timeline information. Step 5-13 of transmitting the write information and the voice information according to the coaching request learning terminal 80 through the network 70; And writing information including typeface, font size, and text color inputted by the coaching request learning terminal 80 into the coaching paper note 90b by the coaching digital pen 90a on the touch screen, and the voice information as a timeline information unit. Step 5-14 of controlling the output to the touch screen and the voice output unit sequentially; Further, the write information and the voice information of the coaching provision information unit may be output in synchronization with the timeline information unit.

In order to achieve the above object, a push message-based writing and voice information transmitting and reproducing system according to an embodiment of the present invention is a system for performing the push message-based writing and voice information transmitting and reproducing method. When the specified time every day, the test is transmitted to the coaching request learning terminal 80, which is a learning smart device, in the form of a push message through the network 70, and learning by the learner operating the coaching request learning terminal 80 is possible. A push server 20 for conducting a test on the coaching request learning terminal 80 by the web server 40 according to the message click in time and presenting an answer; It characterized in that it comprises a.

In addition, the present invention, the web application server (Web Application Server), the coaching request request so that the coaching learning request application of the coach request request learning terminal 80, the coach terminal 90 can operate the coaching learning application A WAS server 30 supporting stable transaction processing between the learning terminal 80 and the coach terminal 90 and the web server 40; And a web server 40 transmitting static and dynamic contents to the coaching request learning terminal 80 and the coach terminal 90 corresponding to the web client. In addition, the coaching request learning terminal 80, as well as being able to receive an answer from the web server 40, as well as being able to receive an answer immediately from the web server 40 to check the results immediately upon submission of the answer And receiving a video listening process.

In addition, the learning digital pen 80a and the coaching digital pen 90a are each provided with an optical recognition module and a voice recognition module, and the movement coordinate calculation by the tip of the pen by the optical recognition module and the recognition by the voice recognition module are performed. Converts the voice signal to voice information, and the learner's writing using the learning digital pen 80a is performed on the learning paper note 80b by default. The learner's writing is performed directly on the terminal 80 and can be recognized as writing information. The coach's writing using the coaching digital pen 90a is performed on the coaching paper notebook 90b by default. If there is no 90b), the learner's writing is performed directly on the coach terminal 90, and is recognized as writing information.

In addition, the present invention, the web server 40 when answering the incorrect problem questions in the self-directed learning process, and the coach terminal 90 at the time of answering the incorrect problem questions in the help coaching process, the helpful material A media server 50 and a file server 60 which extract and store data for performing data transfer to the coaching request learning terminal 80 through the network 70; It characterized in that it further comprises.

In addition, the learning paper note 80b and the coaching paper note 90b are provided as "paper notes" in which N x M lattice patterns (N and M are the same or different natural numbers) are printed, and the learning paper notes 80b are provided. And a method of locating positions in the order of time using absolute starting points by the optical recognition module of the learning digital pen 80a and the coaching digital pen 90a, rather than the grid pattern printed on the coaching paper note 90b. And extracting write information.

Push message-based writing and voice information transmission and reproduction method according to an embodiment of the present invention, and the system, as well as mathematics learning, to enhance the learning capacity in reading instruction, reading Korean language reading, Chinese language instruction, vocabulary, comparative learning, etc. Promoting 1: 1 personalized coaching services for the private sector will help reduce private education costs and strengthen public education competitiveness.

In addition, the push message-based writing and voice information transmission and reproduction method according to another embodiment of the present invention, and the system, when solving the problems of the conventional mobile SNS app service to provide for educational purposes, voice and When the written contents are provided in accordance with the timeline, it delivers many hours of explanation contents in a much smaller capacity than the video, thereby presenting an optimized communication method especially for a mobile environment.

In addition, the push message-based writing and voice information transmission and playback method, and the system according to another embodiment of the present invention, the SAT, language learning, past questions, commentary provided, 1: 1 personalized help coaching By synchronizing the writing information and additional voice information with the timeline information corresponding to the time information, the learner and the leader can be exchanged in the form of a push message so that the 1: 1 learning process can be carried out at a convenient time and place regardless of time and place. Provide the effect of enabling it.

1 is a diagram illustrating a push message based writing and voice information transmitting and reproducing system according to an exemplary embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a web server 40 in the push message based writing and voice information transmitting and reproducing system of FIG. 1.

3 to 7 are UI (User Interface) screens implemented in the coaching request learning terminal 80 and the coach terminal 90 of the push message-based writing and voice information delivery and playback system of FIG. 80A) and a diagram for explaining a process of generating writing information by the coaching digital pen 90a.

8 is a flowchart illustrating an overall process performed by a push message based writing and voice information transmitting and reproducing system according to an exemplary embodiment of the present invention.

9 to 11 are views showing a UI screen in the overall process performed by the push message-based writing and voice information delivery and playback system.

12 is a flowchart illustrating a coaching learning process of step S500 of FIG. 8 in detail and is a flowchart illustrating a push message-based writing and voice information transmission and reproducing method according to an exemplary embodiment of the present invention.

Hereinafter, the detailed description of the preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, detailed descriptions of well-known functions or configurations will be omitted when it is deemed that they may unnecessarily obscure the subject matter of the present invention.

In the present specification, when one component 'transmits' data or a signal to another component, the component may directly transmit the data or signal to another component, and through at least one other component. This means that data or signals can be transmitted to other components.

1 is a diagram illustrating a push message based writing and voice information transmitting and reproducing system according to an exemplary embodiment of the present invention. In the present invention, for the convenience of explanation in Figures 4 to 7, 9 and 10 based on mathematics learning, reading instruction, reading Korean language, kanji guidance, vocabulary, comparative learning, other 1: 1 online learning Universally applicable to

Referring to Figure 1, Push message-based writing and voice information delivery and playback system DB server 10, Push server 20, WAS server 30, Web server 40, media server 50, files Server 60, network 70, coaching request learning terminal 80, learning digital pen 80a, learning paper note 80b, coach terminal 90, coaching digital pen 90a, and coaching paper note 90b ). The network 70 is a communication network which is a high-speed network of a large communication network capable of large-capacity, long-distance voice and data services, and may be a next-generation wired and wireless network for providing Internet or high-speed multimedia services. When the network 70 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. An example of an asynchronous mobile communication network is a communication network of a wideband code division multiple access (WCDMA) scheme. In this case, although not shown in the figure, the network 70 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is taken as an example, it may be an IP network based on a next generation communication network such as 3G LTE network, 4G network, or other IP. Network 70 is DB server 10, Push server 20, WAS server 30, Web server 40, media server 50, file server 60, coaching request learning terminal 80, coach The terminal 90 and other systems serve to mutually transfer signals and data.

On the other hand, the WAS server 30 is a web application server (Web Application Server), so that the server can run the coaching learning request app of the coaching request learning terminal 80, and coaching learning providing app of the coach terminal 90 A stable transaction processing between the coaching request learning terminal 80 and the coach terminal 90 and the web server 40 is supported.

The web server 40 transmits mainly static content (html, jpeg, gif ...) to the coaching request learning terminal 80 and the coach terminal 90 corresponding to the web client. The DB server 10 provides content transmitted from the web server 40 through the network 70 and stores information received from the coaching request learning terminal 80 and the coach terminal 90. In addition, DB in the present specification may mean a functional structural combination of software and hardware that stores information corresponding to each database. The DB may be implemented as at least one table, and may further include a separate Database Management System (DBMS) for searching, storing, and managing information stored in the database. In addition, it may be implemented in various ways such as linked-list, tree, and relational database, and includes all data storage media and data structures capable of storing information corresponding to the database.

The push server 20 transmits a 10-minute test to the coaching request learning terminal 80, which is a learning smart device, in the form of a push message through the network 70, and runs the coaching request learning terminal 80 every day. At the time when learning by the learner is possible, the test of the coaching request learning terminal 80 by the web server 40 according to the message click is performed and the answer is presented.

On the other hand, the coaching request learning terminal 80 is not only can receive the answer immediately upon submission of the answer can be provided from the web server 40, as well as the question and video listening process for the wrong answer from the web server 40 Can be provided.

In addition, the coaching learning request app of the coaching request learning terminal 80 may proceed with a coaching learning clinic in accordance with the coaching learning providing app of the coach terminal 90 by the WAS server 30. That is, for a problem that the learner hardly understands during the provided test, by using a chat window implemented in the coaching learning request app on the touch screen of the coaching request learning terminal 80, by selecting a pen icon at the bottom of the chat window, By providing the contents of the question to the coach teacher who operates the coach terminal 90 as writing information and voice information according to a timeline, careful correction and voice transmission may be possible. This allows the learner to have the same experience of being tutored next to him. To this end, the learning digital pen 80a and the coaching digital pen 90a include an optical recognition module and a voice recognition module, so that the movement coordinate calculation by the tip of the pen by the optical recognition module and the recognized voice signal by the voice recognition module are performed. The conversion to speech information should be performed.

The learner's writing using the learning digital pen 80a is made on the learning paper note 80b by default. When the learning paper note 80b is not present, the learner's writing is performed directly on the coaching request learning terminal 80. It can be recognized as write information. In addition, the writing of the learning leader using the coaching digital pen 90a is made on the coaching paper note 90b by default, and the writing of the learner is performed directly on the coach terminal 90 when there is no coaching paper note 90b. Can be recognized as write information.

To this end, the learning paper note 80b and the coaching paper note 90b are provided as “paper notes” printed with N × M lattice patterns (N, M being the same or different natural numbers), and the coaching request learning terminal 80 ) And the coach terminal 90 should have a touch screen corresponding to the screen input device on which the N × M grid pattern is output.

Through such a configuration, the optical recognition module and the voice recognition module provided in the learning digital pen 80a and the coaching digital pen 90a, the learning paper note 80b and the coaching paper note 90b, or the coaching request learning terminal ( 80) and a coaching learning request app and a coaching learning providing app, which are learning apps of a “mobile device” having a push message function through writing recognition and voice recognition, using a grid pattern printed or output on the coach terminal 90. 70), by sending a push message to a remote learner, and when the remote learner and the learning leader click on the received push message, the contents including the writing and the voice can be played at the same timeline. .

Meanwhile, the media server 50 and the file server 60 are servers for providing necessary knowledge information among various learning material libraries, and request coaching using a library for lecture support such as EBS learning videos, knowledge channels e, and learning beyond. Choose and deliver only what is essential to the learner.

FIG. 2 is a block diagram illustrating a configuration of a web server 40 in the push message based writing and voice information transmitting and reproducing system of FIG. 1. 3 to 7 are UI (User Interface) screens implemented in the coaching request learning terminal 80 and the coach terminal 90 of the push message-based writing and voice information delivery and playback system of FIG. 80A) and a diagram for explaining a process of generating writing information by the coaching digital pen 90a.

First, referring to FIG. 2, the web server 40 includes a transceiver 41 and a controller 42, and the controller 42 includes a magnitude setting module 42a, a test progress module 42b, and self-directed learning. A progress module 42c and a coaching learning progress module 42d. On the other hand, the coaching learning progress module 42d is divided into coaching requesting means 42d-1 and coaching providing means 42d-2.

The progress setting module 42a controls the transceiver 41 to provide learning progress setting through data transmission / reception with the coaching request learning terminal 80 in accordance with access from the coaching request learning terminal 80.

The test progress module 42b receives the diagnostic test information and the ten minute test information stored in the DB server 10 for the coaching request learning terminal 80 and controls the transceiver 41 to perform the test. The test progress module 42b performs a diagnostic test (within 10 questions) at the start of initial learning for each interruption member when performing a diagnostic test, and provides a process of estimating learning ability to the coaching request learning terminal 80 according to the diagnosis result. In addition, the test progress module 42b transmits and receives a transmission unit 41 to transmit a push message form to the coaching learning request by configuring a 1: 1 custom test according to the learner's preset progress and learning schedule when performing the 10 minute test. To control. Here, the UI screen of the coaching request learning terminal 80 having received the push message may be the same as that of FIG. 3, and the UI screen of the coaching request learning terminal 80 for the diagnostic test may be the same as that of FIG. 4. The UI screen of the coaching request learning terminal 80 may be the same as that of FIG. 5A.

Self-directed learning progress module 42c according to the transaction processing between the coaching learning request app of the coaching request learning terminal 80 of the WAS server 30 and the web server 40, the coaching learning request of the coaching request learning terminal 80 When the app receives a learner's input request for the self-directed learning menu, the transmission and reception unit 41 to provide a self-directed learning process corresponding to the dynamic content extracted from the DB server 10 to the coaching request learning terminal 80. ). Here, self-directed learning, which is listed in the order of the recent progress history, provides a dialog window that supports learning and chat for problem solving when selected by the learner. Self-paced learning can provide answers / commentary, help coaching, and video.

Coaching learning progress module 42d according to the coaching learning request app of the coaching request learning terminal 80 of the WAS server 30 and the coaching learning providing app of the coach terminal 90 and the transaction processing between the web server 40, The coaching request learning terminal 80 mediates coaching learning and the coach terminal 90 provides coaching via the network 70.

In order to proceed with the coaching learning clinic, for a problem that the learner does not understand easily during the provided test, by using the dialog implemented in the coaching learning request app on the touch screen of the coaching request learning terminal 80, Through the selection, the contents of the question to the coach teacher who operates the coach terminal 90 may be provided as writing information and voice information according to the timeline, and detailed correction and voice transmission may be possible.

More specifically, the coaching requesting means 42d-1 receives the writing information (which may include voice information) and the timeline information from the coaching request learning terminal 80 through the network 70, and thus the time flow of the timeline information. The write information (including voice information) may be stored in the DB server 10 as one coaching request information unit in order. Here, the UI screen for receiving writing information using the coaching request learning terminal 80 and the learning digital pen 80a connected through Bluetooth may be the same as that of FIG. 6A.

The coaching providing means 42d-2 is a coach terminal designated in advance in the form of a push message via a network 70 with a coaching request message for one coaching request information unit stored in the DB server 10 through the push server 20 ( The transceiver 41 is controlled to transmit to 90.

The coaching providing means 42d-2 is configured to push the network 70 from the coach terminal 90 when an input for the coaching request message occurs on the coach terminal 90 implementing the coaching request message in the form of a push message on a touch screen. Receives the acknowledgment ack signal through, and transmits and receives to transmit the write information (including voice information) in accordance with the time flow of timeline information according to the acknowledgment of the acknowledgment ack signal to the coach terminal 90 through the network 70. The unit 41 is controlled.

Here, the UI screen receiving coaching learning based on the writing information using the coaching device 90 and the coaching digital pen 90a connected through Bluetooth may be the same as that of FIG. 6B. 7A and 7B illustrate that when writing is performed using the coaching digital pen 90a to the coaching paper note 90b, the writing information is automatically transmitted from the coaching digital pen 90a to the coach terminal 90 in the order of time. The actual implementation is shown. In another embodiment of the present invention as shown in FIG. 7, a method of determining positions in the order of time by using a writing start point by a coaching digital pen 90a as an absolute coordinate rather than a lattice pattern printed on the coaching paper note 90b. This can be used.

In addition, the coaching providing means 42d-2 controls the transceiver 41 to receive the writing information, the voice information, and the timeline information from the coach terminal 90 through the network 70, and then the time of the timeline information. The write information and the voice information are stored in the DB server 10 as one 'coaching providing information unit' according to the flow order.

In addition, the coaching providing means 42d-2 transmits a coaching providing message for one coaching providing information unit stored in the DB server 10 to the coaching request learning terminal 80 in the form of a push message through the push server 20. The transmission / reception unit 41 is controlled so as to.

The coaching providing means 42d-2 is configured to, from the coaching request learning terminal 80, when an input for the coaching providing message occurs on the coaching request learning terminal 80 implementing a coaching providing message provided in the form of a push message on a touch screen. Receives the acknowledgment ack signal through the network 70, and the coaching provision information unit according to the acknowledgment of the acknowledgment ack signal, the write information and the voice information according to the order of the time flow of the timeline information to the coaching request learning terminal 80. The transceiver 41 is controlled to transmit through the network 70.

8 is a flowchart illustrating an overall process performed by a push message based writing and voice information transmitting and reproducing system according to an exemplary embodiment of the present invention. 9 to 11 are views showing a UI screen in the overall process performed by the push message-based writing and voice information delivery and playback system.

First, referring to FIG. 8, the coaching request learning terminal 80 accesses the web server 40 through the network 70 and performs 'member registration' for coaching learning (S100). Here, the coaching request learning terminal 80 installs the 'coaching learning request app' for the first access, in the sign-up process according to the automatic access according to the coaching learning request app execution, after inputting the required items, when clicking the OK button, Automatically move to the login window.

Meanwhile, in step S100, the coaching request learning terminal 80 may purchase a product for coaching learning on the web server 40 (see FIG. 9A). After the initial login in the state of automatically moving to the above-described login window, payment can be completed by selecting a learning product.

After step S100, the coaching request learning terminal 80 performs learning progress setting on the web server 40 as shown in FIG. 9B (S200). More specifically, the coaching request learning terminal 80 receives a progress setting process for each subject from the web server 40 when purchasing the package learning product from the learning product purchase in step S100. Meanwhile, the coaching request learning terminal 80 receives a process of setting the monthly progress from the web server 40 at the time of purchasing the term-based learning product. On the other hand, the coaching request learning terminal 80, in the case of both the package learning product and the term-based learning product, it is also possible to set the progress from the web server 40 to the end and end.

After step S200, the coaching request learning terminal 80 receives the diagnostic test information (see FIG. 9C) and the ten minute test information (see FIG. 10A) stored in the DB server 10 on the web server 40 to perform a test. (S300). That is, in the case of the diagnostic test in step S300, a diagnostic test (within 10 questions) is performed at the beginning of learning for each interruption member, and a process of estimating learning ability is provided according to the diagnosis result. On the other hand, in step (S300) coaching request learning terminal 80 may be provided with a one-time mini-test in the form of a push message through the network 70 from the push server 20, for a customized question to the level of the diagnosed learner It may be a process for the preliminary process.

Next, in the case of ten minutes test in step (S300), configure a 1: 1 custom ten minutes test according to the predetermined progress and learning schedule of the learner operating the coaching request learning terminal 80 Push message form to the coaching learning request app After sending it to the student, let the student construct a screen to watch the ten minute test. In this case, the coaching learning request app may provide functions corresponding to scraping, sharing, correct answer input, and confirmation. Here, the scrap can be scraped by subject / unit during the 10-minute test, the sharing is to be shared by SNS, the correct answer input multiple-choice / short answer automatic scoring function, confirm the input when you click the OK button, It automatically moves to the next problem and provides the ability to change to the submit button if it is the last one.

In accordance with the test performed in step (S300), the coaching request learning terminal 80 is a performance analysis (FIG. 10b). , 30% location comparison), item type analysis, and supportable university analysis (2nd half of 201X) can be provided from the web server 40.

After the step S300, the coaching request learning terminal 80 receives a self-directed learning process from the web server 40 when receiving the learner's input for the self-directed learning menu in the coaching learning request app (S400). Here, self-directed learning, which is listed in the order of the recent progress history, provides a dialog window that supports learning and chat for problem solving when selected by the learner. Self-directed learning can provide answers / commentary (see FIG. 10C), help coaching, and video (FIG. 11A). Here, the answer / commentary is a function that displays the correct answer and commentary in the dialog, the help coaching is a feature that the push message is requested to the learning leader and the matched help coaching and learning proceeds in step (S500), the video is Problem solving video is played.

On the other hand, in the self-directed learning process in step S400 is provided with the automatic learning history management function. In other words, the history of learning about incorrect answers is recorded in detail in the order of problems in the dialogue window, so that when coaching, it is possible to find out the learner's status or to reduce the time for the learner to review again and improve the learning efficiency. 1 Manage automatically with customized learning.

After the step (S400), the coaching request learning terminal 80 receives the coaching learning from the web server 40 via the network 70 when selecting the help coaching function in the self-directed learning process in the coaching learning request app (S500) ). In the help coaching process, when a learner asks a wrong answer question, the learner can request a detailed question about an unknown part by using a text or a smart pen learning digital pen 80a by clicking on the “pen” icon at the bottom of the dialog.

Here, the learning digital pen 80a is an essential tool for help coaching, and the learner is a preset area of the touch screen of the coaching request learning terminal 80 which is obtained and implemented in the coaching learning request app, or the learner to the learning paper note 80b which is an offline notebook. When writing, the audio signal is synchronized to the timeline and automatically transmitted to the chat window, so that you can experience like watching a video. The storage capacity is about 10Mb to play for 30 minutes. Provide an optimal remote coaching system regardless of volume.

After the step (S500), the web server 40 at the time of answering the incorrect problem questions during the self-directed learning process of step (S400), and the coach terminal at the time of answering the incorrect problem questions in the help coaching process of step (S500) 90 extracts helpful materials stored in media server 50 and file server 60 and directly (in case of web server 40) or web server 40 (in case of coach terminal 90). The data transmission to the coaching request learning terminal 80 is performed through the network 70 (S600).

The media server 50 and the file server 60 send a supplementary data such as EBS knowledge channels, learning beyond, and reference materials to help library coaches in answering questions of incorrect questions to the library server for more effective help coaching. to be. Here, the library may be provided as a UI screen as shown in FIGS. 11B and 11C. In the help coaching, a library is a cloud-based learning resource library in which a number of materials are classified by subjects and categories in order to help the questioned learner understand. For example, it may be provided to an interrogator who does not know Archimedes' principle by sending materials in the Library → Beyond Learning → Mathematics category.

12 is a flowchart illustrating a coaching learning process of step S500 of FIG. 8 in detail and is a flowchart illustrating a push message-based writing and voice information transmission and reproducing method according to an exemplary embodiment of the present invention. Referring to FIG. 12, the coaching request learning terminal 80 performs Bluetooth pairing on the learning digital pen 80a (S510a). Meanwhile, Bluetooth pairing is an embodiment for explaining the present invention, and may be performed by Zigbee, UWB, Binary CDMA, or the like corresponding to short-range wireless communication.

After the step S510a, the learning digital pen 80a may extract the writing information through the analysis of the moving path on the learning paper note 80b and the voice information when receiving the voice signal. The timeline information is generated in the information extraction process, and is transmitted to the coaching request learning terminal 80 in real time through the Bluetooth method together with the write information (including voice information) (S510b).

After step S510b, the coaching request learning terminal 80 receives write information (including voice information) and timeline information, and transmits the information to the web server 40 through the network 70 (S510c).

After step S510c, the web server 40 stores write information (including voice information) in one coaching request information unit in the DB server 10 in the order of the time flow of the timeline information (S510d). In step S510d, the web server 40 sets the identification number of the coaching request learning terminal 80 as the largest category according to the transaction control of the WAS server 30, and matches each timeline information with the lower element of the identification number. Write information and other voice information can be stored.

After step S510d, the push server 20 transmits a coaching request message for one coaching request information unit stored in the DB server 10 to the pre-designated coach terminal 90 in the form of a push message via the network 70. (S510e).

After the step S510e, when the WAS server 30 determines that an input for the coaching request message has occurred on the coach terminal 90 in which the coaching request message is implemented as a push message on a touch screen in step S510e, The web server 40 receives the acknowledgment ack signal from the coach terminal 90 through the network 70, and writes information (voice information may be included) according to a time flow of timeline information according to the acknowledgment of the acknowledgment ack signal. ) Is transmitted to the coach terminal 90 through the network 70 (S510f). Accordingly, the coach terminal 90 writes the writing information including the typeface, font size, and text color input to the learning paper note 80b with the learning digital pen 80a in step S510b on the touch screen. It is controlled to implement sequentially in units, and at the same time, when there is a voice signal input in step S510b, the voice information is controlled to be output to the voice output unit in synchronization with the write information according to the timeline information unit.

After the step S510f, the coach terminal 90 implementing the writing information (including voice information) performs Bluetooth pairing with the coaching digital pen 90a (S520a).

After step S520a, the coaching digital pen 90a extracts voice information and extracts voice information at the same time through analysis of a moving path onto the coaching paper note 90b, and a timeline for the write information and the voice information. The information is transmitted to the coach terminal 90 in real time through the Bluetooth method (S520b).

After step S520b, the coach terminal 90 receives the write information, the voice information, and the timeline information in step S520b, and transmits the information to the web server 40 through the network 70 (S520c).

After the step S520c, the web server 40 writes the write information and the voice information to the DB server 10 according to the order of time flow of the timeline information under the control of the WAS server 30. '(S520d).

After step S520d, the push server 20 transmits a coaching provision message for one coaching provision information unit stored in the DB server 10 to the coaching request learning terminal 80 of step S510a in the form of a push message. (S520e).

After the step S520e, the WAS server 30 determines that an input for the coaching provision message has occurred on the coaching request learning terminal 80 implementing the coaching provision message in the form of a push message on a touch screen in step S520e. At the time, the web server 40 receives the acknowledgment ack signal from the coaching request learning terminal 80 through the network 70, and in accordance with the acknowledgment of the acknowledgment acknowledgment signal, sets the coaching provision information unit in the time flow of timeline information. The write information and the voice information are transmitted to the coaching request learning terminal 80 through the network 70 (S520f).

Accordingly, the coaching request learning terminal 80 includes writing information including a font, font size, and font color input to the coaching paper note 90b by the coaching digital pen 90a in step S520b on the touch screen, The voice information is sequentially output to the touch screen and the voice output unit in timeline information units. At this time, the write information and the voice information of the coaching provision information unit are output in synchronization with the timeline information unit.

The invention can also be embodied as computer readable code on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes.

The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. And functional programs, codes and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

As described above, the present specification and drawings have been described with respect to preferred embodiments of the present invention, although specific terms are used, it is only used in a general sense to easily explain the technical contents of the present invention and to help the understanding of the present invention. It is not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

[Description of the code]

10: DB server

20: Push server

30: WAS Server

40: web server

41: transceiver

42: control unit

42a: Progress setting module

42b: Test Progress Module

42c: Self-directed learning progress module

42d: Coaching Learning Progress Module

42d-1: Coaching Request Means

42d-2: Coaching provision means

50: media server

60: file server

70: network

80: Coaching Request Learning Terminal

80a: learning digital pen

80b: learning paper notes

90: coach terminal

90a: Coaching Digital Pen

90b: coaching paper notebook

Claims

After the coaching request learning terminal 80 installs a 'coaching learning request app' on first access to perform 'membership' for coaching learning on the web server 40 through the network 70, the coaching learning request app is executed. A first step of completing payment by selecting a learning product when the initial login is completed after the registration process according to the automatic access to the web server 40 is automatically moved to the login window;

When the coaching request learning terminal 80 performs the learning progress setting on the web server 40, when purchasing the package learning product among the learning products in the first step, the subject-specific progress setting process is provided from the web server 40. In the first step, when purchasing the term-based learning product among the learning products, the process of setting the monthly progress is provided from the web server 40, and both the package learning product and the term-learning product are setting the progress from the web server 40 to the end and the class member. A second step of receiving a course;

When the coaching request learning terminal 80 is provided with the diagnostic test information and the ten-minute test information stored in the DB server 10 on the web server 40, and performs the test, in the case of the diagnostic test, the diagnostic test at the start of the first learning for each interruption member. (10 questions or less), in the case of a ten-minute test, a 1: 1 custom ten-minute test according to the preset progress and learning schedule of the learner operating the coaching request learning terminal 80, push to the coaching learning request app After sending the message in the form of a learner to configure the screen to watch the ten minutes test, provides a function corresponding to scraping, sharing, correct answer input, confirmation by the coaching learning request app, when providing the scraps by subject / To be scrap by unit, to share by SNS when providing sharing, to provide the multiple choice / short answer automatic scoring function when providing the correct answer, and enter the correct answer when providing confirmation In the case of clicking the OK button, it automatically moves to the next problem, and if it is the last problem, it provides the function of changing to the submit button. A third step of providing a web server 40 with my location, nationwide top percentage, item type analysis, and supportable university analysis;

When the coaching request learning terminal 80 receives the learner's input for the self-directed learning menu in the coaching learning request app, the list is ranked in the most recent order from the web server 40 for the self-learning process. When selected by the learner, it provides a dialogue window that supports learning and chatting for problem solving, and the answer and commentary is displayed in the dialogue window as a detailed course of self-directed learning. A fourth step of providing a "video" as a function of requesting and matching help coaching and learning as a function of "help coaching" and a problem solving video being played;

When the coaching request learning terminal 80 selects the help coaching function in the self-directed learning process in the coaching learning request app, the coaching learning is provided from the web server 40 through the network 70, and the learner incorrectly answers the help coaching process. A fifth step of requesting a question about an unknown part using a learning digital pen 80a, which is a text or a smart pen, by clicking on the “pen” icon at the bottom of the dialog when a question is asked; And

Each of the web server 40 at the time of answering an incorrect problem question in the self-directed learning process of the fourth step and the coach terminal 90 at the time of answering an incorrect problem question in the help coaching process of the fifth step, A sixth step of extracting helpful data stored in the media server 50 and the file server 60 and transferring the data to the coaching request learning terminal 80 through the network 70; Including, the fifth step,

A fifth step of the coaching request learning terminal 80 performing short-range wireless communication pairing with respect to the learning digital pen 80a;

The learning digital pen 80a extracts writing information and analyzes a movement path onto the learning paper note 80b when the learner's writing to the learning paper note 80b, which is an offline note, simultaneously receives an additional voice signal. In this case, voice information is extracted, and timeline information is generated during the information extraction process, and the writing information (voice) is transmitted to the coaching request learning terminal 80 in real time through a short range wireless communication method together with the writing information (including voice information). Step 5-2 for providing an experience such as viewing a video using the timeline information and also implementing the handwriting order of the learner using the timeline information;

A fifth to third coaching request learning terminal 80 receiving write information (including voice information) and timeline information and transmitting the same to the web server 40 through the network 70;

A fifth step in which the web server 40 stores write information (including voice information) in one coaching request information unit in the DB server 10 in the order of the time flow of the timeline information; And

Step 5-5 of the push server 20 transmitting a coaching request message for one coaching request information unit stored in the DB server 10 to the pre-designated coach terminal 90 in the form of a push message through the network 70. ; Push message-based writing and voice information delivery and playback method comprising a.
The method according to claim 1, After the fifth step 5-5,

On the coach terminal that implements the coaching request message in the form of a push message on the touch screen, when the WAS server 30 determines that an input for the coaching request message has occurred, the web server 40 connects the network from the coach terminal 90 to the network ( 70) and receives the acknowledgment ack signal, and writes information (possibly including voice information) according to the order of timeline information in accordance with the receipt of the acknowledgment ack signal to the coach terminal 90 through the network 70. Transmitting step 5-6; Push message-based writing and voice information delivery and playback method further comprising a.
The method according to claim 2, After the fifth to sixth step,

The coach terminal 90 controls the writing information including the typeface, font size, and font color input to the learning paper note 80b with the learning digital pen 80a on the touch screen, in the timeline information unit. A fifth to seventh step of controlling the voice information to be output to the voice output unit in synchronization with the write information according to the timeline information unit when there is a voice signal input at the same time; Push message-based writing and voice information delivery and playback method further comprising a.
The method of claim 3, wherein after the fifth step 7-7,

Steps 5-8 in which the coach terminal 90 implementing write information (including voice information) performs short-range wireless communication pairing with the coaching digital pen 90a;

The coaching digital pen 90a extracts the writing information and analyzes the movement path on the coaching paper note 90b and simultaneously extracts the voice information, and together with the timeline information about the writing information and the voice information, the coach terminal ( A fifth step of transmitting in real time through a short range wireless communication method in step 90);

A fifth step of receiving, by the coach terminal 90, the writing information, the voice information, and the timeline information in steps 5-9, and transmitting them to the web server 40 through the network 70;

The fifth web server 40 stores the write information and the voice information as one 'coaching provision information unit' in the DB server 10 in the order of the time flow of the timeline information under the control of the WAS server 30. -11 steps; And

A fifth step of the push server 20 transmitting a coaching providing message for one coaching providing information unit stored in the DB server 10 to the coaching request learning terminal 80 in the form of a push message; Push message-based writing and voice information delivery and playback method further comprising a.
The method according to claim 4, After the fifth to 12 steps,

On the coaching request learning terminal 80 implementing the coaching providing message in the form of a push message, the web server 40 learns the coaching request when the WAS server 30 determines that an input for the coaching providing message has occurred. Receives an acknowledgment ack signal from the terminal 80 through the network 70, and the coaching request information learning in accordance with the order of the time flow of the timeline information in the coaching provision information unit according to the acknowledgment of the acknowledgment ack signal A step 5-13 transmitting the terminal 80 through the network 70; And

The writing request including the typeface, font size, and text color inputted by the coaching request learning terminal 80 into the coaching paper note 90b with the coaching digital pen 90a on the touch screen, and the voice information as timeline information units. Step 5-14 of sequentially controlling the output to the touch screen and the voice output unit; More,

The writing information and the voice information of the coaching providing information unit are synchronized with the timeline information unit and are output based on a push message.
In the push message-based writing and voice information transmission and playback system of any one of claims 1 to 5,

When the designated time every day, the test is transmitted to the coaching request learning terminal 80, which is a learning smart device, in the form of a push message through the network 70, the time available for learning by the learner operating the coaching request learning terminal 80 Push server 20 to test the coaching request learning terminal 80 by the web server 40 according to the message click and to present an answer; Push message-based writing and voice information delivery and playback system comprising a.
The method according to claim 6,

As a web application server (Web Application Server), the coaching request learning terminal 80 and the coaching request request learning terminal 80 of the coach request request learning terminal 80, the coach terminal 90, A WAS server 30 supporting stable transaction processing between the coach terminal 90 and the web server 40; And

A web server 40 transmitting static and dynamic contents to the coaching request learning terminal 80 and the coach terminal 90 corresponding to the web client; More,

Coaching request learning terminal 80, not only can receive the answer immediately upon submission of the answer can be provided from the web server 40, but also the process of listening to questions and videos about the incorrect answer from the web server 40 Push message-based writing and voice information delivery and playback system characterized in that provided.
The method according to claim 7,

The learning digital pen 80a and the coaching digital pen 90a are each provided with an optical recognition module and a voice recognition module, and the movement coordinate calculation by the tip of the pen by the optical recognition module and the recognized voice signal by the voice recognition module are provided. Converts to speech information for

The learner's writing using the learning digital pen 80a is made on the learning paper note 80b by default. When the learning paper note 80b is not present, the learner's writing is performed directly on the coaching request learning terminal 80. Can be recognized as write information

The writing of the learning leader using the coaching digital pen 90a is made on the coaching paper note 90b by default. When there is no coaching paper note 90b, the learner's writing is performed directly on the coach terminal 90. Push message-based writing and voice information delivery and playback system characterized in that the information can be recognized.
The method according to claim 8,

Web server 40 when answering the incorrect problem questions in the self-directed learning process, and the coach terminal 90 when answering the incorrect problem questions in the help coaching process, extracts helpful data, the network (70) A media server 50 and a file server 60 that store data for performing data transfer to the coaching request learning terminal 80 through a); Push message-based writing and voice information delivery and playback system further comprising a.
The method of claim 8, wherein the learning paper notebook (80b) and coaching paper notebook (90b),

A learning digital pen provided as a “paper note” printed with N × M lattice patterns (N, M being the same or different natural numbers) and printed on the learning paper notes 80b and coaching paper notes 90b. Push message-based writing and voice information, characterized in that the method of identifying the position in the order of time by using the optical starting module of the optical recognition module 80a and the coaching digital pen 90a as absolute coordinates to extract the writing information. Delivery and playback system.