KR102731781B1 - An electronic device that uses analog handwriting as a digital input signal and a remote teaching method that converts analog handwriting into digital data - Google Patents

Abstract

The present invention relates to an electronic device that uses analog handwriting as a digital input signal, including a communication unit that receives information generated by recognizing a pattern printed on paper from an electronic pen; and a processor that performs a preset operation based on the information.

Description

{An electronic device that uses analog handwriting as a digital input signal and a remote teaching method that converts analog handwriting into digital data}

The present invention relates to an electronic device that uses analog handwriting as a digital input signal and a remote teaching method that converts analog handwriting into digital data and uses it.

In educational settings such as schools, academies, and professional training institutions, various electronic devices including computers are used. These electronic devices can be appropriately utilized for education related to reading, listening, and speaking, but are less useful for education related to writing.

Just like how elementary school students study Korean, education that allows students to write on paper, check their work, and receive feedback from their teachers is important even in today's transition to a digital society.

Meanwhile, non-face-to-face education is becoming more active due to the emergence of COVID-19. In particular, many remote classes are being conducted in the public education sector. Electronic devices are essential for remote classes, and these electronic devices are highly useful for education related to reading, listening, and speaking as mentioned above, but have limitations in writing education. Due to these limitations, even in the situation of the spread of COVID-19, face-to-face education is the principle for first and second graders in elementary school.

In order to utilize electronic devices in writing education, and especially to enable writing education through non-face-to-face education, research and development on methods to connect analog writing with electronic devices is necessary.

Registration Number 10-2338351

The purpose of the present invention is to provide an electronic device that uses analog handwriting as a digital input signal to solve the above-mentioned problem.

In addition, the present invention aims to provide a remote teaching method that converts analog handwriting into digital data and uses it.

The tasks of the present invention are not limited to the tasks mentioned above, and other tasks not mentioned will be clearly understood by those skilled in the art from the description below.

In order to achieve the above task, an electronic device using analog handwriting as a digital input signal according to an embodiment of the present invention can perform a preset operation based on information received from an electronic pen.

An electronic device that uses analog handwriting as a digital input signal according to an embodiment of the present invention includes a communication unit that receives information generated by recognizing a pattern printed on paper from an electronic pen; and a processor that performs a preset operation based on the information.

The above information includes the paper information and handwriting information generated by the electronic pen.

The above paper information includes page ID information, and the processor generates a first control signal so that a screen matching the page ID is displayed when first handwriting information for a first area of the paper is received.

The processor generates a second control signal so that at least one of a preset video playback, a preset webpage display, and a preset file display is performed when a second handwriting input for a second area of the paper is received.

The above processor generates a third control signal to display the next screen of the screen matching the page ID when a third handwriting input for the third area of the paper is received.

The above handwriting information is determined based on a shape drawn by the electronic pen on the paper, and the processor generates a control signal so that an operation matching the shape is performed.

A remote teaching method for converting analog handwriting into digital data according to an embodiment of the present invention includes: a step in which a teacher terminal receives teaching materials from an LMS (Learning Management System); a step in which a teacher terminal and a student terminal share a screen based on the teaching materials; a step in which the teacher terminal receives first handwriting information generated by recognizing a pattern printed on paper from a first electronic pen; a step in which the teacher terminal updates content based on the first handwriting information on the teaching materials; and a step in which the teacher terminal transmits updated teaching materials to the LMS.

A remote teaching method for converting analog handwriting into digital data and utilizing it according to an embodiment of the present invention further includes a step of a teacher terminal transmitting the first handwriting information to a student terminal; and a step of the student terminal displaying teaching materials reflecting the first handwriting information.

A remote teaching method for converting analog handwriting into digital data and using it according to an embodiment of the present invention further includes a step of a student terminal receiving second handwriting information generated by recognizing a pattern printed on paper from a second electronic pen; a step of the student terminal transmitting the second handwriting information to a teacher terminal; a step of the teacher terminal receiving third handwriting information from a first electronic pen; and a step of the teacher terminal transmitting the third handwriting information to the student terminal.

A remote class method for converting analog handwriting into digital data and utilizing it according to an embodiment of the present invention further includes a step of an LMS providing updated class materials to at least one of a teacher terminal and a student terminal.

Specific details of other embodiments are included in the detailed description and drawings.

According to the present invention, one or more of the following effects are achieved.

First, by connecting analog writing and digital electronic devices, it becomes possible to teach writing using electronic devices.

Second, since it has become possible to control electronic devices using analog handwriting, there is an effect of being able to collect data that was not previously possible through a new type of input device.

Third, in the case of non-face-to-face online education, writing education is possible in addition to the conventional reading, listening, and speaking education.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

FIG. 1a is a drawing for reference in explaining a system according to an embodiment of the present invention.
FIG. 1b is a drawing for reference in explaining a system according to an embodiment of the present invention.
FIG. 2 is a drawing for reference in explaining the configuration of an electronic device and an electronic pen according to an embodiment of the present invention.
FIG. 3 is a drawing for reference in explaining information received from an electronic pen according to an embodiment of the present invention.
FIG. 4 is a drawing for reference in explaining paper on which a pattern is printed according to an embodiment of the present invention.
FIGS. 5A to 5D are drawings for reference in explaining a pattern according to an embodiment of the present invention.
FIG. 6 is a drawing for reference in explaining handwriting input according to an embodiment of the present invention.
FIG. 7 is a drawing for reference in explaining handwriting input according to an embodiment of the present invention.
FIG. 8 is a drawing for reference in explaining a remote class system according to an embodiment of the present invention.
FIG. 9 is a drawing for reference in explaining a remote class system according to an embodiment of the present invention.
FIG. 10 is a drawing for reference in explaining a remote class method according to an embodiment of the present invention.

Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing symbols, identical or similar components will be given the same reference numerals and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not have distinct meanings or roles in themselves. In addition, when describing embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The terms are used only to distinguish one component from another.

When it is said that a component is "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. On the other hand, when it is said that a component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, it should be understood that terms such as “comprises” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

FIG. 1a is a drawing for reference in explaining a system according to an embodiment of the present invention.

Referring to the drawing, the system (10a) of Fig. 1a is a system that implements a remote teaching method that converts analog handwriting into digital data and uses it. The system (10a) can provide a remote teaching environment in which writing education based on analog handwriting is possible.

When a teacher uses an electronic pen (300) to write on an analog board on paper with a pattern printed on it, the analog writing can be converted into digital data and displayed on the teacher terminal (100) and student terminal (200).

When a student uses an electronic pen (300) to write analog handwriting on paper with a pattern printed on it, the analog handwriting can be converted into digital data and displayed on the teacher terminal (100) and the student terminal (200).

Through this process, teachers and students can conduct writing classes based on analog handwriting even while conducting remote classes.

The system (10a) may include a learning management system (LMS), a first electronic device (100), a second electronic device (200), and an electronic pen (300).

LMS (50) is a system that supports and manages learners' learning. LMS (50) can be implemented as a server. For example, LMS (50) includes at least one of a cloud server, an IMS (IP Multimedia Subsystem) server, a Telephony Application server, an IM (Instant Messaging) server, an MGCF (Media Gateway Control Function) server, an MSG (Messaging Gateway) server, a CSCF (Call Session Control Function) server, etc., and can be implemented through these.

The LMS (50) can manage content, data or information. When there is a request for at least one of content, data and information from at least one of the first electronic device (100) and the second electronic device (100), the LMS (50) can provide the requested information.

The LMS (50) can manage users (teachers, students, etc.) by managing the first electronic device (100) and the second electronic device (100). The LMS (50) can manage elements related to users, such as user login, logout, attendance, and class participation, through signal exchange with the first electronic device (100) and the second electronic device (100).

The LMS (50) can exchange content, data or information with the first electronic device (100) and the second electronic device (200) through at least one wired or wireless network.

The first electronic device (100) may be referred to as a teacher terminal. The first electronic device (100) may be described as a terminal used by a teacher for teaching. The first electronic device (100) may be a stationary terminal or a mobile terminal capable of computing.

The first electronic device (100) can exchange content, data or information with the LMS (50) and the second electronic device (100) through at least one wired or wireless network.

The first electronic device (100) can communicate wirelessly with the electronic pen (300). For example, the first electronic device (100) can exchange signals with the electronic pen (300) via short-range communication (e.g., Bluetooth).

The first electronic device (100) can receive information from the electronic pen (300). The first electronic device (100) can receive information generated by the electronic pen (300) via wireless communication. Here, the information can include paper information and handwriting information generated by the electronic pen (300). The paper information will be described later with reference to FIGS. 4 to 5d. The handwriting information can mean information generated by writing, drawing, or painting on paper using an analog handwriting means (e.g., ink) provided by the electronic pen (300).

The first electronic device (100) can transmit information received from the electronic pen (300) to at least one of the LMS (50) and the second electronic device (200).

The first electronic device (100) may include a writing program (101). The writing program (101) may be implemented as software. The writing program (101) may be described as a program that assists in the progress of a class based on information received from an electronic pen (300). The writing program (101) may be driven by a processor of the first electronic device (100).

The second electronic device (200) may be referred to as a student terminal. The second electronic device (200) may be described as a terminal used by students for classes. The second electronic device (100) may be a stationary or mobile terminal capable of computing.

The second electronic device (100) can exchange content, data or information with the LMS (50) and the first electronic device (100) through at least one wired or wireless network.

The second electronic device (200) can communicate wirelessly with the electronic pen (300). For example, the second electronic device (200) can exchange signals with the electronic pen (300) via short-range communication (e.g., Bluetooth).

The second electronic device (200) can receive information from the electronic pen (300). The second electronic device (200) can receive information generated by the electronic pen (300) via wireless communication. Here, the information can include paper information and handwriting information generated by the electronic pen (300). The paper information will be described later with reference to FIGS. 4 to 5d. The handwriting information can mean information generated by writing, drawing, or painting on paper using an analog handwriting means (e.g., ink) provided by the electronic pen (300).

The second electronic device (100) can transmit information received from the electronic pen (300) to at least one of the LMS (50) and the first electronic device (100).

The electronic pen (300) can detect a pattern and provide information when the pen tip comes into contact with paper (hereinafter, “pattern paper”) on which a pattern is printed. The information can include paper information and handwriting information.

The electronic pen (300) can recognize a pattern by a sensor. For example, the electronic pen (300) can sense a pattern of the pattern paper through at least one sensor included in the electronic pen (300) when the pen tip comes into contact with the pattern paper. The electronic pen (300) can provide information about the recognized pattern.

The electronic pen (300) can provide a writing means. The user can perform actions of writing, drawing, or painting on paper using the writing means while holding the electronic pen (300). The actions of the user writing, drawing, or painting on paper using the writing means can be called analog writing. Information generated by the user writing, drawing, or painting on paper using the writing means can be called writing information.

The electronic pen (300) can obtain handwriting information by a sensor. For example, the electronic pen (300) can sense a change in a pattern through at least one sensor included in the electronic pen (300) when the pen tip is moved while in contact with a patterned paper. The electronic pen (300) can obtain handwriting information based on information about a change in the recognized pattern.

FIG. 1b is a drawing for reference in explaining a system according to an embodiment of the present invention.

Referring to the drawing, the system (10b) of Fig. 1b is a system that implements a face-to-face class method (classroom class method) that converts analog handwriting into digital data and uses it. The system (10b) can provide a face-to-face class environment in which writing education based on analog handwriting is possible.

When a teacher uses an electronic pen (300) to write analog on paper with a pattern printed on it, the analog writing can be converted into digital data and displayed on the display unit. The display unit can be understood as an educational screen output device placed in a classroom. Meanwhile, the display unit can include a projector system that uses the pattern paper as a screen and outputs a screen by shining light on the pattern paper. In this case, when writing analog on the pattern paper while the screen is displayed on the pattern paper, the analog writing can be converted into digital data.

When a student uses an electronic pen (300) to write analog handwriting on paper with a pattern printed on it, the analog handwriting can be converted into digital data. The converted data can be displayed on the display unit or stored in the memory of the electronic device (100).

The system (50) may include an electronic device (100) and a plurality of electronic pens (300). Depending on the embodiment, the system (50) may further include an LMS (50), a gateway (102), and an output device (150), either individually or in combination.

LMS (50) is a system that supports and manages learners' learning. LMS (50) can be implemented as a server. For example, LMS (50) includes at least one of a cloud server, an IMS (IP Multimedia Subsystem) server, a Telephony Application server, an IM (Instant Messaging) server, an MGCF (Media Gateway Control Function) server, an MSG (Messaging Gateway) server, a CSCF (Call Session Control Function) server, etc., and can be implemented through these.

The LMS (50) can manage content, data or information. When there is a request for at least one of content, data and information from an electronic device (100), the LMS (50) can provide the requested information to the electronic device (100).

The LMS (50) can exchange content, data or information with an electronic device (100) through at least one wired or wireless network.

The electronic device (100) may be referred to as a teacher terminal. The electronic device (100) may be described as a terminal used by a teacher for teaching. Depending on the embodiment, the electronic device (100) may also be described as a presentation terminal. The electronic device (100) may be a fixed terminal or a mobile terminal capable of computing.

The electronic device (100) can exchange content, data or information with the LMS (50) via at least one wired or wireless network.

The electronic device (100) can communicate wirelessly with the electronic pen (300). For example, the electronic device (100) can exchange signals with the electronic pen (300) via short-range communication (e.g., Bluetooth).

The electronic device (100) may also communicate wirelessly with a plurality of electronic pens (300) via a gateway (102). In this case, the gateway (102) may transmit information received from a plurality of electronic pens (300) to the electronic device (100) and transmit information received from the electronic device (100) to a plurality of electronic pens (300).

The electronic device (100) can receive information from a plurality of electronic pens (300). The electronic device (100) can receive information generated from each of the plurality of electronic pens (300) through wireless communication. The information can include paper information and handwriting information generated by the electronic pens (300).

The electronic device (100) can control the output device (150) based on information generated from at least one of a plurality of electronic pens (300). Analog handwriting by the electronic pen (300) can be converted into a digital signal and used as an input signal for controlling the output device (150).

The electronic device (100) may include a writing program (101). The writing program (101) may be implemented as software. The writing program (101) may be described as a program that assists in the progress of a class based on information received from an electronic pen (300). The writing program (101) may be driven by a processor of the electronic device (100).

FIG. 2 is a drawing for reference in explaining the configuration of an electronic device and an electronic pen according to an embodiment of the present invention.

Referring to the drawing, the electronic pen (300) may include a communication unit (310), a sensor unit (320), and a processor (370). The electronic pen (300) may include a writing means for writing analog on pattern paper.

The communication unit (310) may include at least one antenna and an RF (Radio Frequency) circuit for performing wireless communication. The communication unit (310) may transmit information to the electronic device (100).

The sensor unit (320) can recognize the pattern of the pattern paper. The sensor unit (320) can include at least one of an image sensor, a pressure sensor, and a posture sensor. The image sensor can obtain a pattern image of the pattern paper. The pressure sensor can detect pen pressure. The posture sensor can detect the posture of the electronic pen (300).

The processor (370) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

The processor (370) may be driven by power provided from a power supply unit. The processor (370) may receive data, process data, generate signals, and provide signals while being powered by the power supply unit.

The processor (370) can control each unit of the electronic pen (300). The processor (370) is electrically connected to the sensor unit (320) and the communication unit (310) and can control the sensor unit (320) and the communication unit (310).

The processor (370) can transmit information acquired from the sensor unit (320) to the electronic device (100) through the communication unit (310).

The following description of the electronic device (100) can be applied to the first electronic device (100) of FIG. 1a and the electronic device (100) of FIG. 1.

An electronic device (100) can use analog handwriting as a digital input signal.

The electronic device (100) may include a communication unit (110), a memory (140), and a processor (170).

The communication unit (110) may include at least one antenna and RF (Radio Frequency) circuit for performing wireless communication. The communication unit (110) may exchange data with an external electronic device. Meanwhile, the external electronic device is a concept including an electronic pen (300), an LMS (50), a user terminal (e.g., a student terminal), a server, etc., and means a device capable of exchanging signals, data, and information through at least one communication protocol, excluding the electronic device (100).

The communication unit (110) can receive information from the electronic pen (300).

The communication unit (110) can receive information generated by recognizing a pattern printed on paper from the electronic pen (300).

The information may include information about a pattern printed on paper and handwriting information generated by an electronic pen (300).

The memory (140) is electrically connected to the processor (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input/output data. The memory (140) can store data processed by the processor (170). The memory (140) can be configured as at least one of a ROM, a RAM, an EPROM, a flash drive, and a hard drive in terms of hardware. The memory (140) can store various data for the operation of the entire electronic device (100), such as a program for processing or controlling the processor (170). The memory (140) can be implemented as an integral part of the processor (170). Depending on the embodiment, the memory (140) can be classified as a sub-component of the processor (170).

The memory (140) can match and store paper information and content. For example, the memory (140) can match and store the first note ID and the first educational content among the paper information. For example, the memory (140) can match and store the first page ID and the first page of the first educational content.

The processor (170) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

The processor (170) may be driven by power provided from a power supply unit. The processor (170) may receive data, process data, generate signals, and provide signals while being powered by the power supply unit.

The processor (170) can perform a preset operation based on the information received from the electronic pen (300). The processor (170) can control the output device (150) based on the information received from the electronic pen (300). For example, the processor (170) can control the display unit (151) based on the information received from the electronic pen (300). For example, the processor (170) can control the sound output unit (152) based on the information received from the electronic pen (300).

The handwriting information can be determined based on the description by the electronic pen (300) for the area set on the paper. The processor (170) can generate a control signal so that an operation matching the area is performed. Here, the control signal can be a signal that controls the output device (150). The control signal can be a signal that controls the display unit (151). The control signal can be a signal that controls the audio output unit (152).

Paper information may include page ID information.

The processor (170) may generate a first control signal to display a screen matching the page ID when first handwriting information for the first area of the paper is received. The display unit (151) may display a screen matching the page ID when the first control signal is received.

The first handwriting information for the first area of the paper and the screen display operation matching the page ID can be matched and stored in the memory (140). When the first handwriting information for the first area is received, the processor (170) can use this as an input signal. The processor (170) can generate a first control signal for controlling the display unit (151) so that a screen matching the page ID is displayed according to the input signal.

The processor (170) may generate a second control signal to perform at least one of preset video playback, preset webpage display, and preset file execution when a second handwriting input for a second area of the paper is received. The display unit (151) may play the preset video when receiving the second control signal. Alternatively, the display unit (151) may display the preset webpage when receiving the second control signal. Alternatively, the display unit (151) may display the preset file when receiving the second control signal.

The second handwriting information for the second area of the paper and the video playback operation may be matched and stored in the memory (140). Alternatively, the second handwriting information for the second area of the paper and the preset webpage display operation may be matched and stored in the memory (140). Alternatively, the second handwriting information for the second area of the paper and the preset file display operation may be matched and stored in the memory (140). When the second handwriting information for the second area is received, the processor (170) may use this as an input signal. The processor (170) may generate a second control signal for controlling the display unit (151) so that at least one of the preset video playback, the preset webpage display, and the preset file execution is performed according to the input signal.

The processor (170) may generate a third control signal to display the next screen of the screen matching the page ID when a third handwriting input for the third area of the paper is received. The display unit (151) may display the next screen of the screen matching the page ID when the third control signal is received.

The third handwriting information for the third area of the paper and the next screen display operation of the screen matching the page ID can be matched and stored in the memory (140). When the processor (170) receives the third handwriting information for the third area, it can use this as an input signal. The processor (170) can generate a third control signal that controls the display unit (151) to display the next screen of the screen matching the page ID according to the input signal.

The handwriting information can be determined according to a shape drawn on paper by an electronic pen (300). The processor (170) can generate a control signal so that an operation matching the shape is performed. Here, the control signal can be a signal that controls the output device (150). The control signal can be a signal that controls the display unit (151). The control signal can be a signal that controls the audio output unit (152).

The output device (150) may be operated under the control of the electronic device (100). Depending on the embodiment, the output device (150) may be classified as a sub-concept of the electronic device (100). Depending on the embodiment, the output device (150) may be physically separated from the electronic device (100) and may be described as a separate device from the electronic device (100).

The output device (150) is a device for generating output related to vision or hearing. The output device (150) may include a display unit (151) and an audio output unit (152).

The display unit (151) can display graphic objects corresponding to various information.

The display unit (151) may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

The display unit (151) may include a pattern paper and a projector. In this case, the pattern paper may function as a screen. The projector may output a screen by irradiating light onto the pattern paper. When analog writing is performed on the pattern paper using an electronic pen (300), the analog writing may be converted into digital data.

The audio output unit (152) converts an electric signal provided from the processor (270) or the control unit (170) into an audio signal and outputs it. To this end, the audio output unit (152) may include one or more speakers.

FIG. 3 is a drawing for reference in explaining information received from an electronic pen according to an embodiment of the present invention.

Referring to the drawing, information received from the electronic pen (300) may include paper information and handwriting information generated by the electronic pen (300). Here, paper means paper on which a pattern is printed.

Paper information (390) may include information about X coordinates (391), information about Y coordinates (392), pattern information (393), pressure information (394), time information (395), owner ID information (396), note ID information (397), and page ID information (398).

Information on the X coordinate (391) may mean information on the X coordinate of the point of contact when the nib of the electronic pen (300) is in contact with the paper. The electronic pen (300) may recognize the pattern of the point of contact of the nib and generate information on the X coordinate.

Information on the Y coordinate (392) may mean information on the Y coordinate of the point of contact when the nib of the electronic pen (300) is in contact with the paper. The electronic pen (300) may recognize the pattern of the point of contact of the nib and generate information on the Y coordinate.

Pattern information (393) may include at least one of information about the way a pattern is formed, information about the rules of the pattern, information about the shape of the pattern, information about the interval between patterns, information about the size of the pattern, and information about the slope of the pattern. Pattern information (393) may include ID information unique to the pattern paper.

Pressure information (394) may refer to information about writing pressure when the tip of the electronic pen (300) is in contact with the paper.

Time information (395) may mean information about the time measured from the time the tip of the electronic pen (300) first contacts the paper to the time the contact ends.

Owner ID information (396) may be information about the owner of the paper. For example, if content is printed on paper and matches the pattern, the owner ID may be designated as the owner of the content, and the owner ID information (396) may be content owner information.

Note ID information (397) may mean file ID information defined as a set of multiple sheets of paper. For example, when printing one electronic document file consisting of multiple pages, multiple sheets of paper are output, and the set of multiple sheets of paper can be described as a note or file, and information about an ID assigned to a note or file can be described as note ID information.

Page ID information (398) may mean information about an ID assigned to each piece of paper that makes up a note.

Writing means changing the position on the paper while the pen tip is in contact with the paper, and writing information can be defined as information generated by writing. The sensor unit (320) of the electronic pen (300) can detect a change in the pattern according to the movement of the pen tip. The electronic pen (300) can generate writing information based on the change in the pattern.

The handwriting information may be provided to the electronic device (100) in a state of being converted into a digital signal. The electronic device (100) may display the contents of the handwriting on the display unit (151) based on the handwriting information. Alternatively, the electronic device (100) may control the output device (150) based on the handwriting information.

FIG. 4 is a drawing for reference in explaining paper on which a pattern is printed according to an embodiment of the present invention.

Referring to the drawing, the pattern paper (410) can be described as paper on which a predetermined pattern is printed. The pattern can be printed through a printer. One page of specific content can be printed on the pattern paper (410).

The pattern paper (410) can be divided into multiple areas. The areas can be defined by the user. The pattern paper (410) can have different pattern forms depending on the location of the pattern paper (410). The pattern form can be determined by factors such as the shape of the pattern, the spacing between patterns, the size of the pattern, and the inclination of the pattern.

FIGS. 5A to 5D are drawings for reference in explaining patterns according to embodiments of the present invention. FIGS. 5A to 5D are enlarged views of 420 in FIG. 4 and show embodiments of various patterns.

As illustrated in FIG. 5A, a pattern form can be determined based on the intervals (511, 512) between points. For example, a pattern of a pattern sheet (410) can be defined based on a first interval (511) between a point of a first coordinate and a point of a second coordinate and an interval (512) between a point of a third coordinate and a point of a fourth coordinate. Based on the pattern of the pattern sheet (410), a unique ID of the pattern sheet (410) can be assigned. A plurality of pattern sheets can be distinguished from each other by the pattern of the pattern sheet (410). In addition, X and Y coordinates within the pattern sheet (410) can be distinguished by the pattern of the pattern sheet (410).

As illustrated in FIG. 5b, a pattern form can be determined based on the shapes (521, 522) of points. For example, a pattern of a pattern sheet (410) can be defined based on a first shape of a point of a first coordinate and a second shape of a point of a second coordinate. Based on the pattern of the pattern sheet (410), a unique ID of the pattern sheet (410) can be assigned. A plurality of pattern sheets can be distinguished from each other by the pattern of the pattern sheet (410). In addition, X and Y coordinates within the pattern sheet (410) can be distinguished by the pattern of the pattern sheet (410).

As illustrated in FIG. 5c, a pattern form can be determined based on the sizes (531, 532) of points. For example, a pattern of a pattern sheet (410) can be defined based on a first size of a point of a first coordinate and a second size of a point of a second coordinate. Based on the pattern of the pattern sheet (410), a unique ID of the pattern sheet (410) can be assigned. A plurality of pattern sheets can be distinguished from each other by the pattern of the pattern sheet (410). In addition, X and Y coordinates within the pattern sheet (410) can be distinguished by the pattern of the pattern sheet (410).

As illustrated in FIG. 5d, when a point has an elongated shape, a pattern form can be determined based on the inclination of the point with respect to the X-axis or the Y-axis. For example, a pattern of a pattern sheet (410) can be defined based on a first inclination of a point of a first coordinate and a second inclination of a point of a second coordinate. Based on the pattern of the pattern sheet (410), a unique ID of the pattern sheet (410) can be assigned. A plurality of pattern sheets can be distinguished from each other by the pattern of the pattern sheet (410). In addition, X and Y coordinates within the pattern sheet (410) can be distinguished by the pattern of the pattern sheet (410).

FIG. 6 is a drawing for reference in explaining handwriting input according to an embodiment of the present invention.

Referring to the drawing, the pattern paper (600) may include a plurality of areas (610, 620, 630, 640, 650, 660).

The electronic pen (300) can detect handwriting input for one of a plurality of areas. The electronic pen (300) can transmit handwriting information for the corresponding area to the electronic device (100).

The processor (170) can generate a control signal so that the output device (150) performs a preset operation when a handwriting input is received for any one of the plurality of areas.

Each of the plurality of areas has a different pattern printed on it, and the electronic pen (300) can recognize the different patterns. The processor (170) can determine which area the handwriting input is made in through pattern recognition by the electronic pen (300).

The memory (140) can store operation information of an output device (150) that matches each of the plurality of areas. The processor (170) can generate a control signal so that a matched operation is performed when a handwriting input for any one of the plurality of areas is received.

When a handwriting input for the first area (610) is received, the processor (170) can generate a control signal so that the display unit (151) corresponding to the page ID is displayed according to the operation information stored in the memory (140).

The memory (140) can store the owner ID information, note ID information, and page ID information of the pattern paper (600) together with the pattern information. The processor (170) can call the information stored in the memory (140) and check the page ID information based on the ID information unique to the pattern paper (600) obtained by handwriting input for the first area (610). The processor (170) can generate a control signal so that a screen corresponding to the page ID information is displayed on the display unit (151).

When a handwriting input for the second area (620) is received, the processor (170) can generate a control signal to play a video, display a preset webpage, or display a preset file through the display unit (151) according to the motion information stored in the memory (140).

When a handwriting input for the third area (630) is received, the processor (170) can generate a control signal so that the next screen matching the page ID is displayed on the display unit (151) through the display unit (151) according to the operation information stored in the memory (140).

When a handwriting input for the fourth area (630) is received, the processor (170) can generate a control signal so that the previous screen of the screen matching the page ID is displayed on the display unit (151) based on the operation information stored in the memory (140).

When a handwriting input for the fifth area (650) is received, the processor (170) can generate a control signal to display owner ID information through the display unit (151) according to the operation information stored in the memory (140).

When a handwriting input for the sixth area (660) is received, the processor (170) can generate a control signal to display note ID information through the display unit (151) according to the operation information stored in the memory (140).

FIG. 7 is a drawing for reference in explaining handwriting input according to an embodiment of the present invention.

Referring to the drawing, handwriting input can be performed by writing a specific shape (710, 720, 730, 740, 750, 760, 770, 780, 790) on a pattern paper (700). Handwriting input can be performed by writing symbols, text (e.g., Korean consonants, Korean vowels, alphabets), shapes (e.g., circles, polygons), etc.

The electronic pen (300) can recognize handwriting input by detecting changes in the pattern that occur when the tip of the electronic pen (300) moves. The electronic pen (300) can transmit handwriting information that is generated when the tip of the electronic pen (300) moves over the pattern paper (700) to the electronic device (100).

The processor (170) can generate a control signal so that the output device (150) performs a preset operation when a handwriting input describing a specific shape is received.

The memory (140) can store operation information of an output device (150) that matches a specific shape. The processor (170) can generate a control signal so that a matched operation is performed when a handwriting input describing a specific shape is received.

FIGS. 8 and 9 are drawings for reference in explaining a remote class system according to an embodiment of the present invention.

Referring to the drawing, the system (10a) is a system that implements a remote class method that converts analog handwriting into digital data and uses it. The system (10a) can provide a remote class environment in which writing education based on analog handwriting is possible.

The system (10a) may include an LMS (Learning management system), a first electronic device (100), a second electronic device (200), and an electronic pen (300). The electronic pen (300) is for a teacher and a student. The electronic pen for a teacher may communicate with the first electronic device (100), and the electronic pen for a student may communicate with the second electronic device (200).

The first electronic device (100) may be applied with the description of the electronic device (100) described with reference to FIGS. 1A to 7. The first electronic device (100) may be any one of a smart phone, a tablet PC, a notebook, a desktop, a smart TV, and an electronic whiteboard.

The second electronic device (200) may be applied with the description of the electronic device (100) described with reference to FIGS. 1A to 7. It may be any one of a smart phone, a tablet PC, a notebook, a desktop, and a smart TV.

Referring to FIG. 8, the teacher's pen data broadcasting process is examined. The first electronic device (100) can retrieve lesson materials based on user (teacher) input. The first electronic device (100) can retrieve lesson materials from the LMS (50). According to an embodiment, the first electronic device (100) can also retrieve lesson materials stored in the memory (140).

The electronic pen (300) can recognize the teacher's writing input on the pattern paper. The writing input can be explained as a sub-concept of handwriting input, and the creator is the teacher. The electronic pen (300) can transmit the writing information to the first electronic device (100). In this case, the electronic pen (300) can transmit the information to the first electronic device (100) using short-range wireless communication (e.g., Bluetooth).

The first electronic device (100) can transmit the writing information to the second electronic device (200) through the connection manager (102) of the writing program (101). The connection manager (102) can transmit the writing information to the second electronic device (200) through at least one network through the lower components, namely, the Bluetooth manager, the socket manager, and the socket broadcast.

The second electronic device (200) can display a screen corresponding to the written information through a display.

Through this process, the teacher can convey the content written on the board using an electronic pen (300) to students located remotely.

Referring to FIG. 9, when examining the student's pen data transmission process, the electronic pen (300) can recognize the student's handwriting input made on the pattern paper. The electronic pen (300) can transmit the handwriting information to the second electronic device (200). In this case, the electronic pen (300) can transmit the information to the second electronic device (200) using short-range wireless communication (e.g., Bluetooth).

The second electronic device (200) can transmit handwriting information to the first electronic device (100) via at least one network.

The first electronic device (100) can receive handwriting information from the second electronic device (200). The first electronic device (100) can receive handwriting information through the connection manager (102) of the writing program (101). The connection manager (102) can receive handwriting information through a lower component, a socket manager.

The first electronic device (100) can display a screen corresponding to handwriting information through the display unit (151).

Through this process, the student can convey to the teacher the content written using the electronic pen (300).

Through this process, the system (10a) can provide a class environment in which real-time two-way writing classes based on an electronic pen (300) are possible in a non-face-to-face environment.

The system (10a) can support student-participatory classes through a teacher-centered writing program (101).

The judgement program (101) can manage the teacher's judgement input information and the student's handwriting information by using the pattern of the pattern paper.

The system (10a) can recognize various teaching materials based on patterns of pattern sheets through the mobile service of the LMS (50), the writing program (101) and the second electronic device (200), conduct interactive writing-based (e.g., editing) classes, and record them.

The system (10a) can support both teachers and students to check and share past classes through LMS (50).

FIG. 10 is a drawing for reference in explaining a remote class method according to an embodiment of the present invention.

Referring to the drawing, the teacher terminal (100) can request teaching materials from the LMS (50) (S1005).

The teacher terminal (100) can receive teaching materials from the LMS (S1010).

The teacher terminal (100) and the student terminal (200) can share a screen based on class materials (S1015). The teacher terminal (100) can display a screen based on class materials on the display unit (151). The student terminal (200) can display a screen based on class materials on the display.

The teacher terminal (100) can receive first handwriting information generated by recognizing a pattern printed on paper from the first electronic pen (S1020). The first handwriting information can be described as writing information. The first electronic pen can be described as an electronic pen (300) used by the teacher.

The teacher terminal (100) can transmit the first handwriting information to the student terminal (200) (S1025).

The student terminal (200) can display class materials reflecting the first handwriting information (S1026).

The teacher terminal (100) can update content based on the first handwritten information on top of the teaching materials (S1027).

The teacher terminal (100) can transmit updated class materials to the LMS (50) (S1030).

The student terminal (200) can receive second handwriting information generated by recognizing a pattern printed on paper from the second electronic pen (S1035). The second electronic pen can be described as an electronic pen (300) used by the student.

The student terminal (200) can transmit second handwriting information to the teacher terminal (100) (S1040).

The teacher terminal (100) can receive third handwriting information generated by recognizing a pattern printed on paper from the first electronic pen (S1045). The third handwriting information can be described as correction information generated by the first electronic pen on top of handwriting by the second electronic pen.

The teacher terminal (100) can transmit third handwriting information to the student terminal (200) (S1050).

The student terminal (200) can display class materials reflecting third-party handwriting information (S1046).

The teacher terminal (100) can update content based on third-party written information on top of the teaching materials (S1052).

The teacher terminal (100) can transmit updated class materials to the LMS (50) (S1055).

The teacher terminal (100) and student terminal (200) can end the class (S1060).

LMS (50) can provide updated class materials to at least one of the teacher terminal (100) and the student terminal (200) (S1070, S1080).

The teacher terminal (100) can request update data from the LMS (50) (S1065).

LMS (50) can provide update data to the teacher terminal (100) (S1070).

The student terminal (200) can request update data from the LMS (50) (S1075).

LMS (50) can provide update data to the student terminal (200) (S1080).

Through this process, teachers and students can re-check and share class content through LMS (50).

The above-described present invention can be implemented as a computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc. In addition, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as limiting in all aspects but should be considered as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

10a: Remote learning system
10b: Classroom Teaching System
100 : Electronic devices, teacher terminals
200 : Electronic devices, student terminals
300 : Electronic Pen

Claims (10)

A communication unit that receives information generated by recognizing a pattern printed on paper from an electronic pen;
A memory storing a plurality of operation information of an output device matching a plurality of shapes; and
A processor for performing a preset operation based on the above information;
The above information is,
Contains handwriting information determined according to a shape drawn by the electronic pen on the paper,
The above processor,
When a handwriting input is received in the form of describing a first shape among the above multiple shapes,
Generate a control signal so that a first operation matching the first shape is performed in the output device,
The above paper,
An electronic device that uses analog handwriting as a digital input signal, wherein the pattern is defined based on a first shape of a point printed at a first coordinate of the paper and a second shape of a point printed at a second coordinate of the paper. In paragraph 1,
The above information is,
An electronic device that uses analog handwriting containing the above paper information as a digital input signal. In the second paragraph,
The above paper information is,
Contains page ID information,
The above processor,
An electronic device that uses analog handwriting as a digital input signal to generate a first control signal so that a screen matching the page ID is displayed when first handwriting information for a first area of the paper is received. In the third paragraph,
The above processor,
An electronic device that uses analog handwriting as a digital input signal to generate a second control signal so that at least one of preset video playback, preset web page display, and preset file display is performed when a second handwriting input for a second area of the paper is received. In the third paragraph,
The above processor,
An electronic device that uses analog handwriting as a digital input signal to generate a third control signal so that the next screen of the screen matching the page ID is displayed when a third handwriting input for the third area of the above paper is received. delete The step where the teacher's terminal receives class materials from the LMS (Learning management system);
A step in which a screen based on the above teaching materials is shared between the teacher's terminal and the student's terminal;
A step in which a teacher terminal receives first handwriting information, which is generated by recognizing a pattern printed on paper and defined as writing information, from a first electronic pen;
A step in which the teacher terminal transmits the first handwriting information to the student terminal;
A step in which the student terminal displays class materials reflecting the first written information;
A step of the teacher terminal updating content based on the first handwritten information on the teaching materials;
A step in which the teacher terminal transmits updated class materials to the LMS;
A step in which the student terminal receives second handwriting information generated by recognizing a pattern printed on paper from a second electronic pen;
A step in which the student terminal transmits the second handwriting information to the teacher terminal;
A step in which the teacher terminal receives, from the first electronic pen, third handwriting information defined as correction information generated by the first electronic pen on top of handwriting by the second electronic pen;
The step of the teacher terminal transmitting the third handwriting information to the student terminal; and
The LMS comprises a step of providing updated lesson materials to at least one of a teacher terminal and a student terminal;
The above paper,
A remote teaching method that converts analog handwriting into digital data and uses pattern paper in which a pattern is defined based on a first shape of a point printed at a first coordinate of the paper and a second shape of a point printed at a second coordinate of the paper.
delete delete delete