KR102353940B1 - Education system with multipurpose pen - Google Patents

Abstract

Disclosed is a two-way learning system comprising: a net-board formed of a display device having a communication function; and a multi-purpose pen formed in a form of a pen, generating pen input data by detecting a trajectory of a pen input inputted to a paper, and transmitting the pen input data to the net-board. Therefore, the present invention is capable of exquisitely reproducing a pen input of a user.

Description

EDUCATION SYSTEM WITH MULTIPURPOSE PEN

The present invention relates to a multi-purpose pen, and more particularly, to a multi-purpose pen capable of digitizing and providing the contents written on paper by a user.

With the development of digital technology, users can take notes in various ways using various digital devices. For example, by using a wireless pen mouse to write or draw a picture, the above text or picture can be displayed on a computer or laptop connected to the wireless pen mouse. In addition, it is also possible to take notes using a touch pen directly on a smartphone or tablet PC equipped with a touch screen.

However, when writing characters using such a conventional wireless pen mouse or touch pen, the user's pen input involves the movement of the touch pen itself, such as the spacing between characters, so that the user's pen input touches the user's pen input. The pen movement must be compensated to accurately reproduce the user's pen input. To this end, various attempts have been made to recognize and track the movement of the touch pen.

First, a dedicated pad for coordinate recognition may be used to recognize the movement of the touch pen. Using the electronic response between the slip recognition pad and the touch pen that occurs when using the touch pen on the coordinate recognition dedicated pad, it is possible to set accurate coordinates between the pen input input by the touch pen, and based on this, the user Pen input can be recognized.

As another approach, a localization communication device may be used. The positioning device continuously communicates with the electronic pen and tracks the movement of the electronic pen. In particular, it is possible to measure the positions of the electronic pen by measuring a relative distance between them through communication with the electronic pen, and to recognize the positions between pen inputs input through the electronic pen.

As another attempt, a note dedicated to coordinate recognition may be used. This can recognize the pattern formed on the coordinate recognition dedicated note using an electronic pen equipped with a camera, and recognize the position between the user's pen inputs based on this.

However, these attempts are not economical in terms of cost and cause inconvenience to users because separate devices such as a dedicated pad for coordinate recognition, a location measurement device, and a notebook for coordinate recognition are required in addition to the electronic pen.

Therefore, there is a need for a technology capable of improving the user's convenience while being cost-effective by solving these problems.

One aspect of the present invention discloses a multi-purpose pen that generates pen input data by detecting a trajectory of a pen input by a user, and transmits the generated pen input data to a remote netboard for display.

Another aspect of the present invention discloses a multi-purpose pen for generating pen input data by converting a user's voice input into text.

Another aspect of the present invention discloses a multi-purpose pen for generating an erase operation by a user as erase data.

Another aspect of the present invention discloses a multi-purpose pen for identifying pen input data using a deep learning neural network.

Another aspect of the present invention discloses an interactive learning system in which a plurality of students and instructors can participate together using a plurality of multi-purpose pens.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

A multi-purpose pen according to an embodiment of the present invention includes a writing unit that generates pen input data by detecting a trajectory of pen input input to paper, and transmits the pen input data to a remote netboard.

On the other hand, is formed at the end of the multi-purpose pen, a touch sensing unit for sensing a contact according to the user's pen input; an optical sensor unit formed at an end of the multi-purpose pen and sensing a trajectory of a user's pen input; a motion sensing unit formed on at least one side of the multi-purpose pen and detecting a state change such as at least one of rotation, movement, and inclination on at least one axis of the multi-purpose pen; a pen input analysis unit generating pen input data in consideration of the movement of the multi-purpose pen; and an eraser for generating erase data in consideration of the movement of the multi-purpose pen.

The pen input analysis unit generates a trajectory of the pen input sensed by the photosensor unit as a first pen input while the contact is sensed by the contact sensing unit, and performs the pen input determined by the contact sensing unit. generating a second pen input not accompanied by a contact sensed by the contact sensing unit from whether or not and a state change sensed by the motion sensing unit, and generating a pen input of one of the first pen input and the second pen input When this other pen input is followed, the pen input start point of one pen input is the same as the pen input end point of the other pen input, and the pen input data is generated;

The eraser unit outputs the last pen input data from the netboard when the eraser detects a state change in the left-right direction among the state changes sensed by the motion sensing unit while the touch is detected by the touch sensing unit. The deletion data including a deletion operation command of the pen input data output by a predetermined distance to the left or right from the selected point may be generated.

In addition, the writing unit collects alphabet shape data of a specific language including at least one shape for any one alphabet, extracts feature values, and repeats learning through a deep neural network to build a text shape analysis model, , by inputting the pen input data into the text shape analysis model to identify a characteristic value of the corresponding pen input data and an alphabet indicated by the characteristic value, convert the identified alphabet into a specific font, and transmit it to the netboard.

In addition, the communication unit for transmitting the pen input data to the netboard; a memory unit configured to store the pen input data; and a user interface unit receiving a user command for controlling the multi-purpose pen.

The multi-purpose pen may further include a microphone unit formed on at least one side of the multi-purpose pen to receive a voice signal from a user, convert it into a text form, and generate the pen input data.

According to the present invention described above, it is possible to precisely reproduce the user's pen input by recognizing the movement of the pen input device without a separate auxiliary device.

1 is a perspective view of a multi-purpose pen according to an embodiment of the present invention.
2 is a control block diagram of a writing unit according to an embodiment of the present invention.
3 shows an exemplary operation of a multi-purpose pen according to an embodiment of the present invention.
4 is a flowchart illustrating a method of operating a multi-purpose pen according to an embodiment of the present invention.
FIG. 5 shows a flow diagram illustrating one embodiment of step 540 shown in FIG.
6 is a control block diagram of a writing unit according to another embodiment of the present invention.
7 is a control block diagram of a writing unit according to another embodiment of the present invention.
8 to 12 are conceptual diagrams of an interactive learning system according to an embodiment of the present invention.
13 to 18 are views showing a conventional digital pen.
19 and 20 are views showing a multi-purpose pen according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in a variety of different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, "comprises" and/or "comprising" refers to the stated elements, steps, and acts do not exclude the presence or addition of one or more other elements, steps and acts.

1 is a perspective view of a multi-purpose pen according to an embodiment of the present invention.

Referring to FIG. 1 , the multi-purpose pen 100 according to an embodiment of the present invention may be formed in a pen shape, and a mixed resin of ABS (Acrylonitrite Butadiene Styrene Copolymer) and PC (Poly Carbonate), PP (Poly Ropylene) , synthetic resins such as PPS (Poly Phenylene Sulfide), PMMA synthetic resin, PS synthetic resin, glass, metals, etc. may be made of silver material.

The multi-purpose pen 100 according to an embodiment of the present invention may have the same diameter or may be configured in an upper-gwang-low-nose shape, and a cover (not shown) may be provided at both ends.

The multi-purpose pen 100 according to an embodiment of the present invention generates pen input data by using ink (or graphite) to detect an auxiliary writing unit capable of directly inputting pen input data on paper and a trajectory of pen input, , a writing unit capable of inputting pen input data to a remote netboard may be included.

For example, the multipurpose pen 100 may generate pen input data through the writing unit while directly inputting pen input data with ink on paper through the auxiliary writing unit, and transmit the pen input data to a remote netboard for display. have. A detailed description of the writing unit will be described later with reference to FIG. 2 .

The structure and shape of the multi-purpose pen 100 according to an embodiment of the present invention shown in FIG. 1 is exemplary, and various modifications are possible.

2 is a control block diagram of a writing unit according to an embodiment of the present invention.

Referring to FIG. 2 , the writing unit 200 according to an embodiment of the present invention includes a contact sensing unit 210 , an optical sensor unit 220 , a motion sensing unit 230 , a pen input analysis unit 240 , and a communication unit. 250 , a memory unit 260 , and a user interface unit 270 may be included.

The contact sensing unit 210 may be formed at the end of the multi-purpose pen 100 and may detect a contact according to a user's pen input.

The contact sensing unit 210 may come into contact with an external object such as paper or a pad by the user, and may determine whether pen input is performed by the user by detecting such contact.

The touch sensing unit 210 may include a touch sensor for sensing a touch according to a pen input, but is not limited to this configuration and various modifications are possible.

The optical sensor unit 220 may be formed at the end of the multi-purpose pen 100 and may detect the trajectory of the user's pen input.

The photosensor unit 220 may detect the movement of the end of the multi-purpose pen 100 by irradiating light to the outside, that is, the trajectory of the pen input.

The optical sensor unit 220 may include an optical sensor and at least one of a light emitting diode (LED), a laser sensor, and a blue track sensor to detect the trajectory of the pen input. When it is reflected by the desk or notebook and detected by the optical sensor, the trajectory of the pen input can be recognized by processing the signal of the optical sensor. The above configuration of the photosensor unit 220 is exemplary, and various configurations capable of detecting a trajectory of a pen input may be used in an embodiment to which the present invention is applied.

Since the photosensor 220 detects the trajectory of the pen input by irradiating light to the outside and sensing the reflected light accordingly, when the contact sensing unit 210 detects contact with the outside, a high recognition rate is achieved. can be seen However, according to various optical sensor units, even if the contact sensing unit 210 does not come into contact with the outside, it is possible to detect the trajectory of the pen input within a certain range (eg, a range of a certain distance or one recognition rate).

The motion sensing unit 230 may be formed on at least one side of the multi-purpose pen 100 , and may detect the overall movement of the multi-purpose pen 100 . That is, the motion detection unit 230 may detect a state change such as at least one of rotation, movement, and inclination on at least one axis of the multi-purpose pen 100 .

The motion detection unit 230 may be configured to include one or more of various types of measurement sensors to detect the motion of the multi-purpose pen 100 . For example, the measurement sensor may include at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor (compass, compass, compass, compass), and a geomagnetic sensor. The above configuration of the motion sensing unit 230 is exemplary, and various configurations may be applied according to an embodiment to which the present invention is applied.

The pen input analysis unit 240 may generate pen input data.

The pen input data is data related to a pen input input by a user, which is positioned in consideration of the movement of the multipurpose pen 100 , and may include a first pen input and a second pen input.

Here, the first pen input means a pen input accompanying contact, such as a character or a line reproduced through the multi-purpose pen 100 , for example, and the second pen input is, for example, or between a character and a character. A pen input that does not involve contact, such as a gap.

For example, the pen input of “gi” is composed of a first pen input of “a” and “l” and a second pen input equal to the interval between “a” and “l”.

The analysis by the pen input analysis unit 240 may be based on the detection results of the contact sensing unit 210 , the optical sensor unit 220 , and the motion sensing unit 230 .

Specifically, the pen input analysis unit 240 determines whether the pen input has been performed by the contact sensing unit 210 and the trajectory of the pen input detected by the optical sensor unit 220 by the contact sensing unit 210 . A first pen input may be generated that involves the sensed contact. That is, the trajectory of the pen input sensed by the photosensor 220 while the contact is sensed by the contact sensing unit 210 may be generated as the first pen input.

Subsequently, the second pen not accompanying the contact detected by the contact sensing unit 210 from whether the pen input determined by the contact sensing unit 210 is performed and the state change detected by the motion sensing unit 230 . You can create input.

That is, a state change sensed by the motion sensing unit 230 may be generated as the second pen input while no contact is detected by the contact sensing unit 210 .

When the first pen input and the second pen input are generated, the pen input analyzer 240 may generate pen input data by combining the first pen input and the second pen input. In the pen input data, when one pen input of the first pen input and the second pen input follows the other pen input, the pen input start point of one pen input is the pen input end point of the other pen input. By doing the same as above, it is possible to enable precise reproduction of continuous pen input.

The pen input analysis unit 240 generates a third pen input that does not involve contact from the trajectory of the pen input determined by the contact sensing unit 210 and whether the pen input is performed and the optical sensor unit 220 . can do.

That is, the trajectory of the pen input sensed by the photosensor 220 may be generated as the third pen input while the contact is not detected by the contact sensing unit 210 . When the pen input analyzer 240 generates the third pen input, the pen input analyzer 240 may compensate the second pen input by using the third pen input.

The detection of the pen input trajectory by the optical sensor unit 220 may show a high recognition rate when the contact sensing unit 210 detects a contact, but even if it does not involve contact, it may be within a certain range (eg, a constant distance or a constant recognition rate). within the range of ), it is possible to detect the pen input trajectory. Accordingly, the pen input analyzer 240 compensates for the second pen input by using the third pen input, thereby reflecting a more accurate motion of the multi-purpose pen to the pen input data.

On the other hand, the multi-purpose pen 100 does not include the optical sensor unit 220 , and thus the pen input analysis unit 240 receives pen input data based on the detection results of the contact sensing unit 210 and the motion sensing unit 230 . can also create

Specifically, the pen input analysis unit 240 receives the first pen input and the second pen input based on whether the pen input determined by the contact sensing unit 210 is performed and the state change detected by the motion sensing unit 230 . can create

That is, a state change sensed by the motion detection unit 230 is generated as a first pen input while the contact is detected by the contact detection unit 210 , and while the contact is not detected by the contact detection unit 210 . A state change detected by the motion detection unit 240 may be generated as a second pen input. When the first pen input and the second pen input are generated, the pen input analyzer 240 may generate pen input data by combining the first pen input and the second pen input.

In the pen input data, when one pen input of the first pen input and the second pen input follows the other pen input, the pen input start point of one pen input is the pen input end point of the other pen input. By doing the same as above, it is possible to enable precise reproduction of continuous pen input.

Meanwhile, the pen input analyzer 240 may determine whether pen input data corresponds to a character by using the deep learning learning model, and may identify the character.

For example, the pen input analysis unit 240 may collect alphabet shape data of a specific language to extract feature values, and may construct a text shape analysis model by repeatedly learning through a deep neural network. For example, the alphabet shape data may include at least one shape for any one alphabet.

In this case, the pen input analysis unit 240 can extract feature values representing each alphabet from the alphabet shape data using the Librosa library, and a fully connected neural network model having three hidden layers can be adopted as a deep neural network. .

The pen input analyzer 240 may input pen input data into the text form analysis model to extract feature values of the corresponding pen input data and alphabets indicated by the feature values.

The pen input analysis unit 240 may determine whether the generated pen input data corresponds to letters based on the detection results of the contact detection unit 210 and the motion detection unit 230 , and identifies the alphabet It can be converted to font.

When pen input data is converted into a specific font, the pen input analysis unit 240 may transmit and display the pen input data displayed in the specific font to a remote netboard through the communication unit 250 .

For example, the pen input analysis unit 240 may receive input whether to convert a font, a type of font to be converted, and the like through the user interface unit 270 to be described later.

The communication unit 250 may transmit at least one of the pen input data generated by the pen input analysis unit 240 and the pen input data stored in the memory unit 260 to a remote netboard.

The communication unit 250 may transmit pen input data in real time or may transmit pen input data according to the operation of the multi-purpose pen 100 .

For example, the communication unit 250 may transmit the pen input data stored in the memory unit 260 when the user interface unit 270 receives a user input related to the transmission of the pen input data.

Also, for example, when the touch sensing unit 210 does not detect a touch, the communication unit 250 may transmit the pen input data stored in the memory unit 260 immediately or after a predetermined time has elapsed.

The communication unit 250 communicates with an external terminal by a wired communication method such as a universal serial bus (USB) and a mouse port (PS/2 port), or wirelessly such as Bluetooth, infrared communication (IrDA) and other RF communication. It can communicate with an external terminal by a communication method. However, the present invention is not limited thereto and may be implemented in various types of wired/wireless communication methods capable of data communication.

The memory unit 260 may store pen input data generated by the pen input analysis unit 240 .

The pen input data stored in the memory unit 260 may be transmitted to the terminal by the communication unit 250 .

In one embodiment, if a communication connection is not established between the communication unit 250 and the terminal, pen input data is stored in the memory unit 260 , and then, when a communication connection is established between the communication unit 250 and the external terminal, the communication unit 250 may transmit pen input data stored in the memory unit 260 to an external terminal.

The user interface unit 270 may receive a user's input. The user's input may include a command for at least one of starting and ending an operation of the multi-purpose pen and transmitting the pen input data.

The user interface unit 270 may include, for example, an input device such as a button, a touch sensing device (or a touch sensor), a joystick or a wheel, and is configured to be exposed to the outside of the multi-purpose pen 100, One type of input device may be configured in plurality, or may be configured by combining them. Such a configuration is exemplary, and various configurations for receiving a user's input may be applied according to an embodiment applied to the present invention.

3 shows an exemplary operation of a multi-purpose pen according to an embodiment of the present invention.

Referring to FIG. 3A , the multi-purpose pen may generate pen inputs 410 , 430 , and 450 by detecting a motion of the multi-purpose pen by the user. The user's pen input is made in the order of the pen input 410, the pen input 430, and the pen input 450,

Here, the pen input 410 and the pen input 450 indicate a pen input accompanied by a contact, and the pen input 430 indicates a pen input that does not involve a contact.

The multi-purpose pen generates pen input data from the pen inputs 410, 430, and 450. In this case, the pen input end point 420 of the pen input 410 and The pen input start point 420 of the pen input 430 coincides with the pen input end point 440 of the pen input 430 and the pen input start point 440 of the pen input 450 coincide.

The pen input data is displayed as shown in FIG. 3B.

Referring to FIG. 3B , since the pen inputs 410 and 450 are pen inputs that involve contact, they are displayed with an outline or color, and the pen input 430 is transparent because it is a pen input that does not involve contact. is displayed, and the character "gi" is displayed as a whole.

4 is a flowchart illustrating a method of operating a multi-purpose pen according to an embodiment of the present invention.

In operation 510 , a contact according to a pen input may be detected. In step 510 , it may be determined whether a pen input is performed by the user by detecting a contact with an external object.

In operation 520, the trajectory of the user's pen input may be detected. The detection of the trajectory of the pen input performed in step 520 is performed while the touch according to the pen input is detected in step 510, or even if the contact according to the pen input is not detected in step 510, a certain range (eg, For example, it may be performed within a certain distance or a range of a certain recognition rate).

In operation 530, the movement of the multi-purpose pen, that is, a change in state of at least one of rotation, movement, and inclination on at least one axis may be detected.

In step 540 , pen input data is generated by analyzing whether the pen input determined in step 510 is performed, the trajectory of the pen input detected in step 520 and the state change detected in step 530 . can Here, the pen input data refers to data related to a pen input input by a user, which is positioned in consideration of the movement of the multi-purpose pen 200 .

In an embodiment, the method 500 may further include transmitting the pen input data to the external terminal.

As an example, the transmitting may be performed by transmitting pen input data in real time.

As an example, the transmitting may be performed by transmitting the pen input data according to a user input for transmitting the pen input data.

As an example, the transmitting may be performed by transmitting the pen input data immediately or after a predetermined time has elapsed if no contact is detected in step 510 .

In one embodiment, method 500 may further include storing the pen input data. The stored pen input data may be transmitted to the external terminal immediately or later.

As an example, the storing may be performed by storing the pen input data when a communication connection is not established between external terminals.

After a communication connection is established between the external terminals, the stored pen input data may be transmitted to the external terminal.

In one embodiment, the method 500 may further include receiving a user's input for at least one of initiating and terminating an operation of the multipurpose pen, and transmitting pen input data.

FIG. 5 shows a flow diagram illustrating one embodiment of step 540 shown in FIG.

4 and 5 , step 540 includes generating 610 a first pen input; generating (620) a second pen input; and combining the first pen input and the second pen input ( 630 ).

In operation 610 , the first pen input accompanying the contact may be generated based on whether the pen input is performed as determined in operation 510 and the trajectory of the pen input detected in operation 520 .

That is, the trajectory of the pen input detected in operation 520 while the contact is detected in operation 510 may be generated as the first pen input.

In operation 620 , a second pen input without contact may be generated based on whether the pen input determined in operation 510 0 and the state change detected in operation 520 . That is, the state change detected in step 520 may be generated as the second pen input while no contact is detected in step 510 .

In operation 630, pen input data may be generated by combining the first pen input and the second pen input.

In operation 630, in the pen input data, when one pen input of the first pen input and the second pen input follows the other pen input, the pen input starting point of one pen input is the other pen input. By making it the same as the end point of pen input of , it is possible to enable precise reproduction of continuous pen input.

Additionally, step 540 may further include generating a third pen input that does not involve contact from steps 510 and 520 .

That is, the trajectory of the pen input detected in operation 520 may be generated as the third pen input while no contact is detected in operation 510 .

Operation 540 may further include compensating for the second pen input by using the third pen input when the third pen input is generated.

Alternatively, step 520 in method 500 of FIG. 4 may be omitted. Accordingly, step 540 may be performed by analyzing the pen input from steps 510 and 530 to generate pen input data.

Specifically, step 540 determines whether the pen input determined in step 510 is performed and the state change sensed in step 530 to determine the first pen input accompanying the contact and the second pen input not accompanying the contact. It may include the step of generating.

That is, the state change sensed in step 530 is generated as the first pen input while the contact is detected in step 510 , and the state change detected in step 530 while no contact is detected in step 510 is generated in step 510 . may be generated as a second pen input.

Continuing, operation 540 may further include combining the first pen input and the second pen input to generate pen input data when the first pen input and the second pen input are generated.

In the combining step, in the pen input data, when one pen input of the first pen input and the second pen input follows the other pen input, the pen input starting point of one pen input is the other pen input. By making it equal to the end point of pen input of , it is possible to enable precise reproduction of continuous pen input.

Meanwhile, FIG. 6 is a control block diagram of a writing unit according to another embodiment of the present invention.

Referring to FIG. 6 , the writing unit 200 ′ according to another embodiment of the present invention includes the contact sensing unit 210 , the optical sensor unit 220 , the motion sensing unit 230 , and pen input analysis shown in FIG. 2 . In addition to the configuration of the unit 240 , the communication unit 250 , the memory unit 260 , and the user interface unit 270 , a microphone unit 280 may be further included.

In the following description, only the microphone unit 280 will be described, and the remaining contact sensing unit 210 , the optical sensor unit 220 , the motion sensing unit 230 , the pen input analysis unit 240 , the communication unit 250 , and the memory The configuration of the unit 260 and the user interface unit 270 will be replaced with those described above.

The microphone unit 280 may be formed on at least one side of the multi-objective pen 100 and may receive a voice signal from a user.

The microphone unit 280 may convert a voice signal input from the user into a text form to generate pen input data, and may transmit the converted pen input data through the communication unit 250 to a remote netboard.

The communication unit 250 transmits at least one of the pen input data generated by the pen input analysis unit 240 , the pen input data stored in the memory unit 260 , and the pen input data generated by the microphone unit 280 to a remote network network. can be transmitted to the board.

As an example, when a command for transmission of pen input data generated by the microphone unit 280 is input through the user interface unit 270 , the microphone unit 280 transmits the converted pen input data to a remote netboard. can

Meanwhile, FIG. 7 is a control block diagram of a writing unit according to another embodiment of the present invention.

Referring to FIG. 7 , a writing unit 200 ″ according to another embodiment of the present invention includes a contact sensing unit 210 , an optical sensor unit 220 , a motion sensing unit 230 and a pen shown in FIG. 6 . In addition to the configuration of the input analysis unit 240 , the communication unit 250 , the memory unit 260 , the user interface unit 270 , and the microphone unit 280 , an eraser unit 290 may be further included.

In the following description, only the eraser unit 290 will be described, and the remaining touch sensing unit 210 , the optical sensor unit 220 , the motion sensing unit 230 , the pen input analysis unit 240 , the communication unit 250 , and the memory The configuration of the unit 260, the user interface unit 270, and the microphone unit 280 will be replaced with those described above.

The eraser 290 may generate deletion data.

The deletion data may be data regarding a user's pen input deletion operation in consideration of the movement of the multi-purpose pen 100 . That is, the deletion data means an eraser operation input with respect to a pen input to be reproduced through the multi-purpose pen 100 .

The eraser unit 290 performs a motion while the contact is detected by the touch sensing unit 210 based on whether the pen input determined by the contact sensing unit 210 is performed and the state change detected by the motion sensing unit 230 . When a change in the state of left and right movement on at least one axis is sensed by the sensing unit 230 , deletion data may be generated.

That is, the eraser unit 290 may generate, as deletion data, a state change for movement in the left and right direction among the state changes sensed by the motion sensing unit 230 while the contact is detected by the contact sensing unit 210 . have.

For example, the deletion data may include a command to delete the pen input data output by a predetermined distance to the left or right from the point where the last pen input data was output.

The eraser unit 290 may transmit the generated deletion data to a remote netboard through the communication unit 250 .

For example, when a command for transmission of deletion data generated by the eraser 290 is input through the user interface unit 270 , the eraser unit 290 may transmit the deletion data to a remote netboard. In this case, the netboard may perform a deletion operation of the output pen input data according to the deletion data.

8 to 12 are conceptual diagrams of an interactive learning system according to an embodiment of the present invention.

Referring to FIG. 8 , the interactive learning system according to an embodiment of the present invention may include the multi-purpose pen 100 and the netboard 50 shown in FIGS. 1 to 7 .

A plurality of multi-purpose pens 100 may be provided, and each may include unique ID information.

As described above, the multi-purpose pen 100 transmits the pen input data generated by the pen input analysis unit 240 to the remote netboard 50 through the communication unit 250 , the pen input data stored in the memory unit 260 , and a microphone. At least one of the pen input data generated by the unit 280 may be transmitted.

Also, the multi-purpose pen 100 may transmit deletion data to the remote netboard 50 through the communication unit 250 .

In this case, the multi-purpose pen 100 may transmit pen input data or deletion data to the remote netboard 50 together with unique ID information.

The netboard 50 may be formed of a display device having a communication function (eg, an electronic blackboard, etc.).

The netboard 50 may display pen input data received from the multi-purpose pen 100 as shown in FIGS. 9 to 12 , and may delete at least a portion of the displayed pen input data according to the deletion data.

The netboard 50 may store ID information of each of the plurality of multi-purpose pens 100 in advance, and may display pen input data differently for each user based on the ID information received from the multi-purpose pen 100 .

For example, the netboard 50 may display pen input data by differently setting color, transparency, contrast, etc. for each ID information.

Such an interactive learning system can enhance the learning effect by implementing a writing system in which a plurality of students and instructors can participate together.

13 to 18 are views showing a conventional digital pen.

13 to 18 , the dual-mode digital pen 100 is provided on a body part 10 and one end of the body part 10 and displays graphic information by detecting position information on a recording medium having a dot pattern formed thereon. It may be configured to include a first writing unit 20 for generating information for generating information and a second writing unit 30 provided at the other end of the body unit 10 to display graphic information on a touch panel.

The body portion 10 is a mixed resin of ABS (Acrylonitrite Butadiene Styrene copolymer) and PC (Poly Carbonate), PP (PolyPropylene), PPS (Poly Phenylene Sulfide), etc., and a synthetic resin such as, PMMA synthetic resin, PS synthetic resin, glass, metal, etc. It can be made of material.

The body portion 10 may have the same diameter or may be configured in a shape of an upper-gwang-lower narrow, and a cover (not shown) may be provided at both ends.

The first writing unit 20 includes a first pen tip 21 configured in the form of a pen nib that can be written on paper, a first pressure sensor 25 for generating information on pen pressure applied to the first pen tip 21, and recording It may be configured to include an infrared sensor 23 for detecting infrared rays scattered on the medium 200 , a position information calculating unit 24 for detecting position information using the sensed infrared rays, and an infrared light source 26 .

The first pen tip portion 21 may be formed in the form of a pen tip protruding outward from one end of the body portion 10 . The first pen tip part 21 may be configured in the same shape as a nib such as a ballpoint pen, a marking pen, or a fountain pen, which is configured to enable writing on the recording medium 200 made of paper using the ink stored therein, for example. have.

The first pressure sensor 22 is adjacent to the first pen tip part 21 and may sense a pressure applied to the first pen tip part 21 .

The first pressure sensor 22 generates pen pressure information obtained by numerically calculating a pressure proportional to the force applied to the first pen tip 21 when the first pen tip 21 and the recording medium 200 come into contact. can do.

The infrared sensor 23 is located adjacent to the first pen tip portion 21 and may detect infrared rays scattered on the recording medium 200 .

The location information calculating unit 24 may recognize the dot pattern formed on the recording medium 200 using the infrared light detected by the infrared sensor 23 , and through this, the location information on the recording medium 200 is calculated. can

The dot pattern 400 includes a virtual grid line 420 and a plurality of marks 410 , and each mark 410 may be formed at regular intervals around the intersection of the virtual grid lines 420 . . Each mark 410 may provide position information based on a pattern value determined according to a position formed around the intersection of the virtual grid lines 420 .

The mark 410 may be formed of, for example, an infrared absorbing ink using a phthalocyanine-based compound, a naphthalocyanine-based compound, or an aluminum-based compound-based material.

The mark 410 is formed at regular intervals around the intersection of the virtual grid lines 420 and has each mark 410 value, and the mark 410 value is composed of a combination of at least two or more different numbers. can

The shape of the mark 410 has various shapes such as a circle, an ellipse, a polygon, and a straight line, but it is preferable that one type of mark 410 is used on one recording medium.

The mark 410 may exist in four positions according to the relationship with the intersection of the virtual grid lines 420, and when the mark 410 is located to the right of the intersection as in a, the value of the mark 410 is "1" When positioned at the top like ", b, the mark 410 value is set to "2", when positioned on the left like c, the mark 410 value is set to "3", and when positioned at the bottom like d, the mark By indicating the value of (410) as “4”, position information can be provided according to the position of the mark 410 with respect to the intersection of the virtual grid lines 420 .

In addition, the mark 410 may be formed in a diagonal direction rather than on the virtual grid line 420 , and a plurality of marks 410 may be formed at the intersection of one virtual grid line 420 to provide location information. have. In this case, each mark 410 value may be expressed in arbitrary coordinates in a manner separated into an x-coordinate and a y-coordinate, and location information may be provided from the mark 410 value expressed in the coordinates.

The virtual grid lines 420 may be formed horizontally and vertically at regular intervals. The distance between the grid lines 420 may be formed in a range of 250 to 300 μm, and the mark 410 may be formed at a point at a distance of 1/4 or 1/8 with respect to the intersection of the virtual grid lines 420 . can Alternatively, the mark 410 may be formed by associating two or more marks 410 with the intersection of the virtual grid lines 420 .

The infrared sensor 23 may detect infrared rays scattered from a portion of the surface of the recording medium 200 on which the mark 410 is not formed, and the location information calculating unit 24 uses this to generate a 6×6 grid line ( When 36 marks 410 are recognized by 6 horizontally and vertically on 420 , position information according to each mark 410 value is calculated and an absolute position on the recording medium 200 can be determined using this.

The infrared light source 26 may transmit infrared rays to the outside. The infrared light source 26 emits infrared rays onto the recording medium 200 so that the infrared sensor 23 can detect the infrared rays scattered on the recording medium 200 .

In some cases, the infrared light source 26 is not required when it is used for a recording medium equipped with an infrared light source by itself, but in the case where the infrared sensor 23 is difficult to detect even if there is an infrared light source or a recording medium without an infrared light source. It may be useful.

Although an example of calculating position information on the recording medium 200 by recognizing a dot pattern composed of virtual grid lines 420 and marks 410 has been described, an arbitrary pattern formed on the recording medium 200 has been described. It will be natural that all algorithms that can calculate location information using

In addition, in an embodiment of the present invention, the recording medium 200 includes not only a recording medium made of paper, but also all display media capable of expressing a dot pattern.

The second writing unit 30 generates pen pressure information applied to the second pen tip unit 31 through the second pen tip unit 31 and the second pressurized unit 32 configured in the form of a conductive cap. 2 It may be configured to include a pressure sensor (33).

The second pen tip part 31 is made of a conductive material to change the capacitance by moving the electrode of the capacitor on the capacitive touch panel 300 to display graphic information according to the movement path.

The second pen tip part 31 may be made of, for example, silicon containing aluminum and carbon as main components.

In one embodiment of the present invention, the second pen tip unit 31 operating on the capacitive touch panel 300 has been described as an example, but in the case of operating on the resistive type or optical sensor type touch panel 300, It will be said that it can be composed of a general rubber element, etc., within the scope of the technical idea of the present invention.

The second pressure sensor 32 is adjacent to the second pen tip part 31 and may sense a pressure applied to the second pen tip part 31 .

The second pressure sensor 32 generates pen pressure information obtained by numerically calculating a pressure proportional to the force applied to the second pen tip part 31 when the second pen tip part 31 and the touch panel 300 come into contact. can do.

The communication unit 40 may transmit the information generated by the first writing unit 20 or the second writing unit 30 to an external terminal through a wired or wireless communication method. Information transmission of the communication unit 40 may be controlled by a built-in MCU (not shown).

The communication unit 40 may transmit the location information and the pen pressure information together when the writing operation is performed using the first writing unit 20 , and when the writing operation is performed using the second writing unit 30 , It can be controlled to transmit only the pen pressure information.

In this case, the pen pressure information transmitted from the dual-mode pen and the location information sensed by the location information sensing unit 310 of the touch panel may be combined to form one piece of writing information.

A device capable of performing various functions, such as a device for other communication means, a microphone, and a speaker, may be built in the dual mode digital pen 100 , and the operation may be controlled by the built-in MCU.

19 and 20 are views showing a multi-purpose pen according to another embodiment of the present invention.

Referring to FIG. 19 , the multi-purpose pen 100 according to another embodiment of the present invention may further include a cushion part 800 formed on the outer circumferential surface of the body.

Referring to FIG. 20 , the cushion part 800 is formed on the outer peripheral surface of the multi-purpose pen 100 , specifically, a portion where a user's finger supporting the multi-purpose pen 100 abuts, thereby providing a cushioning feeling.

The cushion unit 800 may include a rear plate 810 , a front plate 820 , a first rising plate 830 , a second rising plate 840 , and an elevation 850 .

The back plate 810 may be fixedly installed on the outer peripheral surface of the multi-purpose pen 100 through a bolt (B).

The front plate 820 may be installed at a predetermined interval from the rear plate 810 .

One side of the first rising plate 830 may be rotatably installed on the upper side of the rear plate 810 through the first rotation pin 830a.

The second rising plate 840 may be rotatably installed on the other side of the front plate 820 through the second rotation pin 840a.

The other side of the first rising plate 830 and one side of the second rising plate 840 may be installed to be rotatable with each other through the elevation pins 830b.

The elevating unit 850 may be installed in the inner space S formed by the rear plate 810 , the front plate 820 , the first rising plate 830 , and the second rising plate 840 .

The elevating unit 850 may include a first protrusion 851 , a second protrusion 852 , and an elastic bridge 853 .

The first protrusion 851 may have a semicircular cross-section, and may be installed on the rear plate 810 such that a curved portion faces the front plate 820 .

The second protrusion 852 may have a semicircular cross-section, and may be installed on the front plate 820 such that a curved portion faces the rear plate 810 .

That is, the first protrusion 851 and the second protrusion 852 may be provided in a symmetrical shape in the inner space (S).

The first protrusion 851 and the second protrusion 852 may respectively form a plurality of groove portions 851a and 852a on surfaces facing each other, and in addition, the first protrusion 851 may include one or more upper and lower sides. A first auxiliary groove 851b may be formed, and one or more second auxiliary grooves 852b may be formed on upper and lower sides of the second protrusion 852 .

The elastic bridge 853 may have a semicircular cross-section, and may connect the first protrusion 851 and the second protrusion 852 .

That is, both ends of the elastic bridge 853 may be connected to the upper side of the first protrusion 851 and the second protrusion 852 , respectively. In this case, the upper surface of the elastic bridge 853 may be disposed in abutting state with the first rising plate 830 and the second rising plate 840 . The elastic bridge 853 may form a plurality of groove portions 853a on the upper surface.

The first protrusion 851 , the second protrusion 852 , and the elastic bridge 853 may be made of a material having elasticity, such as synthetic rubber, a tire material, or soft plastic.

When an impact is applied to the front plate 820 in the direction of the rear plate 810, the cushioning part 800 folds the elastic bridge 853 so that the first rising plate 830 and the second rising plate 840 are formed. The interconnected elevating pins 830b are pressed upward so that the first lifting plate 830 and the second lifting plate 840 are folded and raised.

Here, the first protrusion 851 and the second protrusion 852 abut against each other as the front plate 820 moves toward the rear plate 810 and bend to absorb the shock applied to the front plate 820 . Further, the groove portions 851a, 852a, 853a, the first auxiliary groove 851b and the second auxiliary groove 852b are the first projection 851, the second projection 852, and the elastic bridge 853. Facilitates bending.

Although embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing its technical spirit or essential features. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: multi-purpose pen

Claims (2)

a netboard formed of a display device having a communication function; and
A multi-purpose pen formed in the form of a pen, generating pen input data by sensing the trajectory of pen input input to paper, and transmitting the pen input data to the netboard;
The multi-purpose pen,
a writing unit generating the pen input data; and
Including; a cushion portion formed on the outer peripheral surface of the multi-purpose pen,
The cushion part,
a rear plate fixedly installed on the outer peripheral surface of the multi-purpose pen through a bolt;
a front plate installed at a predetermined distance from the rear plate;
a first lifting plate, one side of which is rotatably installed on the upper side of the rear plate through a first pivot pin;
a second lifting plate having one side rotatably installed on the other side of the first lifting plate through an elevating pin, and the other end being rotatably installed on the upper side of the front plate through a second rotating pin; and
Containing; including; and
The elevating unit,
a first protrusion having a semicircular cross-section and installed on the rear plate such that a curved portion faces the front plate;
a second protrusion having a semicircular cross-section and installed on the front plate such that a curved portion faces the rear plate; and
The cross section is formed in a semicircular shape, and both ends are connected to the upper side of the first protrusion and the upper side of the second protrusion, respectively, and the upper surface is disposed in a state in contact with the first rising plate and the second rising plate, and the When a force is applied to the front plate in the direction of the rear plate, an elastic bridge that presses the lifting pin portion upward so that the first lifting plate and the second lifting plate rise while being folded; Bidirectional learning, including system. delete

Images