KR102635215B1 - Input feedback based smart pen - Google Patents

Abstract

One embodiment of the present invention includes a main body having a shape that can be operated by a user, an input unit connected to the main body and performing an input operation by the user's manipulation, and recognizing information input by the user according to the manipulation of the input unit. An input comprising an input information recognition unit and a representation unit including one or more representation members formed on an area of an outer surface of the main body so that the user can sense the information to express information corresponding to the input information recognized by the input information recognition unit. A feedback-based smart pen is launched.

Description

Input feedback based smart pen}

Embodiments of the present invention relate to an input feedback-based smartpen.

Users can perceive information in various ways. For this purpose, various types of information output devices are used.

For example, visual information output devices using printed materials and auditory information output devices using sound are being used.

Meanwhile, users can perform input operations in various ways according to their intentions. For example, you can write or draw on paper with a pen.

The results of these input operations, such as text or pictures, can be visually recognized.

However, when directly detecting the results of such input actions, for example, it may be difficult to visually detect letters or pictures written on paper, there is a limit to improving the convenience of detecting the user's input actions in such cases. There is.

Embodiments of the present invention provide an input feedback-based smartpen that can improve user convenience by facilitating feedback on the user's input actions.

One embodiment of the present invention includes a main body having a shape that can be operated by a user, an input unit connected to the main body and performing an input operation by the user's manipulation, and recognizing information input by the user according to the manipulation of the input unit. An input comprising an input information recognition unit and a representation unit including one or more representation members formed on an area of an outer surface of the main body so that the user can sense the information to express information corresponding to the input information recognized by the input information recognition unit. A feedback-based smart pen is launched.

In this embodiment, it may further include an information processing unit that processes one or more information using the content recognized by the input information recognition unit and transmits it to the expression unit.

In this embodiment, it may further include an operation control unit that can be operated by the user to control one or more operations of the expression unit.

In this embodiment, the expression unit includes a plurality of expression members, and can deliver different information to the user through the protruding shapes of the plurality of expression members.

In this embodiment, it may further include a speaker unit that outputs the one or more pieces of information.

Other aspects, features and advantages in addition to those described above will become apparent from the following drawings, claims and detailed description of the invention.

The input feedback-based smartpen according to this embodiment can improve user convenience by facilitating feedback on the user's input actions.

1 is a diagram illustrating an input feedback-based smartpen according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a modified example of the input recognition member of the input feedback-based smartpen of FIG. 1.
FIG. 3 is a diagram illustrating another modified example of the input recognition member of the input feedback-based smartpen of FIG. 1.
FIG. 4 is an enlarged view to explain the expression portion of the input feedback-based smartpen of FIG. 1.
Figure 5 is a cross-sectional view taken along line V-V of Figure 4.
FIG. 6 is a diagram illustrating an optional embodiment of the representation unit of FIG. 4.
FIG. 7 is a diagram illustrating another optional embodiment of the representation unit of FIG. 4.
FIG. 8 is a diagram illustrating an example of a user using the user input feedback substrate smartpen of FIG. 1.
FIG. 9 is an enlarged view of a region of FIG. 8.
Figure 10 is a diagram illustrating an input feedback-based smart pen according to another embodiment of the present invention.
Figure 11 is a diagram showing an input feedback-based smart pen according to another embodiment of the present invention.
Figure 12 is a diagram showing an input feedback-based smart pen according to another embodiment of the present invention.
FIGS. 13 to 17 are diagrams illustrating examples of use using the input feedback-based smartpen of FIG. 12.

Since the present invention can be modified in various ways and can have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. When describing with reference to the drawings, identical or corresponding components will be assigned the same reference numerals and redundant description thereof will be omitted. .

In the following embodiments, terms such as first and second are used not in a limiting sense but for the purpose of distinguishing one component from another component.

In the following examples, singular terms include plural terms unless the context clearly dictates otherwise.

In the following embodiments, terms such as include or have mean that the features or components described in the specification exist, and do not exclude in advance the possibility of adding one or more other features or components.

In the drawings, the sizes of components may be exaggerated or reduced for convenience of explanation. For example, the size and thickness of each component shown in the drawings are shown arbitrarily for convenience of explanation, so the present invention is not necessarily limited to what is shown.

In the following embodiments, the x-axis, y-axis, and z-axis are not limited to the three axes in the Cartesian coordinate system, but can be interpreted in a broad sense including these. For example, the x-axis, y-axis, and z-axis may be orthogonal to each other, but may also refer to different directions that are not orthogonal to each other.

In cases where an embodiment can be implemented differently, a specific process sequence may be performed differently from the described sequence. For example, two processes described in succession may be performed substantially at the same time, or may be performed in an order opposite to that in which they are described.

1 is a diagram illustrating an input feedback-based smartpen according to an embodiment of the present invention.

The input feedback-based smart pen 100 of this embodiment may include a main body 101, an input unit 110, an input information recognition unit 120, and a representation unit 150.

The main body 101 may have a shape that allows the user to operate it. For example, the main body 101 may have a pillar shape so that the user can hold it, and as specific examples, it may have a cylinder, prism, or oval shape.

In addition, the main body 101 may have various shapes that make it easy for the user to perform input operations, and may also adopt the shapes of various pens.

When a user manipulates the input feedback main body 101, he or she may hold it by hand, and in this case, the upper part 102 including the uppermost region may be located on the upper part of the main body 101.

As an optional embodiment, the upper part 102 may include an area that is thinner than the main body 101, and as another example, although not shown, a hook or handle part may be further formed in the upper part 102 to improve user convenience. It may be possible.

The input unit 110 is connected to the main body 101 and can perform an input operation through user manipulation. The input unit 110 can visually display the form of letters, pictures, etc. on paper. For example, the input unit 110 may have a shape similar to some areas of a ballpoint pen nib, pencil nib, or marker pen.

As an optional embodiment, the input unit 110 may not visually display the results of the input operation, such as on paper. For example, when there is an input operation by the user using the input unit 110, information on changes due to the movement of the input unit 110 may be recognized by the input information recognition unit 120, which will be described later, as a result of the input operation. .

In this case, the input unit 110 may not need to be separately provided with a pencil lead, ballpoint pen lead, or marker pen lead.

The input information recognition unit 120 can recognize information input by the user according to manipulation of the input unit 110.

For example, when a user uses the input unit 110 to input letters, pictures, or other various input actions on paper, the input information recognition unit 120 recognizes visually identifiable information such as letters, pictures, or shapes written on the paper. can do.

As an optional embodiment, the input information recognition unit 120 may include an optical member, for example, a photographing member.

As shown in FIG. 1, the input information recognition unit 120 may be formed in one area of the main body 101, for example, at the bottom of the main body 101.

FIG. 2 is a diagram illustrating a modified example of the input recognition member of the input feedback-based smartpen of FIG. 1.

Referring to FIG. 2 , the input information recognition unit 120 ′ may be arranged adjacent to the input unit 110 and may be arranged to face the direction in which the input unit 110 faces.

For example, the input information recognition unit 120' may be formed at the lower part of the main body 101. Specifically, the input information recognition unit 120' may be formed in an area at the bottom of the main body 101.

FIG. 3 is a diagram illustrating another modified example of the input recognition member of the input feedback-based smartpen of FIG. 1.

Referring to FIG. 3, the input information recognition unit 120" may be placed above the input unit 110, for example, in an area adjacent to the upper part 102.

As an optional embodiment, the input information recognition unit 120" may be formed above the user's hand so that it does not overlap with the user's hand when the user grips the main body 101.

The input information recognition units 120, 120', and 120" of FIGS. 1 to 3 may include a photographing member that recognizes visual information as described above, and in this case, at least one member, for example, an image element, etc. The member may be disposed inside the main body portion 101.

As an optional embodiment, the input information recognition unit 120 may include a motion detection sensor to detect input from the input unit 110. For example, when a user moves to write a letter using the input unit 110, the movement of the input unit 110 can be detected. As an optional embodiment, the result of an input operation using the input unit 110 may not be visually displayed as described above. In this case, the input information recognition unit 120 including a motion detection sensor recognizes the input contents of the input unit 110. It can be easily detected.

The optional embodiments of FIGS. 2 and 3 can also be applied to the input information recognition unit 120 including such a motion detection sensor. However, in order to precisely detect the movement of the input unit 110 through the user's movement, it may be desirable for the motion detection sensor of the input information recognition unit 120 to be placed close to the input unit 110.

As an optional embodiment, the motion detection sensor of the input information recognition unit 120 may not be exposed to the outside and, for example, may be placed inside the main body 101. Alternatively, the input information recognition unit 120 may be formed inside or on one side of the input unit 110 through fine formation.

FIG. 4 is an enlarged view to explain the representation part of the input feedback-based smart pen of FIG. 1, and FIG. 5 is a cross-sectional view taken along line V-V of FIG. 4.

The expression unit 150 may be placed in an area of the outer surface of the main body 101 to express information corresponding to the input information recognized by the input information recognition unit 120.

The expression unit 150 may be formed so that the user can sense it, and for example, it may be formed to correspond to the user's finger.

The expression unit 150 may include one or more expression members 152 so that the user can sense them. For example, the expression unit 150 may include a plurality of expression members 152.

The expression member 152 may be moved to protrude toward at least one area of the user's finger so that the user can sense it.

The expression unit 150 can express content input by the user through the input unit 110. For example, when a user inputs a text through the input unit 110, the input information recognition unit 120 can recognize this input in various ways, as described above, and this recognized information is sent to the expression unit 150. ), and the user can sense what the expression unit 150 expresses.

Through this, the user can detect information about the content entered through the input unit 110.

As an optional embodiment, if the user is blind or has very weak eyesight, it may not be easy to visually check the content entered through the input unit 110. In this embodiment, in this case, the user can detect the protrusion of the expression member 152 through the expression unit 150, so that the user can confirm the entered content.

As a specific example, when a user intentionally inputs the word “mountain” through the input unit 110, the input information recognition unit 120 recognizes the content of the input through the input unit 110, and recognizes this through the expression unit ( 150) is expressed and detected by the user, and even in cases where it is difficult to check what one has written directly with the eyes due to poor or weak eyesight, the user can detect and confirm the protrusion of the expression member 152 of the expression unit 150. The protrusion of this expression member 152 may be in the form of a type of Braille. That is, when “mountain” is input through the input unit 110, the expression member 152 of the expression unit 150 may have a protruding shape so as to express “mountain” in Braille.

As an optional embodiment, it may further include an information processing unit 130, where the information processing unit 130 processes various information using the information recognized by the input information recognition unit 120 and expresses the processed information. It can be delivered to unit 150.

For example, the information processing unit 130 may process Braille information about what the user inputs.

Additionally, as another example, the information processing unit 130 may process voice information about what the user inputs.

As an optional embodiment, the information processing unit 130 may include a storage unit that stores one or more Braille data information.

As an optional embodiment, the information processing unit 130 may include a character determination unit, a shape determination unit, etc. that determine what the user inputs, and may include a database for this purpose.

Additionally, as an additional example, it may include a text information conversion control unit that converts the input content into text information.

As an optional embodiment, the information processing unit 130 may determine whether a character input by a user is correct or not, and process expression information for a correct or incorrect answer.

The expression unit 150 may have various forms. For example, the plurality of expression members 152 of the expression unit 150 are arranged to respectively correspond to the through holes 151H of the base 151, and the through holes ( 151H), it protrudes or moves in the opposite direction so that it can be detected with the user's finger.

Referring to FIG. 5 , the expression member 152 may be moved by the driving providing member MU.

As an alternative embodiment, the drive providing member (MU) may include one or more drive sources (COI), for example a coil portion. Additionally, in an optional embodiment, the driving source (COI) may include a magnet. As a specific example, it may include a coil portion surrounding a magnet.

As an optional embodiment, the drive providing member (MU) may include a movement member (DRU) that moves by a drive source (COI), and the expression member 152 may protrude and move through the movement of the movement member (DRU). there is.

As an optional embodiment, as an example, current may be applied to the coil of the driving source (COI) including the coil portion of the driving providing member (MU), and the moving member (DRU) may be moved by the magnetic field around the coil generated at this time. there is.

In alternative embodiments, the moving member (DRU) may include a magnetic material, or as another example, a magnet.

As an alternative embodiment, the movement member (DRU) may be formed integrally with the expression member 152 or the movement member (DRU) may be disposed inside the expression member 152.

FIG. 6 is a diagram illustrating an optional embodiment of the presentation unit of FIG. 4, and FIG. 7 is a diagram illustrating another optional embodiment of the presentation unit of FIG. 4.

Referring to FIG. 6 , the expression unit 150' may include a plurality of expression members 152' formed on one surface of the base 151' to be spaced apart from each other.

The plurality of expression members 152' may be arranged to correspond to the plurality of through holes 151H' of the base 151' and may be arranged to be spaced apart from each other.

Referring to FIG. 7 , the expression unit 150" may include a plurality of expression members 152" formed on one surface of the base 151" to be spaced apart from each other.

The plurality of expression members 152" may be arranged to correspond to the plurality of through holes 151H" of the base 151" and may be arranged to be spaced apart from each other.

The base 151" may include a curved surface. For example, the base 151" may include a curved surface to correspond to the curved surface of the outer surface of the main body 101 shown in FIG. 1, and the base 151" may include a curved surface along this curved surface. A plurality of expression members 152" may be disposed.

FIG. 8 is a diagram illustrating an example of a user using the user input feedback substrate smart pen of FIG. 1, and FIG. 9 is an enlarged view of an area of FIG. 8.

Referring to FIGS. 8 and 9 , it is shown that a user performs an input operation by manipulating the input feedback-based smart pen 100 using his/her hand (HDU). Referring to FIG. 8, the input content DI includes, for example, text, and specifically shows the text “mountain.”

As a result of an input operation by manipulating the input feedback-based smart pen 100, the input content (DI) can be visually confirmed. For example, the input content (DI) can be displayed through the input unit 110 so that it can be visually confirmed on a piece of paper.

In addition, as an optional embodiment, the input content (DI) may not be visible even if manipulated through the input unit 110, and the input content (DI) of the input unit 110 may be displayed as information on the movement, for example, in the input unit 110. ) The input information recognition unit 120 can recognize the location, movement trajectory, etc.

The input information recognition unit 120 recognizes the input content (DI) entered through the input unit 110, and the expression unit 150 can express this information so that the user can recognize it.

For example, the protrusion of the plurality of expression members 152 of the expression unit 150 may be controlled, and the user may sense the protrusion of the expression members 152, for example, using the user's fingers HF1 and HF2. One of the middle fingers, specifically the index finger (HF1), can detect this. For example, by using the protrusion of the plurality of expression members 152, the user can recognize the input content DI, for example, the information “mountain”, using the index finger HF1.

As an optional embodiment, the meaning of “mountain” may be conveyed in the form of Braille through a plurality of expression members 152.

In addition, as an optional embodiment, instead of directly conveying the meaning of "mountain" through the plurality of expression members 152, indirect information, as a specific example, the meaning of "correct answer" or "incorrect answer" may be conveyed. This may be a method of informing the user that the input content (DI) entered using the input unit 110 is “correct” if “mountain” is written correctly, and “incorrect” if it is not.

Additionally, as an optional embodiment, after the user is asked to input a set problem, the meaning of a correct or incorrect answer to the input may be conveyed. In this case, the set problem can be communicated through voice, for example, through the expression member 152 of the expression unit 150, and can also be transmitted in the form of Braille, for example.

The input feedback-based smart pen of this embodiment can be easily used by the user by holding the main body, etc., and can perform an input operation through the input unit. At this time, as a result of the input operation, the input content may be visually displayed on paper, such as an actual pencil or pen, or, as another example, may not be displayed. The input information recognition unit may recognize such input content, and the expression unit may express the recognized information. As an optional embodiment, the information recognized by the input information recognition unit is used to transmit one or more processed information, such as Braille information, information on whether the answer is correct or incorrect, to the expression unit, and through the protrusion of one or more expression members of the expression unit. Users can recognize it.

The user can check the information he or she entered through the input unit by detecting the protruding form of the expression member of the expression unit immediately or a short time after the input. For example, if the user has no eyesight or has weak eyesight, it is difficult for the user to check the information he or she entered. In that case, the user can easily check the information through the expression unit.

In addition, even for users who have not yet learned letters, it is possible to easily detect whether a correct or incorrect answer is correct or incorrect through the expression unit in the process of practicing letters. At this time, the expression unit can display the protruding form of the expression member in a preset form in addition to the Braille form. The cases of correct and incorrect answers can be differentiated so that users can easily detect them.

Through this, feedback on information entered by users under various conditions can be easily provided and the convenience of users confirming and acquiring information can be increased.

Although not shown, a power supply for the operation of the expression unit or input information recognition unit may be included, and this may include a built-in battery, a rechargeable battery, or an external power connection unit.

Figure 10 is a diagram illustrating an input feedback-based smart pen according to another embodiment of the present invention.

The input feedback-based smart pen 200 of this embodiment may include a main body 201, an input unit 210, an input information recognition unit 220, an expression unit 250, and an operation control unit 260.

For convenience of explanation, the description will focus on differences from the above-described embodiment.

The main body 201 may have a shape that allows the user to operate it. For example, the main body 201 may have a pillar shape so that the user can hold it, and as specific examples, it may have a cylinder, prism, or oval shape.

When a user manipulates the input feedback main body 201, he or she may hold it by hand, and in this case, the upper part 202 including the uppermost region may be located on the upper part of the main body 201.

As an optional embodiment, the upper part 202 may include an area formed thinner than the main body 201, and as another example, although not shown, a hook or handle part may be further formed in the upper part 202 to improve user convenience. It may be possible.

The input unit 210 is connected to the main body 201 and can perform an input operation through user manipulation. The input unit 210 can visually display the form of letters, pictures, etc. on paper. For example, the input unit 210 may have a shape similar to some areas of a ballpoint pen nib, pencil nib, or marker pen.

As an optional embodiment, the input unit 210 may not visually display the results of the input operation, such as on paper. For example, when there is an input operation by the user using the input unit 210, information on changes due to the movement of the input unit 210 may be recognized by the input information recognition unit 220, which will be described later, as a result of the input operation. .

In this case, the input unit 210 may not need to be separately provided with a pencil lead, ballpoint pen lead, or marker pen lead.

The input information recognition unit 220 can recognize information input by the user according to manipulation of the input unit 210.

For example, when a user uses the input unit 210 to input letters, pictures, or other various input actions on paper, the input information recognition unit 220 recognizes visually identifiable information such as letters, pictures, or shapes written on the paper. can do.

As an optional embodiment, the input information recognition unit 220 may include an optical member, for example, a photographing member.

As shown in FIG. 10, the input information recognition unit 220 may be formed in one area of the main body 201, for example, at the bottom of the main body 201.

As an alternative embodiment, the examples of Figures 2 and 3 may also be applied.

As an optional embodiment, the input information recognition unit 220 may include a motion detection sensor to detect input from the input unit 210. For example, when a user moves to write a letter using the input unit 210, the movement of the input unit 210 can be detected. As an optional embodiment, the result of an input operation using the input unit 210 may not be displayed visually as described above. In this case, the input information recognition unit 220 including a motion detection sensor recognizes the input contents of the input unit 210. It can be easily detected.

As an optional embodiment, the motion detection sensor of the input information recognition unit 220 may not be exposed to the outside and, for example, may be placed inside the main body 201. Alternatively, the input information recognition unit 220 may be formed inside or on one side of the input unit 210 through fine formation.

The expression unit 250 may be disposed in an area of the outer surface of the main body 201 to express information corresponding to the input information recognized by the input information recognition unit 220.

The expression unit 250 may be formed so that the user can sense it, and for example, it may be formed to correspond to the user's finger.

The expression unit 250 may include one or more expression members 252 so that the user can sense them. For example, the expression unit 250 may include a plurality of expression members 252.

The expression member 252 may be moved to protrude toward at least one area of the user's finger so that the user can sense it.

Although not shown, the structures of FIGS. 4 and 5 can also be applied to this embodiment.

The expression unit 250 can express content input by the user through the input unit 210. For example, when a user inputs a text through the input unit 210, the input information recognition unit 220 can recognize this input in various ways, as described above, and this recognized information is sent to the expression unit 250. ), and the user can sense what the expression unit 250 expresses.

Through this, the user can detect information about the content entered through the input unit 210.

As an optional embodiment, if the user is blind or has very weak eyesight, it may not be easy to visually confirm the content entered through the input unit 210. In this embodiment, in this case, the input content can be confirmed by allowing the user to sense the protrusion of the expression member 252 through the expression unit 250.

As a specific example, when a user intentionally inputs the word “mountain” through the input unit 210, the input information recognition unit 220 recognizes the content of the input through the input unit 210, and recognizes this through the expression unit ( 250) is expressed and detected by the user, and even in cases where it is difficult to check what one has written directly with the eyes due to poor or weak eyesight, the user can detect and confirm the protrusion of the expression member 251 of the expression unit 250. This protrusion of the expression member 251 may be in the form of a type of Braille. That is, when “mountain” is input through the input unit 210, the expression member 252 of the expression unit 250 may have a protruding shape to express “mountain” in Braille.

As an optional embodiment, it may further include an information processing unit 230, where the information processing unit 230 processes various information using the information recognized by the input information recognition unit 220 and expresses the processed information. It can be delivered to unit 250.

For example, the information processing unit 230 may process Braille information about what the user inputs.

Additionally, as another example, the information processing unit 230 may process voice information about what the user inputs.

As an optional embodiment, the information processing unit 230 may include a storage unit that stores one or more Braille data information.

As an optional embodiment, the information processing unit 230 may include a character determination unit, a shape determination unit, etc. that determine what the user inputs, and may include a database for this purpose.

Additionally, as an additional example, it may include a text information conversion control unit that converts the input content into text information.

As an optional embodiment, the information processing unit 230 may determine whether a character input by a user is correct or not, and process expression information for a correct or incorrect answer.

The expression unit 250 may have various forms. For example, a plurality of expression members (not shown) of the expression unit 250 are arranged to respectively correspond to through holes (not shown) of the base (not shown), It protrudes through a through hole (not shown) or moves in the opposite direction so that it can be detected with the user's finger.

Also, although not shown, the structure of Figure 6 or Figure 7 can be applied as an optional embodiment.

The operation control unit 260 may control one or more operations of the expression unit 250 through user manipulation.

For example, the operation control unit 260 may initiate an initialization operation of the expression members 252 of the expression unit 250, and in the case of a specifically protruding form, all expression members 252 may be reset by the user's manipulation. It is possible to maintain the original state, that is, the non-salient state.

As an optional embodiment, the motion control unit 260 may generate a ready signal for the expression unit 250, for example, the user may manipulate the motion control unit 260 before inputting through the input unit 210, Only when a signal from the operation control unit 260 is generated, the input information recognition unit 220 recognizes the input operation of the input unit 210, and the expression unit 250 can express using the recognized content. Through this, the efficiency of operation of the input feedback-based smart pen 200 can be improved and power consumption can be reduced.

As described above, for example, as shown in FIGS. 8 and 9, the user operates the input feedback-based smart pen 200 using his/her hand to perform an input operation, and as a result of the input operation, the input content is recognized as input information. The unit 220 can recognize and control the protrusion of a plurality of expression members of the expression unit 250, and the user can sense the protrusion of these expression members, for example, one of the user's fingers. Fingers, specifically index fingers, can detect this.

The input feedback-based smart pen of this embodiment can be easily used by the user by holding the main body, etc., and can perform an input operation through the input unit. At this time, as a result of the input operation, the input content may be visually displayed on paper, such as an actual pencil or pen, or, as another example, may not be displayed. The input information recognition unit may recognize such input content, and the expression unit may express the recognized information. As an optional embodiment, the information recognized by the input information recognition unit is used to transmit one or more processed information, such as Braille information, information on whether the answer is correct or incorrect, to the expression unit, and through the protrusion of one or more expression members of the expression unit. Users can recognize it.

The user can check the information he or she entered through the input unit by detecting the protruding form of the expression member of the expression unit immediately or a short time after the input. For example, if the user has no eyesight or has weak eyesight, it is difficult for the user to check the information he or she entered. In that case, the user can easily check the information through the expression unit.

In addition, even for users who have not yet learned letters, it is possible to easily detect whether a correct or incorrect answer is correct or incorrect through the expression unit in the process of practicing letters. At this time, the expression unit can display the protruding form of the expression member in a preset form in addition to the Braille form. The cases of correct and incorrect answers can be differentiated so that users can easily detect them.

Through this, feedback on information entered by users under various conditions can be easily provided and the convenience of users confirming and acquiring information can be increased.

In addition, by controlling the operation of the expression unit, for example, initialization, through the operation control unit, continuous input operations and feedback thereon can be efficiently performed.

In addition, the efficiency and power consumption reduction characteristics of the input feedback-based smart pen can be improved by recognizing the input information through the recognition unit and starting the operation of the expression unit in response, when necessary, through the operation control unit.

Figure 11 is a diagram showing an input feedback-based smart pen according to another embodiment of the present invention.

The input feedback-based smart pen 300 of this embodiment may include a main body 301, an input unit 310, an input information recognition unit 320, an expression unit 350, and a speaker unit 370.

For convenience of explanation, the description will focus on differences from the above-described embodiment.

The main body 301 may have a shape that allows the user to operate it. For example, the main body 301 may have a pillar shape so that the user can hold it, and as specific examples, it may have a cylinder, prism, or oval shape.

When a user manipulates the input feedback main body 301, he or she may hold it by hand, and in this case, the upper part 302 including the uppermost region may be located on the upper part of the main body 301.

As an optional embodiment, the upper part 302 may include an area that is thinner than the main body 301, and as another example, although not shown, a hook or handle part may be further formed in the upper part 302 to improve user convenience. It may be possible.

The input unit 310 is connected to the main body 301 and can perform an input operation through user manipulation. The input unit 310 can visually display the form of letters, pictures, etc. on paper. For example, the input unit 310 may have a shape similar to some areas of a ballpoint pen nib, pencil nib, or marker pen.

As an optional embodiment, the input unit 310 may not visually display the results of the input operation, such as on paper. For example, when there is an input operation by the user using the input unit 310, information on changes due to the movement of the input unit 310 may be recognized by the input information recognition unit 320, which will be described later, as a result of the input operation. .

In this case, the input unit 310 may not need to be separately provided with a pencil lead, ballpoint pen lead, or marker pen lead.

The input information recognition unit 320 can recognize information input by the user according to manipulation of the input unit 310.

For example, when a user uses the input unit 310 to input letters, pictures, or other various input actions on paper, the input information recognition unit 320 recognizes visually identifiable information such as letters, pictures, or shapes written on the paper. can do.

As an optional embodiment, the input information recognition unit 320 may include an optical member, for example, a photographing member.

As shown in FIG. 11, the input information recognition unit 320 may be formed in one area of the main body 301, for example, at the bottom of the main body 301.

As an alternative embodiment, the examples of Figures 2 and 3 may also be applied.

As an optional embodiment, the input information recognition unit 320 may include a motion detection sensor to detect input from the input unit 310. For example, when a user moves to write a letter using the input unit 310, the movement of the input unit 310 can be detected. As an optional embodiment, the results of an input operation using the input unit 310 may not be displayed visually as described above. In this case, the input information recognition unit 320, including a motion detection sensor, recognizes the input contents of the input unit 310. It can be easily detected.

As an optional embodiment, the motion detection sensor of the input information recognition unit 320 may not be exposed to the outside and, for example, may be placed inside the main body 301. Alternatively, the input information recognition unit 320 may be formed inside or on one side of the input unit 310 through fine formation.

The expression unit 350 may be disposed in an area of the outer surface of the main body 302 to express information corresponding to the input information recognized by the input information recognition unit 320.

The expression unit 350 may be formed so that the user can sense it, and for example, may be formed to correspond to the user's finger.

The expression unit 350 may include one or more expression members 352 so that the user can sense them. For example, the expression unit 350 may include a plurality of expression members 352.

The expression member 352 may be moved to protrude toward at least one area of the user's finger so that the user can sense it.

Although not shown, the structures of FIGS. 4 and 5 can also be applied to this embodiment.

The expression unit 350 can express content input by the user through the input unit 310. For example, when a user inputs text through the input unit 310, the input information recognition unit 320 can recognize this input in various ways, as described above, and this recognized information is sent to the expression unit 350. ), and the user can sense what the expression unit 350 expresses.

Through this, the user can detect information about the content entered through the input unit 310.

As an optional embodiment, if the user is blind or has very weak eyesight, it may not be easy to visually confirm the content entered through the input unit 310. In this embodiment, in this case, the input content can be confirmed by allowing the user to sense the protrusion of the expression member 352 through the expression unit 350.

As a specific example, when a user intentionally inputs the word “mountain” through the input unit 310, the input information recognition unit 320 recognizes the contents of the input through the input unit 310, and recognizes this through the expression unit ( 350) is expressed and detected by the user, and even in cases where it is difficult to directly check what the user has written due to poor or weak eyesight, the user can confirm it by detecting the protrusion of the expression member 351 of the expression unit 350. This protrusion of the expression member 351 may be in the form of a type of Braille. That is, when “mountain” is input through the input unit 310, the expression member 352 of the expression unit 350 may have a protruding shape to express “mountain” in Braille.

As an optional embodiment, it may further include an information processing unit 330, where the information processing unit 330 processes various information using the information recognized by the input information recognition unit 320 and expresses the processed information. It can be delivered to unit 350.

For example, the information processing unit 330 can process Braille information about what the user inputs.

Additionally, as another example, the information processing unit 330 may process voice information about what the user inputs.

As an optional embodiment, the information processing unit 330 may include a storage unit that stores one or more Braille data information.

As an optional embodiment, the information processing unit 330 may include a character determination unit, a shape determination unit, etc. that determine what the user inputs, and may include a database for this purpose.

Additionally, as an additional example, it may include a text information conversion control unit that converts the input content into text information.

As an optional embodiment, the information processing unit 330 may determine whether a character input by a user is correct or not, and process expression information for a correct or incorrect answer.

The expression unit 350 may have various forms. For example, a plurality of expression members (not shown) of the expression unit 350 are arranged to respectively correspond to through holes (not shown) of the base (not shown), It protrudes through a through hole (not shown) or moves in the opposite direction so that it can be detected with the user's finger.

Also, although not shown, the structure of Figure 6 or Figure 7 can be applied as an optional embodiment.

The speaker unit 370 is formed to generate a sound, for example, a voice, containing one or more information to the user, and may be formed, for example, in an area of the upper part 302.

For example, after the speaker unit 370 receives input through the input unit 310, the input information recognition unit 320 recognizes it, and the expression unit 350 can express it using this recognized content. The content expressed by 350 can be informed by voice, for example, the user can be informed of “mountain” by voice.

In addition, the user is informed of the problem set by voice through the speaker unit 370, and as a result of the user inputting the problem set through the input unit 310 through an input operation, the input information recognition unit 320 recognizes it, The expression unit 350 or the speaker unit 370 may provide feedback to the input content entered by the user.

At this time, it is possible to detect the content of direct feedback, for example, "mountain", or to distinguish whether the input for the indirectly set problem was correct or not and mark it as "correct" or "incorrect". This may be notified in the form of protrusions of preset expression members of the expression unit 350.

Through this, the operation and usability of the input feedback-based smart pen 300 can be expanded and user convenience can be increased.

The input feedback-based smart pen of this embodiment can be easily used by the user by holding the main body, etc., and can perform an input operation through the input unit. At this time, as a result of the input operation, the input content may be visually displayed on paper, such as an actual pencil or pen, or, as another example, may not be displayed. The input information recognition unit may recognize such input content, and the expression unit may express the recognized information. As an optional embodiment, the information recognized by the input information recognition unit is used to transmit one or more processed information, such as Braille information, information on whether the answer is correct or incorrect, to the expression unit, and through the protrusion of one or more expression members of the expression unit. Users can recognize it.

The user can check the information he or she entered through the input unit by detecting the protruding form of the expression member of the expression unit immediately or a short time after the input. For example, if the user has no eyesight or has weak eyesight, it is difficult for the user to check the information he or she entered. In that case, the user can easily check the information through the expression unit.

In addition, even for users who have not yet learned letters, it is possible to easily detect whether a correct or incorrect answer is correct or incorrect through the expression unit in the process of practicing letters. At this time, the expression unit can display the protruding form of the expression member in a preset form in addition to the Braille form. The cases of correct and incorrect answers can be differentiated so that users can easily detect them.

Through this, feedback on information entered by users under various conditions can be easily provided and the convenience of users confirming and acquiring information can be increased.

In addition, the input feedback-based smart pen can be used for various purposes by informing the user through the speaker unit of various information, for example, the content of the expression unit about the information entered by the user, as is, or by informing the user of setting problems in advance.

For example, it can facilitate the user's character learning, and as a specific example, after raising a problem through the speaker unit and the user entering the character in question, the user can directly receive feedback in real time whether the input character was entered correctly. ,

This can increase the convenience of the process of learning characters or for users who have weak or no eyesight.

Figure 12 is a diagram showing an input feedback-based smart pen according to another embodiment of the present invention.

FIGS. 13 to 17 are diagrams illustrating examples of use using the input feedback-based smartpen of FIG. 12.

The input feedback-based smart pen 400 of this embodiment may include a main body 401, an input unit 410, an input information recognition unit 420, an expression unit 450, and a speaker unit 470.

For convenience of explanation, the description will focus on differences from the above-described embodiment.

The main body 401 may have a shape that allows the user to operate it. For example, the main body 401 may have a pillar shape so that the user can hold it, and as specific examples, it may have a cylinder, prism, or oval shape.

When a user manipulates the input feedback main body 401, he or she may hold it with his or her hand. In this case, the upper part 402 including the uppermost region may be located on the upper part of the main body 401.

As an optional embodiment, the upper part 402 may include an area that is thinner than the main body 401, and as another example, although not shown, a hook or handle part may be further formed in the upper part 402 to improve user convenience. It may be possible.

The input unit 410 is connected to the main body 401 and can perform an input operation through user manipulation. The input unit 410 can visually display the form of letters, pictures, etc. on paper. For example, the input unit 410 may have a shape similar to some areas of a ballpoint pen nib, pencil nib, or marker pen.

As an optional embodiment, the input unit 410 may not visually display the results of the input operation, such as on paper. For example, when there is an input operation by the user using the input unit 410, information on changes due to the movement of the input unit 410 may be recognized by the input information recognition unit 420, which will be described later, as a result of the input operation. .

In this case, the input unit 410 may not need to be separately provided with a pencil lead, ballpoint pen lead, or marker pen lead.

The input information recognition unit 420 can recognize information input by the user according to manipulation of the input unit 410.

For example, when a user uses the input unit 410 to input letters, pictures, or other various input actions on paper, the input information recognition unit 420 recognizes visually identifiable information such as letters, pictures, or shapes written on the paper. can do.

As an optional embodiment, the input information recognition unit 420 may include an optical member, for example, a photographing member.

As shown in FIG. 12, the input information recognition unit 420 may be formed in one area of the main body 401, for example, at the bottom of the main body 401.

As an alternative embodiment, the examples of Figures 2 and 3 may also be applied.

As an optional embodiment, the input information recognition unit 420 may include a motion detection sensor to detect input from the input unit 410. For example, when a user moves to write a letter using the input unit 410, the movement of the input unit 410 can be detected. As an optional embodiment, as described above, the results of an input operation using the input unit 410 may not be displayed visually. In this case, the input information recognition unit 420, including a motion detection sensor, recognizes the input contents of the input unit 410. It can be easily detected.

As an optional embodiment, the motion detection sensor of the input information recognition unit 420 may not be exposed to the outside and, for example, may be placed inside the main body 401. Alternatively, the input information recognition unit 420 may be formed inside or on one side of the input unit 410 through fine formation.

The expression unit 450 may be disposed in an area of the outer surface of the main body 402 to express information corresponding to the input information recognized by the input information recognition unit 420.

The expression unit 450 may be formed so that the user can sense it, and for example, may be formed to correspond to the user's finger.

The expression unit 450 may include one or more expression members 452 so that the user can sense them. For example, the expression unit 450 may include a plurality of expression members 452.

The expression member 452 may be moved to protrude toward at least one area of the user's finger so that the user can sense it.

Although not shown, the structures of FIGS. 4 and 5 can also be applied to this embodiment.

The expression unit 450 can express content input by the user through the input unit 410. For example, when a user inputs a text through the input unit 410, the input information recognition unit 420 can recognize this input in various ways as described above, and this recognized information is sent to the expression unit 450. ), and the user can sense what the expression unit 450 expresses.

Through this, the user can detect information about the content entered through the input unit 410.

As an optional embodiment, if the user is blind or has very weak eyesight, it may not be easy to visually confirm the content entered through the input unit 410. In this embodiment, in this case, the input content can be confirmed by allowing the user to sense the protrusion of the expression member 452 through the expression unit 450.

As a specific example, when a user intentionally inputs the word “mountain” through the input unit 410, the input information recognition unit 420 recognizes the content of the input through the input unit 410, and recognizes this through the expression unit ( 450) is expressed and detected by the user, and even in cases where it is difficult to check what one has written directly with the eyes due to poor or weak eyesight, the user can confirm it by detecting the protrusion of the expression member 451 of the expression unit 450. This protrusion of the expression member 451 may be in the form of a type of Braille. That is, when “mountain” is input through the input unit 410, the expression member 452 of the expression unit 450 may have a protruding shape to express “mountain” in Braille.

As an optional embodiment, it may further include an information control unit 430, and the information control unit 430 processes various information using the information recognized by the input information recognition unit 420 and stores this processed information in an expression unit ( 450).

For example, the information control unit 430 can process Braille information about what the user inputs.

Additionally, as another example, the information control unit 430 may process voice information about what the user inputs.

As an optional embodiment, the information control unit 430 may include a storage unit that stores one or more Braille data information.

As an optional embodiment, the information control unit 430 may include a character determination unit, a shape determination unit, etc. that determine what the user inputs, and may include a database for this purpose.

Additionally, as an additional example, it may include a text information conversion control unit that converts the input content into text information.

As an optional embodiment, the information control unit 430 may determine whether a character input by a user is correct or not, and process expression information for a correct or incorrect answer.

The expression unit 450 may have various forms. For example, a plurality of expression members (not shown) of the expression unit 450 are arranged to respectively correspond to through holes (not shown) of the base (not shown), It protrudes through a through hole (not shown) or moves in the opposite direction so that it can be detected with the user's finger.

Additionally, the information control unit 430 can create and handle setting problems. For example, the user can be asked to enter a setting problem, specifically a specific character, and this setting problem can be presented to the user through the expression unit 450 or, as an optional embodiment, through the speaker unit 470, which will be described later. there is.

To this end, the information control unit 430 may have a storage unit containing one or more characters, words, etc., or may be connected to a storage unit. Additionally, as an optional embodiment, it can be connected to the storage unit wirelessly and, if necessary, can receive information through data connection and communication using the web.

As an optional embodiment, it may be connected to the information control unit 430 or may include a separate wireless communication module, and information about the user's actions may be transmitted to an external device such as a smartphone through this wireless communication module.

As an optional embodiment, the input feedback-based smart pen of this embodiment or the above-described embodiment may be connected to communicate with an external terminal, such as a user's smartphone, and transmit content to be output from the expression unit to the smartphone. It can be delivered.

Additionally, one or more information from the smartphone can be transmitted to the expression unit so that the user can sense it.

Also, although not shown, the structure of Figure 6 or Figure 7 can be applied as an optional embodiment.

The speaker unit 470 is formed to generate a sound, for example, a voice, containing one or more information to the user, and may be formed, for example, in an area of the upper part 402.

For example, after the speaker unit 470 receives input through the input unit 410, the input information recognition unit 420 recognizes it, and the expression unit 450 can express it using this recognized content. The content expressed by 450 can be informed by voice, for example, the user can be informed of “mountain” by voice.

In addition, as described above, when the information control unit 430 creates a set problem, the speaker unit 470 informs the user of the set problem by voice, and the user inputs the set problem through the input unit 410. As a result of the input, the input information recognition unit 420 recognizes it, and the expression unit 450 or the speaker unit 470 can provide feedback to the input content entered by the user.

At this time, it is possible to detect the content of direct feedback, for example, "mountain", or to distinguish whether the input for the indirectly set problem was correct or not and mark it as "correct" or "incorrect". This may be notified in the form of protrusions of preset expression members of the expression unit 450.

Through this, the operation and usability of the input feedback-based smart pen 400 can be expanded and user convenience can be increased.

An exemplary explanation will be given with reference to FIGS. 13 to 17.

Referring to Figure 13, the contents of the setting problem (PB) are displayed. For example, the setting problem (PB) is the letter “mountain”. This setting problem (PB) may be generated by the information control unit 430, and may be output as a voice through the speaker unit 470 so that the user can recognize it.

Additionally, as an optional embodiment, the user may be able to detect the protruding shape of the expression members of the expression unit 450, for example, in the form of Braille.

Users can detect these configuration issues and enter them as is. For example, as shown in FIG. 14, the input feedback-based smart pen 400 can be manipulated by hand to input the contents of the setting problem.

In relation to this, if the content entered by the user through the input unit 410 meets the setting problem (PB), for example, if “mountain” is written correctly, the expression unit 450 can express this content, that is, “mountain”. there is. This may be in the form of Braille or other symbols. As an optional embodiment, “mountain” may be output through the speaker unit 470.

In addition, as an optional embodiment, information indicating that it matches the setting problem can be output, for example, matching information (YI) can be expressed as shown in FIG. 15, and for example, the word "correct answer" can be expressed. It can be expressed through the unit 450 or a voice saying “correct answer” can be output through the speaker unit 470.

Alternatively, the information entered by the user may not match the configuration issue.

For example, as shown in FIG. 16, the input feedback-based smart pen 400 can be manipulated by hand to input the content of the setting problem, and if the input content does not match the setting problem (PB), yes For example, if “mountain” is not written correctly and cannot be read in the sense of “mountain,” the expression unit 450 can express such content, that is, unrecognizability or non-compliance with the setting problem, and express “impossibility” as a specific example. You can. This may be in the form of Braille or other symbols. As an optional embodiment, “unable” may be output through the speaker unit 470.

In addition, as an optional embodiment, information indicating that the setting problem is not met may be output, for example, inconsistent information (NI) may be expressed as shown in FIG. 17, for example, the word "incorrect answer" may be displayed. It can be expressed through the expression unit 450 or a voice saying “incorrect answer” can be output through the speaker unit 470.

The input feedback-based smart pen of this embodiment can be easily used by the user by holding the main body, etc., and can perform an input operation through the input unit. At this time, as a result of the input operation, the input content may be visually displayed on paper, such as an actual pencil or pen, or, as another example, may not be displayed. The input information recognition unit may recognize such input content, and the expression unit may express the recognized information. As an optional embodiment, the information recognized by the input information recognition unit is used to transmit one or more processed information, such as Braille information, information on whether the answer is correct or incorrect, to the expression unit, and through the protrusion of one or more expression members of the expression unit. Users can recognize it.

The user can check the information he or she entered through the input unit by detecting the protruding form of the expression member of the expression unit immediately or a short time after the input. For example, if the user has no eyesight or has weak eyesight, it is difficult for the user to check the information he or she entered. In that case, the user can easily check the information through the expression unit.

In addition, even for users who have not yet learned letters, it is possible to easily detect whether a correct or incorrect answer is correct or incorrect through the expression unit in the process of practicing letters. At this time, the expression unit can display the protruding form of the expression member in a preset form in addition to the Braille form. The cases of correct and incorrect answers can be differentiated so that users can easily detect them.

Through this, feedback on information entered by users under various conditions can be easily provided and the convenience of users confirming and acquiring information can be increased.

In addition, it is possible to easily receive feedback on the content entered by the user by creating and presenting a setting problem to the user and expressing whether the user's input is a correct or incorrect answer.

Through this, it is possible to facilitate the user's learning of characters, and as a specific example, the convenience of users in the process of learning characters or those who have weak or no eyesight can be increased.

*

*As such, the present invention has been described with reference to the embodiments shown in the drawings, but these are merely illustrative, and those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. will be. Therefore, the true scope of technical protection of the present invention should be determined by the technical spirit of the attached patent claims.

Specific implementations described in the embodiments are examples and do not limit the scope of the embodiments in any way. For the sake of brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connections or connection members of lines between components shown in the drawings exemplify functional connections and/or physical or circuit connections, and in actual devices, various functional connections or physical connections may be replaced or added. Can be represented as connections, or circuit connections. Additionally, if there is no specific mention such as “essential,” “important,” etc., it may not be a necessary component for the application of the present invention.

In the specification of the embodiment (particularly in the claims), the use of the term “above” and similar referential terms may refer to both the singular and the plural. In addition, when a range is described in an example, the invention includes the application of individual values within the range (unless there is a statement to the contrary), and is the same as describing each individual value constituting the range in the detailed description. . Lastly, unless the order of the steps constituting the method according to the embodiment is clearly stated or there is no description to the contrary, the steps may be performed in an appropriate order. The embodiments are not necessarily limited by the order of description of the steps above. The use of any examples or illustrative terms (e.g., etc.) in the embodiments is merely for describing the embodiments in detail, and unless limited by the claims, the scope of the embodiments is not limited by the examples or illustrative terms. That is not the case. Additionally, those skilled in the art will recognize that various modifications, combinations and changes may be made depending on design conditions and factors within the scope of the appended claims or their equivalents.

100, 200, 300: Smartpen based on input feedback
101, 201, 301: main body
110, 210, 310: input unit
120, 220, 320: Input information recognition unit
150, 250, 350: Expression part

Claims (1)

a main body formed to be operated by a user;
An input unit where input operations are performed by user manipulation;
an input information recognition unit that recognizes the user's input motion; and
It includes an expression part disposed in one area of the outer surface of the main body part and moving by a magnetic field,
The input unit is connected to one side of the main body,
The input information recognition unit is disposed on the main body and is formed to move together with the main body when the user inputs an input.
Input feedback-based smartpen.