KR102286589B1 - Electronic pen - Google Patents

Abstract

According to an aspect of the present invention, a core to enable writing on the medium; a body part inserted so that a part of the core part is exposed to fix the position of the core part; and a cap part having a predetermined internal space for protecting the core part by inserting one side of the body part in a non-use state, wherein the cap part includes, when the other side of the body part is inserted, the other side of the body part A receiving portion for accommodating and a position fixing portion disposed in the inner space so as to be in contact with the other side of the main body to define a limit of insertion of the other side of the main body, wherein the main body includes a user-gripable body portion and the non-use An electronic pen having a locking part protruding from one side of the body part so that the position fixing part is mounted in a state where the position fixing part is mounted and the cap part is fixed in position to provide a mounting space may be provided.

Description

Electronic pen {ELECTRONIC PEN}

The present invention relates to an electronic pen, and more particularly, to an electronic pen that improves user convenience.

Recently, technologies and products capable of recognizing a user's handwriting using an electronic pen and digitizing and storing the recognized content have been commercialized. However, the development of a method for providing the recognized and digitized handwriting content to the user in a meaningful way using such an electronic pen has not yet been developed. development is required.

On the other hand, in the conventional electronic pen, the core is located in the center of the body part gripped by the user, and it is common to adopt the configuration of the existing writing instrument, and is stored by inserting it into the cover when not in use.

Here, in the case of inserting the main body into the cover, conventionally, in order to prevent separation of the main body and the cover, a protrusion is formed on the outer surface of the main body, a groove is formed on the inner surface of the cover, and the main body is inserted into the cover in such a way that the protrusion is inserted into the groove. fixed.

In this conventional method, the protrusions are frequently damaged by external factors that may occur while the user is using the main body, which leads to a decrease in the bonding force between the main body and the cover, which in turn shortens the life of the electronic pen. has occurred

SUMMARY OF THE INVENTION It is an object of the present invention to provide an electronic pen that maximizes durability and lifespan by not affecting the bonding force between the body part and the cap part even when various external factors are generated.

According to an aspect of the present invention, the core to enable writing on the medium; a body part inserted so that a part of the core part is exposed to fix the position of the core part; and a cap part having a predetermined internal space for protecting the core part by inserting one side of the body part in a non-use state, wherein the cap part includes, when the other side of the body part is inserted, the other side of the body part A receiving portion for accommodating and a position fixing portion disposed in the inner space so as to be in contact with the other side of the main body to define a limit of insertion of the other side of the main body, wherein the main body includes a user-gripable body portion and the non-use An electronic pen having a locking part protruding from one side of the body part so that the position fixing part is mounted in a state where the position fixing part is mounted and the cap part is fixed in position to provide a mounting space may be provided.

According to another aspect of the present invention, the core to enable writing on the medium; a body part inserted so that a part of the core part is exposed to fix the position of the core part; and a cap part having a predetermined internal space for protecting the core part by inserting one side of the main body part in a non-use state, wherein the cap part includes a accommodating part accommodating one side of the main body part and the interior of the accommodating part and a position fixing part protruding from the bottom surface of the body part, wherein the body part protrudes from one side of the body part so that the user can grip the body part and the position fixing part is mounted in the non-use state to fix the position of the cap part An electronic pen may be provided that includes a locking part for providing a mounting space, wherein the core part is eccentrically disposed from the center of the body part toward the outer circumferential surface, and the lock part is formed between the center line of the body part and the core part. .

According to the electronic pen according to the present invention, even if various external factors are generated, the coupling force between the body part and the cap part is not affected, so that durability and lifespan can be maximized.

In addition, when the body part is inserted into the cap part, it is possible to provide convenience to the user by allowing the body part to be mounted on the cap part at any time.

1 is a schematic diagram for explaining a system including an electronic pen related to embodiments of the present invention and an electronic device interworking with the electronic pen.
2 is a diagram illustrating an embodiment of a medium related to embodiments of the present invention.
3 is a diagram illustrating an exemplary appearance of an electronic pen according to embodiments of the present invention.
4 is a block diagram illustrating components of an electronic pen according to embodiments of the present invention.
5 is a block diagram illustrating components of an electronic device according to embodiments of the present invention.
6 and 7 are diagrams exemplarily illustrating unit cells constituting a code pattern according to an embodiment of the present invention.
8 is a diagram for explaining a method of encoding 2-bit information in an information code according to embodiments of the present invention.
9 is a diagram for explaining a method of generating location information of an electronic pen with respect to a medium according to embodiments of the present invention.
10 is a view for explaining an embodiment of reproducing the user's handwriting in real time according to the present invention according to the present invention.
11 to 15 are diagrams for explaining another embodiment of reproducing the user's handwriting in real time according to the present invention.
16 is a diagram for explaining a replay target section according to the present invention.
17 is a diagram illustrating a replay playback time determined according to an embodiment of the present invention for the replay target section as shown in FIG. 16 .
18 and 19 are diagrams illustrating a replay playback time determined according to another embodiment of the present invention for the replay target section as shown in FIG. 16 .
20 to 24 are diagrams for explaining some embodiments of determining a replay playback time to replay a stroke written by a user according to other embodiments of the present invention.
25 is a diagram for explaining a method of determining a reproduction time of a replay based on the number of strokes, according to some embodiments of the present disclosure.
26 is a view for explaining an embodiment of determining a replay speed of a replay according to the number of strokes included in a replay target content according to some embodiments of the present invention.
27 is a view for explaining an embodiment of determining the number of replay strokes per unit time according to a replay reproduction speed according to some embodiments of the present invention.
28 is a diagram for explaining a method of performing a replay operation on a user's handwriting, according to some embodiments of the present invention.
29 is a view of the entire handwritten content and the target handwritten content during a capture operation of the electronic device according to the present invention.
30 to 32 are examples of a user interface for receiving a target section according to the present invention.
33 to 35 are other examples of a user interface for receiving a target section according to the present invention.
36 and 37 are another example of a user interface for receiving a target section according to the present invention.
38 is a view of a screen for outputting entire handwritten contents for receiving an input of a target section according to the present invention.
39 and 40 are diagrams of a screen for identifying a target handwritten content according to the present invention.
41 is a diagram illustrating a captured image according to the present invention.
42 is a schematic perspective view illustrating an exploded view of the main body and the cap provided in the electronic pen according to an embodiment of the present invention.
43 is a schematic perspective view illustrating a state in which a cap provided in the electronic pen according to an embodiment of the present invention is inserted into the other side of the main body.
44 is a schematic perspective view illustrating an internal configuration of a cap and a main body provided in the electronic pen according to an embodiment of the present invention.
45 is a schematic cross-sectional view taken along line AA of FIG. 44 .
46 is a schematic perspective view illustrating a modified example of a cap provided in the electronic pen according to an embodiment of the present invention.
47 is a schematic front view illustrating a main body provided in an electronic pen according to an embodiment of the present invention.
48 and 49 are schematic side views for explaining a process in which the cap is inserted into one side of the main body provided in the electronic pen according to an embodiment of the present invention.
50 and 51 are schematic perspective views illustrating an exploded main body provided in the electronic pen according to an embodiment of the present invention.
52 to 54 are schematic perspective views for explaining a substrate unit, a camera module, and a lighting module fixed in position on the body provided in the electronic pen according to an embodiment of the present invention.
55 to 57 are schematic perspective views for explaining a process of inserting a core into a body provided in an electronic pen according to an embodiment of the present invention.
58 is a flowchart of a first embodiment of a method for real-time reproduction of content written by a user according to the present invention.
59 is a flowchart of a second embodiment of a method for real-time reproduction of content written by a user according to the present invention.
60 is a flowchart of a first embodiment of a method for replaying handwritten content according to the present invention.
61 is a flowchart of a second embodiment of a method for replaying handwritten content according to the present invention.
62 is a flowchart of a handwriting capture method according to an embodiment of the present invention.

The embodiments described in this specification are for clearly explaining the spirit of the present invention to those of ordinary skill in the art to which the present invention pertains, so the present invention is not limited by the embodiments described herein, and the present invention It should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in the present specification are selected as widely used general terms as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or emergence of new technology of those of ordinary skill in the art to which the present invention belongs. can However, if a specific term is defined and used with an arbitrary meaning, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the terms and the contents of the entire specification, rather than the names of simple terms.

The drawings attached to this specification are for easy explanation of the present invention, and the shapes shown in the drawings may be exaggerated as necessary to help understand the present invention, so the present invention is not limited by the drawings.

In the present specification, when it is determined that a detailed description of a known configuration or function related to the present invention may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

Electronic devices interworking with the electronic pen described in this specification are mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDA), portable multimedia players (PMPs), navigation, etc. It may include a mobile terminal as well as a fixed terminal such as a digital TV, a desktop computer, and the like.

According to an aspect of the present invention, there is provided an electronic device for reproducing a user's handwriting on a medium, comprising: a communication unit communicating with an electronic pen detecting information about the user's handwriting; a display for displaying at least a portion of a medium image corresponding to the medium, and visually displaying the user's handwriting on the medium image; and based on the pen data received from the communication unit, it is determined whether the user's handwriting position satisfies a predetermined condition with respect to a first area that is at least a part of the medium image being displayed through the display, and the predetermined condition is determined. If satisfied, a part of the medium image being displayed through the display is shifted from the first area to a second area different from the first area, the second area is displayed through the display, and the user's handwriting a controller configured to display reproduction of the user's handwritten content at a position on the second area corresponding to the user's handwriting position to reproduce the content; An electronic device comprising a may be provided.

The predetermined condition may be whether the user's writing position is out of the first area.

Alternatively, the predetermined condition may be whether the user's handwriting position is included in the edge area of the first area.

The second area may be determined based on the user's handwriting position with respect to the medium.

In this case, the second area may be determined such that the user's writing position with respect to the medium is located at a central portion.

Alternatively, the second region may be determined by further considering the position of the edge of the medium image.

In particular, the second region may be determined so that the edge position of the medium image does not deviate more than a predetermined distance from the edge region of the screen displayed on the display.

In determining whether the predetermined condition is satisfied, the controller may determine whether the predetermined condition is satisfied by using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting. can

Also, the controller may determine whether the predetermined condition is satisfied by using first pen data corresponding to a pen-down time among a plurality of pen data for the one stroke.

Also, when the predetermined condition is satisfied, the controller may determine the second area based on location information included in the first pen data.

The controller may determine whether the predetermined condition is satisfied by using second pen data corresponding to a pen-up time among a plurality of pen data for the one stroke.

Also, when the predetermined condition is satisfied, the controller may determine the second area based on location information included in the second pen data.

Also, the controller may determine whether the predetermined condition is satisfied with respect to each of a plurality of strokes included in the user's handwriting.

According to another aspect of the present invention, there is provided an electronic device for reproducing a user's handwriting on a medium, comprising: a communication unit communicating with an electronic pen detecting information about the user's handwriting; a display for displaying at least a partial region of a medium image corresponding to the medium, and visually displaying the user's handwriting on the medium image; and displaying the first stroke included in the user's handwriting at a corresponding position of the medium image, receiving pen data constituting the second stroke included in the user's handwriting, and configuring the second stroke. It is determined whether the position of the second stroke satisfies a predetermined condition based on at least one pen data among the pen data, and when the predetermined condition is satisfied, the at least one pen constituting the second stroke a controller for shifting at least a partial region of the medium image displayed through the display based on data to correspond to the distance and direction of the first stroke; An electronic device comprising a may be provided.

The predetermined condition may be whether the location information of the at least one pen data constituting the second stroke is out of a partial area of the medium image currently being displayed through the display.

The controller may shift at least a partial region of the medium image so that a position corresponding to the at least one pen data is located in a central portion.

The at least one pen data may be at least one of pen data corresponding to a pen down time point and pen data corresponding to a pen up time point among a plurality of pen data constituting the second stroke.

According to another aspect of the present invention, there is provided an electronic device for reproducing a user's handwriting on a medium, comprising: a communication unit communicating with an electronic pen detecting information about the user's handwriting; a display for displaying a medium image corresponding to the medium, and visually displaying the user's handwriting on the medium image; and determining whether the user's handwriting is reproduced in a normal mode or an enlarged mode through the display, and if the normal mode, reproduces the user's handwritten content according to a first reproduction mode, and is the enlarged mode a control unit for reproducing the user's handwritten content according to a second reproduction mode; and, when the user's handwriting is reproduced according to the second reproduction mode, the control unit places a partial area of the medium image displayed on the display through the enlarged mode at the user's handwriting position. An electronic device characterized in that it shifts accordingly may be provided.

According to another aspect of the present invention, there is provided a method of controlling an electronic device for reproducing a user's handwriting on a medium, based on pen data received from a communication unit communicating with an electronic pen that detects information about the user's handwriting. determining whether a user's handwriting position satisfies a predetermined condition with respect to a first area that is at least a part of a medium image displayed through a display; When the predetermined condition is satisfied, a portion of the medium image displayed through the display may be displayed in the first area to be different from the first area in order to display through the display that the user's handwriting is reproduced. displaying the second area through the display by shifting to a second area; and displaying the reproduction of the user's handwritten content at a location on the second area corresponding to the user's handwriting position to reproduce the user's handwritten content. A method of controlling an electronic device comprising a may be provided.

The predetermined condition may be whether the user's writing position is out of the first area.

The predetermined condition may be whether the user's handwriting position is included in an edge area of the first area.

The second area may be determined based on the user's handwriting position with respect to the medium.

The second area may be determined such that the user's handwriting position with respect to the medium is located at a central portion.

The determining may include determining whether the predetermined condition is satisfied by using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting in determining whether the predetermined condition is satisfied. may be judging.

The determining may include determining whether the predetermined condition is satisfied by using first pen data corresponding to a pen down time among a plurality of pen data for the one stroke.

When the predetermined condition is satisfied, the second area may be determined based on location information included in the first pen data.

The determining may include determining whether the predetermined condition is satisfied by using second pen data corresponding to a pen-up time among a plurality of pen data for the one stroke.

When the predetermined condition is satisfied, the second area may be determined based on location information included in the second pen data.

The determining may include determining whether the predetermined condition is satisfied with respect to each of a plurality of strokes included in the user's handwriting.

According to another aspect of the present invention, there is provided a control method of an electronic device for reproducing a user's handwriting on a medium, the method comprising: receiving pen data constituting a first stroke included in the user's handwriting from the electronic pen; displaying a first stroke included in the user's handwriting at a corresponding position of the medium image; receiving pen data constituting a second stroke included in the user's handwriting from the electronic pen; determining whether the position of the second stroke satisfies a predetermined condition based on at least one pen data among pen data constituting the second stroke; When the predetermined condition is satisfied, at least a partial region of the medium image displayed through the display is shifted according to the distance and direction of the first stroke of the at least one pen data constituting the second stroke. to do; and displaying the medium image with the second stroke on the shifted partial region. A method of controlling an electronic device comprising a may be provided.

According to another aspect of the present invention, there is provided a control method of an electronic device for reproducing the user's handwritten contents on a medium, the step of determining whether the user's handwritten contents are being reproduced through a display in a normal mode or an enlarged mode ; and reproducing the user's handwriting according to a first reproduction mode in the normal mode, and reproducing the user's handwriting according to a second reproduction mode in the enlarged mode; and, when the user's handwriting is reproduced according to the second reproduction mode, the control unit places a partial area of the medium image displayed on the display through the enlarged mode at the user's handwriting position. There may be provided a method for controlling an electronic device, characterized in that it shifts accordingly.

According to another aspect of the present invention, a recording medium recording a program for executing the method for controlling an electronic device provided by the present invention as described above may be provided.

First, an electronic pen and an electronic device interlocking with the electronic pen related to some embodiments of the present invention will be briefly described in an operating environment, and the electronic pen and the electronic device interlocking with the electronic pen according to the embodiments of the present invention will be briefly described. and a method of controlling an electronic device will be described in detail.

<System Configuration>

1 is a schematic diagram for explaining a system including an electronic pen and an electronic device interlocked with the electronic pen according to embodiments of the present invention.

The system may include at least one medium 1000 , at least one electronic pen 2000 , at least one electronic device 3000 , and at least one server 4000 .

The medium 1000 provides a surface for a user to write a desired item using the electronic pen according to embodiments of the present invention.

The medium 1000 may be made of a material such as paper, plastic, or metal, and the material of the medium 1000 is not limited by the present invention.

When the electronic pen according to embodiments of the present invention is an electronic pen (hereinafter, referred to as an optical electronic pen) implemented using an optical component including a camera module, the medium 1000 is It may have a recognizable code pattern. A detailed description of the code pattern will be provided later. When the medium 1000 is provided with a code pattern, the code pattern may be provided to the medium 1000 through a method such as printing.

The electronic pen 2000 may generate pen data by sensing information about the user's handwriting. The pen data may be used to generate stroke data and the like for the user's handwriting. A detailed description of the pen data will be provided later.

The electronic device 3000 may receive and interpret pen data from the electronic pen 2000 . Stroke data may be generated according to the interpretation of the pen data.

The electronic device 3000 may appropriately process the analyzed stroke data and reproduce and display the user's handwriting in real time according to the stroke data through a display provided in the electronic device 3000 , or may be replayed and displayed later.

In addition, the electronic device 3000 may store pen data and/or stroke data generated according to the analysis of the pen data in a memory provided in the electronic device 3000, etc., according to a user's request, etc. Alternatively, appropriate processing may be performed on the stroke data.

The electronic device 3000 may be connected to the server 4000 through a network and transmit or receive necessary information through the network.

The server 4000 may be connected to the electronic device 3000 through a network to receive or transmit necessary information.

The server 4000 may be connected to the plurality of electronic devices 3000 to database pen data (or stroke data) received from the electronic devices 3000 .

The server 4000 may appropriately process pen data (or stroke data) stored in a database according to a request of a plurality of electronic devices 3000 or a user's request.

The server 4000 may share and perform some or all of the functions of the electronic device 3000 described above. For example, the electronic device 3000 may receive pen data from the electronic pen 2000 and directly transmit the pen data to the server 4000 without performing a special processing procedure for the pen data. , the server 4000 may perform operations such as generating stroke data by receiving pen data, storing the stroke data, and additionally processing the stroke data, as described above.

1 shows that one medium 1000-1 corresponds to one electronic pen 2000-1, but the correspondence between the medium 1000 and the electronic pen 2000 is 1:N or N: It is okay to respond according to the correspondence relationship of 1.

Also, although one electronic pen 2000-1 is shown to correspond to one electronic device 3000-1 in FIG. 1, the correspondence between the electronic pen 2000 and the electronic device 3000 is also It is okay to respond according to the correspondence of 1:N or N:1.

In addition, although a plurality of electronic devices 30000 are illustrated as being connected to one server 4000 in FIG. 1 , a system according to embodiments of the present invention may include two or more servers.

Meanwhile, in FIG. 1 , the electronic pen 2000 is shown to communicate with the electronic device 3000 , and the electronic device 3000 is shown to communicate with the electronic pen 2000 and the server 4000 , However, if necessary, the electronic pen 2000 may directly communicate with the server 4000 .

<Medium>

Next, the medium 1000 related to embodiments of the present invention will be described.

2 is a diagram illustrating an embodiment of a medium related to embodiments of the present invention.

Referring to FIG. 2 , it is shown that a notebook or book is provided with a plurality of mediums 1000 . As shown in FIG. 2 , according to some embodiments of the present invention, at least some or all of pages constituting a note or book may be implemented as a medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical electronic pen, code patterns according to embodiments of the present invention may be provided on at least some or all of pages constituting a note or book.

Meanwhile, only a region of at least a portion of a whole surface of a page constituting a note or book may be implemented as the medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical electronic pen, the code pattern is not provided on the whole surface of pages constituting the note or book, but only on a partial area. may have been

Meanwhile, although not shown in the drawings, the medium 1000 according to embodiments of the present invention may be implemented in the form of a blackboard or the like. That is, the medium 1000 according to embodiments of the present invention may be implemented in the form of a blackboard (electronic blackboard) provided with a code pattern.

<Electronic Pen>

Next, an electronic pen according to embodiments of the present invention will be described.

3 is a diagram illustrating an exemplary appearance of an electronic pen according to embodiments of the present invention, and FIG. 4 is a block diagram for explaining components of an electronic pen according to embodiments of the present invention.

Referring to FIG. 3 , the electronic pen 2000 has a main body 2020 for fixing the position of a core part 2010 (see FIG. 42 ) that enables writing on the medium 1000 , and the core part 2010 in a non-use state. ) may include a cap portion 2030 to protect it.

Here, the non-use state may mean a state in which the electronic pen 2000 according to an embodiment of the present invention is stored. can mean

The core 2010 is a component to enable writing on the medium 1000 , and may include a ball and ink, and the ink may be oil-based, water-based, or neutral.

In addition, the core 2010 may be a black lead used in a pencil or a lead used in a general writing instrument.

The body part 2020 is a component that is inserted so that a part of the core part 2010 is exposed to fix the position of the core part 2010, and may refer to a type of grip part that a user can grip by hand.

The cap part 2030 may have a predetermined internal space to protect the core part 2010 by inserting one side of the body part 2020 in a non-use state, and may be inserted into the other side of the body part 2020. In this case, a part of the core 2010 may be exposed to the outside to enable writing.

However, when writing is possible by the core part 2010 , the cap part 2030 does not necessarily need to be inserted into the other side of the body part 2020 , and is separated from the body part 2020 and has a predetermined space. It is free even if it is placed in

Referring to FIG. 4 , the electronic pen 2000 according to an embodiment of the present invention includes an input unit 2100 , an output unit 2200 , a pattern sensing unit 2300 , a communication unit 2400 , a sensor unit 2500 , It may include a memory 2600 , a power supply unit 2700 , a control unit 2800 , and the like. However, since the components shown in FIG. 4 are not essential, an electronic pen having many more components than the illustrated components or fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic pen 2000 will be described in turn.

The input unit 2100 may receive a user input from a user. The user input may be made in various forms including a button input, a key input, a touch input, and a voice sound. For example, the electronic pen 2000 may receive a button input from the user to control power on/off of the electronic pen 2000 .

Examples of the input unit 2100 include a traditional button, a jog wheel, etc., as well as a touch sensor that detects a user's touch, a microphone that receives a voice signal, a camera that recognizes gestures through image recognition, and a camera that detects user approach. Comprehensive including a proximity sensor composed of an illuminance sensor or infrared sensor, a motion sensor that recognizes a user's motion through an acceleration sensor or a gyro sensor, and various types of input means that detect or receive various types of user input is the concept

The output unit 2200 may output various information and provide it to the user. The output unit 2200 generates a display that outputs visible light that can be recognized through the user's eyes, a speaker that outputs a sound that can be recognized through the user's hearing, and a vibration that can be recognized through the user's tactile sense. It should be interpreted as a comprehensive concept including all of the haptic device and other various types of output means. For example, the electronic pen 2000 includes a buzzer ( buzzer) or the like to output a sound with a predetermined characteristic. For another example, a predetermined visible light may be output through a display such as an LED lamp in order to provide the user with information on the operating state of the electronic pen 2000 .

The pattern detection unit 2300 is configured to detect a code pattern in which position information for determining the position of the electronic pen 2000 with respect to the medium 1000 is encoded, and a camera module 2320 and a lighting module ( 2340).

The camera module 2320 is for acquiring an image of the code pattern provided in the medium 1000 . The camera module 2320 adjusts to a predetermined time interval (eg, 1/60 second to 1/240 second, etc.) while the electronic pen 2000 moves on the medium 1000 according to the user's handwriting, etc. An image of a partial region of the code pattern provided in the medium 1000 is acquired. Accordingly, the electronic pen 1000 interprets information on unit cells included in the acquired image according to a code pattern interpretation method to be described later, and the position of the electronic pen 2000 with respect to the medium 1000 . can be interpreted in the form of coordinates.

The lighting module 2340 irradiates light of a predetermined specific frequency toward the medium 1000 so that an image for the code pattern can be obtained through the camera module 2320 . The code pattern provided to the medium 1000 according to the embodiment of the present invention may be printed using an infrared absorbing ink. In this case, the lighting module 2340 may be well absorbed by the ink. Light of a wavelength may be irradiated to the medium 1000 . In this case, the camera module 2320 may be configured to take an image for the infrared band, and for this, the camera module 2320 may include an infrared filter that selectively passes only the infrared band.

The communication unit 2400 may communicate with an external device. For example, the electronic pen 2000 may communicate with the electronic device 3000 or the server 4000 through the communication unit 2400 . Accordingly, the electronic pen 2000 may transmit/receive various types of information to and from an external device. For example, the electronic pen 2000 may transmit pen data generated by the electronic pen 2000 to the electronic device 3000 or the server 4000 through the communication unit 2400, and the electronic pen 2000 ), commands and/or data for controlling the operation of the electronic pen 2000 or providing necessary information to the electronic pen 2000 may be received from the electronic device 3000 or the server 4000 through the communication unit 2400 . .

The communication unit 2400 may include a wired module 2420 and a wireless module 2440 .

The wired module 2420 is a module for transmitting and receiving data with an external device by wire, and may include a configuration such as a USB port, a PS/2 port, a parallel port, and a serial port that can transmit and receive data with an external device. , and further, an Ethernet port for accessing the Internet through a local area network (LAN) may be included.

The wireless module 2440 is a mobile communication module that accesses a mobile communication network through a mobile communication base station and transmits and receives data, a wireless local area network (WLAN) series communication method such as Wi-Fi, or Bluetooth; It may include a short-distance communication module using a wireless personal area network (WPAN)-based communication method such as Zigbee.

The sensor unit 2500 may sense various types of information. Here, various information may be used to generate a control signal for controlling the operation of the electronic pen 2000 , and may be used to generate pen data generated by the electronic pen 2000 . Various information sensed by the sensor unit 2500 may be provided to the electronic device 3000 or the server 4000 .

The sensor unit 2500 may include a pressure sensor 2520 , a pen nib sensor 2540 , a slip sensor 2560 , and the like.

The pressure sensor 2520 may sense pressure generated when the user writes. For example, when the user takes notes using the electronic pen 2000 , the electronic pen 2000 comes into contact with the writing surface, and the pressure generated at this time is sensed by the pressure sensor 2520 . can In particular, the pressure sensor 2520 may be provided at the rear end of the pen nib (core, 2010) mounted on the electronic pen 2000 (one end of the pen nib other than the pen tip) to sense the pressure. The electronic pen 2000 may use the pressure value sensed by the pressure sensor 2520 to generate pen data, which will be described in detail later. In this case, the pressure value included in the pen data may be processed into pen pressure information applied to the medium 1000 by the user when writing, and used to reproduce the content written by the user. Alternatively, the electronic pen 2000 in the off state may be used as a trigger signal for turning on the electronic pen 2000 based on a signal output through the pressure sensor 2520 .

The pen nib sensor 2540 may detect a nib identifier for indicating the type of the pen nib (core unit 2010) mounted on the electronic pen 2000 . For example, a pen nib identifier for indicating the color of the pen nib (core part, 2010) may be provided on the outside of the pen nib (core part, 2010) mounted on the electronic pen 2000, in which case the nib sensor 2540 can detect the pen nib identifier through an optical method/magnetic method and other various available methods. The value sensed by the pen nib sensor 2540 or the information on the pen nib (core, 2010) analyzed by the sensed value may be provided to the electronic device 3000, and the electronic device 3000 may receive the information It can be used to reproduce the content written by the user based on the

The sleep sensor 2560 may detect the state of the electronic pen 2000 used to determine whether the electronic pen 2000 in the on state automatically switches to the off state. For example, the sleep sensor 2560 may include an acceleration sensor, etc., through which the movement of the electronic pen 2000 may be detected. If it is determined that the electronic pen 2000 is not moving for a predetermined time based on the value sensed by the slip sensor 2560 , the electronic pen 2000 automatically controls the electronic pen 2000 . The state can be switched to the off state.

According to some embodiments of the present invention, when the electronic pen 2000 is in the on state, power is normally supplied to the components included in the electronic pen 2000 so that the components operate normally as necessary. However, when the electronic pen 2000 is in the off state, power to all or some of the components provided in the electronic pen 2000 is cut off and the electronic pen 2000 is provided in the off state. All or some of the components cannot operate normally. In particular, according to some embodiments of the present invention, even when the electronic pen 2000 is in the off state, the pressure sensor 2520 and/or the analysis module for interpreting the signal output from the pressure sensor are normally included. Power may be supplied, and accordingly, the electronic pen 2000 in the off state may be automatically switched to the on state based on a sensed value output from the pressure sensor 2520 .

The memory 2600 may store various types of information. The memory 2600 may temporarily or semi-permanently store data. An operation program such as firmware for driving the electronic pen 2000 may be stored in the memory 2600 , and if necessary, pen data generated by the electronic pen 2000 and the sensor unit 2500 . Information, commands, and data necessary for driving the electronic pen 2000, such as a sensing value output by the , may be stored.

Examples of the memory 2600 include a hard disk (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), a random access memory (RAM), and the like. This can be.

The power supply unit 2700 may provide power necessary for the operation of each component of the electronic pen 2000 . The power supply unit 2700 may be implemented as a rechargeable battery, and when the communication unit 2400 of the electronic pen 2000 includes a charging port (eg, a USB port), the electronic pen ( 2000) is connected to the electronic device 3000, power may be supplied from the electronic device 3000, and accordingly, the battery may be charged.

The controller 2800 controls the overall operation of the electronic pen 2000 . To this end, the controller 2800 may perform calculation and processing of various types of information and may control operations of components of the electronic pen 2000 .

In addition, the control unit 2800 may analyze the image for the code pattern obtained by the pattern detection unit 2300, and decode information encoded in the unit cell included in the image of the obtained code pattern, Furthermore, position coordinates of the electronic pen 2000 with respect to the medium 1000 and identification information (eg, book information or page information, etc.) of the medium 1000 may be obtained from the decoded information.

The controller 2800 may generate pen data based on information obtained by decoding information encoded in a unit cell, and as described above, the generated pen data is stored in the memory 2600 or It may transmit to the electronic device 3000 and/or the server 4000 through the communication unit 2400 . A detailed description of the generation of pen data will be provided later.

On the other hand, the controller 2800 analyzes the image acquired by the first controller and the pattern detector 2300 for controlling the general operation of the electronic pen 2000, decodes the information necessary for the unit cell, and It may be divided into a second control unit for generating pen data. The control unit 2800 may be logically divided into the first control unit and the second control unit, but the first control unit and the second control unit are physically may be implemented in a form separated from each other.

The controller 2800 may be implemented as a computer or a similar device according to hardware software or a combination thereof. The hardware-type control unit may be provided in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, may be provided in the form of a program for driving the hardware-type control unit.

Meanwhile, in the following description, unless otherwise specified, the operation of the electronic pen 2000 may be interpreted as being performed under the control of the controller 2800 .

<Electronics>

Next, the electronic device 3000 according to embodiments of the present invention will be described.

5 is a block diagram illustrating components of an electronic device according to embodiments of the present invention.

Referring to FIG. 5 , the electronic device 3000 may include an input module 3100 , an output module 3200 , a communication module 3300 , a memory module 3400 , and a control module 3500 . However, since the components shown in FIG. 5 are not essential, an electronic device having many more components than the illustrated components or fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic device 3000 will be described in turn.

The input module 3100 may receive a user input from a user. The user input may be made in various forms, including a key input, a touch input, and a voice sound. Examples of the input module 3100 that can receive such a user input include a traditional keypad, keyboard, and mouse, as well as a touch sensor that detects a user's touch, a microphone that receives a voice signal, and a gesture through image recognition. camera, a proximity sensor consisting of an illuminance sensor or infrared sensor that detects user approach, a motion sensor that recognizes a user's motion through an acceleration sensor or a gyro sensor, and other various types of sensing or receiving various types of user input It is a comprehensive concept that includes all input means of Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor for detecting a touch through a touch panel or a touch film attached to the display panel, an optical touch sensor for detecting a touch by an optical method, and the like.

The output module 3200 may output various information and provide it to the user. The output module 3200 generates a display that outputs visible light that can be recognized through the user's eyes, a speaker that outputs a sound that can be recognized through the user's hearing, and a vibration that can be recognized through the user's tactile sense. It is a comprehensive concept that includes both haptic devices and other various types of output means.

The display may output an image for reproducing contents written by a user using the electronic pen 2000 and/or the electronic device 3000 according to an embodiment of the present invention.

In addition, the display is a liquid crystal display (LCD: Liquid Crystal Display),

Light emitting diode (LED) display, organic light emitting diode (OLED) display, flat panel display (FPD), transparent display, curved display, flexible display (Flexible display), a three-dimensional display (3D display), a holographic display (holographic display), a concept meaning an image display device in a broad sense including all of various types of devices capable of performing an image output function and other functions am. Such a display may be in the form of a touch display integrally formed with the touch sensor of the input module 3100 .

The communication module 3300 may communicate with an external device. For example, the electronic device 3000 may communicate with the electronic pen 2000 or the server 4000 through the communication module 3300 . Accordingly, the electronic device 3000 may transmit/receive various types of information to and from an external device. For example, the electronic device 3000 may receive pen data generated by the electronic pen 2000 through the communication module 3300 , and may transmit necessary information to the electronic pen 2000 . In addition, the electronic device 3000 may transmit, to the server 4000 , pen data received from the electronic pen 2000 or stroke data obtained by analysis of the pen data through the communication module 3300 , and necessary information may be received from the server 4000 .

The communication module 3300 includes a wired communication module including a LAN port, a USB port, a PS/2 port, a parallel port, a serial port, etc. connected to the Internet through a LAN (Local Area Network), and mobile communication via a mobile communication base station. A mobile communication module that accesses a network to transmit and receive data, a wireless local area network (WLAN) type communication method such as Wi-Fi, or a wireless personal area network (WPAN) type communication method such as Bluetooth or Zigbee It may be composed of a short-distance communication module using a communication method of

The memory module 3400 may store various types of information. The memory module 3400 may temporarily or semi-permanently store data. The memory module 3400 may store an operating system (OS) for driving the electronic device 3000 , and if necessary, various data received from the electronic pen 2000 and the electronic pen 2000 . An application program for processing various data received from the .

Examples of the memory module 3400 include a hard disk (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), and a random access memory (RAM). etc. may exist.

The control module 3500 controls the overall operation of the electronic device 3000 . To this end, the control module 3500 may perform calculation and processing of various types of information and may control operations of components of the electronic device 3000 .

The control module 3500 may be implemented as a computer or a similar device according to hardware software or a combination thereof. The hardware-type control module may be provided in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, may be provided in the form of a program for driving a hardware-type control module).

Meanwhile, in the following description, unless otherwise specified, the operation of the electronic device 3000 may be interpreted as being performed by the control of the control module 3500 .

<Operation of the electronic pen>

Hereinafter, the operation of the electronic pen according to embodiments of the present invention will be described.

A user may take notes on the medium 1000 according to some embodiments of the present invention using the electronic pen 2000 according to embodiments of the present invention.

In addition, the electronic pen 2000 according to the embodiments of the present invention acquires an image of at least a partial region of the code pattern provided in the medium 1000 according to some embodiments of the present invention, and the obtained image It is possible to obtain location information by analyzing information encoded in a unit cell included within. The electronic pen 2000 continuously acquires and processes/stores the image of the code pattern and the position information interpreted therefrom while the user is taking notes, so that the user can It is possible to generate basic data that can interpret whether or not the handwriting is performed along the trajectory.

Hereinafter, a code pattern according to embodiments of the present invention capable of encoding location information and the like will be first described, and the location information encoded in the code pattern using an image of the code pattern will be transferred to the electronic pen (2000). ) and how to interpret it.

However, since the electronic pen 2000 according to embodiments of the present invention uses a generally used pen nib (the core part, 2010), it is necessary to write only for the medium 1000 according to some embodiments of the present invention. It is not possible, and writing on a general medium (eg, paper on which a code pattern is not provided, etc.) is also possible. However, in this case, since the electronic pen 2000 cannot obtain location information for interpreting the user's handwriting trace, operations such as real-time reproduction and replay of the user's handwriting trace, as described later, are performed by the electronic device ( 3000) would be impossible to implement.

1. Code Patterns

The code pattern according to an embodiment of the present invention is configured in such a way that one unit cell is repeatedly arranged according to a desired size in two dimensions.

6 and 7 are diagrams exemplarily illustrating unit cells constituting a code pattern according to an embodiment of the present invention.

6 and 7 , each unit cell includes line segment codes, and the line segment codes can be largely classified into reference codes and information codes.

The reference code is composed of a horizontal reference code, a vertical reference code, and a cross reference code.

The reference code has a function of confirming the area of the unit cell when decoding the code pattern.

The information code performs a function for indicating information to be encoded in a unit cell, in a manner to be described later.

All other reference codes and information codes except for the cross reference code have the same geometric shape. That is, the reference codes and the information codes except for the cross reference code have a shape of rotational symmetry with each other and are 'line segment shape'.

The cross reference code, unlike other reference codes and information codes, has a cross-shaped geometric shape.

Meanwhile, in the unit cell, virtual lines may be defined, and the virtual lines are composed of a plurality of horizontal virtual lines extending in a horizontal direction and a plurality of vertical virtual lines extending in a vertical direction. In the description of some embodiments of the present invention, a component called 'virtual line' may be actually printed on the medium 1000, but may not be printed.

Each of the plurality of horizontal virtual lines is parallel to each other and is disposed apart from each other by a predetermined distance.

In addition, each of the plurality of vertical virtual lines are parallel to each other, and are disposed apart from each other by a predetermined distance.

Any one of the plurality of horizontal virtual lines is orthogonal to any one of the plurality of vertical virtual lines.

A plurality of intersection points formed by meeting a plurality of horizontal virtual lines and a plurality of vertical virtual lines are formed. These intersections are hereinafter referred to as virtual reference points. In the description of some embodiments of the present invention, a component called a 'virtual store' may be actually printed on the medium 1000, but may not be printed.

Referring to FIG. 6 , one unit cell is illustrated as having a total of 7 horizontal virtual lines and 7 vertical virtual lines, and the horizontal reference codes are disposed on the horizontal virtual line disposed at the top of them. It is shown that the vertical reference codes are arranged on the vertical virtual line arranged on the leftmost side.

The reference codes are placed on the virtual reference point. In particular, the reference codes are arranged so that their center of mass is at the virtual reference point. That is, the horizontal reference codes and the vertical reference codes are arranged so that the virtual reference point can be located in the center of both ends of each reference cord. In addition, the cross reference code having a cross-shaped geometric shape is arranged so that the center of the cross is at the virtual reference point.

Information codes are also placed on the virtual reference point. In particular, the information codes, unlike the reference codes, are arranged so that their center of mass is not arranged at the virtual reference point. That is, the virtual reference point is not disposed at the center of both ends of the information codes. In the case of information code, one end of both ends is placed near the virtual reference point, and the other end is determined according to the value to be encoded in the information code. , located at a different location than the virtual reference point. This will be described in detail in the method of encoding information into information codes.

The code pattern having the above-described shape and components is formed on the medium 1000 , and the code pattern actually formed on the medium 1000 may be implemented by printing or a similar method. At this time, when the code pattern is printed on the medium 1000 , as shown in FIG. 7 , only the aforementioned reference code and information code may be printed. That is, horizontal virtual lines, vertical virtual lines, and virtual reference points among the components constituting the above-described code pattern may not be actually printed.

2. Encoding/decoding of information

The basic principle of encoding information in an information code is to arrange one end of the information code near the virtual reference point and the other end of the information code so that the information code passes through the virtual reference point, from the one end to the other end. It encodes the desired information in the corresponding information code using the relationship with the end.

That is, the direction of the information code (hereinafter referred to as the direction of the information code) from one end of the information code (the end disposed closer to the virtual reference point) to the other end (the end disposed further away from the virtual reference point). ), the desired information is encoded in the corresponding information code.

A method of encoding information in an information code will be described in more detail. However, for convenience of explanation, a case in which information that can be encoded in one information code is 2 bits will be described as an example.

8 is a diagram for explaining a method of encoding 2-bit information in an information code according to embodiments of the present invention.

For clear explanation, it is assumed that the origin is a virtual reference point at which an information code to be encoded is arranged, and an orthogonal coordinate system defined in the directions of horizontal reference codes and vertical reference codes provided in a unit cell is assumed.

At this time, if the information to be encoded through the information code is '00', one end of the information code (the end located closer to the virtual reference point) is in the third quadrant of the orthogonal coordinate system, and the other end (the above) The direction of the information code can be determined so that the end (end) located further away from the virtual reference point can be located in the first quadrant of the Cartesian coordinate system (refer to (a) of FIG. 8).

If the information to be encoded through the information code is '01', one end of the information code (the end located closer to the virtual reference point) is in the fourth quadrant of the Cartesian coordinate system, and the other end (the virtual reference point) The direction of the information code can be determined so that the distal end positioned further away from .

In addition, when the information to be encoded through the information code is '10', one end of the information code (the end located closer to the virtual reference point) is in the first quadrant of the Cartesian coordinate system, and the other end (the above) The direction of the information code can be determined so that the end (end) located further away from the virtual reference point can be located in the third quadrant of the Cartesian coordinate system (refer to (c) of FIG. 8).

In addition, when the information to be encoded through the information code is '11', one end of the information code (the end located closer to the virtual reference point) is in the second quadrant of the orthogonal coordinate system, and the other end (the above) The direction of the information code can be determined so that the end) located further away from the virtual reference point can be located in the fourth quadrant of the Cartesian coordinate system (refer to (d) of FIG. 8).

If, as shown in FIG. 8, the information code is designed to encode 2-bit information in the information code, and as shown in FIGS. 6 and 7, 36 information codes are included in one unit cell. If there is, information that can be encoded in one unit cell may be 2 bits * 36 = 72 bits.

However, the method of encoding information in the information code according to the embodiments of the present invention is from one end of the information code (eg, the end located closer to the virtual reference point) to the other end of the information code (eg, For example, the number of bits of information that can be encoded in the information code is not limited to 2 bits, and may be 3 bits or more. For example, if the direction of the information code is interpreted in units of 45 degrees in order to encode information into the information code, there are a total of 8 distinct directions of the information code, and accordingly, a total of 3 bits of information is stored in one information code. can be encoded.

3. Composition of unit cell information

Next, information encoded in the unit cell will be described.

The unit cell information encoded in the unit cell may include error verification information, medium identification information, coordinate information, and other additional information.

The error verification information is information for determining whether an error has occurred during encoding of the unit cell.

The medium identification information is identification information on the medium 1000 in which the unit cell is provided. The medium identification information may include book information, page information, and the like.

The book information refers to identification information given to a corresponding note or book when the plurality of mediums 1000 are manufactured in the form of a note or book.

The page information is for identifying which page the medium 1000 on which the unit cell is provided in the corresponding note or book is located when the plurality of mediums 1000 are manufactured in the form of a notebook or book. means information.

In addition, when the medium 1000 is implemented to have a special format according to a special purpose (eg, a paper including a checklist for security check, a test paper, etc.), the medium identification information, the medium 1000 is It may include information for identifying which format it has.

The coordinate information means two-dimensional coordinate information indicating at which position the unit cell is located on the medium 1000 in which the unit cell is provided. Accordingly, the coordinate information may include an x-coordinate and a y-coordinate.

Other additional information may include various other necessary information. For example, license information on a coordinate code provided to the medium 1000 may be included in the other additional information.

As described above, the electronic pen 2000 analyzes at least one unit cell included in the image acquired through the pattern detection unit 2300 and decodes information encoded in the unit cell, Cell information can be acquired, and accordingly, medium identification information, coordinate information, and other additional information included in the unit cell information can be acquired.

4. Creation of pen data

Next, a method for the electronic pen 2000 to generate pen data based on unit cell information will be briefly described.

The pen data refers to information used to generate stroke data necessary to reproduce a user's writing trajectory in real time or to replay it later, in addition to unit cell information obtained by the electronic pen 2000 .

The pen data may include time information, pen pressure information, location information, medium identification information, and the like.

The visual information is information on a time point at which an image used to generate one unit of pen data is acquired or a time point at which one unit of pen data is generated.

The pen pressure information is pressure information output from the pressure sensor 2520 when an image used to generate one unit of pen data is acquired or when one unit of pen data is generated.

Since the medium identification information is the same as or similar to information included in the unit cell information, a detailed description thereof will be omitted.

The location information is information on the location of the electronic pen 2000 with respect to the medium 1000 that is generated by performing a correction operation necessary for coordinate information obtained from unit cell information. The location information may or may not coincide with coordinate information obtained from unit cell information, and a method of generating location information will be described in detail below.

9 is a diagram for explaining a method of generating location information of an electronic pen with respect to a medium according to embodiments of the present invention.

Referring to FIG. 9 , an image I acquired by the camera module 2320 of the electronic pen 2000 is exemplarily shown. As shown in FIG. 9 , the acquired image I includes at least one The above unit cell UC may be included, and the location CC of the unit cell UC may be obtained in the form of coordinates by interpreting information encoded in the unit cell by the above-described method. At this time, as shown, since the unit cell UC used to interpret the coordinate information may not be located in the center of the acquired image I, the The coordinate information may be slightly different from the exact position of the electronic pen 2000 with respect to the medium 1000 . That is, it can be assumed that the center IC of the acquired image I is closest to the position of the electronic pen 2000 with respect to the medium 1000, and the center IC of the acquired image I is the unit cell. It may be different from the coordinates (x,y) obtained by the coordinate information obtained from (UC).

Accordingly, the electronic pen 2000, in order to obtain the coordinates (x', y') of the center (IC) of the acquired image I, coordinate information obtained from the unit cell UC and the Calculate the offset value between the center (IC) of I), and add or subtract the calculated offset value (?x, ?y) to the coordinate information (x, y) obtained from the unit cell UC to obtain The coordinates (x', y') of the center (IC) of the image (I) are calculated.

The position of the electronic pen 2000 with respect to the medium 1000 can be more accurately calculated in the above-described manner, and the coordinate values (x', y') corrected in the above manner are used as the above-described position information. am.

As described above, the electronic pen 2000 can continuously generate pen data, and accordingly, the position movement of the electronic pen 2000 with respect to the medium 1000 according to the user's handwriting is real-time in the form of pen data. , and the pen data may be appropriately processed as needed by the electronic device 3000 or the server 4000 later as needed.

<Operation of electronic devices>

As described above, when pen data is generated, the electronic pen 2000 may store the pen data in the memory 2600 or transmit the pen data to the electronic device 3000 through the communication unit 2400 .

For example, when the electronic pen 2000 is in a state capable of communicating with the electronic device 3000 , the electronic pen 2000 may generate pen data and directly transmit the pen data to the electronic device 3000 in real time, but if When the electronic pen 2000 is not in a state capable of communicating with the electronic device 3000 , the electronic pen 2000 generates pen data and stores it in the memory 2600 , and later in a state in which communication with the electronic device 3000 is possible. , the stored pen data may be transmitted to the electronic device 3000 .

Hereinafter, the operation of the electronic device 3000 receiving the pen data will be described.

1. Real-time reproduction of user-written content #1

The electronic device 3000 may reproduce the content that the user is taking notes on the medium 1000 in real time based on the pen data received from the electronic pen 2000 and display it on the display of the electronic device 3000 . Hereinafter, a method of reproducing what a user is writing in real time and displaying it on a display will be described.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 are connected to each other in a communicable state, and the electronic pen 2000 transmits the pen data generated as described above in real time to the electronic device ( 3000) is assumed.

The electronic device 3000 may acquire information on the target medium 1000 on which the user is taking notes based on medium identification information included in the pen data received from the electronic pen 2000 .

For example, the electronic device 3000 may determine whether the target medium 1000 on which the user is taking notes is a medium having a specific format for a special purpose, or a medium forming a part of a product provided in the form of a book or note. You can check whether you are aware or not.

In addition, if the target medium 1000 is a medium that forms a part of a product provided in the form of a book or note, it may be checked whether the target medium 1000 is a medium located on several pages of the book or note. there is.

Based on the obtained medium identification information, the electronic device 3000 may display, through a display, a template stored in advance for the target medium 1000 or handwritten content already written by the user for the target medium 1000 . can

At this time, the pre-stored template for the target medium 1000 is meant to include text, images, shapes, symbols, etc. already printed on the target medium 1000 in addition to the code pattern, for example, When the target medium 1000 forms a part of a note, a plurality of lines may be printed on the target medium 1000 for easy writing by the user, and information such as that the plurality of lines are printed It may be included in the previously stored template information for the target medium 1000 . As another example, when the target medium 1000 forms a part of a notebook-like form, a specific date such as February 1, 2015 may be printed on the target medium 1000. As such, the target medium The fact that special information is printed at 1000 may also be included in the predetermined template information. Hereinafter, for convenience, an image displayed for the target medium 1000 including the above-described template information and the like may be referred to as a medium image.

Next, the electronic device 3000 may generate stroke data corresponding to the trajectory the user is taking notes to be displayed through the display, based on location information and time information included in the received pen data. In order to generate the stroke data, at least one unit pen data may be used.

When the stroke data is generated, the electronic device 3000 can reproduce the trajectory written by the user with respect to the target medium 1000 at a corresponding position on the predetermined template displayed on the display as it is, according to the generated stroke data. . FIG. 10 illustrates that the contents written by the user on the target medium 1000b are reproduced on the display of the electronic device 3000 in real time.

When the user's handwritten content is reproduced through the electronic device 3000, the trajectory of the user's handwritten content, the location of the user's handwritten content with respect to the target medium 1000, etc. are location information included in the pen data information. based on it, it can be accurately reproduced.

Hereinafter, for convenience of description, it may be said that the electronic device 3000 operates in a 'normal reproduction mode' according to an embodiment of reproducing the user's handwriting according to the present invention in real time.

2. Real-time reproduction of user-written content #2

Next, another embodiment in which the user's writing on the target medium 1000 is reproduced in real time will be described.

11 to 15 are diagrams for explaining another embodiment of reproducing the user's handwriting in real time according to the present invention.

While the user is using the electronic device 3000 according to an embodiment of the present invention, the user uses the electronic device 3000 so that the entire surface of the medium 1000 on which the user is currently taking notes. However, in some cases, only a part of the surface of the target medium 1000 may be desired to be displayed through the electronic device 3000 .

Hereinafter, at least a partial area displayed through the electronic device 3000 among the medium images corresponding to the target medium 1000 is referred to as a display area. Also, 'a partial area (or display area) of the target medium is displayed' may mean that an area corresponding to the partial area of the target medium among the entire area of the medium image is displayed on the display as the display area.

11 , it is exemplarily shown that only a partial area of the target medium 1000 is displayed through the electronic device 3000 .

At this time, if the user takes notes in another area out of the partial area being displayed through the electronic device 3000 , as described above through the electronic device 3000 , the contents of the user's notes are displayed in real time. What is reproduced may not be displayed through the display. For example, as shown in FIG. 12 , when the user further writes 'EFG' to the right of 'ABCD', as shown in FIG. When displayed, the contents corresponding to 'E' that the user is additionally writing cannot be viewed through the electronic device 3000 .

Another embodiment of reproducing the user's handwriting in real time according to the present invention is proposed to solve the problem.

The electronic device 3000 may check a location (hereinafter, referred to as a writing location) of the content currently being written by the user on the target medium 1000 based on the received pen data.

Next, the electronic device 3000 may determine whether the confirmed writing position satisfies a predetermined condition for the current display area.

For example, the electronic device 3000 may determine whether the writing position corresponds to a position outside the display area. In this case, when determining that the writing position is outside the display area, the electronic device 3000 may determine that the predetermined condition is satisfied.

For another example, the electronic device 3000 may determine whether the identified writing position corresponds to an edge region of the current display area. That is, the electronic device 3000 may determine whether the writing position corresponds to an edge area of the display area even though the writing position is currently included in the display area. In this case, when determining that the writing position corresponds to the edge area of the display area, the electronic device 3000 may determine that the predetermined condition is satisfied.

If the electronic device 3000 determines that the writing position does not satisfy a predetermined condition (eg, when it is determined that the writing position is included in the display area), the electronic device 3000 is shown in FIG. 12 . As described above, without shifting the display area, 'E', which is the content corresponding to the content written by the user, can be reproduced through the electronic device 3000 and displayed on the display.

On the other hand, when the electronic device 3000 determines that the writing position satisfies a predetermined condition (eg, when it is determined that the writing position is out of the display area), the electronic device 3000 corresponds to the writing position. The position of the display area may be shifted so that the displayed position may be displayed on the display of the electronic device 3000 .

For example, in the state where 'ABCDE' is described as shown in FIG. 12, if the user additionally writes 'F', the electronic device 3000 shifts the display area as shown in FIG. 13, Content corresponding to the user's handwriting may be reproduced in the shifted display area.

Various methods may be applied to a method in which the electronic device 3000 shifts the position of the display area.

For example, the electronic device 3000 may determine a direction to shift the position of the display area in consideration of the writing direction of the contents written by the user.

13 shows that the position of the display area is shifted in the same direction as the writing direction of 'ABCDE', which is the contents that the user was taking notes.

As another example, the electronic device 3000 may shift the position of the display area so that the contents of the handwriting written out of the original display area are displayed on the central portion of the shifted display area.

14 shows that the display area is shifted so that the 'F' written out of the original position of the display area can be located in the center of the shifted display area.

As another example, the electronic device 3000 may shift the position of the display area in consideration of the distance and direction between the content written immediately before and the content written out of the original display area.

As another example, when shifting the position of the display area, the electronic device 3000 may consider the edge of the media image. For example, the position of the display area may be shifted so that the edge of the media image does not deviate from a predetermined area of the display screen. That is, the position of the display area may be shifted so that the edge of the media image does not deviate from the edge area of the display screen. In other words, the position of the display area may be shifted so that the edge of the preview image is not displayed at a distance greater than a predetermined distance from the edge area of the display screen.

Meanwhile, the electronic device 3000 considers pen data received from the electronic pen 2000 in order to determine whether the writing position satisfies a predetermined condition. Various methods may be applied to a method of sampling pen data for

For example, the electronic device 3000 determines whether the writing position satisfies a predetermined condition for the partial region (eg, whether the writing position is outside the display region) for all unit pen data. can do. In this case, the electronic device 3000 will be able to reproduce the user's handwriting through the electronic device 3000 as it is closest to real-time reproduction, but there may be a problem in that the amount of calculation is increased.

For another example, the electronic device 3000 may determine whether a writing position satisfies a predetermined condition for the display area with respect to at least some of the pen data that may be grouped in stroke units.

Stroke refers to a line drawn by a pen on a writing surface after the pen contacts the writing surface until the pen is removed from the writing surface, and may also be referred to as a 'stroke'. That is, 'A' is generally composed of three strokes, 'B' is generally composed of two strokes, 'C' is generally composed of one stroke, and 'D' is generally composed of two strokes. As such, the 'E' is generally composed of three strokes. Hereinafter, for convenience of explanation, an operation in which the user brings the electronic pen 2000 into contact with the target medium 1000 in order to write one stroke is referred to as 'pen down', and Afterwards, an operation in which the user removes the electronic pen 2000 from the target medium 1000 will be referred to as 'pen up'.

At this time, the electronic pen 2000 includes pen data sensed through the pressure sensor in the pen data and generates the pen data, and the generated pen data is transmitted to the electronic device 3000 . Whether 'pen down' or 'pen up' may be determined by using the pen pressure value included in the data. That is, when the pen pressure value suddenly rises from '0' to a specific value while receiving pen data, the electronic device 3000 may determine that 'pen down' occurs when the pen pressure value suddenly rises. For convenience, this time point will be defined as a 'pen-down time point'. Also, when the pen pressure value suddenly becomes '0' while receiving pen data, the electronic device 3000 may determine that 'pen up' occurs when the pen pressure value suddenly becomes '0'. For convenience, this time point will be defined as a 'pen-up time point'.

The electronic device 3000 may determine whether the writing position satisfies a predetermined condition for the display area using position information included in the pen data corresponding to the pen-down time, among pen data grouped in stroke units. There is (hereinafter, pen-down-based shift method). In this case, the electronic device 3000 uses only the writing position at the time of pen-down, and the position information included in the remaining pen data among the plurality of pen data groups grouped in stroke units indicates that the writing position is in advance of the display area. It may not be used in determining whether a predetermined condition is satisfied.

Meanwhile, the electronic device 3000 determines whether the writing position satisfies a predetermined condition for the display area using position information included in the pen data corresponding to the pen-up time, among the pen data grouped in stroke units. can be determined (hereinafter referred to as a pen-up-based shift method). In this case, the electronic device 3000 uses only the writing position at the time of pen-up, and the position information included in the remaining pen data from among the plurality of pen data groups grouped in stroke units is determined as to the position of the writing position in advance of the display area. It may not be used in determining whether a predetermined condition is satisfied.

Alternatively, the electronic device 3000 uses all of the position information included in the pen data corresponding to the pen-up time and the pen-down time, among the pen data grouped in stroke units, so that the writing position is determined in advance for the display area. It may be determined whether a condition is satisfied (hereinafter, a hybrid shift method). In this case, the electronic device 3000 may use only the writing position at the pen-down time and the pen-up time, and may not use the rest of the pen data.

If, in the case of the pen-down-based shift method, only the shift of the display area occurs at the time of pen-down, the start point of the stroke input by the user is included in the original display area, but the end point of the stroke is the original display area. If it is out of the display area of , the shift according to the present invention may not occur. That is, as shown in FIG. 15 , even after the user completes all the strokes S, the start point SP of the stroke S was included in the original display area, so the end point ( Even when the EP) is out of the original display area, a screen as shown in FIG. 15B may be shown through the display of the electronic device 3000 even at the pen-up time Tup.

If, according to the pen-up-based shift method, only the shift of the display area occurs at the time of pen-up, when the user inputs one stroke for a long time (for example, one stroke for about 5 seconds) is input), the electronic device 3000 may not perform the shift operation until the user's stroke input is finished.

If the hybrid shift method is used, the advantages of both the pen-down-based shift method and the pen-down-based shift method may be taken.

Meanwhile, in a method of determining a writing position using some of a plurality of pen data that can be grouped in stroke units and performing a shift operation accordingly, as described above, the pen data at the time of pen down and the pen data at the time of pen up There may be various methods other than the method of cooking and using the pen data at the point of view, the pen data at the time of pen down and the pen up, and for example, determination of the writing position using pen data selected according to a predetermined time interval. There may be ways to do it. That is, the pen data at the time of pen-down, pen data at the time of 0.05 seconds after the time of pen-down, pen data at the time of 0.10 second at the time of pen-down, and pen data at the time of 0.15 second at the time of pen-down, etc. There may be a method of making a judgment about , and the like (when the predetermined time interval is 0.05 seconds).

The electronic device 3000 may determine whether to perform at least one shift operation with respect to one stroke. That is, for each stroke, the electronic device 3000 may determine whether the predetermined condition is satisfied by using at least one pen data among a plurality of pen data included in the stroke. In other words, the electronic device 3000 includes pen data (first pen data) corresponding to a pen down time point constituting one stroke, pen data (second pen data) corresponding to a pen up time point, and first pen data Whether the predetermined condition is satisfied may be determined using at least one pen data among all the pen data between and the second pen data.

As described above, according to another embodiment in which the user's handwriting on the target medium 1000 is reproduced in real time, the screen of the electronic device 3000 is enlarged so that only the display area of the target medium 1000 is displayed. Even when being displayed through the display, the effect of being able to reproduce the contents that the user is writing in real time and display it through the display of the electronic device 3000 occurs.

Hereinafter, for convenience of explanation, it may be said that the operation of the electronic device 3000 according to another embodiment of the present invention that reproduces the user's handwritten contents in real time according to the present invention operates in the 'magnified reproduction mode'.

3. Real-time reproduction of user-written content #3

Hereinafter, for convenience of explanation, a mode in which only a partial area of the target medium 1000 is displayed through the electronic device 3000 may be referred to as an 'enlargement mode', and the entire area of the target medium 1000 . All of these modes displayed through the electronic device 3000 may be referred to as 'normal mode'.

The electronic device 3000 may operate in the 'general reproduction mode' or the 'enlarged reproduction mode' in order to reproduce the user's handwriting in real time according to the present invention.

For example, the electronic device 3000 determines whether the display mode of the current electronic device 3000 is the 'normal mode' or the 'magnification mode', and reproduces the user's handwriting in real time according to the determination result It can be operated by selecting the mode for That is, when the display mode of the electronic device 3000 is the 'normal mode', the electronic device 3000 reproduces the user's handwriting in real time according to the aforementioned 'normal reproduction mode', and the electronic device 3000 . When the display mode of is 'enlarged mode', the user's handwriting may be reproduced in real time according to the above-described 'enlarged reproduction mode'.

In this way, when the reproduction mode is selectively set and operated, the 'magnified reproduction mode', in which the amount of computation is relatively higher, is applied only when the screen is enlarged and displayed. As a result, it is possible to operate in the 'normal reproduction mode', which requires less computation, so that the user's handwritten contents can be reproduced in real time more effectively and efficiently.

4. Replay of Written Content #1

Based on the pen data received from the electronic pen 2000 , the electronic device 3000 may later replay the content that the user is taking notes on the medium 1000 to display on the display of the electronic device 3000 . Hereinafter, a method of replaying and displaying items that the user is taking notes on the display in real time will be described.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 receive and store pen data related to notes written on the target medium 1000 by the user using the electronic pen 2000 . do.

The electronic device 3000 may detect whether a predetermined event for replaying the user's handwriting has occurred.

For example, the predetermined event may be a user's request. That is, the electronic device 3000 may provide a user interface (UI) through which the user can request a replay of the handwritten content through the electronic device 3000 , and the user may take notes through the user interface. A replay of the content may be requested, and accordingly, the electronic device 3000 may determine that a predetermined event has occurred, and may perform a replay operation of the handwritten content according to the present invention.

As another example, the predetermined event may be a request of an operating system (OS) of the electronic device 3000 or another application installed in the electronic device 3000 .

As another example, the predetermined event may correspond to a predetermined condition. That is, when a predetermined condition of 'arrival at a specific time' is set, the electronic device 3000 monitors the current time, determines whether the 'specific time' of the predetermined condition has been reached, and arrives at the time In this case, it is determined that a predetermined event has occurred, and a replay operation for the user's handwriting according to the present invention may be performed. The predetermined condition is not limited to the condition for 'time' as in the above example, and may be set in various forms.

When the predetermined event occurs, the electronic device 3000 may determine a target content for performing a replay operation on the handwritten content.

For example, in the electronic device 3000 , pen data for the contents written by the user on the medium 1000 using the electronic pen 2000 may be all stored, and among these writing contents, a replay operation may be performed. It is possible to determine the target handwriting content to be performed. That is, if the target medium 1000 is provided in the same form as a note, the electronic device 3000 records all of the notes written by the user on a plurality of pages of the note in the form of pen data (or stroke data form). may be stored, and in this case, the electronic device 3000 may determine which page (one page or a plurality of pages) among a plurality of pages to perform a replay operation, or any specific page of the page even within the same page. It is possible to determine whether to perform a replay operation on the content written in the area.

The electronic device 3000 may consider the predetermined event in determining the replay target content.

For example, when the predetermined event is a user's request, the replay target content may be determined according to the user's request. As another example, when the predetermined event is a request from an operating system or another application, the replay target content may be determined in consideration of the request.

When the replay target content is determined, a replay target section may be determined. For example, when the electronic device 3000 determines a specific page of the note as the replay target section as the replay target section, a plurality of strokes described in the determined specific page are determined as the replay target, and the replay target section includes the plurality of replay target sections. It is defined by the temporal relationship between the replay target strokes and the replay target strokes. Hereinafter, the replay target section will be described in more detail.

16 is a diagram for explaining a replay target section according to the present invention. Referring to FIG. 16 , a replay section RS according to the present invention includes a stroke section SS and a gap section GS. In particular, FIG. 16 shows that the replay target section RS includes the first to fourth stroke sections SS1, SS2, SS3, SS4 and the first to third sections GS1, GS2, and GS3. has been

In the present invention, for convenience of explanation, the replay target section is defined as the time taken for the user to take notes on the replay target.

That is, the replay target section is defined as the replay target section as a time section from when the user starts writing the first stroke of the target handwritten content requesting replay to the time when the user finishes writing the last stroke of the target handwritten content do. For example, when the replay target section is determined as shown in FIG. 16 , the length of the replay target section RS becomes (t8-t1).

The stroke section is defined as a time taken when a user writes notes or inputs one stroke. That is, as described above, the time from the point of pen-down to the target medium 1000 to the point of pen-up from the target medium 1000 in order to input one stroke is defined as a stroke section. For example, as shown in FIG. 16 , the length of the first stroke section SS1 is (t2-t1), the length of the second stroke section SS2 is (t4-t3), and the third stroke section ( The length of SS3 is (t6-t5), and the length of the fourth stroke section SS4 is (t8-t7).

The interval GS is defined as the time from input of one stroke to input of another stroke immediately following the input stroke when the user takes notes. That is, the time from the pen-up time of the input stroke to the pen-down time of the next input stroke is defined as the interval GS. For example, as shown in FIG. 16 , the length of the first interval GS1 is (t3, t2), the length of the second interval GS2 is (t5-64), and the third interval ( The length of GS3) is (t7-t6).

When defining the interval GS, it was explained that it is defined by the relationship between the two strokes. Strokes that are determined in writing and are not included in the content for replay will not be considered. For example, one stroke (stroke A) is recorded in a first area (eg, page x of note A) and in effect the next stroke (stroke B) is written in a second area (eg, y of note A) page), if the next stroke (stroke C) is written again in the first area, if only page x is selected and page y is not selected, stroke B is included in the target content to be replayed Since it is not, it is not taken into account in defining the above-described interval GS. That is, in this case, the stroke section defined by the stroke B does not exist in the replay target section, and the section between the strokes A and B and the section between the strokes B and C are not defined. Only the interval between stroke A and stroke C can be defined.

Subsequently, the electronic device 3000 may obtain pen data for strokes included in the replay target content from the memory module 3400 , and may generate replay data based on the obtained pen data. The replay data is data generated to perform a replay operation of replaying handwritten content according to the present invention, and may be data generated by sampling pen data for strokes. In addition, the replay data may be interpreted as a very comprehensive meaning that includes stroke positions for displaying on a display, a display order between strokes, timing information for displaying strokes, and the like, when performing a replay operation.

The electronic device 3000 then performs a replay operation according to the present invention based on the replay data.

Hereinafter, the replay operation will be described in more detail.

In the replay operation of the user's handwritten content according to an embodiment of the present invention, the replay time is different from the time required for the user to write the replay target content.

For example, a specific page may be selected as the replay target content, a part of the content included in the specific page selected as the replay target content may be written at 10:00 am, and another part of the content included in the specific page may be selected. can be written at 8 pm. In this case, the time required for the user to write the replay target content is 10 hours, but according to an embodiment of the present invention, when the handwritten content is replayed, the replay is played Time may be minutes. That is, the replay playback time of the replay target section may be shorter than the required writing time (the length of the replay target section) of the replay target section.

As another example, a specific word may be selected as the replay target content, and the time it takes for the user to actually write the specific word selected as the replay target content is 2 seconds, but the playback time of the replay for the word is It may be more than 2 seconds. That is, the replay playback time of the replay target section may be longer than the required writing time (the length of the replay target section) of the replay target section.

(1) Determination of replay playback time of stroke section

The electronic device 3000 may determine a replay replay time of strokes included in the replay target content.

<Relationship between stroke length and replay duration>

According to some embodiments of the present disclosure, the electronic device 3000 may determine a replay replay time for each of the replay target strokes in consideration of the time taken for the replay target strokes to be actually written.

17 is a diagram illustrating a replay reproduction time determined according to an embodiment of the present invention for the replay target section RS as shown in FIG. 16 .

Referring to FIG. 17 , the lengths of the first to fourth stroke replay playback times SR1 , SR2 , SR3 , and SR4 for each of the first to fourth stroke sections SS1 , SS2 , SS3 , and SS4 are respectively second. What is determined in proportion to the lengths of the first to fourth stroke sections SS1, SS2, SS3, and SS4 is illustrated. As such, the electronic device 3000 may determine the replay reproduction time for the replay target strokes in consideration of the time taken for the replay target strokes to be actually written.

However, although FIG. 17 shows an example in which the replay reproduction time is determined so that the replay reproduction time for each stroke is proportional to the length of each stroke section, it is not necessarily determined proportionally, and the replay reproduction time for each section is not necessarily determined. Time may be determined. For example, according to a method in which the time required for the actual writing of each stroke is divided by section and corresponding to each other, and different replay playback times are associated with different sections, the replay playback time for each stroke is may be decided. That is, with respect to the two strokes, even if the length of the actual stroke period is slightly different, when the two strokes are classified as the same period, the replay reproduction time for the two strokes may be determined to be the same. In addition, although FIG. 17 shows that only the length of the stroke section is considered in determining the replay reproduction time for each stroke, in determining the replay reproduction time, not only the length of the stroke section is considered, but the stroke The replay playback time may be determined by further considering the length of . A method of considering the length of the stroke when determining the replay reproduction time will be described later.

Alternatively, the electronic device 3000 may determine the same replay replay time for the replay target strokes.

For example, the electronic device 3000 may determine a replay reproduction time for each of the strokes to be replayed without considering the time required for the strokes to be replayed to be actually written.

In this case, the electronic device 3000 may determine the predetermined replay reproduction time as the replay reproduction time for each of the replay object strokes, regardless of the time required to actually write the replay object strokes. That is, the replay replay time determined for all strokes included in the replay target content may be the same.

18 and 19 are diagrams illustrating a replay playback time determined according to another embodiment of the present invention with respect to the replay target section RS as shown in FIG. 16 .

Referring to FIG. 18 , the lengths of the first to fourth stroke replay playback times SR1 , SR2 , SR3 and SR4 for each of the first to fourth stroke sections SS1 , SS2 , SS3 and SS4 are the same. What has been decided is shown. As such, the electronic device 3000 may determine the replay reproduction time for the replay target strokes without considering the time taken for the replay target strokes to be actually written.

However, in FIG. 18 , in determining the replay reproduction time for each stroke, it has been described that the replay reproduction time is equally determined without considering the length of the stroke section at all, but in this case, considering the length of the stroke, The replay reproduction time may be determined, and when the replay reproduction time is determined in consideration of the length of the stroke, the replay reproduction time for each stroke may be different from each other. A method of considering the length of the stroke when determining the replay reproduction time will be described later.

Meanwhile, although the same determined replay reproduction time is illustrated as a 'time duration' in FIG. 18 , the determined replay reproduction time may be determined as one 'time point'.

For example, as shown in FIG. 19 , when replaying the strokes of the first to fourth stroke sections SS1 , SS2 , SS3 , and SS4 , the electronic device 3000 displays the first The strokes corresponding to the stroke section SS1 are displayed at once, the strokes corresponding to the second stroke section SS2 are displayed at once at a second time point, and the strokes corresponding to the third stroke section SS3 are displayed at the third time point. They may be displayed all at once, and the strokes corresponding to the fourth stroke section SS4 may be displayed at once at the fourth time point. Here, the meaning of displaying the stroke at once may be understood to mean that all points constituting the stroke are all displayed on the display at the same time at the corresponding time point.

That is, Fig. 18 relates to an embodiment in which the points constituting each stroke are sequentially displayed on the display as the determined replay proceeds, and Fig. 19 shows that the dots constituting the strokes are displayed on the display at once It relates to an embodiment.

In the above, the relationship between the length of the stroke section and the replay reproduction time determined therefor has been described. Hereinafter, the relationship between the length of the stroke (the physical length of the stroke actually written by the user) and the replay reproduction time determined accordingly will be described.

<Relationship between stroke length and replay duration>

According to some other embodiments of the present disclosure, the electronic device 3000 may determine the replay replay time for each of the replay target strokes in consideration of the length of the replay target strokes.

20 to 24 are diagrams for explaining some embodiments of determining a replay playback time to replay a stroke written by a user according to other embodiments of the present invention.

Referring to FIG. 20 , it is shown that the first to fourth strokes S1 , S2 , S3 , and S4 are written on the target medium 1000 .

For convenience of explanation, the first stroke S1 is written by the user during the first stroke section SS1 shown in FIG. 16 , and the second stroke S2 is the second stroke section shown in FIG. 16 . It is written by the user during SS2, the third stroke S3 is written by the user during the third stroke section SS3 shown in FIG. 16, and the fourth stroke S4 is shown in FIG. It is assumed that it is written by the user during the fourth stroke section SS4.

In addition, for convenience of description, each length of the first to fourth strokes S1 , S2 , S3 , and S4 is referred to as SL1 , SL2 , SL3 , and SL4 , and similarly as shown in the drawings, SL4>SL1 Assume that the relationship >SL3>SL2 holds.

Here, the length of the stroke may be understood to mean the physical length of the stroke actually written by the user on the target medium 1000 . However, in this case, the length may be understood as an absolute length, but may also be understood as a relative length between strokes.

In this case, the electronic device 3000 may determine the replay reproduction time for each of the strokes in consideration of the lengths of the strokes included in the replay target content.

FIG. 21 shows replay playback times determined according to some embodiments of the present invention for strokes S1 , S2 , S3 , and S4 included in the content to be replayed as shown in FIG. 20 .

Referring to FIG. 21 , the lengths of the first to fourth stroke replay replay times SR1 , SR2 , SR3 and SR4 for each of the first to fourth strokes S1 , S2 , S3 , and S4 are respectively the first Determined in proportion to the lengths of the to fourth strokes S1, S2, S3, and S4 are illustrated. As such, the electronic device 3000 may determine the replay reproduction time for the replay target strokes in consideration of the time taken for the replay target strokes to be actually written.

However, although FIG. 21 shows an example in which the replay reproduction time is determined so that the replay reproduction time for each stroke is proportional to the length of each stroke, it is not necessarily determined proportionally, and the replay reproduction time for each section This may be decided. For example, the replay reproduction time for each stroke may be determined according to a method in which the written length of each stroke is divided into sections and corresponding to each other and different replay reproduction times are associated with different sections. That is, with respect to the two strokes, even though the actual stroke lengths are slightly different, when the two strokes are classified into the same section, the replay reproduction time for the two strokes may be determined to be the same. In addition, although FIG. 21 shows that only the written length of the stroke is considered in determining the replay playback time for each stroke, only the written length of the stroke is not considered in determining the replay playback time. , as described above, the replay playback time may be determined by further considering the length of the stroke section (the time required for the stroke to be actually written).

Alternatively, the electronic device 3000 may determine the same replay replay time with respect to the replay target strokes, regardless of the written length of the strokes. That is, the electronic device 3000 may determine the replay reproduction time for each stroke without considering the written length of the replay target strokes.

22 and 23 are diagrams illustrating a replay reproduction time determined according to some embodiments of the present disclosure for the replay target strokes as illustrated in FIG. 20 .

Referring to FIG. 22 , the first to fourth stroke replay playback times SR1 , SR2 , SR3 , and SR4 for each of the first to fourth strokes S1 , S2 , S3 , and S4 have the same length. Determination is shown. In this way, the electronic device 3000 may determine the replay reproduction time for the replay target strokes without considering the written length of the replay target strokes at all.

Meanwhile, although the same determined replay reproduction time is illustrated as a 'time duration' in FIG. 22, the determined replay reproduction time may be determined as one 'time point'.

For example, as shown in FIG. 23 , when replaying the strokes of the first to fourth strokes S1 , S2 , S3 , and S4 , the electronic device 3000 performs the first stroke at the first time point. The replay for (S1) is displayed at once, the replay for the second stroke (S2) is displayed at a time at a second time point, the replay for the third stroke (S3) is displayed at a time at the third time point, and a fourth time point is displayed. The replay for the fourth stroke S4 may be displayed at once.

(2) Determination of replay playback time in the interval

The electronic device 3000 may determine a replay reproduction time of an interval between strokes included in the replay target content.

According to some embodiments of the present disclosure, when the user actually writes the replay target strokes, the electronic device 3000 determines the replay playback time for each interval in consideration of the actual time interval between the stroke and the stroke. can According to some embodiments of the present invention, the method for determining the replay reproduction time for the inter-sections is substantially the same as the method for determining the replay reproduction time for the stroke section with or without considering the length of the stroke section described above. Since they are similar, only a brief description is provided.

This will be described again with reference to FIGS. 16 to 19 .

Referring to FIG. 17 , the lengths of the first to third replay playback times GR1 , GR2 , and GR3 for each of the first to third sections GS1 , GS2 and GS3 are respectively the first to second It is shown that it is determined in proportion to the lengths of the sections GS1 , GS2 , and GS3 between 3 . In this way, when the electronic device 3000 reproduces the content to be replayed, the replay reproduction time for the interval between the strokes may be determined in consideration of the time difference between the strokes and the strokes that occur while actually taking notes.

However, the replay reproduction time determined for the inter-section does not necessarily have to be proportionally determined with respect to the length of the inter-section, and may be determined separately for each section.

Alternatively, as shown in FIG. 18 , the electronic device 3000 may determine the same replay replay time for sections between replay targets. For example, the electronic device 3000 may determine a replay reproduction time for each of the strokes to be replayed without considering the time required for the strokes to be replayed to be actually written.

(3) Determination of replay replay speed and replay replay time based thereon

On the other hand, according to some embodiments of the present invention, a replay replay speed for the user's handwriting may be determined, and the electronic device 3000 according to the determined replay replay speed, the user's handwriting according to some embodiments of the present invention. can perform a replay operation for .

The electronic device 3000 may determine the replay reproduction speed in consideration of the number of strokes included in the selected replay target section.

For example, the electronic device 3000 stores at least the first predetermined condition and the second predetermined condition in advance, checks the number of strokes included in the selected replay target section, and determines the number of the checked strokes in the first advance. When the predetermined condition or less, the first replay reproduction speed corresponding to the first predetermined condition may be determined as the replay reproduction speed for the selected replay target section, or the number of the checked strokes exceeds the first predetermined condition second When the predetermined condition or less, the second replay reproduction speed corresponding to the second predetermined condition may be determined as the replay reproduction speed for the selected replay target section. The electronic device 3000 may store more predetermined conditions than the first predetermined condition and the second predetermined condition, and a predetermined replay reproduction speed may correspond to each of the predetermined conditions.

When the first predetermined condition is smaller than the second predetermined condition, a first replay reproduction speed corresponding to the first predetermined condition may be slower than a second replay reproduction speed corresponding to the second predetermined condition. can For example, when the first predetermined condition is 100 and the second predetermined condition is 200, the first predetermined replay reproduction speed may be slower than the second predetermined replay reproduction speed.

The electronic device 3000 may determine a replay reproduction time for a stroke section and a replay reproduction time for an interval between strokes in consideration of the determined replay reproduction speed.

When the first replay playback speed is faster than the second replay playback speed, the stroke section replay playback time determined when the determined replay playback speed is the first replay playback speed is determined when the determined replay playback speed is the second replay playback speed The stroke section may be shorter than the replay playback time.

Similarly, when the first replay playback speed is faster than the second replay playback speed, the interval replay playback time determined when the determined replay playback speed is the first replay playback speed is, the determined replay playback speed is the second replay playback speed It may be shorter than the interval replay playback time determined when .

The process of determining the stroke section replay playback time based on the playback speed and the process of determining the inter-section replay playback time based on the playback speed operate independently of each other. It may be determined to be shorter and the inter-section replay reproduction time may be determined to be shorter, but only one of the stroke-section replay reproduction time and the inter-section replay reproduction time may be determined to be shorter.

(4) Determination of the total playing time of the replay and the action of the replay

Next, the electronic device 3000 may, for each of the strokes included in the selected replay target content and the inter-sections between the strokes, the above-described length of the stroke section, the length of the inter-section, and the written length of the stroke. and a playback time may be determined based on at least one of a playback speed to determine a total playback time for the selected replay target content.

Then, according to the determined replay replay time, the electronic device 3000 performs a replay operation on the selected replay target content.

FIG. 24 is a diagram for explaining a screen in which the contents written by the user are replayed through the display according to an embodiment of the present invention.

The electronic device 3000 may sequentially replay the strokes of the user's handwritten content as shown in FIG. 20 , based on the replay replay time determined for the stroke section and the sections between the strokes determined as described above.

If, as described with reference to FIG. 21 or FIG. 22 , when the replay reproduction time for the stroke section and the replay reproduction time for the interval section are determined as the 'time section', the electronic device 3000, the determined first stroke Points constituting the first stroke S1 may be sequentially displayed during the reproduction time SR1 , and as a result, a screen as shown in FIG. 24 ( a ) may be displayed through the display of the electronic device 3000 . Subsequently, the electronic device 3000 maintains the screen as shown in (a) of FIG. 24 for the determined first interval replay time GR1, and then performs a second stroke S2 during the determined second stroke replay time SR2. The points constituting the ? may be sequentially displayed, and as a result, a screen as shown in FIG. 24 (b) may be displayed through the display of the electronic device 3000 . In a similar manner, replay operations for the third and fourth strokes may be performed.

On the other hand, as described with reference to FIG. 23 , when the replay reproduction time for the stroke section is determined as the 'time point', the electronic device 3000 displays the screen as shown in FIG. 24 (a) at the first time point. After displaying on the display, the screen as shown in (a) of FIG. 24 is maintained for the determined first interval replay playback time GR1, and at the second time point, as shown in (b) of FIG. After displaying the same screen through the display, the screen as shown in (b) of FIG. 24 may be maintained for the determined second interval replay reproduction time GR2. In a similar manner, replay operations for the third and fourth strokes may be performed.

In the above, the replay operation for the user's handwriting according to some embodiments of the present invention has been described. In the above-described embodiments, in determining the replay reproduction time for the stroke section, when the stroke replay reproduction time is determined in proportion to the length of the stroke section, the replay reproduction time for the interval is also proportional to the length of the interval It is shown in FIG. 17 to determine the replay replay time between sections, and when the stroke replay replay time is determined to be the same regardless of the length of the stroke section, the replay replay time for the inter section is also irrespective of the length of the section Although it is shown in FIG. 18 as being determined identically, the operation of determining the replay reproduction time for the stroke section and the operation of determining the replay reproduction time for the interval section are independent of each other, and must be shown in FIGS. 17 and 18, etc. It is not limited to the bar, and even when the replay reproduction time for the stroke section is determined dependently on the length of the stroke section, an embodiment in which the replay playback time for the interval section is determined regardless of the length of the interval section is also possible, and the The opposite is also true.

5. Replay of Written Content #2

Hereinafter, based on the pen data received from the electronic pen 2000 , the electronic device 3000 may replay the content that the user is taking notes on the medium 1000 later and display it on the display of the electronic device 3000 . can Hereinafter, another method of replaying and displaying the notes that the user is taking notes on the display in real time will be described.

Hereinafter, for the following description, the electronic pen 2000 and the electronic device 3000 receive and store pen data related to notes written on the target medium 1000 by the user using the electronic pen 2000, and assume that there is

The electronic device 3000 may detect whether a predetermined event for replaying the user's handwriting has occurred. Since the predetermined event has already been described above, a detailed description thereof will be omitted here.

Then, the electronic device may determine the replay target content to be replayed from among the notes written by the user. Since the determination of the replay target content and the replay target content has already been described above, a detailed description thereof will be omitted herein.

The electronic device 3000 may determine the replay time of the replay operation after the content to be replayed is determined. In this case, the electronic device 3000 may check the number of strokes included in the replay target content, and determine the replay time of the replay operation based on the checked number of strokes.

The electronic device 3000 may pre-store the number of strokes to be replayed per unit time in order to determine the replay time of the replay operation based on the checked number of strokes. For example, the electronic device 3000 may pre-store the number of strokes to be replayed to four for one second. As another example, the electronic device 3000 may pre-store the number of strokes to be replayed to two for one second. As another example, the electronic device 3000 may pre-store the number of strokes to be replayed for one second to eight.

The electronic device 3000 may determine the reproduction time of the replay operation based on the checked number of strokes and the number of strokes to be replayed per unit time. For example, if a content determined as a replay target includes a total of 100 strokes and the number of strokes to be replayed for 1 second is 4, the playback time of the replay operation is 100 (pieces)/4 (pieces/ seconds) = 25 (seconds).

That is, the reproduction time of the replay operation determined by the electronic device 3000 may be determined in proportion to the number of strokes included in the replay target content. For example, if the number of strokes is 100 and the predetermined number of playback strokes per second is 4, the playback time may be determined as 25 seconds, but when the number of strokes is confirmed to be 200, the playback time may be determined as 50 seconds. there is.

In other words, according to some embodiments of the present invention, the number of strokes included in the user's handwriting, which is the target of the replay operation, may be defined as N, and the number of predetermined strokes reproduced for a predetermined unit time. may be defined as M. In this case, the reproduction time of the replay operation determined by the electronic device 3000 may be determined as N/M* (predetermined unit time).

On the other hand, in the above example, only the case where the number of strokes included in the replay target content is N times the number of replay strokes per predetermined unit time has been described as an example. Embodiments of determining the reproduction time of a replay for a case where the number is not a multiple will be described.

According to some embodiments, the electronic device 3000 may determine the replay time of the replay in the same manner as described above. That is, if the number of strokes included in the replay target content is 102 and the number of replay strokes per predetermined unit time is 4, the replay is reproduced as 102 (pieces)/4 (pieces/sec) = 25.5 (seconds). Time can be determined.

According to some other exemplary embodiments, in the electronic device 3000 , the number of strokes included in the user's handwriting, which is the target of the replay operation, is defined as N, and the number of predetermined strokes reproduced for 1 second is defined as N. is defined as M, and when N is divided by M, when the quotient is Q and the remainder is defined as R, the playback time of the replay can be determined as (Q+1) (seconds). That is, if the number of strokes included in the replay target content is 102 and the number of replay strokes per predetermined unit time is 4, the quotient obtained by dividing 102 by 4 is 25, so that the replay time of the replay is (25+1) = It can be decided as 26 (seconds).

In summary, the number of strokes included in the user's handwriting, which is the target of the replay operation, is defined as N, the number of the predetermined strokes reproduced for 1 second is defined as M, and N is divided by M. When defining the quotient as Q and the remainder as R, if R is 0, the electronic device 3000 determines the reproduction time of the replay as Q, and if R is not 0 (ie, R is greater than M) If it is a small integer), the electronic device 3000 may determine the reproduction time of the replay as (Q+1).

However, in this case, the reproduction time of the replay may be determined proportionally to the number of strokes, but is not determined completely proportionally. That is, when the number of strokes is 100 and the number of strokes is 200, the replay time may be doubled, but when the number of strokes is 101, when the number of strokes is 102, When the number of strokes is 103, the reproduction time of the replay may be equally determined. 25 is a diagram for explaining a method of determining a replay time based on the number of strokes according to some embodiments of the present invention. Referring to FIG. 25 , when the number of replay strokes per unit time is 4 , when the reproduction time of a replay is determined according to some embodiments of the present invention, the relationship between the number of strokes and the replay reproduction time is schematically illustrated.

Meanwhile, the electronic device 3000 may store the number of replay strokes per unit time, rather than storing the number of replay strokes per unit time, and according to the predetermined event, an appropriate plurality of replay strokes per unit time. You can determine the number of replay strokes.

Also, the electronic device 3000 may determine the replay speed of the replay operation. There are various methods in which the electronic device 3000 determines the replay speed of the replay operation.

For example, the electronic device 3000 may determine the replay speed of the replay operation according to the predetermined event. The user may separately request a replay speed for a replay operation. Accordingly, the electronic device 3000 may determine the replay replay speed according to the replay speed requested by the user. Alternatively, the operating system of the electronic device 3000 or another application installed in the electronic device 3000 may separately request the replay speed for the replay operation. Accordingly, the electronic device 3000 may , the replay playback speed may be determined according to the playback speed requested by the operating system or the application.

As another example, the electronic device 3000 may determine the replay speed of the replay operation based on the number of strokes included in the replay target content.

26 is a view for explaining an embodiment of determining a replay speed of a replay according to the number of strokes included in a replay target content according to some embodiments of the present invention.

Referring to FIG. 26 , it is illustrated that a plurality of sections are divided according to the number of strokes, and a predetermined reproduction speed is associated with each section. The electronic device 3000 stores the table shown in FIG. 26 in the memory module 3400 in advance, checks the total number of strokes included in the replay target content, and according to the confirmed total number of strokes, in advance By referring to the stored table, it is possible to determine the replay playback speed. For example, when the section according to the number of strokes is determined in units of 500, when the number of replay target strokes is 1 or more and less than 500, the replay speed of the replay may be determined at 1x speed, and the replay target stroke is 500 When the number is greater than or equal to 1000, the speed of the replay may be determined at double speed, and the replay speed of the replay may be similarly determined for a section greater than or equal to 1000.

In this case, the determined replay playback speed may be determined as a basic playback speed for a corresponding replay operation, and the determined basic playback speed may be recommended to the user. That is, when the number of strokes included in the replay target content is 300, 1x speed may be displayed to the user as the recommended replay speed, and when the number of strokes included in the replay target content is 700, double speed is recommended It can be displayed to the user at the replay rate.

In this way, after the replay reproduction speed is determined, the electronic device 3000 may determine the number of replay strokes per unit time based on the determined replay reproduction speed.

27 is a view for explaining an embodiment of determining the number of replay strokes per unit time according to a replay reproduction speed according to some embodiments of the present invention.

Referring to FIG. 27 , it is illustrated that the number of replay strokes per unit time corresponds to each reproduction speed. The electronic device 3000 pre-stores the table as shown in FIG. 27 in the memory module 3400, and determines the number of replay strokes per unit time by referring to the pre-stored table according to the determined replay reproduction speed. can For example, when the replay speed is 1x, the number of replay strokes per unit time (the number of replay strokes per second) may correspond to 4, and when the replay speed is 2x, the number of replay strokes per unit time The number of strokes (the number of replay strokes per second) may correspond to eight.

As such, the electronic device 3000 may determine the number of replay strokes per unit time according to the determined replay reproduction speed.

As described above, after the replay target content is determined, the electronic device 3000 reproduces a replay operation based on a user request, an operating system request, an application request, or the number of strokes included in the replay target content. You can decide the time.

Next, the electronic device 3000 performs a replay operation according to the determined replay operation replay time and the like.

When performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed on the display at a time.

28 is a diagram for explaining a method of performing a replay operation on a user's handwriting, according to some embodiments of the present invention.

FIG. 28 shows the timing at which the replay target stroke is displayed on the display, especially when the number of replay strokes per second is 4, and referring to FIG. 28, it can be seen that one stroke is displayed on the display at 0.25 second intervals. Also, it can be seen that the first stroke is not displayed sequentially between 0 seconds and 0.25 seconds, but is displayed all at once at 0 seconds. In other words, according to some embodiments of the present invention, when the number of replay strokes per unit time is determined, when the replay operation is performed, the stroke and the display interval between the strokes may be determined to be the same. That is, as described above, when performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed on the display one at a time.

Alternatively, the entire stroke may be displayed for a time interval that is much shorter than the display interval between strokes (for example, 0.25 seconds in the example above) instead of at one specific point in time when the entire stroke is displayed on the display. will be.

However, in some embodiments, two or more strokes at a time may be replayed in a form displayed on the display at the same time.

Meanwhile, as described above, the electronic device 3000 may change the replay playback speed according to another predetermined event while performing the replay operation based on the determined replay playback speed and the determined number of replay strokes per unit time. .

For example, the user may request a change in the playback speed of the currently playing replay, and the operating system or another application may request the change of the currently playing replay playback speed.

In this case, the electronic device 3000 changes the replay replay speed according to the other predetermined event, changes the number of replay strokes per unit time based on the changed replay replay speed, and then changes the number of replay strokes per unit time Accordingly, the remaining replay operations may be performed.

As described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's handwriting and the timing of the replay reproduction are not temporally synchronized with each other, but the replay is faster The effect of being able to perform replay by reproducing the user's handwriting within time occurs.

6. Capture of handwriting

The electronic device 3000 may capture the handwritten content written by the electronic pen 2000 . Here, the electronic device 3000 provides a user interface for selecting a specific part to be captured among the entire handwriting content, and through this, a specific part of the entire handwriting content can be selectively captured. In addition, the electronic device 3000 may provide the user with a user interface for checking which part of the entire handwritten content is selected for capturing.

The electronic device 3000 may determine a portion to be captured (hereinafter, referred to as 'target writing content') among the entire handwritten content.

29 is a view of the entire handwritten content and the target handwritten content during a capture operation of the electronic device according to the present invention.

Here, the entire handwritten content may mean any handwritten content that can be continuously reproduced through replay. For example, when the electronic device 3000 reproduces the handwritten content by breaking it in page units of the medium 1000 , the entire handwritten content A may include all the handwritten content written on the corresponding page as shown in FIG. 29 . can Of course, when the handwritten content written on a single page is divided and reproduced as needed, only a part of the handwritten content in the corresponding page may correspond to the entire handwritten content described above, and the handwritten content written on a plurality of pages at once may be reproduced. When continuously reproduced, all of the handwritten contents written on the plurality of pages may correspond to the entire handwritten contents.

Also, here, the target handwritten content may include a part or the entirety of the entire handwritten content. The target handwritten content may include one or more portions of the entire handwritten content including a continuous series of handwritten notes. For example, as the target writing content, the first writing content T1 may be selected as shown in FIG. 29 . As another example, as shown in FIG. 29 , the first handwritten content T1 and the second handwritten content T2 may be selected as the target handwritten content.

The electronic device 3000 may set a target section among the reproduction sections of the entire handwritten content, and determine a portion of the entire handwritten content corresponding to the set target section as the target writing content.

In more detail, the electronic device 3000 may receive from the user at least one viewpoint among the reproduction sections of the entire handwritten content, and set the target section based thereon.

For example, the electronic device 3000 may receive a start time and an end time from the user, and accordingly set a section from the start time to the end time among the reproduction sections of the entire handwritten content as the target section.

As another example, the electronic device 3000 may receive either a start time or an end time from the user. In this case, the electronic device 3000 may set the target section from the start time to the end of the playback section or set the beginning to the end time of the playback section as the target section. That is, when only the start time is input, the end of the entire reproduction section becomes the end time, and when only the end time is input, the beginning of the entire reproduction section becomes the start time.

Alternatively, the electronic device 3000 may receive the start time and end time of the exclusion section from the user, set the exclusion section based thereon, and set the remaining section excluding the exclusion section from among the entire reproduction section as the target section.

For example, the electronic device 3000 may receive a start time and an end time from the user, and accordingly set the section from the start time to the end time among the entire playback section as an excluded section, and set the remaining sections as the target section. there is.

Meanwhile, the electronic device 3000 may set target sections spaced apart from each other. For example, the electronic device 3000 receives a first start time, a first end time, a second start time, and a second end time from the user, and sets the first target period from the first start time to the first end time. , and a second target section may be set from the second start time to the second end time.

In order to receive the at least one viewpoint described above, the electronic device 3000 may provide various types of user interfaces.

30 to 32 are examples of a user interface for receiving a target section according to the present invention.

According to an example, the electronic device 3000 may display the progressive bar together with the entire handwritten content, receive a user input for the progressive bar, and set the target section based thereon.

Here, the progressive bar may mean an indicator that is linked with the progress of the reproduction when the handwritten content is reproduced. As shown in FIG. 30 , the progressive bar P is generally provided in the form of a bar at the bottom of the screen, but the form is not necessarily limited to the form shown in FIG. 30 in the present invention.

Meanwhile, in the present invention, the total reproduction time expressed by the progressive bar may correspond to the time at which the handwritten content is reproduced according to the replay, which is based on the handwriting time included in the pen data, the number of handwritten strokes, and the interval between adjacent handwriting times. can be determined

For example, the total reproduction time according to the progressive bar may be determined to correspond to a time interval from a writing time of pen data for a first stroke of the corresponding handwritten content to a writing time of pen data of the last stroke. In this case, the time the user writes on the medium 1000 using the actual electronic pen 2000 and the longitudinal replay time according to the progressive bar will be set to be the same.

As another example, the total playback time according to the progressive bar is set to correspond to a time interval from the writing time of the pen data for the first stroke of the corresponding handwritten content to the writing time of the pen data of the last stroke, and thereafter, between adjacent strokes in the writing order. When the time interval is larger than the preset reference interval, the corresponding time interval may be decreased. That is, when the time interval between the writing time at which the specific stroke is performed and the writing time at which the next stroke of the specific stroke is performed is greater than the reference interval set to 20 seconds, it may be reduced to a time interval of 5 seconds. In this case, the total replay time according to the progressive bar may be shorter than the time the user actually took notes on the medium 1000 using the electronic pen 2000 .

As another example, the total reproduction time according to the progressive bar may be determined according to the total number of strokes (ie, the number of handwritten strokes) of the corresponding handwritten content. That is, the replay time of the progressive bar may be determined to be 100 seconds for the handwritten content composed of a total of 300 strokes by matching 3 strokes to 1 second on the replay. In this case, the total replay time according to the progressive bar may be different from the actual writing time.

The electronic device 3000 may receive a user input for setting a target section from a user through a user interface that displays such a progressive bar. For example, the user may select two points on the progressive bar as shown in FIG. 30 , and accordingly, the electronic device 3000 determines the front point as the start time and the rear point as the end time, Accordingly, the target section may be set. In this case, it may be displayed on the start indicator I-1 and the end indicator I-2 that respectively identify the start point and the end point on the progressive bar. In addition, the target section R may be displayed on the progressive bar P to be distinguished from the remaining sections. The user may select a desired point on the progressive bar as shown in FIG. 30 or by clicking a mouse. Alternatively, the user may drag from one point to another point on the progressive bar as shown in FIG. 31 , and in this case, the electronic device 3000 may set the dragged section as the target section R. That is, the front of the dragged section becomes the starting point (I-1) and the rearmost becomes the ending point (I-2). According to this input, as shown in FIGS. 30 and 31 , the target writing content corresponding to the target section R may be determined. In addition, as shown in FIG. 32 , the user sets two or more target sections R-1 and R-2 spaced apart from the progressive bar P to determine a plurality of target writing contents T-1 and T-2. possible.

33 to 35 are other examples of a user interface for receiving a target section according to the present invention.

According to another example, the electronic device 3000 may display the entire handwritten content and set a target section according to a user input for selecting a stroke from among the handwritten content. In more detail, when two strokes are selected, handwriting content by strokes between the first and later written strokes among them may be selected as the target handwriting content. In other words, the electronic device 3000 may set the target writing content by setting the playback time of the selected stroke as the start time or the end time of the target section.

Referring to FIG. 33 , the user selects two strokes S-1 and S-2 from among the entire handwritten content, and accordingly, the target handwriting content T may be determined by the two strokes and the strokes therebetween. there is.

Alternatively, the user may select them by dragging from the start stroke S-1 to the end stroke S-2 among the entire handwritten contents similarly to that shown in FIG. 34 , and even in this case, the electronic device 3000 may determine the target writing content T as in the case where the two strokes S-1 and S-2 are respectively selected.

Also, it is possible to set a plurality of target sections in order to select a plurality of target writing contents as shown in FIG. 35 using this method.

As described above, the user input for selecting a stroke among the handwriting contents can accurately select the displayed stroke in the present invention. However, even if a specific stroke is not accurately selected, the electronic device 3000 determines that the stroke closest to the point at which the user input is received is accurately selected. can be considered selected.

36 and 37 are another example of a user interface for receiving a target section according to the present invention.

According to another example, the electronic device 3000 may reproduce the entire handwritten content in the form of a moving picture through the display, and may receive a user input during the reproduction and obtain a time point at which the user input occurs as a start time or an end time. Specifically, referring to FIG. 36 , in a state in which the handwritten content is reproduced up to the “In the evening” part U-1, the user may input that time as the starting time. In addition, referring to FIG. 37 , the user may input the time point as the end time point in a state in which reproduction has progressed up to the “secure” part U-2. Accordingly, from the “In the evening” part (U-1) to the “secure” part (U-2) is set as the target section, and the target writing content T may be determined. As shown in FIGS. 36 and 37 , this may be accomplished by selecting the viewpoint setting button B of the control panel C provided as a user interface, or by clicking or touching a predetermined point. Of course, it is also possible here to select a plurality of target sections and target writing contents. The figure shows that one time setting button (B) is provided, and according to the selection order of the buttons, the first selected time may be the start time and the later selected time may be the end time. However, it is also possible that the time point setting button includes a start time setting button and an end time setting button, respectively, and each time point may be determined by selecting the corresponding button.

Meanwhile, when a user input for inputting a start time or an end time occurs during reproduction, the electronic device 3000 may temporarily stop reproduction or continuously perform reproduction.

As described above, the electronic device 3000 can set the target section through a user input and can determine the target writing content accordingly. The electronic device 3000 allows the user to easily select the target writing content, and It is possible to confirm what the target handwriting content selected by the user is.

38 is a view of a screen for outputting the entire handwritten content for receiving an input of a target section according to the present invention. Referring to FIG. 38 , the electronic device 3000 may display the entire handwritten content before receiving the user's input or before determining the target handwriting content. Accordingly, the user can determine which part is to be the target handwriting content to be turned on while checking the entire handwritten content.

39 and 40 are diagrams of a screen for identifying a target handwritten content according to the present invention. Referring to FIG. 39 , when the target writing content is determined, the electronic device 3000 may display the target writing content to be distinguished from other writing contents. In other words, the target handwritten content and the remaining handwritten content may be displayed with different display properties (eg, contrast, color, font type, font shape, font size, etc.). Also, referring to FIG. 40 , when the target writing content is determined, the electronic device 3000 may display only the target writing content on the screen without displaying the remaining writing content on the screen.

In addition, as shown in FIGS. 39 and 40 , the electronic device 3000 may display the target section to be distinguished from the rest of the section on a progressive bar or the like, and display the start and end times of the target section on the progressive bar. An indicator to be displayed can be displayed.

41 is a diagram illustrating a captured image according to the present invention.

The electronic device 3000 may capture the determined target writing content. Capturing the target handwritten content may be captured in the form of pen data as well as capturing in the form of an image. Capturing in the form of pen data may mean storing the target writing content as separate pen data so that the electronic device 3000 or another electronic device 3000 can use it to check the target writing content.

In the image-type capture, the electronic device 3000 may generate an image including the target handwriting content. Such an image may include only the target handwritten content or a medium image as a background of the target handwritten content. In some cases, the captured image may include the remaining handwritten contents in addition to the target handwritten contents, and in this case, the target handwritten contents may be displayed in a form distinguishable from the remaining handwritten contents. Meanwhile, the capture of the image may take the form of capturing an image that is generated or displayed on a screen in a manner of writing the target handwriting content on a medium image using pen data of the target handwriting content.

Meanwhile, the electronic device 3000 may separately store or transmit the target writing content to an external device instead of capturing the target writing content or together with the capture. For example, the electronic device 3000 may transmit an image in which the target handwriting content is captured to a designated e-mail.

Specifically, as described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's handwriting and the timing of the replay reproduction are not replayed because the timing of the user's handwriting is synchronized with each other in time, There is an effect that replay can be performed by reproducing the user's handwriting in a shorter time.

<Structure of Electronic Pen>

Hereinafter, the structure of the electronic pen 2000 according to an embodiment of the present invention will be described.

42 is a schematic perspective view illustrating an exploded view of the main body and the cap provided in the electronic pen according to an embodiment of the present invention, and FIG. 43 is the other side of the main body of the cap provided to the electronic pen according to an embodiment of the present invention. It is a schematic perspective view showing the state inserted into the .

42 and 43 , the electronic pen 2000 according to an embodiment of the present invention includes a core part 2010 that enables writing on a medium, a body part 2020 for fixing the position of the core part 2010, and It may include a cap part 2030 that protects the core part in a non-use state.

Here, the non-use state may mean a state in which the electronic pen 2000 according to an embodiment of the present invention is stored. can mean

The core 2010 is a component that enables writing on the medium, and may include a ball and ink, and the ink may be oil-based, water-based, or neutral.

In addition, the core 2010 may be a black lead used in a pencil or a lead used in a general writing instrument.

The body part 2020 is a component that is inserted so that a part of the core part 2010 is exposed to fix the position of the core part 2010, and may refer to a type of grip part that a user can grip by hand.

The cap part 2030 may have a predetermined internal space S1 to protect the core part 2010 by inserting one side of the body part 2020 in a non-use state. When it is inserted into the other side, a part of the core part 2010 may be exposed to the outside to enable writing.

However, when writing is possible by the core part 2010 , the cap part 2030 does not necessarily need to be inserted into the other side of the body part 2020 , and is separated from the body part 2020 and has a predetermined space. It is free even if it is placed in

On the other hand, the body portion 2020 and the cap portion 2030 may be formed in a circular or polygonal transverse cross-section, hereinafter, a case in which the transverse cross-section is formed in a polygonal shape will be described as an example.

44 is a schematic perspective view illustrating an internal configuration of a cap and a main body provided in an electronic pen according to an embodiment of the present invention, FIG. 45 is a schematic cross-sectional view taken along line AA of FIG. 44, and FIG. 46 is an embodiment of the present invention It is a schematic perspective view showing a modified example of the cap provided in the electronic pen according to the embodiment.

Also, FIG. 47 is a schematic front view illustrating a main body provided in the electronic pen according to an embodiment of the present invention.

44 to 47 , the electronic pen 2000 according to an embodiment of the present invention may include a body part 2020 for fixing a position of a cap part 2030 and a core part 2010. Hereinafter, the configuration The elements are described in detail.

The cap part 2030 includes a accommodating part 2032 having a predetermined internal space S1 to accommodate one side of the main body 2020 and a position fixing part 2034 protruding from the bottom surface of the inside of the accommodating part. can be provided

Here, the position fixing part 2034 is not necessarily formed to protrude from the inner bottom surface of the accommodating part 2032, for example, may be formed to protrude from the inner side surface of the accommodating part 2032. do.

The cap part 2030 connects the outer surface of the position fixing part 2034 and the bottom surface of the accommodating part 2032 to each other so that the position fixing part 2034 is stably disposed in the inner space S1. It may further include a rigidity reinforcing part 2036.

The rigidity reinforcing unit 2036 may reinforce the rigidity of the position fixing unit 2034 and may perform a kind of reinforcing rib function.

When the other side of the body part 2020 is inserted, the receiving part 2032 may accommodate the other side of the body part 2020. In this case, the position fixing part 2034 is the body part 2020. ) in contact with the other side of the body portion 2020 may be arranged in the inner space (S1) so that the limit of the insertion of the other side is defined.

In other words, when the other side of the body part 2020 is inserted toward the inner space S1, the other end of the body part 2020 is in contact with the position fixing part 2034 to prevent further insertion. In this way, it is possible to guide an appropriate insertion position into the inner space (S1) of the other side of the main body portion (2020).

Here, a light emitting part 2028 (refer to FIG. 43 ) for displaying the state of the electronic pen 2000 to the outside may be provided on the other side of the main body part 2020. Due to the position fixing part 2034, the main body The degree of insertion of the other side of the part 2020 into the internal space S1 is adjusted, and the light emitting part 2028 is formed through the accommodating part 2032 through the penetrating part 2038 (refer to FIGS. 2 and 3 ). ) can be exposed to the outside to provide convenience to the user.

The mounting space S2 may be a space provided by the locking part 2023 of the body part 2020, and the body part 2020 is the body part 2024 that the user can grip and the position in the non-use state. A locking part 2023 protruding from one side of the body part 2024 to provide a mounting space S2 may be provided so that the government 2034 is mounted and the cap part 2030 is fixed in position.

Specifically, the locking part 2023 is a first locking part 2021 protruding toward the center of the body part on one side of the body 2024 and spaced apart from the first locking part 2021 and the body part 2024. may include a second engaging portion 2022 protruding toward the center of the , and a predetermined mounting space S2 may be formed between the first and second engaging portions 2021 and 2022. .

The mounting space S2 may be a space in which the mounting part 2033 of the position fixing part 2034 is mounted, and the mounting part 2033 is the inner space S1 from the center of one surface of the receiving part 2032 . It may be a component formed by extending from the end of the protrusion 2031 protruding toward the.

Here, the accommodating portion 2032 and the body portion 2024 may be formed in a circular or polygonal transverse cross-section, for example, may be formed in a K-th square (K is a natural number greater than or equal to 3) in the transverse cross-section. and may be formed in a triangle as shown in the drawing.

The mounting portion 2033 includes the protrusion 2031 to be mounted in the mounting space S2 regardless of a change in the position of the mounting space S2 when the body 2024 is inserted into the receiving unit 2032 . It may be formed to extend radially from the end of the accommodating portion 2032 toward the vertex of the transverse cross-section.

Here, the vertex generally refers to an intersection where line segments constituting a polygon meet, but in the present invention, it is clarified that the concept includes a point having a minimum radius of curvature.

Since the mounting portion 2033 is formed to extend radially from the end of the protruding portion 2031 , the present invention provides the first locking portion 2021 regardless of how the body portion 2024 is inserted into the receiving portion 2032 . ) and the second locking part 2022, the mounting part 2033 is mounted in the mounting space S2 formed between the part, so that convenience can be increased.

Meanwhile, as shown in FIG. 46 , the mounting portion 2033a may be formed to extend in a circular radial form from the end of the protrusion 2031a.

The core portion 2010 may be eccentrically disposed from the center of the lateral cross-section of the body 2024 toward the vertex of the lateral cross-section of the body 2024, and the first engaging portion 2021 and the second engaging The portion 2022 may be formed between the center line of the transverse cross-section of the body portion 2024 and the core portion 2010 .

For this reason, the mounting space S2 in which the mounting part 2033 is mounted is also formed between the center line of the lateral cross section of the body part 2024 and the core part 2010, so that the user writes on the medium with the core part 2010. During the process, damage to the first locking part 2021 and the second locking part 2022 due to external factors is minimized to prevent deterioration of the function of the mounting space S2 in advance.

48 and 49 are schematic side views for explaining a process in which the cap is inserted into one side of the main body provided in the electronic pen according to an embodiment of the present invention.

First, referring to FIG. 48 , when the electronic pen 2000 according to an embodiment of the present invention is to be stored in an unused state, one side of the main body 2020 is inserted into the cap part 2030 .

In this case, the first locking part 2021 of the body part 2020 may be inserted into the receiving part 2032 of the cap part 2030 , and the first locking part 2021 is the first locking part 2021 . is inserted into the accommodating part 2032 , an insertion inclined surface 2026 inclined downward along the insertion direction may be provided to enter the mounting space S2 after the mounting part 2033 is in contact.

When the body part 2024 is inserted into the accommodating part 2032 , the insertion inclined surface 2026 comes into contact with the mounting part 2033 to primarily insert the body 2024 into the accommodating part 2032 . It can perform the function of a kind of primary barrier that limits the

Here, when the user continuously applies an external force to the body portion 2024 toward the inner space S1 of the receiving portion 2032, the mounting portion 2033 is inserted into the inclined surface 2026 as shown in FIG. is finally installed in the mounting space (S2).

When the mounting part 2033 is disposed in the mounting space S2 by the user's continuous external force, the body 2024 is inserted into the internal space S1 of the receiving part 2032 even when a continuous external force is applied. This may not be the case, and this may be implemented by the second locking part 2022 providing the function of the secondary blocking wall.

The second locking part 2022 is the mounting part ( 2033) may be in surface contact, and specifically, an over-insertion prevention surface 2025 perpendicular to the insertion direction may be provided.

As a result, even if there is a user's continuous external force, the mounting portion 2033 is in contact with the over-insertion prevention surface 2025 to prevent further insertion, so that it can be stably mounted in the mounting space S2.

Here, the end of the second locking part 2022 may be formed closer to the center of the body part 2024 than the end of the first locking part 2021, which means that the first locking part 2021 is This is because, while performing the function of the primary blocking wall, it is a component through which the mounting unit 2033 must pass, while the second stopping unit 2022 has to perform the function of a secondary blocking wall through which the mounting unit 2033 must not pass. am.

When the mounting portion 2033 is mounted in the mounting space (S2), the body portion 2024 between the first engaging portion 2021 and the second engaging portion 2022 defining the mounting space (S2). One surface 2028 of the may be in surface contact with the mounting portion 2033, specifically, may be formed in a plane parallel to the insertion direction of the body portion 2024 into the receiving portion (2032).

Due to the surface contact between the mounting part 2033 and the body part 2024 in the mounting space S2, the coupling force between the cap part 2030 and the body part 2020 may be increased, and a non-ideal external force may not be applied. However, separation of the cap part 2030 and the body part 2020 does not occur.

On the other hand, when the user wants to change the electronic pen 2000 from the non-use state to the use state for taking notes in the state in which the mounting unit 2033 is mounted in the mounting space S2, the user separates the cap part 2030 from the body part 2020 by applying an external force.

To this end, when the first locking part 2021 separates the body part 2024 inserted into the receiving part 2032 , the mounting part 2033 mounted in the mounting space S2 is installed in the mounting space. It may be provided with a separation inclined surface 2027 that is formed to be inclined downward along the separation direction so as to be separated from (S2).

The separation inclined surface 2027 may be formed symmetrically with the insertion inclined surface 2026 described above, but is not limited thereto, and the inclination angle may be slightly different.

Hereinafter, the structure of the electronic pen 2000 will be described in more detail.

50 and 51 are exploded schematic perspective views illustrating a main body provided in an electronic pen according to an embodiment of the present invention, and FIGS. 52 to 54 are a body portion provided in an electronic pen according to an embodiment of the present invention. It is a schematic perspective view for describing a substrate unit, a camera module, and a lighting module that are fixed in position.

First, the electronic pen 2000 according to the present invention may include the cap part 2030 as described with reference to FIGS. 42 to 49 , but the cap part 2030 must be used to implement the electronic pen 2000 . Note that this may not be a necessary component.

50 to 54 , the electronic pen 2000 according to an embodiment of the present invention includes a camera module 2320 and a lighting module 2340 for recognizing a user's handwriting by a core part 2010; The camera module 2320 and the lighting module 2340 are provided with a substrate portion 2110 and a hollow (S5) connected, the receiving substrate portion (C1) and the hollow (S5) accommodated in the hollow (S5) The substrate part 2110 is defined as the exposed substrate part C2 exposed to the outside, and the main body 2120 and the camera module 2320 are made of a first material to shield electromagnetic waves generated by wireless communication. and a battery unit 2160 for driving the lighting module 2340 and a wireless communication module 2440 mounted on the exposed substrate unit C2 to enable wireless communication with other electronic devices.

Since the camera module 2320, the lighting module 2340, and the wireless communication module 2440 have already been described in detail, a detailed description thereof will be omitted.

The main body 2120 may be a component providing the appearance of the electronic pen 2000 according to an embodiment of the present invention, and the main body 2020 together with the substrate fixing unit 2030 and the substrate protection unit 2140 . can be configured.

The substrate unit 2110 may be embodied as a single unit in the electronic pen 2000 according to the present invention, but may be embodied as a plurality, for example, as shown in the drawings, the first substrate 2112 and the second It may be implemented with the substrate 2114 and the third substrate 2116 .

Hereinafter, for convenience of description, a case in which the substrate unit 2110 includes three substrates will be described as an example.

Specifically, the substrate portion 2110 is a first substrate 2112 disposed close to the first end of the main body 2120 to which the core portion 2010 is exposed, and a second end opposite to the first end. It may include a second substrate 2114 disposed close to it, and may further include a third substrate 2116 disposed between the first substrate 2112 and the second substrate 2114 .

Here, the first substrate 2112 , the second substrate 2114 , and the third substrate 2116 may be electrically connected to each other by a flexible printed circuit board (FC), and the hollow of the main body 2120 . Depending on whether or not it is accommodated in ( S5 ), it may be defined as the accommodating substrate part C1 and the exposed substrate part C2 , and a specific substrate may include the accommodating substrate part C1 and the exposed substrate part C2 at the same time.

The receiving substrate portion C1 and the exposed substrate portion C2 virtually divide the substrate region into a portion accommodated in the hollow S5 of the main body 2120 and a portion exposed to the outside of the hollow S5. As a concept, the receiving substrate unit C1 and the exposed substrate unit C2 may simultaneously exist on one substrate.

For example, as shown in the drawings, the first substrate 2112 and the third substrate 2116 are accommodated in the hollow S5 of the main body 2120, so that the entirety of the receiving substrate part C1 is formed. can be formed

On the other hand, since only a portion of the second substrate 2114 is accommodated in the hollow S5, the accommodated portion may form the receiving substrate portion C1, and the remaining portion may form the exposed substrate portion C2.

That is, the second substrate 2114 may include at least a portion of the receiving substrate portion C1 and the exposed substrate portion C2 in the electronic pen 2000 according to the present invention.

Here, the main body 2020 is the main body 2120 and the main body 2120 so that the receiving substrate portion C1 is mounted together with the main body 2120 to fix the receiving substrate portion C1 at a predetermined position in the hollow S5. A connected substrate fixing unit 2030 may be provided, and the exposed substrate unit C2 may be mounted to the substrate fixing unit 2030 and fixed at a predetermined position.

The substrate fixing part 2030 may be a kind of structure for fixing the first substrate 2112 , the second substrate 2114 , and the third substrate 2116 , and the first substrate 2112 , the second substrate 2114 . ) and the third substrate 2116 may be mounted to the substrate fixing unit 2030 by an additional component 2150 .

The substrate fixing unit 2030 may be formed of a single component, but is not limited thereto, and a plurality of components may be connected to each other.

The exposed substrate portion C2, which is a part of the second substrate 2114, is exposed to the outside of a second end opposite to the first end of the main body 2120 to which the core portion 2010 is exposed to the outside of the wireless communication module This may be arranged to be close to the second end.

Here, the camera module 2320 and the lighting module 2340 may be mounted on the first substrate 2112 and electrically connected to the first substrate 2112 by a flexible printed circuit board (FC). free of charge

In addition, the battery unit 2160 providing driving force to the camera module 2320 and the lighting module 2340 may be disposed between the first substrate 2112 and the second substrate 2114 .

The battery unit 2160 may be mounted on a substrate mounting unit 2132 providing a mounting space S6.

The battery unit 2160 may be disposed between the first substrate 2112 and the second substrate 2114 so as to be biased toward the second end of the main body 2120 as a whole, but it is convenient for the user to write. The center of gravity of the electronic pen 2000 may be formed to be biased toward the first end of the main body 2120 in order to increase the weight.

On the other hand, the second substrate 2114 may be equipped with a wireless communication module 2440 that enables wireless communication with other electronic devices, specifically, the exposed substrate portion C2 of the second substrate 2114, the A wireless communication module 2440 may be mounted.

The wireless communication module 2440 may be exposed to the outside of the main body 2120 made of a first material, and may not receive any obstacles in wireless communication with other electronic devices despite the first material. there is.

Here, the first material constituting the main body 2120 may include aluminum (Al) for shielding electromagnetic waves generated during wireless communication by the wireless communication module 2440, but must be made of aluminum (Al). It does not have to be, and any material capable of shielding electromagnetic waves may be applicable.

As described above, the wireless communication module 2440 for implementing wireless communication with other electronic devices is disposed on the outside of the main body 2120 made of a first material capable of shielding electromagnetic waves. Since it is mounted on the exposed board part C2 exposed to the outside, and wireless communication can be implemented without being affected by the main body 2120 in any way, it is possible to maximize the recognition of the user's handwriting.

And, by the main body 2120 made of the first material, the electronic pen 2000 according to the present invention emits electromagnetic waves generated during wireless communication by the wireless communication module 2440 to the outside through the main body 2120 . It is possible to minimize the harmfulness of electromagnetic waves generated during wireless communication by preventing

In addition, since the main body 2120 made of the first material has a higher heat transfer coefficient than the substrate fixing part 2030 made of a synthetic resin such as plastic, heat generated by the operation of the lighting module 2340 and the like is effectively radiated to the outside. Thus, the durability of the electronic pen 2000 may be improved.

On the other hand, the main body portion 2020 provided in the electronic pen 2000 according to the present invention surrounds the exposed substrate portion C2 together with the main body 2120 and the substrate fixing portion 2030 to form the exposed substrate portion C2. ) may be provided with a substrate protection unit 2140 connected to the main body 2120 to protect.

The substrate protection part 2140 may be a kind of cap that is connected to the second end of the main body 2120 and covers the exposed substrate part C2, and the exposed substrate part C2 is a second substrate 2114. It may be a part of as described above.

The substrate protection unit 2140 may be made of a second material that allows electromagnetic waves generated by wireless communication by the wireless communication module 2440 mounted on the exposed substrate unit C2 to pass therethrough, so that the wireless communication The module 2440 may not receive any obstacle in wireless communication with other electronic devices despite the substrate protection unit 2140 .

Here, the second material may be a synthetic resin including plastic, and may have a lower heat transfer coefficient than that of the first material.

55 to 57 are schematic perspective views for explaining a process of inserting a core into a body provided in an electronic pen according to an embodiment of the present invention.

First, referring to FIG. 55 , in the electronic pen 2000 according to the present invention, the core part 2010 can be freely replaced, and the core part 2010 is a core part formed in the substrate fixing part 2030 of the body part 2020 . It may be inserted into the insertion hole (S7).

Referring to FIG. 56 , the substrate fixing unit 2030 includes a substrate mounting unit 2132 to which the receiving substrate C1 is mounted, a core insertion guide 2134 providing a path into which the core 2010 is inserted, and the core. A deep part fixing part 2136 for fixing the core part 2010 may be provided so that the core part 2010 inserted into the insertion guide part 2134 is press-fitted.

The substrate mounting part 2132 may be a kind of frame constituting the substrate fixing part 2030, and the deep part insertion guide part 2134 may be formed in an open state through a path communicating with the deep part insertion hole (S7). can

However, the deep insertion guide portion 2134 is not necessarily formed in an open state, and may be formed as a kind of groove or hole.

On the other hand, referring to FIGS. 55 and 56 , the deep insertion guide 2134 includes the first deep insertion guide 2135 through which the core 2010 passes and the second core in which the deep fixing part 2136 is mounted. An insertion guide part 2137 may be provided, and the deep part fixing part 2136 may be slidably mounted in the second deep part insertion guide part 2137 .

The deep part fixing part 2136 may be detachably mounted on the second deep part insertion guide part 2137, and when it is mounted on the second deep part insertion guide part 2137, the second deep part insertion guide part 2137 ) may be provided with a protrusion 2139 that is formed to extend outwardly so that it can slide without being separated from the inside.

In addition, the second core insertion guide portion 2137 may include a projection corresponding portion 2131 formed to protrude to form a space in which the projection portion 2139 is mounted.

When the deep part fixing part 2136 is mounted on the second deep part insertion guide part 2137, the protrusion part 2139 is caught by the protrusion corresponding part 2131, so that it can be prevented from departing to the outside.

As the core fixing part 2136 is slidably mounted in the core insertion guide part 2134 , the electronic pen 2000 according to the present invention allows the user to feel comfortable in writing while taking notes.

On the other hand, the deep part fixing part 2136 may have an attractive force with the substrate mounting part 2132 in the second deep part insertion guide part 2137, and a first magnet 2172 and a second magnet as a means for generating an attractive force. The magnetic force by (2174) can be used.

The first magnet 2172 may be mounted on the deep fixing part 2136 , and the second magnet 2174 is mounted on the substrate mounting part 2132 so that the deep fixing part 2136 is the substrate mounting part 2132 . and the force of attraction can be maintained.

An elastic body 2176 having elasticity may be disposed between the first magnet 2172 and the second magnet 2174, and the elastic body 2176 provides softness while the user writes on the medium for convenience. can be improved

<Control method of electronic equipment>

1. Real-time reproduction method #1 of content written by the user

Hereinafter, a first embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

58 is a flowchart of a first embodiment of a method for real-time reproduction of content written by a user according to the present invention. Referring to FIG. 58 , the real-time reproduction method of content written by a user includes acquiring pen data ( S110 ), acquiring information on a target medium based on the acquired pen data ( S120 ), and a target medium Displaying a medium image corresponding to ( S130 ), and reproducing the user's handwriting on the medium image based on the acquired pen data ( S140 ).

The step of reproducing the user's handwriting ( S140 ) may include reproducing the user's handwriting at a corresponding position on the medium image in real time based on the stroke data generated from the pen data.

Accordingly, the electronic device 3000 may reproduce the user's handwriting in real time based on the pen data received from the electronic pen 2000 and display it through the electronic device 3000 .

While the above-described operation method of the electronic device is described, the description corresponding to each step has already been described in detail, and thus a detailed description thereof will be omitted.

2. Real-time reproduction method #2 of the content written by the user

Hereinafter, a second embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

59 is a flowchart of a second embodiment of a method for real-time reproduction of content written by a user according to the present invention. Referring to FIG. 59 , in the real-time reproduction method of the handwritten content, a step of acquiring pen data ( S210 ), a predetermined condition for a first area that is at least a part of a medium image being displayed based on the acquired pen data is satisfied (S220), if a predetermined condition is satisfied, a part of the medium image being displayed through the display is shifted from the first area to the second area and displayed (S230), the shifted second area is displayed. and reproducing the user's handwriting on the second area ( S240 ).

In this case, the predetermined condition may be whether the user's writing position is out of the first area. That is, when the user's writing position is out of the first area displayed through the display, it may be determined that the predetermined condition is satisfied.

Accordingly, when the electronic device 3000 reproduces the user's handwriting in real time based on the pen data received from the electronic pen 2000, the target medium is enlarged and displayed so that the entire target medium is displayed through the display. In the case where the display area is not displayed and only a portion is displayed, even if the user's handwriting is input to another area that is not being displayed through the display, the user's handwriting can be reproduced after the display area is shifted to the corresponding area.

While the above-described operation method of the electronic device is described, the description corresponding to each step has already been described in detail, and thus a detailed description thereof will be omitted.

3. Replay of Written Content #1

Hereinafter, a first embodiment of a method for replaying handwritten content according to the present invention will be described.

60 is a flowchart of a first embodiment of a method for replaying handwritten content according to the present invention. Referring to FIG. 60 , the step of receiving the information about the user's handwriting from the electronic pen detecting the information (S310), the step of storing the received information about the user's handwriting in a memory (S320), at least a first stroke and and performing a replay operation of sequentially replaying the user's handwriting including a second stroke following the second stroke on the display (S330).

In this case, the first stroke and the second stroke are displayed on the display one at a time, regardless of the time required for the user to write the first stroke and the second stroke, and at a first time point, the first stroke A stroke may be displayed on the display, and the second stroke may be displayed on the display at a second time point later than the first time point.

Accordingly, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000, the electronic device 3000 can replay the user's handwriting within a shorter time than the time the user actually inputs the handwriting. there will be

While the above-described operation method of the electronic device is described, the description corresponding to each step has already been described in detail, and thus a detailed description thereof will be omitted.

4. Replay of Written Content #2

Hereinafter, a second embodiment of a method for replaying handwritten content according to the present invention will be described.

61 is a flowchart of a second embodiment of a method for replaying handwritten content according to the present invention. Referring to FIG. 61 , the method for replaying the handwritten content includes receiving, through a communication unit, pen data that is information about the user's handwriting (S410), and storing the received pen data in a memory (S420). ), and performing a replay operation of sequentially replaying the user's handwriting on a display based on the stored pen data (S430).

In this case, the replay time of the replay operation is determined based on the number of strokes included in the handwriting of the user who is the target of the replay operation.

Accordingly, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000 , the user actually inputs the handwriting by determining the reproduction time of the replay operation based on the number of strokes. Users' handwriting can be replayed in less than an hour.

While the above-described operation method of the electronic device is described, the description corresponding to each step has already been described in detail, and thus a detailed description thereof will be omitted.

5. Capture of your handwriting

Hereinafter, a handwriting capturing method according to the present invention will be described.

62 is a flowchart of a handwriting capturing method according to an embodiment of the present invention. Referring to FIG. 62 , the handwriting capture method includes at least one of receiving pen data from the electronic pen 2000 ( S510 ), obtaining handwriting content based on the pen data ( S520 ), and a reproduction section of the handwriting content A step of receiving a user input corresponding to the time point of ( S530 ), a step of setting a target section based on the user input ( S540 ), a step of determining the target writing content corresponding to the target section among the handwriting contents ( S550 ), and the target It may include capturing an image including the handwritten content (S560).

First, the electronic device 3000 may receive pen data related to writing from the electronic pen 2000 ( S510 ). The pen data may include coordinate data written on the medium 1000 using the electronic pen 2000 and data regarding a writing time.

The electronic device 3000 may acquire the writing content by using the pen data ( S520 ). The handwritten content may be obtained by connecting the coordinate data in the order of the handwriting time and generating the stroke.

The electronic device 3000 may receive a user input corresponding to at least one point in the playback section ( S530 ). To this end, the electronic device 3000 may display the progressive bar to receive a user input for the progressive bar, display the handwriting to receive an input for a specific stroke among the handwritten content, or receive a user input while reproducing the handwritten content. there is. The electronic device 3000 may acquire a start time and an end time of the reproduction section according to the user input. If only one viewpoint is acquired, the other viewpoints may be set by the electronic device 3000 itself.

In addition, in order to receive such a user input, the electronic device 3000 may display the entire handwritten content on the screen to help the user input.

The electronic device 3000 may set a target section based on a user input (S540). The electronic device 3000 may determine a start time and an end time of the target section according to a user input, and set the target section accordingly.

When the target section is set, the electronic device 3000 may determine the target writing content among all the writing contents ( S550 ). One or a plurality of target writing contents may be determined. In addition, the electronic device 3000 may display the target handwritten content to be distinguished from the rest of the handwritten content so that the user can feedback which handwritten content is determined as the target handwritten content.

The electronic device 3000 may capture the selected target writing section (S560). The capture may be performed in an image capture method or through pen data. In addition, the captured image may be transmitted externally through an external device or the Internet or stored separately.

In the above-described method for controlling an electronic device according to the present invention, the step of configuring each embodiment is not essential, and therefore each embodiment may selectively include the above-described step. In addition, each step constituting each embodiment does not necessarily have to be performed in the order described, and a step described later may be performed before the step described earlier.

In addition, the method for controlling an electronic device according to the present invention may be implemented in the form of a code or program for performing the same, and such code or program may be stored in a computer-readable recording medium.

The present invention described above is capable of various substitutions, modifications and changes within the scope without departing from the technical spirit of the present invention for those of ordinary skill in the art to which the present invention pertains. It is not limited by the drawing. In addition, the embodiments described in this document may not be limitedly applied, but all or some of the embodiments may be selectively combined so that various modifications may be made. Furthermore, steps constituting each embodiment may be used individually or in combination with steps constituting other embodiments.

1000: medium
2000: electronic pen
3000: electronic device
4000: server

Claims (18)

delete a core that enables writing on the medium;
a body part inserted so that a part of the core part is exposed to fix the position of the core part; and
It includes; a cap part having a predetermined internal space to protect the core part by inserting one side of the main body part in a non-use state,
The cap part,
When the other side of the body portion is inserted, a receiving portion for accommodating the other side of the main body portion and a position fixing portion disposed in the inner space so as to be in contact with the other side of the main body portion to define a limit of insertion of the other side of the main body portion,
The body part,
A body part that a user can grip and a locking part protruding from one side of the body part so that the position fixing part is mounted in the non-use state to fix the position of the cap part to provide a mounting space,
The position fixing unit,
and a protrusion protruding from the center of one surface of the accommodating part into the inner space and a mounting part extending from an end of the protrusion and mounted in the mounting space,
The locking part,
An electronic pen having a first locking part and a second locking part formed to be spaced apart from the first locking part so as to be provided in the mounting space between the first locking part and the second locking part.
3. The method of claim 2,
The mounting part,
An electronic pen extending radially from an end of the protrusion.
3. The method of claim 2,
The receiving part and the body part,
The transverse section is formed in a Kth square (K is a natural number greater than or equal to 3),
The mounting part,
When the body part is inserted into the accommodating part, the electronic pen is formed by radially extending from an end of the protrusion toward a vertex of a transverse cross-section of the accommodating part so as to be mounted in the mounting space regardless of a change in the position of the mounting space.
5. The method of claim 4,
The core is
It is arranged eccentrically from the center of the transverse cross-section of the body part toward the vertex of the transverse cross-section of the body part,
The first engaging portion and the second engaging portion,
An electronic pen formed between a center line of a transverse cross-section of the body and the core.
3. The method of claim 2,
The first locking part,
and an insertion inclined surface inclined downward along an insertion direction to enter the mounting space after the body part is in contact with the receiving part when the body part is inserted into the accommodating part.
3. The method of claim 2,
The first locking part,
and a separation inclined surface inclined downward along a separation direction so that the mounting part mounted in the mounting space is separated from the mounting space when the body part inserted into the accommodating part is separated.
3. The method of claim 2,
The second locking part,
When the body part is inserted into the receiving part, the electronic pen is in surface contact with the mounting part to prevent the mounting part from being inserted beyond the mounting space.
3. The method of claim 2,
The second locking part,
and an over-insertion preventing surface perpendicular to an insertion direction to prevent the mounting part from being inserted beyond the mounting space when the body part is inserted into the receiving part.
3. The method of claim 2,
The end of the second locking part,
The electronic pen is formed closer to the center of the body portion than the end of the first locking portion.
3. The method of claim 2,
One surface of the body portion between the first engaging portion and the second engaging portion defining the mounting space,
An electronic pen in surface contact with the mounting part.
12. The method of claim 11,
One surface of the body portion between the first engaging portion and the second engaging portion defining the mounting space,
The electronic pen is formed in a plane parallel to the insertion direction of the body portion into the receiving portion.
3. The method of claim 2,
The cap part,
The electronic pen further comprising a rigidity reinforcing unit connecting an outer surface of the position fixing unit and a bottom surface of the receiving unit to each other so that the rigidity of the position fixing unit is reinforced.
a core that enables writing on the medium;
a body part inserted so that a part of the core part is exposed to fix the position of the core part; and
It includes; a cap part having a predetermined internal space to protect the core part by inserting one side of the main body part in a non-use state,
The cap part,
and a accommodating part accommodating one side of the body part and a position fixing part protruding from the bottom surface of the inside of the accommodating part,
The body part,
It includes a body part that a user can grip and a locking part that protrudes from one side of the body part so that the position fixing part is mounted in the non-use state so that the cap part is fixed in position to provide a mounting space,
The core is
It is arranged eccentrically from the center of the body part toward the outer circumferential surface,
The locking part,
An electronic pen formed between the center line of the body part and the core part.
15. The method of claim 14,
The position fixing unit,
and a protrusion protruding from the center of one surface of the accommodating part into the inner space and a mounting part extending from an end of the protrusion and mounted in the mounting space,
The locking part,
An electronic pen having a first locking part and a second locking part formed to be spaced apart from the first locking part so as to be provided in the mounting space between the first locking part and the second locking part.
16. The method of claim 15,
The mounting part,
An electronic pen extending radially from an end of the protrusion.
16. The method of claim 15,
The receiving part and the body part,
The transverse section is formed in a Kth square (K is a natural number greater than or equal to 3),
The mounting part,
When the body part is inserted into the accommodating part, the electronic pen is formed by radially extending from an end of the protrusion toward a vertex of a transverse cross-section of the accommodating part so as to be mounted in the mounting space regardless of a change in the position of the mounting space.
18. The method of claim 17,
The core is
It is arranged eccentrically from the center of the transverse cross-section of the body part toward the vertex of the transverse cross-section of the body part,
The first engaging portion and the second engaging portion,
An electronic pen formed between a center line of a transverse cross-section of the body and the core.

Images