KR102645306B1 - Electronic pen, electronic device associated with electronic pen, method for controlling electronic device and computer-readable medium on which program for performing the method for controlling electronic device is recorded - Google Patents

Abstract

According to an embodiment of the present disclosure, an electronic device for reproducing the contents of a user's handwriting on Medium, comprising: a communication unit that communicates with an electronic pen that detects information about the user's handwriting; display; and a control unit, wherein the control unit displays a medium image corresponding to the medium and controls the display to reproduce and visually display the user's handwriting on the medium image, wherein the control unit controls the display. Determine whether the display mode is a normal mode or an enlarged mode, and in the case of the normal mode, reproduce the user's handwriting according to a first reproduction mode, and in the case of the enlarged mode, reproduce the user's handwriting according to a second reproduction mode. When reproducing handwriting content and reproducing the user's handwriting content according to the second reproduction mode, the first area of the medium image displayed on the display through the magnification mode is adjusted according to the user's writing position. An electronic device characterized by shifting may be provided.

Description

An electronic pen, an electronic device linked to an electronic pen, a control method of an electronic device, and a recording medium recording a program that executes a control method of the electronic device MEDIUM ON WHICH PROGRAM FOR PERFORMING THE METHOD FOR CONTROLLING ELECTRONIC DEVICE IS RECORDED}

The present invention relates to an electronic pen, an electronic device linked with an electronic pen, and a method of controlling an electronic device. More specifically, an electronic pen that recognizes and displays a user's handwriting, an electronic device linked to an electronic pen, and a method of controlling the electronic device. It's about control methods.

Recently, technologies and products that can recognize a user's handwriting using an electronic pen and digitize and store the recognized content have been commercialized. However, the development of a method to recognize and provide digitized handwriting contents to users using these electronic pens in a meaningful way is still insufficient, and methods to enable users to utilize digitized handwriting contents more effectively are not yet available. development is required.

Meanwhile, conventional electronic pens generally adopt the structure of existing writing instruments, with the core located in the center of the main body that the user grips, and are stored by inserting them into a cover when not in use.

Here, when inserting the main body into the cover, conventionally, in order to prevent separation of the main body and the cover, a protrusion is formed on the outer surface of the main body, a groove is formed on the inner surface of the cover, and the protrusion is inserted into the groove. Fixed.

In this conventional method, the protrusions were frequently damaged by external factors that may occur while the user was using the main body, which led to a decrease in the bonding strength between the main body and the cover, ultimately shortening the lifespan of the electronic pen. occurred.

One object of the present invention is to provide an electronic pen capable of recognizing a user's handwriting and replaying the recognized user's handwriting at a later date, an electronic device linked to the electronic pen, and a method of controlling the electronic device.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and problems not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings. .

According to one aspect of the present invention, an electronic device for replaying the content of a user's handwriting on Medium, comprising: a communication unit that communicates with an electronic pen that detects information about the user's handwriting; memory to store data; Displays that visually display information; and receiving pen data, which is information about the user's handwriting, through the communication unit, storing the received pen data in the memory, and sequentially displaying the content of the user's handwriting on the display based on the stored pen data. an electronic device that includes a control unit that performs a replay operation to replay the replay operation, wherein the control unit determines the playback time of the replay operation based on the number of strokes included in the handwriting of the user who is the target of the replay operation. is provided.

According to another aspect of the present invention, there is provided a control method of an electronic device for replaying the content of a user's handwriting on Medium, comprising: receiving pen data, which is information about the user's handwriting, through a communication unit; storing the received pen data in memory; And based on the stored pen data, performing a replay operation to sequentially replay the user's handwriting on the display, wherein the playback time of the replay operation is determined by the user's handwriting that is the target of the replay operation. A control method for an electronic device determined based on the number of included strokes is provided.

According to another aspect of the present invention, a recording medium recording a program for executing the control method of an electronic device provided by the above-described present invention can be provided.

The means for solving the problem of the present invention are not limited to the above-mentioned solution means, and the solution methods not mentioned will be clearly understood by those skilled in the art from this specification and the attached drawings. You will be able to.

According to the present invention, it is possible to replay how the user's handwriting progressed at a later time, thereby allowing the user to check more information (for example, the order of writing, etc.) from the written content.

In addition, according to the present invention, when replaying the user's handwriting, by appropriately controlling the replay playback time, it is possible to provide a replay of the user's handwriting in a more effective and efficient manner in a shorter time. there is.

1 is a schematic diagram illustrating a system including an electronic pen and electronic devices linked to the electronic pen related to embodiments of the present invention.
Figure 2 is a diagram showing one embodiment of a medium related to embodiments of the present invention.
Figure 3 is a diagram showing an exemplary appearance of an electronic pen according to embodiments of the present invention.
Figure 4 is a block diagram for explaining the components of an electronic pen according to embodiments of the present invention.
Figure 5 is a block diagram for explaining components of electronic devices according to embodiments of the present invention.
Figures 6 and 7 are diagrams illustrating unit cells constituting a code pattern according to an embodiment of the present invention.
Figure 8 is a diagram for explaining a method of encoding 2 bits of information in an information code according to embodiments of the present invention.
FIG. 9 is a diagram illustrating a method of generating location information of an electronic pen for a medium according to embodiments of the present invention.
Figure 10 is a diagram for explaining an embodiment of reproducing the user's handwriting in real time according to the present invention.
Figures 11 to 15 are diagrams for explaining another embodiment of reproducing the user's handwriting in real time according to the present invention.
Figure 16 is a diagram for explaining a section subject to replay according to the present invention.
FIG. 17 is a diagram showing the replay playback time determined according to an embodiment of the present invention for the replay target section as shown in FIG. 16.
Figures 18 and 19 are diagrams showing the replay playback time determined according to another embodiment of the present invention for the replay target section as shown in Figure 16.
20 to 24 are diagrams for explaining some other embodiments of determining a replay playback time to replay a stroke written by a user according to some other embodiments of the present invention.
Figure 25 is a diagram for explaining a method of determining the playback time of a replay based on the number of strokes, according to some embodiments of the present invention.
FIG. 26 is a diagram for explaining an example of determining the replay speed of a replay according to the number of strokes included in the replay target content according to some embodiments of the present invention.
Figure 27 is a diagram for explaining an embodiment of determining the number of replay strokes per unit time according to the replay playback speed according to some embodiments of the present invention.
Figure 28 is a diagram for explaining a method of performing a replay operation for a user's handwriting, according to some embodiments of the present invention.
Figure 29 is a diagram of the entire written content and the target written content during the capture operation of the electronic device according to the present invention.
30 to 32 are examples of a user interface for inputting a target section according to the present invention.
Figures 33 to 35 are another example of a user interface for inputting a target section according to the present invention.
Figures 36 and 37 are another example of a user interface for inputting a target section according to the present invention.
Figure 38 is a diagram of a screen that outputs the entire handwriting content for receiving input of a target section according to the present invention.
Figures 39 and 40 are diagrams of a screen for identifying target written content according to the present invention.
Figure 41 is a diagram showing a captured image according to the present invention.
Figure 42 is a schematic perspective view showing an exploded view of the main body and the cap provided in the electronic pen according to an embodiment of the present invention.
Figure 43 is a schematic perspective view showing a state in which the cap provided in the electronic pen according to an embodiment of the present invention is inserted into the other side of the main body.
Figure 44 is a schematic perspective view showing the internal structure of the cap portion and the main body provided in the electronic pen according to an embodiment of the present invention.
FIG. 45 is a schematic cross-sectional view taken along line AA in FIG. 44.
Figure 46 is a schematic perspective view showing a modified example of a cap portion provided in an electronic pen according to an embodiment of the present invention.
Figure 47 is a schematic front view showing the main body provided in the electronic pen according to an embodiment of the present invention.
Figures 48 and 49 are schematic side views for explaining the process of inserting a cap part into one side of the main body provided in an electronic pen according to an embodiment of the present invention.
Figures 50 and 51 are schematic perspective views showing an exploded main body provided in an electronic pen according to an embodiment of the present invention.
Figures 52 to 54 are schematic perspective views illustrating a substrate portion, a camera module, and a lighting module positioned and fixed to the body portion provided in an electronic pen according to an embodiment of the present invention.
Figures 55 to 57 are schematic perspective views for explaining the process of inserting a core part into the body provided in an electronic pen according to an embodiment of the present invention.
Figure 58 is a flowchart of a first embodiment of a method for real-time reproduction of content written by a user according to the present invention.
Figure 59 is a flowchart of a second embodiment of a method for real-time reproduction of content written by a user according to the present invention.
Figure 60 is a flowchart of a first embodiment of a method for replaying written content according to the present invention.
Figure 61 is a flowchart of a second embodiment of a method for replaying written content according to the present invention.
Figure 62 is a flowchart of a handwriting capture method according to an embodiment of the present invention.

The embodiments described in this specification are intended to clearly explain the idea of the present invention to those skilled in the art to which the present invention pertains, and the present invention is not limited to the embodiments described in this specification, and the present invention The scope of should be construed to include modifications or variations that do not depart from the spirit of the present invention.

The terms used in this specification are general terms that are currently widely used as much as possible in consideration of their function in the present invention, but this may vary depending on the intention, custom, or the emergence of new technology of a person skilled in the art in the technical field to which the present invention pertains. You can. However, if a specific term is defined and used with an arbitrary meaning, the meaning of the term will be described separately. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the term and the overall content of this specification, not just the name of the term.

The drawings attached to this specification are intended to easily explain the present invention, and the shapes shown in the drawings may be exaggerated as necessary to aid understanding of the present invention, so the present invention is not limited by the drawings.

In this specification, if it is determined that a detailed description of a known configuration or function related to the present invention may obscure the gist of the present invention, the detailed description thereof will be omitted as necessary.

Electronic devices linked to the electronic pen described in this specification include mobile phones, smart phones, laptop computers, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), navigation devices, etc. It may not only include mobile terminals, but may also include fixed terminals such as digital TVs, desktop computers, etc.

According to one aspect of the present invention, an electronic device for reproducing the contents of a user's handwriting on Medium, comprising: a communication unit that communicates with an electronic pen that detects information about the user's handwriting; a display that displays at least a portion of the medium image corresponding to the medium and visually displays the content of the user's handwriting on the medium image; and based on the pen data received from the communication unit, determine whether the user's writing position satisfies a predetermined condition for a first area that is at least a portion of the medium image displayed through the display, and determine whether the predetermined condition is met. If satisfied, a part of the medium image displayed through the display is shifted from the first area to a second area different from the first area, the second area is displayed through the display, and the user's handwriting is displayed. a control unit that displays a reproduction of the user's handwriting content at a location on the second area corresponding to the user's writing position, in order to reproduce the content; Electronic devices including may be provided.

The predetermined condition may be whether the user's writing position deviates from the first area.

Alternatively, the predetermined condition may be whether the user's writing position is included in an edge area of the first area.

The second area may be determined based on the user's writing position with respect to the medium.

At this time, the second area may be determined so that the user's writing position for the medium is located in the center.

Alternatively, the second area may be determined by further considering the position of the edge of the medium image.

In particular, the second area may be determined so that the edge position of the medium image does not deviate by more than a predetermined distance from the edge area of the screen being displayed on the display.

In determining whether the predetermined condition is satisfied, the control unit determines whether the predetermined condition is satisfied using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting. You can.

Additionally, the control unit may determine whether the predetermined condition is satisfied by using the first pen data corresponding to the pen down time point among the plurality of pen data for the one stroke.

Additionally, when the predetermined condition is satisfied, the control unit may determine the second area based on location information included in the first pen data.

The control unit may determine whether the predetermined condition is satisfied by using second pen data corresponding to the pen up point among the plurality of pen data for the one stroke.

Additionally, when the predetermined condition is satisfied, the control unit may determine the second area based on location information included in the second pen data.

Additionally, the control unit may determine whether each of a plurality of strokes included in the user's handwriting satisfies the predetermined condition.

According to another aspect of the present invention, there is an electronic device for reproducing the content of a user's handwriting on Medium, comprising: a communication unit that communicates with an electronic pen that detects information about the user's handwriting; a display that displays at least a partial area of the medium image corresponding to the medium and visually displays the content of the user's handwriting on the medium image; and displaying a first stroke included in the user's handwriting at a corresponding position in the medium image, receiving pen data constituting a second stroke included in the user's handwriting, and configuring the second stroke. Based on at least one pen data among the pen data, it is determined whether the position of the second stroke satisfies a predetermined condition, and if the predetermined condition is satisfied, the at least one pen constituting the second stroke a control unit that shifts at least a portion of the medium image displayed on the display based on data to correspond to the distance and direction of the first stroke; Electronic devices including may be provided.

The predetermined condition may be whether the location information of the at least one pen data constituting the second stroke deviates from a partial area of the image of the medium currently displayed on the display.

The control unit may shift at least a portion of the medium image so that the location corresponding to the at least one pen data is located in the center.

The at least one pen data may be at least one of pen data corresponding to a pen down time and pen data corresponding to a pen up time among the plurality of pen data constituting the second stroke.

According to another aspect of the present invention, an electronic device for reproducing the content of a user's handwriting on Medium, comprising: a communication unit that communicates with an electronic pen that detects information about the user's handwriting; a display that displays a medium image corresponding to the medium and visually displays the content of the user's handwriting on the medium image; and determine whether the user's handwriting content is being reproduced through the display in a normal mode or an enlarged mode, and if in the normal mode, reproduce the user's handwriting content according to a first reproduction mode, and in the enlarged mode a control unit that reproduces the user's handwriting according to a second reproduction mode; It includes, when reproducing the user's handwriting according to the second reproduction mode, the control unit selects a partial area of the medium image displayed on the display through the magnification mode to the user's writing position. An electronic device characterized by shifting according to the device may be provided.

According to another aspect of the present invention, there is a method of controlling an electronic device for reproducing the contents of a user's handwriting on Medium, based on pen data received from a communication unit that communicates with an electronic pen that detects information about the user's handwriting. Thus, determining whether the user's writing position satisfies a predetermined condition for the first area, which is at least part of the medium image displayed through the display; When the predetermined condition is satisfied, a part of the medium image displayed through the display is displayed in the first area in a different area from the first area so that the reproduction of the user's handwriting can be displayed through the display. Shifting to a second area and displaying the second area on the display; and displaying a reproduction of the user's handwriting at a location on the second area corresponding to the user's writing position, to reproduce the user's handwriting; A control method of an electronic device including a may be provided.

The predetermined condition may be whether the user's writing position deviates from the first area.

The predetermined condition may be whether the user's writing position is included in an edge area of the first area.

The second area may be determined based on the user's writing position with respect to the medium.

The second area may be determined so that the user's writing position for the medium is located in the center.

The determining step includes determining whether the predetermined condition is satisfied by using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting. It may be judgment.

The determining step may include determining whether the predetermined condition is satisfied using first pen data corresponding to the pen down time point among the plurality of pen data for the one stroke.

If the predetermined condition is satisfied, the second area may be determined based on location information included in the first pen data.

The determining step may include determining whether the predetermined condition is satisfied using second pen data corresponding to the pen up point among the plurality of pen data for the one stroke.

If the predetermined condition is satisfied, the second area may be determined based on location information included in the second pen data.

The determining step may determine whether each of the plurality of strokes included in the user's handwriting satisfies the predetermined condition.

According to another aspect of the present invention, there is provided a method of controlling an electronic device for reproducing the content of a user's handwriting on Medium, the method comprising: receiving pen data constituting a first stroke included in the user's handwriting from an electronic pen; displaying a first stroke included in the user's handwriting at a corresponding position in the medium image; Receiving pen data constituting a second stroke included in the user's handwriting from the electronic pen; determining whether the position of the second stroke satisfies a predetermined condition based on at least one pen data among pen data constituting the second stroke; When the predetermined condition is satisfied, shifting at least a portion of the medium image displayed on the display according to the distance and direction of the at least one pen data constituting the second stroke with respect to the first stroke. steps; and displaying the medium image using the second stroke in the shifted partial area. A control method of an electronic device including a may be provided.

According to another aspect of the present invention, a method of controlling an electronic device for reproducing the contents of a user's handwriting on Medium, comprising the step of determining whether the user's handwriting is being reproduced in a normal mode or an enlarged mode through a display. ; and reproducing the user's handwriting according to a first reproduction mode when in the normal mode, and reproducing the user's handwriting according to a second reproduction mode when using the enlarged mode; It includes, when reproducing the user's handwriting according to the second reproduction mode, the control unit selects a partial area of the medium image displayed on the display through the magnification mode to the user's writing position. A control method of an electronic device characterized by shifting according to the device may be provided.

According to another aspect of the present invention, a recording medium recording a program for executing the control method of an electronic device provided by the above-described present invention can be provided.

First, the environment in which the electronic pen and electronic devices linked to the electronic pen related to some embodiments of the present invention are operated will be briefly described, and the electronic pen and electronic devices linked to the electronic pen according to the embodiments of the present invention will be briefly described. and control methods of electronic devices, etc. will be described in detail.

<System configuration>

1 is a schematic diagram illustrating a system including an electronic pen and electronic devices linked to the electronic pen related to embodiments of the present invention.

The system may include at least one medium 1000, at least one electronic pen 2000, at least one electronic device 3000, and at least one server 4000.

The medium 1000 provides a surface for the user to write desired information using an electronic pen according to embodiments of the present invention.

The medium 1000 may be made of materials such as paper, plastic, and metal, and the material of the medium 1000 is not limited by the present invention.

If the electronic pen according to embodiments of the present invention is an electronic pen (hereinafter referred to as an optical electronic pen) implemented using optical components including a camera module, the medium 1000 is used by the electronic pen. It may have a code pattern that can be recognized. A detailed explanation of the code pattern will be provided later. When the medium 1000 is provided with a code pattern, the code pattern can be provided to the medium 1000 through a method such as printing.

The electronic pen 2000 can detect information about the user's handwriting and generate pen data. The pen data can be used to generate stroke data for the user's handwriting, etc. A detailed explanation of pen data will be provided later.

The electronic device 3000 can receive pen data from the electronic pen 2000 and interpret it. Stroke data may be generated according to the interpretation of pen data.

The electronic device 3000 can appropriately process the interpreted stroke data and reproduce and display the user's handwriting in real time according to the stroke data through a display provided in the electronic device 3000 or replay and display it at a later time.

In addition, the electronic device 3000 may store pen data and/or stroke data generated according to the interpretation of the pen data in a memory provided in the electronic device 3000, and may store the pen data and/or stroke data generated according to the interpretation of the pen data in a memory provided in the electronic device 3000. Alternatively, appropriate processing may be performed on the stroke data.

The electronic device 3000 is connected to the server 4000 through a network and can transmit or receive necessary information through the network.

The server 4000 is connected to the electronic device 3000 through a network and can receive or transmit necessary information.

The server 4000 is connected to a plurality of electronic devices 3000 and can form a database of pen data (or stroke data) received from the electronic devices 3000.

The server 4000 may appropriately process pen data (or stroke data) stored in a database according to requests from a plurality of electronic devices 3000 or requests from users.

The server 4000 may share and perform some or all of the functions of the electronic device 3000 described above. For example, the electronic device 3000 may receive pen data from the electronic pen 2000 and directly transmit the pen data to the server 4000 without performing a special processing procedure for the pen data. In this case, , the server 4000 may perform operations such as receiving pen data and generating stroke data, storing stroke data, and additional processing of stroke data, as described above.

In Figure 1, one medium (1000-1) is shown as corresponding to one electronic pen (2000-1), but the correspondence relationship between the medium (1000) and the electronic pen (2000) is 1:N or N: It is okay to correspond according to the correspondence relationship of 1.

In addition, in Figure 1, one electronic pen (2000-1) is shown as corresponding to one electronic device (3000-1), but the correspondence relationship between the electronic pen (2000) and the electronic device (3000) is It is okay to correspond according to the correspondence relationship of 1:N or N:1.

In addition, although FIG. 1 shows a plurality of electronic devices 30000 connected to one server 4000, systems according to embodiments of the present invention may include two or more servers.

Meanwhile, in FIG. 1, the electronic pen 2000 is shown communicating with the electronic device 3000, and the electronic device 3000 is shown communicating with the electronic pen 2000 and the server 4000. However, if necessary, the electronic pen 2000 may directly communicate with the server 4000.

<Medium>

Next, the medium 1000 related to embodiments of the present invention will be described.

Figure 2 is a diagram showing one embodiment of a medium related to embodiments of the present invention.

Referring to Figure 2, it shows that a note or book is provided with a plurality of mediums (1000). As shown in FIG. 2, according to some embodiments of the present invention, at least part or all of the pages constituting a note or book may be implemented as medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical electronic pen, code patterns according to embodiments of the present invention may be provided on at least some or all of the pages constituting a notebook or book.

Meanwhile, only at least a portion of the entire surface of the pages constituting a note or book may be implemented as medium 1000 according to embodiments of the present invention. For example, if the electronic pen 1000 is implemented as an optical electronic pen, the code pattern is not provided on the entire surface of the pages that make up a note or book, but only in some areas. It may be.

Meanwhile, although not shown in the drawings, the medium 1000 according to embodiments of the present invention may be implemented in the form of a blackboard or the like. That is, the medium 1000 according to embodiments of the present invention can be implemented in the form of a blackboard (electronic blackboard) provided with a code pattern.

<Electronic pen>

Next, an electronic pen according to embodiments of the present invention will be described.

FIG. 3 is a diagram illustrating an exemplary appearance of an electronic pen according to embodiments of the present invention, and FIG. 4 is a block diagram for explaining components of an electronic pen according to embodiments of the present invention.

Referring to FIG. 3, the electronic pen 2000 largely includes a main body portion 2020 that fixes the position of the core portion 2010 (see FIG. 42) that enables writing on the medium 1000, and the core portion 2010 when not in use. ) may include a cap portion 2030 that protects the cap portion 2030, etc.

Here, the non-use state may mean a state in which the electronic pen 2000 according to an embodiment of the present invention is being stored. In this case, the core portion 2010 is not exposed to the outside, so writing on the medium is impossible. It can mean.

The core portion 2010 is a component that enables writing on the medium 1000 and may include a ball and ink, and the ink may be oil-based, water-based, or neutral.

Additionally, the core portion 2010 may be a black core used in a pencil or a lead used in a general writing instrument.

The main body portion 2020 is a component that is inserted so that a portion of the core portion 2010 is exposed to fix the position of the core portion 2010, and may refer to a type of grip portion that a user can grip with his or her hand.

The cap portion 2030 may be inserted into one side of the main body 2020 when not in use and may have a predetermined internal space to protect the core portion 2010, and may be inserted into the other side of the main body 2020. If possible, a portion of the core portion 2010 may be exposed to the outside to enable writing.

However, when writing is enabled by the core part 2010, the cap part 2030 does not necessarily need to be inserted into the other side of the main body 2020, and is separated from the main body 2020 to leave a predetermined space. It is okay to place it in .

Referring to FIG. 4, the electronic pen 2000 according to an embodiment of the present invention includes an input unit 2100, an output unit 2200, a pattern detection unit 2300, a communication unit 2400, a sensor unit 2500, It may include a memory 2600, a power unit 2700, and a control unit 2800. However, since the components shown in FIG. 4 are not essential, an electronic pen may be implemented that has more components than the illustrated components or fewer components than the illustrated components.

Hereinafter, each component of the electronic pen 2000 will be looked at in turn.

The input unit 2100 may receive user input from the user. User input can take various forms, including button input, key input, touch input, and voice input. For example, the electronic pen 2000 may receive a button input from the user and control the power on/off of the electronic pen 2000.

Examples of the input unit 2100 include traditional buttons, jog wheels, etc., as well as a touch sensor that detects the user's touch, a microphone that receives voice signals, a camera that recognizes gestures through image recognition, and a device that detects user access. A comprehensive range of input means that includes a proximity sensor consisting of an illumination sensor or an infrared sensor, a motion sensor that recognizes user movements through an acceleration sensor or a gyro sensor, and various other types of input means that detect or receive user input. It is a concept.

The output unit 2200 can output various information and provide it to the user. This output unit 2200 includes a display that outputs visible light that can be recognized through the user's vision, a speaker that outputs sound that can be recognized through the user's hearing, and a device that generates vibration that can be recognized through the user's sense of touch. It should be interpreted as a comprehensive concept that includes both haptic devices and various other types of output means. For example, the electronic pen 2000 is equipped with a buzzer ( A sound with predetermined characteristics can be output through a buzzer, etc. For another example, in order to provide the user with information about the operating state of the electronic pen 2000, predetermined visible light may be output through a display such as an LED lamp.

The pattern detection unit 2300 is configured to detect a code pattern in which position information for determining the position of the electronic pen 2000 with respect to the medium 1000 is encoded, and includes a camera module 2320 and a lighting module ( 2340).

The camera module 2320 is used to obtain an image of the code pattern provided in the medium 1000. The camera module 2320 moves the electronic pen 2000 on the medium 1000 according to the user's handwriting, at a predetermined time interval (for example, 1/60 second to 1/240 second, etc.). An image of a partial area of the code pattern provided in the medium 1000 is acquired. Accordingly, the electronic pen 1000 analyzes the information about the unit cell included in the acquired image according to the code pattern interpretation method described later, and determines the position of the electronic pen 2000 with respect to the medium 1000. can be interpreted in coordinate form.

The lighting module 2340 irradiates light of a specific predetermined frequency toward the medium 1000 so that an image of the code pattern can be obtained through the camera module 2320. The code pattern provided in the medium 1000 according to an embodiment of the present invention may be printed using ink that absorbs infrared rays. In this case, the lighting module 2340 may be well absorbed by the ink. Light of different wavelengths may be irradiated to the medium (1000). At this time, the camera module 2320 may be configured to capture images in the infrared band, and for this purpose, the camera module 2320 may be equipped with an infrared filter that selectively passes only the infrared band.

The communication unit 2400 can communicate with external devices. For example, the electronic pen 2000 may communicate with the electronic device 3000 or the server 4000 through the communication unit 2400. Accordingly, the electronic pen 2000 can transmit and receive various information with external devices. For example, the electronic pen 2000 can transmit pen data generated by the electronic pen 2000 to the electronic device 3000 or the server 4000 through the communication unit 2400, and the electronic pen 2000 ) Commands and/or data for controlling the operation of the electronic pen 2000 or providing necessary information to the electronic pen 2000 may be received from the electronic device 3000 or the server 4000 through the communication unit 2400. .

The communication unit 2400 may include a wired module 2420 and a wireless module 2440.

The wired module 2420 is a module for transmitting and receiving data to and from an external device by wire, and may include components such as a USB port, PS/2 port, parallel port, and serial port that can transmit and receive data to and from an external device. , Furthermore, it may include an Ethernet port for accessing the Internet, etc. through a LAN (Local Area Network).

The wireless module 2440 is a mobile communication module that transmits and receives data by connecting to a mobile communication network via a mobile communication base station, a WLAN (Wireless Local Area Network) type communication method such as Wi-Fi, Bluetooth, It may include a short-distance communication module that uses a WPAN (Wireless Personal Area Network) communication method such as Zigbee.

The sensor unit 2500 can sense various information. Here, various information can be used to generate control signals for controlling the operation of the electronic pen 2000 and can be used to generate pen data generated by the electronic pen 2000. Various information sensed through the sensor unit 2500 may be provided to the electronic device 3000 or the server 4000.

The sensor unit 2500 may include a pressure sensor 2520, a pen core sensor 2540, a slip sensor 2560, etc.

The pressure sensor 2520 can sense the pressure generated when the user writes. For example, when a user writes using the electronic pen 2000, the electronic pen 2000 comes into contact with the writing surface, and the pressure generated at this time is sensed by the pressure sensor 2520. You can. In particular, the pressure sensor 2520 is provided at the rear end of the pen core (core part, 2010) mounted on the electronic pen 2000 (an end other than the pen tip among both ends of the pen core) to sense pressure. The electronic pen 2000 can use the pressure value sensed through the pressure sensor 2520 to generate pen data, which will be described in detail later. At this time, the pressure value included in the pen data can be processed into pen pressure information applied by the user to the medium 1000 when writing and used to reproduce the content written by the user. Alternatively, based on the signal output through the pressure sensor 2520, the electronic pen 2000 in the off state may be used as a trigger signal to turn on the electronic pen 2000.

The pen nib sensor 2540 can detect a pen nib identifier to indicate the type of pen nib (core, 2010) mounted on the electronic pen 2000. For example, a pen nib identifier to indicate the color of the pen nib (core 2010) may be provided on the outside of the nib (core 2010) mounted on the electronic pen 2000, and in this case, the pen nib sensor 2540 The pen nib identifier can be detected through optical/magnetic methods and other various available methods. The value sensed by the pen nib sensor 2540 or information about the pen nib (simbu, 2010) interpreted by the sensed value may be provided to the electronic device 3000, and the electronic device 3000 may provide the received information It can be used to reproduce content written by the user based on.

The sleep sensor 2560 can detect the state of the electronic pen 2000, which is used to determine whether the electronic pen 2000 in the on state will automatically switch to the off state. For example, the slip sensor 2560 may include an acceleration sensor, and whether the electronic pen 2000 is moving can be detected through the acceleration sensor. If it is determined that the electronic pen 2000 is not moving for a predetermined period of time based on the value sensed through the slip sensor 2560, the electronic pen 2000 automatically moves the electronic pen 2000. The state can be switched to the off state.

According to some embodiments of the present invention, when the electronic pen 2000 is in the on state, power is normally supplied to the components provided in the electronic pen 2000 and the components operate normally as needed. However, when the electronic pen 2000 is in an off state, power to all or some components provided in the electronic pen 2000 is cut off and the electronic pen 2000 is not equipped with the electronic pen 2000. All or some of the components cannot operate normally. In particular, according to some embodiments of the present invention, even when the electronic pen 2000 is in an off state, the pressure sensor 2520 and/or an analysis module for interpreting the signal output from the pressure sensor normally operates. Power can be supplied, and accordingly, the electronic pen 2000 in the off state can be automatically switched to the on state based on the sensing value output from the pressure sensor 2520.

The memory 2600 can store various types of information. The memory 2600 can store data temporarily or semi-permanently. The memory 2600 may store operating programs such as firmware for driving the electronic pen 2000, and, if necessary, pen data generated by the electronic pen 2000 and the sensor unit 2500. Information, commands, and data necessary for operating the electronic pen 2000, such as sensing values output by , may be stored.

Examples of memory 2600 include hard disk drive (HDD), solid state drive (SSD), flash memory, read-only memory (ROM), random access memory (RAM), etc. This can be.

The power supply unit 2700 can provide power necessary for the operation of each component of the electronic pen 2000. The power unit 2700 may be implemented as a rechargeable battery, and if the communication unit 2400 of the electronic pen 2000 includes a charging port (for example, a USB port), the electronic pen ( When 2000 is connected to the electronic device 3000, power can be supplied from the electronic device 3000, and the battery can be charged accordingly.

The control unit 2800 controls the overall operation of the electronic pen 2000. To this end, the control unit 2800 can perform computation and processing of various information and control the operation of components of the electronic pen 2000.

In addition, the control unit 2800 may analyze the image for the code pattern obtained by the pattern detection unit 2300 and decode the information encoded in the unit cell included in the image of the obtained code pattern, Furthermore, the location coordinates of the medium 1000 of the electronic pen 2000 and identification information (for example, book information or page information, etc.) of the medium 1000 can be obtained from the decoded information.

The control unit 2800 may generate pen data based on information obtained by decoding information encoded in a unit cell. As described above, the generated pen data is stored in the memory 2600 or the It can be transmitted to the electronic device 3000 and/or the server 4000 through the communication unit 2400. A detailed explanation of the creation of pen data will be provided later.

Meanwhile, the control unit 2800 analyzes the image acquired by the first control unit and the pattern detection unit 2300 for controlling the general operation of the electronic pen 2000, decodes the necessary information for the unit cell, and It may be divided into a second control unit for generating pen data. The control unit 2800 may be logically divided into the first control unit and the second control unit, but the first control unit and the second control unit may be physically divided into the first control unit and the second control unit. It can also be implemented in a form that is separated from each other.

The control unit 2800 may be implemented as a computer or similar device based on hardware, software, or a combination thereof. A hardware-type control unit may be provided in the form of an electronic circuit that processes electrical signals to perform a control function, and a software-type control unit may be provided in the form of a program that drives the hardware-type control unit.

Meanwhile, unless otherwise specified in the following description, the operation of the electronic pen 2000 may be interpreted as being performed under the control of the control unit 2800.

<Electronic devices>

Next, an electronic device 3000 according to embodiments of the present invention will be described.

Figure 5 is a block diagram for explaining components of electronic devices according to embodiments of the present invention.

Referring to FIG. 5 , the electronic device 3000 may include an input module 3100, an output module 3200, a communication module 3300, a memory module 3400, and a control module 3500. However, since the components shown in FIG. 5 are not essential, an electronic device may be implemented that has more components than the illustrated components or fewer components than the illustrated components.

Hereinafter, each component of the electronic device 3000 will be looked at in turn.

The input module 3100 can receive user input from the user. User input can take various forms, including key input, touch input, and voice input. Examples of the input module 3100 that can receive such user input include a traditional keypad, keyboard, and mouse, as well as a touch sensor that detects the user's touch, a microphone that receives voice signals, and recognition of gestures through image recognition. a camera, a proximity sensor consisting of an illumination sensor or an infrared sensor that detects the user's approach, a motion sensor that recognizes the user's movements through an acceleration sensor or a gyro sensor, and various other forms of detecting or receiving user input. It is a comprehensive concept that includes all input means. Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor that detects touch through a touch panel or touch film attached to the display panel, or an optical touch sensor that detects touch by an optical method.

The output module 3200 can output various information and provide it to the user. This output module 3200 includes a display that outputs visible light that can be recognized through the user's vision, a speaker that outputs sound that can be recognized through the user's hearing, and a device that generates vibration that can be recognized through the user's sense of touch. It is a comprehensive concept that includes both haptic devices and various other types of output means.

The display may output an image to reproduce content written by a user using the electronic pen 2000 and/or the electronic device 3000 according to an embodiment of the present invention.

In addition, the display is a liquid crystal display (LCD),

Light emitting diode (LED) display, Organic Light Emitting Diode (OLED) display, Flat Panel Display (FPD), transparent display, Curved Display, flexible display A concept that refers to a wide range of image display devices, including flexible displays, 3D displays, holographic displays, projectors, and other various types of devices that can perform image output functions. am. This display may be in the form of a touch display integrated with the touch sensor of the input module 3100.

The communication module 3300 can communicate with external devices. For example, the electronic device 3000 may communicate with the electronic pen 2000 or the server 4000 through the communication module 3300. Accordingly, the electronic device 3000 can transmit and receive various information with external devices. For example, the electronic device 3000 can receive pen data generated by the electronic pen 2000 through the communication module 3300 and transmit necessary information to the electronic pen 2000. In addition, the electronic device 3000 can transmit pen data received from the electronic pen 2000 or stroke data obtained by analysis of the pen data to the server 4000 through the communication module 3300, and provide the necessary information. can be received from the server 4000.

The communication module 3300 is a wired communication module including a LAN port, USB port, PS/2 port, parallel port, serial port, etc. that connects to the Internet, etc. through a LAN (Local Area Network), and mobile communication via a mobile communication base station. A mobile communication module that connects to a network to transmit and receive data, a WLAN (Wireless Local Area Network) type communication method such as Wi-Fi, or a WPAN (Wireless Personal Area Network) type such as Bluetooth or Zigbee. It may be composed of a short-range communication module using a communication method, a satellite communication module using a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System), or a combination thereof.

The memory module 3400 can store various types of information. The memory module 3400 can store data temporarily or semi-permanently. The memory module 3400 may store an operating program (OS; Operating system) for driving the electronic device 3000, and, if necessary, various data received from the electronic pen 2000 and the electronic pen 2000. Applications for processing various data received from may be stored.

Examples of the memory module 3400 include hard disk drive (HDD), solid state drive (SSD), flash memory, read-only memory (ROM), and random access memory (RAM). There may be etc.

The control module 3500 controls the overall operation of the electronic device 3000. To this end, the control module 3500 can perform computation and processing of various information and control the operation of components of the electronic device 3000.

The control module 3500 may be implemented as a computer or similar device based on hardware, software, or a combination thereof. A hardware-type control module may be provided in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, it may be provided in the form of a program that drives a hardware-type control module.

Meanwhile, unless otherwise specified in the following description, the operation of the electronic device 3000 may be interpreted as being performed under the control of the control module 3500.

<Operation of electronic pen>

Below, the operation of the electronic pen according to embodiments of the present invention will be described.

A user can write on the medium 1000 according to some embodiments of the present invention using the electronic pen 2000 according to some embodiments of the present invention.

In addition, the electronic pen 2000 according to some embodiments of the present invention acquires an image of at least a partial area of the code pattern provided in the medium 1000 according to some embodiments of the present invention, and the obtained image Location information can be obtained by interpreting the information encoded in the unit cell contained within. While the user is writing, the electronic pen 2000 continuously acquires and processes/stores images of code patterns and location information interpreted therefrom, and as a result, the user can later use any information on the medium 1000. It is possible to generate basic data that can be used to interpret whether writing was done along the trajectory.

Below, the code pattern according to the embodiments of the present invention that can encode location information, etc. will first be described, and the location information encoded in the code pattern using the image for this code pattern will be displayed using the electronic pen (2000). ) explains how to interpret it.

However, since the electronic pen 2000 according to some embodiments of the present invention uses a commonly used pen nib (Simbu, 2010), writing is necessarily possible only with the medium 1000 according to some embodiments of the present invention. Although this is not possible, writing on common media (e.g., paper for which no code pattern is provided) is also possible. However, in this case, since the electronic pen 2000 cannot acquire location information to interpret the user's handwriting trace, operations such as real-time reproduction and replay of the user's handwriting trace, as described later, are performed by the electronic device ( 3000), etc., it would be impossible to implement it.

1. Code pattern

The code pattern according to one embodiment of the present invention is structured in such a way that one unit cell is repeatedly arranged two-dimensionally to fit a desired size.

Figures 6 and 7 are diagrams illustrating unit cells constituting a code pattern according to an embodiment of the present invention.

Referring to Figures 6 and 7, each unit cell contains codes in the form of line segments, and the codes in the form of line segments can be broadly classified into reference codes and information codes.

The standard code consists of a horizontal standard code, a vertical standard code, and a cross standard code.

The reference code has the function of confirming the area of the unit cell when decoding the code pattern.

The information code performs a function to indicate information to be encoded in the unit cell in a manner that will be described later.

Except for the intersection standard code, all other reference codes and information codes have the same geometric shape. In other words, the reference codes and information codes, excluding the intersection reference code, have a rotationally symmetrical shape and are in the form of a 'line segment'.

The cross reference code, unlike other reference codes and information codes, has a cross-shaped geometric shape.

Meanwhile, within a unit cell, virtual lines may be defined, and the virtual lines are composed of a plurality of horizontal virtual lines extending in the horizontal direction and a plurality of vertical virtual lines extending in the vertical direction. In the description of some embodiments of the present invention, an element called an 'imaginary line' may be actually printed on the medium 1000, or may not be printed.

Each of the plurality of horizontal imaginary lines is parallel to each other and is arranged at a constant distance from each other.

Additionally, each of the plurality of vertical imaginary lines is parallel to each other and is arranged at a certain distance from each other.

Any one of the plurality of horizontal imaginary lines is orthogonal to any one of the plurality of vertical imaginary lines.

A plurality of intersection points are formed when a plurality of horizontal virtual lines and a plurality of vertical virtual lines meet each other, and these plural intersection points are hereinafter referred to as virtual reference points. In the description of some embodiments of the present invention, a component called a 'virtual point' may be actually printed on the medium 1000, or may not be printed.

Referring to FIG. 6, one unit cell is shown as having a total of 7 horizontal imaginary lines and 7 vertical imaginary lines, of which the horizontal reference codes are arranged on the horizontal imaginary line placed at the top. It is shown that the vertical reference codes are arranged on the leftmost vertical imaginary line.

Reference codes are placed on virtual reference points. In particular, the reference codes are arranged so that their center of mass is at the virtual reference point. That is, the horizontal reference codes and vertical reference codes are arranged so that the virtual reference point is located at the center of both ends of each reference code. Additionally, the intersection reference code having a cross-shaped geometric shape is arranged so that the center of the cross is at the virtual reference point.

Information codes are also placed on virtual reference points. In particular, information codes, unlike reference codes, are arranged so that their center of mass is not located at a virtual reference point. In other words, the virtual reference point is not located at the center of both ends of the information codes. In the case of an information code, one end of both ends is placed near the virtual reference point, and the other end is determined according to the value to be encoded in the information code. , it is placed in a location different from the virtual reference point. This will be explained in detail in the method of encoding information in information codes.

A code pattern having the above-described form and components is formed on the medium 1000, and the code pattern actually formed on the medium 1000 may be implemented by printing or a similar method. At this time, when the code pattern is printed on the medium 1000, as shown in FIG. 7, only the above-described reference code and information code can be printed. That is, among the components constituting the above-described code pattern, horizontal virtual lines, vertical virtual lines, and virtual reference points may not be actually printed.

2. Encoding/Decoding of Information

The basic principle of encoding information in an information code is to place one end of the information code near a virtual reference point, and place the other end of the information code so that the information code passes through the virtual reference point. The desired information is encoded in the corresponding information code using the relationship with the end.

That is, the direction of the information code (hereinafter referred to as the direction of the information code) from one end of the information code (the end disposed closer to the virtual reference point) to the other end (the end disposed farther from the virtual reference point). ), encode the desired information in the corresponding information code.

The method of encoding information in the information code is explained in more detail. However, for convenience of explanation, an example will be given where the information that can be encoded in one information code is 2 bits.

Figure 8 is a diagram for explaining a method of encoding 2 bits of information in an information code according to embodiments of the present invention.

For clear explanation, the virtual reference point where the information code to encode information is to be placed is taken as the origin, and a rectangular coordinate system defined in the directions of the horizontal and vertical reference codes provided in the unit cell is assumed.

At this time, when the information to be encoded through the information code is '00', one end of the information code (the end located closer to the virtual reference point) is in the third quadrant of the Cartesian coordinate system, and the other end (the end located closer to the virtual reference point) is in the third quadrant of the Cartesian coordinate system. The end located further away from the virtual reference point) can determine the direction of the information code so that it can be located in the first quadrant of the Cartesian coordinate system (see (a) of FIG. 8).

If the information to be encoded through the information code is '01', one end of the information code (the end located closer to the virtual reference point) is in the fourth quadrant of the Cartesian coordinate system, and the other end (the end located closer to the virtual reference point) is in the fourth quadrant of the Cartesian coordinate system. The end (which is located further away from) can determine the direction of the information code so that it can be located in the second quadrant of the Cartesian coordinate system (see (b) of FIG. 8).

In addition, when the information to be encoded through the information code is '10', one end of the information code (the end located closer to the virtual reference point) is in the first quadrant of the Cartesian coordinate system, and the other end (the end located closer to the virtual reference point) is in the first quadrant of the rectangular coordinate system. The end located further away from the virtual reference point) can determine the direction of the information code so that it can be located in the third quadrant of the Cartesian coordinate system (see (c) of FIG. 8).

In addition, when the information to be encoded through the information code is '11', one end of the information code (the end located closer to the virtual reference point) is in the second quadrant of the Cartesian coordinate system, and the other end (the end located closer to the virtual reference point) is in the second quadrant of the rectangular coordinate system. The end located further away from the virtual reference point) can determine the direction of the information code so that it can be located in the fourth quadrant of the Cartesian coordinate system (see (d) in FIG. 8).

If, as shown in Figure 8, the information code is designed to encode 2 bits of information in the information code, and as shown in Figures 6 and 7, one unit cell contains 36 information codes If so, the information that can be encoded in one unit cell could be 2bit*36=72bit.

However, the method of encoding information in the information code according to embodiments of the present invention is from one end of the information code (e.g., an end located closer to the virtual reference point) to the other end of the information code (e.g., an end located closer to the virtual reference point). For example, the number of bits of information that can be encoded in the information code is not limited to 2 bits and may be 3 bits or more, as it is encoded by the direction toward the end located further away from the virtual reference point. For example, in order to encode information into an information code, if the direction of the information code is interpreted in 45-degree increments, there are a total of 8 distinct directions of the information code, and accordingly, a total of 3 bits of information are contained in one information code. Encoding is possible.

3. Configuration of unit cell information

Next, the information encoded in the unit cell will be described.

Unit cell information encoded in the unit cell may include error verification information, medium identification information, coordinate information, and other additional information.

Error verification information is information for determining whether an error occurred when encoding a unit cell.

The medium identification information is identification information for the medium 1000 in which the unit cell is provided. Medium identification information may include book information, page information, etc.

Book information refers to identification information given to the notes or books when a plurality of media 1000 are manufactured in the form of notes or books.

Page information is used to identify which page of the note or book the medium 1000 on which the unit cell is provided is located when a plurality of mediums 1000 are manufactured in the form of a notebook or book. It means information.

In addition, if Medium (1000) is implemented to have a special format according to a special purpose (e.g., paper containing a security check checklist, test paper, etc.), the Medium identification information is provided by the Medium (1000). It may contain information to identify what format it has.

Coordinate information refers to two-dimensional coordinate information indicating where the unit cell is located on the medium 1000 in which the unit cell is provided. Accordingly, the coordinate information may include x-coordinates and y-coordinates.

Other additional information may include various other necessary information. For example, license information about coordinate codes provided to Medium 1000 may be included in the other additional information.

As described above, the electronic pen 2000 analyzes at least one unit cell included in the image acquired through the pattern detection unit 2300 and decodes the information encoded in the unit cell, Cell information can be obtained, and accordingly, medium identification information, coordinate information, and other additional information included in the unit cell information can be obtained.

4. Creation of pen data

Next, a method for the electronic pen 2000 to generate pen data based on unit cell information will be briefly described.

Pen data refers to information used to reproduce the user's handwriting trajectory in real time or generate stroke data necessary for later replay, in addition to unit cell information acquired by the electronic pen 2000.

Pen data may include visual information, pen pressure information, location information, and medium identification information.

Visual information is information about the point in time when an image used to generate one unit pen data is acquired or the point in time when one unit pen data is generated.

Pen pressure information is pressure information output from the pressure sensor 2520 at the time when an image used to generate one unit pen data is acquired or at the time when one unit pen data is generated.

Since the medium identification information is the same or similar to the information included in the unit cell information, detailed description is omitted.

The position information is information about the position of the electronic pen 2000 with respect to the medium 1000, which is generated by performing a necessary correction on coordinate information obtained from unit cell information. The location information may or may not match coordinate information obtained from unit cell information, and the method of generating location information will be described in detail below.

FIG. 9 is a diagram illustrating a method of generating location information of an electronic pen for a medium according to embodiments of the present invention.

Referring to FIG. 9, an image (I) acquired by the camera module 2320 of the electronic pen 2000 is shown as an example. As shown in FIG. 9, the acquired image (I) includes at least one More than one unit cell (UC) may be included, and the position (CC) of the unit cell (UC) may be obtained in the form of coordinates by analyzing the information encoded in the unit cell by the above-described method. At this time, as shown, since the unit cell (UC) used to interpret the coordinate information may not be located in the center of the acquired image (I), the unit cell (UC) obtained by interpreting the unit cell (UC) The coordinate information may be slightly different from the exact location of the electronic pen 2000 with respect to the medium 1000. In other words, it can be assumed that the center (IC) of the acquired image (I) is closest to the position of the electronic pen 2000 with respect to the medium 1000, and the center (IC) of the acquired image (I) is the unit cell It may be different from the coordinates (x,y) obtained by coordinate information obtained from (UC).

Accordingly, the electronic pen 2000 uses the coordinate information obtained from the unit cell (UC) and the acquired image ( Obtained by calculating the offset between the centers (IC) of I) and adding or subtracting the calculated offset value (?x, ?y) to the coordinate information (x, y) obtained from the unit cell (UC). The coordinates (x', y') of the center (IC) of the image (I) are calculated.

In the same manner as described above, the position of the electronic pen (2000) with respect to the medium (1000) can be calculated more accurately, and the coordinate values (x', y') corrected in the above manner are the above-mentioned location information. am.

As described above, the electronic pen 2000 can continuously generate pen data, and accordingly, the position movement of the electronic pen 2000 relative to the medium 1000 according to the user's handwriting is performed in real time in the form of pen data. It can be recorded, and the pen data can be appropriately processed later as needed by the electronic device 3000 or the server 4000.

<Operation of electronic devices>

As described above, when pen data is generated, the electronic pen 2000 can store the pen data in the memory 2600 or transmit the pen data to the electronic device 3000 through the communication unit 2400.

For example, when the electronic pen 2000 is capable of communicating with the electronic device 3000, the electronic pen 2000 can generate pen data and immediately transmit the pen data to the electronic device 3000 in real time. If the electronic pen 2000 is not in a state in which it can communicate with the electronic device 3000, the electronic pen 2000 creates pen data and stores it in the memory 2600, and then becomes capable of communicating with the electronic device 3000 at a later time. When , the stored pen data can be transmitted to the electronic device 3000.

Below, the operation of the electronic device 3000 that has received pen data will be described.

1. Real-time reproduction of content written by the user #1

Based on the pen data received from the electronic pen 2000, the electronic device 3000 can reproduce in real time what the user is writing in the medium 1000 and display it on the display of the electronic device 3000. Below, we will explain how to reproduce the user's notes in real time and display them on the display.

For the following explanation, it is assumed that the electronic pen 2000 and the electronic device 3000 are connected in a state capable of communicating with each other, and the electronic pen 2000 transmits the pen data generated as described above in real time to the electronic device ( 3000).

The electronic device 3000 may obtain information about the target medium 1000 on which the user is writing based on medium identification information included in pen data received from the electronic pen 2000.

For example, the electronic device 3000 determines whether the target medium 1000 on which the user is writing is a medium with a specific format for a special purpose, or a medium that forms part of a product provided in the form of a book or note. You can check whether it is recognized or not.

In addition, if the target medium (1000) is a medium that forms part of a product provided in the form of a book or note, it is possible to check whether the target medium (1000) is located on which page of the book or note. there is.

Based on the acquired medium identification information, the electronic device 3000 displays, through a display, a template previously stored for the target medium 1000 or handwriting content already written by the user for the target medium 1000. You can.

At this time, the pre-stored template for the target medium 1000 means that it includes text, images, shapes, symbols, etc. that have already been printed on the target medium 1000 in addition to the code pattern, for example, When the target medium 1000 forms part of a note, a plurality of lines may be printed on the target medium 1000 to facilitate the user's writing, and information such as that such a plurality of lines are printed may be provided. It may be included in the template information for the target medium 1000 that was previously stored. As another example, if the target medium (1000) forms part of a notebook in the form of a diary, the target medium (1000) may have a specific date printed on it, such as February 1, 2015. Special information printed at 1000 may also be included in the predetermined template information. Hereinafter, for convenience, the image displayed for the target medium 1000, which includes the above-described template information, etc., may be referred to as a medium image.

Next, the electronic device 3000 may generate stroke data corresponding to the user's writing trajectory to be displayed on the display based on the location information and time information included in the received pen data. To generate stroke data, at least one unit of pen data may be used.

When stroke data is generated, according to the generated stroke data, the electronic device 3000 can reproduce the trace written by the user for the target medium 1000 at the corresponding position on the predetermined template displayed on the display. . FIG. 10 shows that the content written by the user on the target medium 1000b is reproduced in real time on the display of the electronic device 3000.

When the user's handwritten content is reproduced through the electronic device 3000, the trajectory of the user's handwritten content, the location of the target medium 1000 of the user's handwritten content, etc. are location information included in the pen data information. Based on this, it can be accurately reproduced.

Hereinafter, for convenience of explanation, the operation of the electronic device 3000 according to an embodiment of the present invention that reproduces the user's handwriting in real time may be referred to as operating in a 'general reproduction mode'.

2. Real-time reproduction of content written by the user #2

Next, another embodiment of reproducing in real time what the user is writing on the target medium 1000 will be described.

Figures 11 to 15 are diagrams for explaining another embodiment of reproducing the user's handwriting in real time according to the present invention.

While the user is using the electronic device 3000 according to an embodiment of the present invention, the entire surface of the target medium 1000 on which the user is currently writing is completely covered by the electronic device 3000. However, in some cases, only a part of the surface of the target medium 1000 may be desired to be displayed through the electronic device 3000.

Hereinafter, at least a portion of the area displayed through the electronic device 3000 among the medium image corresponding to the target medium 1000 is referred to as a display area. Additionally, 'a partial area (or display area) of the target medium is displayed' may mean that an area corresponding to a partial area of the target medium among the entire area of the medium image is displayed on the display as the display area.

FIG. 11 exemplarily shows that only a partial area of the target medium 1000 is displayed through the electronic device 3000.

At this time, if the user writes in an area other than the partial area displayed through the electronic device 3000, the contents of the user's writing are displayed in real time through the electronic device 3000, as described above. What is reproduced may not be displayed on the display. For example, as shown in FIG. 12, when the user writes 'EFG' to the right of 'ABCD', the user continues to write 'EFG' to the right of 'ABCD' through the electronic device 3000 in some areas set as shown in FIG. 11. When displayed, the content corresponding to 'E' that the user is additionally writing cannot be viewed through the electronic device 3000.

Another embodiment of the present invention that reproduces the user's handwriting in real time is proposed to solve the problem.

The electronic device 3000 can confirm the location of the content currently being written by the user in the target medium 1000 (hereinafter referred to as the writing location) based on the received pen data.

Next, the electronic device 3000 may determine whether the confirmed writing position satisfies predetermined conditions for the current display area.

For example, the electronic device 3000 may determine whether the writing position corresponds to a position outside the display area. At this time, when the electronic device 3000 determines that the writing position is outside the display area, it may determine that the predetermined condition is satisfied.

For another example, the electronic device 3000 may determine whether the confirmed writing position corresponds to an edge area of the current display area. That is, the electronic device 3000 can determine whether the writing position corresponds to an edge area of the display area even if it is included in the current display area. At this time, when the electronic device 3000 determines that the writing position corresponds to an edge area of the display area, it may determine that the predetermined condition is satisfied.

If the electronic device 3000 determines that the writing position does not satisfy the predetermined condition (for example, if it is determined that the writing position is included in the display area), the electronic device 3000 determines that the writing position does not satisfy the predetermined condition, as shown in FIG. 12. As described above, without shifting the display area, 'E', which is content corresponding to the content written by the user, can be reproduced through the electronic device 3000 and displayed on the display.

On the other hand, when the electronic device 3000 determines that the writing position satisfies a predetermined condition (for example, when it is determined that the writing position is outside the display area), the electronic device 3000 responds to the writing position. The position of the display area can be shifted so that the desired position can be displayed on the display of the electronic device 3000.

For example, if 'ABCDE' is written as shown in FIG. 12 and the user additionally writes 'F', the electronic device 3000 shifts the display area as shown in FIG. 13, Content corresponding to the user's handwriting can be reproduced in the shifted display area.

Various methods can be applied to how the electronic device 3000 shifts the position of the display area.

For example, the electronic device 3000 may determine a direction in which to shift the position of the display area by considering the writing direction of the contents written by the user.

Figure 13 shows that the position of the display area has been shifted in the same direction as the writing direction of 'ABCDE', which is the content the user was writing.

For another example, the electronic device 3000 may shift the position of the display area so that the content of handwriting written beyond the original display area is displayed in the center of the shifted display area.

FIG. 14 shows that the display area has been shifted so that 'F', which is written beyond the position of the original display area, can be located in the center of the shifted display area.

As another example, the electronic device 3000 may shift the position of the display area by considering the distance and direction between the content written immediately before and the content of the handwriting written outside the original display area.

For another example, the electronic device 3000 may consider the edges of the media image when shifting the position of the display area. For example, the position of the display area can be shifted so that the edge of the media image does not exceed a predetermined area of the display screen. That is, the position of the display area can be shifted so that the edge of the media image does not exceed the edge area of the display screen. In other words, the position of the display area can be shifted so that the edge of the preview image is not displayed more than a predetermined distance from the edge area of the display screen.

Meanwhile, the electronic device 3000 considers pen data received from the electronic pen 2000 to determine whether the writing position satisfies predetermined conditions. The electronic device 3000 checks the writing position. Various methods can be applied to sample pen data for.

For example, the electronic device 3000 determines whether the writing position satisfies a predetermined condition for the partial area (for example, whether the writing position is outside the display area) for all unit pen data. can do. In this case, the electronic device 3000 will be able to reproduce the user's handwriting through the electronic device 3000 as close to real-time reproduction as possible, but a problem may arise in which the amount of calculation increases.

For another example, the electronic device 3000 may determine whether the writing position of at least some of the pen data that can be grouped in stroke units satisfies a predetermined condition for the display area.

A stroke refers to a line drawn on a writing surface by a pen after the pen touches the writing surface until the pen leaves the writing surface, and can also be called a 'stroke'. That is, 'A' typically consists of 3 strokes, 'B' typically consists of 2 strokes, 'C' typically consists of 1 stroke, and 'D' typically consists of 2 strokes. 'E' is generally composed of three strokes. Hereinafter, for convenience of explanation, the action of the user contacting the electronic pen 2000 with the target medium 1000 to write one stroke is called 'pen down', and the action of writing one stroke is called 'pen down'. The action of the user removing the electronic pen 2000 from the target medium 1000 is referred to as 'pen up'.

At this time, the electronic pen 2000 generates the pen data by including the pen pressure sensed through the pressure sensor in the pen data, and the generated pen data is transmitted to the electronic device 3000, so the electronic device 3000 uses the pen Using the pen pressure value included in the data, it is possible to determine whether the pen is 'pen down' or 'pen up'. That is, if the pen pressure value suddenly increases from '0' to a specific value while receiving pen data, the electronic device 3000 may determine that 'pen down' occurred at the time the pen pressure value suddenly increased. For convenience, this point will be defined as the ‘pen down point’. Additionally, when the pen pressure value suddenly becomes '0' while receiving pen data, the electronic device 3000 may determine that 'pen up' has occurred at the point when the pen pressure value suddenly becomes '0'. For convenience, this point will be defined as the ‘pen-up point’.

The electronic device 3000 can determine whether the writing position satisfies a predetermined condition for the display area using the position information included in the pen data corresponding to the pen down time among the pen data grouped in stroke units. (hereinafter referred to as pen down-based shift method). In this case, the electronic device 3000 uses only the writing position at the time of pen down, and the position information included in the remaining pen data among the plurality of pen data groups grouped in stroke units determines the writing position in advance for the display area. It may not be used when determining whether a set condition is satisfied.

Meanwhile, the electronic device 3000 determines whether the writing position satisfies the predetermined condition for the display area using the position information included in the pen data corresponding to the pen up time among the pen data grouped in stroke units. Can be judged (hereinafter referred to as pen up-based shift method). In this case, the electronic device 3000 uses only the writing position at the time of pen up, and the position information included in the remaining pen data among the plurality of pen data groups grouped in stroke units determines the writing position in advance for the display area. It may not be used when determining whether a set condition is satisfied.

Alternatively, the electronic device 3000 uses all of the position information included in the pen data corresponding to the pen up and pen down times among the pen data grouped in stroke units to determine the writing position in a predetermined location for the display area. It can be determined whether the conditions are satisfied (hereinafter referred to as hybrid shift method). In this case, the electronic device 3000 may use only the writing positions at the time of pen down and pen up and may not use the remaining pen data.

If the pen down-based shift method is used, the display area only shifts when the pen is down, so the starting point of the stroke entered by the user is included in the original display area, but the end point of the stroke is within the original display area. If it is outside the display area, the shift according to the present invention may not occur. That is, as shown in FIG. 15, even after the user completes the stroke (S), the starting point (SP) of the stroke (S) was included in the original display area, so the end point (SP) of the stroke (S) Even if EP) is outside the original display area, a screen such as (b) in FIG. 15 may be displayed through the display of the electronic device 3000 even at the pen up time (Tup).

If the pen up-based shift method only shifts the display area at the time of pen up, if the user inputs one stroke for a long time (for example, one stroke for about 5 seconds) is input), the electronic device 3000 may not perform the shift operation before the user's stroke input ends.

If the hybrid shift method is used, the advantages of both the pen-down-based shift method and the pen-down-based shift method can be taken.

Meanwhile, in the method of determining the writing position using some of a plurality of pen data that can be grouped in stroke units and performing a shift operation accordingly, as described above, pen data at the time of pen down and pen up There may be various methods other than the method of using pen data at the point of view, pen down, and pen up, for example, determining the writing position using pen data selected according to a predetermined time interval. There may be ways to do this. In other words, pen data at the time of pen down, pen data at 0.05 seconds after pen down, pen data at 0.10 seconds after pen down, and pen data at 0.15 seconds after pen down, etc. are collected to determine the writing position. There may be a method for making a judgment, etc. (if the predetermined time interval is 0.05 seconds).

The electronic device 3000 can determine whether at least one shift operation is performed for one stroke. That is, for each stroke, the electronic device 3000 can determine whether the predetermined condition is satisfied using at least one pen data among a plurality of pen data included in the stroke. In other words, the electronic device 3000 includes pen data (first pen data) corresponding to the pen down time and pen data (second pen data) and first pen data corresponding to the pen up time constituting one stroke. It is possible to determine whether the predetermined condition is satisfied using at least one pen data among all pen data between and the second pen data.

As described above, according to another embodiment in which the contents written by the user on the target medium 1000 are reproduced in real time, the screen of the electronic device 3000 is enlarged, so that only the display area of the target medium 1000 is displayed. Even when it is displayed through a display, the effect of being able to reproduce the content the user is writing in real time and display it through the display of the electronic device 3000 occurs.

Hereinafter, for convenience of explanation, the operation of the electronic device 3000 according to another embodiment of the present invention that reproduces the user's handwriting in real time may be referred to as operating in an 'enlarged reproduction mode'.

3. Real-time reproduction of content written by the user #3

Hereinafter, for convenience of explanation, a mode in which only a partial area of the target medium 1000 is displayed through the electronic device 3000 may be referred to as an 'enlarged mode', and the entire area of the target medium 1000 may be referred to as an 'enlarged mode'. All of these modes displayed through the electronic device 3000 can be referred to as 'normal mode'.

In order to reproduce the user's handwriting in real time according to the present invention, the electronic device 3000 may operate in the above-described 'normal reproduction mode' or in the 'enlarged reproduction mode'.

For example, the electronic device 3000 determines whether the current display mode of the electronic device 3000 is 'normal mode' or 'enlarged mode', and reproduces the user's handwriting in real time according to the determination result. You can operate by selecting the mode to do so. That is, when the display mode of the electronic device 3000 is 'normal mode', the electronic device 3000 reproduces the user's handwriting in real time according to the above-described 'general reproduction mode', and the electronic device 3000 If the display mode is 'enlarged mode', the user's handwriting can be reproduced in real time according to the 'enlarged reproduction mode' described above.

In this way, when the reproduction mode is selectively set and operated, the 'enlarged reproduction mode', which requires relatively more calculations, is applied only when the screen is enlarged and displayed. As a result, it is possible to operate in 'general reproduction mode' with less calculation amount, which has the effect of being able to reproduce the user's handwriting in real time more effectively and efficiently.

4. Replay of written content #1

Based on the pen data received from the electronic pen 2000, the electronic device 3000 can later replay what the user is writing in the medium 1000 and display it on the display of the electronic device 3000. Below, we will explain how to replay and display what the user is writing on the display in real time.

For the following explanation, it is assumed that the electronic pen 2000 and the electronic device 3000 receive and store pen data related to what the user wrote on the target medium 1000 using the electronic pen 2000. do.

The electronic device 3000 can detect whether a predetermined event for replaying the user's handwriting has occurred.

For example, the predetermined event may be a user request. That is, the electronic device 3000 can provide a user interface (UI) through which the user can request a replay of the handwritten content, and the user can write the handwriting through the user interface. A replay of the content may be requested, and accordingly, the electronic device 3000 may determine that a predetermined event has occurred and perform a replay operation of the written content according to the present invention.

For another example, the predetermined event may be a request from the operating system (OS) of the electronic device 3000 or another application installed on the electronic device 3000.

For another example, the predetermined event may meet a predetermined condition. That is, when a predetermined condition of 'reaching a specific time' is set, the electronic device 3000 monitors the current time, determines whether the 'specific time' of the predetermined condition has been reached, and determines whether the 'specific time' of the predetermined condition has been reached. In this case, it is determined that a predetermined event has occurred, and a replay operation for the user's handwriting according to the present invention can be performed. The predetermined condition is not limited to the 'time' condition as in the above-mentioned example, and may be set in various forms.

When the predetermined event occurs, the electronic device 3000 may determine target content for performing a replay operation on the handwritten content.

For example, the electronic device 3000 may store all pen data for the contents written by the user on the Medium 1000 using the electronic pen 2000, and among these written contents, a replay operation may be performed. You can decide what writing you want to do. In other words, if the target medium 1000 is provided in a form such as a note, the electronic device 3000 stores all of the content written by the user on a plurality of pages of the note in the form of pen data (or stroke data form). It may be stored, and at this time, the electronic device 3000 can determine which page (one page or multiple pages) among the plurality of pages to perform a replay operation, or, within the same page, any specific page of the page. You can decide whether to perform a replay operation on the content written in the area.

The electronic device 3000 may consider the predetermined event when determining the content to be replayed.

For example, if the predetermined event is a user's request, the replay target content may be determined according to the user's request. For another example, if the predetermined event is a request from an operating system or another application, the replay target content may be determined by considering the request.

Once the content to be replayed is determined, the section to be replayed can be determined. For example, when the electronic device 3000 determines a specific page of a note as a replay target section as the replay target content, a plurality of strokes written on the determined specific page are determined as a replay target, and the replay target section is the plurality of strokes. It is defined by the strokes subject to replay and the temporal relationship between the strokes subject to replay. Below, the replay target section will be described in more detail.

Figure 16 is a diagram for explaining a section subject to replay according to the present invention. Referring to FIG. 16, the replay section (RS) according to the present invention includes a stroke section (SS) and a gap section (GS). In particular, Figure 16 shows that the replay target section (RS) includes the first to fourth stroke sections (SS1, SS2, SS3, SS4) and the first to third sections (GS1, GS2, GS3). It is done.

In the present invention, for convenience of explanation, the replay target section is defined as the time taken by the user to write down the replay target.

In other words, the replay target section is defined as the time interval from the time the user begins writing the first stroke of the target handwriting for which replay is requested to the time the user finishes writing the last stroke of the target handwriting. do. For example, when the replay target section is determined as shown in FIG. 16, the length of the replay target section (RS) is (t8-t1).

The stroke section is defined as the time it takes for a user to input one stroke when writing. That is, as described above, the time from the point of pen down on the target medium 1000 to the point of pen up from the target medium 1000 in order to input one stroke is defined as the stroke section. For example, in the case shown in FIG. 16, the length of the first stroke section SS1 is (t2-t1), the length of the second stroke section SS2 is (t4-t3), and the third stroke section ( The length of SS3) is (t6-t5), and the length of the fourth stroke section (SS4) is (t8-t7).

The interval between strokes (GS) is defined as the time from when a user inputs one stroke when writing to inputting another stroke immediately following the input stroke. In other words, the time from the pen-up point of the inputted stroke to the pen-down point of the next input stroke is defined as the interval (GS). For example, in the case shown in FIG. 16, the length of the first interval GS1 is (t3, t2), the length of the second interval GS2 is (t5-64), and the third interval ( The length of GS3) is (t7-t6).

When defining the interval section (GS), it was explained that it is defined by the relationship between two strokes. At this time, the two strokes to define the interval section are defined by the relationship between the strokes included in the replay target content determined as the replay target. The decision will be made in writing, and strokes not included in the replay will not be considered. For example, one stroke (stroke A) is written in a first area (e.g., page x of Note A) and in fact the next stroke (stroke B) is recorded in the second area (e.g. page), and then the next stroke (stroke C) is written again in the first area, if only page x is selected as the content to be replayed and page y is not selected, stroke B is included in the content to be replayed. Since it has not been done, it is not considered in defining the above-mentioned interval (GS). That is, in this case, not only does the stroke section defined by stroke B not exist in the replay target section, but the interval between strokes A and stroke B and the interval between strokes B and stroke C are also not defined, Only the interval between stroke A and stroke C can be defined.

Subsequently, the electronic device 3000 may obtain pen data for strokes included in the replay target content from the memory module 3400 and generate replay data based on the acquired pen data. Replay data is data generated to perform a replay operation of replaying the content written by a user according to the present invention, and may be data generated by sampling pen data for strokes. In addition, replay data can be interpreted in a very comprehensive sense, including the position of strokes for display on the display, the display order between strokes, and timing information for displaying strokes, when performing a replay operation.

The electronic device 3000 then performs a replay operation according to the present invention based on the replay data.

Below, the replay operation will be described in more detail.

In the replay operation of the user's handwritten content according to an embodiment of the present invention, the playback time of the replay is different from the time taken by the user to write the content to be replayed.

For example, a specific page may be selected as the content to be replayed, part of the content included in the specific page selected as the content to be replayed may be written at 10 a.m., and another part of the content included in the specific page may be written at 8 p.m. In this case, the time it takes for the user to write down the content to be replayed is 10 hours, but when replaying the written content according to an embodiment of the present invention, the replay is played. Time can be minutes. That is, the replay playback time of the replay target section may be shorter than the writing time (length of the replay target section) of the replay target section.

For another example, a specific word may be selected as the content to be replayed, and the time it takes for the user to actually write the specific word selected as the content to be replayed is 2 seconds, but the playback time of the replay for that word is 2 seconds. It may be 2 seconds or longer. In other words, the replay playback time of the replay target section may be longer than the writing time (length of the replay target section) of the replay target section.

(1) Determination of replay playback time of stroke section

The electronic device 3000 may determine the replay playback time of strokes included in the replay target content.

<Relationship between stroke section length and replay playback time>

According to some embodiments of the present invention, the electronic device 3000 may determine the replay playback time for each stroke by considering the time taken for the strokes to be replayed to be actually written.

FIG. 17 is a diagram showing the replay playback time determined according to an embodiment of the present invention for the replay target section (RS) as shown in FIG. 16.

Referring to FIG. 17, the lengths of the first to fourth stroke replay playback times (SR1, SR2, SR3, and SR4) for each of the first to fourth stroke sections (SS1, SS2, SS3, and SS4) are respectively It is shown that it is determined in proportion to the length of the first to fourth stroke sections (SS1, SS2, SS3, and SS4). In this way, the electronic device 3000 may determine the replay playback time for the strokes to be replayed by considering the time taken for the strokes to be replayed to actually be written.

However, in Figure 17, an example is shown in which the replay playback time for each stroke is determined so that the replay playback time is proportional to the length of each stroke section, but it does not necessarily have to be determined proportionally, and the replay playback is performed for each section. Time may be determined. For example, by dividing the time taken to actually write each stroke into sections and corresponding different replay playback times to different sections, the replay playback time for each stroke is It may be decided. That is, for two strokes, even if the actual length of the stroke section is slightly different, when the two strokes are classified into the same section, the replay playback time for the two strokes can be determined to be the same. In addition, Figure 17 shows that only the length of the stroke section is considered in determining the replay playback time for each stroke. However, in determining the replay playback time, not only the length of the stroke section is considered, but the stroke section is The replay playback time may be determined by further considering the length of . A method of considering the length of the stroke when determining the replay playback time will be described later.

In contrast, the electronic device 3000 may determine the same replay playback time for strokes subject to replay.

For example, the electronic device 3000 may determine the replay playback time for each stroke without considering the time it takes for the strokes to be replayed to actually be written.

At this time, the electronic device 3000 may determine a predetermined replay playback time as the replay playback time for each of the replay target strokes, regardless of the time it takes to actually write down the replay target strokes. In other words, the replay playback time determined for all strokes included in the replay target content may all be the same.

Figures 18 and 19 are diagrams showing the replay playback time determined according to another embodiment of the present invention for the replay target section (RS) as shown in Figure 16.

Referring to FIG. 18, the lengths of the first to fourth stroke replay playback times (SR1, SR2, SR3, and SR4) for each of the first to fourth stroke sections (SS1, SS2, SS3, and SS4) are the same. What has been decided is shown. In this way, the electronic device 3000 can determine the replay playback time for the strokes to be replayed without any consideration of the time taken for the strokes to be replayed to be actually written.

However, in Figure 18, it is explained that when determining the replay playback time for each stroke, the replay playback time is determined to be the same for all strokes without taking the length of the stroke section into consideration at all. However, at this time, considering the length of the stroke The replay playback time may be determined, and if the replay playback time is determined considering the length of the stroke, the replay playback time for each stroke will be different. A method of considering the length of the stroke when determining the replay playback time will be described later.

Meanwhile, in FIG. 18, the similarly determined replay playback time is shown as a 'time duration', but the determined replay playback time may also be determined as a single 'time point'.

For example, as shown in FIG. 19, when replaying strokes of the first to fourth stroke sections (SS1, SS2, SS3, and SS4), the electronic device 3000 plays the first stroke at the first point in time. The strokes corresponding to the stroke section (SS1) are displayed at once, the strokes corresponding to the second stroke section (SS2) are displayed at the same time at the second time, and the strokes corresponding to the third stroke section (SS3) are displayed at the third time. It is possible to display them all at once, and at the fourth viewpoint, the strokes corresponding to the fourth stroke section (SS4) can be displayed all at once. Here, the meaning of displaying a stroke all at once can be understood to mean that all the points that make up the stroke are displayed on the display at the same time.

That is, Figure 18 relates to an embodiment in which the points constituting each stroke are sequentially displayed on the display as the determined replay progresses, and Figure 19 shows the dots constituting the strokes displayed all at once on the display. This relates to examples.

Above, the relationship between the length of the stroke section and the replay playback time determined for it has been explained. Below, the relationship between the length of the stroke (the physical length of the stroke actually written by the user) and the replay playback time determined accordingly will be described.

<Relationship between stroke length and replay playback time>

According to some other embodiments of the present invention, the electronic device 3000 may determine the replay playback time for each stroke by considering the length of the strokes to be replayed.

20 to 24 are diagrams for explaining some other embodiments of determining a replay playback time to replay a stroke written by a user according to some other embodiments of the present invention.

Referring to FIG. 20, it shows that the first to fourth strokes S1, S2, S3, and S4 are written on the target medium 1000.

For convenience of explanation, the first stroke (S1) is written by the user during the first stroke section (SS1) shown in FIG. 16, and the second stroke (S2) is written by the user during the first stroke section (SS1) shown in FIG. 16. (SS2) is written by the user during the third stroke section (SS3) shown in FIG. 16, and the fourth stroke (S4) is written by the user during the third stroke section (SS3) shown in FIG. 16. It is assumed that the writing was written by the user during the fourth stroke section (SS4).

In addition, for convenience of explanation, the lengths of each of the first to fourth strokes S1, S2, S3, and S4 are referred to as SL1, SL2, SL3, and SL4, and similarly as shown in the drawing, SL4>SL1 Assume that the relationship >SL3>SL2 holds.

Here, the length of the stroke may be understood to mean the physical length of the stroke actually written by the user on the target medium 1000. However, at this time, the length may be understood as an absolute length, but may also be understood as a relative length between strokes.

At this time, the electronic device 3000 may determine the replay playback time for each stroke by considering the length of the strokes included in the replay target content.

FIG. 21 shows the replay playback time determined according to some embodiments of the present invention for strokes S1, S2, S3, and S4 included in the replay target content as shown in FIG. 20.

Referring to FIG. 21, the length of the first to fourth stroke replay playback times (SR1, SR2, SR3, and SR4) for each of the first to fourth strokes (S1, S2, S3, and S4) is It is shown that it is determined in proportion to the length of the through fourth strokes S1, S2, S3, and S4. In this way, the electronic device 3000 may determine the replay playback time for the strokes to be replayed by considering the time taken for the strokes to be replayed to actually be written.

However, in Figure 21, an example is shown in which the replay playback time for each stroke is determined so that the replay playback time is proportional to the length of each stroke, but it does not necessarily have to be determined proportionally, and the replay playback time for each section is shown. This may be decided. For example, the replay playback time for each stroke may be determined by dividing the written length of each stroke into sections and corresponding different replay playback times to different sections. That is, for two strokes, even if the written length of the actual stroke is slightly different, if the two strokes are classified into the same section, the replay playback time for the two strokes can be determined to be the same. In addition, Figure 21 shows that only the written length of the stroke is considered in determining the replay playback time for each stroke, but in determining the replay playback time, only the written length of the stroke is not considered. , As described above, the replay playback time may be determined by further considering the length of the stroke section (the time it takes for the stroke to be actually written).

In contrast, the electronic device 3000 may determine the same replay playback time for strokes subject to replay, regardless of the written length of the strokes. That is, the electronic device 3000 can determine the replay playback time for each stroke without considering the written length of the strokes subject to replay.

FIGS. 22 and 23 are diagrams showing replay playback times determined according to some embodiments of the present invention for strokes subject to replay as shown in FIG. 20.

Referring to FIG. 22, the lengths of the first to fourth stroke replay playback times (SR1, SR2, SR3, and SR4) for each of the first to fourth strokes (S1, S2, S3, and S4) are all the same. What has been decided is shown. In this way, when determining the replay playback time for the strokes subject to replay, the electronic device 3000 may determine the replay playback time without considering the written length of the strokes subject to replay at all.

Meanwhile, in FIG. 22, the similarly determined replay playback time is shown as a 'time duration', but the determined replay playback time may also be determined as a single 'time point'.

For example, as shown in FIG. 23, when replaying the first to fourth strokes S1, S2, S3, and S4, the electronic device 3000 plays the first stroke at the first time. Display the replay for (S1) all at once, display the replay for the second stroke (S2) all at once at the second time, display the replay for the third stroke (S3) at the same time at the third time, and display the replay for the third stroke (S3) at the same time at the fourth time. The replay for the fourth stroke (S4) can be displayed all at once.

(2) Determination of replay playback time of the section in between

The electronic device 3000 may determine the replay playback time of the interval between strokes included in the replay target content.

According to some embodiments of the present invention, when the user actually writes down the replay target strokes, the electronic device 3000 considers the actual time interval between strokes and determines the replay playback time for each interval. You can. According to some embodiments of the present invention, the method of determining the replay playback time for the intervals is almost the same as the method of determining the replay playback time for the stroke section with or without considering the length of the stroke section described above. Since they are similar, only a brief explanation is provided.

This will be described again with reference to FIGS. 16 to 19.

Referring to FIG. 17, the lengths of the first to third section replay playback times (GR1, GR2, GR3) for each of the first to third sections (GS1, GS2, GS3) are respectively the first to third sections (GS1, GS2, GS3). It is shown that it is determined in proportion to the length of the sections (GS1, GS2, GS3) between 3. In this way, when reproducing content to be replayed, the electronic device 3000 may determine the replay playback time for the section between strokes by considering the stroke that occurred while actually writing and the time difference between the strokes.

However, the replay playback time determined for the interval does not necessarily have to be determined proportionally to the length of the interval, and may be determined separately for each section.

In contrast, the electronic device 3000 may determine the same replay playback time for sections between replay targets, as shown in FIG. 18. For example, the electronic device 3000 may determine the replay playback time for each stroke without considering the time it takes for the strokes to be replayed to actually be written.

(3) Determination of replay playback speed and replay playback time based thereon

Meanwhile, according to some embodiments of the present invention, the replay playback speed for the user's handwriting may be determined, and the electronic device 3000 may play the user's handwriting according to the determined replay playback speed. You can perform replay operations for .

The electronic device 3000 may determine the replay playback speed by considering the number of strokes included in the selected replay target section.

For example, the electronic device 3000 stores at least a first predetermined condition and a second predetermined condition in advance, checks the number of strokes included in the selected replay target section, and determines the number of strokes confirmed as the first predetermined condition. If it is below the predetermined condition, the first replay playback speed corresponding to the first preset condition may be determined as the replay playback speed for the selected replay target section, or the number of confirmed strokes exceeds the first preset condition. If it is below the predetermined condition, the second replay playback speed corresponding to the second preset condition may be determined as the replay playback speed for the selected replay target section. The electronic device 3000 may store more predetermined conditions than the first predetermined condition and the second predetermined condition, and each predetermined condition may be associated with a predetermined replay playback speed.

If the first preset condition is smaller than the second preset condition, the first replay playback speed corresponding to the first preset condition will be slower than the second replay playback speed corresponding to the second preset condition. You can. For example, when the first predetermined condition is 100 and the second predetermined condition is 200, the first predetermined replay playback speed may be slower than the second preset replay playback speed.

The electronic device 3000 may determine the replay playback time for the stroke section and the replay playback time for the interval between strokes, considering the determined replay playback speed.

When the first replay playback speed is faster than the second replay playback speed, the stroke section replay playback time determined when the determined replay playback speed is the first replay playback speed is determined when the determined replay playback speed is the second replay playback speed. The stroke section replay playback time may be shorter.

Similarly, if the first replay playback speed is faster than the second replay playback speed, the interval replay playback time determined when the determined replay playback speed is the first replay playback speed is determined when the determined replay playback speed is the second replay playback speed. It may be shorter than the interval replay playback time, which is determined when.

The process of determining the stroke section replay playback time based on the playback speed and the process of determining the between-section replay playback time based on the playback speed operate independently of each other, and when the speed becomes faster, the stroke section replay playback time is changed. At the same time as deciding to be shorter, the inter-section replay playback time may be determined to be shorter, but only one of the stroke section replay playback time and the inter-section replay playback time may be determined to be shorter.

(4) Determination of the total playing time of the replay and replay operation

Next, the electronic device 3000, for each of the strokes included in the selected replay target content and the intervals existing between the strokes, the length of the above-mentioned stroke interval, the length of the interval interval, and the written length of the stroke and playback speed, the playback time may be determined to determine the total playback time for the selected replay target content.

Next, according to the determined replay playback time, the electronic device 3000 performs a replay operation for the selected replay target content.

FIG. 24 is a diagram illustrating a screen in which content written by a user is replayed on a display according to an embodiment of the present invention.

The electronic device 3000 may replay strokes sequentially based on the stroke section determined according to the above-described content written by the user as shown in FIG. 20 and the replay playback time determined for the sections in between.

If, as described with reference to FIG. 21 or FIG. 22, the replay playback time for the stroke section and the replay playback time for the section in between are determined as 'time sections', the electronic device 3000 determines the first stroke During the playback time SR1, the points constituting the first stroke S1 can be displayed sequentially, and as a result, a screen such as (a) of FIG. 24 can be displayed through the display of the electronic device 3000. Subsequently, the electronic device 3000 maintains the screen as shown in (a) of FIG. 24 during the determined first interval replay time GR1, and then displays the second stroke S2 during the determined second stroke replay time SR2. The points constituting can be displayed sequentially, and as a result, a screen such as (b) of FIG. 24 can be displayed through the display of the electronic device 3000. In a similar manner, replay operations for the third and fourth strokes may be performed.

Meanwhile, as described with reference to FIG. 23, when the replay playback time for the stroke section is determined as 'time point', the electronic device 3000 displays the screen as shown in (a) of FIG. 24 at the first time point. After displaying on the display, the screen as shown in (a) of FIG. 24 is maintained during the determined first interval replay playback time (GR1), and as shown in (b) of FIG. 24 at the second time point. After displaying the same screen through the display, the screen as shown in (b) of FIG. 24 can be maintained for the determined second interval replay playback time (GR2). In a similar manner, replay operations for the third and fourth strokes may be performed.

Above, a replay operation for a user's handwriting according to some embodiments of the present invention has been described. In the above-described embodiments, in determining the replay playback time for the stroke section, when the stroke replay playback time is determined in proportion to the length of the stroke section, the replay playback time for the section between sections is also proportional to the length of the section between sections. It is shown in Figure 17 that the replay playback time for the between section is determined, and when the stroke replay playback time is determined to be the same regardless of the length of the stroke section, the replay playback time for the between section is also determined regardless of the length of the between section. Although they are shown in FIG. 18 to be determined in the same way, the operation of determining the replay playback time for the stroke section and the operation of determining the replay playback time for the section in between are independent of each other, and must be performed as shown in FIGS. 17 and 18, etc. It is not limited to the bar, and even if the replay playback time for the stroke section is determined depending on the length of the stroke section, an embodiment in which the replay playback time for the between section is determined regardless of the length of the between section is also possible. The opposite is also true.

5. Replay of written content #2

Hereinafter, based on the pen data received from the electronic pen 2000, the electronic device 3000 will later replay what the user is writing on the medium 1000 and display it on the display of the electronic device 3000. You can. Below, another method of replaying and displaying the user's notes on the display in real time will be described.

Hereinafter, for the following explanation, the electronic pen 2000 and the electronic device 3000 receive and store pen data regarding matters written by the user on the target medium 1000 using the electronic pen 2000. Assume that there is

The electronic device 3000 can detect whether a predetermined event for replaying the user's handwriting has occurred. Since the predetermined event has already been described above, detailed explanation is omitted here.

Next, the electronic device can determine the replay target content that the user wants to replay among the content written by the user. Since the content to be replayed and the determination of the content to be replayed have already been described above, detailed description will be omitted here.

The electronic device 3000 may determine the playback time of the replay operation after the replay target content is determined. At this time, the electronic device 3000 may check the number of strokes included in the replay target content and determine the playback time of the replay operation based on the confirmed number of strokes.

The electronic device 3000 may previously store the number of strokes to be played back per unit time in order to determine the playback time of the replay operation based on the number of confirmed strokes. For example, the electronic device 3000 may pre-store the number of strokes to be replayed for 1 second as 4. For another example, the electronic device 3000 may pre-store the number of strokes to be replayed for 1 second as 2. For another example, the electronic device 3000 may pre-store the number of strokes to be replayed for 1 second as 8.

The electronic device 3000 may determine the playback time of the replay operation based on the number of confirmed strokes and the number of strokes to be played back per unit time. For example, if the content determined to be replayed includes a total of 100 strokes, and the number of strokes to be replayed for 1 second is 4, the playback time of the replay action is 100(strokes)/4(strokes/ seconds) can be determined as 25 (seconds).

In other words, the playback time of the replay operation determined by the electronic device 3000 may be determined in proportion to the number of strokes included in the replay target content. For example, if the number of strokes is 100 and the predetermined number of playback strokes per second is 4, the playback time may be determined as 25 seconds, but if the number of strokes is confirmed to be 200, the playback time may be determined as 50 seconds. there is.

In other words, according to some embodiments of the present invention, the number of strokes included in the user's handwriting that is the target of the replay operation may be defined as N, and the number of predetermined strokes played during a predetermined unit time may be defined as M. In this case, the playback time of the replay operation determined by the electronic device 3000 may be determined as N/M* (predetermined unit time).

Meanwhile, in the above example, only the case where the number of strokes included in the replay target content is N times the number of replay strokes per predetermined unit time has been described as an example, but in the following, the number of strokes is the number of replay strokes per predetermined unit time. Embodiments of determining the playback time of a replay when the number is not a multiple will be described.

According to some embodiments, the electronic device 3000 may determine the playback time of the replay in the same manner as described above. That is, if the number of strokes included in the replay target content is 102 and the number of replay strokes per predetermined unit time is 4, the replay is played at 102 (strokes) / 4 (strokes / second) = 25.5 (seconds). Time can be determined.

According to some other embodiments, the electronic device 3000 defines the number of strokes included in the user's handwriting that is the target of the replay operation as N, and the predetermined number of strokes to be played for 1 second. is defined as M, and when N is divided by M, the quotient is defined as Q and the remainder is defined as R, the playback time of the replay can be determined as (Q+1) (seconds). In other words, if the number of strokes included in the content subject to replay is 102 and the number of replay strokes per predetermined unit time is 4, the quotient of dividing 102 by 4 is 25, so the playback time of the replay is (25 + 1) = It can be decided as 26 (seconds).

To summarize, the number of strokes included in the user's handwriting that is the target of the replay operation is defined as N, the number of predetermined strokes played for 1 second is defined as M, and N is divided by M. When defining the quotient as Q and the remainder as R, if R is 0, the electronic device 3000 determines the playback time of the replay as Q, and if R is not 0 (i.e., R is longer than M), (if it is a small integer), the electronic device 3000 may determine the playback time of the replay as (Q+1).

However, in this case, the replay playback time may be determined proportionally to the number of strokes, but is not determined completely proportionally. In other words, when the number of strokes is 100 and when the number of strokes is 200, the replay playback time may be twice as different, but when the number of strokes is 101 and when the number of strokes is 102 and When the number of strokes is 103, the playback time of the replay can be determined to be the same. Figure 25 is a diagram for explaining a method of determining the playback time of a replay based on the number of strokes, according to some embodiments of the present invention. Referring to Figure 25, when the number of replay strokes per unit time is 4. , When the replay playback time is determined according to some embodiments of the present invention, the relationship between the number of strokes and the replay playback time is roughly shown.

Meanwhile, rather than storing the number of replay strokes per unit time, the electronic device 3000 may store a plurality of numbers of replay strokes per unit time, and may store an appropriate plurality of replay strokes per unit time according to the predetermined event. The number of replay strokes can be determined.

Additionally, the electronic device 3000 can determine the playback speed of the replay operation. There are various methods by which the electronic device 3000 determines the playback speed of a replay operation.

For example, the electronic device 3000 may determine the playback speed of the replay operation according to the predetermined event. There may be cases where a user separately requests a playback speed for a replay operation, and accordingly, the electronic device 3000 may determine the replay playback speed according to the playback speed requested by the user. Alternatively, there may be a case where the operating system of the electronic device 3000 or another application installed on the electronic device 3000 separately requests a playback speed for the replay operation, and accordingly, the electronic device 3000 , the replay playback speed can be determined according to the playback speed requested by the operating system or application.

For another example, the electronic device 3000 may determine the playback speed of the replay operation based on the number of strokes included in the replay target content.

FIG. 26 is a diagram for explaining an example of determining the replay speed of a replay according to the number of strokes included in the replay target content according to some embodiments of the present invention.

Referring to FIG. 26, it is shown that a plurality of sections are divided according to the number of strokes, and a predetermined playback speed corresponds to each section. The electronic device 3000 stores the table shown in FIG. 26 in advance in the memory module 3400, checks the total number of strokes included in the replay target content, and pre-registers the number of strokes according to the total number of confirmed strokes. By referring to the saved table, the replay playback speed can be determined. For example, when the section according to the number of strokes is determined in units of 500, if the number of strokes subject to replay is 1 or more and less than 500, the playback speed of the replay may be determined at 1x speed, and the strokes subject to replay are 500. If there are more than 1,000 but less than 1,000, the replay speed may be determined at double speed, and the replay playback speed may be determined similarly for sections longer than that.

At this time, the determined replay playback speed may be determined as the basic playback speed for the corresponding replay operation, and the determined basic playback speed may be recommended to the user. That is, if the number of strokes included in the content to be replayed is 300, 1x speed can be displayed to the user as the recommended replay speed, and if the number of strokes included in the content to be replayed is 700, 2x speed is recommended. The replay rate can be displayed to the user.

In this way, after the replay playback speed is determined, the electronic device 3000 can determine the number of replay strokes per unit time based on the determined replay playback speed.

Figure 27 is a diagram for explaining an embodiment of determining the number of replay strokes per unit time according to the replay playback speed according to some embodiments of the present invention.

Referring to FIG. 27, it is shown that the number of replay strokes per unit time corresponds to each playback speed. The electronic device 3000 pre-stores a table as shown in FIG. 27 in the memory module 3400, and determines the number of replay strokes per unit time by referring to the pre-stored table according to the determined replay playback speed. You can. For example, when the playback speed is 1x, the number of replay strokes per unit time (the number of replay strokes per second) may correspond to 4, and when the playback speed is 2x, the number of replay strokes per unit time is 4. The number of strokes (the number of replay strokes per second) may correspond to 8.

In this way, the electronic device 3000 can determine the number of replay strokes per unit time according to the determined replay playback speed.

As described above, after the content to be replayed is determined, the electronic device 3000 reproduces the replay action based on the user's request, the request of the operating system, the request of the application, or the number of strokes included in the content to be replayed. You can decide the time.

Next, the electronic device 3000 performs a replay operation according to the determined replay operation playback time, etc.

When performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed on the display at a time.

Figure 28 is a diagram for explaining a method of performing a replay operation for a user's handwriting, according to some embodiments of the present invention.

Figure 28 shows the timing at which replay target strokes are displayed on the display, especially when the number of replay strokes per second is 4. Referring to Figure 28, it can be seen that one stroke is displayed on the display at intervals of 0.25 seconds. In addition, it can be seen that the first stroke is not displayed sequentially between 0 and 0.25 seconds, but is displayed all at once at 0 seconds. In other words, according to some embodiments of the present invention, if the number of replay strokes per unit time is determined, when performing a replay operation, the display intervals between strokes may be determined to be equal to each other. That is, in this way, when performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed one at a time on the display.

Alternatively, instead of the entire stroke being displayed on the display at one specific point in time, the entire stroke may be displayed for a time interval much shorter than the display interval between strokes (e.g., 0.25 seconds in the example above). will be.

However, in some embodiments, two or more strokes may be replayed at a time by being displayed on the display at the same time.

Meanwhile, as described above, the electronic device 3000 may change the replay playback speed according to another predetermined event while performing a replay operation based on the determined replay playback speed and the determined number of replay strokes per unit time. .

For example, a user may request a change in the playback speed of a currently playing replay, or an operating system or other application may request a change in the playback speed of a currently playing replay.

In this case, the electronic device 3000 changes the replay playback speed according to the other predetermined event, changes the number of replay strokes per unit time based on the changed replay playback speed, and then changes the number of replay strokes per unit time. Depending on this, the remaining replay operations can be performed.

As described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's writing and the timing of the replay playback are not temporally synchronized with each other, but are played faster. The effect is that it is possible to reproduce the user's handwriting within time and perform a replay.

6. Capture of handwriting

The electronic device 3000 can capture handwriting content written by the electronic pen 2000. Here, the electronic device 3000 provides a user interface that allows selection of a specific part to be captured among the entire handwriting content, and through this, a specific portion of the entire handwriting content can be selectively captured. Additionally, the electronic device 3000 may provide a user interface that allows the user to check which part of the entire handwritten content is selected for capture.

The electronic device 3000 can determine the portion of the entire handwriting to be captured (hereinafter referred to as ‘target handwriting content’).

Figure 29 is a diagram of the entire written content and the target written content during the capture operation of the electronic device according to the present invention.

Here, the entire written content may mean any written content that can be continuously reproduced through replay. For example, when the electronic device 3000 reproduces the handwritten content by dividing it into pages of Medium 1000, the entire written content A may include all the written content written on the page, as shown in FIG. 29. You can. Of course, if the handwriting written on a single page is divided and reproduced as needed, only some of the handwriting on the page may correspond to the entire handwriting described above, and the handwriting written on multiple pages at once may be In the case of continuous reproduction, all of the written content written on the plurality of pages may correspond to the entire written content.

Also, here, the target handwriting content may include part or all of the entire handwriting content. The target handwriting content may include one or more portions of the entire handwriting content consisting of a series of consecutive handwritings. For example, the first writing content (T1) may be selected as the target writing content as shown in FIG. 29. For another example, the first written content (T1) and the second written content (T2) may be selected as the target written content, as shown in FIG. 29.

The electronic device 3000 may set a target section among the playback sections of the entire handwriting content and determine that a portion of the entire handwriting content corresponding to the set target section is the target handwriting content.

Specifically, the electronic device 3000 may receive input from the user at least one viewpoint among the playback sections of the entire handwritten content and set the target section based on this.

For example, the electronic device 3000 may receive input from the user as a start point and an end point, and accordingly set the section from the start point to the end point among the playback sections of the entire handwritten content as the target section.

For another example, the electronic device 3000 may also receive input of either a start time or an end time from the user. In this case, the electronic device 3000 may set the target section from the start to the end of the playback section, or may set the time from the beginning to the end of the playback section as the target section. That is, if only the start point is input, the end of the entire playback section becomes the end point, and conversely, if only the end point is input, the beginning of the entire playback section becomes the start point.

In contrast, the electronic device 3000 may receive input from the user as the start and end points of the exclusion section, set the exclusion section based on this, and set the remaining section of the entire playback section minus the exclusion section as the target section.

For example, the electronic device 3000 may receive a start and end point from the user, and accordingly set the section from the start to the end of the entire playback section as an excluded section and set the remaining section as the target section. there is.

Meanwhile, the electronic device 3000 may set target sections that are spaced apart from each other. For example, the electronic device 3000 receives a first start time, a first end time, a second start time, and a second end time from the user, and selects a first target section from the first start time to the first end time. and can be set as the second target section from the second start point to the second end point.

In order to receive input of at least one viewpoint described above, the electronic device 3000 may provide various types of user interfaces.

30 to 32 are examples of a user interface for inputting a target section according to the present invention.

According to one example, the electronic device 3000 may display a progressive bar along with the entire handwriting content, receive user input regarding the progressive bar, and set the target section based on this.

Here, the progressive bar may refer to an indicator linked to the progress of playback when playing back handwritten content. As shown in FIG. 30, the progressive bar P is generally provided in the form of a bar at the bottom of the screen, but in the present invention, its form is not necessarily limited to the form shown in FIG. 30.

Meanwhile, in the present invention, the total playback time expressed by the progressive bar may correspond to the time at which the handwriting content is reproduced according to the replay, based on the writing time included in the pen data, the number of writing strokes, and the interval between adjacent writing times, etc. It can be decided.

For example, the total playback time according to the progressive bar may be determined to correspond to the time interval from the writing time of the pen data for the first stroke of the corresponding handwritten content to the writing time of the pen data for the last stroke. In this case, the time the user writes on the medium 1000 using the actual electronic pen 2000 and the final replay time according to the progressive bar will be set to be the same.

As another example, the total playback time according to the progressive bar is set to correspond to the time interval from the writing time of the pen data for the first stroke of the corresponding handwriting to the writing time of the pen data for the last stroke, and then the interval between adjacent strokes in the writing order If the time interval is greater than the preset standard interval, the time interval can be decreased. That is, if the time interval between the writing time at which a specific stroke was performed and the writing time at which the next stroke of the specific stroke was performed is greater than the standard interval set at 20 seconds, the time interval can be reduced to 5 seconds. In this case, the total replay time according to the progressive bar may be shorter than the time the user actually writes on the medium 1000 using the electronic pen 2000.

As another example, the total playback time according to the progressive bar may be determined according to the total number of strokes (i.e., number of handwritten strokes) of the corresponding handwritten content. In other words, for handwritten content consisting of a total of 300 strokes, with 3 strokes corresponding to 1 second on the replay, the replay time of the progressive bar can be determined as 100 seconds. In this case, the total replay time according to the progressive bar may be different from the actual writing time.

The electronic device 3000 may receive user input for setting the target section from the user through a user interface that displays such a progressive bar. For example, the user can select two points on the progressive bar as shown in FIG. 30, and the electronic device 3000 determines the front point as the start point and the back point as the end point, Accordingly, the target section can be set. At this time, it may be displayed on the start indicator (I-1) and end indicator (I-2), which identify the start and end points, respectively, on the progressive bar. Additionally, the target section (R) may be displayed on the progressive bar (P) to distinguish it from the remaining sections. The user can select the desired point on the progressive bar by touching it or clicking the mouse, as shown in Figure 30. Alternatively, the user may drag from one point on the progressive bar to another point as shown in FIG. 31, and in this case, the electronic device 3000 may set the dragged section as the target section (R). In other words, the very front of the dragged section becomes the starting point (I-1), and the rearmost becomes the ending point (I-2). According to this input, the target handwriting content corresponding to the target section R can be determined, as shown in FIGS. 30 and 31. In addition, the user can also determine multiple target writing contents (T-1, T-2) by setting two or more target sections (R-1, R-2) spaced apart from the progressive bar (P) as shown in FIG. 32. possible.

Figures 33 to 35 are another example of a user interface for inputting a target section according to the present invention.

According to another example, the electronic device 3000 may display the entire handwriting content and set the target section according to a user input for selecting a stroke from the handwriting content. Specifically, when a selection is made between two strokes, the writing content created by the strokes between the stroke written first and the stroke written later can be selected as the target writing content. In other words, the electronic device 3000 can set the target handwriting content by setting the playback time of the selected stroke as the start or end time of the target section.

Referring to FIG. 33, the user selects two strokes (S-1, S-2) from the entire handwriting content, and the target handwriting content (T) can be determined by the two strokes and the strokes between them. there is.

Alternatively, the user may select the entire handwritten content by dragging it from the start stroke (S-1) to the end stroke (S-2), similar to that shown in FIG. 34. In this case, the electronic device 3000 Can determine the target handwriting content (T) as in the case where two strokes (S-1, S-2) are selected respectively.

Also, using this method, it is possible to set multiple target sections to select multiple target writing contents as shown in FIG. 35.

In this way, the user input for selecting a stroke from the handwriting content can accurately select the stroke displayed in the present invention. However, unlike this, even if a specific stroke is not accurately selected, the electronic device 3000 selects the stroke closest to the point where the user input is received. It can be judged as selected.

Figures 36 and 37 are another example of a user interface for inputting a target section according to the present invention.

According to another example, the electronic device 3000 can play the entire handwritten content in video form through a display, receive user input during playback, and obtain the time when the user input occurs as the start time or end time. Specifically, looking at FIG. 36, while the writing content has been reproduced up to the “In the evening” part (U-1), the user can input that point as the starting point. Also, looking at FIG. 37, the user can input that point as the end point while reproduction has progressed up to the “secure” part (U-2). Accordingly, the “In the evening” part (U-1) to the “secure” part (U-2) can be set as the target section and the target written content (T) can be determined. As shown in FIGS. 36 and 37, this can be done by selecting the viewpoint setting button (B) on the control panel (C) provided as a user interface, or by clicking, touching, etc. Of course, here too, it is possible for multiple target sections and target writing contents to be selected. The drawing shows that one time point setting button (B) is provided, and depending on the selection order of the buttons, the time selected first can be the start time and the time selected later can be the end time. However, unlike this, it is possible for the viewpoint setting button to include a start point setting button and an end point setting button, so that each viewpoint is determined by selecting the corresponding button.

Meanwhile, when a user input for inputting a start or end time occurs during playback, the electronic device 3000 may temporarily stop playback or continuously perform playback.

As described above, the electronic device 3000 can set the target section through user input and determine the target handwriting content accordingly. The electronic device 3000 allows the user to easily select the target handwriting content, and It is possible to confirm the target handwriting content selected by the user.

Figure 38 is a diagram of a screen that outputs the entire handwriting content for receiving input of a target section according to the present invention. Referring to FIG. 38, the electronic device 3000 may display the entire handwriting content before receiving user input or before determining the target handwriting content is completed. Accordingly, the user can check the entire handwriting and decide which part of the handwriting to capture.

Figures 39 and 40 are diagrams of a screen for identifying target written content according to the present invention. Referring to FIG. 39, when the target handwriting content is determined, the electronic device 3000 may display the target handwriting content to be distinguished from other handwriting content. In other words, the target handwriting content and the remaining handwriting content may be displayed with different display properties (eg, contrast, color, font type, font type, font size, etc.). Also, referring to FIG. 40 , when the target handwriting content is determined, the electronic device 3000 may display only the target handwriting content on the screen without displaying the remaining handwriting content on the screen.

In addition, the electronic device 3000 may display the target section on a progressive bar to distinguish it from the remaining sections, as shown in FIGS. 39 and 40, and display the start and end points of the target section on the progressive bar. The indicator can be displayed.

Figure 41 is a diagram showing a captured image according to the present invention.

The electronic device 3000 can capture the target handwriting content determined in this way. Capturing the target handwritten content can be done not only in the form of an image, but also in the form of pen data. Capturing in the form of pen data may mean saving the target handwriting content as separate pen data so that the electronic device 3000 or another electronic device 3000 can use it to check the target handwriting content.

In capture in the form of an image, the electronic device 3000 may generate an image containing target handwriting content. These images may include only the target handwriting or may include a medium image as a background of the target handwriting. In some cases, the captured image may include remaining handwriting content in addition to the target handwriting content, and in this case, the target handwriting content may be displayed in a form that is distinguishable from the remaining handwriting content. Meanwhile, image capture may be created by writing the target handwriting content on a medium image using pen data of the target handwriting content, or may take the form of capturing an image displayed on the screen.

Meanwhile, the electronic device 3000 may separately store or transmit the target handwriting content to an external device instead of or together with capturing the target handwriting content. For example, the electronic device 3000 may transmit an image capturing target handwriting content to a designated email address.

Specifically, as described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's writing and the timing of the replay playback are not temporally synchronized with each other and are not replayed. The effect is that the user's handwriting can be reproduced and replayed in a faster time.

<Structure of electronic pen>

Hereinafter, the structure of the electronic pen 2000 according to an embodiment of the present invention will be described.

Figure 42 is a schematic perspective view showing an exploded view of the main body and the cap provided in the electronic pen according to an embodiment of the present invention, and Figure 43 is a schematic perspective view of the cap provided in the electronic pen according to an embodiment of the present invention on the other side of the main body. This is a schematic perspective view showing the inserted state.

Referring to FIGS. 42 and 43, the electronic pen 2000 according to an embodiment of the present invention includes a core portion 2010 that enables writing on a medium, a main body portion 2020 that fixes the position of the core portion 2010, and It may include a cap portion 2030 that protects the core portion when not in use.

Here, the non-use state may mean a state in which the electronic pen 2000 according to an embodiment of the present invention is being stored. In this case, the core portion 2010 is not exposed to the outside, so writing on the medium is impossible. It can mean.

The core portion 2010 is a component that enables writing on medium and may include a ball and ink, and the ink may be oil-based, water-based, or neutral.

Additionally, the core portion 2010 may be a black core used in a pencil or a lead used in a general writing instrument.

The main body portion 2020 is a component that is inserted so that a portion of the core portion 2010 is exposed to fix the position of the core portion 2010, and may refer to a type of grip portion that a user can grip with his or her hand.

The cap portion 2030 may be provided with a predetermined internal space (S1) into which one side of the main body portion 2020 can be inserted in a non-used state to protect the core portion 2010, When inserted into the other side, a portion of the core portion 2010 can be exposed to the outside to enable writing.

However, when writing is enabled by the core part 2010, the cap part 2030 does not necessarily need to be inserted into the other side of the main body 2020, and is separated from the main body 2020 to leave a predetermined space. It is okay to place it in .

Meanwhile, the main body portion 2020 and the cap portion 2030 may have a circular or polygonal cross-section, but hereinafter, the case where the cross-section in the horizontal direction is formed as a polygon will be described as an example.

Figure 44 is a schematic perspective view showing the internal structure of the cap portion and the main body provided in the electronic pen according to an embodiment of the present invention, Figure 45 is a schematic cross-sectional view taken along line AA of Figure 44, and Figure 46 is an embodiment of the present invention This is a schematic perspective view showing a modified example of the cap portion provided in the electronic pen according to the embodiment.

Additionally, Figure 47 is a schematic front view showing the main body provided in an electronic pen according to an embodiment of the present invention.

Referring to FIGS. 44 to 47, the electronic pen 2000 according to an embodiment of the present invention may include a body portion 2020 that positions and fixes the cap portion 2030 and the core portion 2010, and the above configuration is described below. The elements are explained in detail.

The cap portion 2030 includes a receiving portion 2032 having a predetermined internal space S1 to accommodate one side of the main body 2020, and a position fixing portion 2034 protruding from the bottom surface of the inside of the receiving portion. It can be provided.

Here, the position fixing part 2034 does not necessarily need to be formed to protrude from the inner bottom surface of the receiving part 2032. For example, it may be formed to protrude from the inner side of the receiving part 2032. do.

The cap part 2030 connects the outer surface of the position fixing part 2034 and the bottom surface of the receiving part 2032 to ensure that the position fixing part 2034 is stably placed within the internal space S1. A rigidity reinforcement unit 2036 may be further provided.

The rigidity reinforcement part 2036 can reinforce the rigidity of the position fixing part 2034 and can perform a kind of reinforcing rib function.

*The receiving part 2032 can accommodate the other side of the main body part 2020 when the other side of the main body part 2020 is inserted. In this case, the position fixing part 2034 is the main body part ( It may be disposed in the internal space S1 so as to contact the other side of the main body portion 2020 and define a limit of insertion of the other side of the main body portion 2020.

In other words, when the other side of the main body portion 2020 is inserted toward the internal space (S1), the other end of the main body portion 2020 contacts the position fixing portion 2034 to prevent further insertion. This can guide the appropriate insertion position into the internal space (S1) on the other side of the main body 2020.

Here, the other side of the main body 2020 may be provided with a light emitting part 2028 (see FIG. 43) that externally displays the state of the electronic pen 2000, and the position fixing part 2034 allows the main body to The degree of insertion of the other side of the part 2020 into the internal space S1 is adjusted to insert the light emitting part 2028 into a penetrating part 2038 (see FIGS. 2 and 3) formed by penetrating the receiving part 2032. ) can be exposed to the outside to provide convenience to users.

The mounting space S2 may be a space provided by the locking portion 2023 of the main body portion 2020, and the main body portion 2020 includes a body portion 2024 that can be gripped by the user and the position and position when not in use. The top 2034 may be mounted on a locking portion 2023 that protrudes from one side of the body portion 2024 to provide a mounting space S2 so that the cap portion 2030 is fixed in position.

Specifically, the locking portion 2023 is spaced apart from the first locking portion 2021 and a first locking portion 2021 protruding toward the center of the body portion on one side of the body portion 2024 and the body portion 2024. It may be provided with a second locking part 2022 protruding toward the center, and a predetermined mounting space S2 may be formed between the first locking part 2021 and the second locking part 2022. .

The mounting space (S2) may be a space where the mounting part 2033 of the position fixing part 2034 is mounted, and the mounting part 2033 is located in the inner space (S1) from the center of one side of the receiving part 2032. It may be a component formed by expanding from the end of the protrusion 2031 protruding toward.

Here, the receiving portion 2032 and the body portion 2024 may be formed in a circular or polygonal cross-section in the transverse direction. For example, the cross-section in the transverse direction may be formed in a Kth square (K is a natural number of 3 or more). and may be formed as a triangle as shown in the drawing.

When the body part 2024 is inserted into the receiving part 2032, the mounting part 2033 is installed in the mounting space S2 regardless of a change in the position of the mounting space S2. It may be formed to extend radially from the end of the receiving portion 2032 toward the vertex of the transverse cross section.

Here, the vertex generally refers to the point of intersection where line segments constituting a polygon meet, but in the present invention, it should be noted that the concept also includes the point with the minimum radius of curvature.

Since the mounting portion 2033 is formed by extending radially from the end of the protruding portion 2031, when the body portion 2024 is inserted into the receiving portion 2032, the present invention provides a first locking portion 2021 regardless of how it is inserted. Convenience can be increased by allowing the mounting part 2033 to be mounted in the mounting space S2 formed between ) and the second locking part 2022.

Meanwhile, the mounting portion 2033a may be formed by expanding circularly and radially from the end of the protrusion 2031a, as shown in FIG. 46.

The core portion 2010 may be eccentrically disposed from the center of the transverse cross section of the body portion 2024 toward the vertex of the transverse cross section of the body portion 2024, and the first engaging portion 2021 and the second engaging portion The portion 2022 may be formed between the center line of the transverse cross section of the body portion 2024 and the core portion 2010.

As a result, the mounting space S2 in which the mounting portion 2033 is mounted is also formed between the center line of the transverse cross section of the body portion 2024 and the core portion 2010, allowing the user to write on the medium with the core portion 2010. During the process, damage to the first locking portion 2021 and the second locking portion 2022 due to external factors can be minimized to prevent deterioration of the function of the mounting space S2.

Figures 48 and 49 are schematic side views for explaining the process of inserting a cap part into one side of the main body provided in an electronic pen according to an embodiment of the present invention.

First, referring to FIG. 48, when the electronic pen 2000 according to an embodiment of the present invention is to be stored in an unused state, one side of the main body portion 2020 is inserted into the cap portion 2030.

In this case, the first locking part 2021 of the main body 2020 can be inserted into the receiving part 2032 of the cap part 2030, and the first locking part 2021 is the first locking part 2021. When inserted into the receiving part 2032, the mounting part 2033 may be provided with an insertion inclined surface 2026 that slopes downward along the insertion direction so that it can enter the mounting space S2 after contact.

When the body portion 2024 is inserted into the receiving portion 2032, the insertion inclined surface 2026 is in contact with the mounting portion 2033 to primarily insert the body portion 2024 into the receiving portion 2032. It can perform the function of a kind of primary barrier that limits.

Here, when the user continues to apply external force to the body portion 2024 toward the internal space (S1) of the receiving portion 2032, the mounting portion 2033 moves toward the insertion inclined surface 2026 as shown in FIG. 49. It passes through and is finally installed in the mounting space (S2).

When the mounting part 2033 is placed in the mounting space (S2) by the user's continuous external force, the body part 2024 is inserted into the internal space (S1) of the receiving part 2032 even if the external force is continuously applied. This may not be possible, and this may be implemented by the second stopping portion 2022 that provides the function of a secondary barrier.

The second locking portion 2022 is configured to prevent the mounting portion 2033 from being inserted beyond the mounting space S2 when the body portion 2024 is inserted into the receiving portion 2032. 2033) and, specifically, may be provided with an over-insertion prevention surface 2025 perpendicular to the insertion direction.

Ultimately, even if there is continuous external force from the user, the mounting portion 2033 contacts the over-insertion prevention surface 2025 and prevents further insertion, so it can be stably mounted in the mounting space S2.

Here, the end of the second engaging portion 2022 may be formed closer to the center of the body portion 2024 than the end of the first engaging portion 2021, which means that the first engaging portion 2021 This is because it is a component that functions as a primary barrier and must pass through the mounting portion 2033, while the second stopping portion 2022 must perform the function of a secondary barrier through which the mounting portion 2033 must not pass. am.

When the mounting part 2033 is mounted in the mounting space S2, the body part 2024 between the first engaging part 2021 and the second engaging part 2022 defining the mounting space S2 One surface 2028 may be in surface contact with the mounting portion 2033, and specifically, may be formed as a plane parallel to the insertion direction of the body portion 2024 into the receiving portion 2032.

Due to surface contact between the mounting portion 2033 and the body portion 2024 within the mounting space S2, the coupling force between the cap portion 2030 and the body portion 2020 can be increased, and non-ideal external force is not applied. Even so, separation of the cap portion 2030 and the main body portion 2020 does not occur.

Meanwhile, when the mounting unit 2033 is mounted in the mounting space S2, that is, when the user wants to change the electronic pen 2000 from a non-use state to a use state for writing, the user Apply an external force to separate the cap portion 2030 from the main body portion 2020.

To this end, when the first locking part 2021 separates the body part 2024 inserted into the receiving part 2032, the mounting part 2033 mounted in the mounting space S2 is connected to the mounting space S2. It may be provided with a separation inclined surface 2027 that is inclined downward along the separation direction so as to deviate from (S2).

The separation slope 2027 may be formed symmetrically with the insertion slope 2026 described above, but it is not necessarily limited thereto, and the slope angle may be slightly different.

Below, the structure of the electronic pen 2000 will be described in more detail.

Figures 50 and 51 are schematic perspective views showing an exploded body portion provided in an electronic pen according to an embodiment of the present invention, and Figures 52 to 54 are schematic diagrams of a body portion provided in an electronic pen according to an embodiment of the present invention. This is a schematic perspective view to explain the substrate unit, camera module, and lighting module that are positioned and fixed.

First, the electronic pen 2000 according to the present invention may include a cap portion 2030 as described with reference to FIGS. 42 to 49, but the cap portion 2030 is essential in implementing the electronic pen 2000. Please note that this may not be a necessary component.

Referring to FIGS. 50 to 54, the electronic pen 2000 according to an embodiment of the present invention includes a camera module 2320 and a lighting module 2340 that enable recognition of the user's handwriting by the core 2010, The camera module 2320 and the lighting module 2340 are connected to a substrate portion 2110 and a hollow S5, and a receiving substrate portion C1 accommodated in the hollow S5 and the hollow S5. The substrate portion 2110 is defined by an exposed substrate portion C2 exposed to the outside, and the main body 2120 and the camera module 2320 are made of a first material to shield electromagnetic waves generated by wireless communication. It may include a battery unit 2160 for driving the lighting module 2340 and a wireless communication module 2440 mounted on the exposed substrate unit C2 to enable wireless communication with other electronic devices.

Since the camera module 2320, the lighting module 2340, and the wireless communication module 2440 have already been described in detail, detailed descriptions will be omitted.

The main body 2120 may be a component that provides the appearance of the electronic pen 2000 according to an embodiment of the present invention, and the main body portion 2020 together with the substrate fixing portion 2030 and the substrate protecting portion 2140 can be configured.

The substrate unit 2110 may be implemented as a single unit in the electronic pen 2000 according to the present invention, but may be implemented as a plurality. For example, as shown in the drawing, the first substrate 2112, the second substrate 2110 It may also be implemented with a substrate 2114 and a third substrate 2116.

Hereinafter, for convenience of explanation, the case where the substrate unit 2110 includes three substrates will be described as an example.

*Specifically, the substrate portion 2110 includes a first substrate 2112 disposed close to the first end of the main body 2120 where the core portion 2010 is exposed, and a second end that is opposite to the first end. It may include a second substrate 2114 disposed close to and may further include a third substrate 2116 disposed between the first substrate 2112 and the second substrate 2114.

Here, the first substrate 2112, the second substrate 2114, and the third substrate 2116 may be electrically connected to each other by a flexible printed circuit board (FC), and the hollow body of the main body 2120 Depending on whether it is accommodated in (S5), it may be defined as a receiving substrate portion (C1) and an exposed substrate portion (C2), and a specific substrate may include both a receiving substrate portion (C1) and an exposed substrate portion (C2).

The receiving substrate portion C1 and the exposed substrate portion C2 virtually divide the area of the substrate into a portion accommodated in the hollow S5 of the main body 2120 and a portion exposed to the outside of the hollow S5. As a concept, the receiving substrate portion C1 and the exposed substrate portion C2 may exist simultaneously on one substrate.

For example, as shown in the drawing, the first substrate 2112 and the third substrate 2116 are accommodated in the hollow S5 of the main body 2120, so the entire housing substrate portion C1 is can be formed.

On the other hand, since only a part of the second substrate 2114 is accommodated in the hollow S5, the accommodated portion can form the receiving substrate portion C1, and the remaining portion can form the exposed substrate portion C2.

That is, the second substrate 2114 may include at least a portion of the receiving substrate portion C1 and the exposed substrate portion C2 in the electronic pen 2000 according to the present invention.

Here, the main body portion 2020 is mounted with the main body 2120 and the receiving substrate portion C1 to fix the receiving substrate portion C1 at a predetermined position in the hollow S5. It may be provided with a connected substrate fixing part 2030, and the exposed substrate part C2 may be mounted on the substrate fixing part 2030 and fixed at a predetermined position.

The substrate fixing part 2030 may be a type of structure for fixing the first substrate 2112, the second substrate 2114, and the third substrate 2116. ) and the third substrate 2116 can be mounted on the substrate fixing part 2030 by an additional component 2150.

The substrate fixing unit 2030 may be composed of a single component, but is not necessarily limited thereto, and may be implemented by connecting a plurality of components to each other.

The exposed substrate portion C2, which is part of the second substrate 2114, is exposed to the outside of the second end, which is the opposite end of the first end of the main body 2120, where the core portion 2010 is exposed, and is exposed to the wireless communication module. It can be placed close to the second end.

Here, the camera module 2320 and the lighting module 2340 may be mounted on the first board 2112, and may be electrically connected to the first board 2112 by a flexible printed circuit board (FC). It's okay.

In addition, the battery unit 2160 that provides driving force to the camera module 2320 and the lighting module 2340 may be disposed between the first substrate 2112 and the second substrate 2114.

The battery unit 2160 may be mounted on the board mounting unit 2132 that provides the mounting space S6.

The battery unit 2160 may be disposed between the first substrate 2112 and the second substrate 2114 and may be disposed overall to be biased toward the second end of the main body 2120, but may be disposed to provide convenience for the user's writing. In order to increase, the center of gravity of the electronic pen 2000 may be formed to be biased toward the first end of the main body 2120.

Meanwhile, the second substrate 2114 may be equipped with a wireless communication module 2440 that enables wireless communication with other electronic devices. Specifically, the exposed substrate portion C2 of the second substrate 2114 may be installed as described above. A wireless communication module 2440 may be installed.

The wireless communication module 2440 may be exposed to the outside of the main body 2120 made of a first material, and may not experience any obstacles in wireless communication with other electronic devices despite the first material. there is.

Here, the first material constituting the main body 2120 may include aluminum (Al), which shields electromagnetic waves generated during wireless communication by the wireless communication module 2440, but must be composed of aluminum (Al). It is not necessary, and any material that can shield electromagnetic waves can be applied.

As described above, the wireless communication module 2440 for implementing wireless communication with other electronic devices is disposed outside the main body 2120 made of a first material capable of shielding electromagnetic waves. Since it is mounted on the exposed substrate portion C2 exposed to the outside, wireless communication can be implemented without being affected by the main body 2120, thereby maximizing the recognition of the user's handwriting.

In addition, the electronic pen 2000 according to the present invention by the main body 2120 composed of the first material emits electromagnetic waves generated during wireless communication by the wireless communication module 2440 to the outside through the main body 2120. By preventing this, the harmfulness of electromagnetic waves generated during wireless communication can be minimized.

In addition, the main body 2120 made of the first material has a higher heat transfer coefficient than the substrate fixing part 2030 made of synthetic resin such as plastic, so heat generated by the operation of the lighting module 2340, etc. is effectively discharged to the outside. This can improve the durability of the electronic pen 2000.

Meanwhile, the main body portion 2020 provided in the electronic pen 2000 according to the present invention surrounds the exposed substrate portion C2 together with the main body 2120 and the substrate fixing portion 2030. ) may be provided with a substrate protection unit 2140 connected to the main body 2120 to protect the main body 2120.

The substrate protection portion 2140 may be a type of cap that is connected to the second end of the main body 2120 and covers the exposed substrate portion C2, and the exposed substrate portion C2 is connected to the second end of the main body 2120. As described above, it may be a part of .

The substrate protection portion 2140 may be made of a second material that passes electromagnetic waves generated by wireless communication by the wireless communication module 2440 mounted on the exposed substrate portion C2, thereby allowing the wireless communication The module 2440 may not experience any obstacles in wireless communication with other electronic devices despite the substrate protection unit 2140.

Here, the second material may be a synthetic resin containing plastic, and may have a lower heat transfer coefficient than the first material.

Figures 55 to 57 are schematic perspective views for explaining the process of inserting a core part into the body provided in an electronic pen according to an embodiment of the present invention.

First, referring to FIG. 55, the electronic pen 2000 according to the present invention can freely replace the core portion 2010, and the core portion 2010 is a core portion formed in the substrate fixing portion 2030 of the main body portion 2020. It can be inserted into the insertion hole (S7).

Referring to FIG. 56, the substrate fixing portion 2030 includes a substrate mounting portion 2132 on which the receiving substrate portion C1 is mounted, a core insertion guide portion 2134 providing a path through which the core portion 2010 is inserted, and the core portion 2134. The core part 2010 inserted into the insertion guide 2134 may be provided with a core fixing part 2136 that secures the core part 2010 by force fitting it.

The substrate mounting portion 2132 may be a type of frame constituting the substrate fixing portion 2030, and the deep insertion guide portion 2134 may be formed in an open state in a path communicating with the deep insertion hole S7. You can.

However, the deep insertion guide 2134 does not necessarily have to be formed in an open state, and may be formed as a kind of groove or hole.

Meanwhile, referring to FIGS. 55 and 56, the core insertion guide 2134 includes a first core insertion guide 2135 through which the core 2010 passes and a second core on which the core fixing part 2136 is mounted. An insertion guide 2137 may be provided, and the core fixing part 2136 may be slidably mounted within the second core insertion guide 2137.

The core fixing part 2136 may be detachably mounted on the second core insertion guide 2137, and when mounted on the second core insertion guide 2137, the second core insertion guide 2137 ) may be provided with a protrusion 2139 that extends outward to enable sliding without being separated from the inside.

In addition, the second deep insertion guide 2137 may be provided with a protrusion corresponding portion 2131 that protrudes to form a space in which the protrusion 2139 is mounted.

When the core fixing part 2136 is mounted on the second core insertion guide 2137, the protrusion 2139 is caught by the protrusion corresponding part 2131, thereby preventing it from escaping to the outside.

As the core fixing part 2136 is slidably mounted within the core insertion guide 2134, the electronic pen 2000 according to the present invention can enable the user to feel writing comfort while writing.

On the other hand, the core fixing part 2136 can exert an attractive force with the substrate mounting part 2132 within the second core insertion guide part 2137, and the first magnet 2172 and the second magnet are used as a means of generating the attractive force. Magnetic force by (2174) can be used.

The first magnet 2172 may be mounted on the core fixing part 2136, and the second magnet 2174 may be mounted on the substrate mounting part 2132 so that the core fixing part 2136 is attached to the substrate mounting part 2132. It is possible to maintain the state in which the force and gravity work.

An elastic body 2176 having elasticity may be disposed between the first magnet 2172 and the second magnet 2174, and the elastic body 2176 provides softness while the user writes on Medium, thereby improving convenience. It can be improved.

<Control method of electronic devices>

1. Real-time reproduction method of content written by the user #1

Hereinafter, a first embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

Figure 58 is a flowchart of a first embodiment of a method for real-time reproduction of content written by a user according to the present invention. Referring to Figure 58, the real-time reproduction method of content written by a user includes acquiring pen data (S110), acquiring information about the target medium based on the acquired pen data (S120), and selecting the target medium. It includes a step of displaying a medium image corresponding to (S130) and a step of reproducing the user's handwriting on the medium image based on the acquired pen data (S140).

The step of reproducing the user's handwriting (S140) may include reproducing the content of the user's handwriting in real time at a corresponding location on the medium image, based on stroke data generated from the pen data.

Accordingly, the electronic device 3000 can reproduce the user's handwriting in real time based on the pen data received from the electronic pen 2000 and display it through the electronic device 3000.

While explaining the operating method of the above-described electronic device, detailed explanations corresponding to each step have already been provided, so detailed explanations will be omitted here.

2. Real-time reproduction method of content written by the user #2

Hereinafter, a second embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

Figure 59 is a flowchart of a second embodiment of a method for real-time reproduction of content written by a user according to the present invention. Referring to FIG. 59, the real-time reproduction method of the written content includes acquiring pen data (S210), and based on the acquired pen data, predetermined conditions for a first area that is at least a part of the medium image being displayed. (S220) of determining whether a predetermined condition is satisfied, shifting a portion of the medium image displayed on the display from a first area to a second area (S230), and displaying the shifted first area (S230). It includes a step (S240) of reproducing the user's handwriting in area 2.

At this time, the predetermined condition may be whether the user's writing position deviates from the first area. That is, when the user's writing position deviates from the first area displayed on the display, it may be determined that the predetermined condition is satisfied.

Accordingly, when the electronic device 3000 reproduces the user's handwriting in real time based on the pen data received from the electronic pen 2000, the target medium is displayed in an enlarged manner, and the entire target medium is displayed through the display. If it is not displayed and only a part of it is displayed, even if the user's handwriting is input in another area that is not displayed through the display, the user's handwriting can be reproduced after shifting the display area to the corresponding area.

While explaining the operating method of the above-described electronic device, detailed explanations corresponding to each step have already been provided, so detailed explanations will be omitted here.

3. Replay of written content #1

Hereinafter, a first embodiment of a method for replaying written content according to the present invention will be described.

Figure 60 is a flowchart of a first embodiment of a method for replaying written content according to the present invention. Referring to FIG. 60, receiving information about the user's handwriting from an electronic pen that detects (S310), storing the received information about the user's handwriting in a memory (S320), at least the first stroke and and performing a replay operation of sequentially replaying the user's handwriting, including a second stroke following the second stroke, on the display (S330).

At this time, regardless of the time the user spends writing the first stroke and the second stroke, the first stroke and the second stroke are displayed on the display one at a time, and the first stroke is displayed at a first time. A stroke may be displayed on the display, and the second stroke may be displayed on the display at a second time later than the first time.

As a result, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000, the electronic device 3000 can replay the user's handwriting within a shorter time than the time the user actually input the handwriting. There will be.

While explaining the operating method of the above-described electronic device, detailed explanations corresponding to each step have already been provided, so detailed explanations will be omitted here.

4. Replay of written content #2

Hereinafter, a second embodiment of the method for replaying written content according to the present invention will be described.

Figure 61 is a flowchart of a second embodiment of a method for replaying written content according to the present invention. Referring to FIG. 61, the method of replaying the written content includes receiving pen data, which is information about the user's handwriting, through a communication unit (S410), and storing the received pen data in memory (S420). ), and based on the stored pen data, performing a replay operation to sequentially replay the user's handwriting on the display (S430).

At this time, the playback time of the replay operation is determined based on the number of strokes included in the handwriting of the user who is the target of the replay operation.

Accordingly, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000, the playback time of the replay action is determined based on the number of strokes, so that the user actually inputs the handwriting. It will be possible to replay a user's handwriting in less than an hour.

While explaining the operating method of the above-described electronic device, detailed explanations corresponding to each step have already been provided, so detailed explanations will be omitted here.

5. Capture of handwriting

Hereinafter, the handwriting capture method according to the present invention will be described.

Figure 62 is a flowchart of a handwriting capture method according to an embodiment of the present invention. Referring to FIG. 62, the handwriting capture method includes at least one of receiving pen data from the electronic pen 2000 (S510), acquiring handwriting content based on the pen data (S520), and a playback section of the handwriting content. A step of receiving user input corresponding to the point of view (S530), a step of setting a target section based on the user input (S540), a step of determining target handwriting content corresponding to the target section among handwriting content (S550), and target A step (S560) of capturing an image containing written content may be included.

First, the electronic device 3000 may receive pen data related to handwriting from the electronic pen 2000 (S510). The pen data may include coordinate data written on the medium 1000 using the electronic pen 2000 and data regarding the writing time.

The electronic device 3000 may obtain handwriting content using pen data (S520). Handwriting content can be obtained by creating strokes by connecting coordinate data in the order of writing time.

The electronic device 3000 may receive a user input corresponding to at least one viewpoint during the playback section (S530). To this end, the electronic device 3000 can display a progressive bar to receive user input for the progressive bar, display handwriting content to receive input for a specific stroke among the handwriting content, or receive user input while reproducing the handwriting content. there is. The electronic device 3000 can obtain the start and end points of the playback section according to the user input. If only one viewpoint is acquired, the electronic device 3000 may set the remaining viewpoints on its own.

Additionally, in order to receive such user input, the electronic device 3000 may display the entire handwriting content on the screen to assist the user's input.

The electronic device 3000 may set the target section based on the user input (S540). The electronic device 3000 may determine the start and end points of the target section according to the user input and set the target section accordingly.

Once the target section is set, the electronic device 3000 can determine the target handwriting content among the entire handwriting content (S550). The target writing content can be judged as one or multiple. Additionally, the electronic device 3000 can display the target handwriting content to distinguish it from the rest of the handwriting content and provide feedback to the user as to which handwriting content is judged to be the target handwriting content.

The electronic device 3000 may capture the selected target writing section (S560). Capture can be performed through image capture or pen data. Additionally, captured images can be transmitted externally through external devices or the Internet, or stored separately.

In the method for controlling an electronic device according to the present invention described above, the steps configuring each embodiment are not essential, and therefore each embodiment may optionally include the above-described steps. Additionally, each step constituting each embodiment does not necessarily have to be performed in the order described, and steps described later may be performed before steps described earlier.

Additionally, the method for controlling an electronic device according to the present invention may be implemented in the form of a code or program that performs the same, and such code or program may be stored in a computer-readable recording medium.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention to those of ordinary skill in the technical field to which the present invention pertains. It is not limited by the drawings. Additionally, the embodiments described in this document are not limited to application, and all or part of each embodiment may be selectively combined so that various modifications can be made. Furthermore, the steps constituting each embodiment may be used individually or in combination with the steps constituting other embodiments.

1000: Medium
2000: Electronic pen
3000: Electronic devices
4000: Server

Claims (6)

An electronic device for reproducing the contents of a user's handwriting on Medium,
a communication unit that communicates with an electronic pen that detects information about the user's handwriting;
display; and
Includes a control unit;
The control unit controls the display to display a medium image corresponding to the medium and reproduce and visually display the user's handwriting on the medium image,
The control unit,
Determine whether the display mode through the display is normal mode or enlarged mode,
In the case of the normal mode, the user's handwriting is reproduced according to a first reproduction mode, and in the enlarged mode, the user's handwriting is reproduced according to a second reproduction mode,
When a first medium image display area corresponding to a first area in which a portion of the medium is enlarged is displayed through the display, the display mode is determined to be an enlarged mode and the user's handwriting content is displayed according to the second reproduction mode. Reproduce,
Set to shift the first medium image display area to a second medium image display area and display it on the display based on the user's handwritten content in the second area of the medium that is different from the first area.
Electronics.
According to paragraph 1,
When displaying through the display in the normal mode, the control unit is characterized in that the edge position of the medium corresponds to the edge area of the screen displayed on the display.
Electronics.
According to paragraph 1,
The control unit,
When reproducing the user's handwriting according to the first reproduction mode, the user's handwriting is set to be reproduced and visually displayed regardless of the user's writing position.
Electronics.
According to paragraph 1,
When reproducing the user's handwriting according to the second reproduction mode, the medium image display area is shifted so that at least one pen data included in the handwriting corresponding to the user's handwriting position is located in the center. to do
Electronics.
According to paragraph 1,
The control unit,
The medium image display area is set to shift based on at least one pen data among the pen data constituting a plurality of strokes included in the user's handwriting,
The at least one pen data is at least one of pen data corresponding to a pen down time and pen data corresponding to a pen up time among a plurality of pen data constituting the user's handwriting content.
Electronics.
A control method of an electronic device for reproducing the contents of a user's handwriting on Medium, using a control unit included in the electronic device,
displaying a medium image corresponding to the medium on a display;
Determining whether the display mode through the display is a normal mode or an enlarged mode;
If in the normal mode, reproducing the user's handwriting according to a first reproduction mode, and if in the enlarged mode, reproducing the user's handwriting according to a second reproduction mode; and
When a first medium image display area corresponding to a first area in which a portion of the medium is enlarged is displayed through the display, the display mode is determined to be an enlarged mode and the user's handwriting content is displayed according to the second reproduction mode. Including a step of reproducing,
Shifting the first medium image display area to a second medium image display area and displaying it on the display based on the user's written content in the second area of the medium that is different from the first area.
Control method for electronic devices.