KR20230010797A - Electronic pen, electronic device associated with electronic pen, method for controlling electronic device and computer-readable medium on which program for performing the method for controlling electronic device is recorded - Google Patents

Abstract

According to an embodiment of the present disclosure, provided is an electronic device for reproducing notes written on a medium by a user, which comprises: a communication unit for communicating with an electronic pen which detects information on the user's note-taking; a display; and a control unit. The control unit controls the display to display a medium image corresponding to the medium, and reproduce and visually represent notes taken by the user on the medium image. The control unit determines whether a display mode through the display is a normal mode or an enlarged mode, reproduces the user's note-taking according to a first reproduction mode in the case of the normal mode, and reproduces the contents of the user's note-taking in a second reproduction mode in the case of the enlarged mode. When reproducing the user's note-taking according to the second reproduction mode, a first area of the medium image displayed through the display through is shifted according to the user's writing position through the enlarged mode. The recognized user note-taking can be replayed later.

Description

An electronic pen, an electronic device interlocked with the electronic pen, a control method of the electronic device, and a recording medium recording a program executing the control method of the electronic device MEDIUM ON WHICH PROGRAM FOR PERFORMING THE METHOD FOR CONTROLLING ELECTRONIC DEVICE IS RECORDED}

The present invention relates to an electronic pen, an electronic device interlocked with the electronic pen, and a method for controlling the electronic device, and more particularly, to an electronic pen that recognizes and displays a user's handwriting, an electronic device interlocked with the electronic pen, and a method for controlling the electronic device. It's about the control method.

Recently, technologies and products capable of recognizing a user's handwriting using an electronic pen and digitizing and storing the recognized content have been commercialized. However, the development of a method for providing the contents of handwriting recognized and digitized using such an electronic pen in a meaningful way to the user has not yet been developed, so that methods for enabling users to more effectively utilize the digitized writing contents development is required.

On the other hand, in the conventional electronic pen, the core is located in the center of the main body that the user grips, and generally adopts the configuration of an existing writing instrument, and is inserted into a cover and stored when not in use.

Here, when the main body is inserted into the cover, conventionally, in order to prevent separation between the main body and the cover, protrusions are formed on the outer surface of the main body and grooves are formed on the inner surface of the cover, so that the main body is inserted into the cover. Fixed.

In this conventional method, the protrusions are frequently damaged by external factors that may occur while the user is using the main body, which leads to a decrease in the bonding force between the main body and the cover, which eventually shortens the lifespan of the electronic pen. has occurred

An object of the present invention is to provide an electronic pen capable of recognizing a user's handwriting and later replaying the recognized user's handwriting, an electronic device interlocking with the electronic pen, and a method for controlling the electronic device.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and problems not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. .

According to one aspect of the present invention, an electronic device for replaying a user's writing content on a medium, comprising: a communication unit configured to communicate with an electronic pen that detects information about the user's handwriting; memory to store data; a display that visually displays information; and receiving pen data, which is information about the user's handwriting, through the communication unit, storing the received pen data in the memory, and sequentially displaying the user's writing contents on the display based on the stored pen data. and a control unit that performs a replay operation for replaying the replay operation, wherein the control unit is configured to determine a playback time of the replay operation based on the number of strokes included in the user's handwriting, which is a target of the replay operation. is provided.

According to another aspect of the present invention, there is provided a control method of an electronic device for replaying a user's writing content on a medium, comprising: receiving pen data, which is information about the user's handwriting, through a communication unit; storing the received pen data in a memory; and performing a replay operation to sequentially replay the user's handwritten contents on a display based on the stored pen data, wherein the playback time of the replay operation depends on the user's handwriting, which is the object of the replay operation. A control method of an electronic device determined based on the number of included strokes is provided.

According to another aspect of the present invention, a recording medium recording a program for executing the control method of an electronic device provided by the present invention described above may be provided.

The solutions to the problems of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. You will be able to.

According to the present invention, it is possible to replay how the user's handwriting progressed later, so that the user can check more information (eg, the order of writing) from the handwritten content.

In addition, according to the present invention, in replaying the user's handwriting, by properly controlling the replay playback time, there is an effect of providing a replay of the user's handwriting in a more effective and efficient manner in a shorter time. there is.

1 is a schematic diagram for explaining a system including an electronic pen and electronic devices interlocked with the electronic pen related to embodiments of the present invention.
2 is a diagram showing an embodiment of a medium related to embodiments of the present invention.
3 is a diagram illustrating an exemplary appearance of an electronic pen according to embodiments of the present invention.
4 is a block diagram for explaining components of an electronic pen according to embodiments of the present invention.
5 is a block diagram for explaining components of an electronic device according to embodiments of the present invention.
6 and 7 are diagrams exemplarily illustrating unit cells constituting a code pattern according to an embodiment of the present invention.
8 is a diagram for explaining a method of encoding 2-bit information in an information code according to embodiments of the present invention.
9 is a diagram for explaining a method of generating location information of an electronic pen for a medium according to embodiments of the present invention.
FIG. 10 is a diagram for explaining an embodiment of reproducing a user's handwritten contents according to the present invention in real time according to the present invention.
11 to 15 are diagrams for explaining another embodiment of reproducing a user's writing content in real time according to the present invention.
16 is a diagram for explaining a replay target section according to the present invention.
FIG. 17 is a diagram showing a replay reproduction time determined according to an embodiment of the present invention with respect to a replay target section as shown in FIG. 16. Referring to FIG.
18 and 19 are diagrams showing the replay playback time determined according to another embodiment of the present invention with respect to the replay target section as shown in FIG.
20 to 24 are diagrams for explaining some other embodiments of determining a replay reproduction time to replay a stroke handwritten by a user according to some other embodiments of the present invention.
25 is a diagram for explaining a method of determining a replay time based on the number of strokes, according to some embodiments of the present invention.
FIG. 26 is a diagram for explaining an embodiment of determining a replay reproduction speed according to the number of strokes included in content to be replayed according to some embodiments of the present invention.
27 is a diagram for explaining an embodiment of determining the number of replay strokes per unit time according to a replay reproduction speed according to some embodiments of the present invention.
28 is a diagram for explaining a method of performing a replay operation for a user's handwriting, according to some embodiments of the present invention.
29 is a diagram of the entire written content and the target written content during a capture operation of the electronic device according to the present invention.
30 to 32 are examples of user interfaces for receiving an input of a target section according to the present invention.
33 to 35 are other examples of user interfaces for receiving an input of a target section according to the present invention.
36 and 37 are other examples of user interfaces for receiving an input of a target section according to the present invention.
38 is a view related to a screen for outputting entire handwritten contents for receiving an input of a target section according to the present invention.
39 and 40 are diagrams related to screens for identifying target writing content according to the present invention.
41 is a diagram showing a captured image according to the present invention.
42 is a schematic perspective view illustrating an exploded view of a main body and a cap provided in an electronic pen according to an embodiment of the present invention.
43 is a schematic perspective view illustrating a state in which the cap provided in the electronic pen according to an embodiment of the present invention is inserted into the other side of the main body.
44 is a schematic perspective view illustrating the internal configuration of a cap unit and a body unit provided in an electronic pen according to an embodiment of the present invention.
Fig. 45 is a schematic cross-sectional view taken along line AA in Fig. 44;
46 is a schematic perspective view illustrating a modified example of a cap provided in an electronic pen according to an embodiment of the present invention.
47 is a schematic front view illustrating a main body provided in an electronic pen according to an embodiment of the present invention.
48 and 49 are schematic side views illustrating a process of inserting a cap part into one side of a body part provided in an electronic pen according to an embodiment of the present invention.
50 and 51 are schematic perspective views illustrating an exploded view of a main body provided in an electronic pen according to an embodiment of the present invention.
52 to 54 are schematic perspective views for explaining a substrate, a camera module, and a lighting module fixed to a body provided in an electronic pen according to an embodiment of the present invention.
55 to 57 are schematic perspective views for explaining a process of inserting a core into a body provided in an electronic pen according to an embodiment of the present invention.
58 is a flowchart of a first embodiment of a method for real-time reproduction of content written by a user according to the present invention.
59 is a flowchart of a second embodiment of a method for real-time reproduction of content written by a user according to the present invention.
60 is a flowchart of a first embodiment of a method for replaying written content according to the present invention.
61 is a flowchart of a second embodiment of a method for replaying written content according to the present invention.
62 is a flowchart of a handwriting capture method according to an embodiment of the present invention.

The embodiments described in this specification are intended to clearly explain the spirit of the present invention to those skilled in the art to which the present invention belongs, and the present invention is not limited by the embodiments described in this specification, and the present invention The scope of should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in this specification have been selected as general terms that are currently widely used as much as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or the emergence of new technologies of those skilled in the art in the technical field to which the present invention belongs. can However, in the case where a specific term is defined and used in an arbitrary meaning, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the term and the overall content of this specification, not the simple name of the term.

The drawings accompanying this specification are intended to easily explain the present invention, and the shapes shown in the drawings may be exaggerated as necessary to aid understanding of the present invention, so the present invention is not limited by the drawings.

If it is determined that a detailed description of a known configuration or function related to the present invention in this specification may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

Electronic devices that work with the electronic pen described in this specification include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices, and the like. It may include not only a mobile terminal, but also a fixed terminal such as a digital TV and a desktop computer.

According to one aspect of the present invention, an electronic device for reproducing a user's writing content on a medium, comprising: a communication unit configured to communicate with an electronic pen that detects information about the user's handwriting; a display displaying at least a part of the medium image corresponding to the medium, and visually displaying the reproduced content of the user's handwriting on the medium image; and determining whether a writing position of the user satisfies a predetermined condition for a first area that is at least a part of the medium image being displayed on the display, based on the pen data received from the communication unit, and determines the predetermined condition. If it is satisfied, the part of the medium image being displayed through the display is shifted from the first area to a second area different from the first area, and the second area is displayed through the display, and the user's handwriting a control unit displaying reproduction of the user's handwritten content at a position on the second area corresponding to the user's writing position, in order to reproduce the content; An electronic device including a may be provided.

The predetermined condition may be whether the writing position of the user is out of the first area.

Alternatively, the predetermined condition may be whether the writing position of the user is included in an edge area of the first area.

The second area may be determined based on a writing position of the user with respect to the medium.

In this case, the second area may be determined such that the writing position of the user with respect to the medium is located in the central portion.

Alternatively, the second area may be determined by further considering the position of the edge of the medium image.

In particular, the second area may be determined so that the edge position of the medium image does not deviate more than a predetermined distance from the edge area of the screen being displayed on the display.

In determining whether the predetermined condition is satisfied, the control unit determines whether the predetermined condition is satisfied using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting. can

Also, the control unit may determine whether the predetermined condition is satisfied by using first pen data corresponding to a pen-down time point among a plurality of pen data for the one stroke.

Also, the controller may determine the second area based on location information included in the first pen data when the predetermined condition is satisfied.

The controller may determine whether the predetermined condition is satisfied by using second pen data corresponding to a pen-up time point among a plurality of pen data for the one stroke.

Also, the controller may determine the second area based on location information included in the second pen data when the predetermined condition is satisfied.

Also, the control unit may determine whether the predetermined condition is satisfied for each of a plurality of strokes included in the user's handwriting.

According to another aspect of the present invention, an electronic device for reproducing a user's handwritten content on a medium, comprising: a communication unit configured to communicate with an electronic pen that senses information on the user's handwriting; a display displaying at least a partial area of the medium image corresponding to the medium, and visually displaying the reproduced content of the user's handwriting on the medium image; and displaying a first stroke included in the user's handwriting at a corresponding position of the medium image, receiving pen data constituting a second stroke included in the user's handwriting, and constituting the second stroke. Based on at least one pen data among the pen data, it is determined whether the position of the second stroke satisfies a predetermined condition, and if the predetermined condition is satisfied, the at least one pen constituting the second stroke a control unit shifting at least a partial area of the medium image being displayed on the display based on data corresponding to the distance and direction of the first stroke; An electronic device including a may be provided.

The predetermined condition may be whether the positional information of the at least one pen data constituting the second stroke is out of a partial area of the image of the medium currently being displayed through the display.

The controller may shift at least a partial region of the medium image so that a location corresponding to the at least one pen data is located in a central portion.

The at least one pen data may be at least one of pen data corresponding to a pen-down time point and pen data corresponding to a pen-up time point among a plurality of pen data constituting the second stroke.

According to another aspect of the present invention, an electronic device for reproducing a user's handwriting on a medium, comprising: a communication unit configured to communicate with an electronic pen that senses information on the user's handwriting; a display displaying a medium image corresponding to the medium, and visually displaying the reproduction of the user's handwritten content on the medium image; and determining whether the user's writing content is being reproduced through the display in a normal mode or an enlarged mode, and in the case of the normal mode, the user's writing content is reproduced according to a first reproduction mode, and in the enlarged mode, a controller for reproducing the user's handwritten content according to a second reproduction mode; and when reproducing the user's handwritten contents according to the second reproduction mode, the control unit, in the enlarged mode, moves a partial area of the medium image being displayed on the display to the user's writing position. An electronic device characterized in that it shifts along may be provided.

According to another aspect of the present invention, a control method of an electronic device for reproducing a user's handwriting on a medium is provided based on pen data received from a communication unit communicating with an electronic pen that detects information on the user's handwriting. determining whether a user's handwriting position satisfies a predetermined condition for a first area that is at least a part of a medium image being displayed on a display; When the predetermined condition is satisfied, a part of the medium image being displayed through the display is displayed in the first area in a different manner from that of the first area so that the reproduction of the user's handwriting can be displayed through the display. shifting to a second area and displaying the second area through the display; and displaying the reproduction of the user's handwritten content at a position on the second area corresponding to the user's writing position, in order to reproduce the user's handwritten content. A control method of an electronic device comprising a may be provided.

The predetermined condition may be whether a writing position of the user is out of the first area.

The predetermined condition may be whether the writing position of the user is included in an edge area of the first area.

The second area may be determined based on a writing position of the user with respect to the medium.

The second area may be determined such that a writing position of the user with respect to the medium is located at a central portion.

In determining whether the predetermined condition is satisfied, the determining step may include determining whether the predetermined condition is satisfied using at least some pen data among a plurality of pen data for one stroke included in the user's handwriting. may be judging.

The determining may include determining whether the predetermined condition is satisfied using first pen data corresponding to a pen-down time point among a plurality of pen data for the one stroke.

When the predetermined condition is satisfied, the second area may be determined based on location information included in the first pen data.

The determining may include determining whether the predetermined condition is satisfied using second pen data corresponding to a pen-up time point among a plurality of pen data for the single stroke.

When the predetermined condition is satisfied, the second area may be determined based on location information included in the second pen data.

In the determining step, it may be determined whether the predetermined condition is satisfied for each of a plurality of strokes included in the handwriting of the user.

According to another aspect of the present invention, there is provided a control method of an electronic device for reproducing a user's handwritten content on medium, comprising the steps of: receiving pen data constituting a first stroke included in the user's handwriting from an electronic pen; displaying a first stroke included in the user's handwriting at a corresponding position of the medium image; receiving, from the electronic pen, pen data constituting a second stroke included in the handwriting of the user; determining whether a position of the second stroke satisfies a predetermined condition based on at least one pen data among pen data constituting the second stroke; When the predetermined condition is satisfied, at least a partial area of the medium image being displayed through the display is shifted according to the distance and direction of the at least one pen data constituting the second stroke to the first stroke. doing; and displaying the medium image with the second stroke on the shifted partial area. A control method of an electronic device comprising a may be provided.

According to another aspect of the present invention, a control method of an electronic device for reproducing a user's writing content on a medium, comprising the steps of determining whether the user's writing content is being reproduced in a normal mode or an enlarged mode through a display. ; and reproducing the user's handwritten content according to a first reproduction mode in case of the normal mode, and reproducing the user's handwritten content according to a second reproduction mode in case of the enlarged mode; and when reproducing the user's handwritten contents according to the second reproduction mode, the control unit, in the enlarged mode, moves a partial area of the medium image being displayed on the display to the user's writing position. A control method of an electronic device characterized in that it shifts along can be provided.

According to another aspect of the present invention, a recording medium recording a program for executing the control method of an electronic device provided by the present invention described above may be provided.

First, an electronic pen related to some embodiments of the present invention and an electronic device interlocking with the electronic pen will be briefly described, and an electronic pen and electronic device interlocking with the electronic pen according to embodiments of the present invention will be briefly described. And the control method of the electronic device will be described in detail.

<System configuration>

1 is a schematic diagram for explaining a system including an electronic pen and an electronic device interlocking with the electronic pen related to embodiments of the present invention.

The system may include at least one medium 1000, at least one electronic pen 2000, at least one electronic device 3000, and at least one server 4000.

The medium 1000 provides a surface on which a user writes desired items using an electronic pen according to embodiments of the present invention.

The medium 1000 may be made of a material such as paper, plastic, or metal, and the material of the medium 1000 is not limited by the present invention.

Medium 1000, when the electronic pen according to the embodiments of the present invention is an electronic pen implemented using an optical component including a camera module (hereinafter, referred to as an optical electronic pen), by the electronic pen It may have a code pattern that can be recognized. A detailed description of code patterns will be provided later. When the medium 1000 is provided with a code pattern, the code pattern may be provided to the medium 1000 through a method such as printing.

The electronic pen 2000 may detect information about the user's handwriting and generate pen data. The pen data may be used to generate stroke data for the user's handwriting. A detailed explanation of pen data will be given later.

The electronic device 3000 may receive and interpret pen data from the electronic pen 2000 . Stroke data may be generated according to the analysis of the pen data.

The electronic device 3000 may appropriately process the analyzed stroke data and reproduce and display the user's handwriting in real time according to the stroke data through a display or the like provided in the electronic device 3000 or replay and display it later.

In addition, the electronic device 3000 may store pen data and/or stroke data generated by interpreting the pen data, such as a memory provided in the electronic device 3000, and may store pen data and/or stroke data according to a user's request. Alternatively, appropriate processing may be performed on the stroke data.

The electronic device 3000 may be connected to the server 4000 through a network to transmit or receive necessary information through a network.

The server 4000 may receive or transmit necessary information by being connected to the electronic device 3000 through a network.

The server 4000 may be connected to the plurality of electronic devices 3000 and form a database of pen data (or stroke data) received from the electronic devices 3000 .

The server 4000 may appropriately process pen data (or stroke data) stored in a database according to a request of the plurality of electronic devices 3000 or a user's request.

The server 4000 may share and perform some or all of the functions of the electronic device 3000 described above. For example, the electronic device 3000 may receive pen data from the electronic pen 2000 and directly transmit the pen data to the server 4000 without performing a special processing procedure for the pen data. As described above, the server 4000 may perform operations such as generating stroke data by receiving pen data, storing stroke data, and additionally processing stroke data.

1 shows that one medium 1000-1 corresponds to one electronic pen 2000-1, but the correspondence relationship between the medium 1000 and the electronic pen 2000 is 1:N or N: It is okay to correspond according to the correspondence relationship of 1.

In addition, although one electronic pen 2000-1 is shown as corresponding to one electronic device 3000-1 in FIG. 1, the correspondence relationship between the electronic pen 2000 and the electronic device 3000 is also It is okay to correspond according to the correspondence relationship of 1:N or N:1.

In addition, although a plurality of electronic devices 30000 are shown in FIG. 1 as being connected to one server 4000, a system according to embodiments of the present invention may include two or more servers.

Meanwhile, in FIG. 1 , the electronic pen 2000 is shown to communicate with the electronic device 3000, and the electronic device 3000 is shown to communicate with the electronic pen 2000 and the server 4000. However, if necessary, the electronic pen 2000 may directly communicate with the server 4000.

<medium>

Next, the medium 1000 related to the embodiments of the present invention will be described.

2 is a diagram showing an embodiment of a medium related to embodiments of the present invention.

Referring to FIG. 2 , it is shown that a notebook or a book has a plurality of mediums 1000 . As shown in FIG. 2 , according to some embodiments of the present invention, at least some or all of pages constituting a notebook or book may be implemented as a medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical electronic pen, at least some or all of the pages constituting a notebook or book may be provided with a code pattern according to embodiments of the present invention.

Meanwhile, only at least a portion of the entire surface of a page constituting a notebook or book may be implemented as the medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical electronic pen, the code pattern is not provided on the entire surface of the page constituting the note or book, but only on a part of the surface. may have been

Meanwhile, although not shown in the drawings, the medium 1000 according to embodiments of the present invention may be implemented in the form of a blackboard or the like. That is, the medium 1000 according to the embodiments of the present invention may be implemented in the form of a blackboard (electronic blackboard) equipped with code patterns.

<Electronic Pen>

Next, electronic pens according to embodiments of the present invention will be described.

3 is a diagram illustrating an exemplary appearance of an electronic pen according to embodiments of the present invention, and FIG. 4 is a block diagram illustrating components of an electronic pen according to embodiments of the present invention.

Referring to FIG. 3, the electronic pen 2000 includes a main body 2020 that fixes the position of a core 2010 (see FIG. 42) enabling writing on a medium 1000 and a core 2010 in a non-use state. ) It may include a cap portion 2030 that protects.

Here, the non-use state may refer to a state in which the electronic pen 2000 according to an embodiment of the present invention is stored, and in this case, the core 2010 is not exposed to the outside, so that writing on a medium is impossible. can mean

The core 2010 may include a ball and ink as components to enable writing on the medium 1000, and the ink may be oil-based, water-based, or neutral.

In addition, the core 2010 may be a black lead used in a pencil or a lead used in a general writing instrument.

The body part 2020 is a component that is inserted to expose a part of the core part 2010 to fix the position of the core part 2010, and may mean a kind of grip part that a user can grip with his/her hand.

The cap part 2030 may have a predetermined inner space in which one side of the main body part 2020 can be inserted to protect the core part 2010 when not in use, and is inserted into the other side of the main body part 2020. In this case, writing may be possible by exposing a part of the core 2010 to the outside.

However, when writing is enabled by the core portion 2010, the cap portion 2030 does not necessarily need to be inserted into the other side of the main body portion 2020, and is separated from the main body portion 2020 in a predetermined space. It is free to be placed in

Referring to FIG. 4 , the electronic pen 2000 according to an embodiment of the present invention includes an input unit 2100, an output unit 2200, a pattern detection unit 2300, a communication unit 2400, a sensor unit 2500, A memory 2600, a power supply unit 2700 and a control unit 2800 may be included. However, since the components shown in FIG. 4 are not essential, an electronic pen having more components than the illustrated components or fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic pen 2000 will be examined in turn.

The input unit 2100 may receive a user input from a user. User input may be made in various forms including button input, key input, touch input, and voice input. For example, the electronic pen 2000 may control power on/off of the electronic pen 2000 by receiving a button input from a user.

Examples of the input unit 2100 include a touch sensor for detecting a user's touch, a microphone for receiving a voice signal, a camera for recognizing a gesture through image recognition, and a touch sensor for detecting a user's touch, as well as a traditional button or jog wheel. Comprehensive including all types of input means that detect or receive various types of user inputs, such as proximity sensors composed of illuminance sensors or infrared sensors, motion sensors that recognize user motions through acceleration sensors or gyro sensors, etc. is a concept

The output unit 2200 may output various types of information and provide them to the user. The output unit 2200 includes a display that outputs visible light that can be recognized through the user's vision, a speaker that outputs sound that can be recognized through the user's hearing, and a vibration that can be recognized through the user's tactile sense. It should be interpreted as a comprehensive concept that includes all haptic devices and other various types of output means. For example, the electronic pen 2000 has a buzzer ( A sound having a predetermined characteristic may be output through a buzzer or the like. For another example, predetermined visible light may be output through a display such as an LED lamp in order to provide information about an operating state of the electronic pen 2000 to the user.

The pattern detection unit 2300 is a component for detecting a code pattern in which location information for determining the location of the electronic pen 2000 with respect to the medium 1000 is encoded, and includes a camera module 2320 and a lighting module ( 2340).

The camera module 2320 is for acquiring an image of a code pattern provided to the medium 1000. The camera module 2320 adjusts the electronic pen 2000 according to the user's handwriting on the medium 1000 at a predetermined time interval (eg, 1/60 second to 1/240 second, etc.) An image of a partial region of a code pattern provided in Medium 1000 is obtained. Accordingly, the electronic pen 1000 interprets the information on the unit cell included in the acquired image according to a code pattern interpretation method to be described later, and the position of the electronic pen 2000 relative to the medium 1000. can be interpreted in coordinate form.

The lighting module 2340 radiates light of a predetermined specific frequency toward the medium 1000 so that an image of a code pattern can be acquired through the camera module 2320 . The code pattern provided on the medium 1000 according to an embodiment of the present invention can be printed using an ink that absorbs infrared rays. A wavelength of light may be irradiated to the medium 1000. In this case, the camera module 2320 may be configured to capture an image of an infrared band, and for this, the camera module 2320 may include an infrared filter that selectively passes only the infrared band.

The communication unit 2400 may communicate with an external device. For example, the electronic pen 2000 may communicate with the electronic device 3000 or the server 4000 through the communication unit 2400 . Accordingly, the electronic pen 2000 can transmit and receive various types of information to and from external devices. For example, the electronic pen 2000 may transmit pen data generated by the electronic pen 2000 to the electronic device 3000 or the server 4000 through the communication unit 2400, and the electronic pen 2000 ), or commands and/or data for providing necessary information to the electronic pen 2000 may be received from the electronic device 3000 or the server 4000 through the communication unit 2400. .

The communication unit 2400 may include a wired module 2420 and a wireless module 2440.

The wired module 2420 is a module for transmitting and receiving data with an external device by wire, and may include components such as a USB port, a PS/2 port, a parallel port, and a serial port capable of transmitting and receiving data with an external device. , and may further include an Ethernet port for accessing the Internet through a LAN (Local Area Network).

The wireless module 2440 is a mobile communication module that transmits and receives data by accessing a mobile communication network via a mobile communication base station, a wireless local area network (WLAN)-based communication method such as Wi-Fi, Bluetooth, It may include a short-distance communication module using a wireless personal area network (WPAN)-based communication method such as Zigbee.

The sensor unit 2500 may sense various types of information. Here, various information can be used to generate a control signal for controlling the operation of the electronic pen 2000, and can be used to generate pen data generated by the electronic pen 2000. Various pieces of information sensed through the sensor unit 2500 may be provided to the electronic device 3000 or the server 4000 .

The sensor unit 2500 may include a pressure sensor 2520, a pen core sensor 2540, a slip sensor 2560, and the like.

The pressure sensor 2520 may sense pressure generated when the user writes. For example, when a user writes using the electronic pen 2000, a contact of the electronic pen 2000 with the writing surface occurs, and the pressure generated at this time is sensed by the pressure sensor 2520. can In particular, the pressure sensor 2520 is provided at the rear end of the pen core (core part, 2010) mounted on the electronic pen 2000 (the other end side of both ends of the pen nib other than the pen tip) to sense the pressure. The electronic pen 2000 may use a pressure value sensed through the pressure sensor 2520 when generating pen data, which will be described in detail later. At this time, the pressure value included in the pen data can be processed into pen pressure information applied to the medium 1000 when the user writes, and used to reproduce the content written by the user. Alternatively, based on the signal output through the pressure sensor 2520, the electronic pen 2000 in an off state may be used as a trigger signal for turning on the electronic pen 2000.

The pen core sensor 2540 may detect a pen core identifier for indicating the type of the pen core (core 2010) mounted on the electronic pen 2000. For example, a pen core identifier for indicating the color of the pen core (core portion 2010) may be provided on the outside of the pen core (core portion 2010) mounted on the electronic pen 2000. At this time, the pen core sensor 2540 may detect the pen core identifier through an optical/magnetic method and other various usable methods. The value sensed by the pen core sensor 2540 or information about the pen core (core, 2010) interpreted by the sensed value may be provided to the electronic device 3000, and the electronic device 3000 may receive the information Based on this, it can be used to reproduce the contents handwritten by the user.

The slip sensor 2560 may detect a state of the electronic pen 2000 used to determine whether the electronic pen 2000 in an on state automatically switches to an off state. For example, the slip sensor 2560 may include an acceleration sensor, etc., through which the movement of the electronic pen 2000 may be detected. If it is determined that the electronic pen 2000 is not moving for a predetermined time based on the value sensed through the slip sensor 2560, the electronic pen 2000 automatically moves the electronic pen 2000. The state can be switched to off state.

According to some embodiments of the present invention, when the electronic pen 2000 is in an on state, power is normally supplied to the components provided in the electronic pen 2000 so that the components normally operate as needed. However, when the electronic pen 2000 is in an off state, power to all or some of the components provided in the electronic pen 2000 is cut off and provided in the electronic pen 2000. All or some of the components present cannot operate normally. In particular, according to some embodiments of the present invention, even when the electronic pen 2000 is in an off state, the pressure sensor 2520 and/or an analysis module for interpreting a signal output from the pressure sensor normally Power may be supplied, and thus, the electronic pen 2000 in an off state may be automatically switched to an on state based on a sensing value output from the pressure sensor 2520 .

The memory 2600 can store various kinds of information. The memory 2600 may temporarily or semi-permanently store data. The memory 2600 may store operating programs such as firmware for driving the electronic pen 2000, and, if necessary, pen data generated by the electronic pen 2000 and the sensor unit 2500. Information, commands, and data necessary for driving the electronic pen 2000, such as a sensing value output by the , may be stored.

Examples of the memory 2600 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), a random access memory (RAM), and the like. This can be.

The power supply unit 2700 may provide power necessary for the operation of each component of the electronic pen 2000 . The power supply unit 2700 may be implemented as a rechargeable battery, and when the communication unit 2400 of the electronic pen 2000 includes a charging port (eg, USB port), the electronic pen ( When the electronic device 2000 is connected to the electronic device 3000, power may be supplied from the electronic device 3000, and thus the battery may be charged.

The controller 2800 controls overall operations of the electronic pen 2000 . To this end, the controller 2800 may perform calculations and processing of various types of information and control operations of elements of the electronic pen 2000 .

In addition, the controller 2800 may analyze the image of the code pattern obtained by the pattern detector 2300 to decode information encoded in a unit cell included in the image of the obtained code pattern. Furthermore, the positional coordinates of the electronic pen 2000 with respect to the medium 1000 and identification information (eg, book information or page information) with respect to the medium 1000 may be obtained from the decoded information.

The controller 2800 may generate pen data based on information obtained by decoding information encoded in a unit cell, and as described above, the generated pen data may be stored in the memory 2600 or described above. It can be transmitted to the electronic device 3000 and/or the server 4000 through the communication unit 2400. A detailed description of the creation of pen data will be given later.

Meanwhile, the controller 2800 analyzes the image acquired by the first controller and the pattern detector 2300 for controlling general operations of the electronic pen 2000, decodes information necessary for a unit cell, and It can be divided into a second controller for generating pen data. The controller 2800 can be logically divided into the first controller and the second controller, but the first controller and the second controller are physically It may be implemented in a form that is separated from each other.

The control unit 2800 may be implemented with a computer or a similar device according to hardware software or a combination thereof. The hardware-type control unit may be provided in the form of an electronic circuit that performs a control function by processing electrical signals, and may be provided in the form of a program that drives the hardware-type control unit in terms of software.

Meanwhile, in the following description, unless otherwise specified, the operation of the electronic pen 2000 may be interpreted as being performed under the control of the controller 2800.

<Electronic devices>

Next, the electronic device 3000 according to embodiments of the present invention will be described.

5 is a block diagram for explaining components of an electronic device according to embodiments of the present invention.

Referring to FIG. 5 , an electronic device 3000 may include an input module 3100, an output module 3200, a communication module 3300, a memory module 3400, and a control module 3500. However, the components shown in FIG. 5 are not essential, so an electronic device having more components than the illustrated components or fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic device 3000 will be looked at in turn.

The input module 3100 may receive a user input from a user. User input may be made in various forms including key input, touch input, and voice input. Examples of the input module 3100 that can receive such user input include a traditional keypad, keyboard, and mouse, as well as a touch sensor that detects a user's touch, a microphone that receives a voice signal, and gesture recognition through image recognition. A camera that detects user approach, a proximity sensor composed of an illuminance sensor or an infrared sensor that detects user approach, a motion sensor that recognizes user motion through an acceleration sensor or gyro sensor, and various other forms that detect or receive user input. It is a comprehensive concept that includes all input means of Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor that detects a touch through a touch panel attached to a display panel or a touch film, an optical touch sensor that detects a touch by an optical method, and the like.

The output module 3200 may output various types of information and provide them to the user. The output module 3200 includes a display that outputs visible light that can be recognized through the user's vision, a speaker that outputs sound that can be recognized through the user's hearing, and a vibration that can be recognized through the user's tactile sense. It is a comprehensive concept that includes both haptic devices and other various types of output means.

The display may output an image for reproducing the contents written by the user using the electronic pen 2000 and/or the electronic device 3000 according to an embodiment of the present invention.

In addition, the display is a liquid crystal display (LCD: Liquid Crystal Display),

Light emitting diode (LED) display, organic light emitting diode (OLED) display, flat panel display (FPD), transparent display, curved display, flexible display (flexible display), 3D display (3D display), holographic display (holographic display), a concept that means an image display device in a broad sense that includes all types of devices capable of performing image output functions such as projectors and others to be. Such a display may be in the form of a touch display integrated with the touch sensor of the input module 3100.

The communication module 3300 may perform communication with an external device. For example, the electronic device 3000 may communicate with the electronic pen 2000 or the server 4000 through the communication module 3300 . Accordingly, the electronic device 3000 may transmit and receive various types of information with the external device. For example, the electronic device 3000 may receive pen data generated by the electronic pen 2000 through the communication module 3300 and transmit necessary information to the electronic pen 2000 . In addition, the electronic device 3000 may transmit pen data received from the electronic pen 2000 or stroke data obtained by analyzing the pen data to the server 4000 through the communication module 3300, and necessary information may be provided. may be received from the server 4000.

The communication module 3300 is a wired communication module including a LAN port, USB port, PS/2 port, parallel port, serial port, etc. connected to the Internet through a LAN (Local Area Network), and mobile communication via a mobile communication base station. A mobile communication module that transmits and receives data by connecting to a network, a communication method of WLAN (Wireless Local Area Network) such as Wi-Fi, or a WPAN (Wireless Personal Area Network) such as Bluetooth or Zigbee It may be composed of a short-range communication module using a communication method, a satellite communication module using a global navigation satellite system (GNSS) such as a global positioning system (GPS), or a combination thereof.

The memory module 3400 may store various kinds of information. The memory module 3400 may temporarily or semi-permanently store data. An operating system (OS) for driving the electronic device 3000 may be stored in the memory module 3400, and, if necessary, various data received from the electronic pen 2000 and the electronic pen 2000 may be stored. Application programs for processing various data received from may be stored.

Examples of the memory module 3400 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), and a random access memory (RAM). etc. may be present.

The control module 3500 controls the overall operation of the electronic device 3000. To this end, the control module 3500 may perform calculations and processing of various types of information and control the operation of components of the electronic device 3000 .

The control module 3500 may be implemented in a computer or similar device according to hardware software or a combination thereof. The hardware-type control module may be provided in the form of an electronic circuit that performs a control function by processing electrical signals, and may be provided in the form of a program that drives a hardware-type control module in terms of software.

Meanwhile, in the following description, unless otherwise noted, the operation of the electronic device 3000 may be interpreted as being performed by the control of the control module 3500.

<Operation of the electronic pen>

Hereinafter, an operation of an electronic pen according to embodiments of the present invention will be described.

A user may write on the medium 1000 according to some embodiments of the present invention using the electronic pen 2000 according to the embodiments of the present invention.

In addition, the electronic pen 2000 according to embodiments of the present invention acquires an image of at least a partial region of a code pattern provided in the medium 1000 according to some embodiments of the present invention, and acquires the acquired image. Location information may be obtained by interpreting information encoded in a unit cell included in the cell. While the user is taking notes, the electronic pen 2000 continuously acquires and processes/stores the image of the code pattern and the location information interpreted therefrom. It is possible to generate basic data capable of interpreting whether or not the handwriting progressed along the trajectory.

Hereinafter, code patterns according to embodiments of the present invention capable of encoding location information and the like will be described first, and location information encoded in the code pattern using an image of the code pattern will be described in the electronic pen (2000). ) explains how to interpret it.

However, since the electronic pen 2000 according to embodiments of the present invention uses a commonly used pen nib (core, 2010), writing is necessarily performed only for the medium 1000 according to some embodiments of the present invention. It is not possible, but it is also possible to write on a general medium (eg, paper on which no code pattern is provided). However, in this case, since the electronic pen 2000 cannot acquire location information for interpreting the user's writing trajectory, operations such as real-time reproduction and replay of the user's writing trajectory, which will be described later, may be performed by the electronic device ( 3000) and the like would be impossible.

1. Code patterns

A code pattern according to an embodiment of the present invention is configured in such a way that one unit cell is repeatedly arranged two-dimensionally according to a desired size.

6 and 7 are diagrams exemplarily illustrating unit cells constituting a code pattern according to an embodiment of the present invention.

Referring to FIGS. 6 and 7 , each unit cell includes code in the form of a line segment, and the code in the form of a line segment can be largely classified into a reference code and an information code.

The reference code is composed of a horizontal reference code, a vertical reference code, and a cross reference code.

The reference code has a function of confirming the area of a unit cell when decoding a code pattern.

The information code performs a function of representing information to be encoded in a unit cell in a manner described later.

Except for the intersection reference code, the rest of the reference codes and information codes all have the same geometric shape. That is, the reference codes and the information codes, excluding the intersection reference code, have rotationally symmetrical shapes and are 'segmented'.

Unlike other reference codes and information codes, the cross reference code has a cross-shaped geometric shape.

Meanwhile, within the unit cell, virtual lines may be defined, and the virtual lines are composed of a plurality of horizontal virtual lines extending in the horizontal direction and a plurality of vertical virtual lines extending in the vertical direction. In the description of some embodiments of the present invention, a component called a 'virtual line' may be actually printed on the medium 1000 or may not be printed.

Each of the plurality of horizontal virtual lines are parallel to each other and are spaced apart from each other by a predetermined interval.

In addition, each of the plurality of vertical virtual lines are parallel to each other and are spaced apart from each other by a predetermined interval.

Any one of the plurality of horizontal virtual lines is orthogonal to any one of the plurality of vertical virtual lines and each other.

A plurality of intersection points formed by meeting a plurality of horizontal virtual lines and a plurality of vertical virtual lines are formed, and these plurality of intersection points are hereinafter referred to as virtual reference points. In the description of some embodiments of the present invention, a component called a 'virtual store' may be actually printed on the medium 1000 or may not be printed.

Referring to FIG. 6, one unit cell is illustrated as having a total of 7 horizontal virtual lines and 7 vertical virtual lines, and the horizontal reference codes are disposed on the uppermost horizontal virtual line among them. , and it is shown that the vertical reference codes are disposed on the vertical virtual line disposed on the leftmost side.

Reference codes are arranged on virtual reference points. In particular, the reference codes are arranged such that their center of mass is at the virtual reference point. That is, the horizontal reference codes and the vertical reference codes are arranged so that a virtual reference point can be located at the center of both ends of each reference code. In addition, the intersection reference code having a cross-shaped geometric shape is arranged such that the center of the cross lies at the virtual reference point.

Information codes are also placed on the virtual reference points. In particular, the information codes are arranged so that their center of mass is not placed at a virtual reference point, unlike reference codes. That is, the virtual reference point is not disposed at the center of both ends of the information codes. In the case of an information code, one end of both ends is placed near the virtual reference point, and the other end is determined according to the value to be encoded in the information code. , is placed at a different location from the virtual reference point. This will be described in detail in the method of encoding information in information codes.

The code pattern having the above-described shape and components is formed on the medium 1000, and the actual formation of the code pattern on the medium 1000 can be implemented by printing or a similar method. At this time, when the code pattern is printed on the medium 1000, as shown in FIG. 7, only the aforementioned reference code and information code can be printed. That is, horizontal virtual lines, vertical virtual lines, and virtual reference points among components constituting the above-described code pattern may not be actually printed.

2. Encoding/decoding of information

The basic principle of encoding information into an information code is to place one end of the information code near a virtual reference point and place the other end of the information code so that the information code passes the virtual reference point. The desired information is encoded in the corresponding information code using the relationship with the end.

That is, the direction of the information code (hereinafter referred to as the direction of the information code) from one end of the information code (the end disposed closer to the virtual reference point) to the other end (the end disposed farther from the virtual reference point). ), the desired information is encoded in the corresponding information code.

A method of encoding information in an information code will be described in more detail. However, for convenience of explanation, a case in which information that can be encoded in one information code is 2 bits will be described as an example.

8 is a diagram for explaining a method of encoding 2-bit information in an information code according to embodiments of the present invention.

For a clear explanation, assume a Cartesian coordinate system defined in the directions of horizontal reference codes and vertical reference codes provided in a unit cell, with a virtual reference point at which information codes to be encoded are placed as an origin.

At this time, when the information to be encoded through the information code is '00', one end of the information code (the end located closer to the virtual reference point) is in the third quadrant of the Cartesian coordinate system, and the other end (the above) The end located farther from the virtual reference point) can determine the direction of the information code so that it can be located in the first quadrant of the Cartesian coordinate system (see (a) of FIG. 8).

If the information to be encoded through the information code is '01', one end of the information code (the end located closer to the virtual reference point) is in the 4th quadrant of the Cartesian coordinate system, and the other end (the virtual reference point) The end located further away from ) can determine the direction of the information code so that it can be located in the second quadrant of the Cartesian coordinate system (see (b) of FIG. 8).

In addition, when the information to be encoded through the information code is '10', one end of the information code (the end located closer to the virtual reference point) is in the first quadrant of the Cartesian coordinate system, and the other end (the above) The end located farther from the virtual reference point) can determine the direction of the information code so that it can be located in the third quadrant of the Cartesian coordinate system (see (c) of FIG. 8).

In addition, when the information to be encoded through the information code is '11', one end of the information code (the end located closer to the virtual reference point) is in the second quadrant of the Cartesian coordinate system, and the other end (the above) The end located farther from the virtual reference point) can determine the direction of the information code so that it can be located in the fourth quadrant of the Cartesian coordinate system (see (d) of FIG. 8).

If, as shown in FIG. 8, the information code is designed so that 2-bit information can be encoded in the information code, and as shown in FIGS. 6 and 7, one unit cell contains 36 information codes. If there is, the information that can be encoded in one unit cell may be 2 bits * 36 = 72 bits.

However, the method of encoding information into an information code according to embodiments of the present invention is from one end of the information code (eg, an end located closer to the virtual reference point) to the other end of the information code (eg, For example, the number of bits of information that can be encoded in the information code is not limited to 2 bits, and may be 3 bits or more. For example, if the direction of the information code is interpreted in units of 45 degrees in order to encode information into the information code, there are a total of 8 distinct directions of the information code, and accordingly, a total of 3 bits of information is stored in one information code. can be encoded.

3. Configuration of unit cell information

Next, information encoded in a unit cell will be described.

The unit cell information encoded in the unit cell may include error verification information, medium identification information, coordinate information, and other additional information.

The error verification information is information for determining whether an error has occurred when encoding a unit cell.

The medium identification information is identification information about the medium 1000 provided with the unit cell. The medium identification information may include book information, page information, and the like.

Book information refers to identification information assigned to a corresponding note or book when the plurality of mediums 1000 are manufactured in the form of a note or a book.

The page information is used to identify which page the medium 1000 provided with the unit cell is located in, when the plurality of mediums 1000 are manufactured in the form of a notebook or a book. means information.

In addition, if the medium 1000 is implemented to have a special format for a special purpose (eg, a paper including a security checklist, a test paper, etc.), the medium identification information, the medium 1000 It may contain information to identify which format it has.

Coordinate information refers to two-dimensional coordinate information indicating at which position the unit cell is located on the medium 1000 provided with the unit cell. Accordingly, the coordinate information may include an x-coordinate and a y-coordinate.

Other additional information may include various other necessary information. For example, license information about coordinate codes provided to Medium 1000 may be included in the other additional information.

As described above, the electronic pen 2000 analyzes at least one unit cell included in the image acquired through the pattern detection unit 2300 and decodes information encoded in the corresponding unit cell. Cell information can be obtained, and accordingly, medium identification information, coordinate information, and other additional information included in unit cell information can be obtained.

4. Creation of pen data

Next, a method for generating pen data by the electronic pen 2000 based on unit cell information will be briefly described.

Pen data refers to information used to reproduce a user's writing trajectory in real time or to generate stroke data necessary for replay later, in addition to unit cell information obtained by the electronic pen 2000 .

Pen data may include time information, pen pressure information, location information, and medium identification information.

The time information is information about a point in time when an image used to generate one unit pen data is obtained or a point in time when one unit pen data is generated.

The pen pressure information is pressure information output from the pressure sensor 2520 when an image used to generate one unit pen data is obtained or when one unit pen data is generated.

Since the medium identification information is the same as or similar to information included in the unit cell information, a detailed description thereof will be omitted.

The location information is information about the location of the electronic pen 2000 with respect to the medium 1000 that is generated by performing a necessary correction on coordinate information obtained from unit cell information. The location information may or may not coincide with coordinate information obtained from unit cell information, and a method for generating location information will be described in detail below.

9 is a diagram for explaining a method of generating location information of an electronic pen for a medium according to embodiments of the present invention.

Referring to FIG. 9 , an image I obtained by the camera module 2320 of the electronic pen 2000 is shown as an example. As shown in FIG. 9 , at least one image I is obtained. The above unit cell UC may be included, and the position CC of the unit cell UC may be obtained in the form of coordinates by interpreting information encoded in the unit cell by the above-described method. At this time, as shown, since the unit cell UC used to interpret the coordinate information may not be located in the center of the acquired image I, the unit cell UC obtained by the analysis The coordinate information may have a slight difference from the exact location of the electronic pen 2000 relative to the medium 1000. That is, it can be assumed that the center (IC) of the acquired image (I) is closest to the position of the electronic pen 2000 with respect to the medium 1000, and the center (IC) of the acquired image (I) is the unit cell. It may be different from the coordinates (x, y) obtained by the coordinate information obtained from (UC).

Accordingly, the electronic pen 2000, in order to acquire the coordinates (x', y') of the center (IC) of the acquired image (I), coordinate information obtained from the unit cell (UC) and the acquired image ( Obtained by calculating an offset between the centers (IC) of I) and adding or subtracting the calculated offset values (?x, ?y) to the coordinate information (x, y) obtained from the unit cell (UC) The coordinates (x', y') of the center (IC) of the image (I) are calculated.

As described above, the position of the electronic pen 2000 relative to the medium 1000 can be more accurately calculated, and the coordinate values (x', y') corrected in the above manner are the above-described location information. to be.

As described above, the electronic pen 2000 may continuously generate pen data, and thus, the positional movement of the electronic pen 2000 relative to the medium 1000 according to the user's handwriting is in the form of pen data in real time. , and the pen data can be appropriately processed later as needed by the electronic device 3000 or the server 4000.

<Operation of electronic devices>

As described above, when pen data is generated, the electronic pen 2000 may store the pen data in the memory 2600 or transmit the pen data to the electronic device 3000 through the communication unit 2400.

For example, when the electronic pen 2000 is in a communicable state with the electronic device 3000, the electronic pen 2000 may generate pen data and directly transmit the pen data to the electronic device 3000 in real time, but if When the electronic pen 2000 is not in a state capable of communicating with the electronic device 3000, the electronic pen 2000 generates pen data, stores it in the memory 2600, and then communicates with the electronic device 3000 later. , the stored pen data can be transmitted to the electronic device 3000 .

Hereinafter, the operation of the electronic device 3000 that has received pen data will be described.

1. Real-time reproduction of handwritten content #1

Based on the pen data received from the electronic pen 2000, the electronic device 3000 may reproduce in real time what the user writes on the medium 1000 and display it on the display of the electronic device 3000. Hereinafter, a method of reproducing notes written by a user in real time and displaying them on a display will be described.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 are connected in a communicable state, and the electronic pen 2000 transmits pen data generated as described above in real time to the electronic device ( 3000) is assumed.

The electronic device 3000 may obtain information about the target medium 1000 on which the user writes notes, based on the medium identification information included in the pen data received from the electronic pen 2000 .

For example, the electronic device 3000 determines whether the target medium 1000 on which the user writes notes is a medium having a specific format for a special purpose, or a medium that forms part of a product provided in the form of a book or note. acknowledgment, etc.

In addition, if the target medium 1000 is a medium constituting a part of a product provided in the form of a book or note, it is possible to check whether the target medium 1000 is a medium located on what page of the book or note. there is.

Based on the acquired medium identification information, the electronic device 3000 can display a template previously stored for the target medium 1000 or handwritten contents already written by the user for the target medium 1000 on the display. can

At this time, the pre-stored template for the target medium 1000 means to include already printed text, images, shapes, symbols, etc. in addition to the code pattern on the target medium 1000, for example, When the target medium 1000 forms a part of a note, a plurality of lines may be printed on the target medium 1000 for easy writing by the user, and information such as that the plurality of lines is printed It may be included in the previously stored template information for the target medium 1000. As another example, if the target medium 1000 forms part of a diary-like notebook, a specific date such as February 1, 2015 may be printed on the target medium 1000. That special information is printed on 1000 may also be included in the predetermined template information. Hereinafter, for convenience, an image displayed for the target medium 1000 configured by including the aforementioned template information may be referred to as a medium image.

Subsequently, the electronic device 3000 may generate stroke data corresponding to the trajectory the user is writing to be displayed on the display based on the location information and time information included in the received pen data. In order to generate stroke data, at least one unit pen data may be used.

When stroke data is generated, according to the generated stroke data, the electronic device 3000 can reproduce the trajectory written by the user on the target medium 1000 as it is at a corresponding position on a predetermined template displayed on the display. . FIG. 10 shows that the contents written by the user on the target medium 1000b are reproduced on the display of the electronic device 3000 in real time.

When the user's handwritten content is reproduced through the electronic device 3000, the trajectory of the user's handwritten content, the location of the user's handwritten content on the target medium 1000, etc. are location information included in the pen data information Based on , it can be accurately reproduced.

Hereinafter, for convenience of description, the operation of the electronic device 3000 according to an embodiment of reproducing a user's handwritten contents according to the present invention in real time may be referred to as operating in a 'normal reproduction mode'.

2. Real-time reproduction of handwritten content #2

Next, another embodiment of reproducing in real time what the user writes on the target medium 1000 will be described.

11 to 15 are diagrams for explaining another embodiment of reproducing a user's writing content in real time according to the present invention.

While the user is using the electronic device 3000 according to an embodiment of the present invention, the user notices that the entire surface of the target medium 1000 on which the user is currently writing is covering the electronic device 3000. However, in some cases, only a part of the surface of the target medium 1000 may be desired to be displayed through the electronic device 3000.

Hereinafter, at least a part of the medium image corresponding to the target medium 1000 displayed through the electronic device 3000 is referred to as a display area. In addition, the meaning of 'displaying a partial area (or display area) of the target medium' may mean that the area corresponding to the partial area of the target medium among the entire area of the medium image is displayed on the display as the display area.

11 exemplarily shows that only a partial area of the target medium 1000 is displayed through the electronic device 3000 .

At this time, if the user writes in another area outside the partial area being displayed through the electronic device 3000, as described above, through the electronic device 3000, the user writes in real time. What is reproduced may not be displayed on the display. For example, as shown in FIG. 12, when the user further writes 'EFG' to the right of 'ABCD', as shown in FIG. 11, the set part continues through the electronic device 3000 When displayed, the user cannot view the contents corresponding to 'E' additionally written down through the electronic device 3000.

In order to solve the problem, another embodiment of reproducing the user's handwritten content in real time according to the present invention is proposed.

The electronic device 3000 may check the position (hereinafter, the writing position) of the content currently written by the user in the target medium 1000 based on the received pen data.

Subsequently, the electronic device 3000 may determine whether the checked writing position satisfies a predetermined condition for the current display area.

For example, the electronic device 3000 may determine whether the writing position corresponds to a position out of the display area. In this case, when the electronic device 3000 determines that the writing position is outside the display area, it may be determined that the predetermined condition is satisfied.

For another example, the electronic device 3000 may determine whether the checked writing position corresponds to an edge area of the current display area. That is, the electronic device 3000 can determine whether the writing position corresponds to the edge area of the current display area, even though it is included in the current display area. In this case, the electronic device 3000 may determine that the predetermined condition is satisfied when it is determined that the writing position corresponds to the edge area of the display area.

If the electronic device 3000 determines that the writing position does not satisfy a predetermined condition (for example, when it is determined that the writing position is included in the display area), the electronic device 3000 as shown in FIG. 12 As described above, without shifting the display area, 'E' corresponding to the contents written by the user may be reproduced through the electronic device 3000 and displayed on the display.

On the other hand, when the electronic device 3000 determines that the writing position satisfies a predetermined condition (for example, when it is determined that the writing position is out of the display area), the electronic device 3000 corresponds to the writing position. The position of the display area may be shifted so that the position to be displayed on the display of the electronic device 3000.

For example, in the state where 'ABCDE' is written as shown in FIG. 12, if the user additionally writes 'F', the electronic device 3000 shifts the display area as shown in FIG. 13, Content corresponding to the user's handwriting may be reproduced in the shifted display area.

Various methods may be applied to a method for the electronic device 3000 to shift the position of the display area.

For example, the electronic device 3000 may determine the direction in which the position of the display area is to be shifted in consideration of the writing direction of the contents written by the user.

13 shows that the position of the display area is shifted in the same direction as the writing direction of 'ABCDE', which is the contents the user is writing.

For another example, the electronic device 3000 may shift the position of the display area so that the content of the handwriting written out of the original display area is displayed in the center of the shifted display area.

14 shows that the display area is shifted so that 'F', which is written out of the original display area, can be located in the center of the shifted display area.

For another example, the electronic device 3000 may shift the position of the display area in consideration of the distance and direction between the content written immediately before and the content written out of the original display area.

For another example, the electronic device 3000 may consider the edge of the media image when shifting the position of the display area. For example, the position of the display area may be shifted so that the edge of the media image does not deviate from a predetermined area of the display screen. That is, the position of the display area may be shifted so that the edge of the media image does not deviate from the edge area of the display screen. In other words, the position of the display area may be shifted so that the edge of the image is not displayed at a distance greater than or equal to a predetermined distance from the edge area of the display screen.

Meanwhile, in order to determine whether the writing position satisfies a predetermined condition, the electronic device 3000 considers pen data received from the electronic pen 2000. Various methods may be applied to a method of sampling pen data for the purpose.

For example, the electronic device 3000 determines whether the writing position satisfies a predetermined condition for the partial area (eg, whether the writing position is out of the display area) for all unit pen data. can do. When operated in this way, the electronic device 3000 will be able to reproduce the user's handwriting through the electronic device 3000 as close to real-time reproduction as possible, but a problem in that the amount of calculation may increase may occur.

For another example, the electronic device 3000 may determine whether a writing position of at least some of the pen data that may be grouped in stroke units satisfies a predetermined condition for the display area.

A stroke refers to a line drawn by a pen on a writing surface after the pen contacts the writing surface until the pen leaves the writing surface, and may also be referred to as a 'stroke'. That is, 'A' usually consists of 3 strokes, 'B' usually consists of 2 strokes, 'C' usually consists of 1 stroke, and 'D' usually consists of 2 strokes. , 'E' is generally composed of three strokes. For convenience of description below, an operation in which a user brings the electronic pen 2000 into contact with the target medium 1000 to write one stroke is referred to as 'pen down', Afterwards, an operation in which the user removes the electronic pen 2000 from the target medium 1000 will be referred to as 'pen up'.

At this time, the electronic pen 2000 generates the pen data by including the pen data sensed through the pressure sensor in the pen data, and the generated pen data is transmitted to the electronic device 3000, so the electronic device 3000 has a pen data. 'Pen-down' or 'pen-up' can be determined by using the pen pressure value included in the data. That is, when the pen pressure value suddenly rises from '0' to a specific value while receiving pen data, the electronic device 3000 may determine that 'pen down' has occurred at the time when the pen pressure value suddenly rises. For convenience, this point of time is defined as a 'pen down point'. Also, when the pen pressure value suddenly becomes '0' while receiving pen data, the electronic device 3000 may determine that 'pen up' has occurred at the time when the pen pressure value suddenly becomes '0'. For convenience, this point of time is defined as a 'pen-up point'.

The electronic device 3000 may determine whether the writing position satisfies a predetermined condition for the display area by using location information included in the pen data corresponding to the pen down time point, among the pen data grouped in stroke units. There is (hereinafter, a pen-down-based shift method). In this case, the electronic device 3000 uses only the writing position at the point of pen-down, and the positional information included in the remaining pen data among the plurality of pen data groups grouped in stroke units determines the writing position in advance with respect to the display area. It may not be used when determining whether a specified condition is satisfied.

On the other hand, the electronic device 3000 determines whether the writing position satisfies a predetermined condition for the display area by using positional information included in the pen data corresponding to the pen-up time point, among the pen data bundled in stroke units. (hereinafter, a pen-up based shift method). In this case, the electronic device 3000 uses only the writing position at the time of pen-up, and the positional information included in the remaining pen data among the plurality of pen data groups grouped in stroke units determines the writing position in advance with respect to the display area. It may not be used when determining whether a specified condition is satisfied.

Alternatively, the electronic device 3000 uses all of the location information included in the pen data corresponding to the pen up time and the pen down time, among the pen data grouped in stroke units, so that the writing position is determined in advance for the display area. It is possible to determine whether a condition is satisfied (hereinafter, a hybrid shift method). In this case, the electronic device 3000 may use only the writing positions at the pen-down and pen-up times and may not use the remaining pen data.

If the pen-down-based shift method is used, since only the shift of the display area occurs at the pen-down point, the start point of the stroke input by the user is included in the original display area, but the end point of the stroke is the original display area. If it is out of the display area of , the shift according to the present invention may not occur. That is, as shown in FIG. 15, even after the user completes all of the strokes S, since the start point SP of the stroke S was included in the original display area, the end point of the stroke S ( Even when EP) is out of the original display area, a screen as shown in (b) of FIG. 15 may be displayed through the display of the electronic device 3000 even at the pen-up time point (Tup).

If the pen-up-based shift method is used, since only the display area shifts at the point of pen-up, if the user inputs one stroke for a long time (for example, one stroke for about 5 seconds) is input), the electronic device 3000 may not perform the shift operation until the user's stroke input is finished.

If the hybrid shift method is used, advantages of both the pen-down-based shift method and the pen-down-based shift method can be taken.

On the other hand, in the method of determining the writing position by using some of a plurality of pen data that can be grouped in stroke units and performing a shift operation accordingly, as described above, the pen data at the time of pen down, the pen up In addition to the method of cooking and using pen data at the point of view, pen data at the time of pen down and pen up, there may be various methods. For example, determination of the writing position using pen data selected according to a predetermined time interval. There may be a way to do it, etc. That is, pen data at the time of pen down, pen data at the time of 0.05 seconds after the time of pen down, pen data at the time of 0.10 seconds after the time of pen down, and pen data at the time of 0.15 seconds after the time of pen down, etc. There may be a method of making a judgment about (when the predetermined time interval is 0.05 seconds).

The electronic device 3000 may determine whether or not there is at least one shift operation for one stroke. That is, for each stroke, the electronic device 3000 may determine whether the predetermined condition is satisfied by using at least one pen data among a plurality of pen data included in the stroke. In other words, the electronic device 3000 includes pen data (first pen data) corresponding to the pen-down point of time constituting one stroke, pen data (second pen data) and first pen data corresponding to the pen-up point of time. It is possible to determine whether the predetermined condition is satisfied by using at least one pen data among all pen data between the pen data and the second pen data.

As described above, in the case of another embodiment in which the contents written by the user on the target medium 1000 are reproduced in real time, the screen of the electronic device 3000 is enlarged so that only the display area of the target medium 1000 is displayed. Even when it is being displayed through the display, an effect of being able to reproduce the content written by the user in real time and display it through the display of the electronic device 3000 occurs.

Hereinafter, for convenience of explanation, the operation of the electronic device 3000 according to another embodiment of the present invention in which a user's handwriting is reproduced in real time may be referred to as an 'enlarged reproduction mode'.

3. Real-time reproduction of handwritten contents by user #3

Hereinafter, for convenience of description, a mode in which only a partial area of the target medium 1000 is displayed through the electronic device 3000 may be referred to as an 'enlarged mode', and the entire area of the target medium 1000 All of these modes displayed through the electronic device 3000 may be referred to as a 'normal mode'.

The electronic device 3000 may operate in the above-described 'normal reproduction mode' or 'enlarged reproduction mode' in order to reproduce the user's writing content in real time according to the present invention.

For example, the electronic device 3000 determines whether the current display mode of the electronic device 3000 is 'normal mode' or 'enlarged mode', and reproduces the user's writing content in real time according to the determination result. You can operate by selecting the mode to do. That is, when the display mode of the electronic device 3000 is the 'normal mode', the electronic device 3000 reproduces the user's writing contents in real time according to the 'normal reproduction mode' described above, and the electronic device 3000 When the display mode of is the 'enlarged mode', the user's handwriting can be reproduced in real time according to the above-described 'enlarged reproduction mode'.

In this way, when the reproduction mode is selectively set and operated, the 'enlarged reproduction mode', which has a relatively large amount of calculation, is applied only when the screen is enlarged and displayed, and when the screen is not enlarged and displayed, the relative As a result, it is possible to operate in a 'normal reproduction mode' with a smaller amount of calculation, so that the user's handwritten contents can be reproduced in real time more effectively and efficiently.

4. Replay of written content #1

Based on the pen data received from the electronic pen 2000, the electronic device 3000 may later replay the content the user writes on the medium 1000 and display it on the display of the electronic device 3000. Hereinafter, a method of replaying and displaying notes written by a user on a display in real time will be described.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 receive and store pen data related to items written by the user on the target medium 1000 using the electronic pen 2000. do.

The electronic device 3000 may detect whether a predetermined event for replaying the user's handwritten content has occurred.

For example, the predetermined event may be a user's request. That is, the electronic device 3000 can provide a user interface (UI) through which the user can request a replay of the writing contents through the electronic device 3000, and the user writes through the user interface. A replay of the content may be requested, and accordingly, the electronic device 3000 may determine that a predetermined event has occurred and perform a replay operation of the written content according to the present invention.

For another example, the predetermined event may be a request of an operating system (OS) of the electronic device 3000 or another application installed in the electronic device 3000 .

For another example, the predetermined event may be a meeting of a predetermined condition. That is, when a predetermined condition of 'arrival at a specific time' is set, the electronic device 3000 monitors the current time, determines whether the 'specific time' of the predetermined condition has been reached, and reaches the corresponding time. In this case, it is determined that a predetermined event has occurred, and a replay operation for the user's handwriting according to the present invention can be performed. The predetermined condition is not limited to the condition for 'time' as in the above-described example, and may be set in various forms.

When the predetermined event occurs, the electronic device 3000 may determine target content for performing a replay operation on the written content.

For example, the electronic device 3000 may store all pen data for the contents written by the user on the medium 1000 using the electronic pen 2000, and among these written contents, a replay operation may be performed. It is possible to determine the target writing contents to be performed. That is, if the target medium 1000 is provided in the form of a note, the electronic device 3000 converts all the contents written by the user on the plurality of pages of the note in the form of pen data (or stroke data form). It may be stored, and at this time, the electronic device 3000 may determine which page (one page or a plurality of pages) of a plurality of pages to perform a replay operation, or, even within the same page, any specific page It is possible to determine whether or not to perform a replay operation on the content written in the area.

The electronic device 3000 may consider the predetermined event in determining the content to be replayed.

For example, when the predetermined event is a user's request, the content to be replayed may be determined according to the user's request. For another example, when the predetermined event is a request of an operating system or another application, the content to be replayed may be determined in consideration of the corresponding request.

When the contents to be replayed are determined, a target section to be replayed may be determined. For example, when the electronic device 3000 determines a specific page of a note as a replay target section as a replay target content, a plurality of strokes written on the determined specific page are determined as a replay target, and the replay target section is the plurality of the replay target sections. It is defined by the strokes to be replayed and the temporal relationship between the strokes to be replayed. Hereinafter, the replay target section will be described in more detail.

16 is a diagram for explaining a replay target section according to the present invention. Referring to FIG. 16, a replay target section (RS) according to the present invention includes a stroke section (SS) and a gap section (GS). In particular, FIG. 16 shows that the replay target section RS includes the first to fourth stroke sections SS1, SS2, SS3, and SS4 and the first to third sections GS1, GS2, and GS3. has been

In the present invention, for convenience of description, the replay target section is defined as the time required for the user to write down the replay target.

That is, the replay target section is defined as the time interval from when the user starts writing the first stroke of the target handwritten content requesting replay to the time when the user ends writing the last stroke of the target handwritten content. do. For example, when the replay target section is determined as shown in FIG. 16, the length of the replay target section (RS) becomes (t8-t1).

The stroke period is defined as the time required when the user inputs one stroke while taking notes. That is, as described above, the time from the point of pen-down to the target medium 1000 to the point of pen-up from the target medium 1000 in order to input one stroke is defined as the stroke section. For example, as shown in FIG. 16, the length of the first stroke section SS1 is (t2-t1), the length of the second stroke section SS2 is (t4-t3), and the third stroke section ( The length of SS3) is (t6-t5), and the length of the fourth stroke section SS4 is (t8-t7).

The interval GS is defined as a time period from inputting one stroke to inputting another stroke immediately following the inputted stroke when the user writes. That is, the time from the pen-up point of the inputted stroke to the pen-down point of the next inputted stroke is defined as the interval GS. For example, as shown in FIG. 16, the length of the first interval GS1 is (t3, t2), the length of the second interval GS2 is (t5-64), and the length of the third interval ( GS3) has a length of (t7-t6).

When defining the interval between (GS), it has been explained that it is defined by the relationship between two strokes. Strokes decided in writing and not included in the replay will not be considered. For example, one stroke (stroke A) is written in a first area (e.g., page x of note A) and in effect the next stroke (stroke B) is written in a second area (e.g., page y of note A). page), and then the next stroke (stroke C) is written again in the first area, if only page x is selected as the content to be replayed and page y is not selected, stroke B is included in the content to be replayed Since it is not defined, it is not taken into account in defining the above-mentioned interval interval GS. That is, in this case, not only does the stroke section defined by stroke B not exist in the replay target section, but also the section between stroke A and stroke B and the section between stroke B and stroke C are not defined, Only the interval between stroke A and stroke C can be defined.

Subsequently, the electronic device 3000 may obtain pen data for strokes included in the replay target content from the memory module 3400 and generate replay data based on the obtained pen data. The replay data is data generated to perform a replay operation of replaying the contents written by the user according to the present invention, and may be data generated by sampling pen data for strokes. In addition, replay data can be interpreted in a very comprehensive sense including information on the location of strokes to be displayed on a display, the display order between strokes, timing information for displaying strokes, and the like, in performing a replay operation.

The electronic device 3000 then performs a replay operation according to the present invention based on the replay data.

Hereinafter, the replay operation will be described in more detail.

In the replay operation of user handwritten contents according to an embodiment of the present invention, the reproduction time of the replay differs from the time required for the user to write down the contents to be replayed.

For example, a specific page may be selected as the replay target content, a part of the content included in the specific page selected as the replay target content may be written at 10 am, and another part of the content included in the specific page. may be written at 8:00 PM. In this case, the time required for the user to write down the contents to be replayed is 10 hours. Time can be minutes. That is, the replay reproduction time of the replay target section may be shorter than the required writing time (length of the replay target section) of the replay target section.

As another example, a specific word may be selected as the replay target content, and the time required for the user to actually write the specific word selected as the replay target content is 2 seconds, but the replay playback time for the word is It may be longer than 2 seconds. That is, the replay reproduction time of the replay target section may be longer than the required writing time (length of the replay target section) of the replay target section.

(1) Determination of the replay playback time of the stroke section

The electronic device 3000 may determine a replay reproduction time of strokes included in the content to be replayed.

<Relationship between length of stroke section and replay playback time>

According to some embodiments of the present invention, the electronic device 3000 may determine a replay playback time for each stroke in consideration of the time required to actually write the replay target strokes.

FIG. 17 is a diagram showing a replay reproduction time determined according to an embodiment of the present invention with respect to a replay target section RS as shown in FIG. 16. Referring to FIG.

Referring to FIG. 17, the lengths of the first to fourth stroke replay reproduction times SR1, SR2, SR3, and SR4 for each of the first to fourth stroke sections SS1, SS2, SS3, and SS4 are respectively It is shown that it is determined in proportion to the lengths of the first to fourth stroke sections SS1 , SS2 , SS3 , and SS4 . In this way, the electronic device 3000 may determine the replay reproduction time of the strokes to be replayed in consideration of the time required for actually writing the strokes to be replayed.

However, although FIG. 17 shows an example in which the replay playback time for each stroke is determined in proportion to the length of each stroke section, it is not necessarily determined proportionally, and the replay is reproduced section by section. Time may be determined. For example, according to a method in which the time required for actually writing each stroke is divided into sections and different replay playback times are corresponded to different sections, the replay playback time for each stroke is may be determined. That is, when the two strokes are classified as the same section even if the length of the actual stroke section is slightly different for the two strokes, the replay reproduction time for the two strokes may be determined to be the same. 17 shows that only the length of the stroke section is considered in determining the replay reproduction time for each stroke, but in determining the replay reproduction time, not only the length of the stroke section is considered, but the stroke The replay playback time may be determined by further considering the length of . A method of considering the stroke length when determining the replay reproduction time will be described later.

Alternatively, the electronic device 3000 may determine the same replay reproduction time for strokes to be replayed.

For example, the electronic device 3000 may determine a replay reproduction time for each stroke without considering the time required to actually write the strokes to be replayed.

In this case, the electronic device 3000 may determine a predetermined replay reproduction time as a replay reproduction time for each of the replay target strokes, regardless of the time required to actually write down the replay target strokes. That is, the replay reproduction time determined for all strokes included in the content to be replayed may be the same.

18 and 19 are diagrams showing the replay playback time determined according to another embodiment of the present invention with respect to the replay target section RS as shown in FIG.

Referring to FIG. 18, the lengths of the first to fourth stroke replay playback times SR1, SR2, SR3, and SR4 for each of the first to fourth stroke sections SS1, SS2, SS3, and SS4 are all the same. What has been determined is shown. In this way, the electronic device 3000 may determine the replay reproduction time of the strokes to be replayed without considering the time required for actually writing the strokes to be replayed.

However, in FIG. 18, in determining the replay playback time for each stroke, the length of the stroke section is not considered at all and the replay playback time is determined equally. The replay reproduction time may be determined, and when the replay reproduction time is determined in consideration of the stroke length, the replay reproduction time for each stroke may be different. A method of considering the stroke length when determining the replay reproduction time will be described later.

Meanwhile, in FIG. 18, the determined replay reproduction time is shown as a 'time duration', but the determined replay reproduction time may be determined as one 'time point'.

For example, as shown in FIG. 19, when replaying the strokes of the first to fourth stroke sections SS1, SS2, SS3, and SS4, the electronic device 3000 performs a first stroke at a first point in time. Strokes corresponding to the stroke section SS1 are displayed at once, strokes corresponding to the second stroke section SS2 are displayed at a time at a second time point, and strokes corresponding to the third stroke section SS3 are displayed at a third time point. It may be displayed all at once, and the strokes corresponding to the fourth stroke section SS4 may be displayed all at once at the fourth time point. Here, the meaning of displaying the strokes at once may be understood to mean that all dots constituting the strokes are displayed on the display at the same time.

That is, FIG. 18 relates to an embodiment in which points constituting each stroke are sequentially displayed on a display as the determined replay progresses, and FIG. 19 shows points constituting a stroke displayed on the display all at once. It's about the examples.

In the above, the relationship between the length of the stroke section and the replay reproduction time determined therefor has been described. Hereinafter, the relationship between the stroke length (physical length of the stroke actually written by the user) and the replay reproduction time determined accordingly will be described.

<Relationship between stroke length and replay playback time>

According to some other embodiments of the present invention, the electronic device 3000 may determine a replay playback time for each stroke in consideration of the lengths of the strokes to be replayed.

20 to 24 are diagrams for explaining some other embodiments of determining a replay reproduction time to replay a stroke handwritten by a user according to some other embodiments of the present invention.

Referring to FIG. 20, it is shown that the first to fourth strokes S1, S2, S3, and S4 are written on the target medium 1000.

For convenience of explanation, the first stroke S1 is written by the user during the first stroke section SS1 shown in FIG. 16, and the second stroke S2 is the second stroke section shown in FIG. 16 It is written by the user during (SS2), the third stroke (S3) is written by the user during the third stroke section (SS3) shown in FIG. 16, and the fourth stroke (S4) is shown in FIG. It is assumed that the handwriting was written by the user during the fourth stroke section SS4.

Also, for convenience of explanation, the respective lengths of the first to fourth strokes S1 , S2 , S3 , and S4 are referred to as SL1 , SL2 , SL3 , and SL4 , and similarly as shown in the drawing, SL4 > SL1 It is assumed that the relation >SL3>SL2 holds.

Here, the length of a stroke may be understood to mean the physical length of a stroke actually written by a user on the target medium 1000 . However, at this time, the length may be understood as an absolute length, but may also be understood as a relative length between strokes.

In this case, the electronic device 3000 may determine a replay playback time for each stroke in consideration of the lengths of the strokes included in the content to be replayed.

FIG. 21 illustrates replay reproduction times determined according to some embodiments of the present invention with respect to strokes (S1, S2, S3, and S4) included in the content to be replayed as shown in FIG. 20.

Referring to FIG. 21, the lengths of the first to fourth stroke replay replay times SR1, SR2, SR3, and SR4 for each of the first to fourth strokes S1, S2, S3, and S4 are first It is shown that it is determined in proportion to the lengths of the through fourth strokes S1, S2, S3, and S4. In this way, the electronic device 3000 may determine the replay reproduction time of the strokes to be replayed in consideration of the time required for actually writing the strokes to be replayed.

However, although FIG. 21 shows an example in which the replay playback time for each stroke is determined in proportion to the length of each stroke, it is not necessarily determined proportionally, and the replay playback time for each section is shown. this may be determined. For example, the replay reproduction time for each stroke may be determined according to a scheme in which the written length of each stroke is divided into sections and different replay reproduction times are corresponded to different sections. That is, when the two strokes are classified into the same section even though the actual written length of the stroke is slightly different, the replay reproduction time of the two strokes may be determined to be the same. 21 shows that only the written length of the stroke is considered in determining the replay reproduction time for each stroke, but in determining the replay reproduction time, only the written length of the stroke is not considered. As described above, the replay reproduction time may be determined by further considering the length of the stroke section (the time required for actually writing the stroke).

Alternatively, the electronic device 3000 may determine the same replay reproduction time for strokes to be replayed, regardless of the written lengths of the strokes. That is, the electronic device 3000 may determine the replay reproduction time for each stroke without considering the written length of the strokes to be replayed at all.

22 and 23 are diagrams illustrating replay reproduction times determined according to some embodiments of the present invention, for strokes to be replayed as shown in Fig. 20;

Referring to FIG. 22, the lengths of the first to fourth stroke replay replay times SR1, SR2, SR3, and SR4 for each of the first to fourth strokes S1, S2, S3, and S4 are all the same. What has been determined is shown. In this way, the electronic device 3000 may determine the replay reproduction time of the strokes to be replayed without considering the written lengths of the strokes to be replayed.

Meanwhile, in FIG. 22, the determined replay reproduction time is shown as a 'time duration', but the determined replay reproduction time may be determined as one 'time point'.

For example, as shown in FIG. 23, when replaying strokes of the first to fourth strokes S1, S2, S3, and S4, the electronic device 3000 performs the first stroke at the first time point. (S1) are displayed all at once, at the second time point the replay for the second stroke (S2) is displayed at once, at the third time point the replay for the third stroke (S3) is displayed at once, at the fourth time point The replay for the fourth stroke (S4) can be displayed at once.

(2) Determining the replay playback time of the interval between

The electronic device 3000 may determine a replay reproduction time of a section between strokes included in the content to be replayed.

According to some embodiments of the present invention, the electronic device 3000 determines a replay playback time for each of the intervals between strokes in consideration of actual time intervals between strokes when the user actually writes the replay target strokes. can According to some embodiments of the present invention, the method for determining the replay playback time for intervening intervals is substantially the same as the method for determining the replay playback time for a stroke interval with or without consideration of the length of the stroke interval described above. Since they are similar, only a brief description is given.

This will be described with reference to FIGS. 16 to 19 again.

Referring to FIG. 17, the lengths of replay playback times GR1, GR2, and GR3 between the first and third sections GS1, GS2, and GS3 are respectively first to third. It is shown that it is determined in proportion to the lengths of the three intervals (GS1, GS2, GS3). In this way, when the electronic device 3000 reproduces the content to be replayed, the replay playback time for the section between strokes may be determined in consideration of the time difference between strokes actually occurring while writing.

However, the replay reproduction time determined for the intervals is not necessarily determined in proportion to the length of the intervals, and may be determined by dividing the intervals.

Alternatively, as shown in FIG. 18 , the electronic device 3000 may determine the same replay reproduction time for sections between replay targets. For example, the electronic device 3000 may determine a replay reproduction time for each stroke without considering the time required to actually write the strokes to be replayed.

(3) Determination of replay playback speed and replay playback time based thereon

Meanwhile, according to some embodiments of the present invention, a replay reproduction speed for the user's handwriting may be determined, and the electronic device 3000 may determine the user's handwriting according to some embodiments of the present invention according to the determined replay reproduction speed. You can perform a replay operation for .

The electronic device 3000 may determine the replay playback speed by considering the number of strokes included in the selected replay target section.

For example, the electronic device 3000 stores at least a first predetermined condition and a second predetermined condition in advance, checks the number of strokes included in the selected replay target section, and determines the number of confirmed strokes in advance. If it is less than or equal to a predetermined condition, a first replay reproduction speed corresponding to a first predetermined condition may be determined as a replay reproduction speed for the selected replay target section, or a second number of confirmed strokes exceeding the first predetermined condition. If it is less than or equal to a predetermined condition, a second replay reproduction speed corresponding to a second predetermined condition may be determined as the replay reproduction speed for the selected replay target section. The electronic device 3000 may store more predetermined conditions than the first predetermined condition and the second predetermined condition, and a predetermined replay playback speed may correspond to each of the predetermined conditions.

When the first predetermined condition is smaller than the second predetermined condition, the first replay reproduction speed corresponding to the first predetermined condition is slower than the second replay reproduction speed corresponding to the second predetermined condition. can For example, when the first predetermined condition is 100 and the second predetermined condition is 200, the first predetermined replay reproduction speed may be slower than the second predetermined replay reproduction speed.

The electronic device 3000 may determine a replay reproduction time for a stroke section and a replay reproduction time for an interval section in consideration of the determined replay reproduction speed.

If the first replay playback speed is faster than the second replay playback speed, the stroke section replay playback time determined when the determined replay playback speed is the first replay playback speed is determined when the determined replay playback speed is the second replay playback speed. It may be shorter than the stroke section replay reproduction time.

Similarly, if the first replay playback rate is faster than the second replay playback rate, the interval replay playback time determined when the determined replay playback rate is the first replay playback rate is such that the determined replay playback rate is equal to the second replay playback rate. It may be shorter than the interval replay reproduction time determined when .

The process of determining the stroke segment replay playback time based on the playback speed and the process of determining the interval replay playback time based on the playback speed operate independently of each other. At the same time as determining a shorter interval replay reproduction time may be determined to be shorter, only one of the stroke interval replay reproduction time and the interval replay reproduction time may be determined to be shorter.

(4) Determination of total playback time of replay and replay operation

Next, the electronic device 3000 determines the length of the above-described stroke section, the length of the interval section, and the written length of the stroke for each of the strokes included in the selected replay target content and the intervals between the strokes. A playback time may be determined based on at least one of a playback speed and a playback time, so that a total playback time for the selected content to be replayed may be determined.

Then, according to the determined replay reproduction time, the electronic device 3000 performs a replay operation on the selected replay target content.

24 is a diagram for exemplarily illustrating a screen on which a user's handwritten content is replayed through a display according to an embodiment of the present invention.

The electronic device 3000 may sequentially replay the strokes based on the stroke section determined according to the user's handwritten content as shown in FIG. 20 and the replay playback time determined for the intervening sections.

If, as described with reference to FIG. 21 or 22, when the replay playback time for the stroke section and the replay playback time for the interval section are determined to be a 'time section', the electronic device 3000 determines the first stroke. During the playback time SR1, the dots constituting the first stroke S1 may be sequentially displayed, and as a result, a screen as shown in (a) of FIG. 24 may be displayed on the display of the electronic device 3000. Subsequently, the electronic device 3000 maintains the screen shown in (a) of FIG. 24 for the determined first interval replay time GR1, and then performs the second stroke S2 during the determined second stroke replay time SR2. The dots constituting may be displayed sequentially, and as a result, a screen as shown in (b) of FIG. 24 may be displayed through the display of the electronic device 3000. In a similar way, replay operations for the third and fourth strokes may be performed.

On the other hand, as described with reference to FIG. 23, when the replay playback time for the stroke section is determined as 'time point', the electronic device 3000 displays a screen as shown in (a) of FIG. 24 at the first time point. After displaying on the display, the screen as shown in (a) of FIG. 24 is maintained for the determined first interval replay reproduction time (GR1), and at the second time, as shown in (b) of FIG. 24 After the same screen is displayed on the display, the screen shown in (b) of FIG. 24 may be maintained for the determined second interval replay reproduction time GR2. In a similar way, replay operations for the third and fourth strokes may be performed.

In the above, the replay operation for the user's handwriting according to some embodiments of the present invention has been described. In the above-described embodiments, in determining the replay reproduction time for a stroke section, when the stroke replay reproduction time is determined in proportion to the length of the stroke section, the replay reproduction time for the interval section is also proportional to the length of the interval section. It is shown in FIG. 17 to determine the replay playback time between intervals, and when the same stroke replay playback time is determined regardless of the length of the stroke interval, the replay playback time for the interval is also regardless of the length of the interval. Although it is shown in FIG. 18 as being determined identically, the operation of determining the replay playback time for the stroke section and the operation of determining the replay playback time for the interval between strokes are independent of each other, and are necessarily shown in FIGS. 17 and 18. It is not limited to the bar, and even if the replay reproduction time for the stroke section is determined depending on the length of the stroke section, an embodiment in which the replay reproduction time for the interval section is determined regardless of the length of the interval section is also possible. The opposite is also true.

5. Replay of Written Content #2

Hereinafter, based on the pen data received from the electronic pen 2000, the electronic device 3000 will later replay the content the user writes on the medium 1000 and display it on the display of the electronic device 3000. can Hereinafter, another method of replaying and displaying notes written by a user on a display in real time will be described.

In the following, for the following description, the electronic pen 2000 and the electronic device 3000 receive and store pen data related to items written by the user on the target medium 1000 using the electronic pen 2000, and store assuming there is

The electronic device 3000 may detect whether a predetermined event for replaying the user's handwritten content has occurred. Since the predetermined event has already been described above, a detailed description thereof will be omitted.

Subsequently, the electronic device may determine replay target content to be replayed from among the content handwritten by the user. Since the content to be replayed and the determination of the content to be replayed have already been described above, a detailed description thereof is omitted here.

After the content to be replayed is determined, the electronic device 3000 may determine a replay time of the replay operation. In this case, the electronic device 3000 may check the number of strokes included in the content to be replayed, and determine the reproduction time of the replay operation based on the checked number of strokes.

The electronic device 3000 may store in advance the number of strokes to be replayed per unit time in order to determine the replay time of the replay operation based on the confirmed number of strokes. For example, the electronic device 3000 may pre-store the number of strokes to be replayed for 1 second as 4. For another example, the electronic device 3000 may pre-store the number of strokes to be replayed for one second as two. As another example, the electronic device 3000 may pre-store the number of strokes to be replayed for 1 second as 8.

The electronic device 3000 may determine the reproduction time of the replay operation based on the number of confirmed strokes and the number of strokes to be replayed per unit time. For example, if the content determined as the replay target includes a total of 100 strokes and the number of strokes to be replayed for 1 second is 4, the replay time is 100(pcs)/4(pcs/ seconds) = 25 (seconds).

That is, the reproduction time of the replay operation determined by the electronic device 3000 may be determined in proportion to the number of strokes included in the content to be replayed. For example, if the number of strokes is 100 and the predetermined number of playback strokes per second is 4, the playback time may be determined to be 25 seconds, but if the number of strokes is confirmed to be 200, the playback time may be determined to be 50 seconds. there is.

In other words, according to some embodiments of the present invention, the number of strokes included in the user's handwriting, which is the target of the replay operation, may be defined as N, and the predetermined number of strokes reproduced during a predetermined unit time. M may be defined as M, and at this time, the replay time of the replay operation determined by the electronic device 3000 may be determined as N/M* (predetermined unit time).

Meanwhile, in the above example, only the case where the number of strokes included in the replay target content is N times the number of replay strokes per predetermined unit time has been described as an example, but hereinafter, the number of strokes is equal to the number of replay strokes per predetermined unit time. Embodiments of determining the reproduction time of a replay when the multiple of the number is negative will be described.

According to some embodiments, the electronic device 3000 may determine the playback time of the replay in the same way as described above. That is, if the number of strokes included in the content to be replayed is 102 and the number of replay strokes per predetermined unit time is 4, the replay is reproduced at 102 (pieces)/4 (pieces/second) = 25.5 (seconds). time can be determined.

According to some other embodiments, in the electronic device 3000, the number of strokes included in the user's handwriting, which is the target of the replay operation, is defined as N, and the number of strokes reproduced for 1 second is predetermined. is defined as M, and when N is divided by M, the quotient is defined as Q and the remainder is defined as R, the playback time of the replay can be determined as (Q+1) (seconds). That is, when the number of strokes included in the replay target content is 102 and the number of replay strokes per predetermined unit time is 4, the quotient of dividing 102 by 4 is 25, so the replay time is (25+1) = 26 (seconds) can be determined.

In summary, the number of strokes included in the user's handwriting, which is the target of the replay operation, is defined as N, the number of predetermined strokes reproduced for 1 second is defined as M, and N is divided by M. When the quotient is defined as Q and the remainder as R, if R is 0, the electronic device 3000 determines the replay time of the replay as Q, and if R is not 0 (i.e., R is greater than M If it is a small integer), the electronic device 3000 may determine the reproduction time of the replay as (Q+1).

However, in this case, the replay time may be determined proportionally to the number of strokes, but not completely proportionally. That is, when the number of strokes is 100 and when the number of strokes is 200, the replay time may be doubled, but when the number of strokes is 101, when the number of strokes is 102, and When the number of strokes is 103, the reproduction time of the replay may be equally determined. 25 is a diagram for explaining a method of determining a replay playback time based on the number of strokes according to some embodiments of the present invention. Referring to FIG. 25, when the number of replay strokes per unit time is 4, FIG. , when the reproduction time of the replay is determined according to some embodiments of the present invention, the relationship between the number of strokes and the replay reproduction time is roughly shown.

Meanwhile, the electronic device 3000 may store the number of replay strokes per unit time rather than storing the number of replay strokes per unit time, and according to the predetermined event, an appropriate number of replay strokes per unit time may be stored. The number of replay strokes may be determined.

Also, the electronic device 3000 may determine the reproduction speed of the replay operation. There are various methods for the electronic device 3000 to determine the replay speed of the replay operation.

For example, the electronic device 3000 may determine the replay speed of the replay operation according to the predetermined event. There may be cases where a user separately requests a playback speed for a replay operation, and accordingly, the electronic device 3000 may determine the replay playback speed according to the playback speed requested by the user. Alternatively, there may be cases where the operating system of the electronic device 3000 or another application installed on the electronic device 3000 separately requests a playback speed for the replay operation, and accordingly, the electronic device 3000 , The replay playback speed may be determined according to the playback speed requested by the operating system or application.

For another example, the electronic device 3000 may determine the reproduction speed of the replay operation based on the number of strokes included in the replay target content.

FIG. 26 is a diagram for explaining an embodiment of determining a replay reproduction speed according to the number of strokes included in content to be replayed according to some embodiments of the present invention.

Referring to FIG. 26, it is shown that a plurality of sections are divided according to the number of strokes, and a predetermined reproduction speed corresponds to each section. The electronic device 3000 stores the table shown in FIG. 26 in the memory module 3400 in advance, checks the total number of strokes included in the content to be replayed, and determines the total number of strokes according to the checked total number of strokes. The replay playback speed may be determined by referring to the stored table. For example, if the section according to the number of strokes is determined in units of 500, and the number of strokes to be replayed is 1 or more and less than 500, the reproduction speed of the replay may be determined as 1x, and the strokes to be replayed are 500. In the case of more than 1,000, the speed of the replay may be determined as double speed, and the reproduction speed of the replay may be similarly determined for a section of more than 2 times.

In this case, the determined replay reproduction speed may be determined as a basic reproduction speed for the corresponding replay operation, and the determined basic reproduction speed may be recommended to the user. That is, when the number of strokes included in the replay target content is 300, 1x speed may be displayed to the user as the recommended replay speed, and when the number of strokes included in the replay target content is 700, 2x speed is recommended. It can be displayed to the user at the replay rate.

In this way, after the replay reproduction speed is determined, the electronic device 3000 may determine the number of replay strokes per unit time based on the determined replay reproduction speed.

27 is a diagram for explaining an embodiment of determining the number of replay strokes per unit time according to a replay reproduction speed according to some embodiments of the present invention.

Referring to FIG. 27, it is shown that the number of replay strokes per unit time corresponds to each reproduction speed. The electronic device 3000 previously stores a table as shown in FIG. 27 in the memory module 3400, and determines the number of replay strokes per unit time by referring to the previously stored table according to the determined replay reproduction speed. can For example, when the reproduction speed is 1x speed, the number of replay strokes per unit time (the number of replay strokes per second) may correspond to 4, and when the reproduction speed is 2x speed, the number of replay strokes per unit time may correspond to four. The number of strokes (the number of replay strokes per second) may correspond to eight.

In this way, the electronic device 3000 may determine the number of replay strokes per unit time according to the determined replay reproduction speed.

As described above, after the content to be replayed is determined, the electronic device 3000 reproduces a replay operation based on a user's request, a request from an operating system, a request from an application, or the number of strokes included in the content to be replayed. time can be determined.

Subsequently, the electronic device 3000 performs a replay operation according to the determined replay operation reproduction time or the like.

When performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed on the display at a time.

28 is a diagram for explaining a method of performing a replay operation for a user's handwriting, according to some embodiments of the present invention.

28 shows the timing at which the replay target strokes are displayed on the display when the number of replay strokes per second is 4. Referring to FIG. 28, it can be seen that strokes are displayed on the display one by one at intervals of 0.25 seconds. In addition, it can be seen that the first strokes are not displayed sequentially between 0 and 0.25 seconds, but are all displayed at 0 seconds at once. In other words, according to some embodiments of the present invention, if the number of replay strokes per unit time is determined, when a replay operation is performed, display intervals between strokes may be determined to be equal to each other. That is, in this way, when performing the replay operation, the electronic device 3000 may perform the replay operation so that one stroke is displayed on the display one at a time.

Alternatively, the entire stroke may be displayed for a time interval that is much shorter than the display interval between strokes (eg, 0.25 seconds in the above example), instead of displaying the entire stroke at a specific point in time. will be.

However, in some embodiments, two or more strokes may be replayed at the same time displayed on the display.

Meanwhile, as described above, the electronic device 3000 may change the replay reproduction speed according to another predetermined event while performing the replay operation based on the determined replay reproduction speed and the determined number of replay strokes per unit time. .

For example, a user may request a change in playback speed of a currently playing replay, and an operating system or other application may request a change in playback speed of a currently playing replay.

In this case, the electronic device 3000 changes the replay reproduction speed according to the other predetermined event, changes the number of replay strokes per unit time based on the changed replay reproduction speed, and then changes the number of replay strokes per unit time. Accordingly, the rest of the replay operation can be performed.

As described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's handwriting and the timing of replay reproduction are not replayed in temporal synchronization with each other, but more rapid An effect of being able to perform replay by reproducing the user's handwritten contents within a certain amount of time occurs.

6. Capture your handwriting

The electronic device 3000 may capture writing contents written by the electronic pen 2000 . Here, the electronic device 3000 provides a user interface for selecting a specific part of the entire handwritten content to be captured, and through this, a specific part of the entire handwritten content can be selectively captured. In addition, the electronic device 3000 may provide a user interface through which a user may check which part of the entire handwritten content is selected for capture.

The electronic device 3000 may determine a portion to be captured (hereinafter referred to as 'target written content') of the entire written content.

29 is a diagram of the entire written content and target writing content during a capture operation of an electronic device according to the present invention.

Here, the entire written content may mean any written content that can be continuously reproduced through replay. For example, when the electronic device 3000 reproduces the handwritten contents by dividing the medium 1000 page by page, the entire written contents A may include all the written contents written on the corresponding page as shown in FIG. 29 . can Of course, when the handwritten content written on a single page is divided and reproduced as necessary, only a part of the written content on the corresponding page may correspond to the entire written content described above, and the handwritten content written on a plurality of pages at once In the case of being reproduced continuously, all of the written contents written on the plurality of pages may correspond to the entire written contents.

Also, the target written content may include a part or all of the entire written content. The target written content may include one or more parts made up of a series of continuous writings among the entire written content. For example, as the target writing content, as shown in FIG. 29 , the first writing content T1 may be selected. For another example, as the target writing content, as shown in FIG. 29 , first writing content T1 and second writing content T2 may be selected.

The electronic device 3000 may set a target section among the reproduction sections of the entire written content, and determine a portion corresponding to the set target section among the entire written content as the target writing content.

In detail, the electronic device 3000 may receive input of at least one viewpoint from a reproduction section of the entire handwritten content from the user and set a target section based on the received input.

For example, the electronic device 3000 may receive input of a start time and an end time from the user, and accordingly set a section from the start time to the end time of the playback section of the entire handwritten contents as the target section.

For another example, the electronic device 3000 may receive any one of start time and end time input from the user. In this case, the electronic device 3000 may set the start time to the end of the play section as the target section or set the play section from the beginning to the end of the play section as the target section. That is, when only the start time is input, the end of the entire reproduction section becomes the end time, and conversely, when only the end time is input, the beginning of the entire reproduction section becomes the start time.

Unlike this, the electronic device 3000 may receive input of the start and end times of the exclusion section from the user, set the exclusion section based on the input, and set the remaining section after subtracting the exclusion section from the entire reproduction section as the target section.

For example, the electronic device 3000 may receive input of a start time and an end time from a user, and accordingly set a section from the start time to the end time of the entire playback section as an excluded section and set the remaining section as a target section. there is.

Meanwhile, the electronic device 3000 may set target sections that are spaced apart from each other. For example, the electronic device 3000 receives inputs of a first start time, a first end time, a second start time, and a second end time from the user, and the first target section from the first start time to the first end time. , and a period from the second start point to the second end point may be set as the second target interval.

In order to receive at least one viewpoint described above, the electronic device 3000 may provide various types of user interfaces.

30 to 32 are examples of user interfaces for receiving an input of a target section according to the present invention.

According to an example, the electronic device 3000 may display the progressive bar together with the entire written content, receive a user input for the progressive bar, and set a target section based on the user input.

Here, the progressive bar may mean an indicator interlocked with the progress of the reproduction when the written contents are reproduced. As shown in FIG. 30, the progressive bar (P) is generally provided in the form of a bar at the bottom of the screen, but the form is not necessarily limited to the form shown in FIG. 30 in the present invention.

On the other hand, in the present invention, the total playback time expressed by the progressive bar may correspond to the time at which the writing content is reproduced according to replay, which is based on the writing time included in the pen data, the number of strokes, and the interval between adjacent writing times. can be determined

For example, the total playback time according to the progressive bar may be determined to correspond to a time interval from the writing time of pen data for the first stroke of the corresponding written content to the writing time of the pen data for the last stroke. In this case, the time the user writes on the medium 1000 using the actual electronic pen 2000 and the replay time according to the progressive bar will be determined identically.

As another example, the total playback time according to the progressive bar is set to correspond to the time interval from the writing time of pen data for the first stroke of the corresponding written content to the writing time of the pen data for the last stroke, and then between adjacent strokes in the writing order. When the time interval is larger than the preset reference interval, the corresponding time interval may be decreased. That is, when the time interval between the writing time at which a specific stroke is performed and the writing time at which the next stroke of the specific stroke is performed is greater than the reference interval set at 20 seconds, the time interval may be reduced to 5 seconds. In this case, the total replay time according to the progressive bar may be shorter than the time the user writes on the actual medium 1000 using the electronic pen 2000 .

As another example, the total playback time according to the progressive bar may be determined according to the total number of strokes (ie, the number of handwritten strokes) of the corresponding handwritten content. That is, the replay time of the progressive bar may be determined to be 100 seconds for handwritten content consisting of a total of 300 strokes by matching 3 strokes to 1 second on the replay. In this case, the total replay time according to the progressive bar may differ from the actual writing time.

The electronic device 3000 may receive a user input for setting a target section from a user through a user interface displaying such a progressive bar. For example, the user can select two points on the progressive bar as shown in FIG. 30, and accordingly, the electronic device 3000 determines the previous point as the starting point and the later point as the end point, Accordingly, a target section may be set. At this time, a start indicator (I-1) and an end indicator (I-2) may be displayed on the progressive bar to identify a start point and an end point, respectively. Also, on the progressive bar P, the target section R may be displayed to be distinguished from the rest of the sections. As shown in FIG. 30 , the user may select a desired point on the progressive bar by touching or clicking a mouse. Alternatively, the user may drag from one point to another point on the progressive bar as shown in FIG. 31, and in this case, the electronic device 3000 may set the dragged section as the target section R. That is, the first part of the dragged section becomes the starting point (I-1) and the last part becomes the ending point (I-2). According to this input, as shown in FIGS. 30 and 31 , the target writing content corresponding to the target section R can be determined. In addition, as shown in FIG. 32, the user sets two or more target sections (R-1, R-2) spaced apart from the progressive bar (P) to determine a plurality of target writing contents (T-1, T-2). It is possible.

33 to 35 are other examples of user interfaces for receiving an input of a target section according to the present invention.

According to another example, the electronic device 3000 may display the entire written content and set a target section according to a user input for selecting a stroke from the written content. In detail, when two strokes are selected, writing contents by strokes between the first written stroke and the second written stroke may be selected as the target writing content. In other words, the electronic device 3000 may set the target writing content by setting the reproduction time of the selected stroke as the start time or end time of the target section.

Referring to FIG. 33, the user selects two strokes (S-1 and S-2) from the entire written content, and accordingly, the target writing content (T) can be determined by the two strokes and the strokes between them. there is.

34, the user may select them by dragging from the start stroke (S-1) to the end stroke (S-2) of the entire handwritten content, similar to that shown in FIG. can determine the target writing content T, similarly to the case where the two strokes S-1 and S-2 are respectively selected.

Also, using this method, it is possible to set a plurality of target sections to select a plurality of target writing contents as shown in FIG. 35 .

In this way, the user input for selecting a stroke from the handwritten content can accurately select the stroke displayed in the present invention. However, even if a specific stroke is not accurately selected, the electronic device 3000 selects the stroke closest to the point where the user input is received. can be judged as selected.

36 and 37 are other examples of user interfaces for receiving an input of a target section according to the present invention.

According to another example, the electronic device 3000 may reproduce the entire handwritten content in the form of a video through a display, receive a user input during playback, and obtain a time point at which the user input occurs as a start time or an end time. In detail, referring to FIG. 36 , in a state in which the handwritten content is reproduced up to the “In the evening” part (U-1), the user can input that point in time as the starting point in time. In addition, referring to FIG. 37 , the user can input the point in time as the end point in the state in which reproduction has progressed to the “secure” part (U-2). Accordingly, the “In the evening” part (U-1) to the “secure” part (U-2) are set as the target section, so that the target writing content (T) can be determined. As shown in FIGS. 36 and 37 , the viewpoint setting button (B) of the control panel (C) provided as the user interface may be selected, or through a predetermined click or touch. It goes without saying that it is also possible to select a plurality of target sections and target writing contents. The figure shows that one time setting button B is provided, and according to the selection order of the buttons, the time selected first may be the start time and the time selected later may be the end time. However, unlike this, the viewpoint setting button may include a start time setting button and an end time setting button, respectively, and each viewpoint may be determined by selecting a corresponding button.

Meanwhile, when a user input inputting a start time or an end time during playback occurs, the electronic device 3000 may temporarily stop playback or continuously perform playback.

As described above, the electronic device 3000 can set a target section through user input and determine the target writing content accordingly. The electronic device 3000 allows the user to easily select the target writing content, and It is possible to check what the target handwritten content selected by the user is.

38 is a diagram related to a screen for outputting entire handwritten contents for receiving an input of a target section according to the present invention. Referring to FIG. 38 , the electronic device 3000 may display the entire written content before receiving a user's input or before determining the target writing content is completed. Accordingly, the user can determine which part is to be the target writing content to be displayed while checking the entire writing content.

39 and 40 are diagrams related to screens for identifying target writing content according to the present invention. Referring to FIG. 39 , when the target writing content is determined, the electronic device 3000 may display the target writing content to be distinguished from other writing content. In other words, the target handwritten content and the remaining handwritten content may be displayed with different display properties (eg, contrast, color, font type, font type, font size, etc.). Referring to FIG. 40 , when the target writing content is determined, the electronic device 3000 may display only the target writing content on the screen without displaying the remaining writing content on the screen.

In addition, as shown in FIGS. 39 and 40, the electronic device 3000 may display the target section on a progressive bar so as to be distinguished from the rest of the section, and indicate the start and end times of the target section on the progressive bar. It is possible to display an indicator to indicate.

41 is a diagram showing a captured image according to the present invention.

The electronic device 3000 may capture the determined target writing content. It is possible to capture target handwritten content not only in the form of an image but also in the form of pen data. Capturing in the form of pen data may mean storing target writing contents as separate pen data so that the electronic device 3000 or another electronic device 3000 can check the target writing contents using it.

In the capture in the form of an image, the electronic device 3000 may create an image including target handwritten content. Such an image may include only the target handwritten content or may include a medium image as a background of the target handwritten content. In some cases, the captured image may include other handwriting contents in addition to the target writing contents, and in this case, the target writing contents may be displayed in a form distinguishable from the rest of the writing contents. On the other hand, capturing an image may take the form of capturing an image displayed on a screen or created by writing a target handwritten content on a medium image using pen data of the target handwritten content.

Meanwhile, the electronic device 3000 may separately store or transmit the target handwriting content to an external device instead of or together with capturing the target writing content. For example, the electronic device 3000 may transmit an image in which the target writing content is captured to a designated e-mail address.

Specifically, as described above, according to some embodiments of the present invention, when the user's handwriting is replayed, the timing of the user's handwriting and the timing of replay reproduction are chronologically synchronized with each other and are not replayed. An effect of being able to perform replay by reproducing the user's handwritten content within a shorter period of time occurs.

<Structure of electronic pen>

Hereinafter, the structure of the electronic pen 2000 according to an embodiment of the present invention will be described.

42 is a schematic perspective view illustrating an exploded view of a main body and a cap provided in an electronic pen according to an embodiment of the present invention, and FIG. It is a schematic perspective view showing a state inserted into.

42 and 43, the electronic pen 2000 according to an embodiment of the present invention includes a core part 2010 enabling writing on a medium, a main body part 2020 fixing the position of the core part 2010, and It may include a cap portion 2030 that protects the core portion in a non-use state.

Here, the non-use state may refer to a state in which the electronic pen 2000 according to an embodiment of the present invention is stored, and in this case, the core 2010 is not exposed to the outside, so that writing on the medium is impossible. can mean

The core 2010 is a component enabling writing on a medium, and may include a ball and ink, and the ink may be oil-based, water-based, or neutral.

In addition, the core 2010 may be a black lead used in a pencil or a lead used in a general writing instrument.

The body part 2020 is a component that is inserted to expose a part of the core part 2010 to fix the position of the core part 2010, and may mean a kind of grip part that a user can grip with his/her hand.

The cap part 2030 may have a predetermined inner space S1 in which one side of the main body part 2020 can be inserted to protect the core part 2010 in a non-use state. When inserted into the other side, writing may be possible by exposing a part of the core 2010 to the outside.

However, when writing is enabled by the core portion 2010, the cap portion 2030 does not necessarily need to be inserted into the other side of the main body portion 2020, and is separated from the main body portion 2020 in a predetermined space. It is free to be placed in

Meanwhile, the main body portion 2020 and the cap portion 2030 may have circular or polygonal cross sections in the horizontal direction, but hereinafter, a case in which the horizontal cross section is formed in a polygonal shape will be described as an example.

44 is a schematic perspective view showing the internal configuration of a cap part and a body part provided in an electronic pen according to an embodiment of the present invention, and FIG. 45 is a schematic cross-sectional view taken along line AA of FIG. 44, and FIG. It is a schematic perspective view showing a modified example of the cap part provided in the electronic pen according to the embodiment.

47 is a schematic front view illustrating a main body provided in an electronic pen according to an embodiment of the present invention.

44 to 47, the electronic pen 2000 according to an embodiment of the present invention may include a cap part 2030 and a main body part 2020 for position fixing the core part 2010. Describe the elements in detail.

The cap portion 2030 includes an accommodating portion 2032 having a predetermined inner space S1 to accommodate one side of the body portion 2020 and a position fixing portion 2034 protruding from the bottom surface of the interior of the accommodating portion. can be provided

Here, the position fixing part 2034 does not necessarily need to protrude from the inner bottom surface of the accommodating part 2032, for example, it may protrude from the inner side surface of the accommodating part 2032. Do.

The cap part 2030 connects the outer surface of the position fixing part 2034 and the bottom surface of the accommodating part 2032 to each other so that the position fixing part 2034 is stably disposed in the inner space S1. A rigidity reinforcing unit 2036 may be further provided.

The rigidity reinforcing part 2036 can reinforce the rigidity of the position fixing part 2034 and can perform a kind of reinforcing rib function.

* The accommodating part 2032 can accommodate the other side of the main body part 2020 when the other side of the main body part 2020 is inserted. In this case, the position fixing part 2034 is the main body part ( 2020) may be disposed in the inner space S1 so as to be in contact with the other side of the main body portion 2020 so that the insertion limit of the other side of the main body portion 2020 is defined.

In other words, when the other side of the body portion 2020 is inserted toward the inner space S1, the other end of the body portion 2020 is in contact with the position fixing portion 2034 to prevent further insertion. This may guide the appropriate insertion position into the inner space (S1) on the other side of the body portion (2020).

Here, a light emitting part 2028 (see FIG. 43) for displaying the state of the electronic pen 2000 to the outside may be provided on the other side of the main body part 2020, and the main body due to the position fixing part 2034 The light emitting portion 2028 is a penetrating portion 2038 (see FIGS. 2 and 3) formed by penetrating the accommodating portion 2032 by adjusting the degree of insertion of the other side of the portion 2020 into the inner space S1. ) may be exposed to the outside to provide convenience to the user.

The mounting space (S2) may be a space provided by the hooking part 2023 of the main body part 2020, and the main body part 2020 is located in the body part 2024 that can be gripped by the user and in a non-use state. A hooking part 2023 may be provided with a top part 2034 protruding from one side of the body part 2024 to provide a mounting space S2 so that the cap part 2030 is fixed in position.

Specifically, the hooking part 2023 is spaced apart from the first hooking part 2021 protruding toward the center of the body part on one side of the body part 2024 and the first hooking part 2021, and the body part 2024 may be provided with a second hooking part 2022 protruding toward the center of, and a predetermined mounting space S2 may be formed between the first hooking part 2021 and the second hooking part 2022. .

The mounting space S2 may be a space in which the mounting part 2033 of the position fixing part 2034 is mounted, and the mounting part 2033 extends from the center of one surface of the receiving part 2032 to the inner space S1. It may be a component formed by extending from the end of the protruding portion 2031 protruding toward the .

Here, the accommodating portion 2032 and the body portion 2024 may have a circular or polygonal cross section in a lateral direction, for example, a K-th angular cross section (K is a natural number of 3 or more). And, as shown in the drawing, it may be formed in a triangle.

When the body part 2024 is inserted into the accommodating part 2032, the mounting part 2033 has the protruding part 2031 so as to be mounted in the mounting space S2 regardless of the position change of the mounting space S2. It may be formed by extending radially from the end of the receiving portion 2032 toward the vertex of the cross section in the transverse direction.

Here, a vertex generally means a point of intersection where line segments constituting a polygon meet, but in the present invention, it is clarified that the concept includes a point having a minimum radius of curvature.

Since the mounting portion 2033 extends radially from the end of the protruding portion 2031, when the body portion 2024 is inserted into the accommodating portion 2032, regardless of how the body portion 2024 is inserted, the present invention provides the first hooking portion 2021 Convenience can be increased by allowing the mounting portion 2033 to be mounted in the mounting space S2 formed between the ) and the second hooking portion 2022 .

Meanwhile, as shown in FIG. 46, the mounting portion 2033a may be formed by extending in a circular radial shape from the end of the protruding portion 2031a.

The core portion 2010 may be disposed eccentrically from the center of the transverse cross section of the body portion 2024 toward the vertex of the transverse cross section of the body portion 2024, and the first hooking portion 2021 and the second hooking The portion 2022 may be formed between the center line of the cross section of the body portion 2024 and the core portion 2010 .

Due to this, the mounting space (S2) in which the mounting part 2033 is mounted is also formed between the center line of the transverse cross section of the body part 2024 and the core part 2010, so that the user writes on medium with the core part 2010. Damage to the first hooking part 2021 and the second hooking part 2022 caused by external factors during the process can be minimized to prevent the functional degradation of the mounting space S2 in advance.

48 and 49 are schematic side views illustrating a process of inserting a cap part into one side of a body part provided in an electronic pen according to an embodiment of the present invention.

First, referring to FIG. 48 , when the electronic pen 2000 according to an embodiment of the present invention is to be stored in a non-use state, one side of the main body 2020 is inserted into the cap 2030.

In this case, the first hooking part 2021 of the body part 2020 may be inserted into the accommodating part 2032 of the cap part 2030, and the first hooking part 2021 is the first hooking part 2021 When is inserted into the accommodating part 2032, the mounting part 2033 may be provided with an insertion inclined surface 2026 inclined downward along the insertion direction so as to enter the mounting space S2 after being in contact with it.

When the body part 2024 is inserted into the accommodating part 2032, the insertion inclined surface 2026 contacts the mounting part 2033 and is primarily inserted into the accommodating part 2032 of the body part 2024. It can perform the function of a kind of primary barrier that limits

Here, when the user continuously applies an external force to the body part 2024 toward the inner space S1 of the accommodating part 2032, the mounting part 2033 moves along the insertion slope 2026 as shown in FIG. It passes through and is finally mounted in the mounting space (S2).

When the mounting part 2033 is placed in the mounting space S2 by the user's continuous external force, the body part 2024 is inserted into the inner space S1 of the accommodating part 2032 even when the external force is continuously applied. This may not be the case, and this may be implemented by the second hooking part 2022 providing the function of the secondary blocking wall.

When the body part 2024 is inserted into the accommodating part 2032, the second hooking part 2022 prevents the mounting part 2033 from being inserted beyond the mounting space S2. 2033), and specifically, may be provided with an excessive insertion prevention surface 2025 perpendicular to the insertion direction.

As a result, even if there is a user's continuous external force, the mounting portion 2033 contacts the excessive insertion prevention surface 2025 to prevent further insertion, so that it can be stably mounted in the mounting space S2.

Here, the end of the second clasp 2022 may be formed closer to the center of the body portion 2024 than the end of the first clasp 2021, which means that the first clasp 2021 This is because it functions as a primary barrier and at the same time is a component through which the mounting portion 2033 must pass, while the second hanging portion 2022 functions as a secondary barrier through which the mounting portion 2033 must not pass. to be.

When the mounting part 2033 is mounted in the mounting space S2, the body part 2024 between the first hanging part 2021 and the second hanging part 2022 defining the mounting space S2 One surface 2028 of may be in surface contact with the mounting portion 2033, and specifically, may be formed as a plane parallel to the insertion direction of the body portion 2024 into the receiving portion 2032.

Due to the surface contact between the mounting part 2033 and the body part 2024 in the mounting space S2, the bonding force between the cap part 2030 and the body part 2020 can be increased, and non-ideal external force is applied. Even if it does, separation of the cap part 2030 and the body part 2020 does not occur.

Meanwhile, in a state where the mounting part 2033 is mounted in the mounting space S2, that is, when the electronic pen 2000 is to be changed from a non-use state to a use state for taking notes, the user separates the cap portion 2030 from the body portion 2020 by applying an external force.

To this end, when the first hooking part 2021 separates the body part 2024 inserted into the accommodating part 2032, the mounting part 2033 mounted in the mounting space S2 is attached to the mounting space. A separation slope 2027 formed to be inclined downward along the separation direction to be separated from (S2) may be provided.

The separation slope 2027 may be formed symmetrically with the insertion slope 2026 described above, but is not necessarily limited thereto, and may have slightly different inclination angles.

Hereinafter, the structure of the electronic pen 2000 will be described in more detail.

50 and 51 are disassembled schematic perspective views of a body provided in an electronic pen according to an embodiment of the present invention, and FIGS. 52 to 54 are a body provided in an electronic pen according to an embodiment of the present invention. It is a schematic perspective view for explaining a substrate part, a camera module and a lighting module that are fixed in position.

First of all, the electronic pen 2000 according to the present invention may include the cap part 2030 as described with reference to FIGS. 42 to 49 , but the cap part 2030 must Note that this may not be a required component.

50 to 54, the electronic pen 2000 according to an embodiment of the present invention includes a camera module 2320 and a lighting module 2340 for recognizing a user's handwriting by a core 2010, The substrate portion 2110 to which the camera module 2320 and the lighting module 2340 are connected and a hollow S5 are provided, and the accommodating substrate portion C1 accommodated in the hollow S5 and the hollow S5 The substrate portion 2110 is defined as the exposed substrate portion C2 exposed to the outside, and the main body 2120 made of a first material to shield electromagnetic waves generated by wireless communication, and the camera module 2320 and a battery unit 2160 for driving the lighting module 2340 and a wireless communication module 2440 mounted on the exposed substrate unit C2 to enable wireless communication with other electronic devices.

Since the camera module 2320, the lighting module 2340, and the wireless communication module 2440 have already been described in detail, a detailed description thereof will be omitted.

The main body 2120 may be a component that provides the appearance of the electronic pen 2000 according to an embodiment of the present invention, and the main body 2020 together with the substrate fixing unit 2030 and the substrate protecting unit 2140 can be configured.

The substrate unit 2110 may be implemented as a single unit in the electronic pen 2000 according to the present invention, but may be implemented as a plurality of substrate units. For example, as shown in the drawing, the first substrate 2112, the second substrate unit 2110 It may be implemented as a substrate 2114 and a third substrate 2116 .

Hereinafter, for convenience of explanation, a case in which the substrate part 2110 includes three substrates will be described as an example.

* Specifically, the substrate portion 2110 includes a first substrate 2112 disposed close to the first end of the main body 2120 where the core portion 2010 is exposed, and a second end opposite to the first end. It may include a second substrate 2114 disposed close to , and may further include a third substrate 2116 disposed between the first substrate 2112 and the second substrate 2114 .

Here, the first substrate 2112, the second substrate 2114, and the third substrate 2116 may be electrically connected to each other by a flexible printed circuit board (FC), and the hollow of the main body 2120 Depending on whether or not it is accommodated in (S5), it may be defined as the receiving substrate part C1 and the exposed substrate part C2, and a specific substrate may include the receiving substrate part C1 and the exposed substrate part C2 at the same time.

The receiving substrate part C1 and the exposed substrate part C2 virtually divide the substrate area into a part accommodated in the hollow S5 of the main body 2120 and a part exposed to the outside of the hollow S5. In one concept, the receiving substrate portion C1 and the exposed substrate portion C2 may simultaneously exist on one substrate.

For example, as shown in the drawing, since the first substrate 2112 and the third substrate 2116 are accommodated in the hollow S5 of the main body 2120, the entirety of the receiving substrate portion C1 can form

On the other hand, since only a portion of the second substrate 2114 is accommodated in the hollow S5, the accommodated portion may form the receiving substrate portion C1, and the remaining portion may form the exposed substrate portion C2.

That is, the second substrate 2114 may include at least a portion of the receiving substrate portion C1 and the exposed substrate portion C2 in the electronic pen 2000 according to the present invention.

Here, the main body 2020 is equipped with the main body 2120 and the receiving substrate part C1 so that the receiving substrate part C1 is fixed to a predetermined position in the hollow S5. A substrate fixing part 2030 may be provided, and the exposed substrate part C2 may be mounted on the substrate fixing part 2030 and fixed at a predetermined position.

The substrate fixing part 2030 may be a kind of structure for fixing the first substrate 2112, the second substrate 2114, and the third substrate 2116, and the first substrate 2112 and the second substrate 2114 ) and the third substrate 2116 may be mounted on the substrate fixing part 2030 by the additional component 2150.

The substrate fixing part 2030 may be composed of a single component, but is not necessarily limited thereto, and may be implemented by connecting a plurality of components to each other.

The exposed substrate portion C2, which is a part of the second substrate 2114, is exposed to the outside of the second end opposite to the first end of the main body 2120, where the core portion 2010 is exposed, to the outside of the wireless communication module. This may be disposed close to the second end.

Here, the camera module 2320 and the lighting module 2340 may be mounted on the first board 2112, even though they are electrically connected to the first board 2112 by a flexible printed circuit board (FC). free

Also, the battery unit 2160 providing driving power to the camera module 2320 and the lighting module 2340 may be disposed between the first substrate 2112 and the second substrate 2114 .

The battery unit 2160 may be mounted on a substrate mounting unit 2132 providing a mounting space S6.

The battery unit 2160 may be disposed between the first board 2112 and the second board 2114 so as to be biased toward the second end of the main body 2120 as a whole, but it is convenient for the user to write. In order to increase , the center of gravity of the electronic pen 2000 may be biased toward the first end of the main body 2120 .

Meanwhile, a wireless communication module 2440 enabling wireless communication with other electronic devices may be mounted on the second substrate 2114. Specifically, the exposed substrate portion C2 of the second substrate 2114 may have the above A wireless communication module 2440 may be mounted.

The wireless communication module 2440 may be exposed to the outside of the main body 2120 made of a first material, and may not receive any obstacle in wireless communication with other electronic devices despite the first material. there is.

Here, the first material constituting the main body 2120 may include aluminum (Al) to shield electromagnetic waves generated during wireless communication by the wireless communication module 2440, but must be made of aluminum (Al). It does not have to be, and any material capable of shielding electromagnetic waves can be applied.

As described above, the wireless communication module 2440 for implementing wireless communication with other electronic devices is disposed on the outside of the main body 2120 made of a first material capable of shielding electromagnetic waves. Since it is mounted on the exposed substrate portion C2 exposed to the outside, wireless communication can be implemented without being affected by the main body 2120, and thus the recognition of the user's handwriting can be maximized.

And, by the main body 2120 made of the first material, the electronic pen 2000 according to the present invention emits electromagnetic waves generated during wireless communication by the wireless communication module 2440 to the outside through the main body 2120. It is possible to minimize the harmfulness of electromagnetic waves generated during wireless communication by preventing

In addition, since the main body 2120 made of the first material has a higher heat transfer coefficient than the substrate fixing part 2030 made of synthetic resin such as plastic, heat generated by the operation of the lighting module 2340 is effectively discharged to the outside. Thus, the durability of the electronic pen 2000 can be improved.

Meanwhile, the body portion 2020 provided in the electronic pen 2000 according to the present invention surrounds the exposed substrate portion C2 together with the main body 2120 and the substrate fixing portion 2030, thereby surrounding the exposed substrate portion C2. ) may be provided with a substrate protection unit 2140 connected to the main body 2120 to protect it.

The substrate protecting portion 2140 may be a kind of cap that is connected to the second end of the main body 2120 and covers the exposed substrate portion C2, and the exposed substrate portion C2 is a second substrate 2114. It may be a part of as described above.

The substrate protection unit 2140 may be made of a second material that passes electromagnetic waves generated by wireless communication by the wireless communication module 2440 mounted on the exposed substrate unit C2, and thereby the wireless communication The module 2440 may not experience any obstacle in wireless communication with other electronic devices despite the substrate protection unit 2140 .

Here, the second material may be a synthetic resin including plastic, and may have a lower heat transfer coefficient than the first material.

55 to 57 are schematic perspective views for explaining a process of inserting a core into a body provided in an electronic pen according to an embodiment of the present invention.

First of all, referring to FIG. 55 , in the electronic pen 2000 according to the present invention, the core portion 2010 can be freely replaced, and the core portion 2010 is formed in the substrate fixing portion 2030 of the body portion 2020. It can be inserted into the insertion hole (S7).

Referring to FIG. 56, the substrate fixing part 2030 includes a substrate mounting part 2132 on which the receiving substrate part C1 is mounted, a deep part insertion guide part 2134 providing a path into which the core part 2010 is inserted, and the core part A core fixing portion 2136 may be provided to fix the core portion 2010 by forcefully fitting the core portion 2010 inserted into the insertion guide portion 2134 .

The substrate mounting portion 2132 may be a kind of frame constituting the substrate fixing portion 2030, and the deep insertion guide portion 2134 may be formed in an open state with a path communicating with the deep insertion hole S7. can

However, the deep insertion guide 2134 does not necessarily have to be formed in an open state, and may be formed as a kind of groove or hole.

Meanwhile, referring to FIGS. 55 and 56, the core insertion guide 2134 includes the first core insertion guide 2135 through which the core 2010 passes and the second core to which the core fixing unit 2136 is mounted. An insertion guide part 2137 may be provided, and the deep fixing part 2136 may be slidably mounted within the second deep insertion guide part 2137 .

The deep part fixing part 2136 may be detachably mounted on the second deep part insertion guide part 2137, and when mounted on the second deep part insertion guide part 2137, the second deep part insertion guide part 2137 ) may be provided with a protrusion 2139 formed by extending outwardly so as to be able to slide without being separated from within.

Also, the second deep insertion guide 2137 may include a protrusion corresponding portion 2131 protruding to form a space in which the protrusion 2139 is mounted.

When the deep part fixing part 2136 is mounted on the second deep part insertion guide part 2137, the protrusion part 2139 is caught by the protrusion corresponding part 2131, so that it can be prevented from escaping to the outside.

As the deep fixing part 2136 is slidably mounted within the deep insertion guide part 2134, the electronic pen 2000 according to the present invention allows the user to feel comfortable writing while writing.

On the other hand, the deep fixing part 2136 can act with the substrate mounting part 2132 and the attractive force within the second deep insertion guide part 2137, and the first magnet 2172 and the second magnet are means for generating the attractive force. The magnetic force by (2174) can be used.

The first magnet 2172 may be mounted on the deep fixing part 2136, and the second magnet 2174 may be mounted on the board mounting part 2132 so that the deep fixing part 2136 may be mounted on the board mounting part 2132. and can maintain the state of attraction.

An elastic body 2176 having elasticity may be disposed between the first magnet 2172 and the second magnet 2174, and the elastic body 2176 provides softness while the user writes on medium, thereby improving convenience. can improve

<How to control electronic devices>

1. Real-time reproduction method of handwritten content #1

Hereinafter, a first embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

58 is a flowchart of a first embodiment of a real-time reproduction method of content written by a user according to the present invention. Referring to FIG. 58 , a method for real-time reproduction of content written by a user includes obtaining pen data (S110), obtaining information on a target medium based on the obtained pen data (S120), and and displaying a medium image corresponding to (S130), and reproducing the user's handwriting on the medium image based on the acquired pen data (S140).

Reproducing the user's handwriting ( S140 ) may include reproducing the user's handwriting in real time at a corresponding position on the medium image based on stroke data generated from the pen data.

In this way, the electronic device 3000 may reproduce the user's handwritten contents in real time based on the pen data received from the electronic pen 2000 and display the contents through the electronic device 3000 .

While explaining the operation method of the above-described electronic device, since the description corresponding to each step has already been detailed, the detailed description is omitted here.

2. Real-time reproduction method #2 of user-written content

Hereinafter, a second embodiment of a method for real-time reproduction of content written by a user according to the present invention will be described.

59 is a flowchart of a second embodiment of a real-time reproduction method of content written by a user according to the present invention. Referring to FIG. 59 , the real-time reproduction method of the written content includes obtaining pen data (S210), a predetermined condition for a first area that is at least a part of a displayed medium image based on the obtained pen data. is satisfied (S220); if a predetermined condition is satisfied, shifting and displaying a part of the medium image being displayed on the display from the first area to the second area (S230); A step of reproducing the user's handwritten contents on the second area (S240) is included.

In this case, the predetermined condition may be whether the writing position of the user is out of the first area. That is, when the writing position of the user is out of the first area displayed through the display, it may be determined that the predetermined condition is satisfied.

Accordingly, when the electronic device 3000 reproduces the user's writing content in real time based on the pen data received from the electronic pen 2000, the target medium is enlarged and displayed, so that the entire target medium is displayed on the display. When the user's handwriting is input to another area that is not being displayed through the display, the user's handwriting can be reproduced after shifting the display area to the corresponding area.

While explaining the operation method of the above-described electronic device, since the description corresponding to each step has already been detailed, the detailed description is omitted here.

3. Replay of written content #1

Hereinafter, a first embodiment of a method for replaying written content according to the present invention will be described.

60 is a flowchart of a first embodiment of a method for replaying written content according to the present invention. Referring to FIG. 60 , receiving the user's handwriting-related information from an electronic pen that detects it (S310), storing the received user's handwriting-related information in a memory (S320), at least a first stroke and and performing a replay operation of sequentially replaying the user's handwritten contents including a second stroke following the second stroke on the display (S330).

At this time, the first stroke and the second stroke are displayed on the display one at a time, regardless of the time required for the user to write the first stroke and the second stroke, and the first stroke at a first time point. A stroke may be displayed on the display, and the second stroke may be displayed on the display at a second time point later than the first time point.

Accordingly, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000, the user's handwriting can be replayed within a shorter time than the time the user actually inputs the handwriting. there will be

While explaining the operation method of the above-described electronic device, since the description corresponding to each step has already been detailed, the detailed description is omitted here.

4. Replay of Written Content #2

Hereinafter, a second embodiment of a method for replaying written content according to the present invention will be described.

61 is a flowchart of a second embodiment of a method for replaying written content according to the present invention. Referring to FIG. 61 , the method for replaying the written content includes receiving pen data, which is information about the user's handwriting, through a communication unit (S410), and storing the received pen data in a memory (S420). ), and performing a replay operation of sequentially replaying the user's handwritten content on a display based on the stored pen data (S430).

In this case, the reproduction time of the replay operation is determined based on the number of strokes included in the user's handwriting, which is the object of the replay operation.

Accordingly, when the electronic device 3000 replays the user's handwriting based on the pen data received from the electronic pen 2000, the user actually inputs the handwriting by determining the reproduction time of the replay operation based on the number of strokes. The user's handwritten contents can be replayed in less than an hour.

While explaining the operation method of the above-described electronic device, since the description corresponding to each step has already been detailed, the detailed description is omitted here.

5. Capture your handwriting

Hereinafter, a handwriting capture method according to the present invention will be described.

62 is a flowchart of a handwriting capture method according to an embodiment of the present invention. Referring to FIG. 62 , the handwriting capture method includes at least one of receiving pen data from the electronic pen 2000 (S510), acquiring the writing content based on the pen data (S520), and playing a section of the writing content. Receiving a user input corresponding to the viewpoint of (S530), setting a target section based on the user input (S540), determining target handwritten content corresponding to the target section among the handwritten contents (S550), and target A step of capturing an image including handwritten contents (S560) may be included.

First, the electronic device 3000 may receive pen data related to handwriting from the electronic pen 2000 (S510). The pen data may include coordinate data written on the medium 1000 using the electronic pen 2000 and data related to the writing time.

The electronic device 3000 may obtain the written content using the pen data (S520). The handwritten content may be obtained by generating a stroke by connecting coordinate data in the order of writing time.

The electronic device 3000 may receive a user input corresponding to at least one viewpoint of the reproduction section (S530). To this end, the electronic device 3000 may display a progressive bar to receive a user input for the progressive bar, display handwritten content to receive an input for a specific stroke among the handwritten content, or receive user input while reproducing the handwritten content. there is. The electronic device 3000 may obtain start and end times of the playback section according to the user input. If only one viewpoint is acquired, the other viewpoints may be set by the electronic device 3000 itself.

In addition, in order to receive such user input, the electronic device 3000 may assist the user's input by displaying the entire writing content on the screen.

The electronic device 3000 may set a target section based on a user input (S540). The electronic device 3000 may determine the start time and end time of the target section according to the user input and set the target section accordingly.

When the target section is set, the electronic device 3000 may determine the target writing contents among all the writing contents (S550). One or a plurality of target writing contents may be determined. In addition, the electronic device 3000 may display the target writing content to be distinguished from other writing contents, and provide feedback to the user as to which writing content is determined as the target writing content.

The electronic device 3000 may capture the selected target writing section (S560). Capturing may be performed in an image capture method or a method through pen data. In addition, the captured image may be transmitted externally through an external device or the Internet, or stored separately.

In the control method of an electronic device according to the present invention described above, the step of configuring each embodiment is not essential, and therefore each embodiment may selectively include the above-described steps. In addition, each step constituting each embodiment does not necessarily have to be performed in the order described, and steps described later may be performed before steps described earlier.

In addition, the method for controlling an electronic device according to the present invention may be implemented in the form of a code or program that performs the same, and such code or program may be stored in a computer-readable recording medium.

The present invention described above is capable of various substitutions, modifications, and changes to those skilled in the art without departing from the technical spirit of the present invention. It is not limited by drawings. In addition, the embodiments described in this document may not be applied in a limited manner, but may be configured by selectively combining all or part of each embodiment so that various modifications can be made. Furthermore, steps constituting each embodiment may be used individually or in combination with steps constituting other embodiments.

1000: medium
2000: electronic pen
3000: electronic devices
4000: server

Claims (6)

As an electronic device for reproducing the user's handwriting on medium,
a communication unit that communicates with an electronic pen that detects information about a user's handwriting;
display; and
Including; control unit;
The control unit controls the display to display a medium image corresponding to the medium, reproduce and visually display the user's writing content on the medium image,
The control unit,
Determining whether the display mode through the display is a normal mode or an enlarged mode;
In the normal mode, the user's handwritten content is reproduced according to a first reproduction mode, and in the enlarged mode, the user's handwritten content is reproduced according to a second reproduction mode;
When the user's handwriting is reproduced according to the second reproduction mode, the first area of the medium image being displayed on the display is shifted according to the user's writing position through the enlargement mode.
Electronics.
According to claim 1,
Characterized in that when the control unit displays through the display in the normal mode, the edge position of the medium corresponds to the edge area of the screen being displayed on the display
Electronics.
According to claim 1,
The control unit,
When reproducing the user's writing contents according to the first reproduction mode, the user's writing contents are reproduced and visually displayed regardless of the user's writing position.
Electronics.
According to claim 1,
When reproducing the user's handwritten contents according to the second reproduction mode, the first area of the medium image is shifted so that at least one pen data included in the handwritten contents corresponding to the user's writing position is located in the center. characterized by
Electronics.
According to claim 1,
The control unit,
Based on at least one pen data among pen data constituting a plurality of strokes included in the user's handwriting, the first area of the medium image is set to shift,
The at least one pen data is at least one of pen data corresponding to a pen-down time point and pen data corresponding to a pen-up time point among a plurality of pen data constituting the user's handwritten content.
Electronics.
As a control method of an electronic device for reproducing a user's handwritten content on medium, by a control unit included in the electronic device,
displaying a medium image corresponding to the medium through a display;
determining whether a display mode through the display is a normal mode or an enlarged mode; and
reproducing the user's handwritten content according to a first reproduction mode in the normal mode, and reproducing the user's handwritten content according to a second reproduction mode in the enlarged mode; including,
When reproducing the user's writing contents according to the second reproduction mode, the control unit shifts the first area of the medium image displayed on the display in the enlarged mode according to the user's writing position. characterized by
How to control electronic devices.

Images