KR20160045537A - Electronic pen, electronic device associated with electronic pen, method for controlling electronic device and computer-readable medium on which program for performing the method for controlling electronic device is recorded - Google Patents

Abstract

According to the present invention, provided is an electronic device to replay notes written on a medium by a user. The electronic device comprises; a communication unit for communicating with an electronic pen which detects information on the notes written by the user; a memory for storing data; a display for visually displaying information; and a control unit for receiving pen data serving as the information on the notes written by the user through the communication unit, for storing the received pen data in the memory, and for performing a replay operation of sequentially replaying the notes written by the user on the display based on the stored pen data. The control unit determines time which is taken to reproduce the replay operation, based on the number of strokes included in the notes written by the user, which is a target of the replay operation.

Description

TECHNICAL FIELD [0001] The present invention relates to an electronic pen, an electronic apparatus interlocked with an electronic pen, a control method of the electronic apparatus, and a recording medium storing a program for executing the control method of the electronic apparatus. MEDIUM ON WHICH PROGRAM FOR PERFORMING THE METHOD FOR CONTROLLING ELECTRONIC DEVICE IS RECORDED}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic pen, an electronic apparatus interlocked with an electronic pen, and a control method of the electronic apparatus, and more particularly to an electronic pen for recognizing and displaying a handwriting of a user, And a control method.

BACKGROUND ART [0002] Recently, technologies and products capable of recognizing a user's handwriting using a digital pen and digitizing and storing recognized contents have been commercialized. However, development of a method for providing contents of a handwriting recognized and digitized using such an electronic pen to a user in a meaningful manner has not been developed yet, and methods for enabling a user to utilize digitized handwriting contents more effectively Development is required.

On the other hand, the conventional electronic pen is generally located at the center of the main body to which the user grips, adopts a conventional writing instrument configuration, and is inserted and stored in the cover in the non-use state.

When the main body is inserted into the cover, protrusions are formed on the outer surface of the main body and grooves are formed on the inner surface of the cover to prevent the main body from being separated from the cover. Respectively.

In such a conventional method, protrusions are frequently broken due to external factors that may be generated during use of the main body by the user, which leads to a decrease in the coupling strength between the main body and the cover, .

An object of the present invention is to provide an electronic pen capable of recognizing a handwriting of a user and replaying a handwriting of a recognized user at a later time, and an electronic apparatus and an electronic apparatus control method interlocked with the electronic pen.

It is to be understood that the present invention is not limited to the above-described embodiments and that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the following claims .

According to an aspect of the present invention, there is provided an electronic device for replaying a user's handwriting content on a medium, the electronic device comprising: a communication unit for communicating with an electronic pen for sensing information on the handwriting of the user; A memory for storing data; A display for visually displaying information; And a control unit for receiving via the communication unit pen data which is information on the handwriting of the user, storing the received pen data in the memory, and writing the handwriting contents of the user on the display sequentially Wherein the control unit is operable to determine the play time of the replay operation based on the number of strokes included in the handwriting of the user who is the subject of the replay operation, Is provided.

According to another aspect of the present invention, there is provided a method of controlling an electronic device for replaying a user's handwriting on a medium, comprising: receiving pen data, which is information on handwriting of the user, through a communication unit; Storing the received pen data in a memory; And performing a replay operation for sequentially replaying the handwritten content of the user on the display based on the stored pen data, wherein the play time of the replay operation is determined by a user's handwriting A control method of an electronic device is provided which is determined based on the number of included strokes.

According to still another aspect of the present invention, there is provided a recording medium on which a program for executing a control method of an electronic apparatus provided by the above-described present invention is recorded.

It is to be understood that the solution of the problem of the present invention is not limited to the above-mentioned solutions, and the solutions which are not mentioned can be clearly understood by those skilled in the art to which the present invention belongs It will be possible.

According to the present invention, it is possible to replay the progress of the handwriting of the user at a later time, thereby enabling the user to check more information (for example, written order, etc.) from the written content.

Further, according to the present invention, in replaying the handwriting contents of the user, it is possible to provide a replay of the handwriting of the user in a more effective and efficient manner in a shorter time by appropriately controlling the replay reproduction time have.

1 is a schematic diagram for explaining a system including an electronic pen associated with the embodiments of the present invention and an electronic device interlocked with the electronic pen and the like.
2 is a diagram illustrating an embodiment of a medium related to embodiments of the present invention.
3 is a diagram showing an exemplary appearance of an electronic pen according to embodiments of the present invention.
4 is a block diagram for explaining components of the electronic pen according to the embodiments of the present invention.
5 is a block diagram for explaining components of an electronic apparatus according to embodiments of the present invention.
6 and 7 are views showing unit cells constituting a code pattern according to an embodiment of the present invention.
8 is a diagram for explaining a method of encoding 2-bit information in an information code according to embodiments of the present invention.
9 is a diagram for explaining a method of generating position information of the electronic pen with respect to the medium according to the embodiments of the present invention.
FIG. 10 is a diagram for explaining an embodiment of real time reproduction of a handwriting content of a user according to the present invention according to the present invention.
FIGS. 11 to 15 are views for explaining another embodiment for reproducing the handwriting contents of the user according to the present invention in real time.
16 is a diagram for explaining a replay object section according to the present invention.
FIG. 17 is a view showing replay reproduction time determined according to an embodiment of the present invention, with respect to a replay object section as shown in FIG. 16. FIG.
FIGS. 18 and 19 are views showing replay reproduction time determined according to another embodiment of the present invention, with respect to the replay object section as shown in FIG.
Figures 20-24 are illustrations of some other embodiments for determining a replay play time to replay a stroke handwritten by a user in accordance with some other embodiments of the present invention.
25 is a diagram for explaining a method of determining a play time of a replay based on the number of strokes, according to some embodiments of the present invention.
26 is a diagram for explaining an embodiment for determining the replay speed of replay according to the number of strokes included in the replay object contents according to some embodiments of the present invention.
27 is a diagram for explaining an embodiment for determining the number of replay strokes per unit time in accordance with the replay reproduction speed according to some embodiments of the present invention.
28 is a diagram for explaining a method of performing a replay operation for a handwriting of a user, according to some embodiments of the present invention.
FIG. 29 is a diagram showing the overall handwriting content and the target handwriting content in the capture operation of the electronic device according to the present invention. FIG.
30 to 32 show an example of a user interface for receiving an object interval according to the present invention.
33 to 35 show another example of a user interface for receiving an object interval according to the present invention.
36 and 37 are still another example of a user interface for receiving an object interval according to the present invention.
FIG. 38 is a diagram illustrating a screen for outputting entire handwriting contents for receiving an object section according to the present invention; FIG.
Figs. 39 and 40 are diagrams showing a screen for identifying target handwriting contents according to the present invention. Fig.
41 is a diagram showing a captured image according to the present invention.
FIG. 42 is a schematic perspective view of an electronic pen according to an embodiment of the present invention. FIG.
FIG. 43 is a schematic perspective view showing a state in which the cap portion provided in the electronic pen according to the embodiment of the present invention is inserted into the other side of the main body. FIG.
FIG. 44 is a schematic perspective view showing an internal configuration of a cap portion and a main body portion provided in an electronic pen according to an embodiment of the present invention. FIG.
45 is a schematic sectional view taken along the line AA of Fig.
46 is a schematic perspective view showing a modified example of the cap portion provided in the electronic pen according to the embodiment of the present invention.
47 is a schematic front view showing a main body provided in an electronic pen according to an embodiment of the present invention.
48 and 49 are schematic side views for explaining the process of inserting the cap portion into one side of the main body provided in the electronic pen according to the embodiment of the present invention.
FIGS. 50 and 51 are schematic perspective views of an electronic pen according to an embodiment of the present invention.
FIGS. 52 to 54 are schematic perspective views illustrating a substrate unit, a camera module, and an illumination module, which are positioned and fixed to a body portion provided in an electronic pen according to an embodiment of the present invention.
55 to 57 are schematic perspective views illustrating a process of inserting a deep portion into a body portion provided in an electronic pen according to an embodiment of the present invention.
58 is a flowchart of a first embodiment of a method for real-time reproduction of contents written by a user according to the present invention.
59 is a flowchart of a second embodiment of a method for real-time reproduction of contents written by a user according to the present invention.
60 is a flowchart of a first embodiment of a replay method of written contents according to the present invention.
61 is a flowchart of a second embodiment of a replay method of written contents according to the present invention.
62 is a flowchart of a handwriting capturing method according to the embodiment of the present invention.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to be illustrative of the present invention and not to limit the scope of the invention. Should be interpreted to include modifications or variations that do not depart from the spirit of the invention.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, they are generally used in general terms. However, the present invention is not limited to the intention of the person skilled in the art to which the present invention belongs . However, if a specific term is defined as an arbitrary meaning, the meaning of the term will be described separately. Accordingly, the terms used herein should be interpreted based on the actual meaning of the term rather than on the name of the term, and on the content throughout the description.

The drawings attached hereto are intended to illustrate the present invention easily, and the shapes shown in the drawings may be exaggerated and displayed as necessary in order to facilitate understanding of the present invention, and thus the present invention is not limited to the drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of known configurations or functions related to the present invention will be omitted when it is determined that the gist of the present invention may be obscured.

The electronic device that is interlocked with the electronic pen described in the present specification can be used in various applications such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) A mobile terminal, a fixed terminal such as a digital TV, a desktop computer, and the like.

According to an aspect of the present invention, there is provided an electronic device for reproducing a user's handwriting content on a medium, comprising: a communication unit for communicating with an electronic pen for sensing information on the handwriting of the user; A display which displays at least a part of the medium image corresponding to the medium and reproduces and visually displays the handwriting contents of the user on the medium image; And determining, based on the pen data received from the communication unit, whether the user's handwriting position satisfies a predetermined condition for a first area that is at least a part of the medium image being displayed on the display, If it is satisfied, displaying the second area on the display by shifting a part of the medium image being displayed through the display from the first area to a second area different from the first area, A control unit for displaying reproduction of the handwriting contents of the user at a position on the second area corresponding to the handwriting position of the user; An electronic apparatus including the above-described electronic apparatus can be provided.

The predetermined condition may be whether or not the writing position of the user is out of the first area.

Or the predetermined condition may be whether or not the writing position of the user is included in the edge area of the first area.

The second area may be determined based on the user's handwriting position for the medium.

At this time, the second area may be determined so that the handwriting position of the user with respect to the medium is located at a central portion.

 Alternatively, the second area may be determined by further considering the position of the edge of the medium image.

In particular, the second area may be determined so that the edge position of the medium image does not deviate by more than a predetermined distance from the edge area of the screen displayed on the display.

The controller may determine whether the predetermined condition is satisfied by using at least a part of pen data among a plurality of pen data for one stroke included in the handwriting of the user in determining whether the predetermined condition is satisfied .

The controller may determine whether the predetermined condition is satisfied by using the first pen data corresponding to the pen-down time among the plurality of pen data for the one stroke.

The control unit may determine the second area based on the position information included in the first pen data when the predetermined condition is satisfied.

 The control unit may determine whether the predetermined condition is satisfied by using second pen data corresponding to the pen-up time among the plurality of pen data for the one stroke.

The control unit may determine the second area based on the position information included in the second pen data when the predetermined condition is satisfied.

The control unit may determine whether each of the plurality of strokes included in the handwriting of the user satisfies the predetermined condition.

According to another aspect of the present invention, there is provided an electronic device for reproducing a user's handwriting content for a medium, comprising: a communication unit for communicating with an electronic pen for sensing information about the handwriting of the user; A display for displaying at least a partial area of the medium image corresponding to the medium and for visualizing the handwriting content of the user on the medium image; And displaying pen strokes included in the user's handwriting at a corresponding position of the medium image, receiving pen data constituting a second stroke included in the handwriting of the user, and configuring the second stroke Determining whether or not the position of the second stroke satisfies a predetermined condition based on at least one pen data of the pen data, and when the predetermined condition is satisfied, determining whether the position of the at least one pen A control unit for shifting at least a part of the area of the medium image displayed through the display based on the data, corresponding to the distance and the direction of the first stroke; An electronic apparatus including the above-described electronic apparatus can be provided.

The predetermined condition may be whether or not the positional information of the at least one pen data constituting the second stroke is deviated from a partial area of the image of the medium currently being displayed through the display.

The control unit may shift at least a partial area of the medium image such that a position corresponding to the at least one pen data is located at a central portion.

The at least one pen data may be at least one of pen data corresponding to a pen-down time point and pen data corresponding to a pen-up time point among a plurality of pen data constituting the second stroke.

According to still another aspect of the present invention, there is provided an electronic apparatus for reproducing a user's handwriting content on a medium, the communication apparatus comprising: a communication unit for communicating with an electronic pen for sensing information on the handwriting of the user; A display for displaying a medium image corresponding to the medium and reproducing the written contents of the user on the medium image to visually display the medium image; And determining whether the user's handwriting content is being reproduced through the display in the normal mode or the enlargement mode, and in the normal mode, reproducing the handwriting content of the user according to the first reproduction mode, A control unit for reproducing the handwriting contents of the user according to a second reproduction mode; Wherein, when reproducing the handwriting content of the user according to the second reproduction mode, the control unit displays a partial area of the medium image displayed on the display through the enlargement mode to the user's handwriting position An electronic device characterized by being shifted along a predetermined direction.

According to still another aspect of the present invention, there is provided a method of controlling an electronic device for reproducing a user's handwriting content on a medium, the method comprising the steps of: based on pen data received from a communication unit communicating with an electronic pen Determining whether a user's handwriting position satisfies a predetermined condition for a first area that is at least a portion of a medium image being displayed through the display; Wherein when the predetermined condition is satisfied, a part of the medium image displayed through the display is displayed in the first area in a manner different from the first area in the first area so that the display of the user's handwriting content can be displayed on the display Shifting to a second area to display the second area via the display; And displaying a representation of the user's handwriting content at a location on the second area corresponding to the handwriting location of the user to reproduce the handwriting content of the user; A control method of an electronic apparatus including the electronic apparatus may be provided.

The predetermined condition may be whether or not the writing position of the user is out of the first area.

The predetermined condition may be whether or not the writing position of the user is included in the edge area of the first area.

The second area may be determined based on the user's handwriting position for the medium.

The second area may be determined so that the writing position of the user with respect to the medium is located at a central portion.

 Wherein the determining step determines whether the predetermined condition is satisfied by using at least a part of the pen data among the plurality of pen data for one stroke included in the handwriting of the user It can be judging.

The determining step may determine whether the predetermined condition is satisfied using the first pen data corresponding to the pen-down time point among the plurality of pen data for the one stroke.

If the predetermined condition is satisfied, the second area may be determined based on the position information included in the first pen data.

 The determining may determine whether the predetermined condition is satisfied using the second pen data corresponding to the pen-up time among the plurality of pen data for the one stroke.

If the predetermined condition is satisfied, the second area may be determined based on the position information included in the second pen data.

The determining may determine whether each of the plurality of strokes included in the handwriting of the user satisfies the predetermined condition.

According to still another aspect of the present invention, there is provided a method of controlling an electronic device for reproducing a user's handwriting content on a medium, comprising: receiving pen data constituting a first stroke included in a handwriting of the user from an electronic pen; Displaying a first stroke included in the handwriting of the user at a corresponding position of the medium image; Receiving pen data constituting a second stroke included in the handwriting of the user from the electronic pen; Determining whether a position of the second stroke satisfies a predetermined condition based on at least one pen data of the pen data constituting the second stroke; Wherein at least a portion of the medium image being displayed through the display is shifted according to the distance and direction of the first stroke of the at least one pen data constituting the second stroke when the predetermined condition is satisfied, ; And displaying the medium image with the second stroke in the shifted partial area; A control method of an electronic apparatus including the electronic apparatus may be provided.

According to another aspect of the present invention, there is provided a method of controlling an electronic device for reproducing a user's handwriting content on a medium, the method comprising the steps of: determining whether the handwriting content of the user is reproduced through a display, ; And reproducing the handwriting contents of the user according to the first reproduction mode when the normal mode is selected and reproducing the handwriting contents of the user according to the second reproduction mode when the enlarging mode is selected; Wherein, when reproducing the handwriting content of the user according to the second reproduction mode, the control unit displays a partial area of the medium image displayed on the display through the enlargement mode to the user's handwriting position And then shifting according to the control signal.

According to another aspect of the present invention, there is provided a recording medium on which a program for executing a control method of an electronic apparatus provided by the above-described present invention is recorded.

First, an electronic pen associated with some embodiments of the present invention, an environment in which an electronic apparatus associated with the electronic pen is operated will be briefly described, and an electronic pen according to the embodiments of the present invention, And a control method of the electronic apparatus will be described in detail.

<System configuration>

1 is a schematic diagram for explaining a system including an electronic pen and an electronic device associated with the electronic pen and the like in connection with the embodiments of the present invention.

The system may include at least one medium 1000, at least one electronic pen 2000, at least one electronic device 3000, and at least one server 4000.

The medium 1000 provides a surface for writing a desired item by using the electronic pen according to the embodiments of the present invention.

The medium 1000 may be made of paper, plastic, metal or the like, and the material of the medium 1000 is not limited to the present invention.

In the case where the electronic pen according to the embodiments of the present invention is an electronic pen (hereinafter referred to as an optical electronic pen) implemented using an optical component including a camera module or the like, It may have a code pattern that can be recognized. A detailed description of the code pattern will be given later. When the code pattern is provided in the medium 1000, the code pattern may be provided to the medium 1000 through a method such as printing.

The electronic pen 2000 can generate pen data by sensing information about the handwriting of the user. The pen data may be used to generate stroke data or the like for the user's handwriting. A detailed description of the pen data will be given later.

The electronic device 3000 can receive pen data from the electronic pen 2000 and analyze it. Stroke data can be generated according to interpretation of the pen data.

The electronic device 3000 can appropriately process the analyzed stroke data, reproduce the user's handwriting in real time according to the stroke data through a display or the like provided in the electronic device 3000, or replay it at a later time.

The electronic device 3000 may store the stroke data generated according to the analysis of the pen data and / or the pen data, for example, in a memory provided in the electronic device 3000, and may store the pen data and / Or perform appropriate processing on the stroke data.

The electronic device 3000 may be connected to the server 4000 through a network and transmit or receive necessary information through a network.

The server 4000 can be connected to the electronic device 3000 through a network to receive or transmit necessary information.

The server 4000 may be connected to a plurality of electronic devices 3000 to convert the pen data (or stroke data) received from the electronic devices 3000 into a database.

The server 4000 can appropriately process the pen data (or the stroke data) stored in the database in response to a request from the plurality of electronic devices 3000 or a user's request.

The server 4000 can share some or all of the functions of the electronic device 3000 described above. For example, the electronic device 3000 can receive the pen data from the electronic pen 2000 and transmit the pen data directly to the server 4000 without performing any special processing procedure on the pen data. In this case, , The server 4000 can perform operations such as the operation of receiving pen data to generate stroke data, storing of stroke data, and further processing of stroke data, as described above.

1, one medium 1000-1 corresponds to one electronic pen 2000-1, but the corresponding relationship between the medium 1000 and the electronic pen 2000 is 1: N or N: 1, respectively.

1, one electronic pen 2000-1 corresponds to one electronic apparatus 3000-1, but the corresponding relationship between the electronic pen 2000 and the electronic apparatus 3000 is 1: N or N: 1.

In addition, although a plurality of electronic devices 30000 are shown as being connected to one server 4000 in FIG. 1, a system according to embodiments of the present invention may include two or more servers.

1, the electronic pen 2000 is shown as performing communication with the electronic device 3000 and the electronic device 3000 is shown as performing communication with the electronic pen 2000 and the server 4000 However, if necessary, the electronic pen 2000 may perform communication with the direct server 4000.

<Medium>

Next, the medium 1000 related to the embodiments of the present invention will be described.

2 is a diagram illustrating an embodiment of a medium related to embodiments of the present invention.

Referring to FIG. 2, a note or book has a plurality of mediums 1000. As shown in FIG. 2, according to some embodiments of the present invention, at least some or all of the pages that make up a note or book may be implemented in a medium 1000 according to embodiments of the present invention. For example, when the electronic pen 1000 is implemented as an optical system electronic pen, a code pattern according to embodiments of the present invention may be provided on at least a part or all of pages constituting a note or book.

On the other hand, only a part of the whole surface of a page or a page constituting the book can be implemented in the medium 1000 according to the embodiments of the present invention. For example, in the case where the electronic pen 1000 is implemented as an optical system electronic pen, the code pattern is not provided on the whole surface of the page constituting the note or book, .

Meanwhile, although not shown in the drawings, a medium 1000 according to embodiments of the present invention may be implemented in the form of a blackboard or the like. That is, the medium 1000 according to the embodiments of the present invention may be implemented in the form of a blackboard (electronic board) provided with a code pattern.

<Electronic pen>

Next, the electronic pen according to the embodiments of the present invention will be described.

Fig. 3 is a view showing an exemplary appearance of the electronic pen according to the embodiments of the present invention, and Fig. 4 is a block diagram for explaining components of the electronic pen according to the embodiments of the present invention.

3, the electronic pen 2000 includes a main body portion 2020 for positioning and fixing a deep portion 2010 (see FIG. 42) for enabling writing to the medium 1000, A cap portion 2030 for protecting the cap 2030, and the like.

Here, the non-use state may mean a state in which the electronic pen 2000 is stored according to an embodiment of the present invention. In this case, since the deep portion 2010 is not exposed to the outside, . &Lt; / RTI &gt;

The core 2010 may include a ball and ink as components to be written on the medium 1000, and the ink may be various, such as oily, aqueous or neutral.

The core 2010 may be a black core used for a pencil or may be used for a common writing instrument.

The main body part 2020 may be a kind of grip part that can be gripped by the user by being inserted into the body part 2010 to expose a part of the core part 2010 and fixing the position of the core part 2010. [

The cap portion 2030 may have a predetermined internal space for inserting one side of the main body portion 2020 in a non-use state and protecting the core portion 2010. The cap portion 2030 may be inserted into the other side of the main body portion 2020 A portion of the core 2010 may be exposed to the outside to enable writing.

When the cap 2030 can be written by the core 2010, the cap 2030 need not necessarily be inserted into the other side of the main body 2020, but may be separated from the main body 2020, As shown in FIG.

4, an electronic pen 2000 according to an embodiment of the present invention includes an input unit 2100, an output unit 2200, a pattern sensing unit 2300, a communication unit 2400, a sensor unit 2500, A memory 2600, a power supply 2700, a controller 2800, and the like. However, the components shown in Fig. 4 are not essential, and an electronic pen having more components than the illustrated components or having fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic pen 2000 will be described in turn.

The input unit 2100 can receive a user input from a user. The user input may be in various forms including a button input, a key input, a touch input, and a voice lunar power. For example, the electronic pen 2000 can receive a button input from a user and control power on / off of the electronic pen 2000. [

Examples of the input unit 2100 include a touch sensor that detects a touch of a user, a microphone that receives a voice signal, a camera that recognizes a gesture through image recognition, A proximity sensor composed of an illuminance sensor or an infrared sensor, a motion sensor for recognizing a user's operation through an acceleration sensor or a gyro sensor, and various other types of input means for sensing or receiving various types of user input .

The output unit 2200 can output various information and provide it to the user. The output unit 2200 may include a display for outputting visible light that can be recognized through the user's viewpoint, a speaker for outputting sound that can be recognized through the hearing of the user, A haptic device, and various other types of output means. For example, the electronic pen 2000 is connected to a buzzer (not shown) provided in the electronic pen 2000 to provide the user with information on whether the electronic pen 2000 is turned on or off, buzzer) and the like. For example, in order to provide the user with information on the operating state of the electronic pen 2000, predetermined visible light may be output through a display such as an LED lamp.

The pattern sensing unit 2300 is configured to sense a code pattern in which position information for determining the position of the electronic pen 2000 with respect to the medium 1000 is encoded and includes a camera module 2320 and a lighting module 2340).

The camera module 2320 is for acquiring an image of a code pattern provided in the medium 1000. The camera module 2320 may set the camera 1000 in accordance with a predetermined time interval (for example, 1/60 seconds to 1/240 seconds, etc.) while the electronic pen 2000 moves on the medium 1000, And acquires an image of a partial area of the code pattern provided in the medium 1000. [ Accordingly, the electronic pen 1000 analyzes the information about the unit cell included in the acquired image according to a method of analyzing a code pattern to be described later, and determines the position of the electronic pen 2000 for the medium 1000 Can be interpreted in the form of coordinates.

The illumination module 2340 irradiates light of a predetermined frequency to the medium 1000 so that an image of the code pattern can be acquired through the camera module 2320. [ The code pattern provided in the medium 1000 according to an embodiment of the present invention may be printed using ink that absorbs infrared light, in which case the light module 2340 may be well absorbed by the ink So that light of a wavelength can be irradiated to the medium 1000. In this case, the camera module 2320 can be configured to take an image of the infrared band, and the camera module 2320 can include an infrared ray filter for selectively passing only the infrared ray band.

The communication unit 2400 can perform communication with an external device. For example, the electronic pen 2000 can communicate with the electronic device 3000 or the server 4000 through the communication unit 2400. Accordingly, the electronic pen 2000 can exchange various information with an external device. For example, the electronic pen 2000 can transmit pen data or the like generated in the electronic pen 2000 to the electronic device 3000 or the server 4000 through the communication unit 2400, Or data for controlling the operation of the electronic pen 2000 or providing information necessary for the electronic pen 2000 may be received from the electronic device 3000 or the server 4000 through the communication unit 2400 .

The communication unit 2400 may include a wired module 2420 and a wireless module 2440.

The wired module 2420 is a module for transmitting and receiving data to / from an external device by wire, and may include a configuration such as a USB port, a PS / 2 port, a parallel port, and a serial port capable of transmitting and receiving data with an external device , And an Ethernet port for connecting to the Internet or the like through a LAN (Local Area Network).

The wireless module 2440 includes a mobile communication module that connects to a mobile communication network via a mobile communication base station and transmits and receives data, a WLAN (Wireless Local Area Network) based communication method such as Wi-Fi, And a short distance communication module using a wireless personal area network (WPAN) based communication method such as Zigbee.

The sensor unit 2500 can sense various information. Here, various information can be utilized to generate a control signal for controlling the operation of the electronic pen 2000, and can be used to generate pen data generated by the electronic pen 2000. [ Various information sensed through the sensor unit 2500 may be provided to the electronic device 3000 or the server 4000. [

The sensor unit 2500 may include a pressure sensor 2520, a pentium sensor 2540, a slip sensor 2560, and the like.

The pressure sensor 2520 can sense the pressure generated at the time of writing by the user. For example, when the user writes using the electronic pen 2000, contact of the electronic pen 2000 with the writing surface occurs, and the pressure generated at this time is sensed by the pressure sensor 2520 . In particular, the pressure sensor 2520 is provided at the rear end of the pen core (deep portion 2010) mounted on the electronic pen 2000 (on the other end side than the pen tip among the both ends of the pen shim) to sense the pressure. The electronic pen 2000 can use the pressure value sensed by the pressure sensor 2520 when generating pen data, which will be described later in detail. At this time, the pressure value included in the pen data may be used to reproduce the contents written by the user by processing the pen pressure information applied to the medium 1000 at the time of writing by the user. Or the electronic pen 2000 in the off state may be used as a trigger signal for turning on the state of the electronic pen 2000 based on a signal output through the pressure sensor 2520. [

The pen center sensor 2540 can sense a pen point identifier for indicating the type of the pen center (deep portion 2010) mounted on the electronic pen 2000. [ For example, a pen-center identifier for indicating the color of the pen-core (the deep portion 2010) may be provided outside the pen-center (the center portion 2010) mounted on the electronic pen 2000. At this time, Can detect the pen-point identifier through an optical / magnetic method or various other available methods. The information about the pen center (the center part 2010) analyzed by the value sensed by the pen center sensor 2540 or the sensed value may be provided to the electronic device 3000, and the electronic device 3000 may receive information And can be used to reproduce the contents written by the user.

The slip sensor 2560 can sense the state of the electronic pen 2000 used to determine whether the electronic pen 2000 in the on state automatically switches to the off state. For example, the slip sensor 2560 may include an acceleration sensor or the like, and the presence or absence of movement of the electronic pen 2000 may be sensed through an acceleration sensor or the like. If it is determined that the electronic pen 2000 is not moving for a predetermined period of time based on the sensed value through the slip sensor 2560, the electronic pen 2000 automatically detects the electronic pen 2000 The state can be switched to the off state.

According to some embodiments of the present invention, when the electronic pen 2000 is in an on state, power is normally supplied to the components provided in the electronic pen 2000, However, when the electronic pen 2000 is in an off state, power to all the components or some components provided in the electronic pen 2000 is cut off and provided in the electronic pen 2000 All or some of the components may not function normally. Particularly, according to some embodiments of the present invention, even when the electronic pen 2000 is in the off state, the analysis module for analyzing the signal output from the pressure sensor 2520 and / Power can be supplied so that the electronic pen 2000 in the off state can be automatically switched on based on the sensing value output from the pressure sensor 2520. [

The memory 2600 can store various kinds of information. The memory 2600 may store data temporarily or semi-permanently. An operating program such as firmware for driving the electronic pen 2000 can be stored in the memory 2600 and the pen data generated by the electronic pen 2000, the sensor unit 2500, Information, command, and data necessary for driving the electronic pen 2000, such as a sensing value output by the electronic pen 2000, can be stored.

Examples of the memory 2600 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a ROM (Read-Only Memory), a RAM (Random Access Memory) This can be.

The power supply unit 2700 can supply power necessary for operation of each component of the electronic pen 2000. [ When the communication unit 2400 of the electronic pen 2000 includes a charging port (for example, a USB port), the power supply unit 2700 may be implemented as a rechargeable battery. 2000 are connected to the electronic device 3000, power can be supplied from the electronic device 3000, so that the battery can be charged.

The control unit 2800 controls the overall operation of the electronic pen 2000. To this end, the control unit 2800 may perform various operations on information and control the operation of the components of the electronic pen 2000.

The control unit 2800 may analyze the image of the code pattern acquired by the pattern sensing unit 2300 and may decode information encoded in the unit cell included in the image of the obtained code pattern, Further, from the decoded information, position coordinates of the electronic pen 2000 with respect to the medium 1000 and identification information (e.g., book information or page information) with respect to the medium 1000 can be obtained.

The control unit 2800 can generate pen data based on the information obtained by decoding the information encoded in the unit cell. As described above, the generated pen data is stored in the memory 2600, To the electronic device (3000) and / or the server (4000) through the communication unit (2400). A detailed description of the generation of pen data will be given later.

Meanwhile, the control unit 2800 analyzes the image obtained by the first control unit and the pattern sensing unit 2300 for controlling the general operation of the electronic pen 2000, decodes the necessary information in the unit cell, And a second control unit for generating pen data. The control unit 2800 may be logically divided into the first control unit and the second control unit, but the first control unit and the second control unit may be divided into physical As shown in FIG.

The control unit 2800 may be implemented as a computer or similar device in accordance with hardware software or a combination thereof. The hardware type control unit may be provided in the form of an electronic circuit for performing a control function by processing an electrical signal, and may be provided in the form of a program for operating a hardware type control unit in software.

On the other hand, in the following description, the operation of the electronic pen 2000 can be interpreted as being performed by the control unit 2800 when no particular mention is made.

<Electronic equipment>

Next, an electronic device 3000 according to embodiments of the present invention will be described.

5 is a block diagram for explaining components of an electronic apparatus according to embodiments of the present invention.

5, the electronic device 3000 may include an input module 3100, an output module 3200, a communication module 3300, a memory module 3400, and a control module 3500. However, the components shown in FIG. 5 are not essential, and an electronic device having more components than the illustrated components or having fewer components than the illustrated components may be implemented.

Hereinafter, each component of the electronic device 3000 will be described in turn.

Input module 3100 may receive user input from a user. The user input may be in various forms including key input, touch input, and phonetic lunar power. Examples of the input module 3100 capable of receiving such a user input include a conventional keypad, a keyboard, a mouse, a touch sensor that detects a user's touch, a microphone that receives a voice signal, and a gesture A proximity sensor including an illuminance sensor or an infrared ray sensor for detecting user access, a motion sensor for recognizing a user's operation through an acceleration sensor or a gyroscope, and various other forms of detecting or receiving various types of user input And an input means for inputting the input data. Here, the touch sensor may be implemented by a touch panel attached to a display panel or a piezoelectric or electrostatic touch sensor that senses a touch through a touch film, or an optical touch sensor that senses a touch by an optical method.

The output module 3200 can output various information and provide it to the user. The output module 3200 includes a display for outputting visible light that can be recognized through the user's viewpoint, a speaker for outputting a sound that can be recognized through the auditory sense of the user, A haptic device, and various other types of output means.

The display may output an image for reproducing contents written by a user using the electronic pen 2000 and / or the electronic device 3000 according to an embodiment of the present invention.

In addition, the display may be a liquid crystal display (LCD)

A light emitting diode (LED) display, an organic light emitting diode (OLED) display, a flat panel display (FPD), a transparent display, a curved display, which means an optical image display device including all kinds of devices capable of performing a video display function, a flexible display, a 3D display, a holographic display, a projector, to be. Such a display may be in the form of a touch display integrated with the touch sensor of the input module 3100.

The communication module 3300 can perform communication with an external device. For example, the electronic device 3000 can communicate with the electronic pen 2000 or the server 4000 through the communication module 3300. Accordingly, the electronic device 3000 can transmit / receive various information to / from the external device. For example, the electronic device 3000 can receive pen data or the like generated in the electronic pen 2000 through the communication module 3300, and can transmit necessary information to the electronic pen 2000. [ The electronic device 3000 can transmit the stroke data obtained by analyzing the pen data or the pen data received from the electronic pen 2000 to the server 4000 through the communication module 3300, Can be received from the server (4000).

The communication module 3300 is a wired communication module including a LAN port, a USB port, a PS / 2 port, a parallel port, and a serial port, which are connected to the Internet or the like via a LAN (Local Area Network) A mobile communication module for connecting and receiving data to and from a network, a wireless local area network (WLAN) communication system such as Wi-Fi, a wireless personal area network (WPAN) system such as Bluetooth and Zigbee A satellite communication module using a Global Navigation Satellite System (GNSS) such as a Global Positioning System (GPS), or a combination thereof.

The memory module 3400 can store various kinds of information. The memory module 3400 may store data temporarily or semi-permanently. The memory module 3400 may store an operating system (OS) for driving the electronic device 3000 and may store various data received from the electronic pen 2000, And an application program for processing various data received from the mobile terminal.

Examples of the memory module 3400 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a ROM (Read-Only Memory), a RAM (Random Access Memory) And so on.

The control module 3500 controls the overall operation of the electronic device 3000. To this end, the control module 3500 may perform various operations on information and control the operation of the components of the electronic device 3000.

The control module 3500 may be implemented in a computer or similar device depending on the hardware software or a combination thereof. A hardware type control module may be provided in the form of an electronic circuit for performing a control function by processing an electrical signal, and a software type for controlling a hardware type control module).

On the other hand, in the following description, the operation of the electronic device 3000 can be interpreted as being performed by control of the control module 3500 unless otherwise specified.

<Operation of electronic pen>

Hereinafter, the operation of the electronic pen according to the embodiments of the present invention will be described.

A user can make a handwriting using the electronic pen 2000 according to embodiments of the present invention in a medium 1000 according to some embodiments of the present invention.

In addition, the electronic pen 2000 according to embodiments of the present invention acquires an image for at least some areas of the code pattern provided in the medium 1000 according to some embodiments of the present invention, The position information can be obtained by interpreting the information encoded in the unit cell included in the unit cell. The electronic pen 2000 acquires and processes / stores the image for the code pattern and the position information interpreted therefrom, while the user is writing, thereby consequently allowing the user to select the desired position on the medium 1000 It is possible to generate basic data that can be interpreted as to whether the handwriting has proceeded along the trajectory.

Hereinafter, a code pattern according to embodiments of the present invention capable of encoding position information and the like will be described first, and position information or the like encoded in a code pattern using the image of the code pattern is described as an electronic pen 2000 ) Will be explained.

However, since the electronic pen 2000 according to the embodiment of the present invention uses a generally used pen core (deep portion 2010), only the pen 1000 for the medium 1000 according to some embodiments of the present invention Not possible, but writing on a general medium (e.g., paper on which no code pattern is provided) is also possible. However, in such a case, since the electronic pen 2000 can not acquire the position information for analyzing the handwriting trajectory of the user, the operation such as real-time reproduction and replay of the user's handwriting trajectory, which will be described later, 3000) or the like.

1. Code pattern

The code pattern according to an embodiment of the present invention is configured in such a manner that one unit cell is repeatedly arranged in a two-dimensional manner to a desired size.

6 and 7 are views showing unit cells constituting a code pattern according to an embodiment of the present invention.

Referring to FIGS. 6 and 7, each unit cell includes line segment codes, and line segment codes can be classified into a reference code and an information code.

The reference code is composed of a horizontal reference code, a vertical reference code, and an intersecting reference code.

The reference code has a function of confirming the area of the unit cell when decoding the code pattern.

The information code performs a function for indicating information to be encoded in a unit cell in a manner to be described later.

The remaining reference codes except for the cross reference code, and the information codes all have the same geometric shape. That is, the reference codes and the information codes except for the cross reference code have a rotationally symmetrical shape and are in a 'line segment form'.

The cross reference code, unlike the other reference codes and the information code, has a cross-shaped geometric form.

On the other hand, in the unit cell, virtual lines can be defined. The virtual lines are composed of a plurality of horizontal horizontal vertical lines and vertical vertical horizontal vertical lines. In the description of some embodiments of the present invention, a component referred to as a "virtual line" may be one that is actually printed on the medium 1000, but not printed.

Each of the plurality of horizontal gantry lines is parallel to each other and spaced apart from each other by a predetermined distance.

In addition, each of the plurality of vertical imaginary lines is parallel to each other and spaced apart from each other by a predetermined distance.

And one of the plurality of horizontal imaginary lines is orthogonal to the vertical imaginary line of any one of the plurality of vertical imaginary lines.

A plurality of intersection points are formed such that a plurality of horizontal imaginary lines and a plurality of vertical imaginary lines meet with each other to form a plurality of intersection points. In the description of some embodiments of the present invention, a component referred to as a 'virtual point' may be one that is actually printed on the medium 1000, but not printed.

Referring to FIG. 6, one unit cell is shown to have a total of 7 horizontal and vertical vertical phantom lines, of which horizontal horizontal reference codes are arranged And the vertical reference codes are arranged in the vertical left-hand vertical line.

The reference codes are placed on virtual reference points. In particular, the reference codes are arranged such that their center of mass is at the virtual reference point. That is, the horizontal reference codes and the vertical reference codes are arranged so that virtual reference points can be located at the center of both ends of each reference codes. Also, a cross reference code having a geometric shape in the shape of a cross is arranged such that the center of the cross is at a virtual reference point.

Information codes are also placed on virtual reference points. In particular, the information codes are arranged such that, unlike the reference codes, the center of mass is not placed at the virtual reference point. That is, the virtual reference point is not located at the center of both ends of the information codes. In the case of the information code, one end of both ends is placed near the virtual reference point and the other end is determined according to the value to be encoded in the information code , Which is different from the virtual reference point. This will be described in detail in the manner of encoding information in the information codes.

The code patterns having the above-described shapes and components are formed in the medium 1000, and the code patterns actually formed in the medium 1000 can be implemented in a print or the like manner. At this time, when the code pattern is printed on the medium 1000, only the reference code and the information code described above can be printed, as shown in Fig. That is, among the components constituting the above-described code pattern, the horizontal virtual lines, the vertical virtual lines and the virtual reference points may not actually be printed.

2. Encoding / decoding of information

The basic principle of encoding information in an information code is to place one end of the information code near the virtual reference point and to place the other end of the information code so that the information code passes the virtual reference point, And the desired information is encoded in the corresponding information code using the relationship with the end.

That is, the direction of the information code (hereinafter referred to as the direction of the information code) from one end of the information code (the end closer to the virtual reference point) to the other end (the end farther than the virtual reference point) ), The desired information is encoded in the corresponding information code.

Details on how to encode information in the information code are described in more detail. However, for convenience of explanation, the case where the information that can be encoded into one information code is 2 bits will be described as an example.

8 is a diagram for explaining a method of encoding 2-bit information into an information code according to embodiments of the present invention.

For the sake of clarity, assume a virtual reference point at which to place the information code to encode information as an origin, and an orthogonal coordinate system defined in the direction of horizontal reference codes and vertical reference codes provided in the unit cell.

At this time, when the information to be encoded through the information code is '00', one end of the information code (end closer to the virtual reference point) is located in the third quadrant of the orthogonal coordinate system and the other end An end located farther from the virtual reference point) can determine the direction of the information code so that it can be located in the first quadrant of the rectangular coordinate system (see FIG. 8A).

If the information to be encoded through the information code is '01', one end of the information code (end closer to the virtual reference point) is located in the fourth quadrant of the orthogonal coordinate system and the other end Can determine the direction of the information code so that it can be located in the second quadrant of the orthogonal coordinate system (see FIG. 8 (b)).

If the information to be encoded through the information code is '10', one end of the information code (the end closer to the virtual reference point) is located in the first quadrant of the orthogonal coordinate system and the other end The end located farther away from the virtual reference point) can determine the direction of the information code so that it can be located in the third quadrant of the rectangular coordinate system (see (c) of FIG. 8).

In addition, when the information to be encoded through the information code is '11', one end of the information code (the end closer to the virtual reference point) is located in the second quadrant of the orthogonal coordinate system and the other end The end located farther away from the virtual reference point) can determine the direction of the information code so that it can be located in quadrant 4 of the Cartesian coordinate system (see FIG. 8 (d)).

As shown in FIG. 8, an information code is designed so as to encode 2-bit information in the information code, and 36 information codes are included in one unit cell, as shown in FIGS. 6 and 7 , The information that can be encoded in one unit cell may be 2 bits * 36 = 72 bits.

However, the manner of encoding information in an information code according to embodiments of the present invention may be based on the fact that the other end of the information code (e.g., the end of the information code) For example, a direction farther from the virtual reference point), the number of bits of information that can be encoded in the information code is not limited to 2 bits but may be 3 bits or more. For example, if the direction of the information code is to be interpreted in units of 45 degrees in order to encode the information into the information code, the information code has a total of 8 distinct directions, so that a total of 3 bits of information Encoded.

3. Configuration of unit cell information

Next, the information encoded in the unit cell will be described.

The unit cell information encoded in the unit cell may include error verification information, medium identification information, coordinate information, and other additional information.

The error verification information is information for determining whether or not an error has occurred in the encoding of the unit cell.

The medium identification information is identification information for the medium 1000 in which the unit cell is provided. The medium identification information may include book information, page information, and the like.

The book information means identification information given to a corresponding note or book when a plurality of mediums 1000 are manufactured in the form of a note or a book.

When the plurality of mediums 1000 are manufactured in the form of a note or a book, the page information is used to identify the number of pages of the medium 1000 in which the unit cell is provided, Information.

In addition, if the medium 1000 is implemented to have a particular format for a particular application (e.g., a sheet containing a security check checklist, a test paper, etc.) And may include information for identifying which format it has.

The coordinate information indicates two-dimensional coordinate information indicating a unit cell located at a position on the medium 1000 in which the unit cell is provided. Accordingly, the coordinate information may include an x-coordinate and a y-coordinate.

Other additional information may include various other necessary information. For example, license information on coordinate codes and the like provided to the medium 1000 may be included in the additional additional information.

As described above, the electronic pen 2000 analyzes at least one unit cell included in the image obtained through the pattern sensing unit 2300 and decodes information encoded in the unit cell, It is possible to acquire cell identification information, coordinate information, and other additional information included in the unit cell information.

4. Creating pen data

Next, a method of generating pen data by the electronic pen 2000 based on the unit cell information will be briefly described.

Pen data means information used to generate stroke data necessary for reproducing the user's handwriting trajectory in real time or replaying at a later time, in addition to the unit cell information obtained by the electronic pen 2000.

The pen data may include time information, pressure information, position information, and medium identification information.

The time information is information on a time at which an image used to generate one unit pen data is acquired or a time at which one unit pen data is generated.

The pressure information is pressure information outputted from the pressure sensor 2520 at the time when an image used to generate one unit pen data is acquired or at the time when one unit pen data is generated.

Since the medium identification information is the same as or similar to the information contained in the unit cell information, detailed description is omitted.

The positional information is information on the position of the electronic pen 2000 with respect to the medium 1000 generated by performing a correction operation required for the coordinate information obtained from the unit cell information. The position information may or may not coincide with the coordinate information obtained from the unit cell information, and a method of generating position information will be described in detail below.

9 is a diagram for explaining a method of generating position information of the electronic pen with respect to the medium according to the embodiments of the present invention.

9, an image I obtained by the camera module 2320 of the electronic pen 2000 is illustrated by way of example. As shown in FIG. 9, at least one The unit cell UC may be included and the position CC of the unit cell UC may be obtained in a coordinate form by interpreting the information encoded in the unit cell by the method described above. At this time, as shown, since the unit cell UC used for interpreting the coordinate information may not be located at the center of the obtained image I, the unit cell UC obtained by interpreting the unit cell UC The coordinate information may be slightly different from the exact position of the electronic pen 2000 for the medium 1000. That is, it can be assumed that the center (IC) of the acquired image I is closest to the position of the electronic pen 2000 with respect to the medium 1000, and the center (IC) (X, y) obtained by the coordinate information obtained from the coordinate system (UC).

Accordingly, the electronic pen 2000 can acquire the coordinates (x ', y') of the center (IC) of the obtained image I from the coordinate information obtained from the unit cell UC and the acquired image (? X,? Y) calculated on the coordinate information (x, y) obtained from the unit cell (UC) by adding or subtracting the offset value (X ', y') of the center (IC) of the image I obtained.

The position of the electronic pen 2000 relative to the medium 1000 can be more accurately calculated in the above-described manner, and the coordinate value (x ', y') corrected in the above- to be.

As described above, the electronic pen 2000 can continuously generate pen data, and accordingly, the positional movement of the electronic pen 2000 with respect to the medium 1000 according to the handwriting of the user can be realized in real time And the pen data can be appropriately processed by the electronic device 3000 or the server 4000 as needed, as needed.

&Lt; Operation of electronic device &

As described above, when the pen data is generated, the electronic pen 2000 can store the pen data in the memory 2600 or transmit the pen data to the electronic device 3000 through the communication unit 2400. [

For example, when the electronic pen 2000 can communicate with the electronic device 3000, the electronic pen 2000 can generate pen data and transmit the pen data to the electronic device 3000 in real time, When the electronic pen 2000 is not in a state in which it can communicate with the electronic device 3000, the electronic pen 2000 generates and stores the pen data in the memory 2600, It is possible to transmit the stored pen data to the electronic device 3000.

Hereinafter, the operation of the electronic device 3000 that has received the pen data will be described.

1. Real-time recreation of the contents written by the user # 1

The electronic device 3000 can reproduce the contents written by the user in the medium 1000 in real time on the display of the electronic device 3000 based on the pen data received from the electronic pen 2000. [ Hereinafter, a description will be given of a method in which a user plays back what is being written in real time and displays it on the display.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 are communicably connected to each other, and the electronic pen 2000 transmits the pen data generated as described above to the electronic device 3000).

The electronic device 3000 can acquire information on the target medium 1000 that the user is writing based on the medium identification information included in the pen data received from the electronic pen 2000. [

For example, the electronic device 3000 may be configured to determine whether the target medium 1000 being handwritten by the user is a medium having a particular format for a particular use, a medium that is part of a product provided in a book or note format And the like.

In addition, if the target medium 1000 is a medium constituting a part of a product provided in the form of a book or a note, it is possible to confirm whether the target medium 1000 is a medium located on a few pages of the book or the note have.

The electronic device 3000 displays the handwritten content or the like already written by the user on the template or the target medium 1000 previously stored in the target medium 1000 based on the acquired medium identification information .

In this case, the template for the target medium 1000 stored in advance means that the target medium 1000 includes text, image, shape, symbol, etc. already printed in addition to the code pattern. For example, When the target medium 1000 is a part of the note, a plurality of lines may be printed on the target medium 1000 for easy writing by the user. Information such as the fact that the plurality of lines are printed And may be included in the template information for the target medium 1000 that has been stored in advance. In another example, if the target medium 1000 is part of a diary-like note, the target medium 1000 may have a particular date printed, such as February 1, 2015, It may be included in the predetermined template information that special information is printed on the template information. Hereinafter, the image displayed on the target medium 1000 including the template information described above may be referred to as a medium image.

Subsequently, the electronic device 3000 can generate stroke data corresponding to the locus written by the user to be displayed on the display, based on the positional information and the time information included in the received pen data. In order to generate the stroke data, at least one or more unit pen data may be used.

When the stroke data is generated, the electronic device 3000 can reproduce the locus written by the user with respect to the target medium 1000 at the corresponding position on the predetermined template displayed on the display, in accordance with the generated stroke data . FIG. 10 shows that the contents written by the user on the target medium 1000b are reproduced on the display of the electronic device 3000 in real time.

When the handwritten content of the user is reproduced through the electronic device 3000, the locus of the content written by the user, the position of the content written by the user with respect to the target medium 1000, , It can be accurately reproduced.

Hereinafter, for convenience of explanation, it can be said that the operation of the electronic device 3000 operates in a 'normal reproduction mode' according to an embodiment in which a user's handwriting contents are reproduced in real time.

2. Real-time reproduction of the contents written by the user # 2

Next, a description will be given of another embodiment in which the user reproduces the contents written in the target medium 1000 in real time.

FIGS. 11 to 15 are views for explaining another embodiment for reproducing the handwriting contents of the user according to the present invention in real time.

While the user is using the electronic device 3000 according to an embodiment of the present invention, the user can recognize that the whole surface of the target medium 1000 currently being handwritten by the user is all the electronic device 3000 , But in some cases it may be desirable to display only a part of the surface of the target medium 1000 through the electronic device 3000. [

Hereinafter, among the medium images corresponding to the target medium 1000, at least some areas displayed through the electronic device 3000 are referred to as display areas. In addition, 'some area (or display area) of the target medium is displayed' may mean that the area corresponding to a part of the target medium among the entire area of the medium image is displayed on the display area as a display area.

FIG. 11 exemplarily shows that only a part of the target medium 1000 is displayed through the electronic device 3000.

At this time, if the user makes a handwriting in another area out of the partial area displayed through the electronic device 3000, the contents written by the user in real time The reproduced data may not be displayed through the display. For example, as shown in FIG. 12, when the user further writes 'EFG' to the right side of 'ABCD', a partial area set as shown in FIG. 11 is continuously transmitted through the electronic device 3000 The user can not see through the electronic device 3000 the contents corresponding to the 'E' which the user further handwrites.

Another embodiment for reproducing the handwriting contents of the user according to the present invention in real time is proposed in order to solve the problem.

The electronic device 3000 can confirm the position (hereinafter referred to as the handwriting position) in the target medium 1000 of the contents currently being handwritten by the user based on the received pen data.

Then, the electronic device 3000 can determine whether or not the identified handwriting position satisfies a predetermined condition for the current display area.

For example, the electronic device 3000 can determine whether or not the handwriting position corresponds to a position out of the display area. At this time, when the electronic device 3000 determines that the handwriting position is located outside the display area, it can determine that the predetermined condition is satisfied.

In another example, the electronic device 3000 can determine whether the identified handwriting position corresponds to an edge area of the current display area. That is, the electronic device 3000 can determine whether or not the handwriting position is included in the current display area and corresponds to the edge area of the display area. At this time, when the electronic device 3000 determines that the handwriting position corresponds to the edge area of the display area, it can determine that the predetermined condition is satisfied.

If the electronic device 3000 determines that the handwriting position is not satisfied with the predetermined condition (for example, when it is determined that the handwriting position is included in the display area), the electronic device 3000 displays, E 'corresponding to the contents written by the user can be reproduced through the electronic device 3000 and displayed on the display without shifting the display area as shown in FIG.

On the other hand, when the electronic device 3000 determines that the handwriting position satisfies a predetermined condition (for example, when it is determined that the handwriting position is out of the display area), the electronic device 3000 responds to the handwriting position The position of the display area can be shifted so that the position of the display area can be displayed on the display of the electronic device 3000. [

For example, if the user further describes 'F' in the state of 'ABCDE' as shown in FIG. 12, the electronic device 3000 shifts the display area as shown in FIG. 13, The content corresponding to the handwriting of the user can be reproduced in the shifted display area.

Various methods can be applied to the manner in which the electronic device 3000 shifts the position of the display area.

For example, the electronic device 3000 can determine the direction to shift the position of the display area in consideration of the handwriting direction of the contents described by the user.

13 shows that the position of the display area is shifted in the same direction as the handwriting direction of 'ABCDE', which is the contents of the handwriting by the user.

In another example, the electronic device 3000 can shift the position of the display area so that the content of handwriting written outside the original display area is displayed at the center of the shifted display area.

14 shows that the display area is shifted so that the 'F' described outside the original display area can be located at the center of the shifted display area.

In another example, the electronic device 3000 can shift the position of the display area in consideration of the distance between the contents immediately before and the contents of the handwriting written off the original display area.

As another example, the electronic device 3000 may consider the edge of the media image when shifting the position of the display area. For example, the position of the display area can be shifted so that the edge of the media image does not deviate from a predetermined area of the display screen. That is, the position of the display area can be shifted so that the edge of the media image does not deviate from the edge area of the display screen. In other words, the position of the display area can be shifted so that the edge of the preview image is not displayed at a predetermined distance or more from the edge area of the display screen.

On the other hand, the electronic device 3000 considers the pen data received from the electronic pen 2000 in order to determine whether or not the handwriting position satisfies a predetermined condition. When the electronic device 3000 confirms the handwriting position Various methods can be applied to the method of sampling the pen data.

For example, the electronic device 3000 determines whether or not the handwriting position satisfies a predetermined condition for the partial area with respect to all the unit pen data (for example, whether or not the handwriting position is out of the display area) can do. In this case, the electronic device 3000 can reproduce the handwriting of the user through the electronic device 3000 in the nearest real-time reproduction, but there is a problem that the calculation amount becomes large.

For example, the electronic device 3000 can determine whether or not the handwriting position satisfies a predetermined condition for the display area with respect to pen data of at least a part of the pen data that can be bundled in units of strokes.

The stroke refers to a line drawn on the writing surface by the pen until the pen comes off the writing surface after the pen contacts the writing surface, and may be referred to as a stroke. That is, 'A' is generally composed of three strokes, 'B' is generally composed of two strokes, 'C' is generally one stroke, and 'D' is generally two strokes , And 'E' generally consists of three strokes. Hereinafter, for convenience of explanation, it is assumed that a user touches the electronic pen 2000 to the target medium 1000 in order to write one stroke is referred to as 'pen down', and one stroke is written Hereinafter, the operation of releasing the electronic pen 2000 from the target medium 1000 will be referred to as &quot; pen up. &Quot;

At this time, the electronic pen 2000 generates the pen data by including the pen pressure in the pen data through the pressure sensor, and the generated pen data is transmitted to the electronic device 3000, Pen-down "or" pen-up "using the pressure value included in the data. That is, when the pressure value is suddenly increased from '0' to a specific value during reception of the pen data, the electronic device 3000 can determine that 'pen down' has occurred at the point when the pressure value suddenly increases. For convenience, this point is defined as the 'pen-down point'. In addition, when the pressure value suddenly becomes '0' during reception of the pen data, the electronic device 3000 may determine that 'pen-up' has occurred at the time when the pressure value suddenly becomes '0'. For convenience, this point is defined as the 'pen-up point'.

The electronic device 3000 can determine whether or not the handwriting position satisfies a predetermined condition for the display area by using the position information included in the pen data corresponding to the pen-down time among the pen data grouped in units of strokes (Hereinafter referred to as a pen-down-based shift method). In this case, the electronic device 3000 uses only the handwriting position at the pen-down time point, and the position information included in the rest of the pen data among the plurality of pen data groups grouped in units of strokes is written in advance It may not be used in judging whether or not the predetermined condition is satisfied.

On the other hand, the electronic device 3000 determines whether or not the handwriting position satisfies a predetermined condition for the display area, using the position information included in the pen data corresponding to the pen-up time, among the pen data bundled in units of strokes (Hereinafter referred to as a pen-up based shift method). In this case, the electronic device 3000 uses only the handwriting position at the pen-up time point, and the position information included in the rest of the pen data among the plurality of pen data groups grouped in units of strokes is written in advance It may not be used in judging whether or not the predetermined condition is satisfied.

Alternatively, the electronic device 3000 may use all of the position information included in the pen data corresponding to the pen-up time and the pen-down time among the pen data grouped in units of strokes, It is possible to determine whether or not the condition is satisfied (hereinafter referred to as a hybrid shift method). In this case, the electronic device 3000 may use only the handwriting position of the pen-down time point and the pen-up time point, and may not use the remaining pen data.

In the case of the pen-down based shift method, since only the shift of the display area occurs only at the pen-down time, the start point of the stroke input by the user is included in the original display area, The shift according to the present invention may not occur. 15, since the time point SP of the stroke S is included in the original display area even after the user completes the stroke S, the end point of the stroke S (i.e., The screen as shown in FIG. 15 (b) may be displayed through the display of the electronic device 3000 even at the pen-up time (Tup), even if the EP is out of the original display area.

If the pen-up based shift method is used, only the shift of the display area occurs at the pen-up time only. Therefore, when the user inputs one stroke for a long time (for example, The electronic device 3000 may not perform the shift operation until the stroke input of the user is completed.

If a hybrid shift method is used, both the pen-down based shift method and the pen-down based shift method can be taken.

On the other hand, in a method of determining a handwriting position using a part of a plurality of pen data that can be bundled in units of strokes, and performing a shift operation according to the penwriting data, pen data at a pen- There are various methods other than the method of using the pen data of the time point, the pen down and the pen data of the pen-up time point, and for example, there is a method of judging the handwriting position using the pen data selected according to the predetermined time interval And the like. That is, the pen data at the pen-down time point, the pen data at the time of 0.05 seconds from the pen-down time, the pen data at the time of 0.10 seconds at the pen-down time, (For example, when the predetermined time interval is 0.05 second).

The electronic device 3000 can determine whether or not at least one shift operation is performed for one stroke. That is, the electronic apparatus 3000 can determine whether or not the predetermined condition is satisfied by using at least one pen data among a plurality of pen data included in the stroke, for each of the strokes. In other words, the electronic device 3000 is configured to store the pen data (first pen data) corresponding to the pen-down point constituting one stroke, the pen data (second pen data) corresponding to the pen- It is possible to determine whether the predetermined condition is satisfied by using at least one pen data among all the pen data between the first pen data and the second pen data.

As described above, according to another embodiment of the present invention, in which the user reproduces the contents written in the target medium 1000 in real time, the screen of the electronic device 3000 is enlarged and only the display area of the target medium 1000 An effect that the contents written by the user can be reproduced in real time and displayed through the display of the electronic device 3000 even when displayed through the display.

Hereinafter, for convenience of explanation, it is assumed that the electronic device 3000 operates in an 'enlarged reproduction mode' according to another embodiment for reproducing the handwriting contents of the user according to the present invention in real time.

3. Real-time recreation of content written by the user # 3

Hereinafter, for convenience of explanation, a mode in which only a part of the target medium 1000 is displayed through the electronic device 3000 may be referred to as an 'enlargement mode', and the entire area of the target medium 1000 The mode displayed through the electronic device 3000 may be referred to as 'normal mode'.

The electronic device 3000 may operate in the 'normal reproduction mode' or the 'enlarged reproduction mode' in order to reproduce the handwriting contents of the user according to the present invention in real time.

For example, the electronic device 3000 determines whether the display mode of the electronic device 3000 is 'normal mode' or 'enlarged mode', and reproduces the handwriting contents of the user in real time according to the determination result It is possible to operate by selecting a mode to be used. That is, when the display mode of the electronic device 3000 is 'normal mode', the electronic device 3000 reproduces the handwriting contents of the user in real time according to the 'general reproduction mode' The user can reproduce the handwriting contents in real time according to the 'enlargement reproduction mode' described above.

As described above, when the reproduction mode is selectively set and operated, the 'enlarged reproduction mode' in which the calculation amount is relatively increased is applied only when the screen is enlarged and displayed. If the screen is not enlarged and displayed, The user can operate in a 'general reproduction mode' having a smaller amount of computation, thereby enabling to reproduce user's handwriting contents more effectively and efficiently in real time.

4. Replay of handwritten content # 1

The electronic device 3000 can replay contents written by the user in the medium 1000 on the display of the electronic device 3000 at a later time based on the pen data received from the electronic pen 2000. [ Hereinafter, a method of replaying and displaying the contents written by the user in real time on the display will be described.

For the following description, it is assumed that the electronic pen 2000 and the electronic device 3000 receive and store the pen data related to the matters written on the target medium 1000 by using the electronic pen 2000 do.

The electronic device 3000 can detect whether or not a predetermined event for replaying the handwriting contents of the user has occurred.

For example, the predetermined event may be a request of the user. That is, the electronic device 3000 can provide a user interface (UI) through which the user can request a replay of the handwritten content through the electronic device 3000, The electronic device 3000 may determine that a predetermined event has occurred and perform the replay operation of the handwritten content according to the present invention.

For example, the predetermined event may be an operating system (OS) of the electronic device 3000 or another application installed in the electronic device 3000.

As another example, the predetermined event may be one that meets a predetermined condition. That is, when a predetermined condition of 'arrival at a specific time' is set, the electronic device 3000 monitors the current time and determines whether it has reached the 'specific time' of the predetermined condition, , It is determined that a predetermined event has occurred and the replay operation for the handwriting of the user according to the present invention can be performed. The predetermined condition is not limited to the condition for 'time' as in the above-described example, but may be set in various forms.

The electronic device 3000 can determine the target content for performing the replay operation on the handwriting content when the predetermined event occurs.

For example, in the electronic device 3000, the pen data for the contents written by the user using the electronic pen 2000 may be stored in the medium 1000. Among the handwritten contents, It is possible to determine the target handwriting content to be executed. That is, if the target medium 1000 is provided in the form of a note, the electronic device 3000 stores all the contents written by the user on a plurality of pages of the note in the form of a pen data (or stroke data) The electronic device 3000 may determine whether to perform a replay operation of a plurality of pages (one page or a plurality of pages), or may determine whether to perform a replay operation for a certain page It is possible to decide whether to perform the replay operation with respect to the written contents in the area.

The electronic device 3000 may consider the predetermined event in determining the contents to be replayed.

For example, if the predetermined event is a user's request, the content of the replay object can be determined according to a request of the user. For example, if the predetermined event is a request from the operating system or another application, the content of the replay object may be determined in consideration of the request.

If the contents of the replay object are determined, the replay object section can be determined. For example, when the electronic device 3000 determines that a specific page of the note is a replay object section, the plurality of strokes described in the determined specific page are determined as a replay object, and the replay object section includes the plurality of Is defined by the temporal relationship between replay target strokes and replay target strokes. Hereinafter, the replay object section will be described in more detail.

16 is a diagram for explaining a replay object section according to the present invention. Referring to FIG. 16, a replay section (RS) according to the present invention includes a stroke section (SS) and a gap section (GS). Particularly, FIG. 16 shows that the replay object section RS includes the first through fourth stroke sections SS1, SS2, SS3, and SS4 and the first through third intervening sections GS1, GS2, and GS3 .

In the present invention, for convenience of explanation, the replay object section is defined as the time spent by the user to write the replay object.

That is, the replay section is defined as a replay object section from the time when the user starts writing the first stroke of the target handwriting to which the replay is requested to the point when the user finishes writing the last stroke of the handwritten content do. For example, when the replay object section is determined as shown in FIG. 16, the length of the replay object section RS is (t8-t1).

The stroke interval is defined as the time required when a user inputs a stroke when writing. That is, as described above, a stroke interval is defined as a time from the time when the pen is down to the target medium 1000 to the time when the target medium 1000 is pushed up to input one stroke. 16, the length of the first stroke section SS1 is (t2-t1), the length of the second stroke section SS2 is (t4-t3), the length of the third stroke section The length of the fourth stroke segment SS3 is (t6-t5), and the length of the fourth stroke segment SS4 is (t8-t7).

The interval GS is defined as the time from when a user writes one stroke to when another stroke following immediately after the inputted stroke is inputted. That is, the time from the pen-up point of the stroke in which the input is completed to the pen-down point of the next stroke to be inputted is defined as the interval GS. 16, the length of the first interval GS1 is (t3, t2), the length of the second interval GS2 is (t5-64), the interval of the third interval GS3) is (t7-t6).

(GS) is defined by the relationship of two strokes. In this case, the two strokes for defining the interval are defined by the relationship of the strokes included in the replay object content determined as the replay object Strokes not included in the replay object content are not considered. For example, one stroke (stroke A) is written in the first area (e.g., the x page of A note), and in fact the next stroke (stroke B) is written in the second area (Stroke C) is rewritten in the first area, if only the x page is selected as the content to be replayed and the y page is not selected, the stroke B is included in the content to be replayed , It is not considered in defining the aforementioned interval GS. That is, in such a case, not only the stroke interval defined by the stroke B does not exist in the replay object section but also the interval between the stroke A and the stroke B and the interval between the stroke B and the stroke C are not defined, Only the interval between stroke A and stroke C can be defined.

Then, the electronic device 3000 can acquire pen data for the strokes included in the replay object contents from the memory module 3400, and generate replay data based on the obtained pen data. The replay data may be data generated in order to perform a replay operation replaying contents written by a user according to the present invention, and may be data generated by sampling pen data for strokes. Further, the replay data can be interpreted in a very comprehensive sense including a position of a stroke to be displayed on a display, a display order between the strokes, timing information for displaying the strokes, and the like in performing the replay operation.

The electronic device 3000 then performs the replay operation according to the present invention based on the replay data.

Hereinafter, the replay operation will be described in more detail.

In the replay operation of the user's handwriting content according to the embodiment of the present invention, the replaying time of the replay differs from the time spent by the user to write the content of the replay object.

For example, a specific page may be selected as the replay object, a part of the contents included in the specific page selected as the replay object can be created at 10:00 am, and another part of the contents included in the specific page In this case, the time taken for the user to write the contents of the replay object is 10 hours. However, according to the embodiment of the present invention, when the handwritten content is replayed, Time can be water. That is, the replaying time of the replay object section may be shorter than the time required for writing the replay object section (the length of the replay object section).

As another example, a certain word can be selected as the content to be replayed, and the time taken by the user to actually record a specific word selected as the content to be replayed is 2 seconds, but the replay time for the word is It can be more than 2 seconds. That is, the replaying time of the replay object section may be longer than the time required for the writing of the replay object section (the length of the replay object section).

(1) Determination of the replay play time of the stroke section

The electronic device 3000 can determine the replay playback time of the strokes included in the replay object content.

&Lt; Relation between length of stroke section and replay play time >

According to some embodiments of the present invention, the electronic device 3000 may determine the replay play time for each of the strokes, taking into account the time it took for the replay target strokes to be actually written.

FIG. 17 is a view showing replay reproduction time determined according to an embodiment of the present invention, with respect to a replay object period RS as shown in FIG. 16; FIG.

17, the lengths of the first through fourth stroke replay times SR1, SR2, SR3, and SR4 for the first through fourth stroke intervals SS1, SS2, SS3, 1 to the fourth stroke intervals SS1, SS2, SS3, and SS4. As described above, the electronic device 3000 can determine the replay play time for the replay target strokes in consideration of the time taken for the replay target strokes to actually be written.

17 shows an example in which the replay reproduction time is determined so that the replay reproduction time for each stroke is proportional to the length of each stroke section. However, the replay reproduction time is not necessarily determined proportionally, The time may be determined. For example, depending on the manner in which the time taken for actual writing of the respective strokes is divided into corresponding sections and corresponded to different replay reproduction times in different sections, the replay reproduction time for each of the strokes is May be determined. That is, for two strokes, even if the length of the actual stroke section is slightly different, in the case where the two strokes are classified into the same section, the replay reproduction time for the two strokes can be determined equally. 17, only the length of the stroke section is considered in determining the replay reproduction time for each of the strokes. However, in determining the replay reproduction time, not only the length of the stroke section is considered, The length of the replay play time may be further determined. A method of considering the stroke length when determining the replay play time will be described later.

On the other hand, the electronic device 3000 can determine the replay reproduction time to be the same for the replay target strokes.

For example, the electronic device 3000 can determine the replay play time for each of the strokes without considering the time taken for the replay target strokes to be actually written.

At this time, the electronic device 3000 can determine a predetermined replay play time as the replay play time for each of the replay target strokes, regardless of the time required for actual rewriting of the replay target strokes. That is, the replay play times determined for all the strokes included in the replay object contents may be the same.

FIGS. 18 and 19 are views showing replay reproduction time determined according to another embodiment of the present invention, with respect to the replay object period RS as shown in FIG.

18, when the lengths of the first through fourth stroke replay times SR1, SR2, SR3, and SR4 for the first through fourth stroke intervals SS1, SS2, SS3, and SS4 are all the same As shown in Fig. As described above, the electronic device 3000 can determine the replay play time for the replay target strokes without considering the time taken for the replay target strokes to actually be written.

However, in FIG. 18, in determining the replay play time for each of the strokes, the replay play time is determined to be the same regardless of the length of the stroke section. However, at this time, The replay reproduction time may be determined, and when the replay reproduction time is determined in consideration of the length of the stroke, the replay reproduction time for each stroke may be different from each other. A method of considering the stroke length when determining the replay play time will be described later.

Meanwhile, although the replay reproduction time determined in the same manner is shown as 'time duration' in FIG. 18, the determined replay reproduction time may be determined as one time point.

19, when reloading the strokes of the first through fourth stroke intervals SS1, SS2, SS3, and SS4, the electronic device 3000 can display the first The stroke corresponding to the stroke section SS1 is displayed at once, the stroke corresponding to the second stroke section SS2 is displayed at the same time at the second time, and the stroke corresponding to the third stroke section SS3 is displayed at the third time It is possible to simultaneously display strokes corresponding to the fourth stroke section SS4 at the fourth time point. Here, the meaning of displaying the strokes at once means that all the points constituting the stroke are all displayed on the display at the same time.

That is, Fig. 18 relates to the embodiment in which the points constituting each stroke are sequentially displayed on the display as the determined replay progresses, and Fig. 19 shows that the points constituting the stroke are displayed on the display all at once Gt; embodiment. &Lt; / RTI &gt;

The relationship between the length of the stroke section and the replay reproduction time determined thereby has been described above. Hereinafter, the relationship between the length of the stroke (actually the physical length of the stroke written by the user) and the replay reproduction time determined thereby will be described.

<Relationship between stroke length and replay play time>

According to some other embodiments of the present invention, the electronic device 3000 may determine the replay play time for each of the strokes, taking into consideration the length of the replay target strokes.

Figures 20-24 are illustrations of some other embodiments for determining a replay play time to replay a stroke handwritten by a user in accordance with some other embodiments of the present invention.

Referring to FIG. 20, the first through fourth strokes S1, S2, S3, and S4 are written in the target medium 1000.

For convenience of explanation, the first stroke S1 is written by the user during the first stroke interval SS1 shown in Fig. 16, and the second stroke S2 is the second stroke interval &lt; RTI ID = 0.0 &gt; The third stroke S3 is written by the user during the third stroke period SS3 shown in Fig. 16, and the fourth stroke S4 is written by the user during the second stroke SS2, It is assumed that it has been handwritten by the user during the fourth stroke period SS4.

For convenience of explanation, the lengths of the first to fourth strokes S1, S2, S3 and S4 are SL1, SL2, SL3 and SL4, and SL4> SL1 &Gt; SL3 > SL2.

Here, the stroke length may be understood to mean the physical length of the stroke actually taken by the user in the target medium 1000. However, at this time, the length may be understood as an absolute length, but it may be understood as a relative length between the strokes.

At this time, the electronic device 3000 can determine the replay play time for each of the strokes in consideration of the lengths of the strokes included in the replay object contents.

FIG. 21 shows the replay play time determined according to some practical examples of the present invention for the strokes S1, S2, S3, S4 included in the replay object contents as shown in FIG.

21, the lengths of the first through fourth stroked replay times SR1, SR2, SR3, and SR4 for the first through fourth strokes S1, S2, S3, and S4, respectively, To the lengths of the first to fourth strokes S1, S2, S3, and S4. As described above, the electronic device 3000 can determine the replay play time for the replay target strokes in consideration of the time taken for the replay target strokes to actually be written.

21 shows an example in which the replay reproduction time is determined so that the replay reproduction time for each stroke is proportional to the length of each stroke. However, the replay reproduction time is not necessarily determined proportionally, May be determined. For example, the replay play time for each of the strokes may be determined according to the manner in which the written lengths of the respective strokes are divided and corresponded to each other, and different replay play times are corresponded to different intervals. That is, for two strokes, even if the written length of the actual stroke is slightly different, when two strokes are classified into the same section, the replay reproduction time for the two strokes can be determined equally. 21, only the written length of the stroke is considered in determining the replay reproduction time for each of the strokes. However, in determining the replay reproduction time, not only the written length of the stroke is considered , The replay reproduction time may be determined in consideration of the length of the stroke section (the time required for actually taking the stroke) as described above.

Alternatively, the electronic device 3000 can determine the replay play time equal to each other, regardless of the written length of the strokes, for the replay target strokes. That is, the electronic device 3000 can determine the replay play time for each of the strokes without considering the written length of the replay target strokes at all.

22 and 23 are views showing replay play time determined according to some embodiments of the present invention, with respect to replay target strokes as shown in Fig.

22, when the lengths of the first through fourth stroke replay times SR1, SR2, SR3, and SR4 for the first through fourth strokes S1, S2, S3, and S4 are all the same The determination is shown. In this manner, the electronic device 3000 can determine the replay play time for the replay target strokes without considering the written length of the replay target strokes at all.

Meanwhile, although the replay reproduction time determined in the same manner is shown as 'time duration' in FIG. 22, the determined replay reproduction time may be determined as one time point.

23, when electronic devices 3000 replay the strokes of the first through fourth strokes S1, S2, S3, and S4, the electronic device 3000 is moved to the first stroke The replay for the second stroke S1 is displayed all at once, the replay for the second stroke S2 is displayed at the second time, the replay for the third stroke S3 is displayed at the third time, The replay for the fourth stroke S4 can be displayed at once.

(2), the replay play time is determined

The electronic device 3000 can determine the replay playback time of the interval between the strokes included in the content to be replayed.

According to some embodiments of the present invention, the electronic device 3000 determines the replay play time for each of the intervals between the stroke, taking into account the actual time interval between the stroke and the stroke, when the user actually writes the replay target strokes . According to some embodiments of the present invention, a method for determining the replay playback time for the inter-intervals may include a method for determining the replay playback time for the stroke interval, with or without considering the length of the above- And therefore only a brief description will be given.

This will be described with reference to Figs. 16 to 19 again.

Referring to FIG. 17, the lengths of the first to third interval playback replay times GR1, GR2, and GR3 for the first to third interval intervals GS1, GS2, 3 are determined in proportion to the lengths of the periods GS1, GS2, and GS3. As described above, the electronic apparatus 3000 can determine the replay object contents in consideration of the time difference between the strokes and strokes that occur while the replay reproduction time is actually written, in the interval between the strokes and the strokes.

However, the replay reproduction time determined for the interval does not necessarily have to be determined proportionally to the length of the interval, but may be determined separately for each interval.

Alternatively, as shown in Fig. 18, the electronic device 3000 can determine the replay reproduction time for each of the intervals between replay objects. For example, the electronic device 3000 can determine the replay play time for each of the strokes without considering the time taken for the replay target strokes to be actually written.

(3) Determination of replay reproduction speed and replay reproduction time based thereon

Meanwhile, according to some embodiments of the present invention, a replay playback speed for a user's handwriting can be determined, and the electronic device 3000 can determine, based on the determined replay speed, Lt; / RTI &gt;

The electronic device 3000 can determine the replay reproduction speed in consideration of the number of strokes included in the selected replay target section.

For example, at least the first predetermined condition and the second predetermined condition are stored in advance in the electronic device 3000, the number of strokes included in the selected replay object section is confirmed, and the number of confirmed strokes is stored in the first The first replay reproduction speed corresponding to the first predetermined condition can be determined as the replay reproduction speed for the selected replay object section, or the number of the confirmed strokes can be determined as the second predetermined replay speed, The second replay reproduction speed corresponding to the second predetermined condition can be determined as the replay reproduction speed with respect to the selected replay target section. The electronic device 3000 may store more predetermined conditions than the first predetermined condition and the second predetermined condition and each predetermined condition may correspond to a predetermined replay reproduction speed.

When the first predetermined condition is smaller than the second predetermined condition, the first replay reproducing speed corresponding to the first predetermined condition is slower than the second replay reproducing speed corresponding to the second predetermined condition . For example, when the first predetermined condition is 100 and the second predetermined condition is 200, the first predetermined replay reproduction speed may be slower than the second predetermined replay reproduction speed.

The electronic device 3000 can determine the replay reproduction time with respect to the stroke section and the replay reproduction time with respect to the interval in consideration of the determined replay reproduction speed.

When the first replay reproduction speed is higher than the second replay reproduction speed, the stroke section replay reproduction time determined when the determined replay reproduction speed is the first replay reproduction speed is determined when the determined replay reproduction speed is the second replay reproduction speed May be shorter than the stroke interval replay play time.

Similarly, when the first replay reproduction speed is faster than the second replay reproduction speed, the inter-segment replay reproduction time determined when the determined replay reproduction speed is the first replay reproduction speed is shorter than the second replay reproduction speed Lt; RTI ID = 0.0 &gt; replay &lt; / RTI &gt; playback time.

The process of determining the stroke section replay reproduction time based on the reproduction speed and the process of determining the inter-segment replay reproduction time based on the reproduction speed operate independently of each other. When the speed is further increased, the stroke section replay reproduction time It is possible to determine the shorter time interval and the shorter time interval replay time, but the shorter the interval time replay time and the shorter time interval replay time may be determined.

(4) Determination of the total play time of replay and replay operation

Subsequently, for each of the intervals between the strokes and the strokes included in the selected replay object contents, the electronic apparatus 3000 determines the length of the stroke interval, the length of the interval, the written length of the stroke And the reproduction speed of the content to be reproduced can be determined and the total reproduction time for the selected replay object content can be determined.

Subsequently, in accordance with the determined replay play time, the electronic device 3000 performs a replay operation on the selected replay object contents.

FIG. 24 is an exemplary view illustrating a screen in which contents written by a user are replayed through a display according to an embodiment of the present invention.

The electronic device 3000 can sequentially replay the strokes on the basis of the replay play time determined for the stroke interval and the interval determined according to the above description of the contents written by the user as shown in Fig.

As described with reference to FIG. 21 or FIG. 22, when the replay reproduction time for the stroke section and the replay reproduction time for the interval are determined as the 'time section,' the electronic device 3000 determines that the determined first stroke The points constituting the first stroke S1 during the reproduction time SR1 can be sequentially displayed. As a result, a screen as shown in FIG. 24 (a) can be displayed through the display of the electronic device 3000. FIG. Then, the electronic apparatus 3000 maintains the screen as shown in FIG. 24 (a) during the determined first inter-segment replay time GR1, and then the second stroke S2 during the determined second stroke playback time SR2, So that the screen as shown in FIG. 24 (b) can be displayed through the display of the electronic device 3000. FIG. In a similar manner, a replay operation for the third and fourth strokes can be performed.

23, when the replay reproduction time for the stroke section is determined to be the 'viewpoint', the electronic device 3000 displays the screen as shown in FIG. 24 (a) at the first point in time, 24A is displayed during the determined first inter-segment replay play time GR1, and at the second time point, as shown in FIG. 24B (b) After displaying the same screen through the display, the screen as shown in FIG. 24 (b) can be maintained during the determined second inter-segment play time GR2. In a similar manner, a replay operation for the third and fourth strokes can be performed.

The replay operation of the user's handwriting according to some embodiments of the present invention has been described above. In the above-described embodiments, in determining the replay reproduction time with respect to the stroke section, when the stroke replay reproduction time is determined in proportion to the length of the stroke section, the replay reproduction time with respect to the interval is also proportional to the length of the interval In the case where the stroke replay reproduction time is determined to be the same regardless of the length of the stroke section, the replay reproduction time for the interval is also determined irrespective of the length of the interval between the intervals 18, the operation of determining the replay reproduction time with respect to the stroke section and the operation of determining the replay reproduction time with respect to the interval are independent from each other, But is not limited to a bar, Even if for a replay duration which is dependent on the determined length of the stroke range, ripple mozzarella the duration of the interval between possible embodiment in which independently of determining the length of the interval, and vice versa.

5. Replay of handwritten content # 2

Hereinafter, the electronic apparatus 3000 will be described in detail based on the pen data received from the electronic pen 2000, in which the user rewrites the content written on the medium 1000 at a later time and displays it on the display of the electronic apparatus 3000 . Hereinafter, another method of replaying and displaying the contents written by the user in real time on the display will be described.

Hereinafter, for the following description, the electronic pen 2000 and the electronic device 3000 receive and store the pen data related to the matters written on the target medium 1000 by the user using the electronic pen 2000 .

The electronic device 3000 can detect whether or not a predetermined event for replaying the handwriting contents of the user has occurred. The predetermined event has already been described above, so a detailed description thereof will be omitted here.

Then, the electronic device can determine the contents of the replay object to be replayed among the contents handwritten by the user. The determination of the contents of the replay object and the contents of the replay object have already been described above, so a detailed description thereof will be omitted here.

The electronic device 3000 can determine the playback time of the replay operation after the content to be replayed is determined. At this time, the electronic device 3000 can confirm the number of strokes included in the contents to be replayed and determine the reproduction time of the replay operation based on the number of confirmed strokes.

The electronic device 3000 may previously store the number of strokes to be replayed per unit time in order to determine the playback time of the replay operation based on the number of confirmed strokes. For example, the electronic device 3000 may store the number of strokes to be replayed for one second in advance. In another example, the electronic device 3000 may store in advance the number of strokes to be replayed for one second. As another example, the electronic device 3000 may have stored in advance the number of strokes to be replayed for one second.

The electronic device 3000 can determine the playback time of the replay operation based on the number of confirmed strokes and the number of strokes to be replayed per unit time. For example, if a total of 100 strokes is included in the content determined as a replay object, and the number of strokes to be replayed for one second is four, the replay time of the replay operation is 100 (pieces) / 4 (pieces / Sec) = 25 (seconds).

That is, the playback time of the replay operation determined by the electronic device 3000 may be determined proportionally to the number of strokes included in the replay object contents. For example, if the number of strokes is 100 and the predetermined number of reproduction strokes per second is 4, the reproduction time can be determined to be 25 seconds, but if the number of strokes is 200, the reproduction time can be determined to be 50 seconds have.

In other words, according to some embodiments of the present invention, the number of strokes included in the handwriting of the user subject to the replay operation can be defined as N, and the number of predetermined strokes reproduced for a predetermined unit time The playback time of the replay operation determined by the electronic device 3000 may be determined as N / M * (a predetermined unit time).

On the other hand, in the above-described example, only the case where the number of strokes included in the replay object contents is N times the number of replay strokes per a predetermined unit time has been described as an example. Hereinafter, the number of strokes will be referred to as a replay stroke Embodiments for determining the replay time of replay in the case where there is no multiple of number will be described.

According to some embodiments, the electronic device 3000 can determine the play time of the replay in the same manner as described above. That is, if the number of strokes contained in the replay object contents is 102, and the number of replay strokes per a predetermined unit time is 4, reproduction of the replay is performed with 102 (pieces) / 4 (pieces per second) = 25.5 The time can be determined.

According to some other embodiments, the electronic device 3000 determines that the number of strokes included in the handwriting of the user subject to the replay operation is defined as N, and the number of reproduced predetermined strokes reproduced for one second Is defined as M, and when the quotient is divided by Q and N is divided by M, the replaying time of the replay can be determined as (Q + 1) (second) when R is defined as the remainder. That is, when the number of strokes included in the replay object contents is 102, and the number of replay strokes per predetermined unit time is 4, the quotient of dividing 102 by 4 is 25, so that the reproduction time of the replay is (25 + 1) = 26 (seconds).

To sum up, the number of strokes included in the handwriting of the user subject to the replay operation is defined as N, the number of predetermined strokes to be reproduced to be reproduced for one second is defined as M, and N is divided by M The electronic device 3000 determines the replay time of the replay as Q, and if R is not 0 (i.e., if R is greater than M The electronic device 3000 can determine the reproduction time of the replay as (Q + 1).

However, in such a case, the replay play time may be determined proportionally to the number of strokes, but is not determined in complete proportion. In other words, when the number of strokes is 100 and the number of strokes is 200, the replay play time may differ by a factor of two, but when the number of strokes is 101, when the number of strokes is 102, If the number of strokes is 103, the replay time of the replay can be determined to be the same. 25 is a diagram for explaining a method of determining a play time of a replay based on the number of strokes according to some embodiments of the present invention. Referring to Fig. 25, when the number of replay strokes per unit time is 4 , The relationship between the number of strokes and the replay play time is schematically shown when the play time of the replay is determined according to some embodiments of the present invention.

On the other hand, the electronic device 3000 may store the number of replay strokes per unit time rather than storing the number of replay strokes per unit time. In accordance with the predetermined event, The number of replay strokes can be determined.

In addition, the electronic device 3000 can determine the playback speed of the replay operation. There are various ways in which the electronic device 3000 determines the playback speed of the replay operation.

For example, the electronic device 3000 can determine the playback speed of the replay operation in accordance with the predetermined event. There may be a case where the user separately requests a playback speed for the replay operation. Accordingly, the electronic device 3000 can determine the replay playback speed according to the playback speed requested by the user. Alternatively, there may be a case where the operating system of the electronic device 3000 or another application installed in the electronic device 3000 separately requests a playback speed for the replay operation, whereby the electronic device 3000 , The replay reproduction speed can be determined according to the reproduction speed requested by the operating system or the application.

In another example, the electronic device 3000 can determine the playback speed of the replay operation based on the number of strokes included in the replay object contents.

26 is a diagram for explaining an embodiment for determining the replay speed of replay according to the number of strokes included in the replay object contents according to some embodiments of the present invention.

Referring to Fig. 26, a plurality of sections are divided according to the number of strokes, and a predetermined playback speed is associated with each section. The electronic device 3000 stores the table shown in Fig. 26 in advance in the memory module 3400, confirms the total number of strokes included in the contents to be replayed, and stores the table in advance in accordance with the total number of confirmed strokes By referring to the stored table, the replay reproduction speed can be determined. For example, in the case where the interval according to the number of strokes is determined in units of 500, if the replay target stroke is less than 1 to 500, the replay speed of the replay can be determined at 1x speed. If the replay target stroke is 500 The replay speed can be determined at 2x speed, and the replay speed can similarly be determined for the intervals longer than this.

At this time, the determined replay reproduction speed may be determined as the basic reproduction speed for the corresponding replay operation, and the determined basic reproduction speed may be recommended to the user. That is, when the number of strokes included in the replay object is 300, 1x can be displayed to the user at the recommended replay speed. If the number of strokes contained in the replay object is 700, 2x is recommended It can be displayed to the user at the replay speed.

As described above, after the replay reproduction speed is determined, the electronic device 3000 can determine the number of replay strokes per unit time based on the determined replay reproduction speed.

27 is a diagram for explaining an embodiment for determining the number of replay strokes per unit time in accordance with the replay reproduction speed according to some embodiments of the present invention.

Referring to FIG. 27, it is shown that the number of replay strokes per unit time is associated with each of the playback speeds. The electronic apparatus 3000 stores a table as shown in Fig. 27 in advance in the memory module 3400, and determines the number of replay strokes per unit time with reference to a table stored in advance according to the determined replay reproduction speed . For example, when the playback speed is 1x, the number of replay strokes per unit time (the number of replay strokes per second) may correspond to four, and when the playback speed is 2x, The number of strokes (the number of replay strokes per second) may correspond to eight.

In this manner, the electronic device 3000 can determine the number of replay strokes per unit time in accordance with the determined replay reproduction speed.

As described above, after the content to be replayed is determined, the electronic device 3000 performs replay of the replay operation based on the request of the user, the request of the operating system, the request of the application, the number of strokes included in the contents of the replay object, Time can be determined.

Then, the electronic device 3000 performs a replay operation in accordance with the determined replay operation reproduction time or the like.

The electronic device 3000 may perform the replay operation such that one stroke at a time is displayed on the display when performing the replay operation.

28 is a diagram for explaining a method of performing a replay operation for a handwriting of a user, according to some embodiments of the present invention.

28 shows the timing at which the replay target strokes are displayed on the display in the case where the number of replay strokes per sec is four. Referring to FIG. 28, it is seen that strokes are displayed on the display one by one at 0.25 second intervals And the first stroke is not displayed sequentially from 0 second to 0.25 second, but all at once at 0 second. In other words, according to some embodiments of the present invention, when the number of replay strokes per unit time is determined, the display intervals between the strokes and the strokes can be determined to be equal to each other when the replay operation is performed. That is, in this way, when performing the replay operation, the electronic device 3000 can perform the replay operation such that one stroke is displayed one by one on the display at a time.

Alternatively, instead of the time at which the entire stroke is displayed on the display at one specific time, the entire stroke may be displayed for a time interval that is much shorter than the display interval between strokes and strokes (for example, 0.25 seconds in the above example) will be.

However, in some embodiments, it may be replayed in such a manner that two or more strokes at a time are displayed on the display at the same time.

On the other hand, as described above, the electronic apparatus 3000 can change the replay reproduction speed in accordance with another predetermined event while performing the replay operation based on the determined replay reproduction speed and the determined number of replay strokes per unit time .

For example, the user can request a change in replay play speed currently being played, and the operating system or another application can request a change in the replay play speed currently being played.

In this case, the electronic device 3000 changes the replay reproduction speed in accordance with the predetermined other event, changes the number of replay strokes per unit time based on the changed replay reproduction speed, and then changes the number of replay strokes per unit time So that the replay operation can be performed.

As described above, according to some embodiments of the present invention, when the user's handwriting content is replayed, the timing at the time of writing by the user and the timing at the replay reproduction are not synchronized with each other in a temporally synchronized manner, It is possible to reproduce the handwriting contents of the user in a time and perform the replay.

6. Capturing handwriting content

The electronic device 3000 can capture the handwriting content written by the electronic pen 2000. [ Here, the electronic device 3000 provides a user interface for selecting a specific portion of the entire handwriting to be captured, thereby selectively capturing a specific portion of the entire handwriting. The electronic device 3000 may also provide a user interface that allows the user to determine which portion of the entire handwriting is selected for capture.

The electronic device 3000 can determine a part to be captured (hereinafter referred to as &quot; target handwriting content &quot;) among the entire handwriting content.

FIG. 29 is a diagram showing the overall handwriting content and the target handwriting content in the capture operation of the electronic device according to the present invention. FIG.

Here, the entire handwritten content may mean any handwritten content that can be reproduced continuously through the replay. For example, in the case where the electronic device 3000 plays back the handwriting content in units of pages of the medium 1000, the entire handwriting content A includes all the handwriting content written on the page as shown in FIG. 29 . Of course, when the handwritten content written on a single page is divided and reproduced as needed, only a part of the handwritten content in the page may correspond to the entire handwritten content described above, and the handwritten content written on a plurality of pages at once In the case of continuous reproduction, all of the handwritten contents described in the plural pages may correspond to the entire handwritten content.

Here, the target handwritten content may include part or all of the entire handwritten content. The target handwritten content may include at least one portion of a series of handwritten characters among the entire handwritten content. For example, as shown in Fig. 29, the first handwriting content T1 can be selected as the target handwriting content. As another example, the first handwritten content T1 and the second handwritten content T2 can be selected as the target handwritten content as shown in FIG.

The electronic device 3000 can set a target section in a playback section of the entire handwritten content and determine a portion corresponding to the set target section among the entire handwritten content as the target handwritten content.

Specifically, the electronic device 3000 can input at least one time point of the playback period of the entire handwritten content from the user, and set the target time period based on the received time point.

For example, the electronic device 3000 receives start and end points from a user, and accordingly sets a section from the start point to the end point of the entire written content as the target section.

In another example, the electronic device 3000 can receive either a starting point or a finishing point from a user. In this case, the electronic device 3000 may set the target section from the start point to the end of the playback section, or set the target section from the beginning of the playback section to the ending point. That is, when only the start time point is input, the end of the entire playback time point becomes the end time point. On the other hand, when only the end point time point is input, the beginning of the entire playback time point becomes the start time point.

Alternatively, the electronic device 3000 may set the exclusion interval based on the starting and ending points of the exclusion interval from the user, and may set the remaining interval minus the exclusion interval of the entire playback interval as the object interval.

For example, the electronic device 3000 receives start and end points from a user and sets a section from the start point to the end point of the entire playback section as an excluded section, and sets the remaining section as a target section have.

On the other hand, the electronic device 3000 may set distant object sections that are spaced apart from each other. For example, the electronic device 3000 receives a first start time point, a first end time point, a second start time point, and a second end point time from the user, and receives the first start point, the first end point, And a second object section from the second start point to the second end point can be set.

In order to receive at least one time point described above, the electronic device 3000 may provide various types of user interfaces.

30 to 32 show an example of a user interface for receiving an object interval according to the present invention.

According to one example, the electronic device 3000 may display a progressive bar along with the entire handwriting content, receive a user input to the progressive bar, and set an object section based thereon.

Here, the progressive bar may mean an indicator linked with the progress of reproduction of the handwritten content. 30, the progressive bar P is generally provided in the form of a bar at the bottom of the screen. However, the form of the progressive bar P is not necessarily limited to the form shown in FIG.

On the other hand, in the present invention, the total playback time represented by the progressive bar may correspond to the time at which the handwritten content is reproduced according to the replay, which is based on the handwritten time, the handwritten number of strokes, Can be determined.

For example, the total reproduction time according to the progressive bar may be determined so as to correspond to the time interval from the writing time of the pen data to the first stroke of the writing contents to the writing time of the pen data of the last stroke. In this case, the time written on the medium 1000 by the user using the actual electronic pen 2000 and the slave replay time according to the progressive bar will be determined to be the same.

As another example, the total reproduction time according to the progressive bar may be set so as to correspond to the time interval from the writing time of the pen data to the first stroke of the writing content to the writing time of the pen data of the last stroke, If the time interval is greater than the preset reference interval, the corresponding time interval can be reduced. That is, if the time interval between the handwriting time at which the specific stroke is performed and the time at which the next stroke of the specific stroke is performed is greater than the reference interval set at 20 seconds, it can be reduced to a time interval of 5 seconds. In this case, the total replay time according to the progressive bar may be shorter than the time written by the user using the electronic pen 2000 in the actual medium 1000.

As another example, the total playing time according to the progressive bar can be determined by the total number of strokes of the writing contents (i.e., the number of strokes). That is, the replay time of the progressive bar can be determined to be 100 seconds for the handwritten content consisting of 300 strokes by associating three strokes in 1 second on the replay. In this case, the total replay time due to the progressive bar may differ from the actual writing time.

The electronic device 3000 may receive a user input for setting a target section from a user through a user interface displaying such a progressive bar. For example, the user can select two points on the progressive bar, as shown in FIG. 30, so that the electronic device 3000 determines the point after the start point as the end point, Accordingly, the target section can be set. At this time, the start indicator (I-1) and the end indicator (I-2) can be displayed on the progressive bar to identify the start point and the end point, respectively. On the progressive bar P, the target section R may be displayed so as to be distinguished from the remaining sections. The user can select a desired point on the progressive bar by touching or clicking with a mouse as shown in FIG. Alternatively, the user may drag from one point to another point on the progressive bar as shown in FIG. 31, in which case the electronic device 3000 may set the dragged section as the target section R. That is, the beginning of the dragged section is the start point I-1, and the end point is the end point I-2. According to this input, the target writing contents corresponding to the target section R can be determined as shown in Figs. 30 and 31. [ Also, the user can set two or more target sections R-1 and R-2 spaced apart from the progressive bar P as shown in FIG. 32 to define a plurality of target handwriting contents T-1 and T-2 It is possible.

33 to 35 show another example of a user interface for receiving an object interval according to the present invention.

According to another example, the electronic device 3000 can display the entire handwriting content and set the target section according to a user input for selecting strokes in the handwriting content. Specifically, when the two strokes are selected, the handwriting content by the strokes between the strokes written first and the handwritten strokes can be selected as the target handwriting content. In other words, the electronic instrument 3000 can set the target handwriting content as the start point or the end point of the target section as the playback point of the selected stroke.

33, the user selects two strokes (S-1, S-2) out of the entire handwriting contents, and accordingly, the target handwriting content T can be determined by the two strokes and the strokes in between have.

Alternatively, the user may select them by dragging from the start stroke (S-1) to the end stroke (S-2) out of the entire handwriting contents similar to that shown in Fig. 34, Can determine the target handwriting content T as in the case where the two strokes S-1 and S-2 are respectively selected.

It is also possible to set a plurality of target sections in order to select a plurality of target handwritten contents as shown in Fig. 35 using this method.

In this way, the user input for selecting the stroke among the handwriting contents can accurately select the stroke to be displayed in the present invention. However, even if the specific stroke is not accurately selected, the electronic device 3000 can obtain the stroke closest to the point It can be judged that it is selected.

36 and 37 are still another example of a user interface for receiving an object interval according to the present invention.

According to another example, the electronic device 3000 can reproduce the entire handwriting content in the form of a moving picture through the display, and can receive the user input during the reproduction to acquire the time when the user input occurred as the starting point or the ending point. Specifically, referring to FIG. 36, the user can input the point of time as the start point in a state in which the handwriting contents are reproduced until the "In the evening" part (U-1). Referring to FIG. 37, the user can input the point of time as the end point in the state where the reproduction is progressed up to the "secure" portion U-2. Accordingly, the target handwriting content (T) can be determined by setting the "In the evening" part (U-1) to the "secure" part (U-2) as the target section. The user can select the viewpoint setting button B of the control panel C provided in the user interface as shown in FIG. 36 and FIG. It is needless to say that a plurality of target sections and target handwriting contents can also be selected here. The figure shows that one view setting button B is provided, and the time selected first may be the start time and the time selected later may be the end time according to the selection order of the buttons. However, it is also possible that the viewpoint setting buttons include the start point setting button and the end point setting button, respectively, and the respective viewpoints can be determined by selecting the corresponding buttons.

On the other hand, when a user input for inputting a start point or an end point of the reproduction occurs, the electronic device 3000 can temporarily stop the reproduction or continuously perform reproduction.

As described above, the electronic device 3000 can set the target section through the user input, and can determine the target handwriting content. The electronic device 3000 allows the user to easily select the target handwriting content, It is possible to confirm what the target handwriting content selected by the user is.

FIG. 38 is a diagram illustrating a screen for outputting entire handwriting contents for inputting a target section according to the present invention; FIG. Referring to FIG. 38, the electronic device 3000 can display the entire contents of the handwriting before receiving the user's input or before the determination of the target handwriting content is completed. Accordingly, the user can check the entire handwriting content and determine which portion is to be handwritten to be turned on.

Figs. 39 and 40 are diagrams showing a screen for identifying target handwriting contents according to the present invention. Fig. Referring to FIG. 39, the electronic device 3000 can display the target handwriting content to be distinguished from other handwriting content when the target handwriting content is determined. In other words, the target handwritten content and the remaining handwritten content can be displayed with different display attributes (e.g., contrast, color, font type, font type, font size, etc.). Referring to FIG. 40, when the target handwriting content is determined, the electronic handwriting content 3000 may display only the target handwriting content on the screen without displaying the remaining handwriting content on the screen.

39 and 40, the electronic device 3000 may display a progress bar or the like so that the target section is distinguished from the remaining section, and the start and end points of the target section are displayed on the progressive bar An indicator for display can be displayed.

41 is a diagram showing a captured image according to the present invention.

The electronic device 3000 can capture the determined handwriting content. Capture of the target handwriting content can be captured in the form of pen data as well as in the form of image capture. The capturing of the pen data type may mean that the target handwriting content is stored as separate pen data so that the electronic handwriting device 3000 or other electronic device 3000 can check the target handwriting content.

In the image-type capturing, the electronic device 3000 can generate an image including the target handwriting content. These images may include only the target handwriting content or may include a medium image as the background of the target handwriting content. In some cases, the captured image may include other handwritten content in addition to the target handwritten content, in which case the target handwritten content may be displayed in a form that is distinguishable from the remaining handwritten content. On the other hand, the capturing of the image may be performed in such a manner that the target handwriting content is described on the medium image using the pen data of the target handwriting content, or may be a form of capturing the image displayed on the screen.

On the other hand, the electronic device 3000 may store the target handwriting content separately or transmit it to an external device, instead of capturing or capturing the target handwriting content. For example, the electronic device 3000 can transmit the captured image of the target handwriting with the designated e-mail.

Specifically, as described above, according to some embodiments of the present invention, when the user's handwriting content is replayed, the timing at which the user writes and the timing at which the replay is reproduced are not synchronized in time with each other, It is possible to reproduce the handwriting contents of the user in a shorter time and to perform the replay.

<Structure of electronic pen>

Hereinafter, the structure of the electronic pen 2000 according to the embodiment of the present invention will be described.

FIG. 42 is an exploded perspective view of a main part and a cap part of the electronic pen according to an embodiment of the present invention, and FIG. 43 is a perspective view of the cap part provided on the electronic pen according to an embodiment of the present invention, As shown in Fig.

42 and 43, the electronic pen 2000 according to an embodiment of the present invention includes a core 2010 for writing on a medium, a main body 2020 for fixing the core 2010, And a cap portion 2030 for protecting the core portion in an unused state.

Here, the non-use state may mean a state in which the electronic pen 2000 is stored according to an embodiment of the present invention. In this case, since the deep portion 2010 is not exposed to the outside, It can mean.

The deep portion 2010 is a component that enables writing on a medium, and may include balls and ink, and the ink may be various such as oil, water, or neutral.

The core 2010 may be a black core used for a pencil or may be used for a common writing instrument.

The main body part 2020 may be a kind of grip part that can be gripped by the user by being inserted into the body part 2010 to expose a part of the core part 2010 and fixing the position of the core part 2010. [

The cap portion 2030 may have a predetermined internal space S1 for inserting one side of the main body portion 2020 in a non-use state to protect the core portion 2010, And when part of the core 2010 is inserted into the other side, a portion of the core 2010 may be exposed to the outside to enable writing.

When the cap 2030 can be written by the core 2010, the cap 2030 need not necessarily be inserted into the other side of the main body 2020, but may be separated from the main body 2020, As shown in FIG.

The main body 2020 and the cap 2030 may have a circular cross section or a polygonal cross section. Hereinafter, the cross section of the main body 2020 and the cap 2030 are polygonal.

FIG. 44 is a schematic perspective view showing the internal structure and the main body of the cap provided in the electronic pen according to the embodiment of the present invention, FIG. 45 is a schematic sectional view taken along the line AA in FIG. 44, Fig. 7 is a schematic perspective view showing a modified example of the cap portion provided in the electronic pen according to the embodiment.

47 is a schematic front view showing a main body provided on an electronic pen according to an embodiment of the present invention.

44 to 47, the electronic pen 2000 according to an embodiment of the present invention may include a cap portion 2030 and a main body portion 2020 for fixing the core portion 2010. Hereinafter, The elements will be described in detail.

The cap portion 2030 includes a receiving portion 2032 having a predetermined internal space S1 to accommodate one side of the main body portion 2020 and a position fixing portion 2034 protruding from the bottom surface of the receiving portion .

The position fixing portion 2034 is not necessarily protruded from the bottom surface of the accommodating portion 2032. For example, the position fixing portion 2034 may protrude from the side surface of the accommodating portion 2032, Do.

The cap portion 2030 may be configured to connect the outer surface of the position fixing portion 2034 and the bottom surface of the accommodating portion 2032 to each other so as to stably arrange the position fixing portion 2034 in the inner space S1. And a rigid-steel-reinforced steel portion 2036 that is made of steel.

The rigid beam guiding portion 2036 can reinforce the rigidity of the position fixing portion 2034 and can perform a kind of reinforcing rib function.

When the other side of the main body 2020 is inserted, the accommodating portion 2032 can accommodate the other side of the main body 2020. In this case, the position fixing portion 2034 can be fixed to the main body 2020 And may be disposed in the internal space S1 such that a limit of insertion of the other side of the body portion 2020 is defined.

In other words, when the other end of the main body portion 2020 is inserted toward the inner space S1, the other end of the main body portion 2020 contacts the position fixing portion 2034 to prevent further insertion So that it is possible to guide an appropriate insertion position of the other side of the body portion 2020 into the internal space S1.

43) for indicating the state of the electronic pen 2000 to the outside can be provided on the other side of the main body part 2020. Due to the position fixing part 2034, The degree of insertion of the other side of the light emitting portion 2020 into the internal space S1 is adjusted so that the light emitting portion 2028 (see FIG. 2 and FIG. 3), which is penetrated through the receiving portion 2032, To be exposed to the outside, thereby providing convenience to the user.

The mounting space S2 may be a space provided by the latching portion 2023 of the main body portion 2020. The main body portion 2020 includes a body portion 2024 in which the user can grip, And a locking portion 2023 protruding from one side of the body portion 2024 to provide a mounting space S2 so that the cap portion 2030 may be fixed with the mounting portion 2034 mounted thereon.

The latching portion 2023 includes a first latching portion 2021 protruding toward the center of the body portion at one side of the body portion 2024 and a second latching portion 2021 spaced apart from the first latching portion 2021, And a predetermined mounting space S2 may be formed between the first engaging portion 2021 and the second engaging portion 2022. The second engaging portion 2022 may be formed with a predetermined mounting space S2 between the first engaging portion 2021 and the second engaging portion 2022. [ .

The mounting space S2 may be a space in which the mounting portion 2033 of the position fixing portion 2034 is mounted and the mounting portion 2033 may be formed in the inner space S1 from the center of one surface of the accommodating portion 2032. [ The protruding portion 2031 may protrude from the end portion of the protrusion 2031, as shown in FIG.

Here, the receiving portion 2032 and the body portion 2024 may have a circular cross section or a polygonal cross section. For example, the cross section may be formed as a K-shaped (K is a natural number of 3 or more) And may be formed as a triangle as shown in the drawing.

When the body 2024 is inserted into the accommodating portion 2032, the mounting portion 2033 is provided with the protrusion 2031 so as to be mounted in the mounting space S2 regardless of a change in the position of the mounting space S2. And extend radially from the end of the receiving portion 2032 toward the vertex of the lateral cross section of the receiving portion 2032. [

Here, the term &quot; vertex &quot; means an intersection point where a line segment constituting a polygon generally meets, but it is noted that the present invention includes a point having a minimum radius of curvature.

The attachment portion 2033 extends radially from the end of the protrusion 2031 so that regardless of how the body portion 2024 is inserted into the accommodation portion 2032, The mounting portion 2033 may be mounted in the mounting space S2 formed between the first and second latching portions 2022 and 2022, thereby enhancing convenience.

46, the mounting portion 2033a may be formed by extending radially from the end of the protrusion 2031a

The deep portion 2010 may be disposed eccentrically from the center of the transverse section of the body portion 2024 toward the vertex of the transverse section of the body portion 2024, and the first and second engaging portions 2021, The body 2020 may be formed between the center line of the transverse section of the body 2024 and the core 2010. [

The mounting space S2 in which the mounting portion 2033 is mounted is also formed between the center line of the transverse section of the body portion 2024 and the core 2010 so that the user can write in the medium with the core 2010 It is possible to minimize the breakage of the first latching portion 2021 and the second latching portion 2022 due to an external factor during the operation, thereby preventing the functioning of the mounting space S2 from being deteriorated in advance.

48 and 49 are schematic side views for explaining the process of inserting the cap portion into one side of the main body provided in the electronic pen according to the embodiment of the present invention.

Referring to FIG. 48, one side of the main body 2020 is inserted into the cap portion 2030 in order to store the electronic pen 2000 in an unused state according to an embodiment of the present invention.

In this case, the first latching portion 2021 of the main body portion 2020 can be inserted into the receiving portion 2032 of the cap portion 2030, and the first latching portion 2021 can be inserted into the first latching portion 2021, The insertion portion 2033 may include an insertion slope 2026 that slopes downward along the insertion direction so that the insertion portion 2033 can enter the mounting space S2 after the contact portion 2033 is inserted into the accommodation portion 2032. [

The insertion inclined surface 2026 contacts the mounting portion 2033 when the body portion 2024 is inserted into the accommodating portion 2032 so that the insertion of the body portion 2024 into the accommodating portion 2032 Which is a kind of primary blocking wall that restricts the flow of the fluid.

When the user applies a continuous external force to the body portion 2024 toward the inner space S1 of the accommodating portion 2032, the mounting portion 2033 is inserted into the insertion inclined surface 2026, And finally mounted on the mounting space S2.

When the mounting portion 2033 is disposed in the mounting space S2 due to the continuous external force of the user, the body portion 2024 is inserted into the internal space S1 of the accommodating portion 2032 And this can be realized by the second latching portion 2022 which provides the function of the secondary blocking wall.

The second latching portion 2022 is inserted into the receiving portion 2032 to prevent the insertion of the mounting portion 2033 beyond the mounting space S2 when the body portion 2024 is inserted into the receiving portion 2032. [ 2033, and more specifically, may include an excess insertion preventing surface 2025 perpendicular to the insertion direction.

As a result, even if there is continuous external force of the user, the mounting portion 2033 contacts the over-insertion preventing surface 2025 and is prevented from further insertion, so that the mounting portion 2033 can be stably mounted in the mounting space S2.

The end of the second latching part 2022 may be formed closer to the center of the body part 2024 than the end of the first latching part 2021. This is because the first latching part 2021 Since the second latching portion 2022 has to perform the function of the secondary blocking wall in which the mounting portion 2033 should not pass, while the second latching portion 2022 is a component that performs the function of the primary blocking wall and the mounting portion 2033, to be.

The body portion 2024 between the first engaging portion 2021 and the second engaging portion 2022 defining the mounting space S2 may be formed in the mounting space S2 when the mounting portion 2033 is mounted in the mounting space S2. The surface 2028 of the body portion 2024 may be in surface contact with the mounting portion 2033 and may be formed in a plane parallel to the insertion direction of the body portion 2024 into the receiving portion 2032. [

The coupling force between the cap portion 2030 and the main body portion 2020 can be increased due to surface contact between the mounting portion 2033 and the body portion 2024 in the mounting space S2, The separation between the cap portion 2030 and the main body portion 2020 does not occur.

On the other hand, when the mounting portion 2033 is mounted in the mounting space S2, that is, when the electronic pen 2000 is to be changed from the non-use state to the use state for handwriting, The cap portion 2030 is separated from the main body portion 2020 by applying an external force.

The first latching portion 2021 may be configured such that when the body portion 2024 inserted into the accommodating portion 2032 is detached, the mounting portion 2033 mounted in the mounting space S2 is inserted into the mounting space 2032, And an inclined separation surface 2027 inclined downward along the separation direction so as to be separated from the separation surface S2.

The separation slope 2027 may be formed symmetrically with respect to the insertion slope 2026 described above, but the present invention is not limited thereto, and the inclination angle may be slightly different.

Hereinafter, the structure of the electronic pen 2000 will be described in more detail.

FIGS. 50 and 51 are schematic perspective views of a body part provided on the electronic pen according to an embodiment of the present invention, and FIGS. 52 to 54 are views showing the body part provided on the electronic pen according to the embodiment of the present invention. A camera module, and a lighting module.

The electronic pen 2000 according to the present invention may include a cap portion 2030 as described with reference to FIGS. 42 to 49. However, the cap portion 2030 is not necessarily required to implement the electronic pen 2000 It should be noted that this may not be a necessary component.

50 to 54, the electronic pen 2000 according to an embodiment of the present invention includes a camera module 2320 and an illumination module 2340, A substrate portion 2110 to which the camera module 2320 and the illumination module 2340 are connected and a hollow portion S5 to which the receiver plate portion C1 accommodated in the hollow S5 and the hollow portion S5 A main body 2120 made of a first material to shield the electromagnetic wave generated by wireless communication, a camera body 2320 having a main body 2120, A battery unit 2160 for driving the illumination module 2340, and a wireless communication module 2440 mounted on the exposed substrate unit C2 to enable the wireless communication with other electronic devices.

Since the camera module 2320, the illumination module 2340, and the wireless communication module 2440 have been described in detail, a detailed description thereof will be omitted.

The main body 2120 may be a component that provides an appearance of the electronic pen 2000 according to an embodiment of the present invention and may include a main body portion 2020 together with the substrate fixing portion 2030 and the substrate protecting portion 2140, .

The substrate portion 2110 may be implemented as a single unit in the electronic pen 2000 according to the present invention, but may be implemented in a plurality of units. For example, as shown in the drawing, the first substrate 2112, A substrate 2114, and a third substrate 2116. [0156] FIG.

Hereinafter, for convenience of explanation, the case where the substrate portion 2110 includes three substrates will be described as an example.

Specifically, the substrate portion 2110 includes a first substrate 2112 disposed closer to a first end of the main body 2120 to which the core 2010 is exposed, and a second substrate 2112 disposed on the opposite end of the first end, And a third substrate 2116 disposed between the first substrate 2112 and the second substrate 2114. The second substrate 2114 may include a second substrate 2114 disposed closer to the first substrate 2112 and a third substrate 2116 disposed between the first substrate 2112 and the second substrate 2114. [

The first substrate 2112, the second substrate 2114 and the third substrate 2116 may be electrically connected to each other by a flexible printed circuit board (FC), and the hollow of the main body 2120 The receptacle plate C1 and the exposed substrate portion C2 may be defined depending on whether they are accommodated in the receptacle S5 and the specific substrate may include the receptacle plate C1 and the exposed substrate portion C2 at the same time.

The receiving plate portion C1 and the exposed substrate portion C2 may be formed by virtually dividing a region of the substrate into a portion accommodated in the hollow S5 of the main body 2120 and a portion exposed to the outside of the hollow S5 In one concept, the receiver plate portion C1 and the exposed substrate portion C2 may be simultaneously present on one substrate.

Since the first substrate 2112 and the third substrate 2116 are accommodated in the hollow S5 of the main body 2120 as shown in the figure, .

On the other hand, since only part of the second substrate 2114 is accommodated in the hollow S5, the accommodated portion can form the receiver plate C1 and the remainder can form the exposed substrate portion C2.

That is, the second substrate 2114 may include at least a portion of the receiver plate C1 and the exposed substrate portion C2 in the electronic pen 2000 according to the present invention.

The main body part 2020 includes the main body 2120 and the main body part 2120 so that the receiving plate part C1 is mounted together with the main body 2120 to fix the receiving plate part C1 to a predetermined position of the hollow S5. And the exposed substrate portion C2 may be mounted on the substrate fixing portion 2030 and fixed at a predetermined position.

The substrate fixing unit 2030 may be a structure for fixing the first substrate 2112, the second substrate 2114 and the third substrate 2116. The substrate fixing unit 2030 may include a first substrate 2112, a second substrate 2114 And the third substrate 2116 may be mounted to the substrate fixing portion 2030 by an additional component 2150. [

The substrate fixing part 2030 may be composed of a single part, but is not limited thereto, and a plurality of parts may be connected to each other.

The exposed substrate portion C2 which is a part of the second substrate 2114 is exposed to the outside of the second end which is the opposite end of the first end of the main body 2120 in which the core portion 2010 is exposed, Can be arranged close to the second end.

The camera module 2320 and the illumination module 2340 may be mounted on the first substrate 2112 and electrically connected to the first substrate 2112 by a flexible printed circuit board FC It is acceptable.

The battery module 2160 that provides driving force to the camera module 2320 and the illumination module 2340 may be disposed between the first substrate 2112 and the second substrate 2114.

The battery portion 2160 may be mounted on the board mounting portion 2132 which provides a mounting space S6.

The battery unit 2160 may be disposed between the first substrate 2112 and the second substrate 2114 so as to be offset to the second end of the main body 2120 as a whole, The center of gravity of the electronic pen 2000 may be biased to the first end of the main body 2120 such that the center of gravity of the electronic pen 2000 is biased toward the first end of the main body 2120.

The second substrate 2114 may be provided with a wireless communication module 2440 that enables wireless communication with other electronic devices. More specifically, the second substrate 2114 may include a wireless communication module 2440, The wireless communication module 2440 can be mounted.

The wireless communication module 2440 may be exposed to the outside of the main body 2120 formed of the first material and may receive no interference in wireless communication with other electronic devices despite the first material have.

Here, the first material forming the main body 2120 may include aluminum (Al) that shields electromagnetic waves generated during wireless communication by the wireless communication module 2440, But it may be applied to any material that can shield electromagnetic waves.

As described above, the wireless communication module 2440 for realizing wireless communication with other electronic devices is installed in the main body 2120 so as to be disposed outside the main body 2120 composed of the first material capable of shielding electromagnetic waves. Since the wireless communication can be implemented without being influenced by the main body 2120, it is possible to maximize the recognition of the handwriting of the user.

The electromagnetic pen 2000 according to the present invention is configured such that electromagnetic waves generated during wireless communication by the wireless communication module 2440 are emitted to the outside through the main body 2120 by the main body 2120 composed of the first material So that the harmfulness of the electromagnetic wave generated in the wireless communication can be minimized.

Since the main body 2120 made of the first material has a higher heat transfer coefficient than the substrate fixing part 2030 made of synthetic resin such as plastic, the heat generated by the operation of the lighting module 2340, The durability of the electronic pen 2000 can be improved.

The body part 2020 provided in the electronic pen 2000 according to the present invention surrounds the exposed substrate part C2 together with the main body 2120 and the substrate fixing part 2030 to form the exposed substrate part C2 The main body 2120 may be provided with a substrate protector 2140 to protect the main body 2120.

The substrate protector 2140 may be a kind of cap covering the exposed substrate portion C2 in connection with the second end of the main body 2120. The exposed substrate portion C2 may be a second substrate 2114, As described above.

The substrate protector 2140 may be formed of a second material that allows electromagnetic waves generated by wireless communication performed by the wireless communication module 2440 mounted on the exposed substrate unit C2 to pass therethrough, The module 2440 may be free from any obstacle in wireless communication with other electronic devices despite the substrate protection part 2140. [

Here, the second material may be a synthetic resin including plastic, and the heat transfer coefficient may be lower than that of the first material.

55 to 57 are schematic perspective views illustrating a process of inserting a deep portion into a body portion provided in an electronic pen according to an embodiment of the present invention.

Referring to FIG. 55, the electronic pen 2000 according to the present invention can be freely replaced with the core 2010, and the core 2010 can be removed from the core 2020 of the main body 2020, And can be inserted into the insertion hole S7.

56, the substrate fixing portion 2030 includes a substrate mounting portion 2132 on which the receiver plate C1 is mounted, a deep portion insertion guide portion 2134 for providing a path through which the deep portion 2010 is inserted, And a deep portion fixing portion 2136 for fixing the deep portion 2010 so that the deep portion 2010 inserted into the insertion guide portion 2134 can be prevented.

The substrate mounting portion 2132 may be a frame constituting the substrate fixing portion 2030 and the deep portion inserting portion 2134 may be formed in a state open by a path communicating with the deep portion insertion hole S7 .

However, the deep portion insertion guide portion 2134 is not necessarily formed in an open state, but may be formed as a kind of groove or hole.

55 and 56, the core insertion guide portion 2134 includes a first core insertion guide portion 2135 through which the core portion 2010 passes, and a second core insertion portion 2135 through which the core portion fixing portion 2136 is mounted, And the deep portion fixing portion 2136 can be slidably mounted in the second deep portion insertion guide portion 2137. [

The deep portion fixing portion 2136 may be detachably mounted on the second deep portion insertion guide portion 2137 and may be mounted on the second deep portion insertion guide portion 2137 when the second deep portion insertion guide portion 2137 And protruding portions 2139 extending outwardly so as to be slidable without being detached from each other.

The second core insertion guide portion 2137 may include a protrusion corresponding portion 2131 protruding to form a space in which the protrusion 2139 is mounted.

When the deep portion fixing portion 2136 is mounted on the second deep portion insertion guide portion 2137, the protruding portion 2139 is caught by the protrusion corresponding portion 2131 so that it can be prevented from deviating to the outside.

As the deep portion fixing portion 2136 is slidably mounted in the deep portion inserting portion 2134, the electronic pen 2000 according to the present invention can feel the comfort of handwriting while the user is writing.

The core fixing portion 2136 may apply a force to the board mounting portion 2132 in the second core insertion guide portion 2137 and may include a first magnet 2172 and a second magnet It is possible to use the magnetic force by the magnet 2174.

The first magnet 2172 can be mounted on the core fixing portion 2136 and the second magnet 2174 is mounted on the board mounting portion 2132 so that the core fixing portion 2136 can be mounted on the substrate mounting portion 2132. [ And the attraction force can be maintained.

An elastic body 2176 having elasticity may be disposed between the first magnet 2172 and the second magnet 2174. The elastic body 2176 may provide softness while the user writes medium, Can be improved.

<Control Method of Electronic Device>

1. Real-time recreation of the contents written by the user # 1

Hereinafter, a first embodiment of a method for real-time reproduction of contents written by a user according to the present invention will be described.

58 is a flowchart of a first embodiment of a method for real-time reproduction of contents written by a user according to the present invention. 58, a method for real-time reproduction of contents written by a user includes the steps of acquiring pen data (S110), acquiring information about a target medium based on the obtained pen data (S120) A step S140 of reproducing a user's handwriting on the medium image based on the obtained pen data (S140).

The step of reproducing the handwriting of the user may include reproducing the handwriting content of the user at a corresponding position on the medium image in real time based on the stroke data generated from the pen data.

Thus, the electronic device 3000 can reproduce the handwriting contents of the user in real time based on the pen data received from the electronic pen 2000, and display it through the electronic device 3000.

In describing the operation method of the above-described electronic device, descriptions corresponding to the respective steps have already been described in detail, and a detailed description thereof will be omitted here.

2. Real-time recreation of user-written content # 2

Hereinafter, a second embodiment of a method for real-time reproduction of contents written by a user according to the present invention will be described.

59 is a flowchart of a second embodiment of a method for real-time reproduction of contents written by a user according to the present invention. Referring to FIG. 59, the method for real-time reproduction of the written contents may include acquiring pen data (S210), acquiring pen data based on the obtained pen data, determining a predetermined condition for a first area that is at least a part of the displayed medium image A step S230 of shifting a part of the medium image displayed through the display from the first area to the second area and displaying the shifted image if the predetermined condition is satisfied, And reproducing the handwritten content of the user on the second area (S240).

At this time, the predetermined condition may be whether or not the handwriting position of the user is out of the first area. That is, when the handwriting position of the user is out of the first area being displayed through the display, it can be determined that the predetermined condition is satisfied.

Thus, when the electronic device 3000 reproduces the handwriting contents of the user in real time based on the pen data received from the electronic pen 2000, the target medium is enlarged and displayed, so that the entirety of the target medium is displayed through the display Even if a user's handwriting is input to another area that is not displayed through the display, the handwriting of the user can be reproduced after shifting the display area to the area.

In describing the operation method of the above-described electronic device, descriptions corresponding to the respective steps have already been described in detail, and a detailed description thereof will be omitted here.

3. Replay of handwritten content # 1

Hereinafter, a first embodiment of a replay method of written contents according to the present invention will be described.

60 is a flowchart of a first embodiment of a replay method of written content according to the present invention. Referring to FIG. 60, a step S310 of receiving information on a handwriting of the user from an electronic pen sensing information on the handwriting of the user, a step S320 of storing information on the handwriting of the user received in the memory S320, And performing a replay operation of sequentially replaying the handwritten content of the user including the second stroke following the second stroke on the display (S330).

At this time, the first stroke and the second stroke are displayed on the display, one at a time, regardless of the time taken by the user to write the first stroke and the second stroke, and the first stroke A stroke is displayed on the display and the second stroke at a second time later than the first time can be displayed on the display.

Thereby, when the electronic device 3000 replays the handwriting of the user based on the pen data received from the electronic pen 2000, it can replay the handwriting content of the user in a time shorter than the time when the user actually input the handwriting .

In describing the operation method of the above-described electronic device, descriptions corresponding to the respective steps have already been described in detail, and a detailed description thereof will be omitted here.

4. Replay of handwritten content # 2

Hereinafter, a second embodiment of a replay method of written contents according to the present invention will be described.

61 is a flowchart of a second embodiment of a replay method of written content according to the present invention. Referring to FIG. 61, the replay method of the written contents includes receiving (S410) pen data, which is information related to handwriting of the user, through a communication unit, storing the received pen data in a memory And performing a replay operation for sequentially replaying the handwritten content of the user on the display based on the stored pen data (S430).

At this time, the reproduction time of the replay operation is determined based on the number of strokes included in the handwriting of the user to be subjected to the replay operation.

Thus, when the electronic apparatus 3000 replays the handwriting of the user based on the pen data received from the electronic pen 2000, the reproduction time of the replay operation is determined based on the number of strokes, The user can replay the handwriting content in a time shorter than one hour.

In describing the operation method of the above-described electronic device, descriptions corresponding to the respective steps have already been described in detail, and a detailed description thereof will be omitted here.

5. Capturing handwriting content

Hereinafter, a handwriting capturing method according to the present invention will be described.

62 is a flowchart of a handwriting capturing method according to an embodiment of the present invention. 62, the handwriting capturing method includes a step S510 of receiving pen data from the electronic pen 2000, a step S520 of acquiring handwriting content based on the pen data, A step S540 of receiving a user input corresponding to a time point of the handwriting content, a step S540 of setting a target section based on a user input, a step S550 of determining a target handwriting content corresponding to a target section of the handwriting content, And capturing an image including the handwriting content (S560).

First, the electronic device 3000 can receive pen data related to handwriting from the electronic pen 2000 (S510). The pen data may include coordinate data written in the medium 1000 using the electronic pen 2000, data regarding the writing time, and the like.

The electronic device 3000 can acquire handwriting content using the pen data (S520). The handwritten content can be obtained by connecting the coordinate data in the order of the handwritten time and generating it as a stroke.

The electronic device 3000 may receive a user input corresponding to at least one of the playback sections (S530). To this end, the electronic device 3000 displays a progressive bar to receive user input to the progressive bar, display the handwritten content, receive input for a specific stroke of the handwritten content, or receive user input while reproducing the handwritten content have. The electronic device 3000 may acquire a start point and an end point of the reproduction interval according to the user input. If only one time point is acquired, the remaining time points can be set by the electronic device 3000 itself.

In order to receive such a user input, the electronic device 3000 may display the entire handwriting content on the screen to help the user input.

The electronic device 3000 can set an object section based on the user input (S540). The electronic device 3000 can determine the starting point and the end point of the target section according to the user input and set the target section accordingly.

When the target section is set, the electronic device 3000 can determine the target handwriting content among the entire handwriting content (S550). The target handwritten content can be judged to be one or more. In addition, the electronic device 3000 can display the target handwriting content so as to be distinguished from the remaining handwriting content, so that the user can be informed of what handwriting content is the target handwriting content.

The electronic device 3000 can capture the selected target handwriting section (S560). The capture may be performed in an image capturing manner or in a manner via pen data. The captured image may be transmitted to the outside via an external device or the Internet, or may be separately stored.

In the above-described method of controlling an electronic device according to the present invention, the steps constituting each embodiment are not essential, and therefore, each embodiment can selectively include the above-described steps. Moreover, each step constituting each embodiment is not necessarily performed according to the order described, and the step described later may be performed before the step described earlier.

Further, the control method of an electronic device according to the present invention can be implemented in the form of a code or a program for performing the control, and the code or the program can be stored in a computer-readable recording medium.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, The present invention is not limited to the drawings. In addition, the embodiments described in this document can be applied to not only the present invention, but also all or some of the embodiments may be selectively combined so that various modifications can be made. Further, the steps constituting each embodiment can be used separately or in combination with the steps constituting the other embodiments.

1000: Medium
2000: Electronic pen
3000: Electronic devices
4000: Server

Claims (21)

An electronic device for replaying a user's handwriting content on a medium,
A communication unit for communicating with an electronic pen for sensing information on the handwriting of the user;
A memory for storing data;
A display for visually displaying information; And
Receiving pen data, which is information on the handwriting of the user via the communication unit,
Storing the received pen data in the memory,
And a controller for performing a replay operation for sequentially replaying the handwriting contents of the user on the display based on the stored pen data,
Wherein,
The playback time of the replay operation is determined based on the number of strokes included in the handwriting of the user who is the subject of the replay operation
Electronics.
The method according to claim 1,
Wherein,
And determines the reproduction time of the replay operation in proportion to the number of the strokes.
The method according to claim 1,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N,
A predetermined number of strokes to be reproduced for a predetermined unit time is defined as M,
Wherein,
The reproduction time of the replay operation is determined as N / M * (predetermined unit time)
Electronics.
The method according to claim 1,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N,
The number of reproduced predetermined strokes to be reproduced for one second is defined as M,
Wherein,
The playback time of the replay operation is determined as N / M seconds
Electronics.
The method according to claim 1,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N, the number of predetermined strokes to be reproduced to be reproduced for one second is defined as M, and when N is divided by M, Q, and the remainder is defined as R,
Wherein,
Wherein when the R is 0, Q seconds is determined as the playback time of the replay operation,
If R is not 0, (Q + 1) second is determined as the reproduction time of the replay operation
Electronics.
The method according to claim 1,
Wherein,
The replay reproduction speed is determined based on the number of strokes included in the handwriting of the user subject to the replay operation,
Determines the number of strokes to be played per unit time based on the determined replay reproduction speed,
Based on the determined number of strokes to be played back per unit time, determines the playback time of the replay operation
Electronics.
The method according to claim 6,
Wherein the greater the number of strokes included in the handwriting of the user subject to the replay operation, the faster the reproduction speed of the determined replay is.
Electronics.
8. The method of claim 7,
And the number of strokes to be played back per unit time is further increased as the replay reproduction speed is higher.
Electronics.
The method according to claim 1,
Wherein,
Wherein when performing the replay operation, the replay operation is performed so that one stroke at a time is displayed on the display
Electronics.
The method according to claim 1,
Wherein,
A replay operation is performed based on the number of strokes to be replayed per unit time determined according to the first replay reproduction speed,
When the first replay reproduction speed is changed to the second replay reproduction speed, the number of strokes to be replayed per unit time is changed,
The replay operation is continued based on the number of strokes to be replayed per the changed unit time
Electronics.
A method of controlling an electronic device for replaying a user's handwriting content on a medium,
Receiving pen data, which is information on the handwriting of the user, through the communication unit;
Storing the received pen data in a memory; And
And performing a replay operation for sequentially replaying the handwritten content of the user on the display based on the stored pen data,
The playback time of the replay operation is determined based on the number of strokes included in the handwriting of the user who is the subject of the replay operation
A method of controlling an electronic device.
12. The method of claim 11,
Wherein the playback time of the replay operation is determined in proportion to the number of the strokes.
12. The method of claim 11,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N,
A predetermined number of strokes to be reproduced for a predetermined unit time is defined as M,
The reproduction time of the replay operation is determined as N / M * (predetermined unit time)
A method of controlling an electronic device.
12. The method of claim 11,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N,
The number of reproduced predetermined strokes to be reproduced for one second is defined as M,
The playback time of the replay operation is determined as N / M seconds
A method of controlling an electronic device.
12. The method of claim 11,
The number of strokes included in the handwriting of the user subject to the replay operation is defined as N, the number of predetermined strokes to be reproduced to be reproduced for one second is defined as M, and when N is divided by M, Q, and the remainder is defined as R,
When R is 0, Q seconds is determined as the reproduction time of the replay operation,
If R is not 0, (Q + 1) second is determined as the reproduction time of the replay operation
A method of controlling an electronic device.
12. The method of claim 11,
The replay reproduction speed is determined based on the number of strokes included in the handwriting of the user subject to the replay operation,
Based on the determined replay reproduction speed, the number of strokes to be played back per unit time is determined,
The playback time of the replay operation is determined based on the determined number of strokes to be played back per unit time
A method of controlling an electronic device.
17. The method of claim 16,
Wherein the greater the number of strokes included in the handwriting of the user subject to the replay operation, the faster the reproduction speed of the determined replay is.
A method of controlling an electronic device.
18. The method of claim 17,
And the number of strokes to be played back per unit time is further increased as the replay reproduction speed is higher.
A method of controlling an electronic device.
12. The method of claim 11,
The step of performing the replay operation includes:
Wherein when performing the replay operation, the replay operation is performed so that one stroke at a time is displayed on the display
A method of controlling an electronic device.
12. The method of claim 11,
The step of performing the replay operation includes:
Performing a replay operation based on the number of strokes to be replayed per unit time determined according to the first replay reproduction speed;
Changing the number of strokes to be replayed per unit time when the first replay reproduction speed is changed to the second replay reproduction speed; And
And continuously performing a replay operation based on the number of strokes to be replayed per the changed unit time
A method of controlling an electronic device.
A recording medium on which a program for executing the method of any one of claims 11 to 20 is recorded.

Images