JP6710803B2 - Digital ink file reproducing device, digital ink file reproducing method, and program - Google Patents

Description

The present invention relates to a digital ink generating device, a digital ink generating method, and a digital ink reproducing device, and more particularly, to a digital ink generating device and a digital ink generating method that generate digital ink based on event data generated by operating a pen. , And a digital ink reproducing device for reproducing the digital ink thus generated.

By moving an ink-filled pen or a brush with paint on the paper, the ink or paint is absorbed or deposited on the paper and a trace is drawn.

In this way, digital data is generated by converting the trajectory of a pointing device such as an electronic pen or stylus moved on a position detector such as a tablet into electronic data so as to simulate a handwritten trajectory (stroke) drawn on paper. Is. Digital ink is usually configured to include (1) data for reproducing a handwritten trajectory, (2) data for describing a trajectory drawing style, and (3) data for describing a conversion rule of data regarding the trajectory. It Digital ink has standardized data formats that can be used in different environments such as drawing applications and document creation applications that operate on various OSs (Non-Patent Documents 1 to 4).

InkML described in Non-Patent Document 1 is one of the most known data formats of digital ink. (1) Data for reproducing a handwritten trajectory is called a <trace> element. In the <trace> element, a plurality of point data (detected by the input sensor at predetermined time intervals) that form a locus of one stroke (the operation from the contact of the pointer with the sensor surface of the position detecting device until the pointer is released) Data, which describes a set of coordinate data (X, Y), writing pressure data P, time data T, and the like (including data indicating an input sensor-dependent attribute (input sensor attribute)). In InkML, (2) data that specifies the drawing style of the locus, for example, data such as the <brush> element, and (3) data that describes the conversion rule of the data related to the locus, such as the data such as the <mapping> element, which will be described later, are specified. Has been done.

The ISF (Ink Serialized Format) described in Non-Patent Document 2 is a data format of digital ink used in applications of Microsoft Corporation. (1) A block of data for reproducing a handwritten locus is called StrokeDescriptorBlock. In the StrokeDescriptorBlock, points (points are X and Y coordinate values) for reproducing the trajectory of the stroke, writing pressure values, and the like are described. Further, (2) DrawingAttributeBlock, which is a block that describes a drawing style, and (3) TransformBlock, which is a block that describes a transformation rule of data regarding a trajectory, are defined.

SVG described in Non-Patent Document 3 is a markup language for describing a set of two-dimensional graphics applications and images, and a graphic script. (1) There is a <path> element as data for reproducing a handwritten trajectory. A plurality of control points (point data) are included in the <path> element, and the locus is reproduced by a Bezier curve based on these plurality of control points.

In addition, HTML5 described in Non-Patent Document 4 defines (1) a data type called a Canvas Path class as data for reproducing a handwritten trajectory.

In the following, <trace> in Non-Patent Document 1, StrokeDescriptor block in Non-Patent Document 2, <path> element in Non-Patent Document 3, CanvasPath in HTML5 described in Non-Patent Document 4, etc. are collectively referred to and handwritten using an input device. Vector data for reproducing the shape including the trace and the line width is called stroke data.

In the following, data that describes a conversion rule of data (stroke data) related to a locus such as <mapping> in Non-Patent Document 1 and <transformBlock> in Non-Patent Document 2 is generically called mapping data.

FIG. 19A is a diagram illustrating a <mapping> element that is mapping data of Non-Patent Document 1. This example shows a conversion rule using "affine" as the type of the <mapping> element. This conversion rule is that the affine transformation shown in the matrix shown in the 4th to 7th rows (conversion that makes a 90 degree rotation and moves 200 translations in the Y direction) for the figure defined by the X and Y coordinates. It shows the conversion to apply.

FIG. 19B is a diagram showing a conversion rule using “mathml” as the type of the <mapping> element. In the conversion rule using "mathml", expressions such as "root", "cos", and "minus" reserved in the namespace defined by MathML2 of Non-Patent Document 5 are used, and the operation associated therewith is used. can do. The conversion rule shown in the example of FIG. 19B is a rule for converting the coordinate data (VR, VTh) of the input sensor attribute shown in the polar coordinate format into the coordinate data (X, Y) shown in the rectangular coordinate format. In the drawing, the conversion rule indicated by the broken line frame MD_X from the second line to the thirteenth line is the value of the diameter VR (variable r) and the value of the angle VTh (variable theta) indicated by the input sensor attribute, and MathML. A conversion rule for deriving new X coordinate data is described by using a cosine or the like defined by "cos". Further, the conversion rules indicated by MD_Y on the 14th to 25th lines indicate the conversion rules for obtaining new Y coordinate data.

The ISF of Non-Patent Document 2 lists variations that can be used as conversion rules as types of <TRANSFORM BLOCK> (page 10). As a transformation such as the affine transformation matrix shown in FIG. 19A, a transformation matrix that can be expressed by 2 rows and 3 columns composed of elements M11, M12, M21, M22 and DX, DY was considered, and this transformation matrix was used. Various conversions are specified. For example, <TAG_TRANSFORM_ISOTROPIC_SCALE> for enlarging/reducing stroke data, <TAG_TRANSFORM_ANISOTROPICSCALE>, <TAG_TRANSFORM_ROTATE> for performing rotation of stroke data, <TAG_TRANSFORM_translation after performing parallel movement for performing parallel movement, etc. <TAG_TRANSFROM_ROTATE_AND_TRANSLATE>_ can be used.

Non-Patent Document 6 discloses an example of a drawing method for drawing a natural line based on digital ink.

Yi-Min Chee, 11 others, "Ink Markup Language (InkML) W3C Recommendation 20 September 2011", [online], September 20, 2011, W3C, [Search November 19, 2014], Internet < URL: http://www.w3.org/TR/InkML/〉 "Ink Serialized Format Specification", [online], Microsoft Corporation, [December 11, 2014 search], Internet <URL: http://download.microsoft.com/download/0/B/E/0BE8BDD7-E5E8 -422A-ABFD-4342ED7AD886/InkSerializedFormat(ISF)Specification.pdf〉 Erik Dahlstrom, 9 others, "Scalable Vector Graphics (SVG) 1.1 (Second Edition) W3C Recommendation 16 August 2011", [online], August 16, 2011, W3C, [December 11, 2014 search] , Internet <URL: http://www.w3.org/TR/SVG/> Ian Hickson, 6 others, "A vocabulary and associated APIs for HTML and XHTML W3C Recommendation 28 October 2014", [online], October 28, 2014, W3C, [December 11, 2014 search], Internet <URL: http://www.w3.org/TR/html5/> Ron Ausbrooks, 15 others, "Mathematical Markup Language (MathML) Version 2.0 (Second Edition) W3C Recommendation 21 October 2003", [online], October 21, 2003, W3C, [December 11, 2014 search ], Internet <URL: http://www.w3.org/TR/MathML2/> LM Mestetskii, "Fat Curves and Representation of Planar Figures", [online], 2000, Department of Information Technologies, Tver' State University, Tver, Russia, [November 19, 2014 search], Internet <URL: http://cgm.cs.ntust.edu.tw/hlyang/www/Fat%20Curves.ppt〉

However, the conversion rules based on the mapping data exemplified in Non-Patent Document 1 and Non-Patent Document 2 above are for use in geometric deformation such as rotation and enlargement of stroke data, and the coordinates included in the stroke data. It does not focus on conversion from input sensor attributes such as data and writing pressure value obtained by the input sensor into drawing attribute data used in drawing processing such as line width and transparency. Instead of showing the value of the drawing attribute data in the stroke data, it is necessary to indicate which value of the input attribute the value of the drawing attribute data is obtained by what kind of calculation when the stroke data is generated. This is useful in that the function of the input sensor used for can be confirmed afterwards.

Further, the conventional conversion rule description format is not sufficient for describing the conversion rule for expressing the conversion of the line drawn by an actual pen or brush into the shading and width of the line. Specifically, for example, when a line is drawn on a paper using a pen filled with ink or a brush that has absorbed the paint, the ink or paint may fade when the pen or the brush is moved, especially at the start and end points. A part of the stroke may become thin or conversely thick depending on the condition. Depending on the description format of the conventional conversion rule described above, a description that gives a conversion rule that applies a special conversion rule to a part of the stroke or a conversion rule for the amount of change in the value of the input sensor attribute of the stroke such as velocity may be used. Cannot be described.

Therefore, one of the objects of the present invention is to provide a handwriting in which the line width and/or the transparency and the like change from the values of the input sensor attributes such as the writing pressure obtained from the input sensor while storing the values of the input sensor attributes. A digital ink generating apparatus and a digital ink generating method for generating a digital ink capable of describing a conversion rule for reproducing the above, and a digital ink reproducing apparatus capable of reproducing the digital ink generated by such a digital ink generating apparatus. To provide.

A first invention includes a stroke data generation unit that generates stroke data having an attribute of an input sensor attribute based on pen event data generated by an input sensor when an indicator is operated, and a stroke data generation unit included in the stroke data. A mapping data generation unit that generates mapping data indicating a conversion rule for converting the input sensor attribute value that has been converted into a line width or transparency value, and a predetermined amount of digital ink that includes the stroke data and the mapping data. And a digital ink assembly unit for outputting in a data format.

In a second aspect based on the first aspect, the mapping data generation unit indicates a conversion rule for converting the value of the input sensor attribute into a line width or transparency value and a range to which the conversion rule is applied. Mapping data including range data is generated.

In a third aspect based on the first aspect, the stroke data generation unit generates stroke data including a plurality of point data having the input sensor attribute as an attribute, and the mapping data generation unit includes a plurality of the point data. Of the input sensor attributes included in the first point data of the first point data and the second point data different from the first point data of the plurality of point data, Mapping data including a conversion rule for obtaining a line width or transparency value of the second point data is generated based on a statistical value with the value of the first attribute.

Also, the digital ink reproducing device according to the present invention extracts the stroke data and the mapping data from the digital ink generated by the digital ink generating device according to the present invention, and the value of the input sensor attribute included in the stroke data. In addition, by applying the conversion rule included in the mapping data, stroke data including a line width or transparency value is generated, and the generated stroke data is drawn.

A digital ink generating method according to the present invention is a digital ink generating method executed by a computer having an input sensor, and is based on pen event data generated by the input sensor when an indicator is operated. A stroke data generating step of generating stroke data having the first attribute as an attribute, and converting the value of the first attribute included in the stroke data into a value of the first attribute or a second attribute. A mapping data generating step of generating mapping data indicating a conversion rule for performing the printing, and a digital ink assembling step of outputting digital ink including the stroke data and the mapping data in a predetermined data format.

According to the first invention, the value of the drawing attribute of the stroke data such as the line width or the transparency is derived based on the value of the input sensor attribute while holding the value of the input sensor attribute such as the writing pressure data. A digital ink can be created that describes the conversion rules. This makes it possible, for example, to distinguish between values such as line width and transparency that are derived from the writing pressure acquired by the input sensor, or values that are virtually derived from the velocity parameter. This is useful when it is desired to collectively change the correspondence between the writing pressure and the line width, or when the writing pressure value P is used as a comparison parameter for signature authentication.

Further, according to the second invention, it becomes possible to generate digital ink in which a rule for applying the conversion rule in the mapping data is described for a partial range. This makes it possible, for example, to configure the conversion rule to be applied only to the portion near the start point and the end point of the stroke. It is possible to describe a highly expressive conversion rule capable of executing special emphasis processing for.

Further, according to the third invention, it is possible to generate mapping data that defines a conversion relationship for obtaining a line width, transparency, etc., by inputting input sensor attribute values included in two or more point data having different index values. it can. Thus, when deriving the value of an attribute used at the time of drawing such as transparency and line width, a conversion rule based on a statistical value such as a differential value, an integrated value, or an arithmetic mean can be applied. It is possible to describe a conversion rule for generating digital ink imitating an actual ink situation, such as a conversion rule whose transparency increases according to the moving speed of the ink.

It is a conceptual diagram which shows the input system 1 by the 1st Embodiment of this invention. 2 is a functional block diagram of the digital ink processing device 2 shown in FIG. 1. FIG. It is a figure explaining the relationship between point data PD and stroke data SD. It is a figure which shows stroke data SD0-SD4 of FIG. 3 produced|generated according to the format of InkML format. It is the figure which extracted only the stroke data SD1 corresponding to alphabet "e" among the stroke data SD0-SD4 corresponding to five alphabets of FIG. It is a figure explaining the digital ink INKD which the digital ink assembly part 31 shown in FIG. 2 assembles. It is a figure which shows the various examples of the content func of the mapping data which a user sets. It is a figure which shows the example of the mapping data MD according to the format of InkML. It is a figure which shows the range of the stroke at the time of specifying range= "-2, -1" as an example of range data rd. It is a figure which shows the range of the stroke at the time of specifying range="0, 1" as an example of the range data rd. It is a figure which shows the range of the stroke when range=“-1,0” is designated as an example of the range data rd. It is a figure which shows the range of the stroke at the time of specifying range="1,-2" as an example of range data rd. FIG. 6 is a diagram showing, as an example of drawing style data DD, drawing style information DD1 indicating a brush style set in an application when stroke data SD is generated. (A) is a figure which shows the stroke data SD1 in the state extracted from the digital ink INKD by the digital ink reproducing part 40, (b) is a figure which shows the stroke data SD1 after applying the mapping data MD1. FIG. 7C is a diagram showing the stroke data SD1 after the mapping data MD2 is applied. FIG. 12 is a diagram schematically showing an example of a drawing process described in Non-Patent Document 6. The stroke data SD0 to SD4 shown in FIG. 3 is reproduced from the stroke data SD obtained by applying the conversion rule func1 for multiplying the writing pressure P by 10 to obtain the line width W to all the stroke data. It is a figure which shows the image signal. For the stroke data SD0 to SD4 shown in FIG. 3, (1) a conversion rule func1 for multiplying the writing pressure P by 10 to obtain a line width W is applied to all parts of the stroke data. FIG. 6 is a diagram showing an image signal reproduced from stroke data SD obtained by applying a conversion rule func2a in which the pressure P is multiplied by 5 to obtain a line width W to the end portion indicated by a broken line frame in the drawing. is there. For the stroke data SD0 to SD4 shown in FIG. 3, (1) a conversion rule func1 for multiplying the writing pressure P by 10 to obtain a line width W is applied to all parts of the stroke data. It is reproduced from the stroke data SD obtained by applying the conversion rule func2a for multiplying the pressure P by 5 to obtain the line width W to both the end and the end of the stroke indicated by the broken line frame. It is a figure which shows the image signal. For the stroke data SD0 to SD4 shown in FIG. 3, (1) a conversion rule func1 for multiplying the writing pressure P by 10 to obtain a line width W is applied to all parts of the stroke data. A conversion rule func2b for multiplying the pressure P by 20 to obtain the line width W is reproduced from the stroke data SD obtained by applying the conversion rule func2b to both the end and the end shown by the broken line frame in the drawing. It is a figure which shows the image signal. It is a figure which shows stroke data SD5 containing 10 pieces of point data PD0-PD9 as an example of stroke data SD produced|generated by the stroke data production|generation part 20 by the 2nd Embodiment of this invention. It is a figure which shows the mapping data MD3 which the mapping data production|generation part 32 by the 2nd Embodiment of this invention produces|generates. (A) is a figure which shows the stroke data SD5 in the state extracted from the digital ink INKD by the digital ink reproduction part 40, (b) shows the stroke data SD5 after applying the mapping data MD3 to all the strokes. It is a figure which shows, and is a figure which shows stroke data SD5 after applying mapping data MD3 to the part of range data rd="-3, -1". It is a figure for demonstrating stroke data SD by the 2nd Embodiment of this invention. FIG. 8 is another diagram for explaining the effect of the conversion rule in which the transparency A increases according to the speed V. It is a figure explaining the <mapping> element which is the mapping data of nonpatent literature 1. It is a figure which shows the conversion rule using "mathml" as a type of a <mapping> element.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a conceptual diagram showing an input system 1 according to the first embodiment of the present invention. The input system 1 includes a digital ink processing device 2 having a storage device 2a, a digitizer 3 (position detecting device) having a flat sensor 3a, an electronic pen 4 (pointer), and a display 5. It In addition to the electronic pen 4, it is possible to use, for example, a human finger or a simple plastic stick (stylus) as the indicator. Further, in FIG. 1, the computer 2, the digitizer 3, and the display 5 are illustrated as separate devices, but it is possible to configure some or all of them as an integrated device (tablet PC or the like).

The input system 1 generates digital ink in the InkML format on the basis of coordinate data or the like input by a user drawing a character or a picture on the sensor 3a of the digitizer 3 using the electronic pen 4 and stores it in the storage device 2a. It has a function of recording and a function of generating an image signal from the recorded digital ink and reproducing it on the display 5.

On the surface of the sensor 3a, a plurality of linear conductors extending in the x direction (one direction in the surface of the sensor 3a) and in the y direction (direction orthogonal to the x direction in the surface of the sensor 3a) are respectively provided. A plurality of existing linear conductors are arranged at equal intervals. The digitizer 3 uses coordinate data (X, Y) indicating the position of the electronic pen 4 on the surface of the sensor 3a based on changes in the potentials of these linear conductors caused by the electronic pen 4 approaching the surface of the sensor 3a. Is configured to detect.

The electronic pen 4 of the present embodiment is configured to detect the writing pressure data P at predetermined time intervals and transmit the detected writing pressure data P to the digitizer 3 as needed.

The digitizer 3 is configured to detect the coordinate data (X, Y) and the writing pressure data P. Then, the input sensor data ISD, which is a set of the detected coordinate data (X, Y), the corresponding writing pressure data P, and the time data T indicating the detection time, is generated, and digital data as shown in FIG. It is configured to output to the ink processing device 2 through an IO unit (not shown). As a result, a series of input sensor data ISD is supplied to the digital ink processing device 2 at each sampling rate of the sensor 3a while the digitizer 3 is detecting the electronic pen 4.

The digital ink processing device 2 is, for example, a personal computer. In addition to the storage device 2a shown in the figure, it is provided with a configuration such as a CPU and a communication circuit provided in an ordinary computer. The storage device 2a includes a main storage device such as a main memory and an auxiliary storage device such as a hard disk. The functional blocks of the digital ink processing device 2 shown in FIG. 2 are realized by the CPU of the digital ink processing device 2 operating according to a program stored in the storage device 2a.

FIG. 2 is a functional block diagram of the digital ink processing device 2. As shown in the figure, the digital ink processing device 2 is functionally configured to include an input processing unit 10, a stroke data generation unit 20, a digital ink generation unit 30, and a digital ink reproduction unit 40. Among them, the digital ink generating unit 30 is configured to include a digital ink assembling unit 31, a mapping data generating unit 32, and an application order determining unit 33 as an internal configuration.

The input processing unit 10 extracts input sensor attributes ISA such as coordinate data (X, Y) and writing pressure data P from the input sensor data ISD supplied from the digitizer 3 via an interface such as USB or I2C, and the operating system operates. The event data ED, which is a format that can be used by other programs that operate in, is output. The input processing unit 10 is typically realized as a device driver corresponding to the digitizer 3 incorporated in the operating system operating on the digital ink processing apparatus 2.

Here, in addition to the point data PD including the coordinate data (X, Y) and the writing pressure data P, the information included in the event data ED identifies which part of the series of strokes the point data PD is. Event type identification information ETYPE is included. The values of the event type identification information ETYPE include a pen down state Pdown, a pen moved state Pmvd, a pen up state Pup, and the like. When the input processing unit 10 detects that an indicator such as the electronic pen 4 or a finger has come into contact (pen down) with the digitizer 3, it generates point data PD including coordinate data (X, Y) corresponding to the contact position. Event data ED in which the pen-down state Pdown is set as the value of the event type identification information ETYPE is generated. After that, while the electronic pen 4 and the indicator are slid on the digitizer 3, the input processing unit 10 sets the value of the event type identification information ETYPE together with the series of point data PD corresponding to the series of coordinate data (X, Y). The event data ED in which the value of the pen moved state Pmvd is set is continuously generated. Finally, when the input processing unit 10 detects that the electronic pen 4 has been lifted from the digitizer 3 (pen-up), the event data ED specifying that the value of the event type identification information ETYPE is the pen-up state Pup. To generate.

The stroke data generation unit 20 is a functional unit that receives supply of the event data ED from the input processing unit 10 and generates stroke data SD (first stroke data) including one or more point data PD. The stroke data generation unit 20 is typically realized by a program called a library or service executed by the CPU of the digital ink processing device 2. The stroke data generation unit 20 refers to the value of the event type identification information ETYPE of the event data ED supplied from the input processing unit 10, and from the event data ED indicating the pen-down state Pdown to the event data ED indicating the pen-up state Pup. One stroke data SD including a series of point data PD included in the event data ED between is generated. The stroke data generation unit 20 uses the value of the coordinate data (X, Y) included in the input sensor data ISD as the value of the coordinate data (X, Y) of the point data PD, as well as the input sensor data ISD. The value of new coordinate data (X, Y) obtained by performing smoothing processing such as weighted averaging or exponential smoothing or thinning processing on the included coordinate data (X, Y) value is used as the coordinate data of the point data PD. In the case of (X, Y), and in addition to the coordinate data (X, Y) included in the input sensor data ISD, an additional control point for determining the shape of an interpolation curve such as a Bezier curve is referred to as point data PD. There is a case.

FIG. 3 is a diagram for explaining the relationship between the point data PD and the stroke data SD. In the figure, the five broken line frames are the five stroke data SD (SD0, SD1, SD2, SD3, generated when the five alphabets "h", "e", "l", "l", and "o" are input. SD4) is shown.

Each of the stroke data SD0 to SD4 includes a series of point data PD indicated by white circles in the figure. The solid line between the white circles in the figure indicates that the point data PD indicated by the white circles is a series.

Here, in the stroke data SD0 corresponding to the alphabet “h”, the point data number n=26 point data PD0 starting from the point data PD0 having an index value of 0 and ending at PD25 having an index value of 25. PD25 is included. Further, the stroke data SD1 corresponding to the alphabet "e" includes the point data number n=15 point data PD0 to PD14 starting from PD0 having an index value of 0 and ending at PD14 having an index value of 14. The stroke data SD4 corresponding to the alphabet "o" includes the point data number n=9 point data PD0 to PD8 starting from PD0 having an index value of 0 and ending at PD8 having an index value of 8. As described above, the value of the point data number n of the point data PD included by the stroke data SD is different.

Note that OP shown in FIG. 3 indicates the origin coordinates of the coordinate system for the coordinate data (X, Y) included in the point data PD. Hereinafter, for convenience of description, the value of the coordinate data is defined such that the direction to the right is the direction in which the value of the X coordinate increases and the downward direction is the direction in which the value of the Y coordinate increases.

The stroke data generation unit 20 of the present embodiment generates the stroke data SD according to the description format of the <trace> element according to the format using InkML of Non-Patent Document 1 as the format of the stroke data SD.

FIG. 4 is a diagram showing the stroke data SD0 to SD4 of FIG. 3 generated according to the InkML format. FIG. 5 is a diagram in which only the stroke data SD1 corresponding to the alphabet "e" is extracted from the stroke data SD0 to SD4 corresponding to the five alphabets in FIG.

As shown in the examples of FIGS. 4 and 5, the stroke data SD is expressed as a <trace> element, and each point data PD0 to PD14 is delimited by a comma (,) existing at the end of each line in the drawings as a delimiter. It is generated by the format.

In each point data PD, each attribute data is divided with one or more half-width spaces as delimiters. In the present embodiment, the stroke data SD has a first attribute (coordinate data X), a second attribute (coordinate data Y), and a third attribute (writing pressure data P) which are input sensor attributes ISA. The three pieces of attribute data of are retained as the values of the original data.

The values of these three input sensor attributes ISA are arranged in each point data PD in the order of coordinate data X, coordinate data Y, and writing pressure data P. For example, regarding the first point data PD0 having the index value 0 in the stroke data Sd1 shown in FIG. 5, “199” on the left side is the coordinate data X, “306” is the coordinate data Y, and “1.0” is the coordinate data Y. It becomes the writing pressure data P.

Returning to FIG. The stroke data SD generated by the stroke data generation unit 20 is supplied to the digital ink assembly unit 31. The digital ink assembling unit 31 is configured to assemble the digital ink INKD based on the stroke data SD thus supplied and the one or more mapping data MD supplied from the application order determining unit 33.

FIG. 6 is a diagram illustrating the digital ink INKD assembled by the digital ink assembly unit 31. The example in the figure is an example in which the digital ink INKD is generated according to the InkML format.

The digital ink INKD is configured to include an XML declaration starting with “<?xml” and an <ink> element described between the line starting with “<ink... >” and the last line </ink>. To be done.

The <ink> element includes a definition block DEB (<definitions> element) and a stroke data description block SDB (<stroke data SD> element).

The definition block DEB includes a mapping data description block MDB and a drawing style data description block DDB.

The mapping data description block MDB is a block in which mapping data MD indicating a conversion rule of stroke data is described. As a conversion rule, the value of the input sensor attribute ISA included in the stroke data SD described in the stroke data description block SDB is used as the value of the data before conversion, and a new drawing such as a line width or shading is made from the value of the data before conversion. A conversion rule func for obtaining the value of the attribute of the attribute DA is described.

The drawing style data description block DDB is a block that describes a drawing style indicating a basic style when drawing the stroke data SD such as the shape of the pen tip.

The stroke data description block SDB is a block in which the stroke data SD is described. A plurality of stroke data SD such as the stroke data SD0 to SD4 shown in FIG. 4 are listed.

Returning to FIG. 2, the mapping data generation unit 32 is a functional unit that generates and outputs mapping data MD indicating a conversion rule for converting the input sensor attribute ISA included in the stroke data SD into the drawing attribute DA. The drawing attribute DA is configured to include either the line width value W or the grayscale value (transparency A). Further, the mapping data MD generated by the mapping data generating unit 32 includes range data rd (described later) indicating the applicable range of the conversion rule.

The content func of the conversion rule of the mapping data MD generated by the mapping data generation unit 32 is designated in advance by user setting.

FIG. 7 is a diagram showing various examples of the content func of the mapping data set by the user. FIG. 7A shows an example of a conversion rule in which the writing pressure value P is the value before the conversion of the input sensor attribute ISA and the value of the drawing attribute DA having the line width W is output as the value after the conversion. In the figure, the function indicated by func1 is a conversion rule in which the line width W is 10 times the writing pressure value P that takes a value between 0.0 and 1.0. In the figure, the function indicated by func2a is a conversion rule in which the line width W is a value five times the writing pressure value P that takes a value between 0.0 and 1.0. In the figure, the function denoted by func2b is a conversion rule in which the line width W is 20 times the writing pressure value P that takes a value between 0.0 and 1.0.

FIG. 7B shows a drawing attribute DA in which the speed V derived based on the coordinate data (X, Y) and the time T is the value before the conversion of the input sensor attribute ISA and the converted value is the transparency A. The example of the conversion rule which outputs the value of is shown. In the figure, the functions indicated by func3 and func3b indicate conversion rules in which the transparency monotonously increases as the speed V increases.

The conversion rule can be arbitrarily designated by the user, and as the function of the conversion rule of the mapping data MD, a function func2c that does not pass through the origin, a non-linear function func3b, or the like can be used.

Next, the mapping data MD generated by the mapping data generation unit 32 will be described in more detail with reference to FIG. FIG. 8 shows an example of the mapping data MD according to the InkML format. As shown in FIG. 8, the mapping data generation unit 32 according to this embodiment is configured to generate two mapping data MD1 and MD2.

First, the mapping data MD1 (first mapping data) will be described.

The fifth to sixth lines in FIG. 8 indicate that the mapping data MD1 is a conversion rule (first line) for converting the writing pressure data P (source=“P”) into the line width data W (target=“W”). Conversion rule). The 7th line shows that it is expressed using MathML described above. In the ninth to eleventh lines, the line width data W is generated by multiplying the writing pressure data P (the variable p representing the source) by the numerical value 10 (<timees/>). Shows the content of the conversion rule of func1. Since the application range of the conversion rule by this function func1 is the entire stroke data SD, it does not include the data of the application range of the conversion rule.

Next, the mapping data MD2 (second mapping data) will be described. The 19th to 20th lines in FIG. 8 indicate that the mapping data MD2 is a conversion rule (second line) for converting the writing pressure data P (source=“P”) into the line width data W (target=“W”). Conversion rule). The 23rd to 25th lines of the conversion rule of FIG. 7 indicate that the line width data W is generated by multiplying the writing pressure data P (variable p representing the source) by the numerical value 5 (<timees/>). The content func2a is shown. The "range" on the 18th line indicates the existence of range data rd (first range data) indicating the applicable range of the conversion rule by this function func2a and an example ""-2, -1"" of the range. ing. Here, "-2" on the left side indicates the start point of the range, and "-1" indicates the end point of the range.

Here, the description method of the range data rd will be described in detail. It is assumed that each point data PD in the stroke data SD has an index value starting from 0. The range data rd uses index value information indicating the index value of this point data PD to indicate the range of the stroke data. The index value information is specifically the index value itself or a modified index value obtained by modifying the index value according to a calculation rule using a remainder calculation.

The calculation rule is represented by the following formulas (1) and (2), for example. However, i is an index value before correction, j is a correction index value, n is the number n of point data of the point data PD in the stroke data SD (for example, for the stroke data SD1 shown in FIG. =15). Also, mod(a,b) is a function for obtaining a remainder obtained when a is divided by b. As understood from the equation (1), the modified index value j is an integer congruent with the corresponding index value i when the number of point data n is modulo.

The modified index value j calculated by the equation (1) is “−1” or “−2” in order from the last index value (modified index value j of the n-th point data PD) regardless of the total number n of the point data PD. “−3”... Negative value that decreases by one. On the other hand, since all the index values are positive values, it is determined whether the index value information is the index value or the modified index value by determining whether the index value information included in the range data rd is positive or negative. You can

9A to 9D are diagrams illustrating four examples of the range data rd and the range (end portion) of the stroke in the stroke data SD0, the stroke data SD1, and the stroke data SD4 shown in each example. The broken line frame in the figure is the range of strokes corresponding to the range data rd in each example.

FIG. 9A is a diagram showing a range of strokes when range=“-2,−1” is designated as an example of the range data rd. For the stroke data SD0, SD1, and SD4 having different point data number n, the expression using the modified index value is used, and the same expression is used for the second stroke from the end, which is the last end of any stroke data. It is possible to indicate the range from the point data PD to the last point data PD.

FIG. 9B is a diagram showing a range of strokes when range=“0, 1” is designated as an example of the range data rd. With respect to different stroke data SD0, SD1, and SD4 having different point data number n, the range of a portion from the first point data PD to the second point data PD, which is the first end portion in the same expression, can be shown. It will be possible.

FIG. 9C is a diagram showing a range of strokes when range=“-1,0” is specified as an example of the range data rd. With respect to the stroke data SD0, SD1, and SD4 having different point data number n, it is possible to represent the range including two end portions by one expression. This is an effect obtained by handling the point data PD included in the stroke data SD with the index value and the modified index value. This point is particularly useful when special treatment is required for both ends of the stroke.

FIG. 9D shows the range of strokes when range=“1, −2” is specified as an example of the range data rd.

As described above, the following effects can be obtained by using the index value information including the modified index value j using the remainder value in the description of the range data.

First, regardless of the total number n of the point data PD of each of the stroke data SD0 to SD4, the range of the end portion of all the stroke data SD0 to SD4 can be designated. This means that it is not necessary to refer to the stroke data SD in advance when generating the mapping data MD when designating the end of the stroke. Therefore, even an application in which new stroke data SD is continuously generated even after the mapping data is generated (for example, an application that shares a drawing area in real time) is independent of the stroke data SD in advance. It becomes possible to generate the mapping data MD.

Further, by using the modified index value calculated by using the remainder, the stroke data SD is divided into the end point data PDn to which the modified index value -1 is given and the end point data PD0 to which the index value 0 is given. Can be treated as continuous circular data. As a result, it is possible to represent the deformation of both ends of the stroke data in which the line width and the shade of the ink data are largely changed, by one range data rd.

When it is necessary to specify the index of the point data PD on the way for each stroke data SD, for example, when the point data PD located at the center is specified, as shown by the broken line in FIG. Then, the stroke data SD may be supplied to the mapping data generation unit 32. By doing so, the mapping data generation unit 32 can determine the index value of the point data PD that is the target of the conversion rule and include it in the corresponding range data.

Returning to FIG. 2, the one or more mapping data MD generated by the mapping data generation unit 32 is supplied to the application order determination unit 33. The application order determination unit 33 is a functional unit that determines the application order of a plurality of mapping data MD when supplied from the mapping data generation unit 32.

For example, in the example of FIG. 8, if the mapping data MD1 is applied after the mapping data MD2 is applied, the mapping data MD1 is applied to the point data PD0 to PDn of all index values included in the stroke data SD0 to SD5. Therefore, the application result of the mapping data MD2 is canceled. On the other hand, if the mapping data MD2 is applied after the mapping data MD1 is applied, after the line width data W is generated for the point data PD0 to PDn of all index values included in the stroke data SD by the mapping data MD1. , The line width data W corresponding to the point data PD of a part (first end, both ends, etc.) of the index value so as to overwrite the line width data W can be corrected by the mapping data MD2 ( (It will be described later with reference to FIG. 11).

As described above, when one digital ink INKD includes a plurality of mapping data MD, the result varies depending on the application order, and thus the application order needs to be specified in advance. More specifically, the application order determination unit 33 determines that there are two mapping data MD configured to convert the same attribute data into the same attribute data, and these range data have an overlap. For example, the application order of the mapping data MD may be determined according to a user setting such as overwriting the mapping data MD1 for the entire stroke data SD with the mapping data MD2 for a part of the stroke data SD. By doing so, it becomes possible to obtain the attribute data (line width data W in the example of FIG. 8) as intended by the user.

The digital ink assembling section 31 arranges the stroke data SD supplied from the stroke data generating section 20 in the stroke data description block SDB shown in FIG.

Further, the digital ink assembling unit 31 arranges one or a plurality of mapping data MD supplied from the application order determining unit 33 in the mapping data description block MDB shown in FIG. In this case, when a plurality of mapping data MD is supplied from the application order determination unit 33, the digital ink assembling unit 31 arranges the plurality of mapping data MD based on the application order determined by the application order determination unit 33. Determine the order. The specific arrangement order depends on the specifications of the digital ink reproducing unit 40 to be described later, but the mapping data MD to be applied first (the mapping data MD1 in the example of FIG. 8) and the mapping data MD to be applied later (FIG. In the example of No. 8, the mapping data MD2) is arranged so that when the reproducing unit 30 interprets the digital ink INKD, the mapping data MD1, MD2, and MDm are sequentially arranged from the beginning of the data. By applying the conversion rule in, the application order at the time of reproduction can be made the same order as the application order determined by the application order determination unit 33.

The digital ink assembling unit 31 also adds drawing style data DD that describes a style relating to the format of the stroke data SD to the setting data description block DDB.

FIG. 10 shows, as an example of the drawing style data DD, drawing style information DD1 indicating the style of the brush set in the application when the stroke data SD was generated.

In this way, the digital ink assembling unit 31 assembles the digital ink INKD according to the InkML format by combining the stroke data SD, the mapping data MD, and the drawing style data DD as an XML document.

The digital ink assembling unit 31 converts the digital ink INKD thus assembled into a byte string according to the XML file encoding method (UTF8 or the like) declared at the beginning of the line in FIG. 6 to form the XML file as the storage device 2a in FIG. Output to network media etc. In this way, the digital ink processing device 2 of the present embodiment outputs the digital ink INKD.

<Digital ink recycling process>
Next, a process of reproducing digital ink will be described.

The digital ink reproducing section 40 shown in FIG. 2 is a functional section of the digital ink processing device 2 which plays a role of reproducing the digital ink INKD generated by the digital ink generating section 30.

In the process performed by the digital ink reproducing unit 40, the stroke data SD (first stroke data) and the mapping data MD are extracted from the digital ink INKD, and the input sensor attribute ISA included in the extracted stroke data SD is extracted. By applying the mapping data MD described above, a process of generating modified stroke data SD (second stroke data) including the value of the drawing attribute DA is included.

Hereinafter, this digital ink reproduction process will be specifically described with reference to FIG. In the following, it is assumed that the digital ink INKD to be processed includes the mapping data description block MDB shown in FIG.

FIG. 11A shows the stroke data SD1 extracted from the digital ink INKD by the digital ink reproducing unit 40. The stroke data SD1 includes, as the input sensor attribute ISA, the three attribute data of the first attribute data X indicating the X coordinate, the second attribute data Y indicating the Y coordinate, and the third attribute data P indicating the writing pressure value. Contains.

The digital ink reproducing unit 40 sequentially extracts the mapping data MD1 and MD2 shown in FIG. 8 from the mapping data description block MDB in the digital ink INKD shown in FIG.

Of the two extracted mapping data MD1 and MD2, the digital ink reproducing unit 40 first applies the first extracted mapping data MD1 to the stroke data SD1.

As a result, as shown in FIG. 11B, the stroke data SD1 after applying the mapping data MD1 is obtained. The stroke data SD after applying MD1 includes the value of the line width W which is a new drawing attribute DA as the fourth attribute data in addition to the first to third attribute data X, Y, P before conversion.

Here, the mapping data MD1 shown in FIG. 8 has no explicit description of the range data rd. When no explicit range is specified in this way, the digital ink reproducing unit 40 maps all strokes (point data PD of all indexes included in the stroke data SD) according to the rule of the <mappping> element in the past. The processing is performed assuming that the data MD1 is applied. As a result, with respect to the mapping data MD1 shown in FIG. 8, the conversion rule is applied to all parts of the stroke data SD. In FIG. 11, a broken line frame indicated by rd1 indicates a range of strokes to which the conversion rule of the mapping data MD1 is applied in the stroke data SD. Further, the value in the broken line frame indicated by rd1 indicates the value of the line width W obtained by the mapping data MD1 having the content of the conversion rule of func1 (10 times) in FIG.

As a result of the processing performed by the digital ink reproducing unit 40 according to the conversion rule func1 in the mapping data MD1 of FIG. 8, as shown in FIG. 11B, in the stroke data SD after the mapping data MD1 is applied, each point data PD The value of the fourth attribute data (line width W) is derived as 10 times the value of the writing pressure data P.

Next, the digital ink reproducing unit 40 applies the mapping data MD2 shown in FIG. 8 to the range (part) of the stroke data SD indicated by the range data rd described therein. Note that the range data rd shown in FIG. 8 is "-2, -1", but in FIG. 11C, the value of the range data rd is "-1, -1". An example is shown. The broken line frame indicated by rd2 in FIG. 11C indicates the range to which the mapping data MD2 is applied when the value of the range data rd is "-1, -1". The value in the broken line frame indicated by rd2 indicates the value of the drawing attribute DA (fourth attribute data) obtained from the mapping data MD2 having func2a (5 times) in FIG. 7 as the content of the conversion rule.

As to the point data PD14, the value "3" after applying the mapping data MD2 shown in FIG. 11C is compared with the value "6" after applying the mapping data MD1 shown in FIG. In the stroke data SD after the application of the data MD2, the value of the line width W, which is the fourth attribute data of the drawing attribute DA of the point data PD14 of a part (last part) of the stroke, is partially reduced. This is to convert the writing pressure data P into line width data W by multiplying the writing pressure data P by 5 in the mapping data MD2, and the last point data whose applicable range is indicated by an index value -1. This corresponds to the fact that only PD is described.

As described above, the digital ink reproducing unit 40 that has generated the stroke data SD after conversion by deriving the drawing attribute DA from the value of the input sensor attribute ISA is based on other information such as the above-described drawing style DD. An image signal is generated by applying an existing drawing processing method.

FIG. 12 is a schematic view of an example of the drawing processing described in Non-Patent Document 6 as an example of the existing drawing processing method. In the figure, white circles PD0 to PD14 indicate 15 point data PD included in the stroke data SD1. The numbers in the white circles indicate the value of the fourth attribute W for each of the point data PD0 to PD15. In the figure, the radius of each white circle is described as a value proportional to the value of the fourth attribute W. For example, the point data PD0 has a diameter of 10 which is the value of the fourth attribute W, and the point data PD14 has a diameter of 3 which is the value of the fourth attribute (line width data W) obtained from the mapping data MD2. Listed in circles.

The digital ink reproducing unit 40 derives two envelopes (inner envelope IE and outer envelope OE) that are in contact with each circle of the point data PD0 to PD14. Then, the obtained two envelopes IE and OE are set as the contour of the shape of the stroke data SD1. For example, in this way, the digital ink reproducing unit 40 can generate an image signal in which the line width proportional to the line width data W is used as the line width of the stroke data. The method of drawing the converted stroke data SD is not limited to this, and an existing drawing method may be used.

The image signal generated by the digital ink reproducing unit 40 is output to the display 5, as shown in FIG. As a result, the stroke data SD corrected by the mapping data MD2 of the stroke data SD0 to SD5 is displayed in a form visible to the user.

13A to 13D show image examples of the stroke data SD (stroke data SD0 to SD4) converted into image signals as described above.

FIG. 13A is stroke data obtained by applying the conversion rule func1 to the stroke data SD0 to SD4 shown in FIG. 3 to obtain the line width W by multiplying the writing pressure P by 10 to all parts of the stroke data. The image signal reproduced from SD is shown.

In FIG. 13B, with respect to the stroke data SD0 to SD4 shown in FIG. 3, (1) a conversion rule func1 for multiplying the writing pressure P by 10 to obtain a line width W is applied to all parts of the stroke data. (2) An image signal reproduced from the stroke data SD obtained by applying the conversion rule func2a in which the writing pressure P is multiplied by 5 to obtain the line width W to the end portion indicated by the broken line frame in the drawing. Is shown.

In FIG. 13C, (1) a conversion rule func1 for multiplying the writing pressure P by 10 to obtain a line width W is applied to all parts of the stroke data for the stroke data SD0 to SD4 shown in FIG. (2) Stroke data obtained by applying the conversion rule func2a in which the writing pressure P is multiplied by 5 to obtain the line width W to both the end and the end of the stroke indicated by the broken line frame in the figure. The image signal reproduced from SD is shown.

In FIG. 13D, with respect to the stroke data SD0 to SD4 shown in FIG. 3, (1) the conversion rule func1 that obtains the line width W by multiplying the writing pressure P by 10 is applied to all parts of the stroke data. (2) Stroke data obtained by applying the conversion rule func2b, in which the writing pressure P is multiplied by 20 to obtain the line width W, to both ends of the end and the tip shown by the broken line frame of the stroke. The image signal reproduced from SD is shown.

As described above, according to the input system 1 (particularly, the digital ink generation unit 30) according to the present embodiment, the line width W, the transparency A, etc. can be obtained without losing the data indicating the input sensor attribute ISA such as the writing pressure data. Ink data INKD describing a conversion rule for deriving the value of the drawing attribute DA of the stroke data can be generated.

This allows the digital ink INKD to indicate from which value of the input sensor attribute ISA the value of the drawing attribute DA (the line width W and the transparency A) is derived. The correspondence between the writing pressure data P included in the ink INKD and the line width W is collectively changed, or the writing pressure data stored in the digital ink INKD (although it is not directly used for drawing) It is also possible to use P as a comparison parameter for signature authentication.

Further, according to the method of generating the digital ink INKD according to the present embodiment, the digital ink INKD that describes the rule for applying the conversion rule in the mapping data MD to a partial range of the stroke data SD is generated. It will be possible. Therefore, as in the above-described example, it is possible to configure the conversion rule to be applied only to the start point and the end point of the stroke data SD, and as a result, as shown in FIGS. It is possible to generate a digital ink INKD having Further, in order to express the end point of the range data by using the index value and the modified index value obtained by using the remainder calculation, the conversion rule that specifies the end part or both the end part and the end part is defined as the stroke data. It is possible to obtain SD in advance before it is generated.

(Embodiment 2)
Next, the input system 1 according to the second embodiment of the present invention will be described. The system configuration of the input system 1 according to the present embodiment and the functional block of the digital ink processing device 2 are the same as those according to the first embodiment shown in FIGS. 1 and 2.

The input system 1 according to the present embodiment is the first embodiment in terms of the contents of the stroke data SD output from the stroke data generation unit 20 and the internal processing of the mapping data generation unit 32 and the digital ink reproduction unit 40. Since it is different from the input system 1 according to the embodiment, the same components as those in the first embodiment are designated by the same reference numerals and the description thereof will be omitted. In the following, focusing on the difference from the first embodiment, explain.

The stroke data generation unit 20 according to the present embodiment generates stroke data SD including three types of input sensor attributes ISA of coordinate data X, coordinate data Y, and time data T. FIG. 14 shows stroke data SD5 including ten point data PD0 to PD9 as an example of the stroke data SD generated by the stroke data generation unit 20 according to the present embodiment.

As shown in the example of FIG. 14, also in the present embodiment, it is assumed that the stroke data SD is generated in the InkML format, and specifically, the format in which each point data PD is separated by a comma (,). Is generated by. In addition, in each point data PD, each attribute data is separated by a half-width space. Arrangement of each attribute data in the point data PD is in the order of coordinate data X, coordinate data Y, and time data T. For example, regarding the second point data PD1 in the above example, “8” on the left side is coordinate data X, “0” in the center is coordinate data Y, and the numerical value 16 on the right side of “'16” on the right side is time. It becomes the data T. The time data T of each point data PD is expressed by the elapsed time from the time corresponding to the first index value being 0 milliseconds.

For simplicity of explanation, the example of FIG. 14 shows an example in which coordinate data (X, Y) is obtained at a constant interval of 16 milliseconds. Also for the coordinate data (X, Y), the Y coordinate is fixed at 0, and is obtained when the electronic pen 4 is moved only in the X direction at a constant acceleration (the speed at which the speed increases by 8 every 16 milliseconds). The example of the coordinate set is shown.

The mapping data generation unit 32 according to the present embodiment uses the first input sensor attribute ISA of the first point data PDi (for example, coordinate data (X, Y)) of the plurality of point data PD included in one stroke data SD. Alternatively, it is the transparency data A based on the value of the time data T) and the value of the first input sensor attribute ISA included in the second point data PDi+1 having an index value different from that of the first point data PDi. It is configured to generate mapping data MD including a conversion rule for obtaining the drawing attribute DA.

The mapping data MD generated by the mapping data generation unit 32 according to this embodiment will be described in more detail with reference to FIG.

FIG. 15 is a diagram showing the mapping data MD3 generated by the mapping data generation unit 32 according to this embodiment.

The third line to the seventh line are portions that define the input sensor attribute (X, Y, T) that is the conversion source and the drawing attribute (transparency A) obtained by the conversion.

The 11th line to the 37th line are portions showing the conversion rules included in the mapping data MD3. Specifically, the conversion rule that the transparency data A _i corresponding to the i-th index value is generated is described by the following expressions (2) and (3). Here, X _i , X _i-1 , Y _i , Y _i-1 , T _i , and T _i-1 in the equation (3) are coordinate data X and i-1 corresponding to the i-th index value, respectively. The coordinate data X corresponding to the i-th index value, the coordinate data Y corresponding to the i-th index value, the coordinate data Y corresponding to the (i-1)th index value, and the time data T,i corresponding to the i-th index value. The time data T corresponding to the -1st index value is shown.

The feature of the conversion rules by the above formulas (2) and (3) is that when generating the transparency data A _i corresponding to the i-th index value, the attribute data corresponding to the index value other than the i-th index value is referred to. There is a point. Specifically, the attribute data corresponding to the immediately preceding index value i−1 is referenced, and V _i obtained by Expression (3) is changed from the position corresponding to the index value i−1 to the index value i. The moving speed of the electronic pen 4 until it moves to the corresponding position is shown. According to the conversion rule by the equation (2), a function (func3 shown in FIG. 7B) is set such that the transparency increases as the moving speed V _i increases.

Here, the correspondence relationship between the mapping data MD3 shown in FIG. 15 and the equations (2) and (3) will be described. First, in FIG. 15, line 22 indicated by dx "'x", line 27 indicated by dy''y', the line 32 indicated by dt "'t", respectively, _{"X i -X i-1"} means _{"Y i -Y i-1", "T i -T i-1".}

A portion surrounded by a broken line frame A in FIG. 15 indicates a value obtained by squaring “X _i −X _i−1 ”, which is the displacement amount of X. A portion surrounded by a broken line frame B shows a value obtained by squaring “Y _i −Y _i−1 ”, which is the displacement amount of Y. A portion surrounded by a broken line frame C in the drawing shows the amount of displacement in the two-dimensional plane corresponding to the numerator on the right side of Expression (3). The part surrounded by the broken line frame D corresponds to the entire right side of Expression (3), and indicates the speed of the section of time “T _i −T _i−1 ”. The part surrounded by the broken line frame E corresponds to the entire right side “20·V _i ”of the right side of Expression (2). As described above, the mapping data MD3 shown in FIG. 14 describes the conversion rule from the input sensor attribute ISA to the drawing attribute DA (transparency A) represented by the equations (2) and (3).

In this way, the digital ink processing device 2 of the present embodiment generates and outputs the digital ink INKD including the mapping data MD3.

Next, the digital ink reproducing process according to the present embodiment will be described with reference to FIG.

First, the digital ink data reproducing unit 30 extracts the stroke data SD5 and the mapping data MD3 from the digital ink INKD.

FIG. 16A shows the stroke data SD5 of the conversion source extracted from the digital ink INKD by the digital ink reproducing unit 40. As described with reference to FIG. 14, the stroke data SD5 includes the first attribute data X indicating the X coordinate, the second attribute data Y indicating the Y coordinate, and the third attribute data T indicating the time information as the input sensor attribute ISA. It contains three data.

Next, the digital ink reproducing unit 40 that has acquired the digital ink INKD applies the extracted mapping data MD3 to the extracted stroke data SD5. FIG. 16B shows stroke data SD5 obtained by applying the mapping data MD3. The stroke data SD5 at this time point includes the transparency data A having the fourth attribute (drawing attribute DA) derived from the input sensor attribute ISA. In addition, since the transparency data A ₀ corresponding to the first index value cannot be obtained by the above formulas (2) and (3), the digital ink reproducing unit 40 conveniently stores the value of the transparency data A ₁ for convenience. 10 is set as the value 10 of the transparency data A ₀ .

FIG. 16C shows stroke data SD obtained when the conversion rule func3 is applied to not the entire stroke but the range data rd=“−3,−1”. In this example, only the three transparency data A from the end in the stroke are obtained, and the other portions such as the leading portion are set to the default transparency value of 0 when no value is obtained.

As described above, in the digital ink data reproducing process according to the present embodiment, the stroke data SD including the transparency A obtained by the conversion rule can be obtained.

As described above, the digital ink reproducing unit 40 that has generated the stroke data SD after conversion by deriving the drawing attribute DA from the value of the input sensor attribute ISA is based on other information such as the above-described drawing style DD. An image signal is generated by applying an existing drawing processing method.

FIG. 17 is a diagram for explaining the stroke data SD according to the present embodiment.

The uppermost row A of FIG. 17 shows the positional relationship of the 10 pieces of coordinate data (X, Y) of the point data PD0 to PD9 included in the stroke data SD5 shown in FIG.

In the middle part B of FIG. 17, the stroke data SD5 obtained by expressing each point data PD0 to PD9 by a black circle and setting the value of the transparency A shown in FIG. It is an image figure of the image signal generated based on. By setting the transparency A to increase as the displacement amount per unit time or the moving speed V increases, it is possible to reproduce the state in which the amount of ink absorbed by the paper per unit time decreases, and to reproduce a more natural stroke expression. it can.

In the lower part C of FIG. 17, stroke data SD5 obtained by expressing each point data PD0 to PD9 by a black circle and setting the value of the transparency A shown in FIG. It is an image figure of the image signal generated based on. By partially applying the conversion rule func3 only to the range of the end part of the stroke, it becomes possible to specify that an expression imagining the accelerated movement of the human hand, the payment of kanji, etc., is reproduced. ..

FIG. 18 is another diagram for explaining the effect of the conversion rule in which the transparency A increases according to the speed V. When data such as a felt-tip pen is applied as the brush type set in the drawing style information DD1 (see FIGS. 6 and 10), the stroke data SD5 shown in FIG. 17 moves from the left side to the right side in the figure. As a result, an image signal in which the transparency A increases as the moving speed (speed) of the indicator increases is shown.

As described above, according to the digital ink processing apparatus 2 of the present embodiment, the conversion for obtaining the drawing attribute DA by inputting the value of the input sensor attribute ISA included in the two or more point data PD having different index values. The mapping data MD defining the relationship can be generated. Thus, for example, even if the ink is digital ink generated using an input sensor that cannot output the input sensor attribute ISA such as the writing pressure data P, the drawing attribute DA such as the line width W and the transparency A can be derived. And the type of the original data used to give the transparency A and the line width W (whether the writing pressure data was included or the data derived from the speed, etc.) can be recorded. it can.

Further, in deriving the drawing attribute DA such as the transparency A and the line width W, a conversion rule based on a differential value, an integrated value, or a statistical value such as an arithmetic mean of the same input sensor attribute ISA (coordinate value) is described. It will be possible. For example, it becomes possible to describe a conversion rule in which the transparency A increases as the moving speed increases.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and the present invention can be implemented in various modes without departing from the scope of the invention. Of course.

For example, it is possible to combine the first embodiment and the second embodiment to obtain a digital ink having a high expression capability with respect to both thickness and shade. In this case, each point data PD forming the stroke data SD includes both the writing pressure data P and the time data T, and the mapping data for converting the writing pressure data P into the line width data W in the digital ink INKD. Both MD (first embodiment) and mapping data MD (second embodiment) for obtaining the transparency data A from the writing speed may be included.

The conversion rule applied to the range specified by the range data in the first embodiment does not have to be for deriving the drawing attribute DA such as the line width W and the transparency A from the input sensor attribute ISA. It may be used when it is desired to deform the geometric shape by using the conventional affine transformation or the like for a part of the stroke.

Further, in the second embodiment, the attribute obtained by converting the statistical value of the same input sensor attribute ISA is not limited to the drawing attribute DD such as the line width W and the transparency A. The coordinate data included in the stroke data SD may be used as the original data, and a conversion rule such as a weighted average may be applied to obtain the coordinate data of the point data PD used in actual drawing.

It should be noted that the present invention can be regarded as an invention of a method of sequentially executing the processes of the stroke data generating unit 20 and the digital ink generating unit 30 using a computer, and is capable of executing these processes. It goes without saying that the invention can be regarded as an invention of a computer program that describes the program.

1 Input System 2 Digital Ink Processing Device 2a Storage Device 3 Digitizer 3a Sensor 4 Electronic Pen 5 Display 10 Input Processing Unit 20 Stroke Data Generation Unit 30 Digital Ink Generation Unit 31 Digital Ink Assembly Unit 32 Mapping Data Generation Unit 33 Application Order Determination Unit 40 Digital ink reproduction section

Claims (23)

A digital ink file reproducing apparatus for reproducing a digital ink file,
Brush pressure or a digital ink file stored in the storage unit values and the brush pressure or coordinates contained in the digital ink file with conversion rule for converting the coordinate values to the value of the line width or transparency the First extracting means for extracting a value of the writing pressure or the coordinates;
Second extracting means for extracting the transformation rules contained in the digital ink files stored in the storage unit,
Based on the conversion rule that has been extracted by said second extraction means, the brush pressure or extracted by the first extracting means and converting means for converting the coordinate values to the value of the line width or transparency,
Device for reproducing digital ink files . The data format of the digital ink file is an InkML format data format,
The conversion rule is described using a mapping element defined by the InkML format.
The digital ink file reproducing device according to claim 1. The conversion rule is a conversion rule in which the transparency value increases as the moving speed of the indicator derived based on the coordinate value increases.
The digital ink file reproducing device according to claim 1. The conversion rule is a conversion rule that can be set by the user,
The digital ink file reproducing device according to claim 1. The digital ink file includes range data indicating a range to which the conversion rule is applied,
The digital ink file reproducing device according to claim 1. The digital ink file further includes stroke data including one or more point data including the coordinate values,
In the digital ink file , a range to which the conversion rule is applied is index value information indicating an index value of point data indicating a start point of the range and index value information indicating an index value of point data indicating an end point of the range. Including range data indicated by
The digital ink file reproducing device according to claim 1. The index value information is an integer congruent with the index value modulo the index value, or the total number of the point data included in the stroke data,
The digital ink file reproducing device according to claim 6. The index value information is designated by a negative integer when the range data indicates the end of the stroke.
The digital ink file reproducing device according to claim 7. When the range data indicates both end portions of the stroke and the end portion, the index value information corresponding to the start point of the range is designated using a negative integer and corresponds to the end point of the range. The index value information is specified using a positive integer,
The digital ink file reproducing device according to claim 8. The digital ink file includes range data indicating a leading portion and/or a trailing portion of a stroke,
The conversion rule is a rule that gives a conversion rule different from the other parts of the stroke to the leading end and/or the trailing end of the stroke,
The digital ink file reproducing device according to claim 1. The conversion rule is a conversion rule for deriving a line width value from the writing pressure value with respect to the front end portion and/or the end portion of the stroke. It is a conversion rule that is converted so that the line width is larger than the applied conversion rule.
The digital ink file reproducing device according to claim 10. The conversion rule is a conversion rule for deriving the transparency based on the value of the coordinate, so that the transparency is larger for the leading end portion and/or the trailing end portion of the stroke than for other portions of the stroke. Is the conversion rule to be converted,
The digital ink file reproducing device according to claim 10. The digital ink file includes first mapping data including the conversion rule and first range data indicating a range to which the conversion rule is applied, a second conversion rule different from the conversion rule, and the second conversion rule. The second mapping data including the second range data indicating the range to which the second conversion rule is applied,
The digital ink file is based on the application order of the first mapping data and the second mapping data when the range indicated by the first range data and the range indicated by the second range data overlap each other. , A digital ink file in which the arrangement order of the first mapping data and the second mapping data in the digital ink file is determined.
The digital ink file reproducing device according to claim 1. A digital ink file reproducing method for reproducing digital ink files, a digital ink file reproducing method executed by a computer,
Brush pressure or a digital ink file stored in the storage unit values and the brush pressure or coordinates contained in the digital ink file with conversion rule for converting the coordinate values to the value of the line width or transparency the Extract the writing pressure or coordinate value,
Extracts the conversion rule contained in the digital ink files stored in the storage unit,
Based on the extracted conversion rule, converting the value of the extracted writing pressure or coordinates to the value of the line width or transparency,
How to play digital ink file . The data format of the digital ink file is an InkML format data format,
The conversion rule is described using a ma-pping element defined by the InkML format.
The digital ink file reproducing method according to claim 14. The conversion rule is a conversion rule in which the transparency value increases as the moving speed of the indicator derived based on the coordinate value increases.
The digital ink file reproducing method according to claim 14. The conversion rule is a conversion rule that can be set by the user,
The digital ink file reproducing method according to claim 14. The digital ink file includes range data indicating a range to which the conversion rule is applied,
The method of reproducing a digital ink file according to claim 14. A computer that plays digital ink files
Brush pressure or a digital ink file stored in the storage unit values and the brush pressure or coordinates contained in the digital ink file with conversion rule for converting the coordinate values to the value of the line width or transparency the First extraction means for extracting the value of the writing pressure or the coordinates,
Second extracting means for extracting the transformation rules contained in the digital ink files stored in the storage unit and,
The second based on the conversion rule that has been extracted by the extraction means, the first said brush pressure or extracted by the extracting means is converting means for converting the coordinate values to the value of the line width or transparency,
Program to function as. The data format of the digital ink file is an InkML format data format,
The conversion rule is described using a mapping element defined by the InkML format.
The program according to claim 19. The conversion rule is a conversion rule in which the transparency value increases as the moving speed of the indicator derived based on the coordinate value increases.
The program according to claim 19. The conversion rule is a conversion rule that can be set by the user,
The program according to claim 19. The digital ink file includes range data indicating a range to which the conversion rule is applied,
The program according to claim 19.

Images