JP2014110061A - System and data providing method and electronic equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve a system capable of sharing handwritten information.SOLUTION: The system includes: reception means; control means; and transmission means. The reception means receives a plurality of stroke data corresponding to a plurality of strokes handwritten by a plurality of terminals on a first content from the plurality of terminals. The control means stores the plurality of stroke data in association with the identifiers of the transmission source terminals of the stroke data in a storage medium. The transmission means transmits, to a first terminal among the plurality of terminals, one or more first stroke data among the plurality of stroke data associated with the identifiers of the other terminals other than the first terminal.

Description

  Embodiments described herein relate generally to a technique for processing handwritten data.

  In recent years, various electronic devices such as tablets, PDAs, and smartphones have been developed. Many electronic devices of this type are equipped with a touch screen display to facilitate an input operation by a user.

  The user can instruct the electronic device to execute a function associated with the menu or object by touching the menu or object displayed on the touch screen display with a finger or the like.

  However, many of the existing electronic devices equipped with touch screen displays are consumer products that pursue operability for images, music, and other media data. For use in business scenes such as conferences, business negotiations, and product development It may not always be suitable. For this reason, paper notebooks are still widely used in business scenes.

JP 2011-103035 A

  In a business scene, an electronic device may be expected to function as a digital tool useful for collaborative work such as a conference. Therefore, it is necessary to realize a new technology that can easily share handwritten information.

  An object of one embodiment of the present invention is to provide a system, a data providing method, and an electronic apparatus that can share handwritten information.

  According to the embodiment, the system includes a reception unit, a control unit, and a transmission unit. The receiving means receives a plurality of stroke data corresponding to a plurality of strokes handwritten on the content in any of the plurality of terminals from any of the plurality of terminals. The control means stores each of the plurality of stroke data in a storage medium in association with an identifier of a terminal that is the transmission source of the stroke data and an identifier of content in which the stroke data is handwritten. The transmission means transmits one or more first stroke data to the first terminal after a request from the first terminal in the plurality of terminals. The one or more first stroke data is associated with both an identifier of a terminal other than the first terminal and an identifier of a first content specified by the request, and the first terminal Stroke data not yet transmitted. When the first content is opened in the first terminal, the transmission means transmits a plurality of second stroke data to the first terminal. The plurality of second stroke data includes the first content in a stroke data group handwritten in any of the plurality of terminals before the first content is opened in the first terminal. Is a stroke data group associated with the identifier.

FIG. 2 is a perspective view illustrating an appearance of the electronic apparatus according to the embodiment. The figure which shows the flow of the data between the system which concerns on embodiment, and each terminal. FIG. 3 is a diagram illustrating an example of a display screen of the electronic device in FIG. 1. The figure which shows the example of the handwritten document handwritten on the touchscreen display of the electronic device of FIG. The figure for demonstrating the time series information (handwritten page data) corresponding to the handwritten document of FIG. 4 preserve | saved at a storage medium by the electronic device of FIG. FIG. 2 is a block diagram showing a system configuration of the electronic apparatus of FIG. 1. The block diagram which shows the function structure of the handwritten note application program performed by the electronic device of FIG. The figure which shows the stroke information management table preserve | saved at the database of the server system of FIG. The figure which shows the operation | movement which delivers the stroke data received from the transmission side terminal performed by the system of FIG. 2 to a reception side terminal. The figure which shows the operation | movement which distributes each stroke data received from two transmission side terminals performed by the system of FIG. 2 to a reception side terminal. The figure which shows the operation | movement which exchanges stroke data between the some terminals performed by the system of FIG. The block diagram which shows the structure of the system of FIG. The flowchart which shows the procedure of the stroke delivery process performed by the system of FIG. 5 is a flowchart showing a procedure of handwritten information sharing processing executed by the electronic apparatus of FIG. 1.

Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is a perspective view illustrating an external appearance of an electronic apparatus according to an embodiment. This electronic device is, for example, a pen-based portable electronic device that can be handwritten with a pen or a finger. This electronic device can be realized as a tablet computer, a notebook personal computer, a smartphone, a PDA, or the like. Below, the case where this electronic device is implement | achieved as the tablet computer 10 is assumed. The tablet computer 10 is a portable electronic device also called a tablet or a straight computer, and includes a main body 11 and a touch screen display 17 as shown in FIG. The touch screen display 17 is attached to be superposed on the upper surface of the main body 11.

  The main body 11 has a thin box-shaped housing. The touch screen display 17 incorporates a flat panel display and a sensor configured to detect a contact position of a pen or a finger on the screen of the flat panel display. The flat panel display may be, for example, a liquid crystal display (LCD). As the sensor, for example, a capacitive touch panel, an electromagnetic induction digitizer, or the like can be used. In the following, it is assumed that two types of sensors, a digitizer and a touch panel, are incorporated in the touch screen display 17.

  Each of the digitizer and the touch panel touch is provided so as to cover the screen of the flat panel display. The touch screen display 17 can detect not only a touch operation on a screen using a finger but also a touch operation on a screen using the pen 100. The pen 100 may be an electromagnetic induction pen, for example. The user can perform a handwriting input operation on the touch screen display 17 using an external object (the pen 100 or a finger). During the handwriting input operation, the trajectory of the movement of the external object (the pen 100 or the finger) on the screen, that is, the stroke trajectory (handwriting) handwritten by the handwriting input operation is drawn in real time. Displayed on the screen. The trajectory of the movement of the external object while the external object is in contact with the screen corresponds to one stroke. A set of many strokes corresponding to handwritten characters or figures, that is, a set of many trajectories (handwriting) constitutes a handwritten document.

  In the present embodiment, the handwritten document is stored in the storage medium as time series information indicating the order relationship between the coordinate sequence of the trajectory of each stroke and the stroke, instead of image data. The details of this time series information will be described later with reference to FIG. 5. This time series information indicates the order in which a plurality of strokes are handwritten, and includes a plurality of stroke data respectively corresponding to the plurality of strokes. In other words, this time-series information means a set of time-series stroke data respectively corresponding to a plurality of strokes. Each stroke data corresponds to a certain stroke, and includes a coordinate data series (time series coordinates) corresponding to each point on the locus of this stroke. The order of arrangement of the stroke data corresponds to the order in which the strokes are handwritten, that is, the stroke order.

  The tablet computer 10 reads any existing time-series information from the storage medium, and displays a handwritten document corresponding to the time-series information, that is, a trajectory corresponding to each of a plurality of strokes indicated by the time-series information on the screen. be able to. Furthermore, the tablet computer 10 has an editing function. This editing function deletes or deletes arbitrary strokes or arbitrary handwritten characters in the displayed handwritten document according to the editing operation by the user using the “eraser” tool, range specification tool, and other various tools. Can move. As the “eraser” tool, stroke data (erase stroke data) corresponding to a stroke handwritten in the erase mode can be used. The stroke corresponding to the erasing stroke data is an erasing stroke having an attribute of erasing (making transparent) other strokes. The intersection where the erasing stroke intersects with another normal stroke is transparent. In other words, the intersection in the other stroke is erased (made transparent). The user can visually recognize the background layer or the lower layer on which other content is displayed through the transparent intersection.

  Further, this editing function includes a function for canceling a history of some handwriting operations. Furthermore, this editing function can add arbitrary handwritten characters or handwritten symbols to the displayed handwritten document.

  In this embodiment, the time series information can be managed as one or a plurality of pages. In this case, a group of time-series information that fits on one screen may be recorded as one page by dividing the time-series information into area units that fit on one screen. Alternatively, the page size may be variable. In this case, since the page size can be expanded to an area larger than the size of one screen, a handwritten document having an area larger than the screen size can be handled as one page. When one entire page cannot be displayed simultaneously on the display, the page may be reduced, or the display target portion in the page may be moved by vertical and horizontal scrolling.

  As described above, since the time series information can be managed as page data, hereinafter, the time series information is also referred to as handwritten page data or simply handwritten data.

  The tablet computer 10 has a network communication function, and can cooperate with other personal computers and servers on the Internet. That is, the tablet computer 10 includes a wireless communication device such as a wireless LAN, and can execute wireless communication with other personal computers. Furthermore, the tablet computer 10 can also execute communication with various servers on the Internet.

  The server includes a large-capacity storage medium such as a hard disk drive (HDD). The tablet computer 10 can transmit time-series information (handwritten page data) to the server via the network and store it in the storage medium of the server (upload). In order to ensure secure communication between the tablet computer 10 and the server, the server may authenticate the tablet computer 10 at the start of communication. In this case, a dialog prompting the user to input an ID or password may be displayed on the screen of the tablet computer 10, or the ID of the tablet computer 10 may be automatically transmitted from the tablet computer 10 to the server. Good.

  Thereby, even when the storage capacity of the tablet computer 10 is small, the tablet computer 10 can handle a large amount of time-series information (handwritten page data) or a large amount of time-series information (handwritten page data).

  Furthermore, the tablet computer 10 reads (downloads) any one or more time-series information (handwritten page data) stored in the storage medium of the server, and displays the trajectory of each stroke indicated by the read time-series information on the tablet. It can be displayed on the screen of the display 17 of the computer 10. In this case, a list of thumbnails (thumbnail images) obtained by reducing each page of a plurality of time-series information (handwritten page data) may be displayed on the screen of the display 17 or selected from these thumbnails. One page may be displayed in a normal size on the screen of the display 17.

  Thus, in this embodiment, the storage medium in which the time series information is stored may be either a storage in the tablet computer 10 or a storage in the server. The user of the tablet computer 10 can store arbitrary time-series information in an arbitrary storage selected from the storage in the tablet computer 10 and the storage in the server 2.

  Furthermore, the tablet computer 10 can also hand-write objects such as characters and figures on web pages, texts, images, and other various contents. In this case, the handwritten stroke can be drawn on a transparent layer set on the displayed content. Thereby, the trajectory of this stroke can be displayed over the above-mentioned content. Furthermore, the tablet computer 10 can share stroke data corresponding to each stroke handwritten on the content with other terminals.

  For example, in a conference, a plurality of conference participants display the same content (the same conference material) on the screen of their tablet computer. During the meeting, the chairperson or each speaker may handwrite characters, figures, etc. on the content displayed on the screen of the tablet computer. A plurality of stroke data corresponding to handwritten characters and figures are distributed to tablet computers of other conference participants via the server system. Then, strokes corresponding to characters, figures and the like handwritten by the chairperson or each speaker are drawn on the content on the screen of each tablet computer. Thereby, mutual handwritten information (handwritten characters, handwritten figures, etc.) can be exchanged and shared among the conference participants.

  FIG. 2 shows a stroke management server system 2 configured to execute processing for sharing handwritten information among a plurality of terminals. The stroke management server system 2 is a system for sharing a stroke handwritten in the same content among a plurality of terminals. This stroke management server system 2 is realized by one or more servers. The stroke management server system 2 communicates with a plurality of terminals (here, terminals 10A, 10B, and 10C) via a network 1 such as the Internet or an intranet. The terminal 10A is a tablet computer used by the user A, the terminal B is a tablet computer used by the user B, and the terminal 10C is a tablet computer used by the user C.

  Each of the terminals 10A, 10B, and 10C is a terminal having a handwriting function equivalent to that of the tablet computer 10 of the present embodiment. Each of the terminals 10A, 10B, and 10C has a capability of communicating with each of the stroke management server system 2 and the Web server 3 via the Internet. Here, it is assumed that the same content shared between the terminals 10A, 10B, and 10C is a specific Web page received from the Web server 3. Each of the terminals 10A, 10B, and 10C acquires the specific Web page described above from the Web server 3, and displays the specific Web page on the display screen of each terminal.

  When the user A performs a handwriting input operation on the Web page on the display screen of the terminal 10A, the first stroke written by the handwriting input operation is displayed on the Web page.

  The terminal 10A transmits the first stroke data corresponding to the first stroke handwritten by the user A on the web page (content) displayed on the display of the terminal 10A to the stroke management server system 2. The terminal 10A receives from the stroke management server system 2 second stroke data corresponding to the second stroke handwritten by the user B on the above-described Web page (content) displayed on the display of the other terminal 10B. be able to. The terminal 10A can display the second stroke on the Web page (content) displayed on the display of the terminal 10A based on the second stroke data.

  Further, the terminal 10A also receives third stroke data corresponding to the third stroke handwritten by the user C on the above-described Web page (content) displayed on the display of the other terminal 10C from the stroke management server system 2. Can be received. The terminal 10A can display the third stroke on the Web page (content) displayed on the display of the terminal 10A based on the third stroke data.

  Therefore, on the display of the terminal 10A, not only the handwritten object of the user A is displayed on the web page, but also the handwritten object of the user B and further the handwritten object of the user C are displayed on the web page.

  Similarly, on the display of the terminal 10B, not only the handwritten object of the user B is displayed on the web page, but also the handwritten object of the user A and further the handwritten object of the user C are displayed on the web page. Similarly, on the display of the terminal 10C, not only the handwritten object of the user C is displayed on the web page, but also the handwritten object of the user A and further the handwritten object of the user B are displayed on the web page.

  The stroke management server system 2 receives stroke data from each of a plurality of terminals browsing the same Web page (the same content). That is, the stroke management server system 2 receives, from these terminals 10A, 10B, and 10C, a plurality of stroke data corresponding to a plurality of strokes handwritten on the above-described Web pages at the terminals 10A, 10B, and 10C, respectively. Then, the stroke management server system 2 stores each of the plurality of stroke data in the database 2A in association with the identifier of the terminal that has transmitted the stroke data. For example, individual stroke data received from the terminal 10A is stored in the database 2A in association with the identifier of the terminal 10A (or the identifier of the user A). Similarly, the individual stroke data received from the terminal 10B is stored in the database 2A in association with the identifier of the terminal 10B (or the identifier of the user B), and the individual stroke data received from the terminal 10C is the identifier of the terminal 10C. (Or the identifier of user C) and stored in the database 2A. The identifier may be any information as long as it can identify the terminal. For example, existing information such as a MAC address or an IP address, or a system to which the terminals 10A, 10B, and 10C belong is set. May be information provided to each terminal 10A, 10B, 10C by the stroke management server system 2, or information set for each terminal based on a random number.

  The stroke management server system 2 then associates the first terminal in the terminals 10A, 10B, and 10C with the identifiers of other terminals other than the first terminal in the plurality of stroke data described above. One or more first stroke data is transmitted. When transmitting stroke data of other terminals (terminals 10B, 10C) to the terminal 10A, the stroke management server system 2 uses the stroke data associated with the identifier of the terminal 10B from the plurality of stroke data described above. And stroke data associated with the identifier of the terminal 10C are selected. Then, the stroke management server system 2 transmits the selected stroke data to the terminal 10A as the above-described first stroke data (strokes handwritten in another terminal).

  Furthermore, the stroke management server system 2 can store each of the plurality of stroke data in the database 2A in association with time information corresponding to the handwriting timing. In this case, the stroke management server system 2 transmits a set of stroke data and time information corresponding to the stroke data to each terminal. For example, when providing stroke data of other terminals (terminals 10B and 10C) to the terminal 10A, the stroke management server system 2 uses the strokes associated with the identifier of the terminal 10B from the plurality of stroke data described above. Data is selected, and the selected stroke data and time information corresponding to the selected stroke data are transmitted to the terminal 10A. Further, the stroke management server system 2 selects the stroke data associated with the identifier of the terminal 10C from the plurality of stroke data described above, and selects the selected stroke data and time information corresponding to the selected stroke data. Transmit to terminal 10A.

  Thus, by transmitting not only each stroke data but also time information corresponding to each stroke data to the terminal 10A, the terminal 10A reproduces the order relationship between strokes (stroke order, timing when the stroke is handwritten). be able to. Furthermore, the order relationship between a stroke group such as a handwritten character written in the terminal 10B and a stroke group such as a handwritten character written in the terminal 10C can also be reproduced.

An example of a communication procedure between each terminal and the stroke management server system 2 will be described.
Each time one stroke is handwritten on the display of the terminal 10A on which the above-described Web page is displayed, the terminal 10A has one stroke data corresponding to the one handwritten stroke and the above-described Web page identifier. A set with (URI) is transmitted to the stroke management server system 2. The stroke data may include time information (time stamp) indicating the time when the corresponding stroke was handwritten. This time information may be an absolute time (such as GMT) or a relative time. The relative time is information indicating a difference between the timing when the previous stroke is handwritten and the timing when the current transmission target stroke is handwritten. Further, the stroke data may include pen type information (stroke thickness, stroke color, etc.) of the corresponding stroke. Further, the pen type information may include information for identifying a stroke handwritten in the erasing mode.

  In addition, in order to be able to specify the above-described Web page with higher accuracy, not only the above-described Web page identifier (URI) but also the update date / time information of this Web page is also sent from the terminal 10A to the stroke management server system 2. You may make it transmit.

  Every time one stroke is handwritten on the display of the terminal 10B on which the above-described Web page is displayed, the terminal 10B also includes one stroke data corresponding to the one handwritten stroke and the above-described Web page identifier. A set with (URI) is transmitted to the stroke management server system 2. Similarly, every time one stroke is handwritten on the display of the terminal 10B on which the above-described web page is displayed, the terminal 10C also includes one stroke data corresponding to the handwritten stroke and the above-described web. A set with a page identifier (URI) is transmitted to the stroke management server system 2.

  The stroke management server system 2 stores the stroke data and URI as a set in the database 2A. Each of the terminals 10A, 10B, and 10C polls the stroke management server system 2 periodically (for example, every 1 to 2 seconds), and acquires the stroke data associated with the above-described URI from the stroke management server system 2. In polling, each of the terminals 10 </ b> A, 10 </ b> B, and 10 </ b> C transmits the above-described Web page URI to the stroke management server system 2. If there is new stroke data related to this URI and not acquired in the stroke management server system 2, each of the terminals 10 </ b> A, 10 </ b> B, 10 </ b> C acquires the new stroke data from the stroke management server system 2. In the stroke management server system 2, each stroke data is managed in association with the terminal ID of the transmission source terminal. Therefore, stroke data associated with the terminal 10B or 10C is provided for the terminal 10A, stroke data associated with the terminal 10A or 10C is provided for the terminal 10B, and for the terminal 10C. Stroke data associated with the terminal 10A or 10B is provided.

  Each of the terminals 10A, 10B, and 10C draws a stroke corresponding to each acquired stroke data on the Web page. In this case, in each of the terminals 10A, 10B, and 10C, a stroke data group for a predetermined time may be buffered. Thereby, each stroke can be drawn on the Web page in the order of the timing when each stroke was handwritten.

  FIG. 3 shows an example of the display screen of the terminal 10A. Here, it is assumed that the terminals 10A, 10B, and 10C are browsing the Web page of the URL “http://www.webpage.com/howtoaccess”. A transparent layer (handwriting layer) 30B is set on the screen image 30A of the Web page. Each stroke handwritten by the user is drawn on the layer 30B, whereby each stroke (trajectory of each stroke) is displayed on the screen image 30A of the Web page (overlay). A stroke group handwritten on the screen image 30A of the Web page is sequentially transmitted to the stroke management server system 2 in units of one stroke.

  In FIG. 3, it is assumed that an ellipse stroke surrounding the rectangular object “YYY station” in the Web page is handwritten by the user A. The stroke data corresponding to this stroke is transmitted to the stroke management server system 2 together with meta information such as URL “http://www.webpage.com/howtoaccess”, and the stroke data and meta information are accumulated in the database 2A. . The terminal 10A periodically requests the stroke management server system 2 for stroke data related to the URL “http://www.webpage.com/howtoaccess”. If user B of terminal 10B has handwritten characters on the web page of URL “http://www.webpage.com/howtoaccess” displayed on the display of terminal 10B, stroke data group corresponding to the handwritten characters Are stored in the database 2A of the stroke management server system 2. The terminal 10A can receive the stroke data of the terminal 10B from the stroke management server system 2. Strokes corresponding to these stroke data are drawn on the layer 30B, whereby each stroke of the user B (trajectory of each stroke) is displayed on the screen image 30A of the Web page (overlay).

  Next, the relationship between strokes (characters, marks, figures, tables, etc.) handwritten by the user and time-series information will be described with reference to FIGS. FIG. 4 shows an example of a handwritten document (handwritten character string) handwritten on the touch screen display 17 using the pen 100 or the like.

  In a handwritten document, there are many cases where another character or graphic is handwritten on the character or graphic once handwritten. In FIG. 4, the handwritten character string “ABC” is handwritten in the order of “A”, “B”, and “C”, and then the handwritten arrow is handwritten near the handwritten character “A”. The case is envisaged.

  The handwritten character “A” is represented by two strokes (“∧” -shaped trajectory, “−”-shaped trajectory) handwritten using the pen 100 or the like, that is, two trajectories. The trajectory of the first “∧” -shaped pen 100 handwritten is sampled in real time, for example, at equal time intervals, thereby obtaining the time-series coordinates SD11, SD12,... SD1n of the “∧” -shaped stroke. Similarly, the trajectory of the “−” shaped pen 100 to be handwritten next is also sampled in real time at equal time intervals, thereby obtaining the time series coordinates SD21, SD21,... SD2n of the “−” shaped stroke.

  The handwritten character “B” is expressed by two strokes handwritten using the pen 100 or the like, that is, two trajectories. The handwritten character “C” is represented by one stroke handwritten using the pen 100 or the like, that is, one locus. The handwritten “arrow” is expressed by two strokes handwritten using the pen 100 or the like, that is, two trajectories.

  FIG. 5 shows time-series information (handwritten page data) 200 corresponding to the handwritten document of FIG. The time series information includes a plurality of stroke data SD1, SD2,. In the time series information 200, these stroke data SD1, SD2,..., SD7 are arranged in time series in the order of handwriting, that is, the order in which a plurality of strokes are handwritten.

  In the time series information 200, the first two stroke data SD1 and SD2 indicate two strokes of the handwritten character “A”, respectively. The third and fourth stroke data SD3 and SD4 indicate two strokes constituting the handwritten character “B”, respectively. The fifth stroke data SD5 indicates one stroke constituting the handwritten character “C”. The sixth and seventh stroke data SD6 and SD7 indicate two strokes constituting the handwritten “arrow”, respectively.

  Each stroke data includes a coordinate data series (time series coordinates) corresponding to one stroke, that is, a plurality of coordinates corresponding to a plurality of points on the trajectory of one stroke. In each stroke data, a plurality of coordinates are arranged in time series in the order in which the strokes are written. For example, for the handwritten character “A”, the stroke data SD1 is a coordinate data series (time series coordinates) corresponding to each point on the locus of the stroke of the “∧” shape of the handwritten character “A”, that is, n coordinates. Data SD11, SD12,... SD1n are included. The stroke data SD2 includes coordinate data series corresponding to each point on the trajectory of the stroke of the “−” shape of the handwritten character “A”, that is, n pieces of coordinate data SD21, SD22,. Note that the number of coordinate data may be different for each stroke data.

  Each coordinate data indicates an X coordinate and a Y coordinate corresponding to a certain point in the corresponding locus. For example, the coordinate data SD11 indicates the X coordinate (X11) and the Y coordinate (Y11) of the start point of the “∧” -shaped stroke. SD1n indicates the X coordinate (X1n) and Y coordinate (Y1n) of the end point of the “∧” -shaped stroke.

  Further, each coordinate data may include time stamp information T corresponding to the time when a point corresponding to the coordinate is handwritten. The handwritten time may be either absolute time (for example, year / month / day / hour / minute / second) or relative time based on a certain time. For example, the absolute time (for example, year / month / day / hour / minute / second) when the stroke is started is added to each stroke data as time stamp information, and each coordinate data in the stroke data indicates a difference from the absolute time. The relative time may be added as time stamp information T.

  As described above, by using the time series information in which the time stamp information T is added to each coordinate data, the temporal relationship between the strokes can be expressed more accurately.

  Furthermore, information (Z) indicating writing pressure may be added to each coordinate data.

  The time-series information 200 having the structure as described in FIG. 5 can represent not only the handwriting of each stroke but also the temporal relationship between the strokes. Therefore, by using this time-series information 200, as shown in FIG. 4, the tip of the handwritten “arrow” is written over the handwritten character “A” or close to the handwritten character “A”. However, the handwritten character “A” and the tip of the handwritten “arrow” can be handled as different characters or figures.

  The time stamp information of the stroke data SD1 is any one selected from a plurality of time stamp information T11 to T1n corresponding to each of a plurality of coordinates in the stroke data SD1, or the time stamp information T11 to T1n. You may use the average value of. Similarly, as the time stamp information of the stroke data SD2, any one selected from a plurality of time stamp information T21 to T2n corresponding to each of a plurality of coordinate points in the stroke data SD2 or time stamp information T21. To the average value of T2n may be used. Similarly, as the time stamp information of the stroke data SD7, any one selected from a plurality of time stamp information T71 to T7n corresponding to each of a plurality of coordinate points in the stroke data SD7, or a time stamp An average value of the information T71 to T7n may be used.

  In the time series information 200 of the present embodiment, as described above, the arrangement of the stroke data SD1, SD2,..., SD7 indicates the stroke order of handwritten characters. For example, the arrangement of the stroke data SD1 and SD2 indicates that the stroke of the “∧” shape is first handwritten and then the stroke of the “−” shape is handwritten. Therefore, even if the handwriting of two handwritten characters are similar to each other, when the writing order of the two handwritten characters is different from each other, the two handwritten characters can be distinguished as different characters.

  Further, in the present embodiment, as described above, the handwritten document is not stored as an image or character recognition result, but is stored as time series information 200 including a set of a plurality of stroke data corresponding to a plurality of strokes. Handwritten characters can be handled without depending on the language of handwritten characters. Therefore, the structure of the time-series information 200 according to the present embodiment can be commonly used in various countries around the world with different languages.

FIG. 6 is a diagram showing a system configuration of the tablet computer 10.
As shown in FIG. 6, the tablet computer 10 includes a CPU 101, a system controller 102, a main memory 103, a graphics controller 105, a BIOS-ROM 105, a nonvolatile memory 106, a wireless communication device 107, an embedded controller (EC) 108, and the like. .

  The CPU 101 is a processor that controls the operation of various modules in the tablet computer 10. The CPU 101 executes various software loaded into the main memory 103 from the nonvolatile memory 106 that is a storage device. These software include an operating system (OS) 201 and various application programs. The application program includes a handwritten note application program 202. The handwritten note application program 202 has a browser function for browsing content such as a Web page, a function of drawing a handwritten stroke on the content, a function of cooperating with the stroke management server system 2, and the like.

  The CPU 101 also executes a basic input / output system (BIOS) stored in the BIOS-ROM 105. The BIOS is a program for hardware control.

  The system controller 102 is a device that connects the local bus of the CPU 101 and various components. The system controller 102 also includes a memory controller that controls access to the main memory 103. The system controller 102 also has a function of executing communication with the graphics controller 104 via a PCI Express standard serial bus or the like.

  The graphics controller 104 is a display controller that controls the LCD 17 </ b> A used as a display monitor of the tablet computer 10. A display signal generated by the graphics controller 104 is sent to the LCD 17A. The LCD 17A displays a screen image based on the display signal. A touch panel 17B and a digitizer 17C are disposed on the LCD 17A. The touch panel 17B is a capacitance-type pointing device for inputting on the screen of the LCD 17A. The touch position on the screen where the finger is touched and the movement of the touch position are detected by the touch panel 17B. The digitizer 17C is an electromagnetic induction type pointing device for inputting on the screen of the LCD 17A. The digitizer 17C detects the contact position on the screen where the pen 100 is touched, the movement of the contact position, and the like.

  The wireless communication device 107 is a device configured to perform wireless communication such as wireless LAN or 3G mobile communication. The EC 108 is a one-chip microcomputer including an embedded controller for power management. The EC 108 has a function of turning on or off the tablet computer 10 in accordance with the operation of the power button by the user.

  Next, the functional configuration of the handwritten note application program 202 will be described with reference to FIG.

  The handwritten note application program 202 includes a pen type / eraser control unit 300, a pen locus drawing processing unit 301, a stroke data generation unit 302, a stroke transmission processing unit 304, a stroke reception processing unit 305, a stroke drawing processing unit 307, a browser 308, and A synthesis processing unit 309 and the like are provided.

  The handwritten note application program 202 creates, displays, and edits handwritten page data by using stroke data input using the touch screen display 17. The touch screen display 17 is configured to detect the occurrence of events such as “touch”, “move (slide)”, and “release”. “Touch” is an event indicating that an external object has touched the screen. “Move (slide)” is an event indicating that the contact position has been moved while an external object is in contact with the screen. “Release” is an event indicating that an external object has been released from the screen.

  The pen type / eraser control unit 300 displays a graphical user interface such as a menu or a button on the touch screen display 17. The pen type / eraser control unit 300 receives a “touch” event generated by the touch screen display 17, and thereby detects an operation of the graphical user interface by the user. The “touch” event includes the coordinates of the contact position. Therefore, the pen type / eraser control unit 300 can detect that a button or menu on the graphical user interface is touched. The handwriting note application program 202 has an input mode for handwriting a character, a figure, and the like, and an erasing mode for handwriting the erasing stroke. A stroke handwritten in the erasing mode is treated as the above-described erasing stroke. Also, the user can specify the thickness and color of the stroke to be drawn (trajectory corresponding to the stroke).

  The pen locus drawing processing unit 301 and the stroke data generation unit 302 receive a “touch” or “move (slide)” event generated by the touch screen display 17, thereby detecting a handwriting input operation. As described above, the “touch” event includes the coordinates of the contact position. The “movement (slide)” event also includes the coordinates of the contact position of the movement destination. Therefore, the pen locus drawing processing unit 301 and the time-series information generating unit 302 can receive a coordinate sequence corresponding to the movement locus of the touch position from the touch screen display 17.

  The pen locus drawing processing unit 301 receives the coordinate sequence from the touch screen display 17, and based on the coordinate sequence, the locus of each stroke handwritten by the handwriting input operation using the pen 100 or the like is placed on the above-described layer 30B. The pen type / eraser control unit 300 displays the thickness and color specified. The pen locus drawing processing unit 301 draws the locus of the pen 100 while the pen 100 is in contact with the screen, that is, the locus of each stroke on the layer 30B.

  The stroke data generation unit 302 receives the above-described coordinate sequence output from the touch screen display 17, and generates stroke data having the structure described in detail in FIG. 5 based on the coordinate sequence. In this case, the stroke data, that is, the coordinates and time stamp information corresponding to each point of the stroke may be temporarily stored in the work memory 303.

  Each time one stroke is handwritten on the web page displayed by the browser, the stroke transmission processing unit 304 has a URI (URL) of the web page and stroke data corresponding to the one stroke handwritten on the web page. Are transmitted to the stroke management server system 2.

  The stroke reception processing unit 305 polls the stroke management server system 2 periodically (for example, every 1 to 2 seconds) and receives stroke data related to the Web page currently displayed by the browser from the stroke management server system 2. To do. In this case, since the set of stroke data, the above time information, and pen type information is transmitted from the stroke management server system 2, the stroke reception processing unit 305 receives the set of stroke data, time information, and pen type information. To do. The set of received stroke data, time information, and pen type information may be temporarily stored in the buffer 306.

  The stroke drawing processing unit 307 draws a stroke (stroke trajectory) corresponding to the received stroke data on the layer 30B with the thickness and color specified by the pen type information. The stroke drawing processing unit 307 has a function of handling the above-described erasing stroke data. When the received stroke data is erasing stroke data, a stroke (erasing stroke) for making other strokes transparent is used. Draw on layer 30B. A portion in each existing stroke located below the locus of the erasing stroke is made transparent.

  The composition processing unit 309 displays each stroke on the screen image of the Web content by combining the screen image of the Web content drawn by the browser 308 and the layer 30B.

  FIG. 8 shows a stroke information management table stored in the database 2A of the stroke management server system 2. The stroke information management table includes a large number of records. One stroke (one stroke) is assigned to one record of the stroke information management table. Each record stores a URI for identifying content, time information (GMT or local time) indicating a time when a stroke is written, a user ID (device ID), a stroke (coordinate sequence), pen type information, and the like. The stroke management server system 2 can convert time stamp information added to stroke data received from each terminal into an absolute time (year / month / day / hour / minute / second), and register the absolute time in the record as time information. . Of course, the time stamp information added to the stroke data may be registered in the record as the above time information. The user ID (device ID) is an identifier of the transmission source terminal that has transmitted the stroke data.

  The URI may be any information as long as it is information that can identify at least one of the location and / or name of a resource (including content and information resources). The URI may be an identifier of content on the Internet, such as an http scheme, or may be a scheme uniquely extended by the system, and the same content (for example, an electronic book) locally held by each terminal. It may be information that can be identified.

  When each terminal first opens a file of a certain content, (1) each terminal has a time corresponding to the URI of the opened content and belonging to a period from a certain time before the current time to the current time. Stroke data group, or (2) Stroke data group corresponding to the URI of the opened content and within the number of reference data, or (3) Stroke data group each having time after the last update date of the opened content Obtained from the server system 2. Thereafter, each terminal accesses the stroke management server system 2 at regular intervals, and acquires from the stroke management server system 2 a stroke data group each having a time belonging to the period from the previous acquisition time to the current acquisition time. To do.

  FIG. 9 shows a state in which strokes handwritten on the content displayed on the screen of the terminal 10A are displayed on the screen of the terminal 10B.

  When one stroke is written on the content displayed on the screen of the terminal 10 </ b> A, stroke data corresponding to the stroke is transmitted to the stroke management server system 2. In FIG. 9, it is assumed that the terminal 10A and the terminal 10B are browsing the same Web page, and the character string 50A is handwritten by the user A on the Web page displayed on the screen of the terminal 10A. The terminal 10B polls the stroke management server system 2 at regular intervals. When one or more new stroke data exists on the stroke management server system 2, the terminal 10B receives the new one or more stroke data. In the terminal 10B, the received stroke data is buffered, and drawing of a stroke is started after waiting for a predetermined time. This waiting time may be set to zero or extremely short time if priority is given to real-time characteristics. Alternatively, this wait time may be set to a relatively long time if the reproducibility of the writing method is required.

  FIG. 9 shows an example in which the strokes written on the screen of the terminal 10A are displayed on the screen of the terminal 10B almost in real time.

  Note that, here, the case where the terminal 10A is the transmission side and the terminal 10B is the reception side is exemplarily shown, but communication between the terminals can be executed in a full-duplex manner.

  FIG. 10 shows a state in which strokes handwritten on the content displayed on the screen of the terminal 10A and strokes handwritten on the content displayed on the screen of the terminal 10C are displayed on the screen of the terminal 10B. Is shown.

  When one stroke is written on the content displayed on the screen of the terminal 10 </ b> A, stroke data corresponding to the stroke is transmitted to the stroke management server system 2. In FIG. 10, three terminals 10A, 10B, and 10C are browsing the same web page, and the character string 50A is handwritten by the user A on the web page displayed on the screen of the terminal 10A, and then the terminal 10C. It is assumed that the character string 50C is handwritten by the user C on the Web page displayed on the screen. In this case, in the stroke information management table, the time of each stroke data corresponding to the handwritten character string 50C is later than any time of the stroke data corresponding to the handwritten character string 50A.

  The terminal 10B receives each stroke data corresponding to the handwritten character string 50A and each stroke data corresponding to the handwritten character string 50C, but also receives time information together with each stroke data as described above. Therefore, in the terminal 10B, a stroke group corresponding to the character string 50A is first displayed on the Web page displayed on the screen of the terminal 10B, and thereafter, a stroke group corresponding to the character string 50C is displayed on the Web page. Is displayed.

  Here, the case where the terminals 10A and 10C are the transmitting side and the terminal 10B is the receiving side is exemplarily shown, but the communication between the terminals can be executed in a full-duplex manner. That is, the terminal 10A can be not only the transmitting side but also the receiving side that receives strokes handwritten in the terminals 10B and 10C. Similarly, the terminal 10C can be not only the transmitting side but also the receiving side that receives strokes handwritten in the terminals 10A and 10B. The terminal 10B can be not only the reception side but also the transmission side that transmits strokes handwritten in the terminal 10B.

  FIG. 11 shows a case where three terminals 10A, 10B, and 10C communicate with each other at full duplex. Stroke data corresponding to each stroke of the character string 50A handwritten by the user A is transmitted from the terminal 10A to the stroke management server system 2, and is transmitted from the stroke management server system 2 to the terminals 10B and 10C. Therefore, each stroke of the character string 50A is displayed on the Web page displayed on the screen of the terminal 10B. Similarly, each stroke of the character string 50A is displayed on the Web page displayed on the screen of the terminal 10C.

  Stroke data corresponding to each stroke of the character string 50C handwritten by the user C is transmitted from the terminal 10C to the stroke management server system 2, and then transmitted from the stroke management server system 2 to the terminals 10A and 10B. Therefore, each stroke of the character string 50C is displayed on the Web page displayed on the screen of the terminal 10A. Similarly, each stroke of the character string 50C is displayed on the Web page displayed on the screen of the terminal 10B.

  FIG. 12 shows a functional configuration of the stroke management server system 2. The stroke management server system 2 includes a stroke reception processing unit 21, a stroke transmission processing unit 22, and a stroke management unit 23. The stroke reception processing unit 21 receives a plurality of stroke data corresponding to a plurality of strokes handwritten in the terminals 10A, 10B, and 10C on the same content from the terminals 10A, 10B, and 10C. The stroke management unit 23 functions as a control unit configured to store each of the received plurality of stroke data in the database 2A (storage medium) in association with the identifier of the terminal that transmitted the stroke data. . The stroke transmission processing unit 22 transmits one or more first stroke data received from another terminal other than the first terminal to an arbitrary terminal (first terminal) in the terminals 10A, 10B, and 10C. . In the database 2A, each stroke data is associated with the terminal ID of the transmission source terminal. The one or more first stroke data described above is stroke data associated with a terminal ID of another terminal other than the first terminal.

  Next, a procedure of stroke delivery processing executed by the stroke management server system 2 will be described with reference to the flowchart of FIG.

  The stroke reception processing unit 21 of the stroke management server system 2 includes a plurality of terminals 10A, 10B, and 10C that share the same content and are handwritten on the content by the users A, B, and C of the terminals 10A, 10B, and 10C, respectively. A plurality of stroke data corresponding to the stroke is received (step S11). The stroke management unit 23 of the stroke management server system 2 uses the received stroke data, the ID of the terminal that transmitted the stroke data, the time information indicating the time when the stroke was handwritten, and the pen type information corresponding to the stroke data. Are managed in association with each other.

  The stroke transmission processing unit 22 of the stroke management server system 2 sends, to a certain transmission target terminal in the terminals 10A, 10B, and 10C, stroke data received from other terminals other than the transmission target terminal and time corresponding to this stroke data. Information and pen type information are transmitted (step S13). For example, if the terminal 10A is a transmission target terminal, the stroke transmission processing unit 22 transmits each stroke data received from the terminal 10B, time information and pen type information corresponding to each stroke data, to the terminal 10A. Further, the stroke transmission processing unit 22 transmits each stroke data received from the terminal 10C, time information and pen type information corresponding to each stroke data to the terminal 10A.

  Next, a procedure of handwritten information sharing processing executed by the tablet computer 10 will be described with reference to the flowchart of FIG. Here, the case where the content shared between the terminals is a web page will be described as an example, but the handwritten information sharing process will be described. However, the shared content is not limited to the web page. For example, electronic books, text data, and image data Any content such as (still image, moving image) can be used.

  The handwritten note application program 202 of the tablet computer 10 acquires content such as a web page from the web server 3 (step S21). Then, the handwritten note application program 202 displays the screen image of the Web page on the touch screen display 17 by drawing the screen image of the Web page (Step S22). The handwritten note application program 202 draws each stroke handwritten on the touch screen display 17 by a user's handwriting input operation on the layer 30A on the screen image of the Web page (step S23). Thereby, a handwritten character etc. are displayed on a web page (overlay).

  Then, the handwritten note application program 202 transmits a set of stroke data corresponding to the handwritten stroke and the URI of the Web page to the stroke management server system 2 (step S24). Transmission of a set of stroke data and a URI of a Web page is executed in units of one stroke. The handwritten note application program 202, for example, by periodically polling, from the stroke management server system 2, the stroke data corresponding to the stroke handwritten on the above-mentioned Web page in another terminal and the time information of this stroke data Is received (step S25).

  Based on the received stroke data and time information, the handwritten note application program 202 draws the same stroke as the stroke handwritten on the above-described web page on another terminal on the currently displayed web page (step S26). ). Thereby, characters handwritten on other terminals are displayed on the web page on the screen of the tablet computer 10.

  As described above, in the present embodiment, a plurality of stroke data corresponding to a plurality of strokes handwritten on the plurality of terminals 10A, 10B, and 10C on the first content (shared content) is the plurality of terminals 10A. , 10B, 10C, and each of the plurality of stroke data is stored in the database (storage medium) 2A in association with the identifier of the terminal that transmitted the stroke data. Then, stroke data associated with an identifier of a terminal other than the first terminal is transmitted to a certain first terminal (transmission target terminal) in the terminals 10A, 10B, and 10C. Therefore, since handwritten information written on the same content can be shared between the terminals 10A, 10B, and 10C, for example, in a meeting, handwritten information written on the same material (content) between conference participants (Handwritten characters, handwritten figures, etc.) can be easily exchanged and shared. Also, since both content and stroke data are not exchanged between terminals, but only stroke data is exchanged between terminals, it is possible to exchange and share handwritten information with a relatively small amount of communication data. .

  Furthermore, by sending a set of stroke data and time information to the first terminal, the first terminal can write a stroke group such as handwritten characters written on one other terminal and another terminal. It is possible to reproduce the order relationship between stroke groups such as written handwritten characters.

  In the present embodiment, the case where absolute time is used as the time information has been exemplarily described. However, in the case of content such as a moving image, reproduction of the content is started as the time when the stroke is written. An offset value indicating the elapsed time since then may be used.

  Moreover, although the case where each terminal acquires content from a server was illustrated in this embodiment, the content stored in the local storage of each terminal may be displayed on the display of each terminal.

  Also, electronic textbooks that can be identified with the same URI may be distributed to a plurality of terminals so that strokes written by the lecturer during the lecture are displayed on the electronic textbooks of each terminal in real time. For lectures, it is effective to send a set of stroke data and time information to each terminal because the relationship between the progress of the lecture content and the timing at which the stroke is actually written is important in addition to the stroke information. .

  Since the processing of the stroke management server system 2 of the present embodiment can be realized by a computer program, the computer program is only installed and executed on a server computer through a computer-readable storage medium storing the computer program. Thus, the same effect as in the present embodiment can be easily realized.

  Since the processing of the tablet computer 10 of the present embodiment can also be realized by a computer program, the computer program can be simply installed and executed on a normal computer through a computer-readable storage medium storing the computer program. Effects similar to those of the embodiment can be easily realized.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 2 ... Stroke management server system, 10 ... Tablet computer, 21 ... Stroke reception process part, 22 ... Stroke management part, 23 ... Stroke transmission process part, 200 ... Time series information, 301 ... Pen locus drawing process part, 302 ... Stroke data Generating unit, 304 ... stroke transmission processing unit, 305 ... stroke reception processing unit, 307 ... stroke drawing processing unit

Claims (20)

Receiving means for receiving, from any of the plurality of terminals, a plurality of stroke data corresponding to a plurality of strokes handwritten on the content in any of the plurality of terminals;
Control means for storing each of the plurality of stroke data in a storage medium in association with an identifier of a terminal that is the transmission source of the stroke data and an identifier of content in which the stroke data is handwritten;
Transmission means for transmitting one or more first stroke data to the first terminal after a request from the first terminal in the plurality of terminals;
The one or more first stroke data is associated with both an identifier of a terminal other than the first terminal and an identifier of a first content specified by the request, and the first terminal Stroke data not yet sent to
When the first content is opened in the first terminal, the transmission means transmits a plurality of second stroke data to the first terminal,
The plurality of second stroke data includes the first content in a stroke data group handwritten in any of the plurality of terminals before the first content is opened in the first terminal. A system, which is a stroke data group associated with the identifier.   The plurality of second stroke data is the stroke data group handwritten in any one of the plurality of terminals within a first time immediately before the first content is opened in the first terminal. The system according to claim 1, wherein the system is a stroke data group associated with the identifier of the first content. The control means stores each of the plurality of stroke data in the storage medium in association with time information corresponding to the handwriting timing,
2. The system according to claim 1, wherein the transmission unit transmits time information corresponding to the one or more first stroke data and the one or more first stroke data to the first terminal.   The system according to claim 1, wherein each of the plurality of stroke data includes information indicating a thickness or a color of a stroke corresponding to each of the plurality of stroke data.   The system according to claim 1, wherein the plurality of stroke data includes erase stroke data corresponding to a stroke handwritten on the first content in an erase mode.   2. The system according to claim 1, wherein the transmission unit determines which terminal should provide stroke data to the first terminal in response to a request from the first terminal. Receiving a plurality of stroke data corresponding to a plurality of strokes handwritten on content in any of the plurality of terminals from any of the plurality of terminals;
Storing each of the plurality of stroke data in a storage medium in association with an identifier of a terminal that is the transmission source of the stroke data and an identifier of content in which the stroke data is handwritten;
Sending one or more first stroke data to the first terminal after a request from a first terminal in the plurality of terminals;
The one or more first stroke data is associated with both an identifier of a terminal other than the first terminal and an identifier of a first content specified by the request, and the first terminal Stroke data not yet sent to
When the first content is opened at the first terminal, the transmitting includes transmitting a plurality of second stroke data to the first terminal;
The plurality of second stroke data includes the first content in a stroke data group handwritten in any of the plurality of terminals before the first content is opened in the first terminal. A data providing method, which is a stroke data group associated with the identifier.   The plurality of second stroke data is the stroke data group handwritten in any one of the plurality of terminals within a first time immediately before the first content is opened in the first terminal. The data providing method according to claim 7, wherein the data is a stroke data group associated with an identifier of the first content. The storing includes storing each of the plurality of stroke data in the storage medium in association with time information corresponding to the handwriting timing;
8. The data provision according to claim 7, wherein the transmitting includes transmitting the one or more first stroke data and time information corresponding to the one or more first stroke data to the first terminal. Method.   The data providing method according to claim 7, wherein each of the plurality of stroke data includes information indicating a thickness or a color of a stroke corresponding to each of the plurality of stroke data.   The data providing method according to claim 7, wherein the plurality of stroke data includes erase stroke data corresponding to a stroke handwritten on the first content in an erase mode.   The data providing method according to claim 7, wherein the transmitting includes determining which terminal should provide stroke data to the first terminal in response to a request from the first terminal. Receiving a plurality of stroke data corresponding to a plurality of strokes handwritten on the content in any of the plurality of terminals from any of the plurality of terminals;
Storing each of the plurality of stroke data in a storage medium in association with the identifier of the terminal that is the source of the stroke data and the identifier of the content in which the stroke data is handwritten;
After the request from the first terminal in the plurality of terminals, causing the computer to execute a procedure of transmitting one or more first stroke data to the first terminal;
The one or more first stroke data is associated with both an identifier of a terminal other than the first terminal and an identifier of a first content specified by the request, and the first terminal Stroke data not yet sent to
When the first content is opened in the first terminal, the transmitting procedure includes transmitting a plurality of second stroke data to the first terminal;
The plurality of second stroke data includes the first content in a stroke data group handwritten in any of the plurality of terminals before the first content is opened in the first terminal. A program, which is a stroke data group associated with the identifier.   The plurality of second stroke data is the stroke data group handwritten in any one of the plurality of terminals within a first time immediately before the first content is opened in the first terminal. The program according to claim 13, which is a stroke data group associated with the identifier of the first content. The storing procedure includes a procedure of storing each of the plurality of stroke data in the storage medium in association with time information corresponding to the handwriting timing,
The program according to claim 13, wherein the transmitting step includes a step of transmitting time information corresponding to the one or more first stroke data and the one or more first stroke data to the first terminal.   The program according to claim 13, wherein each of the plurality of stroke data includes information indicating a thickness or a color of a stroke corresponding to each of the plurality of stroke data.   The program according to claim 13, wherein the plurality of stroke data includes erase stroke data corresponding to a stroke handwritten on the first content in an erase mode.   14. The program according to claim 13, wherein the transmitting step includes a step of determining which terminal to provide stroke data to the first terminal in response to a request from the first terminal. Electronic equipment,
Transmitting means for transmitting stroke data handwritten on the first content displayed on the display and the identifier of the first content to the system;
Receiving one or more first stroke data from the system by requesting the system for stroke data corresponding to the first content;
The one or more first stroke data is associated with both an identifier of a device other than the electronic device and an identifier of the first content, and the electronic device is unacquired stroke data. ,
The receiving means receives a plurality of second stroke data from the system when the first content is opened,
The plurality of second stroke data is an identifier of the first content in a stroke data group handwritten in any of the other devices before the first content is opened in the electronic device. An electronic device that is a stroke data group associated with the.   The plurality of second stroke data groups are stroke data groups handwritten in any of the other devices within a first time immediately before the first content is opened in the first terminal, The electronic device according to claim 19, wherein the electronic device is a stroke data group associated with the identifier of the first content.

Images