JP6328436B2 - Handwriting input device and handwriting input method - Google Patents

Description

  The present invention relates to a handwriting input device and a handwriting input method including a display surface capable of handwriting input.

  There is a character search device capable of performing a search using a handwritten character string handwritten by a user as a query. For example, such a character search device extracts feature amounts from individual strokes obtained by handwriting, and, for example, integrates the acquired stroke sequence into a set such as a row block and a character block. There is one that extracts features from the entire stroke group and performs a search by combining them (see Patent Document 1).

JP 2013-246731 A

  However, although the handwritten character search device of Patent Document 1 can perform a search by handwriting input, it is not considered to search for a character written by handwriting input. Cannot search for written characters.

  In addition, when characters are written in a file or the like by handwriting input, all or part of the characters written by handwriting input can be included in the file name so that the written characters can be searched. However, since the number of characters included in the file name is limited, the number of characters to be searched is inevitably limited, so that the search cannot be performed efficiently and the convenience of the user cannot be improved.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a handwriting input device and a handwriting input method capable of improving user convenience.

A handwriting input device according to the present invention is a handwriting input device having a display surface capable of handwriting input, a file display unit for displaying one or more pages constituting one file on the display surface; A character conversion unit that converts handwritten characters input on one or more pages displayed on the file display unit into character data, and a storage unit that stores the character data converted by the character conversion unit and the file in association with each other And an extraction unit that extracts character data that is included in the file and that is different from character data obtained by converting handwritten characters when the file display unit displays one or more pages constituting one file on the display surface. A storage unit that associates and stores the character data extracted by the extraction unit and the file, a reception unit that receives a search character for searching the file, and a search sentence received by the reception unit Characterized in that it comprises a search unit that searches a file stored in each of the storage unit based on.

In the handwriting input device according to the present invention, the reception unit displays a search screen for inputting a handwritten character as the search character on the display surface, and the character conversion unit is displayed on the search screen. The input handwritten character is converted into search character data for search, and the search unit searches for the file stored in each of the storage units based on the search character data converted by the character conversion unit. It is characterized by the above.

  The handwriting input device according to the present invention includes a reduced image display unit that displays a file as a reduced image when a file associated with character data matching the character data searched by the search unit is specified. Features.

  The handwriting input device according to the present invention, when a plurality of files associated with character data matching the character data searched by the search unit is specified, a file that accepts an operation for selecting a reduced image of the plurality of files The reduced image display unit, when the operation is accepted by the file selection unit, out of the pages constituting the file corresponding to the selected reduced image, the character data that matches the search character data It is characterized in that a reduced image of each of one or a plurality of pages that are included is displayed.

Handwriting input apparatus according to the present invention, the search case, included in the page corresponding to the reduced image selected said Installing receives an operation of selecting one or more pages each reduced image displayed on the display surface A display control unit that displays at least character data obtained by converting the handwritten character by the character conversion unit among character data that matches character data in a display mode different from character data that does not match the search character data included in the page. equipped with a.

The handwriting input method according to the present invention is a handwriting input method by a handwriting input device having a display surface capable of handwriting input, wherein the file display unit displays one or more pages constituting one file. and displaying the surface, the displayed one or more of the steps of the character conversion unit the input handwritten character page is converted to character data, converted character data to the file and the associated and stored in the storage unit And when the file display unit displays one or more pages constituting one file on the display surface, the extraction unit extracts character data that is included in the file and that is different from character data obtained by converting handwritten characters. A step of extracting, a step of storing the extracted character data and the file in association with each other in the storage unit, and a receiving unit receiving a search character for searching the file A step, the search unit files stored in each of the storage unit based on the received search character is characterized in that it comprises a retrieving.

  According to the present invention, user convenience can be improved.

It is explanatory drawing which shows an example of the external appearance of the handwriting input apparatus of Embodiment 1. FIG. It is a block diagram which shows an example of a structure of the handwriting input device of this Embodiment. It is explanatory drawing which shows an example of a file. It is explanatory drawing which shows an example of a structure of original file text DB. It is explanatory drawing which shows 1st Example of a handwritten character input. It is explanatory drawing which shows an example of a structure of handwritten character DB. It is explanatory drawing which shows 2nd Example of handwritten character input. It is explanatory drawing which shows 3rd Example of handwritten character input. It is explanatory drawing which shows the other example of a structure of handwritten character DB. It is explanatory drawing which shows an example of the search screen for inputting a handwritten character. It is explanatory drawing which shows an example of the thumbnail display of a file. It is explanatory drawing which shows an example of the thumbnail display of a page. It is explanatory drawing which shows an example of the display of the searched character. It is a flowchart which shows an example of the process sequence at the time of edit or creation of the file by the handwriting input device of this Embodiment. It is a flowchart which shows an example of the process sequence at the time of edit or creation of the file by the handwriting input device of this Embodiment. It is a flowchart which shows an example of the procedure of the search process by the handwriting input device of this Embodiment. It is a flowchart which shows an example of the procedure of the search process by the handwriting input device of this Embodiment. It is a flowchart which shows an example of the procedure of the search process by the handwriting input device of this Embodiment. It is explanatory drawing which shows an example of the external appearance of the handwriting input device of Embodiment 2.

(Embodiment 1)
Hereinafter, the present invention will be described with reference to the drawings illustrating embodiments. FIG. 1 is an explanatory diagram showing an example of the appearance of the handwriting input device 100 of the first embodiment, and FIG. 2 is a block diagram showing an example of the configuration of the handwriting input device 100 of the present embodiment. The handwriting input device 100 includes a display unit 16 capable of handwriting input, a case 20 that houses the display unit 16, and the like. The handwriting input device 100 is, for example, a tablet device, a notebook personal computer, a mobile phone such as a smartphone, or a display device or information processing device having a large display surface that can share information in a conference room or classroom. It may be.

  As shown in FIG. 2, the handwriting input device 100 includes a CPU, a memory, a timer, and the like, and controls the entire device, a screen control unit 11, a touch detection unit 12, a handwriting input unit 13, and a character conversion unit. 14, a storage unit 15, a display unit 16, a search unit 17, a thumbnail control unit 18, an extraction unit 19, and the like.

  The display unit 16 is, for example, a liquid crystal display, an EL (Electro Luminescence) display, or the like, and can display an image on the display surface.

  The touch detection unit 12 includes a capacitive touch panel, a resistive touch panel, and the like. When the user performs a touch operation on the display surface of the display unit 16 with a pen or a finger, the touch detection unit 12 is information that indicates a position on the display surface where the touch operation is performed, that is, pressed by the touch operation. Position information (for example, when the display surface is represented by xy coordinates, coordinate data such as the x coordinate and y coordinate of the touched part) is acquired.

  In addition, when the user draws a line (straight line or curve) with a pen or a finger on the display surface of the display unit 16 (for example, a drag operation), the touch detection unit 12 has a plurality of points constituting the line. Similarly, the position of is acquired. In addition, when two or more separated locations are pressed, the touch detection unit 12 can also acquire position information of each location, and so-called multi-touch operation is possible. Note that the touch detection unit 12 can also detect a flick operation. The touch detection unit 12 outputs the acquired position information to the control unit 10.

  The handwriting input unit 13 generates stroke information (handwritten stroke data) based on the position information (coordinate data) acquired by the touch detection unit 12. When the user draws a line (straight line or curved line) with a pen or a finger on the display surface of the display unit 16, the stroke information is displayed from the position where the pen or the finger touches the display surface. It is a set of position information of a plurality of points constituting a straight line or a curve drawn before being separated from the surface.

  The storage unit 15 includes volatile memory such as DDR and SDRAM (Double Data Rate Synchronous Dynamic Random Access Memory), nonvolatile memory such as flash ROM (Read Only Memory), EEPROM (registered trademark), HDD (Hard Disk Drive), and the like. Consists of. The storage unit 15 includes information such as an original file text DB and handwritten character DB described later, a program for controlling the handwriting input device 100, an image displayed on the display surface of the display unit 16, and a thumbnail (reduced image) described later. , Data of files (also referred to as notes), programs for editing files, programs for managing files, and the like are stored.

  The screen control unit 11 performs control such as generation and display of an operation screen to be displayed on the display surface of the display unit 16. The screen control unit 11 has a function as a file display unit, and displays one or a plurality of pages constituting one file on the display surface of the display unit 16. One file may be displayed for creating a new file, or may be displayed for editing, for example, an already created file.

  FIG. 3 is an explanatory diagram showing an example of a file. FIG. 3 shows a file that has already been created before handwriting input by the handwriting input device 100 of the present embodiment. The file name (note name) shown in FIG. 3 is NewsReleaseFile. As shown in FIG. 3, it is assumed that the file is composed of four pages, and character data obtained by character-converting characters of keyboard input (not handwritten input) is described on each page.

  When the screen control unit 11 displays one or more pages constituting one file on the display surface, the extraction unit 19 includes character data (text data) that is included in the displayed file and is different from character data obtained by converting handwritten characters. (Also called). Character data different from character data obtained by converting handwritten characters is not character data obtained by converting handwritten characters but character data obtained by converting characters input by a keyboard or the like. The extraction unit 19 outputs the extracted character data to the control unit 10.

  The control unit 10 generates an original file text DB in which the character data extracted by the extraction unit 19 is associated with a file, and stores the original file text DB in the storage unit 15.

  FIG. 4 is an explanatory diagram showing an example of the configuration of the original file text DB. The original file text DB illustrated in FIG. 4 is generated based on the file illustrated in FIG. As shown in FIG. 4, the original file text DB includes a recording number, a note name, a page (page number), character data (text data), a start coordinate of character data, a font size of characters, and the like. The start coordinates are the coordinates of the start position of the character data. On the same page, when a character string is broken by one line, it is stored as two character data.

  That is, as shown in FIG. 4, storing character data extracted by the extraction unit 19 in association with a file means that, for example, if the file is composed of one or more pages, the character input by the keyboard is converted. Each of the obtained character data includes a file name (also referred to as a note name), a page (also referred to as a page or a page number), a position on the page (for example, when the page is expressed in xy coordinates, y coordinate), font size, etc.

  The character conversion unit 14 converts handwritten characters input on one or more pages displayed on the display surface into character data (also referred to as text data). That is, it is assumed that a page is displayed on a display surface where handwritten input is possible, and the user writes handwritten characters with a pen or a finger on the displayed page. When handwritten characters are written on the display surface, the screen control unit 11 draws a pen or finger locus on the display surface, and the handwriting input unit 13 generates stroke information corresponding to the locus. The character conversion unit 14 recognizes a character based on the stroke information and converts the handwritten character into character data. The character conversion unit 14 outputs the converted character data to the control unit 10. The handwriting input unit 13 stores the generated stroke information in the storage unit 15. Thereby, the handwritten character drawn on the display surface can be stored as it is (the state of the handwritten character).

  FIG. 5 is an explanatory view showing a first embodiment of handwritten character input. The file illustrated in FIG. 5 is the same as the file illustrated in FIG. As shown in FIG. 5, it is assumed that the user inputs “important” by handwriting on the first page and the third page, and inputs “reference” by hand on the second page and the fourth page.

  The control unit 10 generates a handwritten character DB that is converted by the character conversion unit 14 and associates the character data with the file, and stores it in the storage unit 15. Further, the control unit 10 generates a handwritten character DB in which the stroke information (handwritten character) generated by the handwriting input unit 13 is associated with a file, and stores it in the storage unit 15.

  FIG. 6 is an explanatory diagram showing an example of the configuration of the handwritten character DB. The handwritten character DB illustrated in FIG. 6 is generated as a result of handwriting input to the file illustrated in FIG. As shown in FIG. 6, the handwritten character DB includes a recording number, a note name, a page (page number), character data (text data), handwritten characters, handwritten object coordinates, and the like. A handwritten character is a character in a handwritten state composed of stroke information before character conversion. The handwritten object coordinates can be, for example, coordinates on a diagonal line of a rectangle surrounding a handwritten character, and can be coordinates on a diagonal line of a rectangle surrounding a handwritten character that has not been converted to text data or text data.

  As shown in FIG. 6, storing character data obtained by converting handwritten input characters in association with a file means, for example, a character obtained by converting handwritten input when the file is composed of one or more pages. Each piece of data is associated with a file name, a page, a position on the page (for example, when the page is represented by xy coordinates, the x-coordinate and y-coordinate of character data), and the like. In addition, when handwritten characters that have not been converted into text data are stored in association with a file, for example, when the file is composed of one or more pages, each handwritten character is represented by a file name, a page, and a position on the page (for example, When a page is represented by xy coordinates, it is associated with handwritten characters such as x-coordinate and y-coordinate).

  FIG. 7 is an explanatory view showing a second embodiment of handwritten character input. The file illustrated in FIG. 7 shows a case where the user creates a new file (note), and shows how “important” is input by handwriting on the first blank page.

  FIG. 8 is an explanatory diagram showing a third embodiment of handwritten character input. In the example of FIG. 8, there are four files, and the file names (note names) are “new note”, “idea memo”, “design review”, and “NewsReleaseFile”, respectively. Then, as shown in FIG. 8, “important” is input by hand for the file “new note”, and “idea memo” is input by hand for the file “idea memo”. For the file “Review”, handwriting input “Back” (not shown in FIG. 8), and for the file “NewsReleaseFile”, “Important” and “Reference” and handwriting input (partial in FIG. 8) (Not shown).

  FIG. 9 is an explanatory diagram showing another example of the configuration of the handwritten character DB. The handwritten character DB illustrated in FIG. 9 is generated as a result of handwriting input for each file illustrated in FIG. As shown in FIG. 9, the file “new note” is associated with the character data (text data) “important” and the handwritten character “important”, and the file “idea memo” , The character data “idea” and “memo” and the handwritten characters “idea” and “memo” are associated, and the file “design review” is handwritten “back”, character data, and “back” Characters are associated with each other, and “NewsReleaseFile” is associated with character data “important” and “reference” and handwritten characters “important” and “reference”.

  As described above, since the character input by handwriting is converted into character data and stored in association with the file, for example, the stored character data is searched with search character data for search (also referred to as a search keyword). Can do. As a result, it is not necessary to include all or part of the characters written by handwriting in the file name, and there is no restriction on the number of characters to be searched, so the file can be searched efficiently, and the user can Improved convenience.

  In addition, if the user himself / herself wrote handwritten characters, the situation at the time of writing the handwritten characters can be easily recalled, so by storing the handwritten characters themselves in association with the file, Find files easily.

  The screen control unit 11 and the touch detection unit 12 have a function as a reception unit, and receive search characters for searching for files. The search character may be a character input by handwriting or a character input by a keyboard or the like.

  The search unit 17 searches for a file with reference to the handwritten character DB stored in the storage unit 15 based on the search characters received by the screen control unit 11 and the touch detection unit 12. Since the file is associated with the character data obtained by converting the handwritten input, the file can be searched efficiently, and the convenience for the user is improved.

  The search unit 17 searches for a file by referring to the original file text DB stored in the storage unit 15 based on the search characters received by the screen control unit 11 and the touch detection unit 12. Characters input from the keyboard are converted into character data and stored as the original file text DB in association with the file. For example, the stored character data is searched with search character data (also referred to as a search keyword) for search. Can do. Thereby, a file having character data can be searched efficiently, and the convenience for the user is improved.

  More specifically, the screen control unit 11 displays a search screen for inputting handwritten characters as search characters on the display surface.

  FIG. 10 is an explanatory diagram showing an example of a search screen for inputting handwritten characters. In the example of FIG. 10, a search screen having a required size for inputting handwritten characters is displayed, and the user inputs a search character “important”. Thereby, the user can input a search character by writing a character with a pen or a finger in a search screen.

  And the character conversion part 14 converts the handwritten character input into the search screen into search character data. The search unit 17 searches for a file by referring to the handwritten character DB stored in the storage unit 15 based on the search character data converted by the character conversion unit 14. Since the file is associated with the character data converted from the handwritten input and the handwritten character, the file can be efficiently searched by handwriting, and the convenience for the user is improved.

  When searching for a file based on handwritten characters input on the search screen, the handwritten characters input on the search screen and the handwritten characters associated with the file may be searched by processing such as pattern matching. Good.

  The thumbnail control unit 18 has a function as a reduced image display unit. When the file associated with the character data that matches the character data searched by the search unit 17 is specified, the thumbnail control unit 18 displays the specified file as a reduced image (also referred to as a thumbnail). The reduced image of the file may be, for example, a reduced image of the first page of the file or a reduced image of a page including character data that matches the search character data. Further, when a plurality of files are specified, a reduced image of each of the plurality of files can be displayed.

  FIG. 11 is an explanatory diagram showing an example of a thumbnail display of a file. FIG. 11 shows thumbnails of files having character data “important” or handwritten characters as a result of searching with the search character “important” exemplified in FIG. 10 with reference to the handwritten character DB exemplified in FIG. 9. Is. As shown in FIG. 9, among the four files “new note”, “idea memo”, “design review”, and “NewsReleaseFile”, files that include the letters “important” are called “new note” and “NewsReleaseFile”. Since there are two files, thumbnails of these two files are displayed as shown in FIG. In the example of FIG. 11, the number of files displayed as thumbnails is 2 for simplicity, but the number of files is not limited to this.

  When searching many files by displaying a reduced image of a file, or when one file is composed of many pages, a file associated with character data or handwritten characters matching the search character data Even when a large number of files are identified, many files can be displayed as a list at the same time. And since a desired file can be found easily, a user's convenience improves.

  The screen control unit 11 and the touch detection unit 12 have a function as a file selection unit. The screen control unit 11 and the touch detection unit 12 are specified when a plurality of files associated with character data or handwritten characters that match the character data searched by the search unit 17 are specified (for example, as illustrated in FIG. 11). An operation for selecting reduced images of a plurality of files is accepted. For example, the user can select a reduced image by touching (touching) the reduced image of the file displayed on the display surface.

  When the thumbnail control unit 18 receives a file selection operation, the thumbnail control unit 18 includes one or a plurality of pages including character data that matches the search character data or handwritten characters among the pages constituting the file corresponding to the selected reduced image. Display a reduced image of.

  FIG. 12 is an explanatory view showing an example of a thumbnail display of a page. The example of FIG. 12 shows a case where the file “NewsReleaseFile” is selected in the illustration of FIG. As shown in FIG. 9, of the pages constituting the file “NewsReleaseFile”, the pages including the character data “important” as the search character data or the handwritten characters are the first page and the third page. Accordingly, as shown in FIG. 12, the images of pages 1 and 3 of the file “NewsReleaseFile” are displayed as thumbnails. In the example of FIG. 12, the number of pages displayed as thumbnails is 2 for simplicity, but the number of pages is not limited to this.

  By displaying a reduced image of the pages that make up the file, when searching many files, or when one file consists of many pages, character data or handwritten characters that match the search character data Even when many associated pages are identified, many pages can be displayed as a list at the same time. And since a desired page can be found easily, a user's convenience improves.

  The screen control unit 11 and the touch detection unit 12 have a function as a page selection unit. The screen control unit 11 and the touch detection unit 12 accept an operation of selecting a reduced image for each of one or more pages displayed on the display surface. For example, the user can select a reduced image by touching (touching) the reduced image of the page displayed on the display surface.

  The screen control unit 11 has a function as a display control unit. When the screen control unit 11 accepts a page selection operation, the character data or handwritten characters that match the search character data included in the page corresponding to the selected reduced image are displayed on the page corresponding to the selected reduced image. It is displayed in a display mode different from that of other included character data (that is, character data that does not match search character data) or handwritten characters.

  FIG. 13 is an explanatory diagram showing an example of the display of searched characters. The example of FIG. 13 shows a case where the first page is selected in the example of FIG. As shown in FIG. 13, the character “important” as the search character is highlighted and displayed differently from the other characters. That is, character data or handwritten characters that match the search character data and character data or handwritten characters that do not match are displayed in different display modes. Displaying in a different display form means, for example, displaying character data or handwritten characters that match the search character data with emphasis and displaying character data or handwritten characters that do not match without emphasis. Highlighting display includes highlighting a rectangular area surrounding the character, changing the color of the character, changing the font or size of the character, and the like. By highlighting and displaying, the user can easily recognize, the character to be searched can be found quickly, and the convenience of the user is improved.

  Next, the operation of the handwriting input device 100 of the present embodiment will be described. FIG. 14 and FIG. 15 are flowcharts showing an example of a processing procedure when a file is edited or created by the handwriting input device 100 of this embodiment. In the following description, the main subject of processing is the control unit 10 for simplicity. The control unit 10 displays a file for editing or new creation (S11), and determines whether there is text information (also referred to as character data or text data) of the file (S12).

  If there is text information (YES in S12), the control unit 10 stores the note name, page, text information, text information coordinates, and text font size in the original file text DB (S13). When there is no text information (NO in S12), for example, when the file is a newly created file, the control unit 10 performs the process of step S14 described later without performing the process of step S13.

  The control unit 10 accepts handwriting input (S14) and determines whether or not the pen or finger has moved (S15). A finger or the like may be used instead of the pen. When the pen moves (YES in S15), the control unit 10 draws the pen trajectory on the screen (on the display surface) (S16), and records the stroke information corresponding to the drawn trajectory (S17). When the pen is not moving (NO in S15), the control unit 10 performs the process of step S18 described later without performing the processes of steps S16 and S17.

  The control unit 10 determines whether or not the pen is separated from the display surface (S18). If the pen is not separated (NO in S18), the processing from step S15 is continued. When the pen is separated (YES in S18), the control unit 10 activates a timer (S19) and determines whether or not a predetermined time has elapsed (S20). The predetermined time can be, for example, about 1 second.

  When the predetermined time has elapsed (YES in S20), the control unit 10 performs character recognition based on the stroke information and converts handwritten characters into text data (character data) (S21). The control unit 10 stores the note name (file name), page, converted text data, and handwritten object coordinates of the file being edited or newly created in the handwritten character DB (S22). The control unit 10 erases the once recorded stroke information (S23). When the predetermined time has not elapsed (NO in S20), the control unit 10 performs the process of step S24 described later without performing the processes of steps S21 to S23.

  The control unit 10 determines whether or not there is a pen down (S24). Pen down is an operation in which the user touches the display surface with a pen that is separated from the display surface. When there is no pen-down (NO in S24), the control unit 10 performs the processing after step S20. If there is a pen down (YES in S24), the control unit 10 clears the timer (S25) and determines whether there is an end process (S26). The termination process includes, for example, an operation for closing an open file and an operation for saving. When there is no end process (NO in S26), the control unit 10 continues the process after step S15, and when there is an end process (YES in S26), the process ends.

  FIGS. 16, 17 and 18 are flowcharts showing an example of the procedure of search processing by the handwriting input device 100 of the present embodiment. The control unit 10 displays a management screen (for example, illustrated in FIG. 10) for performing a search process (S41), and determines whether or not a search keyword (search character information) is input (for example, handwritten input) (S42). ). When no search keyword is input (NO in S42), the control unit 10 continues the process of step S42.

  If there is an input of a search keyword (YES in S42), the control unit 10 refers to the handwritten DB and the original file text DB to search for a note (file) that includes the search keyword in the text data (S43). The control unit 10 determines whether or not there is a note (file) including text data that matches the search keyword (S44).

  When there is a note (file) including text data that matches the search keyword (YES in S44), the control unit 10 displays a thumbnail of the note and a note name (S45). If there is no note (file) containing text data that matches the search keyword (NO in S44), the control unit 10 displays that there is no corresponding note (file) (S46), and ends the process. The control unit 10 determines whether or not a note is selected (S47). If no note (file) is selected (NO in S47), the process of step S47 is continued.

  When a note (file) is selected (YES in S47), the control unit 10 includes a search keyword in the text data for the note (file) selected with reference to the handwritten DB and the original file text DB. A page that is present is searched (S48). The control unit 10 determines whether there is a page (page) including text data that matches the search keyword (S49).

  When there is a page (page) including text data that matches the search keyword (YES in S49), the control unit 10 displays a thumbnail and a page number of the page (S50). When there is no page including text data that matches the search keyword (NO in S49), the control unit 10 displays that there is no corresponding page (S51), and ends the process. The control unit 10 determines whether or not a page has been selected (S52). If no page has been selected (NO in S52), the process of step S52 is continued.

  If there is a page selection (YES in S52), the control unit 10 searches the selected text with reference to the handwritten DB and the original file text DB for the first text data that matches the search keyword (S53). ). The control unit 10 determines the presence / absence of text data (S54).

  If there is no text data (NO in S54), the control unit 10 ends the process. If there is text data (YES in S54), the control unit 10 determines whether the text data is a converted handwritten character (S55). If the text data is a converted handwritten character (in S55). (YES), the area specified by the handwritten object coordinates is highlighted (highlighted), the page is displayed (S56), and the process is terminated.

  When the handwritten character is not converted (NO in S55), the control unit 10 highlights (highlights) the area specified by the start coordinates, the number of text data, and the font size and displays the page (S57). The process is terminated. The area specified by the start coordinate, the number of text data, and the font size is an area that encloses the character data obtained by converting characters entered using the keyboard, etc. It can be specified by size.

  The processing performed by the handwriting input device 100 according to the present embodiment can be realized using a general-purpose computer including a CPU, a RAM, and the like. That is, a recording medium in which a computer program that defines each processing procedure as shown in FIGS. 14 to 18 is recorded is read by a recording medium reader provided in the computer, and the computer program is loaded into a RAM. By executing the program on the CPU, a handwriting input device can be realized on the computer.

(Embodiment 2)
In the first embodiment, as a handwriting input device, a device such as a tablet terminal has been described as an example. However, the handwriting input device is not limited to a tablet terminal or the like, and information can be received by a plurality of users. The present invention can also be applied to a display device including a large display surface that can be shared.

  FIG. 19 is an explanatory diagram showing an example of the appearance of the handwriting input device 120 according to the second embodiment. In the second embodiment, the handwriting input device 120 is a touch panel device including a large display unit 216 (for example, 60 inches, 70 inches, 80 inches, etc.).

  Around the display portion 216, a light emitting portion having a plurality of light emitting diodes emitting infrared light and a light receiving portion having a plurality of photodiodes receiving infrared light are provided. When the user touches (contacts) the display unit 16 with a touch pen or a finger, infrared light from the light emitting unit is blocked according to the touched position, and the touch position can be detected. Note that the handwriting input device 120 according to the second embodiment also has the same effects as those illustrated in FIGS.

  As described above, in the handwriting input device according to the first and second embodiments, it is possible to search for characters written by handwriting input, a file in which handwritten characters are recorded, a page in the file, Characters in the page can be easily found, data can be easily organized or managed, and user convenience is improved. Further, the technical features described in the above embodiments of the present invention can be combined with each other to form a new technical plan.

  The handwriting input device (100, 120) of the present embodiment is a handwriting input device including a display surface (16, 216) capable of handwriting input, and includes one or more pages constituting one file. A file display unit (11) for displaying on the display surface, a character conversion unit (14) for converting handwritten characters input to one or more pages displayed on the file display unit into character data, and the character conversion A storage unit (15) for storing the character data converted by the unit and the file in association with each other.

  The handwriting input method using the handwriting input device (100, 120) according to the present embodiment is a handwriting input method using a handwriting input device including a display surface (16, 216) capable of handwriting input. The file display unit (11) displays one or more pages constituting the file on the display surface, and the character conversion unit (14) converts the displayed handwritten characters input to the one or more pages into character data. And a step of associating the converted character data with the file and storing them in the storage unit (15).

  In the present embodiment, the file display unit (11) displays one or more pages constituting one file on the display surface (16, 216). One file (also referred to as a note) may be displayed for creating a new file, or may be displayed for editing, for example, an already created file. The character conversion unit (14) converts handwritten characters input to one or more pages displayed on the display surface into character data. That is, a page is displayed on a display surface where handwritten input is possible, and handwritten characters are written on the displayed page with a pen or a finger. When a handwritten character is written on the display surface, a pen or finger locus is drawn on the display surface, and stroke information corresponding to the locus is acquired. The character conversion unit recognizes a character based on the stroke information and converts the handwritten character into character data (also referred to as text data).

  The converted character data is stored in the storage unit (15) in association with the file. For example, when a file is composed of one or a plurality of pages, each character data obtained by converting handwritten input is stored as a file name (also referred to as a note name), a page (page, The page position (also referred to as page number), the position on the page (for example, when the page is expressed in xy coordinates, the x-coordinate and y-coordinate of the character data), and the like. Since the handwritten character is converted into character data and stored in association with the file, for example, the stored character data can be searched with search character data (also referred to as a search keyword) for search. As a result, it is not necessary to include all or part of the characters written by handwriting in the file name, and there is no restriction on the number of characters to be searched, so the file can be searched efficiently, and the user can Improved convenience.

  The handwriting input device (100, 120) of the present embodiment includes a reception unit (11, 12) that receives a search character for searching for the file, and the storage unit based on the search character received by the reception unit And a search unit (17) for searching for a file stored in.

  In the present embodiment, the receiving units (11, 12) receive search characters for searching for files. The search character may be a character input by handwriting or a character input by a keyboard or the like. A search part (17) searches the file memorize | stored in the memory | storage part based on the search character received in the reception part. Since the file is associated with the character data obtained by converting the handwritten input, the file can be searched efficiently, and the convenience for the user is improved.

  In the handwriting input device (100, 120) according to the present embodiment, the receiving unit (11, 12) displays a search screen for inputting a handwritten character as the search character on the display surface. The character conversion unit (14) converts the handwritten characters input on the search screen into search character data for search, and the search unit (17) converts the character conversion unit by the character conversion unit. A file stored in the storage unit (15) is searched based on search character data.

  In the present embodiment, the receiving units (11, 12) display a search screen for inputting handwritten characters as search characters on the display surface. Thereby, the user can input a search character by writing a character with a pen or a finger in a search screen. A character conversion unit (14) converts handwritten characters input to the search screen into search character data. The search unit (17) searches the file stored in the storage unit (15) based on the search character data converted by the character conversion unit. Since the file is associated with the character data obtained by converting the handwritten input, the file can be efficiently searched by handwriting, and the convenience for the user is improved.

  The handwriting input device (100, 120) of the present embodiment displays a reduced image when a file associated with character data matching the character data searched by the search unit (17) is specified. A reduced image display unit (18) is provided.

  In the present embodiment, the reduced image display unit (18) reduces the specified file when the file associated with the character data matching the character data searched by the search unit (17) is specified. Display as an image (also called a thumbnail). The reduced image of the file may be, for example, a reduced image of the first page of the file or a reduced image of a page including character data that matches the search character data. Further, when a plurality of files are specified, a reduced image of each of the plurality of files can be displayed. By displaying a reduced image of the file, when many files are searched, or when one file consists of many pages, many files associated with the character data that matches the search character data are specified. When it is done, many files can be displayed as a list at the same time. And since a desired file can be found easily, a user's convenience improves.

  When the handwriting input device (100, 120) of the present embodiment identifies a plurality of files associated with character data that matches the character data searched by the search unit (17), A file selection unit (12) that receives an operation for selecting a reduced image is provided, and the reduced image display unit (18) configures a file corresponding to the selected reduced image when the operation is received by the file selection unit. The reduced image of each of one or a plurality of pages including character data matching the search character data is displayed.

  In the present embodiment, when a plurality of files associated with character data that matches the character data searched by the search unit (17) are specified, the file selection unit (12) specifies the specified plurality of files. An operation for selecting a reduced image of a file is accepted. For example, the user can select a reduced image by touching (touching) the reduced image of the file displayed on the display surface. The reduced image display unit (18), when a selection operation is received by the file selection unit, includes one or a plurality of character data including character data that matches the search character data among the pages constituting the file corresponding to the selected reduced image. A reduced image of each page is displayed. By displaying a reduced image of a page, when many files are searched, or when one file is composed of many pages, many pages associated with character data matching the search character data are specified. When it is done, many pages can be displayed as a list at the same time. And since a desired page can be found easily, a user's convenience improves.

  The handwriting input device (100, 120) according to the present embodiment includes a page selection unit (12) that receives an operation for selecting a reduced image of each of one or more pages displayed on the display surface, and the page selection unit. When the operation is accepted, the display control unit displays character data that matches the search character data included in the page corresponding to the selected reduced image in a display mode different from the other character data included in the page. (11).

  In the present embodiment, the page selection unit (12) receives an operation for selecting a reduced image for each of one or more pages displayed on the display surface. For example, the user can select a reduced image by touching (touching) the reduced image of the page displayed on the display surface. When the selection operation is received by the page selection unit, the display control unit (11) sets character data that matches the search character data included in the page corresponding to the selected reduced image to the page corresponding to the selected reduced image. Is displayed in a display mode different from that of other character data included in the character string (that is, character data that does not match the search character data). That is, the character data that matches the search character data and the character data that does not match are displayed in different display modes. Displaying in a different display mode is, for example, displaying character data that matches the search character data with emphasis and displaying character data that does not match without emphasis. By highlighting and displaying, the user can easily recognize, the character to be searched can be found quickly, and the convenience of the user is improved.

  The handwriting input device (100, 120) of the present embodiment is included in the file display unit (11) when one or more pages constituting one file are displayed on the display surface, An extraction unit (19) for extracting character data different from character data obtained by converting handwritten characters, and a storage unit (15) for storing the character data extracted by the extraction unit and the file in association with each other To do.

  In the present embodiment, when the file display unit (11) displays one or more pages constituting one file on the display surface, the extraction unit (19) is included in the displayed file and handwritten. Character data different from the character data obtained by converting characters is extracted. Character data different from character data obtained by converting handwritten characters is not character data obtained by converting handwritten characters but character data obtained by converting characters input by a keyboard or the like.

  The extracted character data is stored in the storage unit (15) in association with the file. For example, when a file is composed of one or a plurality of pages, each character data obtained by converting characters input from the keyboard is stored as a file name (also referred to as a note name), a page. (Also referred to as a page or page number), a position on a page (for example, when a page is expressed in xy coordinates, the x-coordinate and y-coordinate of the position of character data), a font size, and the like. Since the characters input from the keyboard are converted into character data and stored in association with the file, for example, the stored character data can be searched with search character data for search (also referred to as a search keyword). Thereby, a file having character data can be searched efficiently, and the convenience for the user is improved.

DESCRIPTION OF SYMBOLS 10 Control part 11 Screen control part 12 Touch detection part 13 Handwritten input part 14 Character conversion part 15 Memory | storage part 16,216 Display part 17 Search part 18 Thumbnail control part 19 Extraction part

Claims (7)

A handwriting input device having a display surface capable of handwriting input,
A file display unit for displaying one or more pages constituting one file on the display surface;
A character conversion unit that converts handwritten characters input to one or more pages displayed in the file display unit into character data;
A storage unit that stores the character data converted by the character conversion unit in association with the file ;
When the file display unit displays one or more pages constituting one file on the display surface, an extraction unit that extracts character data that is included in the file and that is different from character data obtained by converting handwritten characters;
A storage unit for storing the character data extracted by the extraction unit in association with the file;
A reception unit for receiving a search character for searching for the file;
A handwriting input device comprising: a search unit that searches for a file stored in each of the storage units based on a search character received by the reception unit. The handwriting input device according to claim 1, wherein at least one of the files to be searched includes a plurality of pages . The reception unit
A search screen for inputting handwritten characters as the search characters is displayed on the display surface;
The character conversion unit
The handwritten characters input on the search screen are converted into search character data for search,
The search unit
3. The handwriting input device according to claim 1, wherein a file stored in each of the storage units is searched based on search character data converted by the character conversion unit.   The method according to claim 3, further comprising a reduced image display unit that displays a reduced image when the file associated with the character data matching the character data searched by the search unit is specified. Input device. When a plurality of files associated with the character data matching the character data searched by the search unit is specified, the file selection unit receives an operation of selecting a reduced image of the plurality of files,
The reduced image display unit includes:
When the operation is accepted by the file selection unit, a reduced image of each of one or a plurality of pages including character data matching the search character data is displayed among pages constituting a file corresponding to the selected reduced image. The handwriting input device according to claim 4, wherein the handwriting input device is configured as described above. If said Installing receives an operation of selecting one or more pages each reduced image displayed on the display surface, in the character data matching the search character data included in the page corresponding to the reduced image selected, 6. A display control unit that displays at least character data obtained by converting the handwritten character by the character conversion unit in a display mode different from character data that does not match the search character data included in the page. The handwriting input device described in 1. A handwriting input method by a handwriting input device having a display surface capable of handwriting input,
A file display unit displaying one or more pages constituting one file on the display surface;
A step in which a character conversion unit converts handwritten characters input on one or more displayed pages into character data;
Storing the converted character data and the file in association with each other in the storage unit ;
When the file display unit displays one or more pages constituting one file on the display surface, the extraction unit extracts character data included in the file and different from character data obtained by converting handwritten characters; ,
Associating the extracted character data with the file and storing them in a storage unit;
Receiving a search character for searching for the file;
A search unit searching for a file stored in each of the storage units based on an accepted search character .

Images