JPH10134003A - Handwritten data managing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a handwritten data managing device with which attributes can be applied to handwritten data by simple operation and the usability of handwritten data is improved. SOLUTION: An operation analytic part 102 accepts the input of handwritten data from an input control parts 101 and lets a display control part 103 displays these data within a display frame on a display screen. A note preparing part 105 and a note managing part 106 prepares notes with the handwritten data in this display frame as contents. A small note preparing part 107 and a small note managing part 108 prepare small notes according to user operation and when the display position of small notes are overlapped with the display frame according to user operation, the notes within that display frame are stored in a data storage part 104 as a parent and a child while defining the notes within that display frame as parent and these small notes as child.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a handwritten data management device for creating, managing, and using handwritten memos by simple operations.

[0002]

2. Description of the Related Art In recent years, devices that manage handwritten data as image data have attracted attention. For example, PDA
Portable devices called (Personal Digital Assistance) are becoming widespread. A general PDA has a configurable small display screen and a tablet, and stores handwritten input data for a plurality of screens as they are so that they can be used instead of memo sheets.

Further, there is an information processing apparatus for managing handwritten data together with attributes. In this type of device, as shown in FIG. 19, a predetermined attribute such as a name or an address is given in advance to an input field 2 of a data input screen. Then, when the user inputs data corresponding to the attribute of the corresponding input field 2 using a keyboard or the like, data with the attribute is automatically created and many data are managed (for example, JP-A-62-217388).

[0004] Although not shown, as another conventional configuration, there is disclosed a configuration in which an attribute is given from a keyboard as a method of managing the data by giving an attribute to image data read by an image scanner or the like (see FIG. 1). For example, JP-A-63-148374.

[0005]

However, in the above-mentioned conventional configuration, a method of inputting attribute data into a fixed input field in order to manage a large amount of data is very convenient from the viewpoint of an information processing apparatus. However, there is a problem that a user's psychological stress is large in filling fixed input items for a specific application.

On the other hand, with respect to a method of assigning attributes to input data later to manage the data, the conventional method of inputting attributes using a keyboard is not suitable for a person who is not accustomed to handling this type of information processing apparatus. Similarly, there was a problem that it was difficult to use. In view of the above-mentioned problems, an object of the present invention is to provide a handwritten data management device that can assign and manage attributes to handwritten data with a simple operation, and enhances the usability of handwritten data.

[0007]

In order to solve the above-mentioned problems, a handwritten data management device according to the present invention is provided with input display means for receiving an input of handwritten data and displaying the data in a display frame on a display screen; A memo creating means for creating a memo containing the handwritten data of the frame, a mini memo consisting of attributes and data according to a user operation, and a mini memo creating means for displaying on a display screen, and a display position of the mini memo according to the user operation. Display position control means to be moved, as a result of the movement, when an overlap between the mini memo and the display frame occurs, a parent and child data creating means for creating a parent and child data with the memo of the display frame as a parent and the mini memo as a child, Data storage means for storing a memo, a mini memo, and parent-child data is provided.

Here, the mini memo creating means includes an attribute indicating a telephone number, an attribute indicating a fax number, an attribute indicating an e-mail address, an attribute indicating an amount of money, an attribute indicating a voice, an attribute indicating an image, and an attribute indicating another device. Alternatively, a mini memo may be created using any one of the attributes indicating the control instruction as an attribute. Further, a software storage means for storing a plurality of software, an execution means for executing the software, a detection means for detecting a user's use request for the displayed mini memo, and a detection means for detecting a use request according to the attribute of the mini memo when the use request is detected. Starting means for starting the executing means to execute the software.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION

<Structure of Entire Home Information System> FIG. 1 is a schematic diagram of an entire home information system including a home information terminal according to an embodiment of the present invention. This system is configured by connecting a home information terminal 1 and a plurality of home appliances 2, 3, 4, and the like.

The home information terminal 1 has an aspect as a control terminal device for controlling various home appliances and a handwritten data management device for creating, managing, and using information (mainly handwritten data) in the home. It is configured to have both sides and to operate in conjunction with both sides. The plurality of home devices 2, 3, 4,... Are various devices controlled by the home information terminal 1. For example,
The household appliance 2 is a water heater for a bathtub, the household appliance 3 is an air conditioner device, the household appliance 4 is a door phone with a TV camera, etc., each of which can operate under the control of the household information terminal 1. It is. Control of these household appliances is realized by the aspect of the home information terminal 1 as a control terminal device. For example, a home bus system (Japan Electronics Machine Industry Association Standard, Radio Technology Association Standard, E
T-2101 "Home Bus System", September 1988
The detailed description is omitted because it can be realized by the existing technology such as Mon. In addition, the control of the home appliances is not limited to the home bus system, and control using wireless communication, for example, may be used.

Hereinafter, the side of the home information terminal 1 as a handwritten data management device and the configuration in which the above both sides are interlocked will be mainly described. <External View> FIG. 2 is an example of an external view of the home information terminal 1 of FIG. The home information terminal 1 shown in FIG. 1 integrates a tablet for inputting handwritten data and a display screen, and further includes a ten-key keyboard that can be operated by anyone, in order to improve operability so that anyone in the home can use it. It has a good appearance. Although only a numeric keyboard is shown in FIG. 1, a full keyboard can be separately provided.

<Hardware Configuration> FIG.
1 is a diagram showing a hardware configuration of a home information terminal 1 of FIG. The home information terminal 1 of FIG. 1A includes a CPU 11, a memory 12, a hard disk 13, a communication control unit 14,
D control unit 15, LCD panel 16, input / output control unit 17,
A tablet 18, a keyboard 19, a speaker 20, a microphone 21, and a home device I / F 22 are provided. Tablet 1
8 and the LCD panel 16, the input position and the display position correspond to each other as shown in FIG.

In FIG. 1A, a portion including a CPU 11, a memory 12, a hard disk 13, a communication control unit 14, an LCD control unit 15, an LCD panel 16, an input / output control unit 17, a keyboard 19, a speaker 20, and a microphone 21 Since this corresponds to the hardware configuration of a conventional general personal computer, a detailed description of the hardware is omitted. Here, a description will be given of how the home information terminal 1 of the present embodiment is realized by combining the hardware in FIG.

The home information terminal 1 of this embodiment has a CPU
11 is realized by executing specific software in the memory 12. The specific software mentioned here is
It is composed of software for realizing the aspect of the handwritten data management device, and software for realizing the interlocking between the control terminal device and the handwritten data management device. In addition to the specific software described above, the hard disk 13 includes control software for realizing aspects of the control terminal, telephone software for making and receiving general telephone calls, FAX software for transmitting and receiving FAX, It stores software for sending and receiving electronic mail, household account book software for managing household account books, and OS (operating system) software.

Here, the OS may be a general OS of a personal computer or a workstation, and is preferably an OS having a GUI (Graphical User Interface) environment by window display. As software other than the above-described specific software, conventional software can be used. <Functional Block Diagram> FIG. 4 is a functional block diagram of the home information terminal 1. The function of each block shown in FIG. 3 is realized by executing the above software on the hardware shown in FIG.

As shown in FIG. 4, the home information terminal 1 comprises:
Input control unit 101, operation analysis unit 102, display control unit 10
3. Data storage unit 104, memo creation unit 105, memo management unit 106, mini memo creation unit 107, mini memo management unit 10
8, a memo 130 created as handwritten data on a display screen and a mini memo 1 representing a telephone number, etc., as shown in FIG.
It is configured such that the memo and the attached mini memo can be managed and used as one piece of data in response to an operation of individually creating 31 to 133 and moving the mini memo on the memo. Here, the memo refers to data having handwritten input data as a content. The mini memo refers to a combination of data indicating the attribute of the memo or the type indicating the attribute of the mini memo.

In FIG. 1, an input control unit 101 controls a tablet 18, a keyboard 19, and a microphone 21 to enable a user to input data and to input a user input to an operation analysis unit 10.
Output to 2. The operation analysis unit 102 includes an input control unit 101
By analyzing the input content from, an operation instruction or data input is determined. Further, when the determination result is an operation instruction, each of the units 103, 105 to 109 is controlled according to the operation instruction. In addition, when the determination result is data, 103;
The data is passed to those requiring data among 105 to 109.

Here, the operation instructions included in the input contents of the user are mainly a memo operation instruction for creating and modifying a memo, a mini memo operation instruction for creating and modifying a mini memo, and activation of software related to the mini memo. There are instructions, window operation instructions for changing the display state of the window and moving the display position, and the like. The data included in the user operation mainly includes the tablet 18
, Data input from the keyboard 19, text data, voice data input from the speaker 20, and the like.

If the result of the analysis shows that the input content is a memo operation instruction, the operation analysis unit 102
Then, the memo management unit 106 is activated to control creation and change of a memo. When the instruction is a mini memo operation instruction, the mini memo creation unit 107 and the mini memo management unit 108 are activated to control the creation and change of the mini memo. If the instruction is an activation instruction, the activation control unit 109 is controlled to activate other software. At this time, data corresponding to the operation instruction is also delivered to each unit.

As a result of the analysis, if the input content is a window operation, the display control unit 103 is controlled to change the display position of the memo window or the mini memo or to change the display state such as iconification. In addition, when the movement of the display position of the mini memo by the user operation is detected, when the mini memo newly moves on the memo on the display screen or when the mini memo on the memo moves to another memo, the mini memo is notified. Notify the management unit 108. In this manner, the operation analysis unit 102 detects on which memo the mini memo is attached by the user operation.

The display control unit 103 controls display of a memo window, an icon, a mini memo, an operation menu, and the like and movement on the screen according to the control from the operation analysis unit 102. The data storage unit 104 is provided in the memory 12 or the hard disk 13, and stores a memo created by the memo creation unit 105.
And a mini memo management table 104b for storing the mini memo created by the mini memo creating unit 107,
Stores information for managing notes and mini-memos,
The image data in the memo and the data in the mini memo are stored as files.

The memo creation unit 105 creates and corrects image data for a new memo and an existing memo under the control of the operation analysis unit 102. The memo management unit 106 stores the image data created in the memo creation unit 105 under the control of the operation analysis unit 102 in the memo management table 104a, and stores the existing memo and the mini memo attached thereto in the memo management table 104a. 104a and mini memo management table 10
4b, and updates the image data after correction by the memo creator 105. Further, the operation analysis unit 102
The memo is also deleted according to the instruction of.

The mini-memo creation unit 107 includes the operation analysis unit 10
Under the control of 2, a new mini memo is created and an existing mini memo is modified. The mini-memo management unit 108 stores the mini-memo created in the mini-memo creation unit 107 under the control of the operation analysis unit 102 in the mini-memo management table 104b, reads out the existing mini-memo from the mini-memo management table 104b, and Update to the mini memo modified by 107. Further, the mini memo is also deleted according to the instruction of the operation analysis unit 102.

The execution unit 110 includes a telephone unit 110a, a facsimile
Section 110b, household account book section 110c, door phone control section 110
d, an air conditioner control unit 110e, and the like. Telephone section 11
0a, FAX section 110b, household account book section 110c, door phone control section 110d, air conditioner control section 110e, and electronic mail section 110f are respectively realized by telephone software, household account book software, door phone control software, air conditioner control software, and electronic mail software. Has functions.

When receiving an instruction to start software related to the mini-memo from the operation analysis unit 102, the start control unit 109 starts one of the execution units 110 according to the type of the mini-memo, that is, starts the corresponding software. Storage Contents of Data Storage Unit 104> FIG. 5A shows an example of storage contents of the memo management table in the data storage unit 104. One memo is managed by memo identifier, display state, icon number, user, display position, application, date, title, and image file as shown in FIG. Note that other items may be provided.

Here, the "memo identifier" is an identifier for specifying each memo, and is represented by a number such as memo 1 and memo 2 in the present embodiment. "Display state" is the current display state of the memo, including image display, reduced display,
Indicates the status of the icon display. The image display means that the memo is displayed in the window in the same state as when the memo is input, that is, with the image data. Reduced display means that image data is reduced and displayed in a window.
The icon display is to display an icon representing a memo.

The "icon number" indicates the type of the icon used for displaying the icon. “User” represents the creator or user of the handwritten memo. The “display position” indicates the display position of the window of the handwritten memo, and in this embodiment, indicates the upper left coordinates (X, Y) of the window. "application"
Indicates the name of the application in which the memo is used.
For example, when set as a browser, it is managed in the browser processing described later, and when another application name such as household account book software is set, it is used for the application in addition to the browser Means

"Date" indicates the date when the memo was created. “Title” is the title of the handwritten memo and is displayed attached to a window or icon. "Image File"
Represents a storage position in the hard disk for storing image data of the handwritten memo, or a file name.

FIG. 5B shows an example of the mini memo management table 104b in the data storage unit 104. FIG.
Like the mini memo management table, the mini memo identifier,
It is managed by items to be pasted, relative position, type, data or file name, and data type. Here, the “mini memo identifier” is an identifier for specifying each mini memo, and is represented by a number such as mini memo 1 and mini memo 2 in the present embodiment.

The "pasting destination (or parent)" is set with the identifier of the memo (or parent memo) of the pasting destination, and indicates to which memo the mini memo is pasted. "Relative position"
It represents the relative coordinates in the memo window of the paste destination, and in this embodiment, indicates the relative coordinates (x, y) at the upper left of the mini memo. “Type” indicates the type number of the mini memo, that is, the attribute of the data of the mini memo or the attribute of the memo of the paste destination.
Type number 1 is phone number, 2 is FAX number,
3 is the amount, 4 is the household equipment 4 (doorphone)
Instruction or memo for the home appliance 3
(Air Conditioner) indicates a control instruction or memo, 6 indicates an e-mail address, and 7 indicates voice data such as a message. This type indicates which software should process the data of the memo and the mini memo while giving the attribute to the memo and the mini memo to facilitate the memo management. In addition, the contents of the type are not limited to the above, and may include images, sounds, images as images, still images, animations,
You may add a type called a moving image. In this case, FIG.
An input device such as a scanner or a video capture may be provided in the hardware configuration of FIG.

The "data or file name" is data of the mini memo itself, and is data such as a telephone number, a fax number, an e-mail address, an amount, a voice, and an image. For small data, the data itself is set, audio,
The file name is set for large data such as an image. The “data type” indicates a data type of a data or a file name, for example, a numerical value, a text, a type of a still image, a type of audio data, and the like. The data type is information that complements the type. For example, when the type represents a still image, a bitmap, a type of compressed data, and the like are further set according to the data type. The operation of the home information terminal 1 configured as described above with more appropriate software when using memo and mini memo data will be described below.

<Schematic Processing Flow of Home Information Terminal 1> FIG. 6 is a flowchart showing the outline processing contents of the home information terminal 1 as a handwritten data management device. First,
The home information terminal 1 activates the specific software in accordance with a user operation on the OS, whereby
(Step 601), the operation as the handwritten data management device is started.

Here, reference numeral 120 in FIG.
6, the display screen 121 is displayed by the above specified software.
This is a screen for creating, modifying, managing, and using memos and mini memos (hereinafter referred to as a memo management screen). In the memo management screen 121, 121a is a memo window for creating, modifying, and displaying a memo, 121b is a mini memo creation window for creating a mini memo, 121c is a type selection button for designating the type of mini memo, and 121d is a type selection button. Various operation instruction input palettes 121e are selection palettes for displaying a list of types and users that can be set in the memo. Although only one memo window is shown in FIG. 12, a plurality of memo windows can be displayed.

After displaying the memo management screen 121, the operation analysis unit 102 determines whether the user input is a memo operation (step 602) or a mini memo operation (step 60).
3) It is determined whether the operation is a window operation (step 604) or an instruction to start software related to a mini memo (step 605), and a memo creation process (step 606) and a mini memo creation process (step 6
07), window operation processing (step 608), and software activation processing (step 609). After the transfer, the operation analysis unit 102 executes the memo creation process in cooperation with the memo creation unit 105 and the memo management unit 106, and executes the mini memo creation process with the mini memo creation unit 10
7 and the mini memo management unit 108, and the activation control unit 109 executes the activation process.

Note that, in the flow of FIG.
After the four processes 609 are completed, the operation analysis unit 102
It looks as if the process returns to the determination process (steps 602 to 605), but in practice, the four processes and the determination process can be executed in parallel. Therefore, it is possible to create a mini memo or perform a window operation during memo creation.

<Memo Creation Processing Flow> FIG. 7 is a flowchart showing the memo creation processing in FIG. First, the operation analysis unit 102 executes the memo management screen 121 shown in FIG.
The memo window 121a is displayed on the display control unit 103 (step 701). At this time, a new memo window is opened when a new memo is created, and a memo is read out from the memo management table 104a via the memo management unit 106 when the existing memo is called, and the memo window 121a is read. The image data of the memo is displayed in the box.

In this state, the memo creation unit 105 transmits the operation instruction from the tablet and the handwritten data to the input control unit 10.
1 and the operation analysis unit 102, and when the operation instruction is new handwritten data input (step 702), image data is created in accordance with the handwritten data (step 703), and the operation instruction is used to modify existing data. At this time (step 704), the image data is corrected accordingly (step 705). When the operation instruction is to specify a title, a user, and an icon (step 7).
06), and temporarily store data designating a title, a user, and an icon (step 707).

The input of the operation instruction at this time is, for example, every time the operation instruction input palette 121d of FIG.
Step 2 can be performed by sequentially changing input modes such as a title input mode, an icon and user designation mode, and a deletion mode. FIG. 12 shows an example in which the selection palette 121e for specifying an icon and a user is displayed by touching the operation instruction input palette 121d, and the mode is a mode for specifying the icon and the user. The upper part of the selection palette 121e in FIG. 13 is a memo icon candidate (indicated by ◆, ◎,... For simplicity of illustration), and the lower part is a mark of a user's mark displayed over the icon. Candidates (in the drawing, the colors are different from each other, the pins for stabbing the icons are made into a graphic, and which marks represent which users are shown in a correspondence table outside the drawing). The memo creator 105 temporarily stores the icon, the user, and the title according to the data input in the input mode set in this manner.

Further, when the operation instruction is a memo creation end (or memo storage) (step 708), the memo creation unit 105 writes the created image data, the selected icon, the user, and the title name in the memo. Output to the management unit 106. The memo management unit 106 stores the image data as a file in the data storage unit 104, and registers or updates the memo number, the display position, the date, etc. in the memo management table 104a together with the icon, the user, and the title (step 709). Then, the memo creation process ends.

<Mini-Memo Creation Processing Flow> FIG.
9 is a flowchart showing a mini memo creation process in FIG. The mini memo creation window 121b is always displayed on the memo management screen 121 in FIG. 12, and when the mini memo creation window 121b is activated (selected) by a user operation, the process shifts to the mini memo creation process. More specifically, when the user touches the mini memo creation window 121b, the operation analysis unit 102 determines that the operation is a mini memo operation instruction, and the display control unit 1
03, the mini memo creation window 121b is selected.

In this state, when the type selection button 121c is touched, the operation analysis unit 102 causes the display control unit 103 to sequentially change the button display each time the type selection button 121c is touched. For example, each time the display control unit 103 is touched, “￥”,
"TEL", "FAX", "MAIL", "A / C", "DOOR",
The display indicating the type (characters or figures) such as “hot water” is changed in order. In addition, the titles of the above types are, in order, an amount, a telephone number, a fax number, an e-mail address, control of an air conditioner, control of a door phone,
It means the control of the water heater.

The mini memo creating unit 107 temporarily holds the displayed button as the selected type (step 80).
1). Therefore, if the user displays the desired type, the user has selected. Further, when the data of the mini memo is input by the ten keys or the keyboard for the mini memo creation window 121b by the user operation (step 802), the mini memo creation window 121b is moved to any memo according to the user operation (step 803). Thereafter, the mini memo creating unit 107 outputs the data and the selected type to the mini memo managing unit 108.
In response to this, the mini memo management unit 108 stores the data in the data storage unit 104, and stores the file name, type, data type, identifier of the destination memo, and the relative coordinates of the memo in the mini memo management table. Registered in 104b (step 804).

The modification of the mini memo is performed in the same manner as the mini memo created in the mini memo creation window 121b for the mini memo attached to the memo. <Processing Flow of Window Operation> FIG. 9 is a flowchart showing the window operation processing in FIG. When the memo window or the mini memo is dragged or clicked, the operation analysis unit 102 determines that the operation is a window operation process. In other words, a user input (i.e., a drag operation) of touching off a predetermined portion of a window (for example, a title bar) or a predetermined portion of a mini memo (for example, a display range of the mini memo) on the screen while touching the tablet is received. At this time, and when a predetermined portion of the window or mini memo is touched (that is, clicked), the operation analysis unit 102 determines that the operation is a window operation process, and performs the following process according to the flow of FIG.

First, a window 121b for creating a mini memo
If the mini memo created in step or a mini memo already existing on the memo is dragged and moved (step 901),
The operation analysis unit 102 acquires the old coordinates and the new coordinates before and after the movement from the input control unit 101 (step 902),
If the new coordinates are in any of the memo windows (step 903), it is updated to the mini memo management table 104b via the mini memo management unit 108 (step 904). For example, as shown in FIG. 14, when the existing mini memo 131 moves from the memo window 130 to the memo window 140, the mini memo management unit 108 sets the identifier of the memo (memo window 140) to which the new coordinates belong to the mini memo. And the relative coordinates of the mini memo in the memo window are obtained, and the mini memo management table 104b is updated as the "relative coordinates" of the mini memo.

If the new coordinates of the mini memo are outside of all the memo windows and within the display range of the trash can icon (step 905: YE
S), the mini-memo management unit 108 deletes the mini-memo (step 906). If it is outside the memo window and outside the display range of the trash can icon (step 905: NO), the display control unit 103 is controlled to return the display position of the mini memo to the old coordinates (step 907).

Also, the operation analysis unit 102 performs a click (touch) on a predetermined portion (for example, a part on the upper right) of the memo window and a double click (two touches) on the memo icon. , Note expansion /
It is determined that the instruction is a reduction instruction (step 908), and the display control unit 103 is instructed to change the display state of the memo window (step 910). Specifically, the display state is
For example, if the display state when an enlargement / reduction instruction is received is an image display state, the display is reduced, if the display is reduced, the icon is displayed, and if the icon is displayed, the image is displayed. The three states are changed sequentially. At this time, in the reduced display of the three display states, the display control unit 103 reduces the memo window to a size equivalent to the width of the mini memo, and arranges the mini memos side by side from the bottom of the memo window without being reduced.

FIG. 13 shows an example of a display screen when the display state is changed. The upper part of the figure shows an example in which mini-memos 131 to 133 are attached to the memo management screen 121 and the memo 130 is displayed as an image. In this state, when the above-mentioned predetermined portion (not shown) of the memo is clicked, the memo 13
0 is a reduced display in the lower part of FIG. In the reduced display as shown in the lower part of the figure, the image data of the memo is reduced,
The mini memos are arranged from below without being reduced. Note that the types of the mini memos 131 to 133 shown in the figure represent a price, a telephone number, and an image, respectively.

When the memo is moved to the recycle bin, the operation analysis unit 102 determines that the memo is to be deleted (step 911), and causes the memo management unit 106 to delete the memo and, at the same time, causes the mini memo management unit 108 to delete the memo. To delete all mini-memos to which the memo is pasted (parent) (step 9).
12). FIG. 16 shows an example of a display screen when a memo or a mini memo is moved to the trash box. In the figure, the memo management screen 121 is displayed.
Memo 130 with mini memos 131 to 133 attached to it,
Recycle bins 181 and 182 are displayed. Here, the trash box 181 is for memo deletion, and the trash box 182 is for mini memo deletion. The operation analysis unit 102 determines that the memo 130
1 is determined to be an instruction to delete the memo 130, and when any of the mini memos 131 to 133 is moved to the trash box 182, it is determined to be an instruction to delete the mini memo. In this example 2
Although one trash can is provided to prevent erroneous operation by the user, one trash can may be provided.

The operation analyzing unit 102 determines that the memo is a browser process by a predetermined operation of the user (for example, calling a pull-down / pull-up menu) (step 9).
13) According to the designation of the menu, memo classification, search, list display and the like are performed (step 914). For example, in the categorization display of memos according to a menu operation, all memos in the memo management table 104a are categorized and displayed as icons using a specific type, icon, user, or the like designated by a user as a key, and the memo corresponds to the above key in memo search Only memos (or icons) are displayed, and the list display shows a list of classification results and search results in various display forms.

<Software Start-Up and Execution Process Flow> FIG. 10 is a flowchart showing the software start-up process and its execution process in FIG. The steps of the subroutine notation (with double lines) in FIG.
10 is an execution process by each unit, and the other steps are an activation process of the activation control unit 109.

For example, when the user performs an operation of double-clicking the mini-memo, the operation analysis unit 102 determines that the instruction is to start the software related to the mini-memo, and notifies the start control unit 109 of that. The activation control unit 109 reads the type and data of the mini memo from the data storage unit 104 via the mini memo management unit 108, and determines the type (step 1000).

When the type of the mini memo is a telephone number, the activation control section 109 activates the telephone section 110a (step a1) and transfers the data of the mini memo to the telephone section 110a as a telephone number (step a2). Since then, telephone 1
Calling, talking, ending processing, and the like are performed by 10a (step a3). FIG. 15 shows an example of a display screen when the telephone unit 110a is activated. In the figure, when the mini memo 131 is double-clicked, the telephone operation panel 150 by the telephone section 110a is displayed, and the telephone number display section 15 is displayed.
1 indicates the telephone number transferred from the activation control unit 109. If the user touches the dial button 152 in this state, a call is made to the telephone number.

When the type of the mini memo is a facsimile number,
The activation control unit 109 activates the FAX unit 110b (step b1), transfers the data of the mini memo as a FAX number to the FAX unit 110b (step b2), and further sends the mini memo attachment destination (parent) from the memo management unit 106.
FAX 110
b (step b3). Thereafter, the fax unit 110
Calling, facsimile transmission, termination processing, etc. are performed by b (step b4). In this case, a facsimile operation panel is displayed instead of the telephone operation panel on the same character display screen as in FIG. 15, and the image data of the memo 130 is faxed after dialing.

If the type of the mini memo is money, the activation control section 109 activates the household account book section 110c (step c1). Thereafter, household account book processing is performed by the household account book section 110c (step c2). When the type of the mini memo is the door phone, the activation control unit 109
d is started (step d1). Thereafter, the intercom control is performed by the intercom controller 110d (step d).
2). At this time, the intercom control unit 110d controls the home information terminal 1 to reproduce the moving image data and the audio data that can be transmitted from the intercom, for example, and sends the audio data from the microphone 21 to the intercom.

If the type of the mini memo is the air conditioner, the activation control unit 109 activates the air conditioner control unit 110e (step e1). Thereafter, the air conditioner is controlled by the air conditioner controller 110e (step e2). At this time, the air conditioner control unit 110e controls, for example, temperature setting and timer setting of the air conditioner. If the type of the mini memo is the e-mail address, the activation control unit 109 activates the e-mail unit 110f (step f1), and uses the data of the mini memo as the e-mail address to send the e-mail unit 1
Deliver to 10f (step f2). Thereafter, an e-mail transmission / reception process is performed by the e-mail section 110f (step f3).

Although not shown, if the type of the mini memo is voice, the activation control unit 109 activates audio reproduction software to reproduce the audio data of the mini memo, and the type of the mini memo is image. In this case, the activation control unit 109 activates the image reproduction software to reproduce the image data of the mini memo. In the above embodiment,
Although the handwritten data management device of the present invention is configured as the home information terminal 1, most of the functions in the functional block diagram of FIG. 4 are realized by software, so that the hardware configuration allows input of handwritten data. Can be implemented. For example, the present invention can be implemented in a personal computer, a workstation, or a pen-input type portable information device. The specific software described above for realizing the function of FIG. 4 can be recorded on a storage medium such as a floppy disk or an optical disk, or can be distributed via a communication network.

In the above embodiment, although the name is the home information terminal 1, it can be used not only in the home but also in a department in a company, a class in a school, and other places. Furthermore, the control of the home appliances 2, 3, 4 and the like has been described as being realized by a home bus system, but a larger control system such as a simpler control system or a centralized building management system may be used. .

Further, the example has been described in which the type selection button 121c is changed in the type display sequentially for each touch operation by the user, but the present invention is not limited to this, and may be, for example, a pop-up menu. Furthermore, in the above-described embodiment, an example in which handwritten data is input by a tablet has been described, but the present invention is not limited to this. For example, the hardware configuration in FIG. 3 may include a pointing device such as a mouse or a trackball for inputting handwritten data.

[0059]

As described above, the handwritten data management device of the present invention receives input of handwritten data and displays the data in a display frame on a display screen, and displays the handwritten data in the display frame. A memo creating means for creating a memo having contents, a mini memo creating means for creating a mini memo comprising attributes and data according to a user operation, and displaying the memo on a display screen, and a display position control for moving a display position of the mini memo according to the user operation Means, when the mini memo and the display frame overlap with each other as a result of the movement, parent-child data creation means for creating parent-child data with the memo of the display frame as a parent and the mini memo as a child, memo, mini memo, and parent-child And data storage means for storing data, so that memo data input by handwriting with a pen or finger Can moved so to keep notes and memorandum, that the user is stored in association with easy notes and the attributes and data check the contents by a simple operation that to visually overlap. Taking daily life activities as an example, the user can operate as if writing a memo and sticking a sticky note on the memo, thereby realizing extremely intuitive operability. Since various attributes and data are added to the memo-written image data as mini-memos, the added value and the utility value of the handwritten data itself are enhanced.

Further, the mini memo creating means includes an attribute indicating a telephone number, an attribute indicating a fax number, an attribute indicating an e-mail address, an attribute indicating an amount of money, an attribute indicating voice,
According to the configuration in which a mini memo is created by using either an attribute indicating an image or an attribute indicating a control instruction to another device as an attribute, a memo having handwritten data as a content includes data in all data formats required in daily life. Attributes can be used.

Further, according to the structure in which the display position control means moves the display position of the memo together with the child mini memo according to the user operation, the mini memo once attached to the memo can be managed integrally with the memo. In addition, the data storage means stores, for each memo, a memo identifier and handwritten data in association with each other, for each mini memo, a mini memo identifier, a parent memo identifier as parent-child data, and the attribute. According to the configuration including the second table that stores the data corresponding to the attribute in association with the data, both the memo and the mini memo are in the table format.
There may be many memos, and there is no limit to the number of mini-memos that can be attached to one memo, and many memos and mini-memos can be easily managed.

Further, according to the configuration in which the parent-child data creating means updates the parent memo identifier in the second table when the mini memo is moved from the parent memo to another memo, the mini memo attached to the memo can be freely changed. It can be peeled off or used for other memos, and the user can intuitively operate with the same feeling as a regular sticky note. When the memo moves to the first predetermined range on the display screen, the handwritten data management device deletes information about the memo from the first table and stores information about all mini-memos that are children of the memo in the second table. According to the configuration including the first deletion unit that deletes from the table, and the second deletion unit that deletes information related to the mini memo from the second table when the mini memo moves to another second predetermined range on the display screen. Mini-memos are treated as parental notes and fate communities,
By simply deleting the parent memo, the child mini memo is also deleted at the same time, so that an operation feeling consistent with the daily act of discarding the memo paper with a sticky note can be realized.

In addition, the handwritten data management device further comprises a second deleting means for deleting only information relating to the mini memo from the second table when the mini memo has moved to another second predetermined range on the display screen. According to the above, since the deletion of the mini memo does not affect the parent memo, it is possible to realize an operation feeling consistent with the daily action of discarding only the sticky note from the memo sheet.

Further, the handwritten data management device displays a memo in a size at the time of handwriting input, a first display state in which the memo is displayed in a reduced size, and a third display state in which the memo is displayed as an icon. According to the configuration including the display state changing means for changing the display state according to the user operation, the memo of the handwritten image can be iconified, and the user can fully grasp the contents of the handwritten image by the reduced display, and the display screen Can be relaxed.

In addition, the handwritten data management device may include a first
According to the configuration including browsing means for classifying, searching, and displaying a list of notes based on a specific key specified by the user with reference to the table and the second table, finding a user's desired note from a large number of notes Can be. further,
The handwritten data management device includes a software storage unit that stores a plurality of software, an execution unit that executes the software, a detection unit that detects a user's use request for the displayed mini memo, and a detection unit that detects when the use request is detected. According to the configuration including the activation unit that activates the execution unit so as to execute the software corresponding to the attribute of the mini memo, not only the added value of the memo can be improved by pasting the mini memo on the memo but also more suitable for the attribute of the mini memo. In addition, data processing such as telephone transmission and facsimile transmission can be realized in conjunction with memos and mini memos.

The starting means starts the determining means for determining the attribute of the mini memo for which the use request has been detected, and the executing means for executing the software according to the determined attribute, and stores the data of the mini memo and its data. According to the configuration including the delivery unit that delivers at least one of the data of the parent memo to the execution unit, the software can be activated with a simpler configuration.

Further, the software storage means includes software for performing transmission processing using the data of the mini memo as a telephone number, software for transmitting the data of the mini memo as a facsimile number, and data for the mini memo as an e-mail address. Software for sending e-mails, software for performing predetermined calculations using mini-memo data as money, software for playing back mini-memo data as audio data, and image display of mini-memo data as image data At least one of
According to the configuration in which the memos are stored, the memo can be effectively used only by preparing software corresponding to the attribute as necessary.

Further, the handwritten data management device further includes communication means for communicating with at least one other device, and the software storage means further controls the operation of the other device via the communication means. According to the configuration for storing software for performing
Not only can information on home appliances such as water heaters be grasped by memos, but also control of home appliances in conjunction with the memos can be realized.

Further, the input display means may include a tablet for inputting handwritten data and a display screen integrated with each other,
According to the configuration in which the input position corresponds to the display position, the user can obtain more intuitive operability.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of an entire system including a home information terminal according to an embodiment of the present invention.

FIG. 2 is an external view of the home information terminal according to the embodiment.

FIG. 3 is a diagram showing a hardware configuration of the home information terminal.

FIG. 4 is a functional block diagram of the home information terminal (handwritten data management device).

FIG. 5A shows an example of the contents of a memo management table. (B) An example of the storage contents of the mini memo management table is shown.

FIG. 6 is a flowchart showing a schematic processing content of a handwritten data management device.

FIG. 7 is a flowchart illustrating a memo creation process of the handwritten data management device.

FIG. 8 is a flowchart illustrating a mini memo creation process of the handwritten data management device.

FIG. 9 is a flowchart showing a window operation process of the handwritten data management device.

FIG. 10 is a flowchart illustrating a software activation process of the handwritten data management device.

FIG. 11 shows an example of an initial screen when a memo is created by the handwritten data management device.

FIG. 12 shows an example of a memo display screen when a mini memo is attached to a memo.

FIG. 13 shows an example of a memo display screen in a case where normal display is performed and a case where reduced display is performed.

FIG. 14 shows an example of a memo display screen when a mini memo is moved between memo display screens.

FIG. 15 shows an example of a display screen when the telephone unit is activated.

FIG. 16 shows an example of a display screen when a memo and a mini memo are deleted.

FIG. 17 is a diagram showing a data attribute input screen of a conventional information processing apparatus.

[Explanation of symbols]

 Reference Signs List 1 home information terminal 11 CPU 12 memory 13 hard disk 14 communication control unit 15 LCD control unit 16 LCD panel 17 input / output control unit 18 tablet 19 keyboard 20 speaker 21 microphone 22 home appliance I / F 101 input control unit 102 operation analysis unit 103 memo 103 display control unit 104 data storage unit 104a memo management table 104b mini memo management table 105 memo creation unit 106 memo management unit 107 mini memo creation unit 108 mini memo management unit 109 activation control unit 110 execution unit 110a telephone unit 110b FAX unit 110c household account book Unit 110d Doorphone control unit 110e Air conditioner control unit 110f E-mail unit

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Yoshihiro Ishizaki 1006 Kazuma Kadoma, Kadoma City, Osaka Matsushita Electric Industrial Co., Ltd.

Claims (14)

[Claims] 1. An input display means for receiving input of handwritten data and displaying it in a display frame on a display screen, a memo creation means for creating a memo containing the handwritten data of the display frame, A mini-memo creating means for creating a mini-memo composed of attributes and data and displaying it on a display screen; a display position control means for moving a display position of the mini-memo according to a user operation; and, as a result of the movement, an overlap between the mini-memo and the display frame. When the event occurs, a parent-child data creating unit that creates parent-child data with the memo of the display frame as a parent and the mini-memo as a child, and a data storage unit that stores the memo, the mini memo, and the parent-child data are provided. Handwritten data management device. 2. The mini memo creating means includes an attribute indicating a telephone number, an attribute indicating a facsimile number, an attribute indicating an e-mail address, an attribute indicating an amount of money, an attribute indicating a voice, an attribute indicating an image, and an attribute indicating another device. 2. The handwritten data management device according to claim 1, wherein the mini memo is created using any one of attributes indicating a control instruction as an attribute. 3. The handwritten data management device according to claim 1, wherein said display position control means further moves the display position of the memo together with a child mini memo according to a user operation. 4. A data storage means comprising: a first table for storing a memo identifier and handwritten data in association with each memo; a mini memo identifier for each mini memo; a parent memo identifier as parent-child data; The handwritten data management device according to claim 3, further comprising a second table that stores the attribute and the data corresponding to the attribute in association with each other. 5. The handwritten data management according to claim 4, wherein the parent-child data creating means updates the parent memo identifier in the second table when the mini memo is moved from the parent memo to another memo. apparatus. 6. When the memo moves to a first predetermined range on the display screen, the handwritten data management device deletes information related to the memo from the first table, and deletes all mini memos that are children of the memo. The handwritten data management device according to claim 4, further comprising a first deletion unit configured to delete information about the second table from the second table. 7. The handwritten data management device further includes a second deletion unit that deletes only information related to the mini memo from the second table when the mini memo moves to another second predetermined range on the display screen. The handwritten data management device according to claim 4, 5 or 6, wherein: 8. The handwritten data management device further includes a first display state in which the memo is displayed in the size when the memo is input by handwriting, a second display state in which the memo is displayed in a reduced size, and a third display in which the memo is displayed as an icon. The handwritten data management device according to claim 4, further comprising a display state changing unit that changes a display state according to a user operation among the states. 9. The handwritten data management device further includes a browsing unit for classifying, searching, and displaying a list of memos based on a specific key designated by the user with reference to the first table and the second table. 9. The handwritten data management device according to claim 8, wherein: 10. The handwritten data management device further comprises: software storage means for storing a plurality of software; execution means for executing the software; detection means for detecting a user's use request for the displayed mini memo; 3. The handwritten data management device according to claim 2, further comprising: an activation unit that activates an execution unit to execute software according to an attribute of the mini memo when a request is detected. 11. The activating means comprises: determining means for determining an attribute of a mini memo for which a use request has been detected; and activating an executing means for executing software corresponding to the determined attribute, and storing the data of the mini memo and its data. The handwritten data management device according to claim 10, further comprising: a delivery unit that delivers at least one of the parent memo data to the execution unit. 12. The software storage means includes software for performing transmission processing using mini memo data as a telephone number, software for facsimile transmitting the mini memo data as a facsimile number, and using the mini memo data as an electronic mail address. Software for sending e-mail, software for performing predetermined calculations using mini memo data as money, software for playing back mini memo data as audio data, and displaying images of mini memo data as image data 12. The handwritten data management device according to claim 11, wherein at least one of the software and the software is stored. 13. The handwritten data management device further includes communication means for communicating with at least one other device, and the software storage means further controls the operation of the other device via the communication means. 13. The handwritten data management device according to claim 12, wherein software for performing the operation is stored. 14. The input display means according to claim 1, wherein a tablet for inputting handwritten data and a display screen are integrated, and an input position and a display position correspond to each other. Any one of the handwritten data management devices.