JP2001209658A - Device and method for processing information and medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To confirm the state of a label at the optional point of time in the past or the like for instance and to easily recognize an eliminated label and the history of a desk-top image where the label is stuck, etc. SOLUTION: A wire frame wf1 for indicating the frame image of a unit time plane by perspective projection and a line ep1 extended in a time base direction for the valid period (duration) of the label are simultaneously displayed on a screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, method, and medium, and more particularly, to a method for performing a predetermined process on a label to be pasted as a sticky note pasted on a desktop screen of a personal computer. Information processing apparatus and method, and a medium.

[0002]

2. Description of the Related Art Heretofore, it has been common practice to attach a sticky note as a mark to a paper document or write a memo on the sticky note and paste it somewhere and use it as a reminder. The present applicant has proposed an application program that reproduces the same thing on a desktop screen of a personal computer, and a personal computer in which the application program is actually preinstalled is also sold. Hereinafter, one sticky note displayed on the desktop screen is called a label, and an application program for displaying the label on the desktop screen is called label software. In the label, it is possible to handle not only text such as characters, but also voice and image, by utilizing that the label software is an application program on a personal computer. Note that a paper sticky note cannot handle sound and images (for example, moving images).

FIG. 82 shows a display example of labels on the desktop screen. In FIG. 82, not only text such as characters, but also voices and images can be attached to the label L. The label L at the bottom of FIG. 82 shows the state when the image is pasted. Also,
When a sound or the like is attached to these labels L,
For example, when the play button PB is clicked with a mouse or the like,
The sound can be reproduced. If the stop button SB is clicked with a mouse or the like during the reproduction of the sound, the reproduction of the sound can be stopped.

[0004] As described above, according to the application program (label software) that allows a label to be pasted on the desktop screen, label creation, movement,
It is possible to perform a deletion operation, and it is also possible to change a text, an image, and a sound of a label.

[0005]

However, the above-described conventional label software stores only the latest information after the correction, for example, when the label is corrected. For example, it is not possible to confirm the state of the label at any time in the past.

Further, when a label is deleted, the data relating to the label is completely erased, so that it is impossible to see the label again (for example, to display it again on the desktop screen). However, it cannot be known that the deleted label exists.

Further, in conventional label software, for example, when a label is created and how long it has existed, how a plurality of labels exist on a time axis,
It is not possible to easily know the history such as the state of the desktop screen to which the label has been attached at any time in the past.

Accordingly, the present invention has been made in view of such circumstances. For example, it is possible to confirm the state of a label at any time, such as in the past, and to delete a label or attach a label. It is an object of the present invention to provide an information processing apparatus, a method, and a medium that allow a user to easily recognize a history of a desktop screen or the like that has been used.

[0009]

An information processing apparatus according to the present invention comprises a storage means for storing a plurality of two-dimensional screens and time information in association with each other, and stores the two-dimensional screen corresponding to the time information along a time axis. The above-mentioned problem is solved by having a display signal generating means for generating a display signal for three-dimensionally displaying the three-dimensional structure arranged in a three-dimensional manner.

Further, the information processing apparatus of the present invention comprises: a frame image information generating means for generating information of a frame image indicating a unit time;
The above-described problem is solved by having a display signal generation unit that generates a display signal for displaying the frame image in a wire frame display by a perspective view. Further, in the information processing apparatus of the present invention, a storage means for storing a predetermined processing unit to which object information of different attributes can be pasted and time information in association with each other, and the processing unit of the predetermined processing unit based on the time information Line image information generating means for generating information of a line image indicating a duration, wherein the display signal generating means combines the frame image displayed in the wire frame and the line image extending along the time axis direction. A display signal is generated.

According to the information processing method of the present invention, a plurality of two-dimensional screens and time information are stored in association with each other, and a three-dimensional structure in which the two-dimensional screens corresponding to the time information are arranged along a time axis is three-dimensionally displayed. By generating a display signal for
The above-mentioned problem is solved.

Further, the information processing method of the present invention generates the information of a frame image indicating a unit time and generates a display signal for displaying the frame image in a wire frame by a perspective drawing, thereby solving the above-mentioned problem. Resolve. Further, in the information processing method of the present invention, a predetermined processing unit to which object information having different attributes can be pasted and time information are stored in association with each other, and the duration of the predetermined processing unit is determined based on the time information. The information of the line image shown is generated, and a display signal is generated by combining the frame image displayed in the wire frame and the line image extending along the time axis direction.

[0013] The medium of the present invention comprises the steps of storing a plurality of two-dimensional screens and time information in association with each other, and displaying a three-dimensional structure in which the two-dimensional screens corresponding to the time information are arranged along a time axis. The above-mentioned problem is solved by causing an information processing apparatus to execute a program characterized by including a step of generating a display signal for performing the processing.

Further, the medium of the present invention includes a step of generating information of a frame image indicating a unit time, and a step of generating a display signal for displaying the frame image in a wire frame by a perspective view. The above-described problem is solved by causing an information processing apparatus to execute a characteristic program.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described with reference to the drawings.

1 to 4 show the appearance of a notebook personal computer as an example to which an information processing apparatus and method and a medium according to the present invention are applied. This notebook personal computer 1 basically includes a main body 2 and
The main body 2 comprises a display unit 3 which can be opened and closed freely. FIG. 1 is an external perspective view showing a state where the display unit 3 is opened with respect to the main body 2. FIG. 2 is a plan view of the main body 2,
FIG. 3 is an enlarged view near the jog dial 4 provided on the main body 2. FIG. 4 shows the jog dial 4 of the main body 2.
It is a side view of a side.

The main body 2 includes a keyboard 5 operated when inputting various characters and symbols, a touchpad 6 as a pointing device operated when moving a mouse cursor, and a power switch 8. It is provided on the upper surface.

An LCD (Liquid Crystal Display) 7 for displaying an image is provided in front of the display unit 3. Further, a power lamp PL,
Battery lamp BL, message lamp ML if necessary,
A lamp made up of other LEDs is provided.

The jog dial 4 is incorporated between the keys A and B (the rightmost key) of the keyboard 5 on the main body 2 and is mounted so as to be substantially the same height as the keys A and B. . The jog dial 4 executes a predetermined process in response to a rotation operation indicated by an arrow a in FIG. 3, and executes a predetermined process in response to a movement operation indicated by an arrow b in FIG. For more information about this jog dial 4,
Japanese Unexamined Patent Application Publication No. Hei 8-8 filed by the present applicant and a joint applicant.
A rotary operation type electronic component with a push switch disclosed in Japanese Patent No. 203387 can be cited as an example, and the specific processing performed by the jog dial 4 is described in the specification and drawings of Japanese Patent Application No. 11-142518 filed by the present applicant. Has been proposed.

The jog dial 4 may of course be arranged on the left side of the main body 2. Also, a jog dial may be arranged at the center of the front surface so that the touch pad 6 can be operated with the thumb while operating with the index finger. Further, it may be arranged on the left side or right side of the display unit 3 provided with the LCD 7. Further, the touch pad 6 may be arranged vertically along the left edge or the right edge. Further, the touch pad 6 may be arranged in the horizontal direction along the upper edge or the lower edge. Further, the touch pad 6 may be arranged vertically between the right button and the left button. Further, it may be arranged vertically between the G key and the H key of the keyboard unit 5. Also,
The arrangement is not limited to the vertical direction and the horizontal direction, and may be arranged at a predetermined angle in an oblique direction that is easy to operate with each finger. Further, it may be arranged at a position operable with the thumb on the side of a mouse as a pointing device.

Next, the notebook personal computer 1
Will be described with reference to FIG.

In FIG. 5, a central processing unit (CPU) 5
1 is, for example, a Pentium (P
entium (trademark) processor or the like, and is connected to the host bus 52. A north bridge (AGP Host Bridge Controller) 53 is further connected to the host bus 52. The north bridge 53 is connected to an AGP (Accele
rated Graphics Port) 50 and a PCI bus 56. The north bridge 53 is composed of, for example, 400BX manufactured by Intel Corporation.
And the main memory 54 are controlled. Further, the north bridge 53 is connected to the video controller 57 via the AGP 50. The north bridge 53 and a south bridge (PCI-
The ISA Bridge 58 constitutes a so-called chipset.

The north bridge 53 is further connected to a main memory 54 and a cache memory 55. The cache memory 55 caches data used by the CPU 51. Although not shown, the CPU 51 also includes a primary cache memory.

The main memory 54 is, for example, a DRAM
(Dynamic Read Only Memory).
Are stored, and data necessary for the operation of the CPU 51 are stored. Specifically, the main memory 54 stores, for example, an e-mail program 54A, an auto-pilot program 54B, a jog dial status monitoring program 54
C, a jog dial driver 54D, an operating program (OS) 54E, and an application program 54 which is label software according to the embodiment of the present invention described later.
F1 and other application programs 54
F ₂ ~54F _n is transferred from HDD 70, is stored.

The e-mail program 54A is connected to the modem 7
5 is a program for exchanging messages via a network from a communication line such as a telephone line 76 or a wireless line via the network. The electronic mail program 54A has an incoming mail acquisition function as a specific function. This incoming mail acquisition function checks whether a mail addressed to the user (user) has arrived in the mailbox 79 with respect to the mail server 78 provided in the provider 77, and if there is mail addressed to the user, Execute the acquisition process.

The autopilot program 54B includes a plurality of processes (or programs) set in advance.
This is a program that is started and processed sequentially in a preset order.

OS (basic program software) 54
E controls the basic operation of the computer represented by, for example, so-called Windows 95, 98, and 2000 (both are trademarks) of Microsoft Corporation, and so-called Mac OS (trademark) of Apple Computer Corporation. .

Jog dial status monitoring program 54C
Receives a notification from each of the above applications as to whether or not it is compatible with the jog dial, and operates, for example, to display what can be done by operating the jog dial 4 if it is compatible. Usually, the jog dial 4 is waiting for an event and has a list for receiving a notification from the application. Jog dial driver 54
D executes various functions in response to the operation of the jog dial 4.

The video controller 57 is connected to the PCI bus 5
6, and controls the display of the LCD 7 on the display unit 3 based on the data supplied via the PCI bus 56.

A sound controller 64 is connected to the PCI bus 56 to receive an input from a microphone 66 or to supply an audio signal to a speaker 65. A modem 75 is also connected to the PCI bus 56. The modem 75 can be connected to a communication network 80 such as the Internet, a mail server 78, and the like via a public telephone line 76 and an Internet service provider 77.

A south bridge 58 is also connected to the PCI bus 56. The south bridge 58 is composed of, for example, PIIX4E manufactured by Intel Corporation, and controls various I / Os (Input / Output). That is, the south bridge 58
(Integrated Drive Electronics) A device that includes a controller / configuration register 59, a timer circuit 60, an IDE interface 61, and is connected to the IDE bus 62, and an ISA / EIO (Indu
stry Standard Architecture / Extended Input Outpu
t) Control of devices connected via the bus 63 and the embedded controller 68 is performed.

The IDE controller / configuration register 59 has two IDs, a so-called primary IDE controller and a secondary IDE controller.
It is composed of an E controller, a configuration register and the like (both not shown).

The primary IDE controller is an IDE
It is connected to a connector (not shown) via a bus 62, and an HDD 67 is connected to the connector. Also, the secondary IDE controller can be connected to a CD-ROM drive (not shown) via another IDE bus or the like,
When a bay device, which is a so-called IDE device, such as a second HDD or FDD, is mounted, a connector of the mounted bay device is electrically connected.

The HDD 67 has an electronic mail program 67A, an autopilot program 67B, a jog dial status monitoring program 67C, a jog dial driver 67D, and an OS (basic program software).
67E, the application program 67F ₁ is a label software of the present embodiment described below, several other application programs 67F ₂ ~67F _n and the like are stored. Each of the programs 67A and 67 in the HDD 67
B, 67C, 67D, 67E, 67F 1 ~67F n , etc.,
In the course of the startup (boot-up) processing, the data is sequentially transferred and stored in the RAM 54.

The ISA / EIO bus 63 is further connected to an embedded controller 68. The embedded controller 68 comprises a microcontroller and is used as an I / O controller. That is, the embedded controller 68 is configured by connecting the I / O interface 69, the ROM 70, the RAM 71, and the CPU 72 to each other.

In the ROM 70, an LED control program 70A, a touch pad input monitoring program 70B, a key input monitoring program 70C, a wake-up program 70D, and a jog dial state monitoring program 70E are stored in advance.

The LED control program 70A is a program for controlling lighting of a power lamp PL, a battery lamp BL, a message lamp ML as required, and other lamps including LEDs. The touchpad input monitoring program 70B is a program that monitors a user input from the touchpad 6. Key input monitoring program 7
0C is a program for monitoring inputs from the keyboard 5 and other key switches. The wake-up program 70D is connected to the timer circuit 60 in the south bridge 58.
It checks whether or not a preset time is reached based on the current time data supplied from the server. When the preset time comes, the management of each chip power supply to start a predetermined process (or program) or the like is performed. Is a program that performs

Jog dial status monitoring program 70E
Is a program for constantly monitoring whether the rotary encoder unit 12 of the jog dial 4 has been rotated or pressed.

The BIOS 70F is further written in the ROM 70. BIOS (Basic Input / Output Sys
The term “tem” refers to a basic input / output system, and is a software program that controls data transfer (input / output) between an OS or application software and peripheral devices (display, keyboard, HDD, etc.).

The RAM 71 has registers 71A to 71F including registers for LED control, touch pad input status, key input status, set time, and I / O registers for monitoring a jog dial state.
For example, when the jog dial 4 is pressed, the LED control register 71A controls, for example, lighting of a message lamp ML that indicates an instantaneous start-up state of an e-mail. The key input status register 71C stores, for example, an operation key flag when the jog dial 4 is pressed (pushed). Setting time register 7
1D can arbitrarily set a certain time.

The embedded controller 68
Is connected to a jog dial 4, a touch pad 6, and a keyboard 5 via connectors (not shown). Signals corresponding to operations of the jog dial 4, the touch pad 6, and the keyboard 5 are transmitted to the ISA / EI.
The data is output to the O bus 63. The embedded controller 68 is connected to a power lamp PL, a battery lamp BL, a message lamp ML, and other lamps including LEDs.

The embedded controller 68 is further connected to a power supply control circuit 73. The power supply control circuit 73 is connected to the built-in battery 74 or the AC power supply, and supplies necessary power to each block, and performs control for charging the built-in battery 74 and a second battery of a peripheral device. It has been done. Further, the embedded controller 68 monitors the power switch 8 operated when turning on or off the power.

The embedded controller 68 includes a power supply 8
, The above programs 70A, 70B, 70C, 70D, and 70E can always be executed by the internal power supply. That is, each of the above programs is displayed on the display unit 3
No matter what window is open on the LCD 7, it is always working. In other words, the embedded controller 68 always executes the jog dial state monitoring program 70E even when the power switch 8 is turned off and the OS 54E is not activated by the CPU 51, so that the notebook personal computer 1 does not need to be provided with a dedicated key. A programmable power key (PPK) function is provided, for example, so that a user can press a jog dial 4 to activate a desired software or script file in a power saving state or when the power is off.

Next, the label software according to the embodiment of the present invention will be described.

The label software according to the present embodiment is a personal computer that allows a user to write a note on a paper document as a mark and write a memo on the sticky note and paste it somewhere and use it as a reminder. An application program that is reproduced on the desktop screen of a computer. In the present embodiment, one sticky note displayed on the desktop screen is called a label, and an application program for displaying the label on the desktop screen is called the label software.

The label software according to the present embodiment includes, as objects that can be pasted on the label, which is one sticky note displayed on the desktop screen, text such as characters and symbols, still images, moving images, and the like. Function to handle images, sounds, music, etc., editing text to be attached to labels, recording / playback of sound to be attached to labels, and importing /
It has a display function, a function of linking with application software for capturing images from a CCD camera attached to a digital camera or a personal computer, and a function of creating a label having a change history as a time management function. The time management function has a function to fully support the jog dial, a function to handle a link as an object to be attached to a label, and the like.

The data structure handled by the label software of this embodiment having these functions includes the following three items: project, label, and object. FIG. 6 shows the relationship between these data.

The above-mentioned project is a set of all label data. Usually, only one project is created. In one project, past, present,
It has all future label information. However, in order to provide, for example, sample contents and exchange of project information via the Internet, the label software of the present embodiment supports switching and addition of projects. Details of the project will be described later.

The label corresponds to one sticky note on the desktop screen. The label has information from generation to destruction. This information includes all actions performed by the user on the label from the time the label was created to the time it was destroyed, including label resizing, color changing, text modification, image modification, sound modification, etc. Information. However, the position information of the label on the screen always has an attribute for displaying it in the foreground, but does not hold information on the vertical relationship between labels, between windows, or between labels and windows. Also, the label is
It can be divided into three types: current label, past label, and future label. The current label is a label whose label creation time is before the current time and has not been deleted at the current time. The relationship between the creation time, the current time, and the end (deletion) time in this current label is
(Creation time ≦ current time <end (deletion) time). The past label is a label that has already been deleted at the current time. Creation time in this past label,
The relationship between the end (delete) time and the current time is (creation time <end (delete) time ≦ current time). What is a future label?
This is a label that has not yet been created at the current time, and has a future set for the creation time.
The relationship between the current time, the creation time, and the end (deletion) time in this future label is (current time <creation time <end (deletion) time). Details of the label will be described later.

The object is data to be pasted into a label, and specifically includes a text object, an image object, a sound object, a link object, and the like. Details of the object will be described later. Next, main components of the desktop screen when the label software of the present embodiment is executed will be described.

First, the overall configuration of the screen will be described.

The state of the label software (the state of the application) according to the present embodiment is roughly classified into two states, a normal mode and a time view mode, which will be described below. ) It is divided into a view mode and a 3D (three-dimensional) view mode.

The normal mode is a state in which the time view mode is not set and a label is attached on the desktop screen. FIG. 7 shows an example of the desktop screen in the normal mode. What is indicated by an instruction code L in FIG. 7 is a label. In the normal mode, the icon IL of the label software of the present embodiment is displayed on the task tray TT of the task bar TB on the desktop screen, and the icon IL is accessed (clicked) with a pointing device such as a mouse. By doing so, it becomes possible to control all functions of the label software application according to the present embodiment.

The time view mode is a mode in which time operation can be performed by the label software of the present embodiment, and includes a 2D view mode consisting of the following three modes: a current mode, a past mode, and a future mode; Divided into view mode states.

FIG. 8 shows the current (Presen) of the 2D view mode.
FIG. 9 shows an example of the configuration of the desktop screen in the past (Past) mode of the 2D view mode, and FIG. 10 shows an example of the configuration of the desktop screen in the future (Future) mode of the 2D view mode. An example of the configuration will be described.

As shown in FIGS. 8 to 10, in the current mode, past mode, and future mode in the 2D view mode, the current state, past state, and future state of the label included in the project are respectively displayed on the desktop screen. You. In addition, on the desktop screen of FIGS.
“Pr” indicating the current mode of the 2D view mode
esent ", a character" Past "indicating the past mode of the 2D view mode, and a character" Future "indicating the future mode of the 2D view mode are displayed near the center and at the four corners, respectively. This makes it possible for the user to visually recognize the current mode, the past mode, or the future mode.

In the time view mode, as in the normal mode, the icon IL of the label software of the present embodiment is displayed on the task tray TT of the task bar TB on the desktop screen.

When the mode is switched from the normal mode to the time view mode, all areas on the desktop screen (if there are a plurality of monitors, on all monitors) are covered with the image by the label software, and the labels are displayed thereon. Is done.

At this time, a time view console TVC for enabling display / change of the currently operated time is displayed on the desktop screen. Hereinafter, the time during which the desktop is displayed in the time view mode is referred to as operation time.

The time view console TVC has two states: a window in a bar state shown in FIGS. 8 to 10 and FIG. 11 and a window in a floating state as shown in FIG. Further, the time view console TVC in a bar state is displayed at the upper part of the screen by default, but can be displayed at the lower part of the screen or at the left and right ends of the screen. That is, the time view console TVC can be dragged with a pointing device such as a mouse, and when the time view console TVC is moved up or down on the screen by the dragging, the bar state shown in FIGS. 8 to 10 and FIG. Otherwise, it is a floating window as shown in FIG. The screen configuration is different between the bar state and the floating state, but the function of the time view console TVC is the same.

A window of the time view console TVC in a bar state as shown in FIG. 11 includes a window title part wt, a year gauge part cg, a search character string input display part sc, a previous search button cbb and a next search button cnb.
, Current button bb, operation time display section ot
i, time up / down buttons tub and tdb, time increase / decrease step selection list box ssl, time increase / decrease step selection menu button sb, menu button m
b, a close button cb, a help button hb, and a rotation animation unit ra. Note that the rotation animation units ra are provided at both ends of the window of the time view console TVC in the bar state. The window title portion wt is a portion for displaying the title of the window (in this example, the character of “time view”), and only the title is displayed. That is, the window title part wt is provided in order to clarify that the application controlling the function of the entire screen is label software.

The above-mentioned year gauge part cg is provided to make it easy for the user to determine which time the label currently displayed corresponds to in the year. This year gauge part cg is displayed so that the time when the label is displayed on the screen is always at the center of the gauge,
Further, for example, a yellow vertical line le is also displayed to clearly indicate this time. That is, the corresponding year gauge part cg
Is the real time (real world current time)
Instead, it is a time corresponding to the past or future (or current time) label displayed on the desktop screen. The year gauge section cg in the example of FIG. 11 is the time when the label is displayed on the screen (time at the center of the gauge).
Is a display example in the case of November 1999, for example.
A yellow vertical line le is displayed at the center of the gauge. Further, for example, a red vertical line lr is displayed on the year gauge part cg to indicate the actual time (not the time corresponding to the displayed label, but the current time in the real world). In the example of FIG. 11, the red vertical line lr indicating that the real time (current time in the real world) is, for example, May 1999 is displayed on the Christian gauge part cg. Thus, according to the year gauge part cg,
The time corresponding to the displayed label (for example, 1999)
(November, 1999) and the actual time (for example, May, 1999) can be easily recognized.

The search character string input display section sc is a portion for inputting a character string to be searched and displaying the input search character string. The previous search button cbb is a button for designating the previous search character string, and the next search button cnb is a button for designating the next search character string.

The current button bb is a button for instructing to return to the actual time (current time in the real world) from the time corresponding to the displayed label. Therefore, by clicking the current button bb with, for example, a mouse or the like, the operation time returns to the current time (current time in the real world). Note that, even if the current time (the current time in the real world) is returned by the current button bb, the state of the label software (the state of the application) maintains the time view mode.

The operation time display unit ti
This is a part for displaying at what time the state where the label is displayed on the screen is. In the example of FIG. 11, the state of the label at 15:27:09 on November 11, 1999 is displayed on the screen.

The up / down buttons tub and tdb
Is a button for increasing / decreasing the time displayed on the operation time display section oti in a designated time increment / decrement unit (time increment / decrement step). Here, for example, the focus is on the operation time display unit otti, and the year, month,
When any one of the day, hour, minute, and second is in the active state, when the up button tub is pressed, the value of the part in the active state is changed to a designated time increment / decrement unit (time increment / decrement step). ), And conversely, when the down button tdb is pressed, the value of the portion in the active state decreases in the designated time increment / decrement unit (time increment / decrement step). Further, in the label software of the present embodiment, the up / down buttons tub and t
The same function as db can be realized by rotating the wheel of a mouse with a wheel, moving the cursor key up and down, rotating the jog dial 4, and the like. That is, in this case, the focus is on the operation time display unit ot i, and the year,
When any one of the month, day, hour, minute, and second is set to the active state, for example, rotate the wheel of a mouse with a wheel, press the up / down cursor keys on the keyboard, or rotate the jog dial 4. Then, the value of the portion in the active state increases or decreases (increases or decreases the time) in the designated time increment or decrement unit (time increment or decrement step).

The time increase / decrease step selection list box ssl is a portion for displaying the time increase / decrease unit (time increase / decrease step) when increasing / decreasing the time of the operation time display section otii. In other words, in the time increase / decrease step selection list box ssl, the year, month, day, hour,
A time increment / decrement unit (time increment / decrement step) corresponding to the active time display portion among minutes, seconds, and the like is displayed. In the example of FIG. 11, “*” appended to the character of the time increment / decrement unit (time increment / decrement step) displayed in the time increment / decrement step selection list box ssl indicates the time with the “*” appended. This indicates that the increase / decrease unit (time increase / decrease step) is currently selected. Here, in the present embodiment, for example, 100 years, 10
There are year, year, month, hour, minute, second, change point, etc., and the time increase / decrease step selection list box ssl shows any of these time increase / decrease steps. Is displayed. The time increase / decrease in change point units refers to the time when the user changes the label by performing some operation on the label (for example, when the label is moved, the size is changed, or the object is corrected; This means that the time is increased or decreased in a unit from the time when the label state changes) to the time when the next change occurs. Therefore, when the time is increased or decreased in the unit of the change point, the time interval that changes by one increase or decrease of the time at the change point is not constant.

The time increase / decrease step selection menu button sb is operated in the time increase / decrease step selection list box ss.
A button for designating a time increase / decrease step displayed in 1 by menu selection. In other words, the time increase / decrease step selection menu button sb displays the year, month, day,
It is a button for selecting a time display portion desired to be activated from among hours, minutes, seconds and the like. When the time increase / decrease step selection menu button sb is pressed (clicked), the time increase / decrease step selection menu button sb is pressed.
Below b, 100 years, 1
0 years, 1 year, 1 month, 1 hour, 1 minute, 1
The time increment / decrement unit (time increment / decrement step) such as a unit of seconds or a change point is displayed. Therefore, by selecting a desired time increase / decrease step from this pull-down menu, the year, month,
The corresponding time display portion is selected from the day, hour, minute, and second displays, and the display becomes active. That is, for example, when a month unit is selected from the pull-down menu of the time increase / decrease step selection menu button sb, for example,
Year, month, day,
The month display portion of the hour, minute, and second displays is in an active state. In this state, the rotation of the up / down buttons tub and tdb, the rotation of the wheel of the mouse with a wheel, the depression of the up / down cursor key, the rotation of the jog dial 4, and the like are performed. By doing so, the value of the month can be changed.

In the label software according to the present embodiment, the same function as the time increase / decrease step selection function by the time increase / decrease step selection menu button sb can be performed, for example, by pressing the left and right cursor keys on the keyboard or by using the mouse with a wheel. It can also be realized by rotation of the wheel, rotation of the jog dial 4, and the like. That is, in this case,
In a state where the focus is on the operation time display unit oti, for example, by rotating the wheel of a mouse with a wheel, pressing the left or right cursor key, or rotating the jog dial 4, the operation time display unit oti is displayed. Any of the time display portions arranged in the horizontal direction, that is, any of the time display portions of year, month, day, hour, minute, and second can be selected to be in the active state.

When the time is increased or decreased by operating the mouse, the keyboard and the jog dial 4 with a wheel, for example, the continuous operation of the keyboard, the rotation speed of the wheel of the mouse with the wheel, and the rotation speed of the jog dial are detected. Depending on the detection result, it is also possible to change how to advance or return the time at an accelerated rate. Thereby, it is possible to easily move to a target time. When the function of selecting the time increase / decrease step is realized by rotation of the wheel of the mouse with a wheel or rotation of the jog dial, the function of selecting the time increase / decrease step is provided for the rotation of the wheel of the mouse with the wheel or the rotation of the jog dial. It is necessary to set up the environment to make it work.

Next, the menu button mb is a button for displaying all operation menus related to the project, for example, file, addition of new label, time, label and the like. When this menu button mb is pressed (clicked), an operation menu such as a file, addition of a new label, time, and a label is displayed as a pull-down menu near the menu button mb. Note that, when the right mouse button is clicked on each part on the time view console TVC, or when an application key is pressed with the focus (context menu), the same as when the menu button mb is clicked. Menu items are displayed as described above. Details of the pull-down menu by clicking the menu button mb of the time view console and the context menu by the application key will be described later.

The close button cb is a button for instructing to close the time view console.

The help button hb is a button for instructing the display of a help window used for checking an unclear point when the user operates the label software of the present embodiment.

The rotation animation unit ra is changed according to the change of the operation time.
This is a part for visually displaying to the user that time is moving by displaying an animation of rotating the time, and the rotation direction is reversed when the time goes to the future and when the time returns to the past. become. FIG. 13 shows only the vicinity of the rotation animation part ra at the left end of the time view console TVC in a bar state in an enlarged manner.
If attention is paid to the portions, it is shown that the rotation animation unit ra rotates in the order of (a), (b), and (c) in the figure. As described above, by performing the animation display in which the rotation animation unit ra rotates, it is possible for the user to recognize that the time is changing.

A window of the time view console TVC in a floating state as shown in FIG. 12 has a window title portion wt displaying a title of the window (in this example, a time view console).
A window menu section wm for displaying operation menus related to the project such as file, addition of new label, time, label, help, etc., a year gauge section cg similar to that of the window in a bar state, and a search character. A column input display section sc, a previous search button cbb and a next search button cnb, a current button bb, an operation time display section oti, and up / down buttons tub and tdb.
, A time increase / decrease step selection list box ssl, and a time increase / decrease step selection menu button sb. In the case of FIG. 12, there is an "x" button as a close button for instructing to close the time view console. Details of the window menu portion wm of the time view console in the floating state will be described later.

In the label software of this embodiment having the time view function as described above, the state in which the label is pasted on the desktop screen can be displayed at any time in the past, present, and future. As described above, not only the 2D view mode that displays the desktop screen at an arbitrary time such as the past, present, and future, but also by adding a time axis to the screen display, the state of the label and the desktop screen from past, present, and future can be displayed. It also has a 3D view mode function of displaying in a three-dimensional format.

That is, in the label software of this embodiment, in the case of the time view mode, the display on the desktop screen can be switched between the 2D view mode and the 3D view mode. More specifically, when switching from the 2D view mode to the 3D view mode in the time view mode, a state in which a menu button mb on the time view console TVC is clicked to display an operation menu as shown in FIG. Then, a check mark is added to the item of “3D view”. As a result, the label software of the present embodiment becomes 3
The mode switches to the D view mode. When switching from the 3D view mode to the 2D view mode, the menu button mb on the time view console TVC is clicked to display an operation menu as shown in FIG. Remove the check mark that is marked. As a result, the label software of the present embodiment switches to the 2D view mode. The operation menu displayed when the menu button mb on the time view console TVC is clicked will be described later in detail.

FIG. 15 shows an example of the desktop screen when the mode is switched to the 3D view mode.

On the desktop screen in the 3D view mode shown in FIG. 15, the unit time (unit of time increment / decrement step selection) which is one unit higher than the unit displayed in the operation time display area oti (in an active state) is highlighted. A wire frame wfl in a so-called perspective view in each unit time above one of the units selected in the list box ssl).
Display, and at the same time, the validity period of each label (label lifetime,
That is, a line epl representing a history indicating a period from when a label is created to when it is deleted) is displayed. FIG. 15 shows the unit time in 1999 and 2000.
Year, 2001, the wire frame wf when the unit is one year (each unit time one month higher than the month selected in the time increase / decrease step selection list box ssl).
An example in which 1 is displayed is given. In addition, hereinafter, a plane configured by the wire frame wfl for each unit time is appropriately referred to as a unit time plane, and a frame of the unit time plane (that is, the wire frame wfl) is also appropriately referred to as a time frame. In the label software of the present embodiment, the wire frame wfl representing this unit time plane
When the left vertical line (vertical line in front of the three-dimensionally displayed unit time plane) is dragged on the desktop screen, the unit time plane and the next unit time are moved in accordance with the drag operation. Interval to surface (ie unit time interval)
Is changed. When a double click is performed instead of dragging the vertical line of the wire frame wfl, the time interval on the unit time plane returns to the standard time interval.

FIG. 15 shows an example of a desktop screen in the 3D view mode in a case where the labels shown in FIGS. 8 to 10 are pasted on the desktop screen in the 2D view mode. ing.

That is, FIG. 15 is a diagram showing the configuration shown in FIG.
Labels L1, L2, L3, and L4 are pasted on the desktop screen at the time of the present mode (Present) of the D view mode, and the past (Pa) of the 2D view mode shown in FIG.
st) Labels L1 and L on the desktop screen in mode
2, L3, L5, and L6 are pasted, and labels L2, L4, and L7 are pasted on the desktop screen in the future (Future) mode of the 2D view mode shown in FIG. The validity period (line epl1) of the label L1 to which the text is added is, for example, 1
The period is from April 26, 999 to August 31, 2000, and the validity period (line epl2) of the label L2 to which the text of “schedule” is added is, for example, 19
From April 1, 1999 to April 1, 2001, "Secretary Meeting"
The validity period (line epl3) of the label L3 to which the text is added is, for example, from September 30, 1999 to 200
Until July 1, 2000, the validity period (line ep14) of the label L4 to which the text of "robot dog" is added is, for example, after January 20, 2000, the label L5 to which the text of "meeting" is added. Validity period (line epl
5) is, for example, from May 15, 1999 to December 1, 1999, the label L to which the text “miscellaneous notes” is added.
6 is valid (line epl6), for example, 1998
3D view mode in a case where the valid period (line epl7) of the label L7 to which the text of "business start" is added is from September 3, 2000 to December 29, 1999, for example, after September 1, 2000 It is an example of a desktop screen at the time. The text on each line epl may be not only the text added to the label but also the text expressing the state of the label closest to the operation time.

FIG. 15 shows a third embodiment of the present invention.
According to the desktop screen in the D-view mode, the validity period of each label is displayed by the line epl, including the labels that are not displayed in the individual operation times as shown in FIGS. 8 to 10, for example. It is easy to visually determine how long it was created or how long it was deleted, so even if it is not clear when it was created and displayed on the desktop screen, It is possible to easily find out the period in which the label was present.

According to the label software of the present embodiment, in the 3D view mode, the wire frame wflp corresponding to the current time as shown in FIG. As shown, the wire frame wflo corresponding to the operation time can also be displayed. FIG. 16 shows an example in which the wire frame wflp corresponding to the current time when the current time is 12:03:10 on January 28, 2000 is displayed, and FIG. An example in which the wire frame wflo corresponding to the operation time when the time is 10:10:07 on October 10, 1999 is shown.
Of course, it is possible to simultaneously display the wire frames corresponding to the current time and the operation time on the desktop screen, or to display only one of them.

According to the label software of this embodiment, in the 3D view mode, the wire frame wflp corresponding to the current time, the wire frame wfl representing the unit time plane, and the wire frame wfl corresponding to the operation time are displayed. In order to make them distinguishable, the wire frame wfl representing the unit time plane is represented by, for example, a dark line, the wire frame wflp corresponding to the current time is represented by, for example, a red line, and the wire frame wfl corresponding to the operation time is represented by a line. For example, it is represented by a light blue line. In addition, not only the line of each wire frame,
It is also possible to color-code the entire surface formed by each wire frame. The line epl indicating the validity period of the label is displayed, for example, in red on the right side (future side) of the surface of the wire frame wflo corresponding to the operation time, and in blue on the left side (past side), for example. Of course, it is also possible to change the color of the line on the right (future side) and the left side (past side) of the surface of the wire frame wflp corresponding to the current time.

Further, according to the label software of the present embodiment, when the mouse cursor (mouse pointer) is placed on the line epl representing the label position and the validity period in the 3D view mode, the shape of the mouse cursor changes. Thereafter, when a predetermined time has elapsed, as shown in FIG. 18, a label indicating a state at a time corresponding to the position on the line epl where the mouse cursor is placed is pop-up displayed. In the example of FIG. 18, the label L4 corresponding to the valid period line epl4 is displayed in a pop-up display by moving the mouse cursor over the valid period line epl4.

According to the label software of the present embodiment, when the display is switched from the 2D view mode to the 3D view mode, for example, a plurality of unit time planes overlapping in parallel in the depth direction of the screen are displayed on the front side. From the point of view, gradually move the viewpoint left or right or up or down,
The three-dimensional display is performed such that each unit time plane is gradually rotated in accordance with the perspective and appears as the viewpoint moves. Conversely, when switching from the 3D view mode to the 2D view mode for display, the viewpoint is gradually shifted to the right, to the left, to the bottom, or to the plurality of unit time planes three-dimensionally displayed in perspective. It is possible to perform display such that the unit time plane moves in the upward direction and the unit time plane overlaps in parallel with the screen depth direction as the viewpoint moves.

Further, according to the label software of the present embodiment, as shown in FIG. 19, a plurality of two-dimensional desktop screens DTSa, DTSb, DTSc such as the past, present, and future in the time view mode are displayed in time. It is also possible to display as a three-dimensional structure arranged three-dimensionally along the axis.

The applicant of the present application has previously filed Japanese Patent Application No. 11-1.
According to the specification and drawings of Japanese Patent Application No. 08535 (Japanese Patent Application No. 10-321772), application software that displays a tag on a desktop screen and realizes a desktop environment capable of moving over time is proposed. FIG. 20 shows an example of a display screen when a time-based cooperation is performed between an application that realizes a desktop environment capable of moving over time and an application of an image browser. In FIG. 20, it is assumed that a search is first performed on the desktop by an application that realizes the desktop environment capable of moving in time, and the character moves in time until a certain character string or icon appears on the desktop screen. In this example, for example, "wearab
le ”into the search character input space 125, an application that implements a desktop environment capable of moving in time searches for the character string“ wearable ”, and the time of the meeting related to the character string“ wearable ” It is assumed that the icon, character string, and the like used in are displayed on the desktop window 200 that can be moved over time. In this example, as can be seen from the display contents of the date and time display section 127, the desktop environment at the time of the meeting held at 15:00 on Friday, November 20, 1998 (Fri) is displayed on the window 200. . As described above, when the “time of the application” is determined by the application that realizes the desktop environment capable of moving in time, the time information is notified to the image browser. Upon receiving the time information, the image browser displays a photographic image taken near the time (during the meeting) on window 2
Display on 01. In this example, as can be seen from the display contents of the creation time display unit 203 of the image file,
A photographic image taken at 16:00 on November 20, 1998 is displayed in the window 201. Conversely, when the user operates the image browser, the state of the desktop at the time when the photographic image was taken is reproduced. Therefore,
Even if the photo image does not have a special caption (explanation), it is possible to understand under what circumstances the photo was taken. If such an application is associated with, for example, the event operation of the jog dial 4, the time movement direction and the amount of the time movable desktop 200 can be operated with the jog dial 4. That is, for example, the jog dial window 90 is displayed at the lower right of the time-movable desktop 200, and the time movement operation to the past and the future can be performed in response to the scroll of the jog dial 4. According to this embodiment, these time-movable desktop windows can be displayed three-dimensionally along the time axis.

Next, FIGS. 21 to 23 show the flow of processing in the CPU 51 when the display on the desktop screen in the time view mode described above is realized by a personal computer using the label software of this embodiment.

FIG. 21 shows that when the time view mode is started after the label software of the present embodiment is started, switching between the 2D view mode and the 3D view mode is performed.
And a process flow after the switching.

In FIG. 21, after the start of the time view mode, the CPU 51 performs a process in step S1 as follows.
Menu button mb on time view console TVC
Is clicked and, for example, in the state where the operation menu as shown in FIG. 14 is displayed, by detecting whether a check mark has been added or removed from the item of “3D view”, It is determined whether or not the user has given an instruction to switch the mode between the 2D view mode and the 3D view mode. If it is determined in the determination processing of step S1 that an instruction to switch the time view mode has been issued, the process of the CPU 51 proceeds to step S2. If it is determined that no instruction to switch the time view mode has been issued, the process of the CPU 51 proceeds to step S3. .

When the CPU 51 proceeds to the process of step S2, it performs a view mode switching process according to the switching instruction in step S1, and then proceeds to the process of step S3. The details of the view mode switching process in step S2 will be described later.

When the CPU 51 proceeds to the process of step S3, the CPU 51 determines whether the current view mode is the 3D view mode, and when the CPU 51 determines that the view mode is the 3D view mode, the process proceeds to step S4. If it is determined that the mode is not the 3D view mode, the process proceeds to step S5.

When the CPU 51 proceeds to the processing in step S4, it performs the processing in the 3D view mode, and then proceeds to the processing in step S6. Also, the CPU 51 determines in step S
When the process proceeds to the process of 5, after performing the screen updating process in the 2D view mode, the process proceeds to the process of step S6. The details of the processing in the 3D view mode in step S4 will be described later.

When the processing proceeds to step S6, the CPU 51
Determines whether or not an instruction to end the processing in the time view mode has been given by the user. If it is determined that the instruction to end has not been issued, the process returns to step S1 and determines that the instruction to end has been issued. In this case, the processing in the time view mode ends.

Next, FIG. 22 shows step S2 of FIG.
5 shows a flow of a view mode switching process in FIG.

In FIG. 22, the CPU 51 determines in step S11 whether or not the instruction to switch the view mode in step S1 in FIG. 21 is an instruction to switch from the 2D view mode to the 3D view mode. Is performed. If it is determined in the determination processing in step S11 that the instruction is for switching from the 2D view mode to the 3D view mode, the processing of the CPU 51 proceeds to step S12 and subsequent steps, in which the CPU 51 switches from the 2D view mode to the 3D view mode.
Not an instruction to switch to D-view mode, ie, 3
If it is determined that the instruction is to switch from the D view mode to the 2D view mode, the process of the CPU 51 proceeds to step S15 and subsequent steps.

When it is determined in step S11 that an instruction to switch from the 2D view mode to the 3D view mode has been issued, and the process proceeds to step S12, the CPU 51 firstly changes the label of the two-dimensional display displayed in the 2D view mode. Erase from the desktop screen and the next step S1
As the process 3, as described above, for example, the viewpoint is gradually moved from a state in which the unit time plane of the two-dimensional display overlapping in parallel in the screen depth direction is viewed from the front, and the unit time plane is changed with the movement of the viewpoint. A three-dimensional display effect display process of gradually rotating and observing according to the perspective method is performed.
Then, as a process of step S14, the CPU 51
The display processing of the three-dimensional display desktop screen in the 3D view mode is performed.

On the other hand, if it is determined in step S11 that an instruction to switch from the 3D view mode to the 2D view mode has been given, and the process proceeds to step S15, the CPU 5
First, a three-dimensional display desktop screen displayed in the 3D view mode is first erased, and a plurality of unit time planes three-dimensionally represented in accordance with the perspective as described above are processed as the next step S16. , The effect display processing is performed such that the viewpoint is gradually moved, and the unit time planes overlap in parallel with the movement of the viewpoint to shift to two-dimensional display. Thereafter, as the processing of step S17, the CPU 51
Performs display processing of a two-dimensional display desktop screen in the 2D view mode.

After the processing in steps S14 and S17, the CPU 51 ends the view mode switching processing and proceeds to the processing in step S3 in FIG.

Next, FIG. 23 shows step S4 of FIG.
3 shows a flow of processing in the 3D view mode.

In FIG. 23, the CPU 51 updates the 3D screen as the processing in step S21, and then performs the processing in step S22 as a vertical line on the left side of the wire frame wfl constituting the unit time plane on the desktop screen. It is determined whether or not (the vertical line on the front side of the time frame of the unit time plane) has been dragged. If it is determined that the drag has been performed, the process proceeds to step S23. If it is determined that the drag has not been performed, the process proceeds to step S24. Proceed to processing.

When the process proceeds to step S23, the CPU 5
1 changes the interval of the time frame of the unit time plane on the desktop screen, that is, the time interval on the time axis according to the drag operation, and updates the 3D view mode desktop screen after the change of the time interval. indicate. After the processing in step S23, the processing of the CPU 51 proceeds to step S24.

When the process proceeds to step S24, the CPU 5
1 is to determine whether or not the user has requested to display the label at the position of the mouse cursor when the mouse cursor (mouse pointer) is positioned on the line epl of the validity period of the label and a predetermined time has elapsed. . In the determination processing of step S24, when it is determined that the label needs to be displayed in response to the request from the user, the processing of the CPU 51 proceeds to step S25, and when it is determined that the label does not need to be displayed, the processing of the CPU 51 is performed. The process proceeds to step S26.

When the process proceeds to step S25, the CPU 5
1 displays a label corresponding to the line epl of the valid period in which the mouse cursor (mouse pointer) is located. On the other hand, when the process proceeds to step S26, the CPU 51 deletes the label, for example, if the label has already been displayed. After the processing in steps S25 and S26, C
The PU 51 ends the processing in the 3D view mode shown in FIG.

Next, the details of the labels displayed on the desktop screen will be described below.

The label window screen displayed on the desktop screen includes a play / pause button, a stop button, a link button, a menu button, objects (text, image, sound) that can be pasted on the label, and icons ( Alarm, repetition). FIG. 24 shows an example of the window screen of the label L. In the example of the label L shown in FIG. 24, a play / pause button PB, a stop button SB, a link button LB, and a menu button MB are displayed, and text, sound, image, and link are pasted into the label L. It represents the state of being thrown. Note that the example of FIG. 24 particularly shows a state in which, for example, an image captured by a digital camera and a text “digital camera” indicating a label for the digital camera are displayed.

The play / pause button PB is a button for instructing, when the label L includes a sound object, to start or pause the reproduction of the sound. That is, when the play / pause button PB is pressed (clicked with a mouse or the like) while the label L includes a sound object, the sound is played, and further, the play and pause are performed during the play of the sound. When the stop button PB is pressed (clicked), the reproduction of the sound is temporarily stopped. A play and pause button PB is a tool tip TC indicating a playback time (a time during which a sound is recorded) as shown in FIG.
For example, when the cursor MC moves on the button PB, a tool tip TCt indicating the reproduction time is displayed.

The stop button SB is a button for stopping the reproduction of the sound. When the stop button SB is pressed (clicked) during the reproduction of the sound, the reproduction of the sound is stopped.

The link button LB is used to open a link destination file associated with the label L,
A button for displaying an L (HyperText Markup Language) format window. That is, when a file path is set as the link destination address in the label L, when the link button LB in the label window in FIG. 24 is pressed (clicked), the file set in the file path is set. The URL is opened and the label L is linked to the URL (Uniform Resource
If the link button LB is pressed (clicked), the HTML (Hyce Locator) is specified.
A window in the format of perText Markup Language) is displayed. The link button LB is associated with a tooltip TCl indicating the link content (a file path or a URL of a link destination) as shown in FIG. 26. For example, when the cursor MC moves over the link button LB. A tool tip TCl indicating the contents of the link is displayed on the screen.

The menu button MB arranged at the upper right of the label window is a button for displaying a menu of all operations related to the label (for example, file, addition of new label, time, label, help, etc.). It is. When the menu button MB is pressed (clicked), the menu items (file, addition of new label, time, label, help, etc.) are displayed as a pull-down menu near the menu button MB, for example. In each part on the label L, when the right mouse button is clicked, or when the application key is pressed with the focus, the menu (context menu) is the same as when the menu button MB is clicked. ) The item is displayed. The details of the pull-down menu by clicking the menu button MB in the label window and the context menu by the application key will be described later.

Further, depending on the status and setting of the label, an icon indicating the current state is displayed at the upper right of the label L (for example, to the left of the menu button MB). The icons include types such as an alarm icon IA and a repetition icon IR as shown in FIG. The alarm icon IA is an icon that is displayed when an alarm is set for a label, and is a repetitive icon IR.
Is an icon displayed when the repeated display is set.

The label in the time view mode may be a label whose correction is prohibited. For example, the label whose modification is prohibited is changed in color of the edge of the label (changes to a color different from the color of the edge of the label that can be modified)
It is distinguishable from a modifiable label. That is, in the present embodiment, the color of the label distinguishes the state of the label and the correction prohibition due to the state of the label so that the user can easily understand. As a specific example, the above-described distinction is made for a label whose modification is prohibited by changing the color of the edge of the label to, for example, “purple” or “blue”. For example, the color of the edge of the label is "purple"
Indicates that the current label is a label that cannot be corrected in past mode and future mode (correction prohibited label). Further, for example, when the color of the edge of the label is “blue”, it indicates that the label is a past label. Past labels cannot be modified in all modes.

Next, the task bar T on the desktop screen
The screen configuration of the label software icon IL of the present embodiment displayed on the task tray TT of B will be described.

In the label software of the present embodiment, for example, when the cursor (mouse pointer) is moved on the label software icon IL displayed on the task tray TT, a click is performed by pressing the left mouse button. Is repeated, a state of "display all" and a state of "hide all" are alternately executed for the label. In addition, the label software according to the present embodiment is configured such that when the user double-clicks by continuously pressing the left button of the mouse twice while the cursor (mouse pointer) is moved on the icon IL, the user can enter, for example, the environment. Default operation specified in advance by setting (for example, adding a new label,
Adding a new label and recording a voice, adding a new label and acquiring a captured image, and entering a time view mode). In addition, the label software according to the present embodiment is configured such that, when the cursor is moved on the icon IL and a right mouse button is pressed, a click is performed.
Displays a menu of all operations related to the label software project. FIG. 28 shows a display example of the operation menu when the “display all” state is designated for the label in the normal mode, and FIG. 29 shows “display all” for the label in the normal mode. 30 shows a display example of the operation menu in the past mode, and FIG. 31 shows a display example of the operation menu in the future mode.

Further, the icon IL has a different design or color in the current mode, the past mode, and the future mode. In the current mode, the icon IL has a different design in the state of "Hide all" and the state of "Display all". Icon is displayed. For example, FIG. 32A shows an example of the current mode icon IL, FIG. 32B shows an example of the past mode icon IL, and FIG. 32C shows an example of the future mode icon IL. (D) of FIG. 32 shows an example of the icon IL in the “hide all” state in the current mode.
Thus, the user can visually know the current state without performing an operation of opening the menu (the menu in FIGS. 28 to 31) of the task tray TT.

In the label software of this embodiment, the main menu itself does not exist, but various menus as described above are displayed under various conditions. The menu is displayed by the menu button M on the label L described above.
B, a menu button mb on the time view console TVC, and a context menu (menu displayed by right-clicking the mouse and pressing an application key).

First, the pull-down menu items by clicking the menu button MB in the label window will be described. The menu using the menu button MB in the label window includes menu items for all operations related to the label. The operation menu items related to the label include “Time view mode”, “Text”, “Sound”, “Image”, “Memo”, “Link”, “Label”, “Align”, “Background color”, “Layout”. , "Property", "file", "delete label", and the like.

The menu items of the “time view” are as follows.
This is for switching the display / non-display of the time view console described above.

[0120] The menu items of the above "text" relate to editing of text by word processing software or the like, and include "edit text", "cut", "copy", "paste", "delete", "Word wrap",
There are items such as "font". In the "text edit" item, the text pasted on the label can be edited on the dialog. In the “cut” item, the text pasted on the label can be cut on the clipboard. In the “copy” item, the text pasted on the label can be copied to the clipboard. "pasting"
Items allow you to paste text from the clipboard into a label. In the "delete" item, the text pasted on the label can be deleted. In the “word wrap” item, word wrap is performed when displaying text. In the “Font” item, a font used for text display can be set.

The "sound" menu item is for operating a sound, and includes "play",
"Pause", "stop", "record", "cut",
There are items such as "copy", "paste", and "delete". In the item of “reproduction”, for example, a sound object can be reproduced by a music-related operation tool. In the item of "pause", it is possible to pause while the sound is being reproduced. In the item of "stop", a stop operation can be performed during reproduction / pause of the sound. In the item of "recording", a new sound can be recorded. In the “cut” item, the sound object pasted on the label can be cut on the clipboard. In the item of “copy”, the sound object pasted on the label can be copied to the clipboard. The item “paste” allows a sound object on the clipboard to be pasted on a label. The item “delete” allows a sound object to be deleted. As a music-related operation tool, there is a MediaBar (trademark). In this media bar, for example, an operation of selecting reproduction of the next music or the previous music or temporarily stopping the reproduction by scrolling with a jog dial or a keyboard is performed.

The "image" menu item is for operating an image, and includes "capture image display", "shot", "cut", "copy", "paste", "delete", There are items such as "change to original size". In the item of “display of captured image”, for example, an application for capturing an image such as a still image / moving image capturing tool is activated, and a finder can be displayed. In the "shot" section,
The captured image can be pasted on the label. In the item “cut”, the image pasted on the label can be cut on the clipboard. In the item “copy”, the image pasted on the label can be copied to the clipboard. The item “paste” allows the image on the clipboard to be pasted on a label. In the item of “delete”, the image pasted on the label can be deleted. The item “set to original size” allows the image to be displayed in the original size. As the still image / moving image capturing tool, for example, there is Smart Capture (trademark) which is a still image / moving image capturing tool of a digital video camera.

The menu item “memo” relates to, for example, the operation of a handwritten memo using the handwritten memo tool, and includes “cut”, “copy”, “paste”,
There are "Delete", "Start", and "Set original size" items. In the item of “cut”, the handwritten memo pasted on the label can be cut on the clipboard. In the item of "copy", the handwritten memo pasted on the label can be copied to the clipboard. In the "paste" item, a handwritten memo on the clipboard can be pasted on a label. In the “delete” item, the handwritten memo attached to the label can be deleted. In the “start” item, for example, a handwritten memo application that reads handwritten input via a touchpad can be started. In the “set to original size” item, the image of the handwritten memo can be displayed in the original size. Note that the handwritten memo tool is a smart pad (Smart Pa
d) (trademark). This handwritten memo tool uses the touchpad 6 as an absolute coordinate detecting means, processes a handwritten memo input from the touchpad 6 by a drawing application, and displays it.

The menu item “link” relates to the operation of the link, and includes “link edit”,
There are "Open Link", "Cut", "Copy", "Paste", and "Delete" items. "Edit link" above
In the item, the link pasted on the label can be edited on the dialog. In the “open link” item, it is possible to open a link corresponding to a file path or a URL attached to a label.
In the case of a page, the browser can be started and the page can be displayed. The “cut” item allows the link pasted on the label to be cut on the clipboard. In the “copy” item, the link pasted on the label can be copied to the clipboard. In the "Paste" field,
The link on the clipboard can be pasted on the label. In the “delete” item, the link pasted on the label can be deleted.

The “label” menu item relates to an operation related to a label, and includes “always in front”,
There is an item for "behind." In the “always on the front” item, it is possible to set so that the label is always displayed on the front. In the "back" item, the label can be displayed at the bottom.

The "arrange" menu item relates to an operation of arranging labels, and includes "arrange at the left edge of the screen", "arrange at the upper edge of the screen", "align at the right edge of the screen", and "arrange at the lower edge of the screen". There are items for each. In each of these items, the label can be arranged at the left end, the upper end, the right end, and the lower end of the screen.

The menu item “background color” relates to the operation of the background color of the label.
By selecting the menu item, the background color of the label can be set.

The “layout” menu items relate to label layout operations, and include “default re-layout”, “custom layout”,
There are items of “expand / contract to label size”, “maintain image aspect ratio”, “set image to original size”, and “set handwritten image to original size”.
In the "relay by default" item, re-layout is possible with a default layout. The “custom layout” item allows the user to perform a layout. In the item “stretch to fit label size”, when the size of the label is changed, the attached object can be stretched to fit the size of the label. The “maintain image aspect ratio” item allows the aspect ratio of the original image to be maintained when the image is resized. In the item “set image to original size”, the image can be displayed in the original size. In the item “set handwritten image to original size”, the handwritten image can be displayed in the original size.

The “property” menu item can display the property of the label.

The "file" menu item is for operating a file, and includes "import" and "export" items. In the "Import" field, file data (text data, image data,
Sound data). In the “export” item, object data can be written to a file.

In the menu item "delete label", a label can be deleted.

Next, the context menu by the application key on the label window will be described. The content of the context menu in the label window changes depending on which position on the label is clicked with the right mouse button. That is, the position clicked by the right mouse button is on the “text object”, on the “image object”, on the play / pause button PB or the stop button SB (that is, on the “sound object”), or on the link. On the button LB (ie "link object")
On "handwritten image" or elsewhere (on "label")
The contents of the menu change depending on this. The menu items displayed in five places on these labels will be described below. Note that the contents to be actually executed are the same as those described for the button menu MB on the label L described above, and a description thereof will be omitted.

The context menu on the "text object" includes "text edit", "cut", "copy", "paste", "delete", "word wrap", "font", and "import file". "
There is an item "Export File".

The context menu on the “image object” includes “display captured image”, “shot”, “cut”, “copy”, “paste”,
There are "Delete", "Set Original Size", "Import File", and "Export File" items.

The context menu on the “sound object” includes “play”, “pause”, “stop”, “record”, “cut”, “copy”, “paste”, “delete”, There are "import file" and "export file" items.

The context menu on the “link object” has items of “link edit”, “open link”, “cut”, “copy”, “paste”, and “delete”.

The context menu on the "handwritten image" has items of "cut", "copy", "paste", "delete", "start", and "set to original size".

The context menu on the “label” includes “insert / edit”, “always front”, “back”,
There are items of "Alignment", "Background color", "Layout", "Properties", "Import file", "Export file", and "Delete label". The “Insert / Edit” item includes “Text Edit”, “Record”,
There are "shot", "link edit", "display captured image", and "from clipboard" items. In the item of the above "alignment", there are items of "alignment at the left edge of the screen", "alignment at the top edge of the screen", "alignment at the right edge of the screen", and "alignment at the bottom edge of the screen". "Relayout by default", "Custom layout", "Stretch to fit label size", "Keep image aspect ratio",
There are items of “set image to original size” and “set handwritten image to original size”.

The context menu on the “custom layout” includes “relay by default”,
There are items of “expand / contract to label size”, “maintain image aspect ratio”, “set image to original size”, “set handwritten image to original size”, and “end editing”.

Next, the pull-down menu items by clicking the menu button mb of the time view console in the bar state will be described. The menu by the menu button mb of the time view console includes menu items of all operations related to the time view mode. The operation menu items in the time view console include “add new label”, “current time”, “advance time”, “return time”, “time increase / decrease interval”,
"Time View Sound", "View Captured Image", "Label", "Arrange", "Project", "Settings", "Search Help", "About Label Software",
There are items such as "close console". In addition,
A description of a menu overlapping with a task tray icon described later is omitted.

In the "add new label" item, it is possible to add a label created during the operation time (however, after the present). In this "Add new label" field,
There are "Text Label", "Sound Label", "From Captured Image", "From Clipboard", and "From Import File" items.

The item "current time" can be set so as to be linked to the current time. In the item of “advance time”, the time can be advanced by one in the future direction in the set time increase / decrease step.

In the item of “return time”, the time can be moved forward by one in the set time increment / decrement step.

In the item of "time increase / decrease interval", the time increase / decrease step used for increasing / decreasing the time can be set to the designated time increase / decrease step. The item of “time increase / decrease interval” includes “100 years”, “10 years”,
"1 year", "January", "1 day", "1 hour", "1
There are items of "minute", "1 second", and "change point". According to the item of “change point”, as described above, the process moves to the step in which the label state has changed, such as generation / correction / discarding of the label, so that the time interval is not constant.

The "label" item includes "display all", "hide all", and "delete all" items.

The items of the above "alignment" include items of "alignment at the left end of the screen", "alignment at the top of the screen", "alignment at the right side of the screen", and "alignment at the bottom of the screen".

The items of the "project" include items of "new generation", "open", "close", "import", "export", and "property".

In the item of “close console”,
It is possible to turn off the time view console and return to the current state.

Next, the window menu items of the floating time view console will be described. The window menu items of the time view console in the rotating state include items of “file”, “add new label”, “time”, “label”, and “help”.

The "file" item further includes "display captured image", "project", "time view sound", "setting", and "close console" items. Items include "New", "Open", "Close", "Import",
There are "Export" and "Properties" items.

The items of "time view sound" include "setting" and "close console".

The items of “Add new label” include
There are "Text Label", "Sound Label", "From Captured Image", "From Clipboard", and "From Import File" items.

The items of “time” include “current time”,
"Advance time", "Return time", "100 years",
There are items of "10 years", "1 year", "January", "1 day", "1 hour", "1 minute", "1 second", and "change point".

The items of “label” include “align on the left side of the screen”, “align on the top of the screen”, “align on the right side of the screen”,
"Align at bottom of screen", "Show all", "Hide all",
There is an item "Delete All".

The items of "help" include items of "search for help" and "about label software".

Next, a context menu by an application key on the time view console will be described. Note that the contents to be actually executed are the same as those described for the menu button mb on the time view console described above, and a description thereof will be omitted.

The context menu on the time view console includes “current time”, “advance time”, “return time”, “time increase / decrease interval”, “time view sound”, and “close console”. There are each item. In the item of “time increase / decrease interval”, “100 years”,
There are items of "10 years", "1 year", "January", "1 day", "1 hour", "1 minute", "1 second", and "change point".

Next, a context menu using an application key on the background window in the time view mode will be described. Note that the contents to be actually executed are the same as those described for the menu button mb on the time view console described above, and a description thereof will be omitted.

The context menu on the background window in the time view mode includes “add new label”, “current time”, “advance time”, “return time”, “time increase / decrease interval”, “console”. Close each item.

In the item “Add new label”, it is possible to add a label created during the operation time (however, from now on), and “text label”, “sound label”, “from captured image”, “clipboard” From "and" From import file ".
In addition, the item “time increase / decrease interval” includes “100
Year, 10 years, 1 year, January, 1 day,
There are items of "1 hour", "1 minute", "1 second", and "change point".

Next, a context menu with a label software icon displayed on the task tray TT will be described.

In the context menu of the icon on the task tray TT, “Add new label”, “Time view mode”, “Time view sound”, “3
"D View", "Display Text (3D View)", "Display Captured Image", "Label", "Arrange", "Project", "Settings", "Tools", "Search Help", "Label Software" About ”and“ End ”.

In the above-mentioned “Add New Label” item,
There are "Text Label", "Sound Label", "From Captured Image", "From Clipboard", and "From Import File" items. In the "text label" item, an empty label can be created and placed on the desktop screen. When the setting of the label software is set to display the creation time, the creation time is inserted. In the "Sound label" item, a label can be created and placed on the desktop screen, and sound recording starts immediately after the creation of the label. If the setting of the label software is set to display the creation time, the creation time is inserted.
In the item “from a captured image”, it is possible to acquire a captured image from an application for capturing a captured image, create a label using the image, and place the label on a desktop screen. If the setting of the label software is set to display the creation time, the creation time is inserted. In the item "from clipboard", it is possible to create a new label from the data on the clipboard and place it on the desktop screen. The clipboard formats that can be used here are text, images, and notes from handwriting applications. If the setting of the label software is set to display the creation time, the creation time is inserted. If the clipboard data is text, the creation time is displayed in the first line, and the text in the clipboard is displayed from the second line. In the item “from the import file”, it is possible to create a new label from the data of the file and place it on the desktop screen. The file formats that can be handled here are text, images, sounds, and notes from handwriting applications. If the setting of the label software is set to display the creation time, the creation time is inserted.

In the “time view mode” item,
The display / non-display of the time view console can be switched.

In the item of “time view sound”, it is possible to switch on / off a sound that flows in the time view mode.

In the item “3D view”, setting to display in the 3D view mode is performed by checking the item.

In the item of “display text (3D view)”, the item is checked to check the 3D view.
A setting is made to display the text added to the label when the view mode is entered.

In the item of “display of captured image”, an application for capturing a captured image is started, and a finder for capturing an image can be displayed.

The "label" item includes "display all", "hide all", and "delete all" items.
In the item “display all”, all labels can be displayed. In the item “Hide all”, it is possible to temporarily hide all labels. When the label software icon IL on the task tray TT is accessed, this attribute is reset and all labels are displayed. This attribute is also reset when the label software is restarted. In the item “delete all”, all labels currently displayed can be deleted.

The items of the above "alignment" include items of "alignment at the left end of the screen", "alignment at the top of the screen", "alignment at the right side of the screen", and "alignment at the bottom of the screen". According to these items, it is possible to arrange the currently displayed labels at the respective places in the order of label creation.

The items of the "project" include items of "new generation", "open", "close", "import", "export", and "property". In the item “Create New”, it is possible to close the currently open project and create a new project. With the item “Open”, it is possible to close the currently open project and open another project.
In the item of “close”, it is possible to close the currently open project. In the "Import" section,
It is possible to add labels of other projects in the archive format to the currently open project.
The item "Export" allows the project to be exported as one file (archive). In the “property” item, it is possible to display the properties of the project. "Settings" above
Item, you can set the label, default layout, sound, image, and environment.

In the "tool" item, selection and setting of the various tools are performed.

In the item of "search for help", help can be displayed.

In the item “About label software”, version information of the label software can be displayed.

In the item of “end”, the label software can be ended.

Next, in the label software according to the present embodiment, “operation for a project”, “operation for a label”, “operation for a time view”, “operation for a keyboard / mouse”, and “operation for a jog dial” are possible. It is.

First, the "operation for a project" will be described.

The project manages all labels belonging to the project. In the label software of this embodiment, one project is always opened when a label is displayed and operated.

In the label software according to the present embodiment, a project is created at the time of initial startup and when a new project is selected from the menu. When creating a new project, determine the project name, close the existing project if it exists, and open a new project.

One project includes a project file, a label file, and a project archive file. The project file has information on the entire project and a list of labels, and exists one for one project.

The label file has information on individual labels such as object information, and one file exists for one label. The project archive file is a collection of project information and information of a plurality of labels included in the project in one file, and is created when the project is exported. The content is a project archive prepared in advance, and when a project is created, the content can be included in a newly created project. The project file and the label file belonging to the project exist in the same folder.

When the project is created, a dialog such as that shown in FIG. 33 is displayed, and the user inputs a project name in the dialog. In FIG. 33, the project name is the name of the lowest folder of the project and is input as the project file name. Note that an existing project name cannot be used. For this project name, for example, a project comment of up to 127 characters can be input.

When the project is created, a folder having the project name is created, and a project file is created thereunder. A project that has just been created has no labels. However, when the content including the content is specified, the label information is fetched from the archive. The operation of capturing the content is the same as the operation of importing a project described later. When the project is created, time information at the time of project creation is recorded as internal data.

The project is opened when the label software according to the present embodiment is started and when a designation is made from the console menu. When the label software is started, the project that was open at the time of the previous end is opened. When a project is opened, the labels belonging to the project are displayed on the desktop screen based on the time information and the position information. Also, it is not possible to open two or more projects at the same time, so if there is a previously open project, that project is closed.

When the project is closed, the currently open project is closed. At that time, all labels belonging to the opened project are closed.

Next, importing a project means adding all labels included in another project in an archive format to the currently open project. When importing the project,
When the import menu is designated, a file dialog is first opened, and a project archive file to be added by the user is designated in the file dialog. When the project archive file is selected, a filter for checking the archive type of each label is executed. The label archive types include the following “no correction”, “set current time as start time”, and “inquire user of start time”. In addition,
An archive type of "unmodified" is imported as it is without modifying the archive information.

When asking the user for the start time, a dialog for setting the time at the time of import, such as that shown in FIG. You. The user inputs a start time through this dialog.

Next, when the start time is input by the user in the dialog shown in FIG. 34, the dialog shown in FIG. 35 is opened after the filter is executed. The dialog shown in FIG. 35 is a project import dialog that displays the project information. At this time, when the import is executed, the data of all the labels of the project archive selected for the currently open project is copied together with the label file.

Here, among the labels to be imported, there are labels having the same history as the labels existing in the current project, or labels in which all histories of one completely match the other partial histories. In the case, for example, FIG.
A dialog for specifying the import method as shown in FIG. 6 is displayed. The dialog shown in FIG. 36 indicates whether the history is completely the same or which has a longer history. In the example of FIG. 36, “do not import label”, “overwrite with label of import file”,
It is possible to select a desired item from each item of "make a copy of label".

Next, in the label software of this embodiment,
As a project export, labels contained in a project can be saved together in one archive file that can be imported into another project.
When exporting the project, for example, FIG.
The project export dialog shown on the screen is displayed on the desktop screen. In the dialog shown in FIG. 37, the user can select “export file name”, “whether the exported labels are to be deleted from the current project”, “export all labels or generate labels in the specified time range, Whether to export a label that includes both deletion times ”is set, thereby creating a project archive file. The number of labels to be exported is displayed at the bottom of the screen of the dialog shown in FIG. Here, exporting a label means that all the history of the label is exported.

Next, when the project property is selected by the user, the label software of this embodiment
For example, a dialog as shown in FIG. 38 is displayed on the desktop screen. This dialog includes "Project folder", "Project comment", "Project creation time, Last update time", "Number of labels (overall,
Past, present, future) ”and“ label existence range ”are displayed. Note that the project folder name is displayed in “project folder”, and the description of the project set at the time of new creation is displayed in “project comment”. The information in this “project comment” can be edited. The “label existence range” indicates the label existence range, and indicates a range from the oldest history (the oldest label creation time) of all the labels to the newest history. If there is a label for which the deletion time is not specified, a check mark is added to the item “there is a label for which the deletion time is undetermined”.

Next, "operation for label" will be described.

As the “operation on the label”,
"New", "Add object", "Modify object", "Layout", "Alignment", "Properties", "Import and export objects",
Each operation of "delete label" is possible.

In the "new creation" operation of the label, when a new label is created, an object to be inserted first can be designated. Labels to be newly created include "text label", "sound label", "from capture image capture software",
"From clipboard", "From import file"
There are each type. The label creation time is displayed on the newly created label as a text object in addition to the above objects. Whether to display the creation time can be set on the setting screen. Each object is displayed according to a default layout described later. The display position of the newly created label is automatically determined. At the same time that a new label is created, a label file for storing the label information is created.

"New creation" also includes new creation in the future mode. That is, in the time view mode, a label to be created in the future (future label) can be added. In the new creation in the future mode, first, when a new creation of a label is selected by the user, a property screen of a new label as shown in FIG. 39 is displayed. By setting the start time, end time, repetition, and alarm of the label on the property screen of FIG. 39 by the user, a new future label can be created. The default value of the display time of the property screen in FIG. 39 is the operation time at that time, and the continuation is checked (O
N).

In the "add object" operation for the label, an object can be added to the currently displayed label. Here, in order to insert a new object, the user designates menu items “text”, “sound”, “image”, “handwritten memo”, and “link” from the menu button on the label. . The "Text" menu item allows you to edit text, paste, import files, and drag and drop. The "Sound" menu item allows you to record, import files, and drag and drop. It is possible, and in the menu item of "image", shot, paste,
For the import file and drag and drop operations, the paste operation is performed in the above “handwritten memo” menu item. Each operation is possible. Note that two or more objects of the same type cannot exist for one label.

In the "addition of object" operation for the label, "addition of object by drag and drop", "addition of position and size of object", and "addition of time view" are also possible.

In the above "adding objects by dragging and dropping", when a file icon of text, sound, or image is dragged and dropped to a place other than the link button of the label, each object is inserted into the label. In addition, an arbitrary file icon can be displayed on the keyboard by, for example, a control key (C
If you drag and drop on the label while holding down the (trl key) and shift key (Shift key) at the same time, or drag and drop on the link button,
The path of the file is added as a link object.

In the above “Addition of position and size of object”, the size and position of the added object follow the parameters of the default layout. If the text object and the image object are set so as not to overlap, and one of the objects is newly added, it is inserted below the existing object.

In the above “Addition in time view mode”, when the time view mode is the current mode,
The same operation as in the normal mode can be performed. When the time view mode is the future mode, an object can be added to the future label. In the operation of adding an object, only the final result is recorded, which is an initial setting at the time of label display. For labels that cannot be added, the frame of the label is purple (current label) as described above,
Or it is displayed in blue (past label).

In the operation of the above label operation, "correct object", "correct text" and "correct sound", "correct image", "correct handwritten memo", "correct link", "time view mode" Time correction "and" Paste from clipboard "are possible.

In the above-mentioned "text correction", when the user selects a text editing item from the menu button MB or the context menu mb, and further selects the menu, the current text as shown in FIG. An editing dialog with is opened. FIG. 4 above
In the dialog box 0, the text edit menu includes “file”, “edit”, and “insert” menus. In the above "File", there are "Import file" and "End text editing". In the above "Import file", you can select and insert a text file. In "End text editing", close the text editing screen. , The text content can be reflected on the label. The "Edit" menu item includes "Undo",
"Cut", "Copy", "Paste", "Delete",
There is an item "Select All". The “insert” menu item includes “current time and date” and “creation time and date” items. The “current time and date” inserts the current (real time) date and time, and In “Time and date”, the label creation time is inserted.

[0203] "Sound correction" can be performed when the user selects recording from the menu button MB or the context menu. At this time, a tool tip TCe indicating a recording time and a maximum recording time is displayed on the label as shown in FIG. 41, and the play button PB changes to a record button RB, thereby recording to the user. Inform that you are inside. Here, when the recording button RB is pressed during recording, the recording is temporarily stopped, and when the recording button RB is pressed again, recording can be performed from the continuation. In the “sound modification”, the sound data existing so far is overwritten.

[0204] In the "modification of image" described above, the label software of the present embodiment cannot modify an existing image object. Therefore, to change (correct) an image, an existing image object is replaced by inserting an image object.

In order to directly correct the handwritten memo created by the handwritten memo application as the “correction of the handwritten memo”, first, the start of the handwritten memo application is selected from the menu button MB or the context menu. After editing with the memo application, the edited memo is displayed on the menu button MB,
Alternatively, this can be realized by selecting paste in the context menu and newly inserting the label.

[0206] The "modification of link" is performed by the user.
This is enabled by selecting a link editing item from the menu button MB or the context menu. That is, when the menu is selected by the user, the label software of the present embodiment displays an editing dialog having the current link on the desktop screen as shown in FIG. 42, for example. The link edit dialog has an edit box EB and a file reference button. In the edit box EB of the dialog, a URL such as a path of a file or a folder or an address of a homepage is described. For example, when the “file reference button” is pressed, a file dialog is displayed. By selecting a file for which a link is to be created, a path to the file is input to the edit box EB. The menu items of the link edit dialog include “file” and “edit”. The “File” menu item has “Reference” and “End link editing” items. The “Reference” item is selected from the file dialog, and is the same as the file reference button. In the "end editing" item, the link correction screen is closed, and the link content is reflected on the label. The "Edit" menu item includes the following items: "Undo", "Cut", "Copy", "Paste", "Delete", and "Select All". This is an operation and the description thereof is omitted.

As the “correction in time view mode”, in the time view mode, an object can be corrected for a label newly displayed in the future.
Only the final result of the modification operation of the object is recorded, which is the initial setting at the time of label display.

In the “paste from clipboard”, the text, bitmap image, WAVE file, and handwritten memo file on the clipboard can be pasted on a label. If only one object in the clipboard can be attached to the label, that object is attached. When there are two or more objects that can be pasted on the label in the clipboard, for example, a dialog as shown in FIG. 43 is displayed on the desktop screen. Here, a check box of data existing on the clipboard is enabled and displayed, and the checked data is pasted as a label object.

Next, the “layout” of the operation on the label is determined based on the default layout. However, this default layout setting is used when creating a label and adding a new object. The default layout is also used when the user explicitly selects the re-layout command.

The default layout includes “label size (X × Y)”, “text margin (left end, top end,
Right edge) "," image margins (left edge, top edge, right edge) ",
There are parameters for "lay out text and images so that they do not overlap" and "settings for resizing (re-layout, maintaining image aspect ratio)". The “label size” is used as the maximum size in the horizontal direction and the minimum size in the vertical direction. "Text margin" and "image margin" are defined as shown in FIG. 44, and are set by the dialog shown in FIG. The size of each object in the vertical direction is determined by the data of the object, and expands and contracts. If the text object and the image object overlap as a result of the expansion and contraction, the lower object can be moved further downward so that the text object and the image object do not overlap (setting item: layout so that the text and the image do not overlap). Do).

There are two settings for the operation when the size of the label is changed. The first “re-layout” is to re-lay out an object when a label size is changed. If not set, the size of the object inside will not be changed even if the size of the label is changed. The second “maintain aspect ratio of image” is a setting as to whether to maintain the aspect ratio when the size of the image is changed due to the re-layout. The above setting is performed on the default label layout screen of the setting dialog of the label software of the present embodiment shown in FIG. In addition to the numerical input, as shown in FIG. 46, the sample can be displayed and set by dragging.

Further, according to the label software of the present embodiment, the user can freely customize the layout for each label in addition to the default layout. For example,
When a custom layout item is provided as a menu item and the custom layout is executed, the label L is displayed, for example, as shown in FIG. At this time, each object has a circumscribed dotted frame drawn therein, and the object can be moved by dragging and dropping the mouse inside the frame. Further, according to the label software of the present embodiment, the size of the object can be changed.
To change the size, click the object to select it. When the selected state is reached, the border of the label changes from a dotted line to a solid line, and handles (for example, small black squares) are displayed at the four corners and four sides. At this time, by dragging and dropping the handle,
You can change the size of the object.

In the label software of the present embodiment, when changing the size of the label, if the automatic expansion and contraction and the aspect ratio maintenance are set to ON, the left and right margins are set unless the image becomes the minimum size. Is always kept constant, and the text has four corners that are always kept constant. In this case, the vertical direction of the image may extend outside the label window in order to maintain the aspect ratio of the image. Also, turn on automatic expansion and contraction and turn off aspect ratio maintenance.
, The margins at the four corners are always kept constant unless the text and image are at their minimum size. Also,
Turn off automatic expansion and contraction and maintain aspect ratio on or off
, Text and images may fall outside the window. In all these cases, when the default layout is selected, the label size, the text, the left, right, and top margins of the image are set to default values. The height of the label, text, or image is automatically adjusted to a value that allows the text or image to be displayed sufficiently. Here, the value that can sufficiently display the text indicates a value that can display all the text. The value at which the image can be sufficiently displayed is a value at which the aspect ratio is correctly displayed and all the images can be viewed. The label has a bottom margin that is the same size as the top margin.

Next, "arrangement" of the operation on the label
There are three types of alignment: "Align to left edge of screen", "Align to top edge of screen", "Align to right edge of screen", "Align to bottom edge of screen"
There is. In the above-mentioned "alignment at the left end of the screen", the labels are arranged and displayed in order from the upper left of the screen toward the lower side. In addition, when it becomes the lower end of a screen, it shifts one step right and arranges similarly. In the above “alignment at the top of the screen”, the labels are arranged and displayed from the upper left of the screen to the right. At the right end of the screen, shift down one step and arrange in the same way. In the above-mentioned "arrange at the right end of the screen", the labels are arranged and displayed downward from the upper right end of the screen. At the bottom of the screen, shift one step to the left and arrange them in the same way. In the above-mentioned "arrange at the bottom of the screen", the labels are arranged and displayed from the bottom left of the screen to the right. At the right edge of the screen, shift up one line and arrange in the same way. Labels are arranged in the order registered in the label list of the project (in order of creation time). The labels are aligned so that they do not overlap each other, and the size of the labels does not change.

Next, in the “property” of the operation on the label, a label property dialog as shown in FIG. 39 is displayed. The display contents of the property include "label number", "history count", "valid period", "set repeat label", "set alarm"
There is. In the “label number”, a label number unique within the project is displayed. This label number is managed by the label software of the present embodiment, and cannot be changed by the user. The “history number” indicates the number of times the label has been modified since it was created. The “valid period” includes a “creation time” and a “deletion time”. The “creation time” displays the label creation time. This “creation time” cannot be changed except when a future label is newly created. In the “deletion time”, the time at which the label is deleted is displayed. This “deletion time” is valid only when continuation is checked. The “set of repetition label” includes “interval and unit of repetition”, “next display start time”, and “next display end time”. The "alarm setting" includes "time when the alarm is activated".

In the label software according to the present embodiment,
On the label property screen, the following “continuation / non-continuation”, “repetition setting”, and “alarm setting” settings for the label can be changed. In the "continuation / non-continuation" item, in the case of non-continuation, a label deletion time can be designated, and the label is automatically deleted when the designated time is reached. In the "repetition setting" item, if "check as a regular repetition label" in FIG. 39 is checked, repetition setting can be performed. Also,
In the “Repetition setting” item, a repetition interval, a display start time, and a display end time can be set. In the “alarm setting” item, a time at which an alarm is displayed is set relative to the start time of the label. The actual alarm time is displayed below the alarm setting.

In the label software of the present embodiment,
Display and non-display of the same label can be repeated at regular intervals. To make it a repeating label, use FIG.
In the label property screen of, check "Set as a recurring label (repeat periodically)" and set the repetition interval and the display time and non-display time of repetition. For example, if a label is displayed at 12:00 every day for 5 minutes, the following settings are made. Repeat: 1 day interval Next display start time: YYYY / MM / DD (current date) 12:00:00 Next display end time: YYYY / MM / DD (current date) 12:05:00 In the form of label software, if you attach each frame image of a movie, for example, to a plurality of labels, and set these labels to be displayed sequentially at the same position in a short time, it is possible to display like an animation Become.

In the label software of this embodiment,
By using an alarm, the user can be notified of an alarm event before or after the start of a specific label. To notify an alarm, an alarm is checked on the label property screen shown in FIG. 39, and an alarm time is set. When the alarm time is set in this way,
When the time specified by the alarm comes, FIG.
Is displayed on the desktop screen. This alarm dialog displays the alarm time and the label generation time. By operating this alarm dialog, the user can select whether to turn off the alarm or to sound again. In addition, when the item of “Time view of label generation time after closing the dialog” in the dialog of FIG. 48 is checked and the OK button is pressed, the time view mode is entered.
The operation time is set to the label generation time.

Next, as “import / export of objects” of the operation on the label, the label can import and display text, sound, and image files. The operation when imported is the same as adding or modifying an object. The label object can extract only its data as an export file. The file format that each object can import and export is
“Text: Text format (extension: .txt)”, “Sound: WAVE format (extension: .wav)”, “Image: Bitmap format (extension: .bmp)”, “GIF format (extension: .gif) "and" JPEG format (extension: .jpg) ". At the time of export, the object to be exported is determined based on the extension of the export file.

[0220] The "delete label" operation for the label includes the deletion of the current label and the deletion of the future label.

When deletion of the current label is selected, the current time is recorded as the end time and is deleted from the screen.
However, the label file is not deleted, and the label can be displayed by returning to the past in the time view mode. When the label is deleted in the future mode of the time view mode, a dialog as shown in FIG. 49 is displayed, and it is possible to select whether to set the operation time to the end time or to delete at the current time.

When the deletion of the future label is selected, FIG.
A dialog box for deleting a future label opens, as shown in (2), where you can select whether to set the operation time to the end time or delete the label completely. If you delete the label completely, the file and record of the label will be deleted and will not be displayed again in the time view mode.

The past label has already been deleted and cannot be further deleted.

Next, "operation for time view" will be described.

In the time view mode, the above-described time view console TVC is displayed, and the time operation in the time view mode is performed by the time view console TV.
Made from C. The transition to the time view mode is performed by displaying the time view console TVC as described above, and the time view console TV
C is the label software icon IL of the Thai tray TT
It is displayed by executing a command from the context menu or the label menu.

After the transition to the time view mode, the time is increased or decreased as described above.
For example, it can be executed from the operation or menu of the up / down buttons tub and tdb of VC. The unit by which the time is changed by the increase or decrease of the time depends on the setting of the above-described time increase / decrease unit (time increase / decrease step).

In the label software of the present embodiment,
You cannot create labels in the past or modify labels in the past.
Note that past labels cannot be corrected, but label movement / label size can be changed. However, this operation is not recorded in the project. Immediately after the operation is completed (immediately after the mouse is dragged), the label returns to the original position / original size. This operation is to temporarily move / resize, for example, to see the label underneath.

In the label software of the present embodiment,
Unlike the past labels, new labels can be created as future labels (future labels). If you create a future label, the label will disappear from your desktop screen when you return to the present. But the current time,
When it comes time to create a future label, it will reappear on the desktop screen. Therefore, creating a future label can be used as a simple reminder. The modification of the future label can be performed in the same manner as at the current time. However, unlike the case at the current time, the history of the correction is not recorded, and only the final result of the correction is saved. Therefore, when a correction is made in the future, the final result is used as a parameter when the label is generated.

[0229] The time view mode is ended by pressing the close button cb of the time view console TVC or by selecting "close time view console" from the menu.
This is done by selecting

In the time view mode, the ON / OFF of the time view sound that flows when the mode shifts to the time view mode and at the end of the time view mode can be performed from a menu.

Next, “operation for keyboard / mouse” will be described.

According to the label software of this embodiment, various shortcut keys are set as specific operations on the keyboard.

For example, a control key (Ctrl key)
And the tab key (Tab key) are pressed at the same time, or when the shift key (Shift key), the control key (Ctrl key) and the tab key (Tab key) are pressed at the same time, the label of the label currently displayed on the screen is displayed. An operation to change the vertical relationship of windows is realized. The operation at this time changes depending on the number of labels currently existing. For example, if there is less than one label, nothing is done. However, a predetermined sound is emitted to indicate that the operation is invalid. For example, when there are two or more labels, the control key and the tab key are simultaneously pressed to move the frontmost label to the rearmost position in the label. By pressing the shift key, the control key, and the tab key at the same time, the rearmost label is moved to the front in the label.

For example, when the delete key (Del key) is pressed, the label having the current focus is deleted. Before deleting the label, display a dialog asking if you want to delete it.

When the escape key (Esc key) is pressed, the currently focused label is temporarily hidden. The hidden label will reappear the next time the time changes.

When the control key and the B key are pressed simultaneously, the console is closed in the time view mode. When the control key and the D key are pressed at the same time, the label having the current focus is laid out by default. When the control key and the E key are pressed at the same time, the text editing of the label having the current focus is opened. When the control key and the L key are pressed simultaneously, the link of the label having the current focus is opened. When the control key and the N key are pressed at the same time, a text label is created. When the control key and the O key are pressed simultaneously, the sound of the label having the current focus is stopped. When the control key and the P key are pressed at the same time, the sound of the label having the current focus is played. When the control key and the R key are pressed at the same time, recording of the label having the current focus is started. When the control key and the T key are pressed simultaneously, enter the time view mode / exit the time view mode. When the control key and the V key are pressed at the same time, the contents of the clipboard are pasted on the label having the current focus. Control key and down key (D
When the (own key) / control key and the up key (Up key) are simultaneously pressed, the time is increased or decreased in the time view. When the control key and the left key (Left key) / the control key and the right key (Right key) are simultaneously pressed, the time increment / decrement step of the operation time display section on the time view console is changed. When the control key and the home key (Home key) are pressed simultaneously, the display returns to the current time in the time view mode.

Next, according to the label software of this embodiment, the operations on the mouse (especially the mouse with a wheel) include “operation on labels”, “operation on time view console”, and “operation on desktop in time view mode”. Is set.

The “operation on label” includes “drag and drop on label”, “drop on label from another application”, “
Right-click "," Rotate wheel around label ",
"Wheel click on label", "Drag and drop on file icon label (except on link button)", "Drag on control key and shift key and file icon label (except on link button)" And drop, or drag and drop on a link button for a file icon. In the operation of “drag and drop on a label”, the label is moved. In the operation of “dropping a label from another application”, an object is pasted on a label for data that can be recognized by the label software of the present embodiment. An error dialog is displayed for data that cannot be recognized by the label software of the present embodiment. In the above "Right click on label" operation,
At that time, a context menu depending on the object clicked is displayed. In the operation of “rotation of the wheel with respect to the label”, the context of the label is adjusted. In the operation of “clicking the wheel on the label”, the time view console is displayed, and the mode shifts to the time view mode. In the operation of “drag and drop on the label (except on the link button) for the file icon”, the text, image, and sound file are inserted as objects. If the file is not recognized as an object, ask if you want to insert it as a link object to the file. On the label for the control key, shift key and file icon (except on the link button)
In the operation of “drag and drop to file or drag and drop onto link button for file icon”, the path to the dragged and dropped file is inserted as a link object. If an attempt is made to insert a file path as a link object by dragging and dropping a place other than the link button LB on the label, a warning dialog as shown in FIG. 51 is displayed. If the "Yes" button is pressed when this dialog is displayed, the same processing is performed as when a file path is inserted as a link object by drag and drop onto the link button LB on the label.

The "operation for the time view console" includes "right-click for the console", "rotation of the wheel with respect to the console operation time display", and "rotation of the wheel with respect to the console time increase / decrease step selection list box". There is each operation of. In the operation of “right-click on the console”, a context menu is displayed. The operation of “rotation of the wheel with respect to the operation time display section of the console” corresponds to an increase or decrease in time. In the above "Console time increase / decrease step selection list box,
The operation of “rotation of the wheel” corresponds to the change of the time increase / decrease interval.

The "operation on the desktop in the time view mode" includes the operations of "clicking the wheel on the desktop in the time view mode" and "right-clicking on the desktop in the time view mode". The operation of “clicking the wheel on the desktop in the time view mode” corresponds to changing the increase / decrease interval. In the operation of “right-click on the desktop in the time view mode”, a time view context menu is displayed.

Next, the “operation on the jog dial” will be described.

In the label software according to the present embodiment, the operations on the jog dial include “rotation of the jog dial right / left”, “push of the jog dial (the interval between pressing and releasing the pressing is 1 second or less)”, “operation of the jog dial”. Long press (interval from press to release of press is 1 second or more) ". In the label software according to the present embodiment, the following functions are assigned to operations on the jog dial. However, the label software of the present embodiment does not pick up these jog dial operations globally at any time, but reacts to the jog dial operation only when the label software has focus.

For example, in the case of the normal mode, the label software according to the present embodiment is used for the operations of “rotation of the jog dial right / left” and “push of the jog dial (the interval between pressing and releasing the pressing is 1 second or less)”. react. That is, in the normal mode, when an operation of “rotation of the jog dial right / left” is performed, the label software of the present embodiment changes the vertical relationship of the window of the label currently displayed on the screen. The operation at this time varies depending on the number of labels currently existing. For example, when the number of labels is one or less, nothing is performed even if the jog dial is rotated right / left. However, a predetermined sound is emitted to indicate that the operation is invalid. Also, for example,
If there are two or more labels, if the jog dial is rotated to the right, the label at the front is moved to the rear of each label, and conversely, if the jog dial is rotated to the left For example, move the last label to the front of each label. Also, in the case of the normal mode, when the operation of “push of the jog dial (the interval between pressing and releasing the pressing is 1 second or less)” is performed, the label software of the present embodiment displays the time view console,
Move to time view mode.

In the case of the time view mode, the label software according to the present embodiment uses “the jog dial is rotated right /
It responds to all operations of "left rotation", "push of jog dial (interval from press to release of press is 1 second or less)", and "push of jog dial (interval from press to release of press of 1 second or more)". That is, when the operation of “jog dial right / left rotation” is performed in the time view mode, the label software according to the present embodiment responds to increase or decrease of time. For example, when the jog dial rotates clockwise, the time advances in the future direction, and when the jog dial rotates counterclockwise, the time advances in the past direction. In addition, when the operation of “push of the jog dial (the interval between pressing and releasing the pressing is 1 second or less)” is performed,
The label software according to the present embodiment corresponds to a change in the time increase / decrease interval (time increase / decrease step) when increasing / decreasing the time.
For example, every time the jog dial is pushed, 100
Year, 10 years, 1 year, January, 1 day, 1 hour, 1 minute, 1 second,
The time increase / decrease interval changes in the order of 100 years, 10 years,.... When the jog dial is rotated while pressing the shift key, the time increase / decrease interval changes in the reverse order of the case where the jog dial is rotated alone. The time increase / decrease interval selected when the jog dial is pushed can be set at the time of environment setting. When the operation of “pushing the jog dial (the interval between pressing and releasing the pressing is 1 second or more)” is performed, the label software of the present embodiment closes the time view console and shifts to the current mode.

Here, the label software of this embodiment is
When the operation of the jog dial is performed as described above, the operation at the time of operating the jog dial is displayed as a jog dial guide on the desktop screen, so that the user can be informed of the operation state of the jog dial and the operation content corresponding to the jog dial operation. It can be presented. That is, in the label software of the present embodiment, as described above, since the functions assigned to the operation of the jog dial are different between the normal mode and the time view mode, the jog dial guides having different contents are displayed.

FIG. 52 shows an example of the jog dial guide in the normal mode, and FIG. 53 shows an example of the jog dial guide in the time view mode. That is, FIG.
The jog dial guide in the normal mode shown in FIG. 4 includes the above-described “rotation of the jog dial right / left” and “pushing of the jog dial (the interval between pressing and releasing the pressing is 1 unit).
Seconds)) as a guide. Further, the jog dial guide at the time view shown in FIG.
Using the contents of the functions corresponding to "Rotate left", "Jog dial push (interval from press to press release is 1 second or less)", "Jog dial push (interval from press to press release of 1 second or more)" as a guide indicate.

Next, the contents of the settings in the label software of this embodiment will be described below. In the label software of the present embodiment, “label setting”, “default label layout setting”, “sound recording setting”,
“Image setting” and “environment setting” are possible. These settings are saved in the registry and used as common settings for all projects.

As the “setting of label”, the level software of the present embodiment can set a default value of the label. As shown in FIG. 54, the label settings are displayed on the screen as “Default background color”, “Default font (including text color)”, “Default word wrap state”, “Display creation time” And "Apply background color only to text". In the "default background color", the background color of a newly created label is set. In the "default font (including text color)", the font of a newly created label is set. In the above "Default Word Wrap State"
Sets whether to apply word wrap to newly created labels. In the "display creation time", it is set whether or not the creation time is displayed on a newly created label. In the above “apply background color only to text”, for the currently displayed label, whether the background color is applied to the entire label or only the text is set. Note that a sample of the label state according to the current settings is displayed at the bottom of the setting screen of the label software.

In the “setting of default label layout”, a default layout is set in the above-mentioned layout part.

In the "sound recording setting", various parameters for sound recording are set. As the setting contents, as shown in FIG. 55, there are respective items of “sound source”, “quantization level”, “sampling frequency”, and “maximum recording time”. Monaural / stereo can be set for the above “sound source”, and 8 bit / 1 for the “quantization level”.
When the setting of 6 bits is “Sampling frequency”, 11.
The setting of 025 kHz, 22.05 kHz, and 44.1 kHz can be set to 1 to 1000 Sec for the “maximum recording time”.

In the "image setting", an image is set when the capture image capturing application is used.
As shown in FIG. 56, the setting contents include “operation when a capture capture button is pressed”, “format of an image captured from a capture image capture application”, and “setting of JPEG compression”. The “operation when the capture capture button is pressed” includes items of “capture an image on a currently selected label” and “capture an image on a new label”. In the above-mentioned "Import image to currently selected label", when a label is not selected, the user is asked to create a new label. In the above-mentioned "Importing an image into a new label", a new label is always created and an image is imported into a new label. The “format of an image captured from the captured image capturing application” includes items of “bitmap” and “JPEG”. Since the above “bitmap” is not H-compressed, the original is preserved, and the above “JPEG” is compressed, but the disk capacity can be reduced. In the "JPEG setting", when "JPEG" is set in the "format of image captured from capture image capturing application", the compression ratio of the captured image is set. The range of the compression ratio is 1/1 to 1/64.

In the "environment setting", "default command", "startup", and "time increase / decrease interval" are set as the environment setting as shown in FIG. The "default command" sets a default command to be executed when the icon IL of the label software on the task tray TT is double-clicked. The “default command” can be selected from “Add new label”, “Add new label and record sound”, “Add new label and get image from captured image capture application”, “Time view mode” Enter. " The default value is “add new label”. In the above “Startup”, set whether to register as a startup. In the "time increase / decrease interval", the time increase / decrease interval (time increase / decrease step) selected when the time increase / decrease step selection menu button sb is pressed in the time view mode is set. The time increase / decrease interval not set here cannot be used,
You can select from a combo box or by clicking on a date string. Note that the time increase / decrease interval checked here is marked with “*” to the right of the character in the time increase / decrease step selection list box ssl, as described above.

According to the label software of the present embodiment having the functions as described above, by saving all the operations on the labels on the desktop screen, it becomes possible to reproduce the state of the label at any time in the past. ing. In addition, as a method of saving the state of the label on the desktop screen, a method of saving all the information of a plurality of labels at a certain time and a method of saving only the difference of the information of the label at a certain time are considered. As the timing for saving the state of the label, there are a method of periodically saving at a fixed interval, and a method of saving when the label changes. In addition, in the case of the method of storing the difference of the label information, a method of storing the operation on the label (that is, storing the operation history) and a method of storing the difference of the label information before and after the operation on the label (that is, the label) Save the changed part of the information).

According to the label software of the present embodiment having the functions described above, not only the operation for the current label but also the future operation is reserved, so that the label (future label) can be used as a reminder. It can be used. The operation of the future label is determined when the current time reaches the time set for the future label.
Therefore, the history of the operation of the future label is not stored, and only the information of the last operation is stored. It is possible to have a history for a future label, but if a history is provided for a future label, there will be multiple futures, which is beyond the scope of human understanding. Then, it is not adopted to have the history of the future label. Further, as a method of reserving an operation for a future label, not only an operation for simply creating a label, but also a repeated operation for displaying / non-displaying a label can be considered.

FIGS. 58 to 61 show the flow of processing in the CPU 51 in the case where the above-described processing is realized by a personal computer using the label software of this embodiment.

FIG. 58 shows the overall flow of the above-described label state reproduction processing at an arbitrary point in the past, the reservation and reproduction processing of an operation for a future label, the alarm processing, and the like.
First, when the label software is started in step S131, the CPU 51 performs a recording process of any operation performed on the label in step S132, and sets an alarm in step S133. If so, the alarm processing is performed, and as step S134, when the setting such as repetition is performed on the label, the label updating processing is performed. Thereafter, in step S135, the CPU 51 determines whether or not each process has been completed. If it is determined that the processes have not been completed, the process returns to step S132. If it is determined that the processes have been completed, the process proceeds to step S136. .
When proceeding to the processing of step S136, the CPU 51 performs end processing of the label software.

FIG. 59 shows a detailed flow of the operation recording process in step S132 of FIG. In FIG. 59, when the operation recording process is started, the CPU 51 determines whether or not any operation has been performed on the label by the user in Step S141. If it is determined in step S141 that the operation on the label has not been performed, the operation recording process ends, and the flow advances to the process in step S133 in FIG. On the other hand, step S14
If it is determined in step 1 that an operation has been performed on the label,
The CPU 51 proceeds to the process of step S142, and calculates difference information between the labels before and after the operation is performed.
Thereafter, the CPU 51 determines in step S143 that the operation on the label is the current label operation (operation history).
Or a future label operation (operation reservation). If it is determined in step S143 that the operation is a current label operation, in step S144, the CPU 51 adds the current time to the label difference information and saves the information. On the other hand, if it is determined in step S43 that the operation is a future label operation, the CPU 51 adds the reservation time to the label difference information and saves the information in step S145. After the processing of steps S144 and S145, the CPU
51 ends the operation recording process and proceeds to the process of step S133 in FIG.

FIG. 60 shows a detailed flow of the alarm processing in step S133 of FIG. 58. In FIG. 60, when the alarm process is started, the CPU 51 determines whether or not an alarm has been set on the label in Step S151. In this step S151,
If it is determined that an alarm has not been set for the label, the process proceeds to step S156. On the other hand, step S
If it is determined in 151 that an alarm has been set on the label, the CPU 51 determines whether the current time has passed the alarm setting time (whether or not the alarm setting time has elapsed), and has determined that the time has passed. If so, step S153
If it is determined that the time has not passed, the process proceeds to step S156. The CPU 51 determines in step S153
In step S154, an alarm is sounded, and thereafter, in step S154, it is determined whether or not it is necessary to display a target label corresponding to the alarm. The CPU 51
If it is determined in step S154 that the target label does not need to be displayed, the process proceeds to step S156. If it is determined that the target label needs to be displayed, the process proceeds to step S155. When the process proceeds to step S155, the CPU 5
1 sets the display time to the time when the target label exists,
Next, the process proceeds to step S156. Step S156
CPU 51 determines whether or not the processing of the alarms for all the labels has been completed. If it is determined that the processing has not been completed, the processing returns to step S151. If it is determined that the processing has been completed, the processing proceeds to step S151. The alarm process ends, and the process proceeds to step S134 in FIG.

FIG. 61 shows the detailed flow of the process in step S134 in FIG. 58. In FIG. 61,
When the label updating process is started, the CPU 51 determines whether or not there is a label set repeatedly, as step S161, and if not, the process proceeds to step S161.
Proceeds to the process of 163, and if it is determined that there is, step S
The process proceeds to 162. When the process proceeds to step S162, the CPU 51 repeats the label process, and then proceeds to step S163. Step S163
The CPU 51 determines whether the current state is being displayed (current mode) or not (if it is determined that the current state is not being displayed (that is, the past or future mode)), the processing of step S165 If it is determined that the display is being performed (current mode), the process proceeds to step S164. When the process proceeds to step S164, the CPU
51 sets the display time to the current time, and then proceeds to the processing of step S166. On the other hand, when proceeding to the processing of step S165, the CPU 51 sets the display time to the time designated by the user, and then proceeds to the processing of step S166. When proceeding to the processing of step S166, the CPU 51 displays the state of the label of the set display time (current, past,
Any mode in the future). After that, the CPU 51
The label update processing ends, and the flow advances to the processing in step S135 in FIG.

Next, the label software of the present embodiment has the above-described functions, so that not only fixed information such as text and images but also all information can be indirectly pasted on labels. It has a link function that can be used. As described above, according to the label software of the present embodiment, by realizing the link function, it is not necessary to display all information in a label having a limited size, and the effective use of the label area can be reduced. It is possible. That is, in the case of a label having no link function as in the present embodiment, it is necessary to take in all information when an object is attached to the label. In the label software of the present embodiment, it is also possible to display all link information in a label. By the link function, the personal computer in a state where the label software of the present embodiment is activated can display not only information in a local machine but also information on a network on a label. As described above, since the information on the network can be set as a link on the label, the personal computer according to the present embodiment can display the content of the link only when a user's execution request is issued. You do not need to be connected to a network.

The flow of processing in the CPU 51 when the above-described link function on a label is realized by a personal computer using the label software of this embodiment is shown in FIGS.
As shown in FIG.

FIG. 62 shows the overall flow of the process of indirectly pasting all information on the label by a link. First, when the label software is started in step S171, the CPU 51 determines whether or not the link has been corrected in step S172. If it is determined that the link has not been corrected, the CPU 51 proceeds to step S172.
Proceed to 174. On the other hand, if it is determined that the link has been corrected, the process proceeds to step S173. When proceeding to the process of step S173, the CPU 51 performs a link editing process. Next, the CPU 51 determines in step S174
It is determined whether or not to execute the link. If it is determined that the link is not to be executed, the process proceeds to step S176.
If it is determined to execute, the process proceeds to step S175. When proceeding to the processing of step S175, the CPU 51
Perform link execution. Thereafter, the CPU 51 determines whether or not the processing has been completed in step S176,
If not completed, the process returns to step S172, and if completed, the process proceeds to step S177. When proceeding to the process of step S177, the CPU 51 performs a label software end process.

FIG. 63 shows a detailed flow of the process in step S173 in FIG. In FIG. 63,
When the link editing process is started, the CPU 51 determines in step S181 whether the link has been edited by, for example, drag and drop using a mouse. The process proceeds to step S183. If it is determined that the drag and drop operation is not performed, the process proceeds to step S182. If the process proceeds to step S183, the CP
U51 saves the dragged and dropped file path or URL as a link, ends the link editing process, and proceeds to the process of step S174 in FIG. On the other hand, when the process proceeds to step S182, the CPU 51 displays the link edit dialog shown in FIG. 32, and then proceeds to the process of step S184. In step S184, the CPU 51 determines whether a file path or URL of a link destination has been input in the link edit dialog or an instruction to refer to a link has been issued. When it is determined that the URL or the URL has been input, the process proceeds to step S187, and when it is determined that the link reference has been instructed, the process proceeds to step S1.
Proceed to 85. When the process proceeds to step S187,
After saving the input file path and URL as the link destination, the CPU 51 ends the link editing process and proceeds to the process of step S174 in FIG. Further, when proceeding to step S185, the CPU 51 displays a dialogue for link reference, and then proceeds to the processing of step S186.
When the process proceeds to step S186, the CPU 51 stores the referenced file path or URL as a link destination, ends the link editing process, and proceeds to step S1 in FIG.
Proceed to 74.

FIG. 64 shows a detailed flow of the process in step S175 in FIG. In FIG. 64,
When the link execution process is started, the CPU 51 determines in step S191 that the stored link information is U
It is determined whether or not the URL is a URL. If it is determined that the URL is the URL, the process proceeds to step S193. If it is determined that the URL is not the URL, the process proceeds to step S192. Step S
When proceeding to the process of 193, the CPU 51 opens the stored link information as a URL, thereafter ends the link execution process, and proceeds to the process of step S176 in FIG. When the process proceeds to step S192, the CPU 5
1 determines whether or not the stored link information is a path to an executable file, and if it is determined to be a path to an executable file, the process proceeds to step S195, where the path to the executable file is determined. If it is determined that it is not, the process proceeds to step S194. When the CPU 51 proceeds to the process of step S195, executes the stored link as an execution file, ends the link execution process, and proceeds to the process of step S176 in FIG. On the other hand, when the CPU 51 proceeds to the process of step S194, opens the saved link as a document file, ends the link execution process, and proceeds to step S194 of FIG.
Proceed to 176.

Next, the label software according to the present embodiment has the above-described functions, so that the time label can be easily displayed on the desktop screen for the present / past / future purpose.

Here, as a method of moving the time of the label on the desktop screen, for example, a method of advancing / returning the label at a fixed interval by executing one command of the user can be considered. This makes it possible to easily search for information one day or one hour later, and the like.

As a method of moving the time of the label on the desktop screen, there is a method of moving the time forward / back to a point in time when the information held by the execution of one command by the user changes. The time interval at this time is not constant, but is determined by the change point of the label information. Therefore, the time interval for moving is variable. As a result, it is possible to easily search for the switching point of the label information.

Further, as a method of moving the time of the label on the desktop screen, a method of changing the way of time advance / return at an accelerated rate by executing a continuous command by the user is also possible. As a result, it is possible to easily and quickly move to a target time.

FIGS. 65 to 67 show the flow of processing in the CPU 51 when the function of moving the time of the label on the desktop screen described above is realized by a personal computer using the label software of the present embodiment.

FIG. 65 shows the overall flow of a process for enabling movement at any time in the present / past / future. First, as step S201, when the label software is started,
The CPU 51 determines the unit of time movement, that is, the above-mentioned time increase / decrease interval (time increase / decrease step), as step S202
It is determined whether or not there is a change. If it is determined that there is no change in the time increase / decrease interval (time increase / decrease step), the process proceeds to step S204. If it is determined that there is a change, the process proceeds to step S203. . When proceeding to the process of step S203, the CPU 51 performs a process of changing the time movement unit according to the operation from the user, that is, a process of changing the time increase / decrease interval (time increase / decrease step). Next, as step S204, the CPU 51 determines whether or not the movement of the time of the label displayed on the desktop screen has been instructed.
The process advances to step S205, and when it is determined that the instruction has been made, the process advances to step S205. When proceeding to the process of step S205, the CPU 51 performs a process of moving time, that is, a process of moving to a desktop screen in a past mode or a future mode.
After the time movement process in step S205, the CPU
In step S206, the display is updated at the set time, and the process proceeds to step S207. Thereafter, the CPU 51 determines whether or not the process has been completed in step S207. If not, the process returns to step S202.
Proceed to processing. When the process proceeds to step S208, the CP
U51 performs the end processing of the label software.

FIG. 66 shows a detailed flow of the processing in step S203 in FIG. 65. In FIG. 66,
When the process of changing the time movement unit (changing the time increase / decrease interval) is started, the CPU 51 determines in step S211 whether the unit of the information change point has been set as the movement unit. If it is determined that the setting has been made, the process proceeds to step S213. If it is determined that the setting has not been made, the process proceeds to step S212. When proceeding to the processing of step S213, the CPU 51 sets a change point of the information as a time movement interval (time increase / decrease interval, time increase / decrease step), ends the movement unit change processing, and ends the step of FIG. The process proceeds to S204. Further, when proceeding to the processing of step S212, the CPU 51
Specified units (100 years, 10 years, 1 year, January, 1
.., Etc.) are set as time movement intervals (time increase / decrease intervals, time increase / decrease steps), and then the process of changing the movement unit is terminated, and the process proceeds to step S204 in FIG.

FIG. 67 shows a detailed flow of the process in step S205 in FIG. In FIG. 67,
When the time movement process is started, the CPU 51 determines whether or not the movement time is directly specified from the operation time display unit oti at Step S221. If it is determined that the time is directly specified, the process proceeds to Step S223.
If it is determined that it is not directly specified, the process proceeds to step S222. When proceeding to the processing of step S223, the CPU 51 sets the directly designated time as the movement time (time increase / decrease interval, time increase / decrease step), ends the movement processing for the time, and performs the processing of step S206 in FIG. Proceed to. Further, when proceeding to the process of step S222, the CPU 51 determines whether or not the interval of the change point of the information is set as the time movement interval (time increase / decrease interval, time increase / decrease step), When it is determined that the interval has not been set, the process proceeds to step S225, and when it is determined that the interval between the change points has been set, the process proceeds to step S224. In the process of step S225, the CPU 51 performs a process of advancing (or returning) the time at a set time interval, ends the moving process for the time, and proceeds to the process of step S206 in FIG. When the process proceeds to step S224, C
The PU 51 searches for the next (or previous) change point. Next, in step S226, the CPU 51 determines whether or not the next (or previous) change point has been found. If it is determined that the next change point has not been found, the CPU 51 ends the movement process for that time and returns to step S206 in FIG. Proceed to the process, and if it is determined that it is found, proceed to the process of step S227. When proceeding to the processing of step S227, the CPU 51 sets the time found by the above search as the moved time, and thereafter ends the moving processing for that time and proceeds to the processing of step S206 in FIG.

Next, the label software according to the present embodiment has a function as described above, so that a jog dial can be used as a user interface for moving a label on a desktop screen over time.
By using the jog dial, the operation of advancing the time / returning the time is realized by the operation of turning the jog dial clockwise / clockwise, and as a result, the time movement operation can be performed smoothly.

Further, according to the label software of the present embodiment, by having the above-described functions, the operation of pressing the jog dial can be assigned to the change of the time interval for moving forward / backward. . Therefore, all operations for changing the time of the label can be realized only by operating the jog dial, and as a result, the change of the time can be completed without using a general keyboard or mouse.

Further, according to the label software of the present embodiment, by having the above-described functions, the operation of pressing the jog dial can be performed not only by changing the constant time increment / decrement interval of the label display but also by the above-described label information. Can also be assigned to the change point movement. As a result, the movement of the time focusing only on the information change point can be realized only by operating the jog dial.

Further, according to the label software of the present embodiment, by having the above-described functions, the amount of movement of the label time can be varied in accordance with the rotation speed of the jog dial. Can also be searched quickly.

Further, according to the label software of the present embodiment, by having the above-described functions, the push of the jog dial is used as a trigger to the time movement mode, and the subsequent rotation / push operation of the jog dial is described above. It is assigned to the time movement operation, and by separating the function by pressing the jog dial short and long, you can realize all the operations of entering the time movement mode / moving the time / exiting the time movement mode only with the jog dial It has become. This makes it possible to browse (browse) information scattered in the past / present / future only with the jog dial. However, for data correction, an input device such as a keyboard and a mouse is required.

Further, according to the label software of the present embodiment, a shift key (Shift key) or a control key (Ctrl) is used for the operation of rotating / pressing the jog dial.
Key) is used together to execute the opposite function or the like, thereby further facilitating the time movement operation. That is, for example, by pressing the jog dial, the unit of the time increase / decrease interval to be changed is changed from a larger one to a smaller one, while the shift key (Shift) is changed.
When the key) and the jog dial are used together, the unit of the time increase / decrease interval is changed more easily by changing the unit of the time increase / decrease interval in the opposite direction to the case of the operation of the jog dial alone.

FIGS. 68 to 71 show the flow of processing in the CPU 51 when the personal computer realizes the function of moving the time to the present / past / future by operating the jog dial by the label software of the present embodiment. Show.

FIG. 68 shows an overall flow in the case where the time movement to the present / past / future is realized by operating the jog dial. First, when the label software is activated in step S231, the CPU 51 proceeds to step S23.
In step S234, it is determined whether the jog dial has been pressed. If it is determined that the jog dial has not been pressed, the process proceeds to step S234.
If it is determined that the button has been pressed, the process proceeds to step S2.
It proceeds to the process of 33. When the process proceeds to step S233,
The CPU 51 performs a process of browsing information by rotating the jog dial. Next, the CPU 51 determines in step S
When the process proceeds to the process of 234, it is determined whether or not the process is completed. If the process is not completed, the process returns to the step S232, and if completed, the process proceeds to the step S235.
When proceeding to the processing of step S235, the CPU 51 performs a label software end processing.

FIG. 69 shows a detailed flow of the processing in step S233 in FIG. In FIG. 69,
When the browse processing by the jog dial is started in step S241, the CPU 51 proceeds to step S242.
It is determined whether or not the jog dial has been pressed for a long time (the long press of the jog dial (the interval between pressing and releasing the press is 1 second or more)), and if it is determined that the jog dial has been pressed for a long time, the browse processing is terminated and Step S23 of 68
The process proceeds to step S243, and if it is determined that the button has not been pressed for a long time, the process proceeds to step S243. When the process proceeds to step S243, the CPU 51 determines whether or not the jog dial has been pressed (that is, when the interval from the pressing of the jog dial to the release of the jog dial is 1 second or less). Proceeds to the process of step S245, and if it is determined that the button has been pressed, the process proceeds to the process of step S244. When the process proceeds to step S244, the CPU 51
Performs the change processing of the time movement unit according to the pressing operation of the jog dial. Next, the CPU 51 determines in step S
In step S245, it is determined whether or not the jog dial has been rotated. If it is determined that the jog dial has not been rotated, the process returns to step S242. If it is determined that the jog dial has been rotated, the process returns to step S246. Proceed to processing. When proceeding to the process of step S246, the CPU 51
The time movement processing according to the rotation operation of the jog dial is performed. Next, when the process proceeds to step S247, the CPU 51 changes the display at the set time, and thereafter returns to the process of step S242. On the other hand, step S24
8, the CPU 51 terminates the browsing process using the jog dial, and then proceeds to step S2 in FIG.
Proceed to the process of 34.

FIG. 70 shows the detailed flow of the process in step S244 in FIG. 69. In FIG. 70,
The CPU 51 determines whether or not the shift key is pressed as step S251. If it is determined that the shift key is pressed, the process proceeds to step S253. If it is determined that the shift key is not pressed, the process proceeds to step S252. . When the process proceeds to step S252, the CPU 51 determines the current time interval unit (time increment / decrement unit, time increment / decrement step).
Determines whether the unit is the minimum unit. When it is determined that the unit is the minimum unit, the process proceeds to step S255. When it is determined that the unit is not the minimum unit, the process proceeds to step S254. Also, the CPU 51 when the process proceeds to the process of step S253
Is to determine whether the current time interval unit (time increment / decrement unit, time increment / decrement step) is the maximum unit. If it is determined that the unit is the maximum unit, the process proceeds to step S255. Proceeds to the process of step S256. CPU 51 when proceeding to the process of step S254
Sets the next unit on the operation time display unit oti as the time movement interval (time increase / decrease unit, time increase / decrease step), and thereafter ends the movement unit change processing and proceeds to the processing of step S245 in FIG. 69. move on. Further, the CPU 51, when proceeding to the processing of step S255, sets the change point of the information as a time movement interval (time increase / decrease unit, time increase / decrease step), ends the change processing of the movement unit, and ends the processing of FIG. The process proceeds to step S245. Further, the CPU 51 when the process proceeds to the process of step S256
Sets the previous unit on the operation time display unit oti as an interval of time movement (time increment / decrement unit, time increment / decrement step), and thereafter ends the movement unit change process and proceeds to the process of step S245 in FIG. move on.

FIG. 71 shows the detailed flow of the process in step S246 in FIG. 69. In FIG. 71,
The CPU 51 determines whether or not a continuous rotation operation has been performed on the jog dial as Step S261. If it is determined that the continuous rotation operation has been performed, the process proceeds to Step S263, and the continuous rotation operation has not been performed. When the determination is made, the process proceeds to step S262. When proceeding to the processing of step S263, the CPU 51
In step S2, after setting to accelerate the time increase / decrease process in response to the continuous rotation operation of the jog dial, that is, to set the time movement amount to be accelerated,
Proceed to step 62. When the process proceeds to step S262,
The CPU 51 determines whether or not an interval between information change points has been set as a time movement interval (time increment / decrement unit, time increment / decrement step). The process proceeds to S264, and if it is determined that the interval between the changing points is not set, the process proceeds to step S265. In step S264, the CPU 51 determines the next (or previous) information change point in consideration of the determination result in step S261 (that is, when the acceleration is set in step S263). Then, the process proceeds to the process of step S267. When the process proceeds to step S265, the CPU 5
In step 1, the determination result in step S261 is considered (that is, when acceleration is set in step S263), the time is advanced (or returned) at the set time interval, and The time movement processing ends, and the flow advances to the processing in step S247 in FIG. Further, when proceeding to the process of step S267, the CPU 51 determines whether or not the next (or previous) change point of the information is found. If found, the process proceeds to step S268. If it is not found, the process proceeds to step S269. Proceed to processing. When the process proceeds to step S268, the CPU 51
Sets the found time as the travel time,
The movement process for the time is completed, and step S24 in FIG. 69 is performed.
Proceed to step 7. Further, when proceeding to the processing of step S269, the CPU 51 sets the time of the last (or first) change point as the moving time, ends the moving processing for that time, and proceeds to the processing of step S247 in FIG. .

[0284] Next, the label software of the present embodiment has the above-described functions, so that the time movement operation by the jog dial as described above can be reflected on the screen (that is, reflected as a jog dial guide). Also, in the label software of the present embodiment, a part of the screen (the rotation animation part ra of the time view console) can be displayed as a rotation animation in accordance with the rotation operation of the jog dial, and the rotation direction of the jog dial is different. Can be expressed by changing the direction of the rotation animation.

Further, the label software of this embodiment is
The current time is displayed numerically on the operation time display unit oti, and the year graph is displayed on the year gauge unit cg. These displays can be updated in real time. Makes the change more understandable. In the year graph, the current time and the time of the label displayed on the desktop screen are indicated by different lines (for example, lines of different colors), so that the relationship between the current time and the display time can be easily checked. I can do it.

Further, the label software according to the present embodiment changes the image of the desktop background depending on the past, present, and future, thereby clarifying the operation that can be performed at present. For example, by changing the image on the desktop background, it is easy for the user to understand that the past cannot be modified, the label operation can only be reserved in the future, and all operations are now possible. providing.

FIGS. 72 and 73 show the flow of processing in the CPU 51 when the above-described jog dial guide and the display function of the year calendar are realized by a personal computer using the label software of this embodiment.

FIG. 72 shows the entire flow when the operation of the jog dial is used as a user interface for time movement. First, when the label software is started in step S271, the CPU 51 proceeds to step S2.
At 72, it is determined whether or not the jog dial has been rotated. If it is determined that the jog dial has not been rotated, the process proceeds to step S274. If it is determined that the jog dial has been rotated, the process proceeds to step S273. When proceeding to the process of step S273, the CPU 51 performs a process of browsing information according to the rotation of the jog dial. Next, C
When proceeding to the process of step S274, the PU 51 determines whether or not the process has been completed. If the process has not been completed, the PU 51 returns to step S272.
Proceed to 275. When proceeding to the process of step S275, the CPU 51 performs a label software end process.

FIG. 73 shows a detailed flow of the process in step S273 of FIG. 72. In FIG. 73,
When the browse processing according to the jog dial operation is started in step S281, the CPU 51 proceeds to step S281.
As 282, it is determined whether or not the jog dial has been rotated. If it is determined that the jog dial has been rotated, the process proceeds to step S283. If it is determined that the jog dial has not been rotated, the process proceeds to step S288. When proceeding to the processing of step S283, the CPU 51 displays the rotation animation corresponding to the rotation direction of the jog dial, and
In step 284, time movement processing is performed in accordance with the direction and amount of rotation of the jog dial.
At 285, the time display and the year graph are updated by the time movement processing. Next, the CPU 51 determines in step S
In step 286, it is determined whether the past / present / future state has changed. If it is determined that the state has not changed, the process proceeds to step S288. If it is determined that the state has changed, step S287 occurs. Proceed to processing. When proceeding to the processing of step S287, the CPU 51 updates the background image of the desktop screen according to the past / present / future state, and proceeds to the processing of step S288. Step S
When proceeding to the process of 288, the CPU 51 determines whether or not to end the browse process in accordance with the jog dial operation. If it is determined that the browse process is not to be terminated, the process returns to step S282. S28
After performing the browsing end process in step 9, the process proceeds to step S274 in FIG.

Next, the label software according to the present embodiment has the above-described functions, so that whether or not each label information can be changed while browsing information in the past / present / future is determined. Is displayed on the label, and the function of presenting the state of the label to the user is realized. As a method of displaying the state of the label, a method of displaying the label as an icon on a part of the label, a method of bordering the label (for example, changing a color of the border), and the like are conceivable. When the method of bordering the label is adopted, the label state can be confirmed even if a part of the label is covered by another window. Also,
The state of the label is not two states of correction possible / correction prohibition, but if the number of states is further increased so that the reason of the correction prohibition can be understood, the user can check the state in more detail.

FIG. 74 shows the flow of processing in the CPU 51 when the above-described label state presentation function is realized by a personal computer using the label software of this embodiment.
76 to FIG.

FIG. 74 shows the overall flow of the function of presenting the label status to the user. First, step S291
When the label software is activated, the CPU 51
In step S292, the jog dial is rotated, the keyboard is operated, and the up / down buttons tub and tdb are pressed.
It is determined whether or not the time movement operation has been performed by, for example, and if it is determined that the time movement operation has not been performed, the process proceeds to step S294. If it is determined that the time movement operation has been performed, the process proceeds to step S293. Proceed to processing.
When proceeding to the process of step S293, the CPU 51 performs a process of browsing information according to the time movement operation. next,
When the process proceeds to step S294, the CPU 51 determines whether or not the process has been completed. When the process has not been completed, the process returns to step S292, and when completed, the process proceeds to step S295. When proceeding to the process of step S295, the CPU 51 performs a label software end process.

FIG. 75 shows a detailed flow of the process of step S293 in FIG. 74. In this FIG.
When the browsing process by the time movement operation is started in step S301, the CPU 51 proceeds to step S302.
It is determined whether the display time has been changed by the time movement operation. If it is determined that the display time has been changed, the process proceeds to step S303. If it is determined that the display time has not been changed, the process proceeds to step S303. The process proceeds to S307. When the process proceeds to step S303, the CPU 51
Performs a time movement process according to the time movement operation,
Next, in step S304, the label information is updated. Next, as step S305, the CPU 51 determines whether or not the past / present / future state has changed.
If it is determined that the state has not changed, step S30
The process proceeds to step S306, and if it is determined that the state has changed, the process proceeds to step S306. In step S306, the CPU 51 updates the label editable state (for example, changes the color of the border) according to the past / present / future state, and then proceeds to step S307.
When the process proceeds to step S307, the CPU 51 determines whether or not to end the browsing process. If it is determined that the browsing process is not to be ended, the process returns to step S302. After the end processing of (1), the process proceeds to the processing of step S294 in FIG.

FIG. 76 shows the detailed flow of the process in step S306 in FIG. 75. In FIG. 76,
When the process of updating the label status is started in step S311, the CPU 51 determines in step S312 whether or not the label is displayed. If it is determined that the label is displayed, the process proceeds to step S313. ,
If it is determined that the message is not displayed, the process proceeds to step S318. When the processing proceeds to step S313, the CPU
51 determines whether the display time is past / present / future, and if it is determined to be past, step S3
The process proceeds to step S15, and if it is determined to be the future, the process proceeds to step S314. If it is determined to be the present, the process proceeds to step S317. If it is determined in step S313 that it is the future, the CPU 51 proceeds to step S313.
At 314, it is determined whether or not the label is a future label. If it is determined that the label is a future label, the process proceeds to step S31.
The process advances to step S316 if it is determined that the label is not the future label. When the CPU 51 proceeds to the process of step S315, the CPU 51 sets the label state to “not editable” (past label), and then proceeds to the process of step S318. CPU when proceeding to the processing of step S316
51 sets the label status to non-editable (current label), and then proceeds to the process of step S318. Step S3
When the CPU 51 proceeds to the process of step S17, the CPU 51 sets the state of the label to be editable (current label or future label), and then proceeds to the process of step S318. Step S318
The CPU 51 determines whether or not the update processing of the state of all the labels has been completed. If it is determined that the update processing has not been completed, the CPU 51 returns to the processing of step S312, and determines that the processing has been completed. Goes to the process of step 319.
When the process proceeds to step S319, the CPU 51 performs a process of ending the update of the label state, and then proceeds to the process of step S307 in FIG.

Next, as described above, the label software according to the present embodiment is provided with a shortcut button (current button bb) for returning to the current time on the time view console TVC, so that even when browsing the past or future, You can immediately return to the current time.

FIGS. 77 and 78 show the flow of processing in the CPU 51 when the function of the above-described shortcut button is realized by a personal computer using the label software of this embodiment.

FIG. 77 shows a time view console TV.
The entire flow at the time of realizing instantaneous return to the current time by the current button bb of C is shown. First, step S32
When the label software is activated as 1, the CPU 51
In step S322, it is determined whether or not the browsing process has started. If it is determined that the browsing process has started, the process proceeds to step S323. If it is determined that the browsing process has not started, the process proceeds to step S324.
When the process proceeds to step S323, the CPU 51 starts the information browsing process, and then proceeds to the process in step S324. When the process proceeds to step S324, the CPU
51 determines whether or not the processing has been completed, and if not completed, returns to step S322; otherwise, proceeds to the processing of step S325. Step S325
When the process proceeds to (3), the CPU 51 performs end processing of the label software.

FIG. 78 shows a detailed processing flow of the processing in step S323 in FIG. In FIG. 78,
When the browsing process is started in step S331, the CPU 51 determines in step S332 whether the display time has been changed. If it is determined that the display time has been changed, the CPU 51 proceeds to the process in step S333 and displays If it is determined that the time has not been changed, step S
The process proceeds to 334. When proceeding to the processing of step S333, the CPU 51 performs time movement processing according to the time movement operation, and then determines whether or not the current button bb has been pressed in step S334, and determines that the button bb has been pressed. Proceeds to the process of step S335, and if it is determined that the button has not been pressed, the process proceeds to the process of step S336. When proceeding to the processing of step S335, the CPU 51 sets the display time to the current time, and then proceeds to the processing of step S336. When proceeding to the processing in step S336, the CPU 51
It is determined whether or not to end the browse process. If it is determined that the browse process is not to be ended, the process returns to step S332, and
If it is determined that the processing is to be ended, browsing end processing is performed in step S337, and the process proceeds to step S324 in FIG.

Next, as described above, the label software of this embodiment changes the design of the label software icon IL on the task tray TT between the current mode, the past mode, and the future mode, and further hides the entirety in the current mode. By making the state different, a selectable menu can be predicted in advance without displaying the context menu. Note that this method is useful not only for an application having a time shift process but also for all applications in which a main window does not exist and a menu is assigned to a task tray icon. In an application that has a main window, the status can be displayed in the main window, but the task tray icon is always visible, so even when the main window is minimized, the main window can be restored to its original size. The menu item status can be predicted without returning.

The flow of processing in the CPU 51 in the case where the function of changing the design of the label software icon IL on the task tray TT described above is realized by a personal computer using the label software of the present embodiment is shown in FIGS.
As shown in FIG.

[0301] Fig. 79 shows the entirety of realizing that the design of the label soft icon IL on the task tray TT is different in the current mode, the past mode, and the future mode, and is different even when all are hidden in the current mode. Show the flow. First, when the label software is started in step S341, the CPU 51 determines in step S342 whether or not the entire label is hidden, and when it is determined that the label is not displayed, step S3 is performed.
The process proceeds to the process of 43, and if it is determined that the display is not hidden, the process proceeds to the process of step S344. Step S343
The CPU 51 sets the non-display icon on the task tray TT, and then proceeds to the process of step S345. When the process proceeds to step S344, the CP
U51 sets the normal icon on the task tray TT, and then proceeds to the process of step S345. Step S3
In step 45, the CPU 51 determines whether or not the browsing process has been started. When it is determined that the browsing process has been started, the process proceeds to step S346. When it is determined that the browsing process has not been started, the process proceeds to step S347. Proceed to processing. When the process proceeds to step S346, the CPU 51
Starts the information browsing process, and then proceeds to step S
Proceed to 347. When proceeding to the processing of step S347, the CPU 51 determines whether or not the processing has been completed, and if not completed, returns to step S342,
When the processing has been completed, the process proceeds to step S348. When proceeding to the processing of step S348, the CPU 51 performs end processing of the label software.

FIG. 80 shows the detailed flow of the process in step S346 in FIG. 79. In FIG. 80,
When the browse process is started in step S351, the CPU 51 determines in step S352 whether or not the display time has been changed. When it is determined that the display time has been changed, the CPU 51 proceeds to the process in step S353 and performs display. If it is determined that the time has not been changed, step S
Proceed to 357. When proceeding to the processing of step S353, the CPU 51 performs time movement processing according to the time movement operation, and then updates the label information in step S354, and then proceeds to the processing of step S355. In step S355, the CPU 51 determines whether the past / present / future state has changed. When it is determined that the state has changed, the CPU 51 proceeds to step S356. The process proceeds to step S357. When proceeding to the processing of step S356, the CPU 51
After the task tray icon is updated, the process proceeds to step S357. When proceeding to the processing of step S357, the CPU 51 determines whether or not to end the browsing processing.
Returning to the process of 52, if it is determined that the process is to be ended, the browser end process is performed in step S358, and then the process proceeds to the process of step S374 in FIG.

FIG. 81 shows the detailed flow of the process in step S356 in FIG. In FIG. 81,
When the icon updating process is started in step S361, the CPU 51 determines in step S362 whether the display time is past / present / future, and when it is determined that the display time is in the past, the process in step S363. To
If it is determined to be the present, the process proceeds to step S364, and if it is determined to be the future, the process proceeds to step S365. When the process proceeds to step S363, the CPU 5
1 is a label software icon IL on the task tray TT
After setting the past icon as shown in FIG. 32B in FIG. 32, the process proceeds to step S366. Step S
Upon proceeding to the process of 364, the CPU 51
FIG. 32A shows the label software icon IL on T.
After setting the current icon as shown in FIG.
Proceed to 366. After proceeding to the processing of step S365, the CPU 51 sets a future icon as shown in FIG. 32C to the label soft icon IL on the task tray TT, and then proceeds to the processing of step S366. When proceeding to the process of step S366, the CPU 51
After the icon update process is completed, the process proceeds to step S in FIG.
Proceed to 357.

[0304] A medium used to install a program for realizing the above-described series of processing in a computer and to make it executable by the computer is, for example, a floppy disk, a CD-RO, or the like.
It may be realized not only by package media such as M and DVD, but also by a semiconductor memory or a magnetic disk in which a program is temporarily or permanently stored, and may be realized by a cable such as a local area network, the Internet, or digital satellite broadcasting. And a wireless communication medium, and various communication interfaces such as a router and a modem for transferring or receiving a program provided through these communication media. Means a broad concept including.

[0305]

As is apparent from the above description, in the information processing apparatus, method, and medium of the present invention, a plurality of two-dimensional screens and time information are stored in association with each other, and the two-dimensional screen corresponding to the time information is stored. 3D structure with screens arranged along the time axis
Generating a display signal for two-dimensional display, generating information of a frame image indicating a unit time, generating a display signal for displaying the frame image in a wire frame by perspective drawing, and further generating an object having a different attribute. A predetermined processing unit (label) to which information can be pasted is stored in association with time information, and line image information indicating the duration of the predetermined processing unit is generated based on the time information, and a wire frame display is performed. By generating a display signal that combines the frame image and the line image extending along the time axis direction,
The duration of the label can be grasped intuitively and at a glance, and the status of the label can be checked at any time, for example, in the past, and the deleted label or the desktop on which the label was attached The history of the screen and the like can be easily recognized.

[Brief description of the drawings]

FIG. 1 is an external perspective view of a notebook personal computer to which the present invention is applied.

FIG. 2 is a plan view of a main body of the notebook personal computer shown in FIG. 1;

FIG. 3 is an enlarged view of the vicinity of a jog dial which is a main part of the present invention.

FIG. 4 is a side view of the main body on a jog dial side.

FIG. 5 is an electrical circuit diagram of the notebook personal computer whose external appearance is shown in FIG.

FIG. 6 is a diagram showing a mutual relationship among three data of a project, a label, and an object handled by the label software according to the embodiment.

FIG. 7 is a diagram illustrating an example of a desktop screen in a normal mode.

FIG. 8 is a diagram illustrating a configuration example of a desktop screen in a present mode (Present) of a 2D view mode.

FIG. 9 is a diagram illustrating a configuration example of a desktop screen in a past (Past) mode of the 2D view mode.

FIG. 10 is a diagram illustrating a configuration example of a desktop screen in a future mode of the 2D view mode.

FIG. 11 is a diagram showing a time view console window in a bar state.

FIG. 12 is a diagram showing a time view console window in a floating state.

FIG. 13 is an enlarged view showing only the vicinity of the rotation animation section at the left end of the time view console in a bar state.

FIG. 14 is a diagram illustrating a display example of an operation menu used when switching between the 2D view mode and the 3D view mode.

FIG. 15 is a diagram illustrating a display example of a desktop screen when switching to a 3D view mode.

FIG. 16 is a diagram illustrating a display example in a state where a wire frame corresponding to the current time is displayed on the desktop screen in the 3D view mode.

FIG. 17 is a diagram illustrating a display example in which a wire frame corresponding to an operation time is displayed on the desktop screen in the 3D view mode.

FIG. 18 is a diagram illustrating a display example of a state in which a label is popped up by a mouse cursor instruction on a label validity period line on a desktop screen in a 3D view mode.

FIG. 19 is a diagram illustrating a display example in which a past, present, and future two-dimensional desktop screen is formed as a three-dimensional structure arranged three-dimensionally along a time axis.

FIG. 20 is a diagram illustrating an example of a display screen when time-based cooperation is performed between an application that realizes a desktop environment capable of moving over time and an image browser application.

FIG. 21 is a flowchart illustrating switching between a 2D view mode and a 3D view mode, and a flow of processing after the switching.

FIG. 22 is a flowchart showing a flow of a view mode switching process in step S2 of FIG. 21.

FIG. 23 is a flowchart showing the flow of processing in a 3D view mode in step S4 of FIG. 21.

FIG. 24 is a diagram illustrating an example of a label window screen according to the present embodiment.

FIG. 25 is a diagram used to explain a tooltip indicating a playback time (time during which a sound is recorded) associated with a play and pause button.

FIG. 26 is a diagram used to explain a tooltip indicating the link content (link destination file path or URL) associated with the link button.

FIG. 27 is a diagram illustrating an example of an alarm icon and a repetition icon.

FIG. 28 is a diagram illustrating a display example of an operation menu when a label is set to “display all” in a normal mode.

FIG. 29: “Hide all” for label in normal mode
It is a figure showing the example of a display of the operation menu at the time of being made into a state.

FIG. 30 is a diagram illustrating a display example of an operation menu in a past mode.

FIG. 31 is a diagram illustrating a display example of an operation menu in a future mode.

FIG. 32 is a diagram used to explain different icons in a current mode, a past mode, and a future mode.

FIG. 33 is a diagram showing a display example of a create new project dialog.

FIG. 34 is a diagram showing a display example of a time setting dialog at the time of import displaying project information.

FIG. 35 is a diagram showing a display example of a project import dialog.

FIG. 36 is a diagram illustrating a display example of a dialog for specifying an import method.

FIG. 37 is a diagram illustrating a display example of a project export dialog.

FIG. 38 is a diagram illustrating a display example of a project property dialog.

FIG. 39 is a diagram illustrating a display example of a label property dialog.

FIG. 40 is a diagram illustrating a display example of a text edit dialog.

FIG. 41 is a diagram used to explain how a recording time and a tooltip indicating a maximum recording time when a recording is selected and a play button are changed to a recording button;

FIG. 42 is a diagram illustrating a display example of a link edit dialog.

FIG. 43 is a diagram illustrating a display example of a clipboard object selection dialog.

FIG. 44 is a diagram used to explain the definition of a text margin and an image margin.

FIG. 45 is a diagram illustrating a dialog display example when a default label layout is selected in the label setting dialog.

FIG. 46 is a diagram illustrating a sample displayed and used for explaining a label layout operation by dragging.

FIG. 47 is a diagram illustrating a label display example when executing a custom layout.

FIG. 48 is a diagram illustrating a display example of an alarm dialog.

FIG. 49 is a diagram illustrating a display example of a current label deletion dialog.

FIG. 50 is a diagram illustrating a display example of a future label deletion dialog.

FIG. 51 is a diagram showing a display example of a warning dialog at the time of pasting a link.

FIG. 52 is a diagram illustrating a display example of a jog dial guide in a normal mode.

FIG. 53 is a diagram illustrating a display example of a jog dial guide in a time view mode.

FIG. 54 is a diagram illustrating a dialog display example when label setting is selected in the label setting dialog.

FIG. 55 is a diagram illustrating a dialog display example when recording setting is selected in the label setting dialog.

FIG. 56 is a diagram illustrating a dialog display example when image setting is selected in the label setting dialog.

FIG. 57 is a diagram illustrating a dialog display example when an environment setting is selected in the label setting dialog.

FIG. 58 is a flowchart showing the overall processing flow in the case where the state of a label at an arbitrary point in the past is reproduced, the reservation and reproduction of an operation for a future label, and the alarm processing are realized by the CPU.

FIG. 59 is a step S132 in the flowchart of FIG. 58;
6 is a flowchart showing details of an operation recording process.

FIG. 60 is a step S133 in the flowchart of FIG. 58;
6 is a flowchart showing details of the alarm processing of FIG.

FIG. 61 is a step S134 in the flowchart of FIG. 58;
9 is a flowchart showing details of the label update process.

FIG. 62 is a flowchart showing the flow of the entire process when the CPU implements the process of indirectly pasting all information on a label by a link.

FIG. 63: Step S173 of the flowchart in FIG. 62
5 is a flowchart showing details of a link editing process.

FIG. 64: Step S175 of the flowchart in FIG. 62
9 is a flowchart showing details of the link execution process.

FIG. 65 is a flowchart showing an overall flow in a case where a CPU realizes a process enabling time movement at an arbitrary time of present / past / future.

FIG. 66 is a step S203 in the flowchart of FIG. 65;
9 is a flowchart showing details of a change process of a movement unit of FIG.

FIG. 67 is a step S205 in the flowchart of FIG. 65;
9 is a flowchart showing details of the time movement process.

FIG. 68 is a flowchart showing an overall flow in a case where a CPU realizes processing for realizing time movement to the present / past / future by operating a jog dial;

FIG. 69 is a step S233 in the flowchart of FIG. 68;
9 is a flowchart showing details of the information browsing process.

FIG. 70 is a step S244 in the flowchart of FIG. 69;
9 is a flowchart showing details of a change process of a movement unit of FIG.

FIG. 71 is a step S246 in the flowchart of FIG. 69;
9 is a flowchart showing details of the time movement process.

FIG. 72 is a flowchart showing an overall flow in a case where a CPU implements a process of using a jog dial operation as a user interface for time movement.

FIG. 73 is step S273 in the flowchart of FIG. 72;
9 is a flowchart showing details of the information browsing process.

FIG. 74 is a flowchart showing an overall flow in the case where the function of presenting the state of the label to the user by changing the color of the edge of the correction prohibition label is realized by the CPU.

FIG. 75: Step S293 of the flowchart in FIG. 74
9 is a flowchart showing details of the information browsing process.

76. Step S307 of the flowchart in FIG. 75
13 is a flowchart showing details of a label editable state update process.

FIG. 77 is a flowchart showing an overall flow in a case where a function of instantly returning to the current time by a current button of a time view console is realized by a CPU.

FIG. 78 is a step S323 in the flowchart of FIG. 77;
9 is a flowchart showing details of the information browsing process.

FIG. 79 shows an overall flow in the case where the CPU realizes a function of making the design of the task tray icon different in the current mode, the past mode, and the future mode, and further, making it different even in the state where all are hidden in the current mode. It is a flowchart shown.

FIG. 80 is step S346 of the flowchart in FIG. 79;
9 is a flowchart showing details of the information browsing process.

FIG. 81 is a step S356 in the flowchart of FIG. 80;
13 is a flowchart showing details of a task tray icon update process.

FIG. 82 is a diagram illustrating an example of a sticky note (label) attached to a desktop.

[Explanation of symbols]

1 notebook personal computer, 2 main unit,
3 display unit, 4 jog dial, 5 keyboard, 6 touch pad, 7 LCD, L label,
TT task tray, IL icon, TVC
Time view console

 ────────────────────────────────────────────────── ─── Continuing from the front page (72) Inventor Junichi Koraimoto 3-14-13 Higashi Gotanda, Shinagawa-ku, Tokyo F-term (reference) in Sony Computer Science Laboratory 5B049 AA01 CC31 EE05 EE07 FF03 5B075 PP03 PQ02 PQ13 PQ23 PR01 PR04 5E501 AA02 AC12 AC15 CB09 DA15 DA17 EA05 EA10 FA12 FA14 FA27 FA32 FB22

Claims (24)

[Claims] 1. A storage means for storing a plurality of two-dimensional screens and time information in association with each other, and for three-dimensionally displaying a three-dimensional structure in which the two-dimensional screens corresponding to the time information are arranged along a time axis. An information processing apparatus comprising: a display signal generation unit configured to generate a display signal. 2. An image processing apparatus comprising: frame image information generating means for generating information of a frame image indicating a unit time; and display signal generating means for generating a display signal for displaying the frame image in a wire frame display by a perspective view. Characteristic information processing device. 3. A storage unit for storing a predetermined processing unit to which object information having different attributes can be pasted and time information in association with each other, and a line indicating a duration of the predetermined processing unit based on the time information. Line image information generating means for generating image information, wherein the display signal generating means generates a display signal obtained by synthesizing the frame image displayed in the wire frame and the line image extending along the time axis direction. 3. The information processing apparatus according to claim 2, wherein: 4. The storage means stores the predetermined processing unit in the predetermined processing unit along with the time information.
At least one display position information to be displayed on the three-dimensional screen is stored in association with the line image, and the display signal generation unit associates the frame image with the display position information of the predetermined processing unit to store the line image. 4. The information processing apparatus according to claim 3, wherein a display signal is generated by synthesizing a frame image displayed with the wire frame. 5. The information according to claim 2, wherein said frame image information generating means generates frame image information indicating a current time and / or frame image information indicating a desired operation time. Processing equipment. 6. The frame image information generating means includes: a frame image indicating the unit time; a frame image indicating the current time;
6. The information processing apparatus according to claim 5, wherein the frame images indicating the desired operation times are generated as images of different display colors. 7. The line image information generating means, wherein the line image extending along the time axis direction with the frame image indicating the current time and / or the frame image indicating the desired operation time as a boundary, 6. The information processing apparatus according to claim 5, wherein the information is generated as a display color image. 8. The information processing apparatus according to claim 2, wherein the display signal generating means generates a display signal in which an interval between the frame images is changed according to a command to move the frame image. 9. The information processing apparatus according to claim 3, wherein said display signal generating means generates a display signal representing said predetermined processing unit in response to an instruction command pointing to said line image. . 10. The apparatus according to claim 1, wherein the line image information generating means generates, together with the line image, a character image added to the predetermined processing unit and a character image representing a duration of the predetermined processing unit. The information processing apparatus according to claim 3, wherein 11. The display signal generating means, when switching from a two-dimensional screen display state to a state in which the frame image is displayed in a wire frame by a perspective view, gradually changes the frame image in accordance with a perspective view in accordance with a movement of a viewpoint. 3. The information processing apparatus according to claim 2, wherein a rotating display signal is generated. 12. A display signal for three-dimensionally displaying a three-dimensional structure in which a plurality of two-dimensional screens and time information are stored in association with each other and two-dimensional screens corresponding to the time information are arranged along a time axis. An information processing method characterized by generating. 13. An information processing method comprising: generating information of a frame image indicating a unit time; and generating a display signal for displaying the frame image in a wire frame by a perspective drawing. 14. A predetermined processing unit to which object information of different attributes can be pasted and time information are stored in association with each other, and information of a line image indicating the duration of the predetermined processing unit based on the time information. 14. The information processing method according to claim 13, wherein a display signal is generated by combining the frame image displayed in the wire frame and the line image extending along the time axis direction. 15. The frame image, wherein the predetermined processing unit is stored together with the time information and at least one piece of display position information for displaying the predetermined processing unit on a two-dimensional screen. 15. The information processing method according to claim 14, wherein a display signal obtained by combining the line image and the frame image displayed in the wire frame is generated by associating the line image with the display position information of the predetermined processing unit. . 16. Frame image information indicating the current time, and / or
14. The information processing method according to claim 13, wherein information of a frame image indicating a desired operation time is generated. 17. The method according to claim 1, wherein the frame image indicating the unit time, the frame image indicating the current time, and / or the frame image indicating the desired operation time are generated as images of different display colors. 17. The information processing method according to claim 16, wherein 18. The method according to claim 18, wherein the line image extending along the time axis direction with the frame image indicating the current time and / or the frame image indicating the desired operation time as a boundary is generated as an image having a different display color. 17. The information processing method according to claim 16, wherein: 19. The information processing method according to claim 13, wherein a display signal in which an interval between the frame images is changed is generated in accordance with a command to move the frame image. 20. The information processing method according to claim 14, wherein a display signal representing the predetermined processing unit is generated in response to an instruction command pointing on the line image. 21. The information processing apparatus according to claim 14, wherein together with the line image, a character image added to the predetermined processing unit and a character image representing a duration of the predetermined processing unit are generated. Method. 22. When switching from a two-dimensional screen display state to a state in which the frame image is displayed in a wire frame by a perspective view, a display signal is generated in which the frame image gradually rotates according to a perspective view in accordance with the movement of a viewpoint. 14. The information processing method according to claim 13, wherein: 23. A step of storing a plurality of two-dimensional screens and time information in association with each other, and a display for three-dimensionally displaying a three-dimensional structure in which the two-dimensional screens corresponding to the time information are arranged along a time axis. A medium for causing an information processing apparatus to execute a program, comprising: generating a signal. 24. A computer-readable storage medium storing a program, comprising: generating information of a frame image indicating a unit time; and generating a display signal for displaying the frame image in a wire frame by perspective drawing. Medium to be executed by the processing unit.