JP2004362601A - Information processing apparatus and method, and graphical user interface - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow intuitive determination of time passage of display contents on a display screen of an information processing apparatus. <P>SOLUTION: On a screen 111, when a user inputs a character string (label) which is to be searched into a search-character input space 125, and when the user operates a search button 126a, search operation for displaying a screen (file) corresponding to the input character string is initiated. This operation allows the user to obtain a desired file according to the needs. Further, a labeled icon 123 has the fading function of gradually changing its color as time passes. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus and method, and a graphical user interface, and more particularly to an information processing apparatus and method suitable for managing files and managing access to various types of information, and a graphical user interface.

  2. Description of the Related Art Conventionally, as a method for organizing files created by a computer user, there is a method of hierarchically storing files using folders, for example. For example, a user creates a “memo” file on a computer and saves the generated “memo” file in, for example, a “My Documents” folder (recorded on a hard disk in an HDD (Hard Disk Drive)) ) Will be described with reference to FIGS. 27 to 29.

  When a user activates an OS (for example, so-called Windows 95 or Windows 98 (trademark) of Microsoft Corporation) on a PC (Personal Computer), for example, a desktop screen as shown in FIG. 27 (hereinafter, also simply referred to as a screen) Is displayed. In FIG. 27, when the user operates a pointing device such as a mouse and clicks, for example, the “My Computer” icon 151 on the upper left of the screen, a screen as shown in FIG. 28 is displayed.

  In the screen of FIG. 28, the “My Computer” icon 151 includes an A drive icon 161 of a 3.5-inch FDD (Floppy Disk Drive), a C drive icon 162 of an HDD, and a CD-ROM (Compact Disk-Read Only Memory) drive. , A printer icon 164, and the like. When the user operates the pointing device and clicks the C drive icon 162, and further clicks a “My Documents” folder (not shown) under the C drive icon 162, a screen as shown in FIG. 29 is displayed.

  In the screen of FIG. 29, in the “My Documents” folder, a “memo” file (document file) icon 172 generated and stored by the user, and “1998.10.20” in which the date is set as the folder name A folder icon 171 and a "China" file (document file) icon 173, which is a material related to China, for example, are stored.

JP-A-7-84748

  However, in the above-mentioned method, it is necessary to determine by itself which folder should store the file generated by the user, which is troublesome.

  For example, as a file management method to which the “super organizing method” (Chuko Shinsho, written by Yukio Noguchi) is applied, as shown in a folder icon 171 of “1998.10.20” in FIG. Although a method of storing a generated file therein has been proposed, this method is difficult to execute accurately.

  Further, as can be seen from the screen of FIG. 29, the number of icons that can be arranged on the desktop screen is limited due to the limitation of the screen size, so that when the number of icons increases, the icons cannot be arranged.

  Furthermore, when the application programs that handle the above-mentioned files and folders and other various data are different from each other, there is a problem that accessing and searching for those files and folders and various data becomes very complicated. For example, "I want to reproduce the state of the desktop at the time of receiving an e-mail and access the work file I was doing at that time" or "I want to search for the image taken while writing a certain sentence" The operation requires many steps of operation over a plurality of application programs, which is complicated.

  Further, it is preferable that the elapsed time of the display content can be intuitively determined.

  Therefore, the present invention has been made in view of such a situation, and it is possible to easily manage files, folders, and other data, and to intuitively determine the elapsed time of display contents. It is an object to provide a simple information processing apparatus and method, and a graphical user interface.

  In order to solve the above-described problem, an information processing apparatus according to the present invention includes a storage unit that stores generated or changed data in association with time information, a date and time setting unit that sets a desired date and time, Control means for reproducing the state of the data corresponding to the date and time based on the time information, the storage means stores the generated or changed file in association with the time information, and the date and time setting means, The date and time is set according to the past or future screen, and the control means reads out and reproduces the file of the date and time corresponding to the past or future screen from the storage means, displays the file on the screen, and displays the file on the screen. The file is controlled so that the color of the file is changed over time and displayed.

  Further, the information processing method according to the present invention includes a storage step of storing generated or changed data in association with time information, a date and time setting step of setting a desired date and time, and a step of storing data corresponding to the set date and time. And a control step of reproducing the state based on the time information.In the storing step, the generated or changed file is stored in association with the time information, and in the date and time setting step, the file is displayed on a past or future screen. In the control step, the file of the date and time corresponding to the past or future screen is reproduced and displayed on the screen, and the color of the displayed file is changed over time. It is characterized in that it is controlled to be displayed.

  An information processing apparatus according to the present invention has a display unit, a graphical user interface displayed on the display unit, an object for displaying information therein, and the object And a processing unit for performing weathering processing on the object from the time when the object is displayed.

  Further, the information processing apparatus according to the present invention, a display unit, a graphical user interface displayed on the display unit, an object that displays information therein, and when the object is displayed on the display, A processing unit for performing weathering processing on the object.

  A graphical user interface according to the present invention includes an object for displaying information therein, and the object gradually changes over time from when the object is displayed on the display.

  According to the present invention, the display content changes with the lapse of time, so that the lapse of time can be intuitively determined.

  A preferred embodiment of the present invention will be described with reference to the drawings.

  1 to 6 show an example of the configuration of a portable personal computer as an example to which an information processing method and apparatus and a graphical user interface of the present invention are applied. The personal computer 1 is a mini-notebook type personal computer and basically includes a main body 2 and a display unit 3 which can be opened and closed with respect to the main body 2. 1 is an external perspective view showing a state where the display unit 3 is opened with respect to the main body 2, FIG. 2 is a plan view of FIG. 1, and FIG. 3 shows a state where the display unit 3 is closed with respect to the main body 2. 4 is a right side view showing a state where the display unit 3 is opened by 180 degrees with respect to the main body 2, FIG. 5 is a front view of FIG. 3, and FIG. 6 is a bottom view of FIG.

  A keyboard 4 operated when inputting various characters and symbols, and a track point (trademark) 5 as a pointing device operated when moving a mouse cursor are provided on the upper surface of the main body 2. ing. Further, on the upper surface of the main body 2, there are further provided a speaker 8 for outputting sound and a shutter button 10 operated when capturing an image with the CCD video camera 23 provided on the display unit 3.

  A claw 13 is provided at the upper end of the display unit 3. As shown in FIG. 3, when the display unit 3 is closed with respect to the main body 2, The hole 6 into which the claw 13 is fitted is provided. A slide lever 7 is provided on the entire surface of the main body 2 so as to be movable in parallel with the entire surface. The slide lever 7 can be locked by engaging with the claw 13 fitted in the hole 6 and can be unlocked. I can do it. By releasing the lock, the display unit 3 can be rotated with respect to the main body 2. A microphone 24 is attached next to the claw 13. As shown in FIG. 6, the microphone 24 can collect sound from the back.

  A programmable power key (PPK) 9 is also provided on the front of the main body 2. As shown in FIG. 4, an exhaust hole 11 is provided on the right side surface of the main body 2, and an intake hole 14 is provided at a lower part of the front surface of the main body 2 as shown in FIG. 5. Further, a slot 12 for inserting a PCMCIA (Personal Computer Memory Card International Association) card (PC card) is provided on the right side of the exhaust hole 11.

  An LCD (Liquid Crystal Display) 21 for displaying an image is provided in front of the display unit 3, and an imaging unit 22 is provided at the upper end thereof so as to be rotatable with respect to the display unit 3. . That is, the imaging unit 22 can rotate to any position within a range of 180 degrees between the same direction as the LCD 21 and the opposite direction (backward direction). A CCD video camera 23 is attached to the imaging unit 22.

  A power lamp PL, a battery lamp BL, a message lamp ML, and other lamps including LEDs are provided on the lower body side of the display unit 3. Reference numeral 40 shown in FIG. 3 is a power switch provided on the left side surface of the main body 2, and reference numeral 25 shown in FIG. 5 is a focus adjustment ring for adjusting the focus of the CCD video camera 23. Further, reference numeral 26 shown in FIG. 6 is a cover for covering an opening for mounting an additional memory in the main body 2, and reference numeral 41 is a small hole for inserting a pin for releasing a lock nail of the lid 26.

  FIG. 7 shows an electrical configuration inside the personal computer 1. A CPU (Central Processing Unit) 52, a PC card 53 inserted as necessary, a RAM (Random Access Memory) 54, and a graphic chip 81 are connected to an internal (PCI (Peripheral Component Interconnect)) bus 51. . The internal bus 51 is connected to an external (ISA (Industrial Standard Architecture)) bus 55, and the external bus 55 includes a hard disk drive (HDD) 56, an I / O (input / output) controller 57, a keyboard controller 58, The track point controller 59, the sound chip 60, the LCD controller 83, the modem 50 and the like are connected.

  The CPU 52 is a controller that controls each function, and the PC card 53 is appropriately mounted when adding optional functions.

  In the RAM 54, for example, an e-mail program (application program) 54A, an autopilot program (application program) 54B, and an OS (basic program) 54C are transferred from the HDD 56 and stored when the activation is completed.

  The e-mail program 54A is a program for exchanging messages via a network from a communication line such as a telephone line. The e-mail program 54A has an incoming mail acquisition function as a specific function. This incoming mail acquisition function checks the mail server 93 to see if mail addressed to the user (user) has arrived in the mailbox 93A, and if there is mail addressed to the user, acquires the mail. Execute.

  The autopilot program 54B is a program that sequentially activates and executes a plurality of preset processes (or programs) in a preset order.

  The OS (basic program software) 54C controls the basic operation of the computer represented by, for example, the so-called Windows 95 or 98 (registered trademark) of Microsoft Corporation or the so-called Mac OS of Apple Computer.

  On the other hand, a hard disk drive (HDD) 56 on the external bus 55 side stores various application programs such as an e-mail program 56A and an autopilot program 56B, and an OS (basic program software) 56C. The OS 56C, the auto-pilot program 56B, and the e-mail program 56A in the hard disk drive 56 are sequentially transferred and stored in the RAM 54 in the course of startup (boot-up) processing.

  The I / O controller 57 has a microcontroller 61, and the microcontroller 61 is provided with an I / O interface 62. The microcontroller 61 includes an I / O interface 62, a CPU 63, a RAM 64, and a ROM 69, which are interconnected. The RAM 64 has a key input status register 65, an LED (light emitting diode) control register 66, a set time register 67, and a register 68. The set time register 67 is used when the operation of the start-up sequence control unit 76 is started at a time (start-up condition) set by the user in advance. The register 68 stores a correspondence between a preset operation key combination (activation condition) and an application program to be activated. When the stored operation key combination is input by a user, the register 68 stores the correspondence. The activated application program (for example, an e-mail program) is activated.

  The key input status register 65 stores an operation key flag when the programmable power key (PPK) 9 for one-touch operation is pressed. The LED control register 66 controls lighting of a message lamp ML that indicates a startup state of an application program (e-mail program) stored in the register 68. The set time register 67 can arbitrarily set a predetermined time.

  Note that a backup battery 74 is connected to the microcontroller 61, and the values of the registers 65, 66, and 67 are retained even when the power of the main body 2 is turned off. ing.

  A wake-up program 70, a key input monitoring program 71, and an LED control program 72 are stored in the ROM 69 in the microcontroller 61 in advance. The ROM 69 is constituted by, for example, an electrically erasable and programmable read only memory (EEPROM). This EEPROM is also called a flash memory. Further, an RTC (Real-Time Clock) 75 that constantly counts the current time is connected to the microcontroller 61.

  The wake-up program 70 in the ROM 69 checks whether or not the time set in advance in the set time register 67 has been reached based on the current time data supplied from the RTC 75. It is a program that starts processes (or programs). The key input monitoring program 71 is a program that constantly monitors whether or not the user has pressed the PPK 9. The LED control program 72 is a program for controlling lighting of the message lamp ML.

  A BIOS (Basic Input / Output System) 73 is further written in the ROM 69. The BIOS refers to a basic input / output system, and is a software program that controls data transfer (input / output) between an OS or an application program and peripheral devices (display, keyboard, hard disk drive, etc.).

  A keyboard controller 58 connected to the external bus 55 controls input from the keyboard 4. The track point controller 59 controls input of the track point 5.

  The sound chip 60 takes in an input from the microphone 24 or supplies an audio signal to the built-in speaker 8.

  The modem 50 can be connected to a communication network 92 such as the Internet, a mail server 93, and the like via a public telephone line 90 and an Internet service provider 91.

  Image data captured by the CCD video camera 23 is processed by the processing unit 82 and then input to the graphic chip 81 connected to the internal bus 51. The graphic chip 81 stores video data input from the CCD video camera 23 via the processing unit 82 in the built-in VRAM 81A, reads out the data as appropriate, and outputs the read data to the LCD controller 83. The LCD controller 83 outputs the image data supplied from the graphic chip 81 to the LCD 21 for display. The backlight 84 illuminates the LCD 21 from behind.

  The power switch 40 is operated when the power is turned on or off. The half-press switch 85 is turned on when the shutter button 10 is half-pressed, and the full-press switch 86 is turned on when the shutter button 10 is fully pressed. The reversing switch 87 is turned on when the imaging unit 22 is rotated by 180 degrees (when the CCD video camera 23 is rotated in a direction for imaging the opposite side of the LCD 21).

  Next, the personal computer of the first embodiment to which the information processing method and apparatus of the present invention and the graphical user interface are applied is an information processing apparatus that manages the generated files. (For example, the HDD 56 in FIG. 7), a switching unit (for example, the move buttons 124a and 124b in FIG. 8) for switching the screen to a past or future screen, and a past or future switched by the switching unit. And a display control unit (for example, an LCD controller 83) for controlling the display so that the file of the date and time corresponding to the screen is displayed.

  The personal computer according to the first embodiment of the present invention includes an input unit (eg, the keyboard 4 in FIG. 7) for inputting a character string to be searched, and a file corresponding to the character string input by the input unit. A search means for searching for the past or the future (for example, search buttons 126a and 126b in FIG. 8) is further provided.

  Hereinafter, a GUI (Graphical User Interface) screen in the personal computer according to the first embodiment of the present invention will be described with reference to FIG.

  In the personal computer according to the first embodiment of the present invention, as shown in FIG. 8, the icon 121 of the document file (for example, “MEMO” file) generated by the user is displayed on the pointing device (track point 5) by the user. It is possible to freely arrange them on the desktop screen 111 according to the operation. In addition, an icon 122 of an image file (for example, a “meeting room” file) and a keyword character string (sticky note) 123 can be freely arranged. In this embodiment, a folder for organizing files is not used in principle.

  The desktop screen 111 corresponds to a predetermined time (date and time) on the time axis. In the personal computer according to the first embodiment of the present invention, when the user specifies a predetermined time on the time axis, An image corresponding to the predetermined time is displayed on the desktop screen 111. Further, the personal computer according to the first embodiment, for example, returns the desktop screen 111 to the past screen when the user operates the move button 124a with the track point 5, and operates when the user operates the move button 124b with the track point 5. Then, the desktop screen 111 is moved to a future screen.

  In the personal computer of the present embodiment, when the user operates the keyboard 4 and inputs a character string (sticky note) to be searched in the search character input space 125, the character string is searched. Also, when the user operates the search button 126a at the track point 5 to instruct that the character string (sticky note) should be searched for in the past, the personal computer of the present embodiment displays the past screen. Perform a search. Further, when the user operates the search button 126b at the track point 5 to instruct that the character string (sticky note) is to be moved to the future and to search, the personal computer of the present embodiment switches to the future screen. Perform a search.

  The desktop screen 111 is provided with a date and time display unit 127, in which date and time (in the case of the display example of FIG. 8, 11:48 on October 16, 1998) corresponding to the currently displayed screen 111 are provided. Is displayed.

  On the desktop screen 111, icons of files created at the corresponding date and time and recorded in the HDD 56 (icons of files remaining at that date and time) are displayed. Here, when the user operates the track pointer 5 to drag and drop, for example, the document file icon 121, the image file icon 122, or the sticky note icon 123 onto a “trash can” icon (not shown) on the screen, File is deleted and its icon is removed from the screen. However, these files are once recorded in the HDD 56 when the icon is created, and the recorded data itself is stored as it is in the HDD 56 (not erased). Therefore, when the user operates the move button 124a at the track point 5 and returns to the screen 111 of the date and time (past) at which the file was deleted, the document file icon 121, the image file icon 122, or the sticky note icon 123 Is displayed. If the icons are moved by the user to, for example, the screen of the current date and time, the file can be restored. Therefore, the user can relatively easily delete the icons, limit the number of icons displayed on the screen to an appropriate number, and make the icons easy to see.

  Next, a processing operation when the time axis of the desktop screen 111 is moved to the future and used as a reminder will be described with reference to the flowchart of FIG.

  In FIG. 9, when the user operates the keyboard 4 or the track point 5 to give instructions to activate the reminder function, those instructions are notified to the CPU 52 of the personal computer of the present embodiment.

  Here, first, in step S1, when the user operates the move button 124b by the track point 5, the signal is supplied to the CPU 52 via the track point controller 59. The CPU 52 reads out from the file management information recorded in the HDD 56 whether the file validated at the date and time corresponding to the supplied signal is the file, and causes the graphic chip 81 to generate a corresponding icon, The image is displayed on the LCD 21 via the LCD controller 83. As a result, the desktop screen 111 of the personal computer moves to the screen 111 of the desired date and time (future).

  When the user inputs a character string to be displayed on the keyboard 4 in step S2 on the desktop screen 111 moved as described above, the input character string is transmitted to the HDD 56 via the keyboard controller 58 and the external bus 55. Recorded in.

  At this time, the CPU 52 performs a timing operation with a built-in timer as step S3, and when a predetermined date and time comes, reads a character string to be displayed on a screen corresponding to the date and time from the file management information of the HDD 56, and The supplied character string is supplied to the LCD controller 83 via the external bus 55.

  Accordingly, the LCD controller 83 displays the supplied character string on the screen 111 of the LCD 21 in step S4.

  Next, in the first embodiment, a processing operation in a case where a desired document file is searched by moving the time axis of the screen 111 in the past will be described with reference to a flowchart of FIG. Here, a case will be described as an example where a user searches for related materials when a user creates a manuscript.

  First, when a user creates a document, the CPU 52 generates a document file corresponding to the document. The generated document file is recorded on the HDD 56. Next, when a transmission command of the generated document file is input from the keyboard 4 by the user, the command signal is input to the CPU 52 via the keyboard controller 58, the external bus 55, and the internal bus 51. Upon receiving the document file transmission instruction, the CPU 52 reads the document file recorded on the HDD 56 from the HDD 56 and supplies the document file to the modem 50 via the external bus 55. The modem 50 transmits the supplied document file to a destination specified by the user via the telephone line 90, the provider 91, and the Internet 92 based on a command from the CPU 52.

  Thereafter, it is assumed that the icon of the transmitted document file is deleted from the screen by the user (drag and drop to the “trash can” icon (not shown)).

  In this state, for example, when the user wants to search for materials related to the deleted document file, a command indicating this is input from the user to the CPU 52.

  That is, when the user operates the move button 124a with the track point 5 in step S11 of FIG. 10, the operation signal is supplied to the CPU 52 via the track point controller 59, the external bus 55, and the internal bus 51. The CPU 52 reads out the file of the date and time corresponding to the supplied signal from the file management information of the HDD 56 and displays the file on the LCD 21 via the LCD controller 83.

  This allows the user to know the file that was valid at the date (past) when the document file (document) was deleted. Further, the user can refer to each document file displayed on the screen 111 in step S12, and further, in step S13, a document (document file) deleted from the document files displayed on the screen 111. A desired material (document file) related to the file can be found.

  Next, a processing operation for searching for a desired image file by using a sticky note pasted on the screen 111 will be described with reference to a flowchart of FIG.

  When searching for a desired image file, a command for the search is input to the CPU 52. Here, in step S21, the CPU 52 inputs a keyword character string (for example, SIGGRAPH (meaning a subcommittee on CG of ACM)) related to the image file into the search character input space 125 by operating the keyboard 4 by the user in step S21. Then, the process proceeds to step S22.

  Next, when the user operates the search button 126a with the track pointer 5 and the operation signal is input to the CPU 52 via the track point controller 59, the CPU 52 performs the search in the past as the process of step S22. To start. This allows the user to add the keyword character string input from the keyboard as a tag to the image file and record the file on the HDD 56 as file management information. Therefore, the CPU 52 searches for the specified keyword character string from among them.

  That is, when the user issues a search instruction using a keyword character string (sticky note (SIGGRAPH)), the CPU 52 reads the image file to which the keyword character string is pasted from the HDD 56 in step S23, Is displayed on the LCD 21 via.

  Thereby, the user can confirm the image file on which the sticky note (SIGGRAPH) is pasted, and the user refers to the image file displayed on the screen 111 as in step S24, A desired image file can be found. As described above, according to the present embodiment, a file whose content is difficult to understand from the file name, such as an image file, can be relatively easily searched.

  Next, the weathering function of the sticky note pasted on the screen 111 will be described with reference to FIGS. Here, the weathering function refers to a function in which the color of the sticky note gradually changes over time.

  For example, as shown in FIG. 12, a sticky note (for example, Cyber Code) 141 and a sticky note (for example, Sony CSL) 142 are attached at the time when they are pasted on the screen 111 (for example, 9:40 on February 10, 1998. ) Indicates a clear color (for example, yellow). This color gradually changes over time. For example, at 10:40 on October 20, 1998, the sticky notes 141 and 142 shown in FIG. 13 become dull yellow.

  Thus, the user can intuitively determine whether or not the sticky note pasted on the screen 111 has just been pasted.

  Next, a case where the present invention is applied to another OS (for example, UNIX (registered trademark)) that manages files using a directory structure will be described with reference to FIG.

  In UNIX, it is assumed that the user has created a document file on September 1, 1998 in the directory "/ user / rekimoto / doc /" as the file name "genkou.txt". Normally, this file can be accessed as the full pathname "/user/rekimoto/doc/genkou.txt".

  On the other hand, in the method of the present invention, since the content of the file is managed by the file generation time, the above file is also referred to as a time-added path name “/1998.9.1/user/rekimoto/doc/genkou.txt”. (FIG. 14A). This path name is a special path name for referring to “contents of“ /user/rekimoto/doc/genkou.txt ”at the specified time (September 1, 1998)”.

  Thereafter, when this document file is changed, the contents of the file at the time of the change are stored. The usual path name "/user/rekimoto/doc/genkou.txt" always refers to the latest file (similar to existing file systems). On the other hand, the path name with time can refer to “contents of file at specified time”. For example, the content of “genkou.txt” file as of September 10 is “/1998.9.10/user /rekimoto/doc/genkou.txt "(FIG. 14B).

  The generated document file and its change history are stored in the HDD 56. That is, every time a change is made to a file, the change history is stored on the HDD 56, so that the content of the file at an arbitrary time can be reproduced, and the content is referred to by the above-mentioned path name with time. Will be able to do it.

  It is possible to combine a time-added path name with a conventional file management command. For example, a change made by the user between September 1, 1998 and September 10, 1998 is, as shown in FIG. 14C, a diff command (diff command is widely used in UNIX). Command for displaying the difference between the two document files). That is, the user can check the contents of the file and the change at any time without using the version management command with special consideration.

  As described above, according to the first embodiment of the present invention, a file is stored in correspondence with the date and time, and the file is searched and displayed by moving the time axis as necessary. On the screen, the user can organize (manage) files without using folders.

  Next, a second embodiment to which the information processing method and apparatus and the providing medium of the present invention are applied will be described below.

  Generally, on a computer system, for example, data stored in an HDD or the like can be referred to using various application programs. For example, e-mail data can be referred to using an application program called a mail client. For example, image data captured by a digital camera can be referred to using an application program called an image browser (image file browser). can do. Many of these application programs have the concept of “time”. For example, in the mail client, the reception time of the currently referred mail is the “time” of the application, and in the image browser, the time of capturing the image is the time of the application. In the application program shown in the first embodiment, the concept of time is introduced into the desktop environment itself, and the state of the desktop (file, sticky note, photograph, etc.) at any time can be reproduced. ing.

  However, there is no general application program such as the mail client or the image browser that can easily search for information between applications using the concept of time. Therefore, for example, "I want to reproduce the state of the desktop when I received an e-mail and access the work file I was doing at that time" or "I want to search for the image taken while writing this sentence" In response to such a request, a number of steps of operations over a plurality of applications are required, which is complicated.

  Therefore, in the second embodiment of the present invention, time information is exchanged between various application programs (for example, applications such as desktop environment, schedule management software, image viewer, voice memo, etc.) which run on a computer system or other information devices. By communicating with each other, it is possible to cooperate between the applications, thereby searching for information using time as a key, for example, "searching for a photograph image taken when this e-mail was received". It is feasible.

  In order to make this possible, the applications AP1 and AP2 to which the second embodiment of the present invention is applied have the concept of “application time” as shown in FIG. 15, for example. In addition to the application unit A, which is the main body of the application program, a time processing unit T that handles the “time of the application” and a communication unit that communicates at least the “time of the application” with another application program C is provided. For example, in the case of an image browser, the time at which the currently displayed image is photographed (created) is the “time of the application”. For example, a desktop environment that can be moved over time as in the first embodiment described above is used. In the case of an application to be realized, the reproduced time of the desktop is the “time of the application”.

  Further, in the second embodiment of the present invention, when each application receives time information from another application, it is possible to adjust “time of application” to the time information. For example, in the case of an image browser, when time information is received from another application, the state of the application changes so as to display an image captured at a time closest to the received time. For example, in the case of an application that realizes a time-movable desktop environment as in the first embodiment, when time information is received from another application, the state of the desktop at the time corresponding to the received time is displayed on the screen. Reproduce. That is, in the application for realizing the time-movable desktop environment of the first embodiment, the file icon or the sticky note placed on the desktop at the time corresponding to the time information received from another application is moved to the same position. To reproduce.

  Here, in the application for realizing the time-movable desktop environment according to the first embodiment, for example, when a file icon reproduced on the desktop corresponding to the time information received from the other application is opened, the reception is performed. The state of the file at the time corresponding to the time is reproduced and displayed on the screen. In order to reproduce the state of the file at the time corresponding to the time received from another application, for example, the following two methods can be used.

  As a first method, for example, every time a file is changed, the version information of the file is stored together with the time. That is, in the case of the first method, when reproducing the state of the file at the time corresponding to the time received from another application, the file of the version corresponding to the received time is opened.

  As a second method, for example, every time a file is changed, a difference between a previous file and the changed file is stored. That is, in the case of the second method, when reproducing the state of the file at the time corresponding to the time received from another application, the difference corresponding to the received time is sequentially applied to obtain the desired file contents. Generate.

  Further, in the second embodiment of the present invention, each application notifies another application every time the “time of the application” changes. For example, if another image is displayed by operating the image browser, the “time” of the image browser at this time is the shooting time of the image (the generation time of the image file). To other applications.

In addition, the communication method of the time information between the applications may be one-to-one (for example, one-to-one between an image browser application and an application for realizing a time-movable desktop environment). Broadcast, multicast). Multicast is a method for simultaneously transmitting information to application programs belonging to a certain group. In the second embodiment of the present invention, various stages can be considered as the range (group) for multicasting. For example,
"Applications running on the same computer" group "Applications launched by the same user (for example, scheduling software on PDA and mail software on desktop computer)" group "Applications belonging to the same organization (for example, during a meeting) Group of blackboard-type computers, notebook computers owned by conference participants, and information appliances in a living room of a certain household). As shown in this example, in the present embodiment, applications that cooperate in time do not necessarily need to operate on the same computer. Needless to say, it is possible to control the participation in the multicast group by setting the application or operating the user.

  FIG. 16 shows an operation flow of each application.

  In FIG. 16, when an application is started in step S30, each application determines whether or not there is a time notification from another application in step S31.

  When there is a notification of the time from another application in the determination in step S31, each application adjusts the state of the application ("application time") to the time received from the other application in step S33.

  In addition, when there is no notification of the time from another application in the determination of step S31, each application performs a normal application process in step S32, and then, in step S34, has the “application time” changed by any operation? Determine whether or not.

  When it is determined in step S34 that the “time of the application” has changed, each application updates the “time of the application” in step S35, and then notifies other applications of the changed time in step S36. .

  After the processing in steps S33 and S36, or after determining in step S34 that the "time of the application" does not change, it is determined in step S37 whether each application is to be terminated. Return to processing.

  Hereinafter, taking some applications as examples, the meaning of “application time” in each application, that is, the specific operation of step S33 in FIG. 16 and the operations of steps S32, S33, and S35 in FIG. A specific operation will be described. The definition of “time of application” in each application may be different for each application. Generally, a meaning is given so that the user can recall “what kind of work was performed at that time or what the application was doing at that time”.

  FIGS. 17 and 18 show examples in which an image browser is used as an application. FIG. 17 shows the flow of operation of the image browser in step S33 of FIG. 16, and FIG. 18 shows the flow of operation of steps S32, S33, and S35 in FIG. 16 in the image browser.

  In FIG. 17, when the information of “time of application” is received from another application in step S33 of FIG. 16, the image browser determines, in step S41, the “time of reception” of the image files arranged in chronological order. The image (file) closest to is taken out and displayed on the screen. Next, in step S42, the image browser sets “time of application” to the time received from the other application. After that, the processing shifts to the processing of step S37 in FIG.

  In FIG. 18, in the case of the image browser, the “application time” changes when an image file displayed on the screen changes, for example, by a user operation. That is, for example, when the image file displayed on the screen is changed by the operation of the user as in step S43 in FIG. 18 while the normal application processing is being performed in step S32 in FIG. In step S33, it is determined that the “time of application” has changed. When it is determined that the “time of the application” has changed, the image browser sets the time of the image file displayed on the screen to the “time of the application” in step S44 (step S35 in FIG. 16). . After that, the processing shifts to the processing of step S36 in FIG.

  FIGS. 19 and 20 show an example in which an application that realizes a desktop environment that can be moved over time is used as in the second embodiment. FIG. 19 shows the flow of the operation of step S33 in FIG. 16 in the application that realizes the desktop environment capable of moving in time, and FIG. 18 shows the flow of the operation of steps S32, S33, and S35 in FIG. Is shown.

  In FIG. 19, when the information of “application time” is received from another application in step S33 of FIG. 16, the application that realizes the desktop environment capable of moving for the time corresponds to the received time in step S51. Reproduce the state of the desktop at the time. Next, in step S52, the application displays the reproduced state of the desktop on the screen. After that, the “time of the application” is set to the time received from the other application, and the process proceeds to step S37 in FIG.

  In FIG. 20, in the case of an application that implements the desktop environment capable of moving over time, the “time of application” changes when, for example, the user presses a move button or instructs execution of a search. This is when the time shift of the desktop environment (reproducing the state of the desktop at that time) occurs. That is, for example, while the normal application processing is being performed in step S32 in FIG. 16, when the time movement of the desktop environment occurs due to the operation of the user as in step S54 in FIG. 20, the process proceeds to step S33 in FIG. Thus, it is determined that the “time of the application” has changed. When it is determined that the “time of the application” has changed, the application sets the time of the desktop to the “time of the application” in step S55 (step S35 in FIG. 16). After that, the processing shifts to the processing of step S36 in FIG.

  FIGS. 21 and 22 show an example in which an e-mail browser is used as an application. FIG. 21 shows a flow of the operation of the e-mail browser in step S33 of FIG. 16, and FIG. 22 shows a flow of the operation of steps S32, S33, and S35 of FIG. 16 in the e-mail browser.

  In FIG. 21, when information of “time of application” is received from another application in step S33 of FIG. 16, the e-mail browser sets the reception time of the stored e-mail to “ Take out the "mail closest to the received time" and display it on the screen. Next, in step S62, the e-mail browser sets “time of application” to the time received from the other application. After that, the processing shifts to the processing of step S37 in FIG.

  In FIG. 22, in the case of an e-mail browser, the “time of application” changes when the mail displayed on the screen changes, for example, by a user operation. That is, for example, when the mail displayed on the screen is changed by the operation of the user as in step S63 in FIG. 22 while the normal application process is being performed in step S32 in FIG. In step S33, it is determined that the “time of the application” has changed. When it is determined that the “time of application” has changed, the e-mail browser sets the reception time of the mail displayed on the screen to “time of application” in step S64 (step S35 in FIG. 16). I do. After that, the processing shifts to the processing of step S36 in FIG.

  FIGS. 23 and 24 show examples in which an application for realizing a so-called voice memo or handwritten memo system is used as the application. FIG. 23 shows the flow of the operation of step S33 in FIG. 16 in the application of the memo system, and FIG. 24 shows the flow of the operation of steps S32, S33, and S35 of FIG. 16 in the application of the memo system.

  In FIG. 23, when the information of “time of application” is received from another application in step S33 of FIG. 16, the application of the memo system determines in step S71 that the creation time of the stored memo data is The “data closest to the received time” is extracted and displayed on the screen. Next, in step S72, the application of the memo system sets “time of application” to the time received from the other application. After that, the processing shifts to the processing of step S37 in FIG.

  In FIG. 24, in the case of the application of the memo system, the “time of the application” changes when the memo data displayed on the screen changes, for example, by a user operation. That is, when the memo data displayed on the screen is changed by the operation of the user as in step S73 in FIG. 24 while the normal application processing is being performed in step S32 in FIG. In step S33, it is determined that the “time of application” has changed. When it is determined that the “time of the application” has changed, the application of the memo system sets the creation time of the memo displayed on the screen to “the time of the application” in step S74 (step S35 in FIG. 16). Set. After that, the processing shifts to the processing of step S36 in FIG.

  Next, a specific example in the case of performing time-based cooperation between applications as in the second embodiment of the present invention will be described below.

  FIG. 25 shows an example of a display screen when time-based cooperation is performed between an application that realizes a desktop environment that can move over time as in the first embodiment and an application of an image browser. Is shown.

  In FIG. 25, it is assumed that a search is first performed on the desktop by an application that realizes the desktop environment capable of moving over time, for example, and the character moves to a certain character string or icon until it appears on the desktop. In this example, for example, a character string “wearable” is input to the search character input space 125, and the application that realizes a desktop environment capable of moving over time searches for the character string “wearable”. It is assumed that icons, character strings, and the like used at the time of the meeting related to are displayed on the window 200. In this example, as can be seen from the display contents of the date and time display unit 127, the desktop environment at the time of the meeting held at 15:00 on Friday, November 20, 1998 (Fri) is displayed on the window 200. .

  As described above, when the “time of the application” is determined by the application that realizes the desktop environment capable of moving in time, the time information is notified to the image browser.

  The image browser that has received the time information displays a photographic image taken near the time (during the meeting) on the window 201. In this example, a photographic image taken at 16:00 on November 20, 1998 is displayed in the window 201, as can be seen from the display contents of the image file creation time display unit 203.

  Conversely, when the user operates the image browser, the state of the desktop at the time when the photographic image was taken is reproduced. Therefore, even if the photographic image does not have a special caption (explanation), it is possible to understand under what circumstances the photographic image was taken.

  Although the example of FIG. 25 has been described as an example of the cooperation between the application of the image browser and the application that realizes the desktop environment capable of moving in time, there are many other examples of the application having the time as described above.

  For example, when linking e-mail software (e-mail browser) with an application that realizes the desktop environment capable of moving over time, "Files related to the work that was being performed when a certain e-mail was received are stored on the desktop. Display "is possible.

  Also, in the case where the document creation software (so-called word processor software) is linked with an application for realizing the desktop environment capable of moving in time, for example, the document creation software can attach time information to each paragraph (or each character). If it is a thing, cooperation such as "reproducing the work that was being done when editing a paragraph on the desktop" becomes possible.

  In addition, a voice memo and handwritten memo system (Reference: IBM's CrossPad (trademark), a portable system in which a tablet is mounted under a paper memo pad, and when a memo is written with a special pen, it is left on the paper. If the application used for the portable device (e.g., the same information as the memo is stored in the computer) can attach the time to the memo, for example, by linking this application with, for example, an image browser, A memo can be associated with a photo, such as "photo taken near the time when a memo was created." In the case of this example, even if a photograph and its explanatory memo are independently photographed and input, they can be easily linked later.

  Furthermore, the present invention can be applied to devices other than computers as long as they have the concept of "time". For example, if the “current time” of the VCR is “the time when the currently playing video was recorded”, while watching the past news video on the video, the digital video taken at that time or the Work files can be easily accessed. According to this, the efficiency of work in a studio for television production or news production can be improved. At home, it is also possible to use such that "when watching a video of an athletic meet, pictures taken at the athletic meet are also displayed synchronously".

  Also, for example, as shown in FIG. 26, a system such as a GPS (Global Positioning System) or a PHS (Personal Handyphone System) that can record position information with time (for example, a portable position search device 230 or the like), Coordination with a portable device 220 having an application that implements a mobile desktop environment is also conceivable.

  In the example of FIG. 26, when the history information of the user's own position is displayed on the position search device 230 and a specific place is selected, “the time at that place” is notified to the application of the portable device. If this cooperation is used, it is possible to access information using the position and time, such as “a memo file created while in a certain conference room”.

  As described above, according to the second embodiment of the present invention, each application can be linked by time information, and flexible information access corresponding to a human action history can be performed via a plurality of applications. Can be done.

  In each of the first and second embodiments of the present invention, a providing medium for providing a user with a computer program for executing the processing of each of the above embodiments includes an information recording medium such as a magnetic disk and a CD-ROM. In addition, transmission media via networks such as the Internet and digital satellites are included.

  According to the embodiment of the present invention described above, the generated or changed data is stored in association with the time information, a desired date and time is set, and the state of the data corresponding to the set date and time is stored in the time information. , It is possible to easily manage files, folders, and other data.

  Here, the information processing apparatus and method and the providing medium described in the above-described embodiment of the present invention have the following features.

  That is, the information processing apparatus described in the embodiment includes a storage unit that stores generated or changed data in association with time information, a date and time setting unit that sets a desired date and time, And control means for reproducing the state of data corresponding to the time information based on the time information.

  Here, the storage unit stores the generated or changed file in association with time information, the date and time setting unit sets a date and time according to a past or future screen, and the control unit executes the past or It is preferable that a file of a date and time corresponding to a future screen is read out from the storage means, reproduced, and controlled so as to be displayed on the screen. It is preferable that input means for inputting a character string to be searched and a search means for searching for a file corresponding to the character string input by the input means in the past or in the future are provided. The file may be a document file, an image file, or a character string. It is preferable that the control means controls the color of the character string to be changed over time and displayed on the screen. The storage means preferably stores the date and time when the file was changed and the revision information of the file, and the storage means stores a difference before and after the change of the file, and the control means stores the time information. It is preferable to reproduce a desired file from the difference based on the above.

  It is preferable that a time information transmitting / receiving means capable of transmitting / receiving the time information is provided, and the date / time setting means sets the date / time based on the received time information.

  Further, a position detecting means for detecting a position is provided, and the storage means also stores the position in association with time information, and the date and time setting means sets a date and time based on the time information corresponding to the position. Is preferred.

  Further, the storage unit stores an application program capable of transmitting and receiving time information, the date and time setting unit sets the date and time based on time information received from another application program, and the control unit performs the setting. It is preferable to reproduce the state of the application program corresponding to the specified date and time. Here, it is preferable that the date and time setting means sets a date and time closest to the received time information. It is preferable that the application program includes a file management program for managing files. It is preferable that the application program includes a position and time information management program that manages the input position information and time information corresponding to the position information.

  Next, in the information processing method described in the above embodiment, a storage step of storing generated or changed data in association with time information, a date and time setting step of setting a desired date and time, And a control step of reproducing a state of data corresponding to the date and time based on the time information.

  In the storing step, the generated or changed file is stored in association with time information. In the date and time setting step, a date and time is set according to a past or future screen. In the control step, the past or future screen is set. It is preferable to control so that the file of the date and time corresponding to is reproduced and displayed on the screen. The file may be a document file, an image file, or a character string. In the control step, it is preferable that the color of the character string is changed over time so as to be displayed on the screen. In the storing step, it is preferable that a date and time when the file is changed and revision information of the file are stored. Preferably, the storing step stores a difference before and after the change of the file, and the control step reproduces a desired file from the difference based on the time information.

  Preferably, a time information transmitting / receiving step capable of transmitting / receiving the time information is provided, and in the date / time setting step, the date / time is preferably set based on the received time information.

  Further, a position detecting step for detecting a position is provided, and in the storing step, the position is also stored in association with time information, and in the date and time setting step, a date and time are set based on the time information corresponding to the position. Is preferred.

  Further, in the storing step, an application program capable of transmitting and receiving time information is stored. In the date and time setting step, the date and time are set based on time information received from another application program. It is preferable to reproduce the state of the application program corresponding to the specified date and time. In the date and time setting step, it is preferable to set a date and time closest to the received time information. The application program preferably includes a file management program for managing files. It is preferable that the application program includes a position and time information management program that manages the input position information and time information corresponding to the position information.

  Next, the providing medium described in the above embodiment has a storage step of storing generated or changed data in association with time information, a date and time setting step of setting a desired date and time, A computer-readable program for executing a process including a control step of reproducing a corresponding data state based on the time information is provided.

  In the storing step, the generated or changed file is stored in association with the time information. In the date and time setting step, the date and time are set according to the past or future screen. In the controlling step, the past or future screen is set. It is preferable to control so that the file of the date and time corresponding to is reproduced and displayed on the screen.

  Preferably, a time information transmitting / receiving step capable of transmitting / receiving the time information is provided, and the date / time setting step sets the date / time based on the received time information.

1 is an external perspective view showing a state in which a display unit of a configuration example of a portable personal computer to which the present invention is applied is opened with respect to a main body. FIG. 2 is a plan view of FIG. 1. FIG. 2 is a left side view showing a state where the display unit of FIG. 1 is closed to a main body. FIG. 2 is a right side view showing a state where the display unit of FIG. 1 is opened 180 degrees with respect to a main body. FIG. 4 is a front view of FIG. 3. FIG. 5 is a bottom view of FIG. 4. FIG. 2 is a block diagram illustrating a configuration example of an electric circuit in FIG. 1. FIG. 5 is a diagram illustrating a display example of a GUI screen according to the first embodiment of this invention. 9 is a flowchart for explaining a processing operation when the time axis of the screen 111 in FIG. 8 is moved to the future and used as a reminder. 11 is a flowchart for explaining a processing operation when a time axis of the screen 111 is moved in the past to search for a desired document file. 11 is a flowchart for explaining a processing operation in a case where a desired image file is searched using a sticky note pasted on a screen 111. It is a figure for explaining the weathering function of the sticky note pasted on screen 111. It is a figure for explaining the weathering function of the sticky note pasted on screen 111. FIG. 3 is a diagram for describing a case where the first embodiment of the present invention is applied to an OS (eg, UNIX). FIG. 9 is a diagram used for describing a configuration of a second exemplary embodiment of the present invention. It is a flow chart which shows a flow of cooperation operation between each application in a 2nd embodiment of the present invention. 17 is a flowchart showing a flow of an operation of step S33 in FIG. 16 in the image browser. 17 is a flowchart showing the flow of the operation of steps S32, S33, and S35 in FIG. 16 in the image browser. 17 is a flowchart showing the flow of the operation of step S33 in FIG. 16 in an application for realizing a desktop environment capable of moving over time. 17 is a flowchart showing a flow of operations of steps S32, S33, and S35 in FIG. 16 in an application for realizing a desktop environment capable of moving over time. 17 is a flowchart showing the flow of the operation of step S33 in FIG. 16 in the e-mail browser. 17 is a flowchart showing the flow of the operation of steps S32, S33, and S35 in FIG. 16 in the e-mail browser. 17 is a flowchart showing the flow of the operation of step S33 in FIG. 16 in the application of the memo system. 17 is a flowchart showing the flow of operations of steps S32, S33, and S35 in FIG. 16 in the application of the memo system. FIG. 9 is a diagram illustrating an example of a display screen when time-based cooperation is performed between an application that realizes a desktop environment capable of moving over time and an application of an image browser. FIG. 2 is a diagram used to explain a cooperation between a system (portable position search device) capable of recording position information with time and a portable device provided with an application for realizing a desktop environment capable of moving over time. FIG. 7 is a diagram illustrating a display example of a screen when an OS is started. FIG. 28 is a diagram illustrating a display example of a screen when an icon 151 in FIG. 27 is clicked. FIG. 29 is a diagram illustrating a display example of a screen when a “My Documents” folder in an icon 162 in FIG. 28 is clicked.

Explanation of reference numerals

  Reference Signs List 1 personal computer, 2 main body, 3 display unit, 4 keyboard, 5 track point, 21 LCD, 52, 63 CPU, 54, 64 RAM, 54C, 56C OS, 55 external bus, 56 HDD, 58 keyboard controller, 59 track point Controller, 83 LCD controller, 84 backlight, 92 Internet, 111 desktop screen, 121, 122 icon, 123, 141, 142 sticky note, 124a, 124b move button, 125 search character input space, 126a, 126b search button, 127 date and time Display unit, AP1, AP2 application, A application main unit, time processing unit for handling the time of T application, C communication unit, 200 Time movable desktop window, 201 image (photograph) browser window, 203 image file creation time display unit, 220 portable device, 230 portable position search device

Claims (8)

Storage means for storing the generated or changed data in association with time information;
Date and time setting means for setting a desired date and time,
Control means for reproducing the state of the data corresponding to the set date and time based on the time information,
The storage means stores the generated or changed file in association with time information,
The date and time setting means sets a date and time according to a past or future screen,
The control means reads out and reproduces the file of the date and time corresponding to the past or future screen from the storage means, displays the file on the screen, and changes the color of the displayed file with the passage of time and displays it. An information processing apparatus characterized in that the information processing apparatus performs control. The information processing apparatus according to claim 1, wherein the file is a document file, an image file, or a character string. A storage step of storing the generated or changed data in association with the time information;
A date and time setting step of setting a desired date and time;
Having a control step of reproducing the state of the data corresponding to the set date and time based on the time information,
In the storing step, the generated or changed file is stored in association with time information,
In the date and time setting step, set the date and time according to the past or future screen,
In the control step, the file of the date and time corresponding to the past or future screen is reproduced and displayed on the screen, and the color of the displayed file is changed and displayed over time. An information processing method characterized by the following. The information processing method according to claim 3, wherein the file is a document file, an image file, or a character string. A display unit,
A graphical user interface displayed on the display unit;
An object that displays information within it,
A processing unit configured to change a color of the object in the graphical interface as time elapses from when the object is displayed on the display. A display unit,
A graphical user interface displayed on the display unit;
An object that displays information within it,
A processing unit that executes a weathering process on the object after the object is displayed on the display. It has an object that displays information inside,
A graphical user interface wherein the object gradually changes over time from when the object is displayed on the display.   The graphical user interface according to claim 7, wherein the change is a weathering process.

Images