JPH1091388A - Information processor and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display data in conformity with a user's time feeling and to reproduce sound data attached to each data icon in conformity with the time feeling. SOLUTION: In a window 1, display areas corresponding to specific time intervals are secured in a ring shape (rings 2 and 5, etc.) in time order. On th basis of time information included in data, data icons 3 and 4 indicating the data are arranged and displayed on the said rings. Voice data are assigned to those data icons 3 and 4 and sound reproduction levels are set for the respective rings. Then the sound data related to the respective data icons arranged on the rings 2 and 5 are reproduced according to the sound reproduction levels that the rings 2 and 5 have respectively.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method for managing and displaying a plurality of data according to associated dates and times, such as a database and a file system.

[0002]

2. Description of the Related Art In a file management system of a computer, a database system, and the like, date and time are handled as an important parameter when managing a large amount of data.
In the file management system, the date and time when the file was created, the date and time when the file was modified, and the like are automatically added as file attributes. Also, in the database system, the date and time field is provided in the field in the data,
Data can be managed by the date and time entered here. For example, in the case of a personnel management database 30 as shown in FIG. 19, the date of birth is entered in the date and time field 31 and managed. In the schedule application software (hereinafter referred to as a scheduler), the schedule itself is managed by date and time. For example, if the contents of the schedule are a meeting and a document file to be used for the meeting is registered, the , What material,
It is convenient because you can check if you have attended the meeting.

[0003] When searching for desired data from such a large number of data, these date and time data are important parameters. In the file management system, by displaying files arranged in order of creation date and time or modification date and time, desired data can be searched out together with storage of file creation and modification work of the user. Also, in a database system, for example, in a human resources management database, searching and displaying a date of birth is commonly used. Also, the scheduler can look at the contents of the schedule in chronological order and find a related desired data file.

[0004]

For users, the most common unit of storage is chronological. The date when a file is created or modified is usually memorized in a vague manner, and if you compare that memory with the file date, you can find the desired file even if you forget the file name. It is possible. Also,
The same applies to the scheduler, and desired contents can be obtained according to the memory of when. The same applies to the scheduler, and desired contents can be obtained according to the memory of when. Also in a database system, data can be browsed in order by, for example, displaying the date of birth.

However, in a file management system,
It is not clear whether the files displayed vertically adjacently on the list are very close in time or apart from each other. On the other hand, the user looks at the display of each date and time, and imagines the time interval in his / her head, closer or farther, farther and farther, and compares it with his / her own memory. Search for the file. FIG. 20 shows a conventional example of a file management system. Thus, the specified directory 2
1 can be arranged and displayed in the order of new date and time. However, it is necessary to look at each of the 22 date and time display columns to know how much date and time the data was created.

[0006] Even in the display on the database system, the next data is different from the data of a certain person displayed in the order of the date of birth, even if only one year old or ten years old is different. Is displayed. On the other hand, the user needs to confirm the date of birth for each data, and imagine the degree of the deviation in the mind. And it is even harder for the user to understand the general tendency that there are many people of a certain age and few people of a certain age. By displaying the date of birth by age, and by graphing them, we can finally grasp the overall trend.

[0007] In contrast to the above-described conventional techniques, a system for reproducing and displaying data so that a user can more intuitively grasp information on time included in the data is desired.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has an object to display data according to a user's sense of time and to reproduce audio data attached to each data icon in accordance with a sense of time. It is an object of the present invention to provide an information processing apparatus and method capable of performing the information processing.

[0009]

An information processing apparatus according to the present invention for achieving the above object has the following arrangement.
In other words, a securing means for securing a plurality of display areas corresponding to a predetermined time interval in chronological order, and an icon indicating each data in the display area secured by the securing means based on time information included in the data. And a reproducing unit that reproduces audio data associated with each of the icons arranged by the arranging unit based on an audio reproducing level of each of the plurality of display areas.

According to another aspect of the present invention, there is provided an information processing method comprising: a securing step of securing a plurality of display areas corresponding to a predetermined time interval in chronological order; An arranging step of arranging and displaying icons indicating respective data in a display area secured by the securing step; and arranging the icons in the arranging step based on a sound reproduction level of each of the plurality of display areas. A reproducing step of reproducing audio data associated with each icon.

[0011]

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

FIG. 1 is a diagram showing an example of the configuration of a personal computer system which is a platform on which the present embodiment can be implemented. In FIG. 1, reference numeral 301 denotes a computer system main body, 302 denotes a display for displaying data, 303 denotes a mouse as a typical pointing device, 304 denotes a mouse button, 305 denotes a keyboard,
Reference numeral 306 denotes a speaker that reproduces sound.

FIG. 2 is a diagram showing a configuration of a chronological reproduction and display system of data including software and hardware. In FIG. 2, reference numeral 509 denotes hardware,
An operating system (OS) 05 operates on the hardware 509, and an application software 504 operates on the OS 505. Note that, of the blocks constituting the hardware 509 and the OS 505, those blocks which are naturally included as constituent elements but are not directly required for describing the present embodiment are not shown here. Examples of such blocks (not shown) include a CPU as a hardware, a memory, and a memory management system as an OS.

In FIG. 2, reference numeral 515 denotes a hard disk for physically storing files and data, and 508 denotes an OS 50
5, which has a function that allows the application software 504 to input and output files without being aware of hardware. Reference numeral 514 denotes a disk I / O interface for the file system 508 to read from and write to the hard disk 515. Reference numeral 507 denotes a drawing management system included in the OS 505, which has a function of enabling the application software 504 to perform drawing without being aware of hardware.
Reference numeral 513 denotes the display management system 507 that the display 302
This is a video interface for drawing on a video.

Reference numeral 506 denotes an input device management system constituting the OS 505, which has a function of enabling the application software 504 to receive a user's input without being aware of hardware. Reference numeral 510 denotes a keyboard interface for the input device management system 506 to receive input from the keyboard 305, and mouse interface 512 denotes a keyboard interface for the input device management system 50.
Reference numeral 6 denotes a mouse interface for enabling input from the mouse 303 to be received. 501
Reference numeral denotes a data date / time order reproduction / display system, and reference numeral 502 denotes a date / time management unit for managing data in date / time order. 503
A data display unit displays data managed in order of date and time in order of time and at intervals.

Next, blocks related to audio reproduction will be described. The synthesized voice reproduction unit 522 manages reproduction of voice data associated with the image data displayed on the display 302. Further, when there are a plurality of audio data to be reproduced, the synthesized audio generation unit 522 generates output audio data by synthesizing the plurality of audio data in accordance with the reproduction level of each audio data, and performs audio management such that the output audio data is reproduced. Request to system 519. The audio management system 519 includes the audio interface 5
16 is controlled to reproduce the requested audio data. The audio interface 516 converts the electrical audio signal obtained by converting the audio data to be reproduced from a digital signal into an analog audio signal into an audio amplifier 51.
Send to 7. The audio amplifier 517 amplifies the electric audio signal to drive the speaker 306,
The sound signal propagates through the air as a physical sound and reaches the user's ear.

FIG. 3 is a block diagram showing an outline of a hardware configuration in the personal computer system of the present embodiment. In FIG. 1, reference numeral 101 denotes a CPU, which implements various controls in the personal computer system. A ROM 102 stores various control programs and data executed by the CPU 101. A RAM 103 operates as a main memory of the CPU 101. Reference numeral 104 denotes a bus connecting the above components.

The characteristic operation of the personal computer system according to the present embodiment having the above configuration will be described below.

FIG. 4 is a diagram showing a display example of this embodiment. A display window 1 is displayed on the display 302. In the display window 1, square data icons such as 3 and 4 represent image data.
Reference numerals 2 and 5 denote rings corresponding to dates and times associated with the image data. Image data associated with the date and time of the ring is arranged on these rings. The ring is headed toward the center of the screen toward the past or the future on a daily basis, and the larger the image data on the ring around the screen, the larger the image data is displayed. This allows
It expresses the depth where the periphery is in the foreground and the center is in the back. Further, at the upper left of the display screen 1, the date and time of the current attention (current attention date and time) corresponding to the bold line ring 5.
Is shown.

In this embodiment, each ring is in units of one day, but may be in units of two days or one week. If there are many data icons on one ring, the unit of the ring is changed to keep the number of data icons on the ring within a predetermined number. This processing will be described later with reference to FIGS.

In the above display mode, when the user wants to display the back image data larger, the user performs a zoom-in operation. As a result, the data icon is displayed larger, for example, continuously increases with the rings 2 and 5, and the rings 2 and 5 and the data icons 3 and 4 protrude from the frame of the screen and disappear. Conversely, when zooming out, the displayed ring and data icon are small,
In addition, they gather more at the center of the ring, and past or future data icons and rings appear from the outside of the screen.

When the user finds desired data, the original data file is opened in a separate window for editing by double-clicking the data icon. As described above, the date and time are set in the front and depth directions, and by continuously zooming in and out, the data is enlarged or reduced, and the displayed date and time is moved and displayed. .

In the file management system, by selecting a certain directory and designating switching to date and time display according to the present embodiment, the display is performed in a state where the date and time ring at that time is displayed on the foreground. . And by default, the back is the past direction, the front is the current direction,
This direction can be reversed by the user. If the desired image data is found, the image data file is opened in another window by double-clicking the displayed data icon with a mouse, and the contents of this file are confirmed or edited. be able to.

FIG. 5 is a diagram showing an example of zoom-in and zoom-out focusing on a certain ring and data icons belonging to the ring. Here, it is assumed that the back is the past date and time, and the date and time closer to the present is displayed as it comes closer. 40
a to 40d are display screens, 42a to 42d are rings indicating a certain date and time, and 41a to 41d are data icons on the rings (image data within the time zone indicated by the rings)
Is shown. As shown in FIG. 5, in the case of the zoom-in operation (continuously viewing past image data), 41
As shown in FIGS. a and 42a, they appear small in the center of the screen, and by continuing the zoom-in operation, 41b, 42b,
And 41c, 42c, and 41d, 42d are displayed large. In 41d, the data icon is displayed large and only a part is displayed. Thereafter, the image data disappears from the screen. When zooming out, the display is reversed.

In the case of the screen state of 40a, there is actually a larger ring outside the ring 42a, which is one step ahead of the ring 42a, which is a time zone in the future direction. There is a bigger ring that is a time zone in the future. In addition, in the case of the screen 40d, there is actually a smaller ring inside the 42d ring, which is a time zone one step past in the 42d ring, and inside that ring, a time zone one step further in the past direction. There are smaller rings that are. This allows
The display as shown in FIG. 1 is realized as a whole. In this way, by displaying the data icons in chronological order, displaying them, and continuously displaying them by zooming in and out, it is possible to realize image data display that is close to the user's memory feeling, and to display data from the time axis. It is possible to intuitively grasp the tendency of unity and the like.

In the present embodiment, if a large number of data exists during one day, it is necessary to display a large number of data icons on one ring. However, 1
Displaying many data icons on one ring is difficult to see. Therefore, in the present embodiment, the maximum number of data icons to be displayed on one ring is set to eight, and if there is a ring in which the number of data icons exceeds this number, the time unit is shortened and displayed. The user is notified that the time unit has been changed by the color (or density) of the ring. Hereinafter, this control will be described.

FIG. 6 is a conceptual diagram of the data structure in the present embodiment. 50 corresponds to one ring of the display,
Represents time zones separated by a fixed time interval. In the present embodiment, this is one day, and this time zone is called a cell. With respect to this cell, the image data 51 in the time zone of the cell hangs on the cell. At the time of display, a ring is drawn in cell units following this cell, and a data icon of image data of the cell is drawn on the ring. Then, according to the zoom-in / zoom-out operation, the cell array is advanced rightward or leftward to display a data icon.

At this time, if a large number of image data belong to a certain cell, in other words, a time zone of a certain cell, the portion is displayed slowly so that all the image data can be sufficiently confirmed. . Therefore, cells having image data larger than a predetermined value are divided into cells in a finer time zone. In FIG. 6, since there are many image data belonging to 10/7 cells (there are 16 data a to p), the image data is further divided into four cells every 6 hours. Among them, since 16 image data are concentrated in the cells at 12:00 to 18:00, this is further divided into cells for each time.

In this manner, the cells are divided until every 10 minutes, every minute, every second,... Until the number of image data belonging to one cell becomes equal to or less than a predetermined value (8 or less). At the time of display, as indicated by arrows, these hierarchical cells are traced and displayed. Since the display is performed at the speed of the cell unit, the portion where the image data is collected temporally is displayed slowly. In this embodiment, in order to explicitly indicate where time is slowly displayed to the user,
As the time division of cells becomes finer, the color of the ring becomes lighter.

FIG. 7 shows a data structure of a cell in this embodiment. Reference numeral 70 denotes a cell list in which data is arranged hierarchically. 71 is a cell attribute,
The attributes of the cell list 70 are shown. The cell attribute 71 has a cell level 71 for indicating which layer this cell belongs to.
-1 is stored. In FIG. 6, the cells on a daily basis are the basic cells, and thus are at the cell level 0, the cells every 6 hours are at the cell level 1, and the cells every 1 hour are at the cell level 2,. 71-2 is a cell unit (time interval) and stores the time interval of each cell in the cell list. For example, in a day unit cell (cell level 0), a cell unit 71
-2 is 24 hours, 6 hours every 6 hours, 1 every 1 hour
Time.

Reference numeral 71-3 denotes the number of cells, which indicates the number of cells included in the cell list. Reference numeral 71-4 denotes a ring color, which stores data indicating the ring color when the cell is drawn as a ring. In this example, the ring color is black (V (0) = 0) when the cell level is 0, and V (N) = (255−V (N−1)) / 2 each time the level increases. Set up.

Reference numeral 71-5 denotes a parent cell pointer, which stores a pointer for returning from the child cell list to the parent cell. At cell level 0, there is no parent, so nothing is entered in the parent cell pointer 71-5. The child cell attribute of the child cell list 76 described later includes a parent pointer to the cell 72a.

Next, the cells belonging to the cell list 70 are 72
a, 72b, 72c... First, the start time and the end time included in each cell, and the number of data (the number of image data) included in this cell are stored. Then, data information belonging to the image data list 73 is held. One data 74 includes a data icon 74-1, a path name 74-2 of image data, a data time 74-3, and an audio data path name 74-4 when there is audio data associated with the data. Have been.

The data icon 75a is a bitmap image obtained by reducing actual image data. Then, from the data path name, the image data file 7
5b. The data time 74-3 is the time when this data belongs to this cell, and is the data creation date and time or the data correction date and time in the file management system. The audio data path name 74-4 is a path name of an audio data file associated with the image data, and the audio data file on the disk can be referred to by the path name.

When the number of data is larger than a predetermined value (the maximum value of the number arranged in one ring), when adding new data to this data list, it is possible to know by checking the number of data. it can. In this example, when the number of data belonging to a cell becomes larger than 8, a child cell list 76 for further decomposing this cell is generated. The structure of the child cell list 76 is the same as the cell list described above.
0 is the same. When the child cell list is generated, the data contained in the cell is moved to the data list in the child cell at the data time 74-3 and erased from the cell 72a. Therefore, when there is a data list in a cell, there is no child cell list, and when there is a child cell list, there is no data list. The child cell attribute includes a value obtained by increasing the cell level by one, and a ring color that is a lighter color.

FIGS. 8 and 9 are views for explaining a state in which the data structure shown in FIG. 6 is stored in the cell structure shown in FIG. As shown in the drawing, the child cell list 6 corresponding to 12:00 to 18:00 is added to the cell 600 of 10/7.
10 are registered. In the child cell list 610, two child cells 602 and 603 are registered.
4 further includes a child cell list 604. The child cell 603 is
This is a cell corresponding to 17:00 to 18:00 and stores an image data list. In the child cell 603, image data a, b, c, and d are registered. Child cell list 604
Corresponds to 13:00 to 14:00, and the child cell 6
06. Then, the child cell 606 is further added at 13:40.
１３13: 50 is included. Hereinafter, a hierarchical structure is similarly formed by a plurality of cells.

FIG. 10 shows a state in which the data structure shown in FIGS. 8 and 9 is displayed on a ring. FIG. 10 shows a case where 10/7 is designated as the outermost ring. As described above, since there are more than eight image data in 10/7, display is performed by dividing into a plurality of rings. First, a cell 603 is extracted as a cell to be displayed on the outermost ring 701, and image data a, b,
The data icons c and d are displayed. Next ring 70
In cell 2, cell 607 in FIG. 9 is selected, and data icons of image data e, f, and g are displayed. The display size of the data icon on the ring 702 is smaller than the display size of the data icon on the ring 701.

Further, as described above, the ring density is gradually reduced from the cell levels 0 to 6 by the ring color 71-4 in the cell attribute 71. Therefore, the ring 7
01 is displayed in the darkest color in this display example.
The ring 701 has a time of 10/7 at 17:00 to 1
The image data belonging to 8:00 is displayed. Ring 70
2 indicates a minute unit below (13:46 to 13: 4
7), shown in two colors lighter than the ring 701. Since the rings 703 to 705 belong to the cell level 6, they all have the same darkness, but are two colors lighter than the ring 702. According to the display method described above, the user can view the image data in a sufficient time while recognizing a change in the time interval even in a portion having a large amount of image data.

As described above, it is determined whether the number of data belonging to a cell is larger than a predetermined value, which is determined on the basis of one ring. And the maximum number of data icons to be displayed. As shown in FIG. 1, in this embodiment, a maximum of eight pieces of data are placed on one ring. Therefore, in this case, the predetermined value is also 8.

Next, a display algorithm at the time of display will be described. FIG. 11 shows a data structure for display management. In the case of the zoom display, as shown in the display example of FIG. 11, the ring is moved in steps of 32 steps,
In the meantime, a ring is drawn every eight steps. The display step list 80 indicates the size and position of the ring in each step, the size of the data icon drawn on the ring, and the reproduction level of the associated audio data. This is a list corresponding to the previous 32 steps, and corresponds to 8 steps corresponding to each step.
1a, 81b... And step information are stored.

Each step information includes a ring rectangle 82 (upper left coordinates (x1, y1) and lower right coordinates (x2, y2)) of the step. Further, a data rectangle list 83 and an audio reproduction level 84 are included. The size of the ring is an ellipse that is in contact with the ring rectangle 82, and the size of the data icon is a size that inscribes the data rectangle in the data rectangle list 83 while maintaining the aspect ratio of the data icon. The number of data icons displayed on one ring is 8
, The data rectangle list 83 has eight data rectangles, each having size information including the display position.

The size of the ring and the size of the data icon display are set and stored so as to increase sequentially from the minimum ring to the maximum ring. As a result, the data icon is enlarged linearly,
You can make it appear that it suddenly becomes bigger in the middle, or make various settings. Further, by having a table such as the data rectangle list 83, when displaying the data icons, the size and position of the data icons need not be calculated during the zoom operation, and the zoom display can be smoothly performed.

FIG. 12 is a flowchart showing an algorithm for acquiring a cell to be displayed in the outermost ring. The date and time selected in step S01 are acquired. This is basically the date and time at that time, and if the user explicitly specifies the date and time, the date and time is the specified date and time. Next, step S02
Then, a cell list of cell level 0 is obtained as an initial value. In step S03, the time interval 71-2 in the cell list
Then, the start time of the first cell 72a is obtained. In step S04, the cell at the designated date and time is calculated from these pieces of information, and the cell is acquired in step S05. In this example, the cell 600 (FIG. 8) is obtained.

In step S06, it is checked whether or not there is a child cell in the cell. If there is a child cell, step S0
7 Get this child cell list. In this example, the child cell list 601 (FIG. 8) is obtained. In step S08,
Check whether there are any child cells in the obtained child cell list that do not include any further child cell lists. If there is no child cell that does not include the child cell list, the process returns to step S07, and the above processing is performed on all child cells in the child cell list. On the other hand, if a child cell having no child cell list is detected, the child cell is determined as a cell corresponding to the outermost ring. In this example, the child cell 60
3 (FIG. 8).

FIG. 13 is a flowchart showing a data icon display algorithm in this embodiment. In step S10, the count value is set to an initial value 0.
In step S11, cells to be displayed in the outermost ring acquired in the flowchart of FIG. 9 are held. Step S
At 12, the (count × 8) -th step information is obtained from the display step list. Initially count value = 0
Therefore, the content of the step information 0 indicated by 81a in FIG. 11 is obtained. In step S13, the ring rectangle 82 is obtained from the step information, and the ring color 71-4 of the cell is also obtained. Then, the drawing of the ring is performed using the obtained color of the ring color and the position and size of the obtained ring rectangle.

In step S14, the data icons are sequentially taken out of the cell data list, and the data icons are drawn at the drawing positions indicated by the data rectangles so as to fit within the size of the data rectangle 83. This means, for example, that a maximum of eight pieces are drawn in a clockwise order from the upper position. In this example, data icons for the data a, b, c, and d registered in the cell 603 are displayed.

Next, in step S15, the audio data path name 74-4 of the audio data associated with each image data included in the cell is all registered in the audio data file path of the audio data reproduction table. As an initial value, 0 is written as a reproduction point pointer of each audio data, and as the reproduction level, step information of count * 8th step is obtained from the display step list. Initially count value = 0
Therefore, the content of 81a step information 0 is obtained. From the obtained step information, an audio reproduction level is obtained and written in the reproduction level column of the audio data reproduction table.

In step S16, the count value is increased by one, and it is checked in step S17 whether the count value has reached the number of rings to be drawn at one time (five in this example). If the drawing of up to five has been completed, the process proceeds to step S21, and a request for reproducing the synthesized voice is issued to the synthesized voice reproducing unit 522. Then, in step S22, zoom in,
Step = 0 is set as a value used for zoom-out (described later with reference to FIGS. 15 and 16), and the process ends.

On the other hand, if it is determined in step S17 that the number of rings to be drawn at one time has not been displayed, the process proceeds to step S17.
Then, the process proceeds to step S18, where it is checked whether or not the current drawing is the end of the current cell list. If it is not the end of the cell list, the process proceeds to step S18, and the next cell in the cell list is obtained. For example, in FIG. 8, when the display of the cell 603 is finished, the cell list 601 is checked, and an unprocessed child cell 602 is selected. The same processing as in FIG. 12 is performed on the child cell 602 to extract a cell to be the outermost cell. Then, the process returns to step S12, and the above-described processing is repeated. As a result, the cell 607 is selected and displayed on the next ring.

On the other hand, if it is determined in step S18 that the current cell list is at the end, the process proceeds to step S20.
Proceed to. In step S20, the parent cell pointer 71-5
To return to the parent cell and get the next cell in the cell list. Then, the process returns to step S12.

In step S12, since the count value is the eighth step information, the eighth step information is obtained. This is because the display is performed at intervals of 8 steps for each ring. Thereafter, the above-described processing is repeated. Thus, the first sound reproduction and drawing are performed. The procedure for reproducing the synthesized voice by the synthesized voice reproducing unit will be described later.

FIG. 14 is a diagram showing the data structure of the audio data reproduction table. The registration of the data in the audio data reproduction table is performed in step S15 described above. The audio data playback table lists the file path names of the audio data currently being played back, and stores a playback location pointer indicating the current playback location of each audio data, and a playback level indicating the level at which each audio data is played back. Is done. The audio data reproduction table is updated each time the image data is redisplayed, and is used when the synthetic audio reproduction unit 522 generates the synthetic audio.

Next, an algorithm during the zoom operation will be described. FIG. 15 is a flowchart showing a control procedure in the zoom-in operation. In the present embodiment, the user can switch the zoom-in / out speed to eight levels, and designate this at the position of the mouse cursor. Note that while the left button of the mouse 303 is pressed, the zoom in is performed.
Zoom out while pressing the right button. Also,
If the position of the mouse cursor during this operation is in the center of the screen, the zoom change speed is high, and if it is in the vicinity, the zoom change speed is low.

First, in step S30, the zoom change speed is calculated. In this example, when the value of skip that determines the speed of change in zoom is d, the distance from the center of the window 1 at the cursor position is skip = 8−
Int ((d / distance from center to end) × 8).

In step S31, it is determined whether the left button or the right button of the mouse 303 has been pressed. If the left button has been pressed, it means that the user has zoomed in.
Proceed to step S32. Otherwise, zoom-out processing is performed, and the zoom-out processing in step S50 is performed. Since this is the reverse of the zoom-in process from step S32, it will be briefly described later.

Steps S32 to S43 are performed as shown in FIG.
Is basically the same as the processing from step S10 to step S20. The difference is that in step S34, (cou
(nt × 8-step) -th rendering and the refreshing of the audio data reproduction table in step S38.

Variable "step" used in step S34
Has an initial value of 0 from step S22 in FIG.
In accordance with this zoom operation, the following steps S44 to S4
By the processing of 6, the skip is incremented. By the unit of the speed (skip) specified by this,
The data will be zoomed. Step S34
If the (count.times.8-step) -th is smaller than 0, the outermost ring has disappeared from the screen, and the cell is not drawn for the outermost ring without performing the step S49.
Proceed to. In step S49, the audio data file associated with the image data on the outermost ring is deleted from the audio data reproduction table.

On the other hand, in step S34, (cou
If (nt × 8-step) is 0 or more, step S3
Then, in steps S35 to S43, all the rings and data icons to be displayed are displayed. In step S38, the audio data reproduction table is refreshed. That is, the audio data file path associated with the image data included in the current cell is obtained from the cell, and this is compared with the audio reproduction table. If the audio data file path does not exist in the audio reproduction table, Adds the audio data file path to the list and rewrites or writes the reproduction level of each audio data included in the cell to the audio reproduction level included in the new step information. When a new audio data file is written, 0 is written as the initial value of the reproduction location.

In steps S44 to S47, processing for the next zoom operation is performed. First, step is skip
Increased in units. Therefore, when the cursor is at the center of the screen, skip = 8, and the step increases by 8 units. When the cursor is at the end, skip = 1, and the cursor advances one step at a time. Thus, the user can easily view the data at a desired zoom speed according to the appearance of the data. If it is desired to take a closer look, release the mouse button, and no event occurs in the flowchart of FIG. 15, so that the user can take a closer look without updating the display.

If the step is equal to or greater than 8 in step S45, the remainder obtained by dividing step by 8 in step S46 is referred to as st.
ep. Then, in step S47, the cell of the outermost ring is shifted to the next cell, and the process proceeds to step S48. As a result, the outermost ring obtained in step S33 is the next cell. On the other hand, at step S45, st
If ep is smaller than 8, the process proceeds directly to step S48. In step S51, the synthesized voice reproducing unit 52
2 is notified that the audio data reproduction table has been refreshed. Synthesized voice reproduction unit 522 receiving this
Reproduces synthesized speech based on the refreshed table, the details of which will be described later. Step S
After the notification is made at 48, the process waits for an event. if,
When the left mouse button is kept pressed, the same event occurs immediately and the above processing is repeated.

Next, the difference between the zoom-out processing and the zoom-in processing will be described. FIG. 16 is a flowchart showing the procedure of the zoom-out processing. Basically, the reverse of the zoom-in process is performed, but the difference is as follows.

In step S61, (count × 8 + s
If the (step) th is 32 or more, the ring is too small to be displayed, and the process proceeds to step S63. Step S63
Then, after deleting the audio data file associated with the image data in the cell from the audio data reproduction table, the process proceeds to step S39. (Count × 8 + step) is 3
If it is less than 2, the process proceeds to step S62, and (count
(* 8 + step) -th step information is acquired.

When step 8 becomes 8 or more in preparation for the next zoom-out processing after step S44, step S6 is performed instead of step S47 in FIG.
Execute Step 2. That is, at the time of zooming out, the cell of the outermost ring is newly set to the immediately preceding cell.

Next, some preferred embodiments will be described as the values of the audio reproduction level stored as the step information in each display step. The sound reproduction level in each display step may be any. However, as one embodiment, there is an example in which the sound reproduction level is linearly increased as the ring becomes larger. According to this embodiment, the volume of the associated audio data increases as the image data expands due to the zoom-in operation, so that the sense of zoom-in as the image approaches can be obtained from both visual and auditory senses. .

FIG. 17 is a diagram showing the relationship between the display step and the audio reproduction level. In this example, the audio reproduction level (maximum 10) in each step (step 0 to step 32)
0) linearly increases from step 0 to step 32.

FIG. 18 is a flowchart showing a procedure for reproducing a synthesized voice in the present embodiment. When the synthesized voice reproduction unit 522 receives a synthesized voice reproduction request by the process of step S21 in FIG. 13, the process is started. When receiving the request for reproducing the synthesized voice, the synthesized voice reproducing unit 522 starts the process from step S71. First, step S71
With reference to the audio reproduction table, each audio data described in the table is reproduced at the reproduction level described in the table from the reproduction position pointer of the table recording. The synthesized voice reproducing unit 522 also has a unit for synthesizing a plurality of voices for simultaneously reproducing a plurality of voices. Although the details are not particularly described, they may be the same as those of a generally performed synthesis processing of a plurality of voices.

Next, in step S72, it is determined whether or not a refresh notification (step S48 in FIGS. 15 and 16) has been received. If there is a refresh notification, it means that the audio data to be reproduced has been changed or the reproduction level at the time of reproducing each audio data has been changed.
After overwriting the current reproduction location of each audio data in the table at 76, the flow returns to the step S71 to resume the audio reproduction according to the audio reproduction table.

If there is no refresh notification in step S72, the process proceeds to step S73. In step S73, it is determined whether or not there is audio data reproduced to the end. If there is any audio whose reproduction has been completed, the process proceeds to step S74, and the audio data whose reproduction has been completed is deleted from the audio reproduction table. Then, the process proceeds to step S75.

In step S75, it is determined whether or not the user has made a request for terminating audio reproduction. If there is a request to end the sound reproduction, the process proceeds from step S75 to FIG.
Is ended. On the other hand, if there is no end request, step S is executed again to continue sound reproduction.
It returns to the process of 72.

According to the data reproduction / display system shown in the above embodiment in a time sequence, image data can be browsed continuously in a time sequence. Further, since the audio data associated with the image data is reproduced at a high volume with the enlargement of the image, audio reproduction suitable for the present search method is performed.

In the above embodiment, the display step and the reproduction level are changed linearly as shown in FIG. 17, but the present invention is not limited to this. For example, if the display step rapidly increases as the display step approaches 0, the sound associated with the image data displayed in front can be reproduced relatively louder.

Further, in the above embodiment, the sound associated with the displayed data icon is deleted once from the data table when reproduced once, but each sound data may be repeatedly reproduced.

Further, in the above embodiment, the audio data associated with the displayed data icon is reproduced simultaneously, but the audio associated with the desired data icon designated by the mouse may be reproduced. In this case, if another data icon is instructed during reproduction of the audio data associated with the instructed data icon, 2
The audio data corresponding to the two data icons are reproduced simultaneously at the respective reproduction levels.

In the above embodiment, the data icons are arranged based on the date and time when the image data file was created. However, it goes without saying that the present invention is not limited to this. For example, a data icon indicating each record may be arranged using a time data field of a database (such as a data field of date of birth data in personnel management data). Further, the arrangement shape of the data icons is not limited to the ring shape, and various modifications such as concentric squares are possible.

As described above, according to the present embodiment, the data is arranged in chronological order, and the display and the sound reproduction are performed in consideration of the time interval, so that the time can be grasped sensuously.

Further, according to the above-described embodiment, not only is it possible to search for and display predetermined desired data, but also to lengthen the entire data to pick up favorite data from the data or to collect the entire data. Realize a highly flexible search and display system that can be used to grasp trends, etc. Further, by setting the reproduction of the audio data associated with the image to a high volume with the enlargement of the image and a low volume with the reduction of the image, the audio reproduction suitable for the image display method is performed and the search efficiency is further improved. is there.

Even if the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus (for example, a copying machine, a facsimile machine) comprising one device Device).

Further, an object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or the apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts. Each module shown will be stored in a storage medium. That is, at least the program code of each of the “securing processing module”, “arrangement processing module”, and “reproduction processing module” may be stored in the storage medium.

Here, the securing processing module is a program module that executes securing processing for securing a plurality of display areas corresponding to predetermined time intervals in chronological order.
Further, the arrangement processing module implements an arrangement processing of arranging and displaying icons indicating respective data in the display area secured by the securing processing based on time information included in the data. Further, the reproduction processing module, based on a sound reproduction level of each of the plurality of display areas,
A reproduction process for reproducing audio data associated with each icon arranged in the arrangement process is realized.

[0085]

As described above, according to the present invention,
It is possible to display data according to the user's sense of time, and to reproduce audio data attached to each data icon in accordance with the sense of time.

[0086]

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an example of a configuration of a personal computer system which is a platform on which the embodiment can be implemented.

FIG. 2 is a diagram showing a configuration of a chronological reproduction and display system of data including software and hardware.

FIG. 3 is a block diagram showing an outline of a hardware configuration in the personal computer system of the embodiment.

FIG. 4 is a diagram showing a display example of the embodiment.

FIG. 5 is a diagram illustrating an example of zoom-in and zoom-out focusing on a certain ring and data icons belonging to the ring.

FIG. 6 is a conceptual diagram of a data structure in the present embodiment.

FIG. 7 is a diagram showing a data structure of a cell according to the embodiment.

8 is a diagram illustrating a state in which the data configuration illustrated in FIG. 6 is stored in the cell structure illustrated in FIG. 7;

FIG. 9 is a diagram illustrating a state in which the data configuration shown in FIG. 6 is stored in the cell structure shown in FIG. 7;

FIG. 10 is a diagram showing a state where the data configuration shown in FIGS. 8 and 9 is displayed on a ring.

FIG. 11 is a diagram showing a data structure for display management.

FIG. 12 is a flowchart illustrating an algorithm for acquiring a cell to be displayed in the outermost ring.

FIG. 13 is a flowchart illustrating a display algorithm of a data icon according to the present embodiment.

FIG. 14 is a diagram showing a data configuration of an audio data reproduction table.

FIG. 15 is a flowchart illustrating a control procedure in a zoom-in operation.

FIG. 16 is a flowchart illustrating a procedure of a zoom-out process.

FIG. 17 is a diagram showing a relationship between a display step and a sound reproduction level.

FIG. 18 is a flowchart showing a procedure for reproducing a synthesized voice in the embodiment.

FIG. 19 is a diagram showing a data configuration of a general personnel management database.

FIG. 20 is a diagram showing an example of file display by a general file management system.

FIG. 21 is a diagram showing an example of a memory map of a storage medium storing a control program according to the present invention.

Claims (17)

[Claims] 1. A securing means for securing a plurality of display areas corresponding to a predetermined time interval in a chronological order, and displaying each data in the display area secured by the securing means based on time information included in the data. Arranging means for arranging and displaying icons; and reproducing means for reproducing audio data associated with each of the icons arranged by the arranging means based on an audio reproducing level of each of the plurality of display areas. An information processing apparatus characterized by the above-mentioned. 2. The method according to claim 1, wherein the plurality of display areas are on an outer periphery of a plurality of closed figures corresponding to a predetermined time interval, and the plurality of closed figures are arranged concentrically. An information processing apparatus according to claim 1. 3. The information processing apparatus according to claim 2, further comprising an outer peripheral display unit that displays outer peripheral lines of the plurality of closed figures. 4. The information processing apparatus according to claim 1, wherein the reproducing unit holds level information indicating a reproduction level when reproducing the audio data for each of the plurality of display areas. 5. The information processing apparatus according to claim 4, wherein the level information is set such that the newer the time indicated by the plurality of display areas, the higher the reproduction level. 6. The information processing apparatus according to claim 5, wherein the relationship between the reproduction level and the display area in the level information is substantially linear. 7. The reproducing means converts the audio data associated with the icon displayed on the display means into an audio reproduction level assigned to each of the plurality of display areas.
The information processing apparatus according to claim 1, wherein the information is reproduced substantially simultaneously. 8. A changing means for changing a time interval allocated to the plurality of display areas in a future direction or a past direction by a predetermined operation, and a time of the plurality of display areas changed by the changing means. Based on the interval and the time information contained in the data,
2. The apparatus according to claim 1, further comprising: a re-output unit that rearranges and displays each icon on a corresponding display area and reproduces audio data associated with each icon at a reproduction level of a new display area. The information processing apparatus according to any one of claims 1 to 7, 9. A securing step of securing a plurality of display areas corresponding to a predetermined time interval in a time sequence, and displaying each data in the display area secured by the securing step based on time information included in the data. An arrangement step of arranging and displaying icons; and a reproduction step of reproducing audio data associated with each of the icons arranged in the arrangement step, based on an audio reproduction level of each of the plurality of display areas. An information processing method, comprising: 10. The method according to claim 9, wherein the plurality of display areas are on the outer periphery of a plurality of closed figures corresponding to a predetermined time interval, and the plurality of closed figures are arranged concentrically. The information processing method described. 11. The method according to claim 10, further comprising the step of displaying an outer peripheral line of the plurality of closed figures.
An information processing method according to claim 1. 12. The information processing method according to claim 9, wherein said reproducing step holds level information indicating a reproduction level when reproducing the audio data for each of said plurality of display areas. 13. The information processing method according to claim 12, wherein the level information is set such that the newer the time indicated by the plurality of display areas, the higher the reproduction level. 14. The information processing method according to claim 13, wherein the relationship between the reproduction level and the display area in the level information is substantially linear. 15. The reproducing step substantially reproduces audio data associated with the icon displayed in the displaying step at an audio reproducing level assigned to each of the plurality of display areas. Claim 9
An information processing method according to claim 1. 16. A changing step of changing a time interval allocated to the plurality of display areas in a future direction or a past direction by a predetermined operation, and a time of the plurality of display areas changed in the changing step. Based on the interval and the time information contained in the data,
10. A re-outputting step of rearranging and displaying each icon in a corresponding display area and reproducing audio data associated with each icon at a reproduction level of a new display area. 16. The information processing method according to any one of claims 15 to 15. 17. A computer-readable memory storing a control program for displaying an icon indicating a plurality of data, comprising: a code for a securing step for securing a plurality of display areas corresponding to a predetermined time interval in a time sequence. A code of an arrangement step of arranging and displaying icons indicating respective data in the display area secured by the securing step based on time information included in the data; and a sound reproduction level of each of the plurality of display areas. A code for a reproducing step of reproducing audio data associated with each of the icons arranged in the arranging step based on the above.