JPH1055260A - Multi-task management system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acoustically and immediately recognize the operation conditions of a saved task by allocating a sound source position in a three-dimensional sound field, generating the three-dimensional sound field to which the sound source position is allocated when prescribed conditions are satisfied and outputting the sound satisfying the prescribed conditions. SOLUTION: A sound field position allocation means 32 allocates the sound source position in the three-dimensional sound field for outputting sound when the prescribed conditions are satisfied in a saved state for a task saved from the display screen of the display 17 of two-dimensional display. A three- dimensional sound field generation means 30 generates the three-dimensional sound field to which the sound source position is allocated when the prescribed conditions are satisfied in the task saved in the state where the operation screen of a certain task is displayed on the display screen. Further, a sound output means 31 outputs three-dimensional sound field sound including sound output from the sound source position generated by the three-dimensional sound field generation means 30. Thus, based on a direction from which the sound satisfying the prescribed conditions is originated, an operator acoustically, immediately and easily recognizes the operation conditions of the saved task.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to a multitask management system using a three-dimensional sound field system. The present invention also relates to a multitask management system in which a three-dimensional sound field system is combined with a virtual screen system for virtually displaying an operation screen of a task of an arbitrary program of a computer.

[0002]

2. Description of the Related Art As a device for displaying a three-dimensional space, a small display is mounted inside goggles set on the head, and a virtual (virtual) three-dimensional space constructed by a computer is visually recognized. There is a head mounted display (HMD) that allows you to experience it.
However, this is usually applied to games and the like, and is not suitable as a practical display when performing general tasks using a computer. This is because, while looking at the screen, an input operation must be performed with a keyboard, a mouse, and the like, and other operations and operations must be performed at any time.

[0003] Thus, practical displays used to perform common tasks using a computer are conventional two-dimensional displays such as CRTs and LCDs.

When a computer performs multitasking, a task of a certain program is executed while being displayed on the screen of a two-dimensional display, while a task of another program is not displayed on the screen, or the execution of a main program is performed. Run it hidden in the screen display. In this case, a virtual screen system that secures the operation screen of the non-display task on a virtual screen that is not displayed on the screen has already been developed. That is, a memory having a capacity larger than that required for normal program execution and screen display is used as the memory, and not only one task is processed on the memory, but also one or more other tasks are substantially performed. Since one of the plurality of tasks is displayed on the screen of the two-dimensional display and the other task is saved in an appropriate virtual task area of the virtual screen. is there.

FIG. 17 shows an example. In FIG. 17, reference numeral 51 denotes a display screen of a two-dimensional display, and 52 denotes a virtual screen having eight virtual task areas 52a to 52h developed around the two-dimensional display screen 51. In the illustrated example, the operation screen of the execution state of the word processor task T1, which is one of the programs, is displayed on the two-dimensional display screen 51 as it is. This is visible to the operator.

In the virtual task area 52, a virtual task area 52d corresponding to the left side of the two-dimensional display screen 51 virtually displays an execution state operation screen of an e-mail task T2 which is one of the programs. In a virtual task area 52e corresponding to the right side of the two-dimensional display screen 51, an operation screen of an execution state of a task T3 of television broadcast decoding, which is one of the programs, is virtually displayed. In the virtual task area 52b corresponding to the upper side of the two-dimensional display screen 51, an operation screen of the execution state (for example, downloading software and information data) of the task T4 of the personal computer communication, which is one of the programs, is virtually displayed. . The operation screen of the execution state of the task in these virtual task areas cannot be visually recognized by the operator.

By operating an input means such as a keyboard and a mouse, an arbitrary task on the virtual screen 52 is displayed on the two-dimensional display screen 51 instead of the task currently displayed on the two-dimensional display screen 51. Can be done easily. For example, in FIG.
The task T1 of the word processor displayed on the two-dimensional display screen 51 is evacuated to, for example, the virtual task area 52a, and instead, the task T2 of the e-mail that was in the virtual task area 52d is displayed on the two-dimensional display screen 51. Can be easily realized.

On the other hand, a three-dimensional sound field system has already been developed as, for example, a television surround system.
This is because the sound from the sound source can be heard virtually from above, as if there is a sound source above the user's head, or as if the sound source is on the right side of the user's head. Technology that allows the sound from the sound source to be heard from the right side virtually, and that the sound from the sound source is virtually heard from the left side as if the sound source is on the left side of the user's head It is.

[0009]

However, in the virtual screen system shown in FIG. 17 according to the prior art, the operator can visually check the current task status only when the task displayed on the two-dimensional display screen 51 is displayed. Of the virtual task area 52 of the virtual screen 52.
The current execution state of the tasks saved in a to 52h cannot be visually confirmed.

For example, as shown in FIG. 18A, the operation screen of the execution state of the task T2 of the e-mail is displayed on the two-dimensional display screen 51, and FIG.
As shown in (b), when the display is switched to a state in which the operation screen of the execution state of the word processor task T1 is displayed on the two-dimensional display screen 51, the e-mail task T2 is saved in one of the virtual task areas. And an e-mail icon i is displayed at the corner or side of the two-dimensional display screen 51.
2 is displayed, and the word processor task T1 is displayed on the two-dimensional display screen 51. When the mouse is used to move the cursor to the icon i2 and click the mouse, the task T1 of the word processor is saved in one of the virtual task areas, and the task T2 of the e-mail saved in the virtual task area is saved. It returns to the two-dimensional display screen 51 and is displayed.

However, when the task T1 of the word processor shown in FIG. 18B is being executed, the operator does not know at all when the e-mail has arrived. Except for the case, it is unlikely that the display is switched from the word processor task T1 to the e-mail task T2. Therefore, after all, the word processing task T
1 is not being executed, and the task T2 of the e-mail is returned to the two-dimensional display screen 51 after the task T1 of the word processor is completed. In this sense, it was not very convenient.

When one or more tasks are saved in the virtual task area while the execution state of a task is displayed on the two-dimensional display screen 51, A saved task list indicating whether the saved task is saved in the virtual task area must always be displayed on the side of the two-dimensional display screen 51. Then, the operator can visually confirm the evacuation task list to know what task is evacuation. The constant display of the evacuation task list reduces the display area of the tasks displayed on the two-dimensional display screen 51. Furthermore, unless the operator visually checks the evacuation task list, the operator cannot know what the evacuation task is. In this sense, it was not easy to use.

Further, when the operator determines whether or not the execution of the evacuation task has been completed, an end message of the execution of the evacuation task must be displayed in association with the displayed evacuation task list. The system becomes complicated.

By the way, in the conventional multitask management system, there is no idea of using the three-dimensional sound field system for confirming the operation status of the saved program task.

The above two elements, namely, 3
There was no idea to combine a three-dimensional sound field system with a virtual screen system that virtually displays an operation screen of a task of an arbitrary program of a computer.

An object of the present invention is to provide a multitask management system which can confirm the operation status of a saved program task using a three-dimensional sound field system. In addition, by combining the two elements that were not considered in the conventional combination, namely, the three-dimensional sound field system and the virtual screen system that virtually displays the operation screen of the task of an arbitrary program of the computer, It is an object of the present invention to provide a multitask management system capable of immediately recognizing a task execution state on a virtual screen and a save destination of a save task even when a two-dimensional display is used as a display device.

[0017]

A multitask management system according to the present invention provides a multitask capable of simultaneously executing a plurality of program tasks, wherein a task to be saved from a display screen of a two-dimensional display is determined in a saved state. A sound source position at which a sound that satisfies the condition is to be emitted is allocated in a three-dimensional sound field, and when the predetermined condition is satisfied, a three-dimensional sound field to which the sound source position is allocated is generated to output a sound that satisfies the predetermined condition. Therefore, if the operator remembers which position of the sound source is assigned to which evacuation task, while using the planar two-dimensional display, the operator does not display on the screen the condition satisfying the predetermined condition for the evacuation task. However, based on the direction in which the sound that satisfies the predetermined condition is heard, the operator can immediately and audibly determine the operation status of the evacuation task. It is possible to easily recognize and, for example, among the atmosphere sounds in which the sound of a television program or the like or the conversation of a person can be heard, it is possible to clearly distinguish the atmosphere sound and the sound satisfying a predetermined condition. .

Further, the multitask management system according to the present invention combines a three-dimensional sound field system and a virtual screen system, and designates an arbitrary one of a plurality of virtual task areas on a virtual screen when retreating a task. Then, a sound source position at which a sound that satisfies a predetermined condition in the evacuation state in the evacuation state is allocated in the direction of the virtual task area, which is the evacuation destination of the evacuation task based on the display screen, that is, the task evacuation position and the sound source position And the sound source position is allocated when the predetermined condition is satisfied.
Since it is configured to generate a three-dimensional sound field and output a sound that satisfies a predetermined condition, a sound that satisfies a predetermined condition for the evacuation task is heard from the direction of the virtual task area where the evacuation destination is specified. . Therefore, the operator does not need to remember which position the sound source is allocated to which evacuation task, but only the tone color of the sound satisfying the predetermined condition for each task. While using the three-dimensional display, and without displaying the predetermined condition satisfaction state for the evacuation task on the screen, the operator can auditorily determine the operation status of the evacuation task based on the direction in which the sound of the predetermined condition satisfaction is heard. It can be instantly and easily recognized, and, for example, in the atmosphere sound in which the sound of a television program or the like or the conversation of a person is heard,
It is possible to clearly distinguish the sound satisfying the predetermined condition from the atmosphere sound.

[0019]

A multitask management system according to a first aspect of the present invention is a multitask capable of simultaneously executing a plurality of program tasks, wherein a task to be saved from a display screen of a two-dimensional display is saved. Sound field position allocating means for allocating a sound source position in a three-dimensional sound field to be output when predetermined conditions are satisfied, and evacuating the display screen while an operation screen of another task is displayed on the display screen. A three-dimensional sound field generating means for generating a three-dimensional sound field to which the sound source position is allocated when a predetermined condition is satisfied in the task, and a method for generating a three-dimensional sound field from the sound source position generated by the three-dimensional sound field generating means. Sound output means for outputting a three-dimensional sound field sound including a sound output.

In the multitask management system according to the first aspect, when a predetermined condition is satisfied in the program task saved from the display screen of the two-dimensional display and a sound indicating that condition is to be emitted, a three-dimensional sound is generated in advance. Since the sound source positions in the field are assigned and the operator remembers which position the sound source is assigned for which evacuation task, for example, it is not a three-dimensional display such as a head mounted display (HMD) but a planar one. While using a simple two-dimensional display, and without displaying the predetermined condition satisfaction state of the evacuation task on the screen, the operator can hear the operation status of the evacuation task based on the direction in which the sound of the predetermined condition satisfaction is heard. Can be immediately and easily recognized. Also, for example, even among the ambient sounds in which the sound of a TV program or the like or the conversation of a person is being heard, it is possible to clearly distinguish the ambient sound from the sound that satisfies a predetermined condition. Can be recognized. In other words, the constraints of the two-dimensional display are compensated for by the three-dimensional sound field system, and the operability of multitasking is greatly improved.

A multitask management system according to a second aspect of the present invention is a multitask management system capable of simultaneously executing a plurality of program tasks. A virtual task area divided into virtual task areas, and a virtual task area of a plurality of virtual task areas of the virtual screen when retreating a task whose operation status is displayed on the display screen. Virtual screen information holding means for holding information of a task saved by designating a sound source, and a sound source position in a three-dimensional sound field to be outputted as a sound when the saved task satisfies a predetermined condition, by a relative positional relationship. Sound field position allocating means for allocating in the direction of a virtual task area that is a save destination of the save task with reference to the display screen, and A three-dimensional sound field generating means for generating a three-dimensional sound field to which the sound source position is assigned when predetermined conditions are satisfied in the task saved in a state where an operation screen of another task is displayed in This 3
Sound output means for outputting a three-dimensional sound field sound including a sound output from the sound source position generated by the three-dimensional sound field generation means.

In the multitask management system according to the second aspect, when a task whose operation status is displayed on the display screen is saved, any of the plurality of virtual task areas on the virtual screen in the virtual screen information holding means is saved. The task information is saved and held in the area, and the sound source position in the three-dimensional sound field for outputting sound when a predetermined condition of the save task is satisfied is a save destination of the save task based on the display screen. Since the assignment is made in the direction of the virtual task area, the sound that satisfies the predetermined condition for the evacuation task is heard from the direction of the virtual task area in which the evacuation destination is specified. Therefore, the operator does not need to remember the position of the sound source assigned to which evacuation task, but only the tone of the sound that satisfies the predetermined condition for each task. While using a planar two-dimensional display instead of a three-dimensional display such as a display (HMD), and without displaying a predetermined condition-satisfied state of the evacuation task on the screen, a sound of the predetermined condition-satisfied is heard. Based on the coming direction, the operator can immediately and easily recognize the operation status of the evacuation task audibly and easily, and can also determine the direction of the evacuation task in the virtual task area on the virtual screen. It can be perceived instantaneously and easily. In other words, a virtual screen that virtually displays an operation screen of an evacuation task when an arbitrary program task of the three-dimensional sound field system and the computer is evicted, which is two elements that were not considered in combination in the related art. Combined with the system, the evacuation position of the evacuation task on the virtual screen and 3
Since the sound source position of the sound satisfying the predetermined condition in the three-dimensional sound field is associated, the operation status of the evacuation task and the subsequent operation can be extremely easily performed.

Hereinafter, specific embodiments of the multitask management system according to the present invention will be described in detail with reference to the drawings.

[First Embodiment] FIG. 1 is a block diagram showing a configuration of a multitask management system according to a first embodiment. In FIG. 1, reference numeral 11 denotes a control means (CPU);
Is a program storage means (ROM) storing a program for operating the computer system;
Is a working storage means (RAM), 14 is an external storage means such as a hard disk, 15 is a display control means, 16 is a frame buffer, 17 is a two-dimensional display such as a CRT or LCD, 18 is a floppy disk or a magneto-optical disk Disk drive, 19 is CD-RO
M drive, 20 a television receiving means, 21 a video signal decoder, 22 a video reproducing means, 23 a video signal decoder, 24 an NCU (network control unit), 25 a modem controlled by the NCU 24, 2
6 is a telephone line, 27 is a network interface, 2
Reference numeral 8 denotes a network line, 29 denotes input means such as a keyboard and a mouse, 30 denotes a three-dimensional sound field generating means, 31 denotes sound output means such as a speaker and headphones, 32 denotes sound field position allocating means, and 33 denotes a bus connecting each unit. It is.

The sound field position allocating means 32 outputs a sound source position in a three-dimensional sound field to be outputted when a predetermined condition is satisfied in a retracted state for a task to be retracted from the display screen 51 of the two-dimensional display 17. Is assigned. That is, for example, when the e-mail task is withdrawn from the display screen 51, a ring tone is output when an e-mail is received in the evacuation state, and the sound source position of the ring tone is set to the three-dimensional sound field 41 ( (See FIGS. 6 and 7) or output an end sound when software and information data download is completed in the save state when the task of PC communication is saved from the display screen 51 or the task of personal computer communication is saved from the display screen 51. However, the sound source position of the end sound is assigned to an appropriate position in the three-dimensional sound field 41.

The three-dimensional sound field generating means 30 includes a display screen 51
And generating a three-dimensional sound field to which the sound source position is assigned when predetermined conditions are satisfied in the task saved in a state where an operation screen of a certain task is displayed. The sound output means 31 outputs a three-dimensional sound field sound including a sound output from the sound source position generated by the three-dimensional sound field generation means 30.

Next, the operation of the multitask management system according to the second embodiment configured as described above will be described with reference to the flowcharts of FIGS. All of the basic controls are performed by the control unit 11 that operates according to the program stored in the program storage unit 12. Control means 11
Initializes (initializes) each flag and register in step S1, and displays the display control means 1 in step S2.
5 to display a program selection screen on the display 17 via the frame buffer 16. The operator selects any program task i ₁ by operating the input means 29 while watching a program selection screen. This allows
To start the program tasks i ₁ in step S3. A plurality of programs are installed in the external storage means 14 in advance, and the program of the task i ₁ selected from the external storage means 14 is read into the working storage means 13 by selecting a program task. Step S
Flag F indicating that it has started the task i ₁ in 4
(I ₁₎ To set the data "FF _H" (F (i ₁₎ ←
FF _H ). “FF _H ” indicates that the task is in the activated state.

The sound source define the location of the sound source in a three dimensional sound field when a predetermined condition when retracted this task i ₁ for task i ₁ is satisfied to be an audio output in step S5 position variable A the (i ₁₎ Set. This sound source position is
As shown in FIG. 6, the three-dimensional sound field 41, which is the space around the display 17, is divided into left and right, upper, diagonally upper left, and upper right, and the diagonally upper left 41a and upper 41b of the sound field, respectively.
The sound field diagonally upper right 41c, the sound field left 41d, and the sound field right 41e. As shown, sound field numbers (1) to (5) are assigned to the respective sound fields. Sound source position variable A (i
_In setting ₁ ), any of the five sound field portions indicated by the sound field numbers (1) to (5) may be selected. However, it is better for the operator to temporarily store which sound source position has been set for which task. Any one of the sound field numbers (1) to (5) is represented by j. In step S5, this is changed to A
(I ₁ ) ← j. Where j = 1, 2, 3,
One of 4,5. This sound source position variable A
The setting of (i ₁ ) is performed by operating the input unit 29. For example, a numerical value may be input from the keyboard, or a drag operation may be performed with the mouse in the retreat destination direction.

Next, the operation screen for the task i ₁ and displayed on the display 17 proceeds to step S6, performs the processing of the task i ₁ in step S7.

When the selected task is a word processor, a word processor program previously stored in the external storage means 14 is read into the working storage means 13, and the display control means 15 inputs the information from the input means 29 on the display 17. The generated character strings and graphics are displayed, and the created text data and graphics data are stored in a floppy disk or the like through the external storage means 14 or the disk drive 18. If the selected task is an e-mail, the e-mail program stored in the external storage means 14 is read into the working storage means 13 to execute the e-mail processing. When transmitting an electronic mail, transmission is performed from the modem 25 via the telephone line 26 under the control of the NCU 24.
When the selected task is a personal computer communication, a personal computer communication program stored in advance in the external storage means 14 is read into the working storage means 13 and the NCU 2
Under the control of 4, bidirectional personal computer communication is executed from the modem 25 via the telephone line 26. When the selected task is a network process, the external storage unit 14
Is read into the working storage means 13, and network processing is executed bidirectionally from the network interface 27 via the network line 28. If the selected task is to decode a television broadcast,
0 and the video signal decoder 21 are activated, and the decoded video data is displayed on the display 17 via the frame buffer 16. When the selected task is video decoding, the video playback unit 22 and the video signal decoder 23 are activated, and the decoded video data is displayed on the display 17 via the frame buffer 16. The program may be read from the CD-ROM drive 19 and stored in the working storage unit 13 to execute the program (for example, an electronic dictionary or a game).

[0031] determining whether to save the task i ₁ in step S8. Whether saving this task i ₁ is due to the discretion of the operator, when retracting is performed by the input command from the input means 29. No operation from the input unit 29, when not saving the task i ₁ proceeds to step S9, it is determined whether or not the processing of the task i ₁ has been completed, step S7 when not completed
And the process is continued.
The display control unit 15 proceeds to 10 to erase the display of the operation screen for the task i _1, reset to indicate that the processing of the task i ₁ is completed in step S11 the flag F to (i ₁₎ to "0" (F (i ₁ ) ← 0). Step S
For canceling the setting of the sound source position variable A (i ₁₎ at 12, it is set to "FF _H" to the sound source position variable _{A (i 1) (A (} i 1) ← FF H). After step S12, the process proceeds to the display of the program selection screen of step S15.

[0032] When a saving the task i ₁ is determined at step S8, the flag G (i ₁₎ which indicates that it should sound output when a predetermined condition during retraction is satisfied the process proceeds to step S13 Set “1” (G
(I ₁ ) ← 1). This is, for example, the saved task i ₁
Is for generating a ring tone in the case of e-mail. In addition, various sounds are output according to the type of task. Incidentally, when there is an input to the effect that does not wish to output voice sets "0" to the flag _{G (i 1) (G (} i 1) ← 0). Here, it is assumed that the flag G (i ₁ ) is set to “1”. Saving the task i ₁ at step S14.

In the next step S15, the program selection screen is displayed again. In this stage, the task i ₁ is still processing when having passed through the steps S13~S14 from step S8 is not completed. Then, the operator operates the input means 29 while watching the program selection screen in order to perform the multitask, and the program task i _{1 is performed.}
Selecting any other program tasks i _x is the. As a result, in step S16, the program task i _x
Start Task i selected from external storage means 14
The program of _x is read into the working storage unit 13. It sets the data "FF _H" to the flag F (i _x) indicating that it has started the task i _x in step _{S17 (F (i x) ←} FF H).

The sound source position to determine the position of the sound source in a three dimensional sound field by operating the input unit 29 to be voice output when a predetermined condition is satisfied when retracted this task i _x for task i _x in step S18 to set the variable a (i _x). As the sound source position, a sound field number other than the sound field number j set previously (here, k) is set (A).
(I _x) ← k). The display control unit 15 in step S19 to display the operation screen for the task i _x on the display 17 and executes the processing of the task i _x in step S20.

The task can be arbitrarily selected from a word processor, an e-mail, a personal computer communication, a network process, a television broadcast decode, a video decode, a CD-ROM, etc., as described in the step S7. Each process is executed.

Next, it is determined whether or not there is a voice output interrupt request for the non-display task saved in step S21. When there is no request for interruption of the audio output, the process proceeds to step S23. When there is a request, the process proceeds to step S22, and the process proceeds to step S22 shown in FIGS.
A skip to the audio output subroutine of 101 to S119 is executed.

Here, first, the description of the operation will be continued on the assumption that there is no request for interruption of the audio output. In step S23~S27, the task i _x suffix "x"
Contains “1”. Proceeding to step S23,
Processing of the task i _x is determined whether or not it is completed, the case of completion to continue the processing returns to step S20, but the display control unit 15 proceeds to step S24 when the end of the task i _x It clears the display of the operation screen, and resets the flag to indicate that the processing of the task i _x has finished F a (i _x) to "0" in the step S25 (F
(I _x) ← 0). In step S26 the flag N (i _x) to indicate that the task i _x is no longer retracted reset to _{"0" (N (i x} ) ←
0). In step S27 the sound source position variable A (i _x)
To unset, the sound source position variable A (i _x) "F
F _H "to set the _{(A (i x) ← FF} H). Step S
After 27, the process returns to step S15.

Thus, the task is in a state of two multitasks.

If there is a voice output interrupt request in step S21 and the process proceeds to step S22 and skips to the voice output subroutine, the voice output subroutine process starting from step S101 shown in FIGS. Be started. For a task for which an interrupt request has been made in step S101, the task i _y is sounded based on a flag G (i _y ) indicating that sound should be output when a predetermined condition is satisfied while the task is being saved. Recognize whether there was an output interrupt request. For example, based on a flag G (i _y ) that is set to emit a ring tone when an incoming call is received in an e-mail task, it can be recognized that there has been a voice output interrupt request for the task “e-mail”. In step S102, the sound field position allocating means 32 allocates a sound source position in the three-dimensional sound field 41 corresponding to the sound source position variable A (i _y ) for the task i _y . In step S103, the three-dimensional sound field generation means 30 constructs a three-dimensional sound field to which the sound source positions are allocated together with the normal sound at the time of receiving a television broadcast or reproducing a video. Then, in step S104, the audio signal is output from the three-dimensional sound field generation unit 30 to the audio output unit 31, and the task i _y satisfying the predetermined condition is performed.
Is output from the audio output means 31 in accordance with the above-described three-dimensional sound field.

[0040] The for a task i _y output from the sound output unit 31 is an operator heard a sound indicating that a predetermined condition is satisfied, it recognizes that it has reached the predetermined condition is satisfied in the task i _y Of course,
It is possible to recognize which type of task the sound output is based on the state of the sound color or the like and the direction in which the sound is heard. For example, assuming that the operator has set the sound source position of the ring tone for the e-mail task to the obliquely upper right 41c of the sound field in the three-dimensional sound field 41 of FIG. When there is an incoming e-mail, the ring tone is always heard from the diagonally upper right direction. When the task of TV broadcast decoding is also executed at the same time and the sound that seems to be a ringtone is heard from the upper right direction in the atmosphere sound where the sound of the TV program and the conversation of people are heard, the operator, It is possible to immediately and easily recognize that the sound is a ringtone of an e-mail by clearly distinguishing the sound from the atmosphere sound.

[0041] And now, instead of the task i _x being displayed on the display 17, decide whether to switch to a display of the operation screen for the task i _y a predetermined condition is satisfied. When switching, a command is given by an operation from the input means 29.

In step S105, it is determined whether or not to display the operation screen of the saved task i _y in accordance with the sound source position variable A (i _y ) at which the voice was emitted satisfying the predetermined condition. If the operator does not perform the task switching operation as described above, the process proceeds to step S
Proceeding to 106, a return destination to the main routine is determined, and the process returns to step S20. In other words, to continue the processing of the task i _x displaying the operation screen on the display 17 at present.

On the other hand, when it is determined in step S105 that the operation screen of the saved task i _y corresponding to the sound source position variable A (i _y ) is to be displayed, the process proceeds to step S107, and the current screen is displayed on the display 17. Task i _x
In it saves the sets "1" to the flag G (i _x) indicating that it should sound output when a predetermined condition during retraction is satisfied _{(G (i x) ← 1} ). It should be noted that, when there is an input to the effect that do not want the output of the voice, "0" is set to the flag _{G (i x) (G (} i x) ← 0). Here it is assumed that "1" is set to the flag G (i _x) is. Saving the task i _x in step S108.

In the next step S109, an interrupt
Task i_y Display on the display 17
I do. This display is called by the mouse which is the input means 29.
May be performed by dragging in the
You may comprise so that it may be. In step S110,
Lag N (i_y) Contains the data "FF_HIs set (N
(I _y) ← FF_H ), Corresponding task i_y Is a display
Set what is displayed in a17. Step S1
Task i after switching the operation screen in 11_y Processing
Execute.

Next, it is determined whether or not there is a voice output interrupt request for the non-display task saved in step S112. If there is no request for interrupting the audio output, the process proceeds to step S113. If there is a request, the process returns to step S101, and the audio output subroutine starting from step S101 is executed from the beginning.

When there is no interrupt request for audio output, the operation is as follows. Steps S113 to S116
Here, it is assumed that the suffix “y” of the task i _y includes “1”. In step S113, it is determined whether or not the processing of task i _y has been completed. If not, the processing returns to step S111 to continue the processing. In step S1, the display of the operation screen of the task i _y is deleted.
In step 15, the flag F (i _y ) is reset to “0” to indicate that the processing of the task i _y has been completed (F
(I _y ) ← 0). In step S116, task i _y
For resetting the flag N to (i _y) "0" to indicate that no longer retracted is (N (i _y) ←
0). Display control unit 15 in step S117 displays the operation screen of the original task i _x on the display 17. This switching display is automatically executed without an operation from the input unit 29. In step S118 to set "FF _H" to the flag N (i _x) to indicate that the operation screen for the task i _x is displayed (N (i _x) ← F
F _H ). Then, in step S119, a return destination to the main routine is determined, and the process returns to step S20. In other words, to continue the processing of the task i _x displaying the operation screen on the display 17 at present.

As described above, the task is in a multitask state of two or more.

The switching of the operation screen of the task mainly performed by the display control means 15, the sound field position allocating means 32 and the three-dimensional sound field generating means 30 will be described with reference to FIG.

In FIG. 7, the e-mail task, the television broadcast decoding task, and the personal computer communication task are saved, and the operation screen of the word processor task is displayed on the display 17. For email,
When a predetermined condition is satisfied when the task is saved, for example, a sound field left 41d is set as a sound source position in a three-dimensional sound field to which sound is to be output. For TV broadcast decoding, it is assumed that, for example, a sound field right 41e is set as a sound source position in a three-dimensional sound field to output a sound when a predetermined condition is satisfied when the task is saved. Also,
With respect to the personal computer communication, it is assumed that, for example, on the sound field 41b is set as the sound source position in the three-dimensional sound field to which the sound is to be output when a predetermined condition is satisfied when the task is saved.

When executing a word processing task,
When the sound of the TV program is output, the TV sound is output from the sound field right 41e as indicated by an arrow a. The operator is working on a word processor in such a sound environment. When there is an incoming call in the e-mail task, the incoming sound is output from the sound field left 41d as shown by the arrow b. Thus, when a sound that seems to be a ringtone is heard from the left side of the atmosphere sound in which the sound of the TV program or the conversation of the surrounding people is heard, the operator clearly distinguishes the sound from the atmosphere sound. Apart from that, it can be immediately and easily recognized that the sound is a ringtone of an electronic mail. This is because the operator previously remembers that the ring tone of the e-mail should be heard from the left side. Here, the operator displays the operation screen of the e-mail task instead of the operation screen of the word processor task on the display 1.
7 is to be arbitrarily determined by the operator. Also, when performing word processing tasks,
When the download of the software and the information data by the personal computer communication is completed, the end sound is output from the sound field 41b as shown by an arrow c. As a result, when a sound that seems to be the end sound of downloading software or information data is heard from above in the atmosphere sound in which the sound of the TV program and the conversation of the surrounding people are heard, the operator is notified of the atmosphere sound. The sound can be clearly distinguished from the sound, and the sound can immediately and easily be recognized as the end sound of the download of the software and information data in the personal computer communication. This is because the operator previously remembers that the end sound of the download of the software and the information data should be heard from above. Here, whether or not the operator calls the operation screen of the personal computer communication task on the display 17 instead of the operation screen of the word processor task is determined arbitrarily by the operator.

The same applies to the case where an e-mail is received or the download of software or information data is completed while the operation screen of the TV broadcast decoding task is being displayed on the display 17. The same applies to the case where download of software or information data is completed while the operation screen of the e-mail task is displayed on the display 17. At this time, the sound of the television program is heard from the right side. The same applies when an e-mail is received while the operation screen of the task of the personal computer communication is displayed on the display 17. Also at this time, the sound of the television program is heard from the right side. It is of course possible to turn off the sound of the TV program.

The task of the Internet via the network interface 27 and the network line 28 is handled in substantially the same manner as the task of the personal computer communication. Further, it is completely arbitrary to set the sound source of which task to which position in the three-dimensional sound field.

As described above, in the multitask management system according to the first embodiment, the sound source for notifying the operation status of the saved program task is set to a desired position in the three-dimensional sound field. Head mounted display (HMD)
Even if a flat two-dimensional display is used instead of the three-dimensional display as described above, the operation status of the evacuation task can be immediately and easily recognized by auditory perception.

[Second Embodiment] FIG. 8 is a block diagram showing a configuration of a multitask management system according to a second embodiment. 8, reference numerals 11 to 33 are common to the configuration of FIG. 1 according to the first embodiment, and will be described again. 11 is a control means (CPU), and 12 is a program for operating a computer system. Program storage means (ROM), 13 is a working storage means (RAM), 14 is an external storage means such as a hard disk, 15 is a display control means, 16 is a frame buffer, and 17 is a two-dimensional display such as a CRT or LCD. , A disk drive 18 such as a floppy disk or a magneto-optical disk, 19 a CD-ROM drive,
20 is a television receiving means, 21 is a video signal decoder, 22
Is a video playback means, 23 is a video signal decoder, 24 is an NCU (network control unit), 25 is a modem controlled by the NCU 24, 26 is a telephone line, 27 is a network interface, 28 is a network line, 29 is a keyboard and mouse, etc. Input means, 30 is a three-dimensional sound field generating means, 31 is sound output means such as a speaker or headphones, 32 is sound field position allocating means,
Reference numeral 33 denotes a bus that connects the components. Reference numeral 34 denotes virtual screen information holding means such as a video RAM.
Is a display position switching means.

The virtual screen information holding means 34 is provided as shown in FIG.
Display screen 51 of the two-dimensional display 17 as shown in FIG.
Is attached to a virtual screen 52 which is virtually developed around the screen and divided into a plurality of virtual task areas 52a to 52h in the circumferential direction, and a program task whose operation status is displayed on the display screen 51 is saved. Then, any one of the plurality of virtual task areas 52a to 52h is designated and saved, and information on the saved task is held.

As in the case of the first embodiment, the sound field position allocating means 32 outputs a sound when a predetermined condition is satisfied in the retreat state with respect to the task to be retreated from the display screen 51 of the two-dimensional display 17. The sound source position in the three-dimensional sound field to be set is determined by the virtual task area 52x, which is the save destination of the save task based on the display screen 51 in a relative positional relationship.
(The suffix x is any one of a to h). That is, for example, if an e-mail task is evacuated from the display screen 51 to, for example, the virtual task area 52d (left side of the display screen 51), a ringtone is output when an e-mail is received in the evacuation state. When the task is evacuated, the sound source position of the ring tone is set to the sound field left 41d corresponding to the save destination virtual task area 52d in the three-dimensional sound field 41 (see FIGS. 6 and 7).
(Left side of the display 17), or if the task of personal computer communication is saved from the display screen 51 to, for example, the virtual task area 52b (above the display screen 51), the software and information data are downloaded in the saved state. When the task is evacuated, the sound source position of the ending sound is set in the sound field 41b (upper side of the display 17) of the three-dimensional sound field 41 corresponding to the save destination virtual task area 52b. ).

The three-dimensional sound field generating means 30 includes a display screen 51
And generating a three-dimensional sound field to which the sound source position is assigned when predetermined conditions are satisfied in the task saved in a state where an operation screen of a certain task is displayed. The sound output means 31 outputs a three-dimensional sound field sound including a sound output from the sound source position generated by the three-dimensional sound field generation means 30.

Next, the operation of the multitask management system according to the second embodiment configured as described above will be described with reference to the flowcharts of FIGS. The control means 11 initializes (initializes) each flag and register in step S51, and displays the display control means 1 in step S52.
5 to display a program selection screen on the two-dimensional display screen 51 of the display 17 via the frame buffer 16. The operator selects any program task i ₁ by operating the input means 29 while watching a program selection screen. Thus, to start the program task i ₁ at step S53. A plurality of programs are installed in the external storage means 14 in advance, and the program for the task i ₁ selected from the external storage means 14 is read into the working storage means 13 by selecting a program task. In step S54, data “FF _H ” is set in a flag F (i ₁ ) indicating that the task i ₁ has been started (F (i ₁ ) ← FF _H ). “FF _H ” indicates that the task is in the activated state. Displays the operating screen for the task i ₁ on the display 17 in step S55, executes the processing of the task i ₁ at step S56.

[0059] determining whether to save the operation screen for the task i ₁ to the virtual screen 52 in step S57. Whether to save the operation screen of the task i ₁ to the virtual screen 52 is due to the discretion of the operator, when retracting is performed by the input command from the input means 29. There is no operation from the input means 29 and the task i ₁
If the operation screen is not saved, the process proceeds to step S58,
Processing task i ₁ is determined whether or not it is completed, but to continue the process returns to step S56 when not completed, the display control unit 15 proceeds to step S59 when the completion of the task i ₁ The display of the operation screen is erased, and the flag F (i ₁ ) is reset to “0” to indicate that the processing of the task i ₁ has been completed in step S60 (F
(I ₁ ) ← 0). Following step S60 is step S64.
Proceed to display the program selection screen.

In the determination in step S57, task i ₁
When the operation screen is saved to the virtual screen 52, the process proceeds to step S61, where the virtual task area number of the save destination on the virtual screen 52 is set. This setting is performed by operating the input unit 29. For example, a numerical value may be input from the keyboard, or a drag operation may be performed with the mouse in the retreat destination direction. The virtual task areas 52a to 52e shown in FIG.
52h. Here, it is assumed that j _m is set as the virtual task area number. The variable n (i ₁ ) of the virtual task area number is set to j _m (N
(I ₁ ) ← j _m ). Then, "1" is set to the flag G (i ₁₎ which indicates that it should sound output when a predetermined condition is satisfied during the evacuation in step S62 (G
(I ₁ ) ← 1). This is, for example, the saved task i ₁
Is for generating a ring tone in the case of e-mail. In addition, various sounds are output according to the type of task. Incidentally, when there is an input to the effect that does not wish to output voice sets "0" to the flag _{G (i 1) (G (} i 1) ← 0). Here, it is assumed that the flag G (i ₁ ) is set to “1”. It saves the operation screen for the task i ₁ to a virtual task region corresponding to the variable N in the virtual task area number (i ₁₎ in the virtual screen 52 in step S63. At this time, the control unit 11 controls the display control unit 15, and transfers the data of the operation screen by the processing result of the task i ₁ to the virtual screen information holding unit 34, the virtual screen information holding unit 34 that task i ₁ program And data of the operation screen.

At the next step S64, the program selection screen is displayed again. In this stage, the task i ₁ is still processing when having passed through the steps S61~S63 from step S57 has not been completed. Then, the operator operates the input means 29 while watching the program selection screen in order to perform the multitask, and executes the program task i.
₁ selects any other program tasks i _x. Thereby, in step S65, the program task i
Start _x . Selected task i _x program from the external storage unit 14 is loaded into the working storage unit 13. It sets the data "FF _H" to the flag F (i _x) indicating that it has started the task i _x in step _{S66 (F (i x) ←} FF H). The display control unit 15 in step S67 to display the operation screen for the task i _x on the display 17, the task i in step S68
Execute the processing of _x .

The tasks are word processing, electronic mail, personal computer communication, and word processing as described in step S56.
Network processing, television broadcast decoding, video decoding, CD-ROM, and the like can be arbitrarily selected, and each processing is executed.

Next, it is determined whether or not there is a voice output interrupt request for the non-display task saved on the virtual screen 52 in step S69. If there is no request for interruption of the audio output, the process proceeds to step S71. If there is a request, the process proceeds to step S70, and skip to the audio output subroutine of steps S201 to S220.

Here, the description of the operation will be continued on the assumption that there is no request for interrupting the audio output. In step S71~S74, the task i _x suffix "x"
Contains “1”. Proceeding to step S71,
Processing of the task i _x is determined whether or not it is completed, the case of completion to continue the processing returns to step S68, but the display control unit 15 proceeds to step S72 when the completion of the task i _x It clears the display of the operation screen, and resets the flag to indicate that the processing of the task i _x has finished F a (i _x) to "0" in the step S73 (F
(I _x) ← 0). Is reset to "0" to the variable N (i _x) of the virtual task region number to indicate that no longer retracted for the tasks i _x in step _{S74 (N (i x) ←} 0). After step S74, the process returns to step S64.

Thus, the task is in a state of two multitasks.

If it is determined in step S69 that there is a voice output interrupt request, and the flow advances to step S70 to skip to the voice output subroutine, the process proceeds to step S2.
The processing of the audio output subroutine starting from 01 is started. A flag G (i) indicating that audio output should be performed when a predetermined condition is satisfied while the task for which the interrupt request was made in step S201 is being saved.
Based on _y ), it is recognized which task i _y has been requested to interrupt the audio output. For example, based on a flag G (i _y ) that is set to emit a ring tone when an incoming call is received in an e-mail task, it can be recognized that there has been a voice output interrupt request for the task “e-mail”. In step S202, sound field position allocating means 3
2 assigns the position of the three-dimensional sound field corresponding to the variable N (i _y ) of the virtual task area number. In step S203, the allocated three-dimensional sound field is constructed by the three-dimensional sound field generation means 30 together with the normal sound at the time of receiving a television broadcast or reproducing a video. Then, step S20
In step 4, an audio signal is output from the three-dimensional sound field generation means 30 to the audio output means 31, and a sound in accordance with the predetermined condition is satisfied according to the task i _y using the constructed three-dimensional sound field. Output from the output means 31.

[0067] The for a task i _y output from the sound output unit 31 is an operator heard a sound indicating that a predetermined condition is satisfied, it recognizes that it has reached the predetermined condition is satisfied in the task i _y Of course,
It is possible to recognize which type of task is located at which position on the virtual screen 52 based on the state of the tone color of the voice and the direction in which the sound is heard. And now, instead of the task i _x being displayed on the display 17, decide whether to switch to a display of the operation screen for the task i _y a predetermined condition is satisfied. When switching, a command is given by an operation from the input means 29.

In step S205, it is determined whether or not to display the operation screen of the saved task i _y corresponding to the variable N (i _y ) of the virtual task area number. When the operator does not perform the operation of switching the displayed task as described above, the process proceeds to step S206, a return destination to the main routine is determined, and the process returns to step S68. In other words, to continue the processing of the task i _x displaying the operation screen on the display 17 at present.

On the other hand, when the operation screen of the saved task i _y corresponding to the variable N (i _y ) is to be displayed in the judgment of step S205, the operation proceeds to step S207, where the task currently displayed on the display 17 is displayed. for i _x to set a virtual task area number of save destination on the virtual screen 52. This setting is performed by operating the input unit 29. For example, a numerical value may be input from the keyboard, or a drag operation may be performed with the mouse in the retreat destination direction. The save destination virtual task area is a virtual screen 5
2 is an empty virtual task area. Here, it is assumed that _jk is set as the virtual task area number. It will set the j _k virtual task area number of the variable _{N (i x) (N (} i x) ← j k). Next, step S208
"1" is set to the flag G (i _x) indicating that it should sound output when a predetermined condition during retraction is satisfied in _{(G (i x) ← 1} ). It should be noted that, when there is an input to the effect that do not want the output of the voice, "0" is set to the flag _{G (i x) (G (} i x) ← 0). Here it is assumed that "1" is set to the flag G (i _x) is. Step in S209 the task i _x virtual task region number of the virtual screen 52 the operation screen of the variable N (i _x)
Save to the virtual task area corresponding to. At this time, the control unit 11 controls the display control unit 15, and transfers the data of the operation screen by the processing result of the task i _x to the virtual screen information holding unit 34, the virtual screen information holding means 34
It holds the data of the program and the operation screen for that task i _x.

In the next step S 210, the operation screen of the task i _y interrupted by the display position switching means 35 is displayed on the display 17. This display may be performed by a drag operation in the calling direction with the mouse as the input means 29, or may be configured to be performed automatically.
In step S211, the variable N of the virtual task area number
(I _y) to set the data "FF _H" (N (i _y) ← F
F _H ), setting that the corresponding task i _y is being displayed on the display 17. In step S212, the process of the task i _y after the switching of the operation screen is executed.

Next, in step S 213, it is determined whether or not there is a request to interrupt the audio output for the non-display task saved on the virtual screen 52. If there is no request for interrupting the audio output, the process proceeds to step S214. If there is a request, the process returns to step S201.
The audio output subroutine starting from step S201 is executed from the beginning.

When there is no interrupt request for audio output, the operation is as follows. Steps S214 to S217
Here, it is assumed that the suffix “y” of the task i _y includes “1”. In step S214, it is determined whether or not the processing of task i _y has been completed. If not, the processing returns to step S212 to continue the processing. In step S2, the operation screen of the task i _y is erased, and
In step 16, the flag F (i _y ) is reset to “0” to indicate that the processing of task i _y has been completed (F
(I _y ) ← 0). In step S217, task i _y
The variable N (i _y ) of the virtual task area number is reset to “0” (N (i _y ) ← 0) in order to indicate that is no longer saved. Operation screen original task i _x by the display position switching means 35 is displayed on the display 17 in step S218. This switching display is automatically executed without an operation from the input unit 29. Variable N (i virtual task region number to indicate that the operation screen for the task i _x is displayed in step S219
is set to "FF _H" to the _{x) (N (i x)} ← FF H).
Then, in step S220, a return destination to the main routine is determined, and the process returns to step S68.
In other words, to continue the processing of the task i _x displaying the operation screen on the display 17 at present.

As described above, the task becomes a multitask state of two or more tasks.

Hereinafter, the switching of the operation screen of the task mainly performed by the display control means 15, the display position switching means 35, the virtual screen information holding means 34, the sound field position allocating means 32 and the three-dimensional sound field generating means 30 will be described. From FIG.
This will be described with reference to FIG.

In FIG. 13A, the task selected first is an e-mail, and the operation screen of the task T11 of the e-mail is displayed on the display 17 (the display screen 51 of the virtual screen 52). As shown in FIG. 13B, the operation screen of the e-mail task T11 is moved to, for example, the virtual task area 52d on the left side of the virtual screen 52, and the TV broadcast decoding is selected as a new task. The operation screen of the task T12 is displayed on the display screen 51 of the display 17. In this state, it is assumed that there is an incoming call in the e-mail task T11, and a ringtone is output from the voice output unit 31. Since the operation screen of the e-mail task T11 is on the left side of the display 17, the ringtone is output from the left side by the sound field position assigning means 32 and the three-dimensional sound field generating means 30. Thereby, the operator recognizes that there is an incoming call in the task T11 of the e-mail, even in the atmosphere sound in which the voice of the TV program, the conversation of the surrounding people, and the like are being heard.
Since the ringtone is heard from the left side, it is possible to immediately and easily recognize that the virtual task area in which the operation screen of the task T11 of the electronic mail is saved is the virtual task area 52d on the left side. Here, it is optional whether the operator calls the operation screen of the e-mail task T11 on the display 17 or keeps watching the television broadcast.
Display the operation screen of task T11 of e-mail on display 1
7, the TV broadcast decoding task T is performed by dragging the mouse or the like as shown in FIG.
The operation screen 12 is moved to the right side of the display screen 51 of the display 17 on the virtual screen 52, for example.
E-mail task T1 by dragging the mouse
The operation screen 1 is moved to the display screen 51. The sound of the TV program is heard from the right side.

As shown in FIG. 13D, the operation screen of the TV broadcast decoding task T12 is changed from the state of FIG. 13B to the virtual task area 5 on the right side of the virtual screen 52, for example.
2e, if personal computer communication is selected as a new task, the operation screen of the personal computer communication task T13 is displayed on the display screen 51 of the display 17. Further, when the download of software and information data by the personal computer communication starts, the operation screen of the task T13 of the personal computer communication is moved to, for example, the virtual task area 52b above the virtual screen 52 as shown in FIG. Select a word processor as the task. Then, the operation screen of the task T14 of the word processor is displayed on the display screen 51 of the display 17. It is assumed that there is an incoming call in the e-mail task T11 in the state of FIG. Email Task T1
Since the operation screen 1 is again on the left side of the display 17, the ringtone is output from the left side by the sound field position allocating means 32 and the three-dimensional sound field generating means 30. As a result, the operator recognizes that there is an incoming call in the task T11 of the e-mail, and the ringtone is heard from the left side, even among the atmosphere sounds in which the voice of the TV program and the conversation of the surrounding people are being heard. E-mail task T1
It is possible to immediately and easily recognize that the virtual task area in which the first operation screen is saved is the virtual task area 52d on the left side. Here, it is assumed that the operator calls the operation screen of the task T11 of the e-mail on the display 17. In this case, as shown in FIG. 14B, the operation screen of the word processor task T14 is moved to a virtual task area 52a on the upper left of the display screen 51 on the virtual screen 52 by, for example, dragging the mouse. The operation screen of the e-mail task T11 is moved to the display screen 51 by a drag operation or the like.

In the state shown in FIG.
Although the sound of the television broadcast is heard from the right side by the two- and three-dimensional sound field generating means 30, when the operator wants to watch the video of the television broadcast, as shown in FIG. The operation screen of the e-mail task T11 is moved again to the virtual task area 52d on the left side of the display screen 51 on the virtual screen 52 by a drag operation or the like, and further, the operation screen of the television broadcast decoding task T12 is moved by the mouse drag operation or the like. To the display screen 51. The destination to which the operation screen of the e-mail task T11 is moved is indicated by the square brackets in the virtual task area 52.
Virtual task area 5 on the upper right side of display screen 51
2c may be used. In addition, the position of the operation screen of the task T11 of the e-mail and the position of the operation screen of the task T12 of the television broadcast decoding may be exchanged with each other.

In the state of FIG. 14C, the sound field position allocating means 3
When the operator hears a sound indicating that the download of the software and information data of the personal computer communication has been completed from the upper side by the two and three-dimensional sound field generating means 30, and the operator wants to see the contents of the download, FIG.
As shown in FIG. 4D, the operation screen of the TV broadcast decoding task T12 is moved to, for example, the virtual task area 52c on the upper right side of the display screen 51 on the virtual screen 52 by dragging the mouse or the like. For example, the operation screen of the task T13 of the personal computer communication is moved to the display screen 51. It should be noted that the destination to which the operation screen of the task T12 of the television broadcast decoding is shifted is again set to the virtual task area 5.
2 may be on the right side of the display screen 51. Further, the position of the operation screen of the task T12 of the television broadcast decoding and the position of the operation screen of the task T13 of the personal computer communication may be exchanged with each other.

In the state of FIG. 14D, the sound field position allocating means 3
The two- and three-dimensional sound field generating means 30 allows the sound of the television broadcast to be heard from the obliquely upper right side. When the operator wants to view the video of the television broadcast, the mouse is used as shown in FIG. The operation screen of the task T13 of the personal computer communication by the drag operation of the
Then, the screen is moved to the virtual task area 52e on the right side of the display screen 51, and the operation screen of the TV broadcast decoding task T12 is moved to the display screen 51 by dragging the mouse or the like. The destination to which the operation screen of the task T13 of the personal computer communication is transferred is changed to the display screen 51 in the virtual task area 52 again.
May be above. In addition, task T1 of personal computer communication
3 Operation Screen Position and TV Broadcast Decoding Task T1
The positions of the two operation screens may be interchanged.

In the state shown in FIG.
The processing sound of the task T14 of the word processor is heard from the diagonally upper left side by the two- and three-dimensional sound field generation means 30, but when the operator wants to operate the word processor, FIG.
As shown in (b), the operation screen of the TV broadcast decoding task T12 is moved to, for example, the virtual task area 52b above the display screen 51 on the virtual screen 52 by a mouse drag operation or the like. Screen 5 for displaying the operation screen of task T14
Move to 1. As indicated by brackets, the destination to which the operation screen of the TV broadcast decoding task T12 is shifted may be the virtual task area 52a on the upper right side of the display screen 51 in the virtual task area 52. Further, the position of the operation screen of the task T12 of the television broadcast decoding and the position of the operation screen of the task T14 of the word processor may be interchanged.

The screen switching process between the task displayed on the display screen 51 and the non-display task saved in each virtual task area of the virtual screen 52 executed by the display position switching means 35 is described below. In addition to the above, as shown in FIGS. 16A and 16B, the display position switching unit 35 moves the display area 51 ′ (portion surrounded by a black frame) virtually on the virtual screen 52. May be configured. For example, as shown in FIG. 16A, a display area 51 'indicated by a black frame is located at the center on the virtual screen 52, and the operation screen of the word processor task T14 is displayed on the display screen 51. When a ring tone is heard in task T11, the mouse cursor (not shown) is moved by operating the input means 29 in the direction in which the ring tone was heard, that is, to the left on the screen of the current display area 51 '. When the mouse cursor reaches the left end (on the boundary of the virtual task area), as shown in FIG.
The display area 51 'indicated by the black frame is the task T14 of the word processor.
May be virtually moved to the e-mail task T11, and the operation screen of the e-mail task T11 may be displayed on the display screen 51.

The task of the Internet via the network interface 27 and the network line 28 is handled in substantially the same manner as the task of the personal computer communication.

As described above, in the multi-task management system according to the second embodiment, two elements which have not been considered for combination in the past, namely, the three-dimensional sound field system and the task of the task of an arbitrary program of the computer. Combined with a virtual screen system that virtually displays the operation screen, the operation status of the task evacuated on the virtual screen is notified to the operator by outputting sound from the direction of the virtual task area where the task is evacuated. Therefore, even if a flat two-dimensional display is used instead of a three-dimensional display such as a head-mounted display (HMD) as a display, a state in which a predetermined condition for an evacuation task is satisfied is not displayed on the screen. However, the evacuation task operation status can be heard and sentiment instantly and easily. Since the evacuation destination of the evacuation task having the voice output is the direction in which the voice can be heard, the operation for calling the evacuation task on the display can be performed quickly and easily. Can be.

In both the first embodiment and the second embodiment, not only the start and end of the program task, but also the progress of the saved operation of the saved program task should be satisfied. It is possible to determine any stages along the way. Then, by programming so as to generate a sound corresponding to the progress of the program task, the progress can be checked in detail.

[0085]

According to the multitask management system according to the present invention, a sound source position at which a sound satisfying a predetermined condition in a retracted state for a task to be saved from a display screen is allocated in a three-dimensional sound field. Since the three-dimensional sound field to which the sound source position is assigned is generated and a sound satisfying the predetermined condition is output, the sound satisfying the predetermined condition can be heard without displaying the state of satisfying the predetermined condition for the evacuation task on the screen. Based on the direction, the operator can instantly and easily recognize the operation status of the evacuation task in an aural sense. It is possible to clearly distinguish sounds satisfying a predetermined condition by distinguishing them from each other, and by compensating the constraints of the two-dimensional display with the three-dimensional sound field system, The operability of the disk can be greatly improved.

Further, according to the multitask management system of the present invention, a three-dimensional sound field system and a virtual screen system are combined, and any of a plurality of virtual task areas on a virtual screen when a task is saved is saved. And assigning a sound source position at which a sound that satisfies a predetermined condition in the evacuation state in the evacuation state is to be emitted in the direction of the virtual task area, which is the evacuation destination of the evacuation task based on the display screen, that is, the task evacuation position and When a predetermined condition is satisfied, a three-dimensional sound field to which the sound source position is assigned is generated and a sound that satisfies the predetermined condition is output, so that the sound that satisfies the predetermined condition for the evacuation task specifies an evacuation destination. From the direction of the virtual task area that has been set, the operator assigns a sound source to It is not necessary to remember whether or not the tone of the sound that satisfies the predetermined condition for each task is required. The operator can immediately and easily recognize the operation status of the evacuation task based on the direction in which the sound is heard, and the evacuation task is retreated to the virtual task area in any direction on the virtual screen. Can also be immediately and easily recognized audibly. That is, since the evacuation position of the evacuation task on the virtual screen is associated with the sound source position of the sound satisfying the predetermined condition in the three-dimensional sound field,
Confirmation of the operation status of the evacuation task and subsequent operations can be made extremely easy.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a multitask management system according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing an operation of the multitask management system according to the first embodiment.

FIG. 3 is a flowchart (continuation of FIG. 2) showing the operation of the multitask management system according to the first embodiment.

FIG. 4 is a flowchart (continuation of FIG. 3) illustrating an operation of the multitask management system according to the first embodiment.

FIG. 5 is a flowchart (continuation of FIG. 4) showing the operation of the multitask management system according to the first embodiment.

FIG. 6 is an explanatory diagram of a configuration of a three-dimensional sound field system of the multitask management system according to the first and second embodiments.

FIG. 7 illustrates a multitask management system according to the first embodiment.
It is operation | movement explanatory drawing using the three-dimensional sound field system.

FIG. 8 is a block diagram showing a configuration of a multitask management system according to Embodiment 2 of the present invention.

FIG. 9 is a flowchart showing an operation of the multitask management system according to the second embodiment.

FIG. 10 is a flowchart (continuation of FIG. 9) showing the operation of the multitask management system according to the second embodiment.

FIG. 11 is a flowchart (continuation of FIG. 10) showing the operation of the multitask management system according to the second embodiment.

FIG. 12 is a flowchart (continuation of FIG. 11) showing the operation of the multitask management system according to the second embodiment.

FIG. 13 is an explanatory diagram of an operation of the multitask management system according to the second embodiment using a virtual screen system.

FIG. 14 is an explanatory diagram of the operation of the multitask management system according to the second embodiment using the virtual screen system.

FIG. 15 is an explanatory diagram of the operation of the multitask management system according to the second embodiment using the virtual screen system.

FIG. 16 is an operation explanatory diagram of a screen switching process of another mode executed by the display position switching means of the second embodiment.

FIG. 17 is a schematic explanatory diagram of a virtual screen system.

FIG. 18 is an explanatory diagram of the operation of the virtual screen system in the case of the conventional technique.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 ... Control means 12 ... Program storage means 13 ... Working storage means 14 ... External storage means 15 ... Display control means 16 ... Frame buffer 17 ... Display (two-dimensional display) 18 ... Disk drive 19 ... CD-ROM drive 20 TV receiving means 21 Video signal decoder 22 Video reproducing means 23 Video signal decoder 24 NCU (network control unit) 25 Modem 26 Telephone line 27 ... Network interface 28... Network line 29... Input means 30... Three-dimensional sound field generating means 31... Audio output means 32. ... display position switching means 41 ... three-dimensional sound field 41a ... sound field inclination Upper left 41b Upper sound field 41c Upper right sound field 41d Left sound field 41e Right sound field 51 Display screen 52a-52h Virtual task area T11 E-mail task T12 TV broadcast decoding task T13: Task of PC communication T14: Task of word processor

Claims (2)

[Claims] 1. A multi-task capable of simultaneously executing a plurality of program tasks, wherein a task to be saved from a display screen of a two-dimensional display is a three-dimensional sound to be output as a sound when a predetermined condition is satisfied in a saved state. Sound field position allocating means for allocating a sound source position in a field, and when a predetermined condition is satisfied in the retreated task in a state where an operation screen of another task is displayed on the display screen, the sound source position is Three-dimensional sound field generating means for generating the allocated three-dimensional sound field; and sound output means for outputting three-dimensional sound field sound including sound output from the sound source position generated by the three-dimensional sound field generating means. A multi-task management system comprising: 2. A multi-task capable of simultaneously executing a plurality of program tasks, comprising a virtual screen virtually developed around a display screen of a two-dimensional display and divided into a plurality of virtual task areas in a circumferential direction. When saving a task whose operation status is displayed on the display screen, the information of the saved task is specified by designating an arbitrary virtual task area among a plurality of virtual task areas of the virtual screen. Virtual screen information holding means for performing the evacuation task based on the display screen in a relative positional relationship with a sound source position in a three-dimensional sound field to be output as sound when the evacuation task satisfies a predetermined condition. Sound field position allocating means for allocating in the direction of the virtual task area that is the evacuation destination; A three-dimensional sound field generating means for generating a three-dimensional sound field to which the sound source position is allocated when a predetermined condition is satisfied in the task saved in the state; A multi-task management system comprising: a sound output unit that outputs a three-dimensional sound field sound including a sound output from the sound source position.