JPH08161145A - Man-machine interface method and information processing equipment - Google Patents

Abstract

PURPOSE: To surely inform a user of a change in the state of an information processing equipment at the time of using it by effectively utilizing acoustic information. CONSTITUTION: A control part 5 checks the initial state of a system, reads out acoustic information corresponding to the initial state from a sound storing part 3 and sends the information to a sound reproducing part 4 to reproduce and output a sound expressing the initial state. Then the control part 5 always checks the states of previously determined sorts in the information processing equipment, judges the existence of a change in the states, and if the state is changed, judges acoustic information corresponding to the changed state (new state), selectively reads out the acoustic information from the sound storing part 3 and sends the information to the sound reproducing part 4 to switch sound to be reproduced.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a man-machine man interface method and an information processing device for notifying a user of a state change when using the information processing device.

[0002]

2. Description of the Related Art Recently, in information processing equipment such as computers,
There is provided a multi-window environment in which one screen can be divided into a plurality of areas called windows to perform different tasks. In addition, various processes such as transmission / reception of electronic mail and document editing in an input environment having various input modes are performed.

When using multiple windows, the input window is generally designated by the position of a mouse pointer (mouse cursor) as a position indicator. Further, although there are some cases where a change in state such as arrival of an electronic mail emits a temporary warning sound (beep sound), it is often notified by being displayed mainly on the screen.

Further, some document editing systems have a plurality of input modes such as Japanese input and English (English) input, and these input modes are also presented by character strings and symbols shown on the screen. Has been done. As described above, conventionally, a change in the state of an information processing device such as a computer is generally informed by the information presented on the screen.

[0005]

In an information processing device such as the computer described above, in a multi-window environment, for example, the mouse pointer is unintentionally (erroneously) moved while inputting in a certain window, and the mouse pointer is When the user moves to the window, the input target is switched to the other window. Therefore, if the input operation is performed without noticing it, the state of the other window may be destroyed.

Further, even if an electronic mail arrives, the user may not notice the arrival of the mail immediately because he / she missed the warning sound at the arrival. Further, when using a document editing system having a plurality of input modes, there are cases where the user inputs in a mode different from the mode requested by the user.

That is, in the computer use environment provided by the conventional information processing equipment, the state change (change of input target window, arrival of e-mail, switching of input mode in the document editing system, etc.) mainly depends on only visual information. ) Has to be recognized, the user often does not notice the change of state, which causes a problem of unexpected behavior.

The present invention has been made in consideration of such circumstances, and an object of the present invention is to effectively use auditory information for a change in state when an information processing device is used.
An object of the present invention is to provide a man-machine interface method and an information processing device capable of surely notifying a user.

[0009]

According to the man-machine interface method of the present invention, an acoustic output different from the acoustic output before the state change is performed in response to a change of a predetermined type state in an information processing device. It is characterized in that the user is notified of the change in the above state.

Further, the information processing apparatus of the present invention detects a change in a predetermined kind of state in the information processing apparatus and a sound output means for outputting a sound, and in response to the state change detection, the sound output means. In addition, the control means for making an acoustic output different from that before the state change detection is provided.

[0011]

According to the above configuration, when a predetermined type of state in the information processing device changes, a different acoustic output from that before the state change is output. The sound output different from that before this state change is the type of sound or song (melody) to be output,
It is realized by changing the tone or speed (tempo).

By switching the acoustic output according to such a state change, the user can know the above state change by hearing even if his eyes are away from the screen.

Therefore, for example, a change (switch) of an input target window in a multi-window environment and a switching of each input mode such as Japanese input and English input in a document editing system are regarded as the above state change, and the state change is performed. By switching the audio output depending on the input, the user can be sure that the input target window has been changed or that the input mode has been changed, such as Japanese input or English input, and incorrect input will be made. Can be prevented.

Further, by recognizing arrival of electronic mail as the above-mentioned state change and switching the sound output according to the state change, even if the electronic mail arrives, for example, until it is read (that is, another Until it changes to
Since the acoustic output indicating the arrival of the email can be continued, even if the user is temporarily away from the device, when the user returns to the device, the acoustic output immediately and surely causes the email to arrive. I can know.

[0015]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment of the present invention.

The information processing apparatus shown in FIG. 1 mainly includes an input unit 1, an output unit 2, a sound storage unit 3 for storing a plurality of sound information, a sound reproduction unit 4 for reproducing and outputting sound, and these. The control unit 5 is configured to control each of the units 1 to 4.

The input unit 1 converts a user's operation input into a signal and sends it to the control unit 5, and includes, for example, a keyboard and a mouse. The input unit 1 also controls the input of a signal sent from another system via a communication line.

The output unit 2 receives an output signal from the control unit 5 and outputs it to the outside, and includes a display device such as a CRT display or a liquid crystal display. The sound storage unit 3 stores a plurality of reproducible sound information, for example, sound information of a song (melody). As a method of storing the acoustic information, both an analog method and a digital method are known, but since they are not directly related to the present invention, the method is not limited here.

The plurality of pieces of acoustic information stored in the acoustic storage unit 3 are used to switch the acoustic output (perform different acoustic output) according to the state change in the information processing equipment. As a method of switching the sound output, when outputting a song (melody) as in this embodiment, a method of changing the type of the song (melody), a method of changing the tone of the song (melody),
Alternatively, a method of changing the speed of a song (melody) is applied.

First, when the type of music (melody) is changed, the sound storage unit 3 stores the music and its sound information as a set, as shown in FIG. 2 (a). In the figure, letters such as c, d, and e indicate note names such as do, le, and mi, subscripts indicate types of notes (for example, subscript 4 indicates quarter notes), and letters (note names). The number of dots above indicates the pitch of the pitch name (1 pitch and 2 dots have a pitch difference of 1 octave).

When changing the tone of a tune (melody), the tone storage unit 3 stores the tone type and its acoustic information as a set, as shown in FIG. 2B. Furthermore,
When changing the speed of a song (melody), the sound storage unit 3
As shown in FIG. 2 (c), the type of velocity and the acoustic information thereof are stored as a set.

The sound reproduction section 4 reproduces the sound information extracted from the sound storage section 3 and sent from the control section 5, and includes a speaker. The control unit 5 is realized by a CPU or the like, receives an input signal from the input unit 1, performs a process according to the input signal, and sends an output signal according to the process result to the output unit 2. Control as the control center of. Further, when the state of a predetermined type (predetermined type) in the information processing device changes due to an input from the input unit 1 or the like, the control unit 5 stores the state in the acoustic storage unit 3 according to the state change. It also manages a new control in which a plurality of pieces of audio information that have been recorded are selectively used and one of them is selectively output to the audio reproduction unit 4.

Next, the basic operation of the configuration of FIG.
The processing will be mainly described with reference to the flowchart of FIG. First, the control unit 5 confirms the initial state of the system,
The corresponding acoustic information is read from the acoustic storage unit 3,
By sending the information to the sound reproducing unit 4, the sound representing the initial state is reproduced and output (step 301). As a result, the sound reproduction unit 4 continues to reproduce the sound (here, song) according to the initial state sound information sent from the control unit 5.

Next, the control section 5 confirms the state of a predetermined type in the information processing equipment (step 30).
2) Judge whether or not the state has changed (step 30).
3). If the state has not changed, the control unit 5 returns to step 302 again to check the state.

On the other hand, if there is a change in the state, the control section 5 judges whether or not the change is due to the input of the operation end (step 304). If it is confirmed that the state does not change with the input of the operation end, the control unit 5 determines the acoustic information according to the changed state (new state), and the acoustic information from the acoustic storage unit 3 is determined. Are selectively read (step 305). Then, the control unit 5 sends the acoustic information selectively read from the acoustic storage unit 3 to the acoustic reproduction unit 4 to switch the acoustic to be reproduced. As a result, the sound reproduction unit 4 continues to reproduce the sound (here, song) according to the new state sound information sent from the control unit 5.

After switching the sound output, the control unit 5 returns to step S2 again to check the state, and repeats the series of processes. If it is confirmed in step 304 that the state has changed due to the input of the operation end, the control unit 5 ends the series of processes.

Next, in the case where the switching of the acoustic output according to the state change in the information processing equipment as shown in FIG. 1 is applied to the environment using the multiple window system,
This will be described with reference to FIG. The same parts as those in FIG.

FIG. 4 is a block diagram showing the configuration of an information processing device that supports the multiple window system. In the figure, the control unit 15 corresponds to the control unit 5 in FIG. 1 and is realized by a CPU or the like. The control unit 15 has functional elements of a window state storage unit 151, a window management unit 152, and a main control unit 153.

The window state storage unit 151 stores the state of windows handled by the multiple window system, for example, the size and position of the windows. The window management unit 152 determines the input target window based on the position of the pointer (mouse pointer) in the input target window and the information in the window state storage unit 151.

The main control section 153 has a window management section 15
Confirm the switching of the input target window using 2,
In accordance with the switching, a plurality of pieces of acoustic information stored in the acoustic storage unit 3 are selectively used, and one of them is selectively output to the acoustic reproduction unit 4.

Next, the operation of the configuration of FIG. 4 will be described. First, it is assumed that a plurality of windows, for example, two windows are simultaneously opened in an environment using the multiple window system. In the multiple window system, when there are a plurality of windows, the window indicated by the mouse pointer (mouse cursor) as a position indicator is generally the input target window.

Here, the two windows that are currently open are the window A and the window B. If the window A is the input target (the mouse pointer points to that window), the song A is played and the window is displayed. When B is an input target, music B is played.

First, the window state storage unit 151 in the control unit 15 stores the states (size, position) of the windows A and B.
Is remembered. The window management unit 152 constantly monitors the position of the mouse pointer, and refers to the state information in the window state storage unit 151 to determine the window in which the mouse pointer exists (points), that is, the input target window. are doing.

The main control section 153 has a window management section 15
2 is inquired about the input target window, and if it is confirmed that the mouse pointer is pointing to the window A, that is, the window A is the input target window, the music stored in the acoustic storage unit 3 The acoustic information of A (see FIG. 2A) is selectively read out, and this information is sent to the acoustic reproduction section 4 to continue (play) music A. The user can audibly recognize that the window A is the input target because the song A is playing. Of course, the fact that the window A is the input target can be visually recognized from the position of the mouse pointer as in the conventional case.

The main control unit 153 constantly (periodically) makes the above inquiry to the window management unit 152 and confirms the input target window to detect the switching (change) of the input target window. are doing.

If the mouse (in the input unit 1) is moved by an operation intended by the user or an unconscious (erroneous) operation,
If it is confirmed (detected) that the input target is changed from the window A to the window B as a result of the mouse pointer moving from the current input target window A and pointing to another window B, the main control unit 153 Is the acoustic information of the song B stored in the acoustic storage unit 3 (see FIG. 2A).
Is selectively read and this information is sent to the sound reproducing unit 4, so that the music B is played (reproduced) instead of the music A.

By switching the song played from the sound reproducing unit 4 from the song A to the song B, the user (even if his eyes are away from the screen and visually confirms the position of the mouse pointer). It is possible to audibly recognize that the input target window has been changed from the window A to the window B (even if not). Therefore, even if the mouse is unintentionally moved and the input target window is switched to another window, it is possible to prevent the state of the other window from being destroyed by the input operation without noticing the state. .

Next, in the case where the switching of the acoustic output according to the state change in the information processing apparatus as shown in FIG. 1 is applied to the environment using the electronic mail system (at least the environment capable of receiving the electronic mail), This will be described with reference to FIG. The same parts as those in FIG.

FIG. 5 is a block diagram showing the configuration of an information processing device capable of receiving at least electronic mail. In the figure, the control unit 25 corresponds to the control unit 5 in FIG.
It is realized by a CPU or the like. The control unit 25 includes functional elements of an electronic mail temporary storage unit 251, an electronic mail management unit 252, and a main control unit 253.

The electronic mail temporary storage unit 251 is for temporarily storing an electronic mail sent from the communication line via the input unit 1. E-mail management unit 2
Reference numeral 52 is for determining arrival of an e-mail and reading of the arrival e-mail based on the information in the e-mail temporary storage unit 251.

The main control unit 253 is an electronic mail management unit 25.
2 is used to confirm whether or not an e-mail has arrived, and further confirm that the e-mail has been read, and according to the change in the mail state in the e-mail temporary storage unit 251, a plurality of sounds stored in the sound storage unit 3 are detected. Information is selectively used, and one of them is selectively output to the sound reproducing unit 4.

Next, the operation of the configuration shown in FIG. 5 will be described. First, it is assumed that an email can be received while performing other work in an environment where the email can be received. In the electronic mail system, generally, an incoming mail is temporarily stored in a specific place (here, the electronic mail temporary storage unit 251), and the user retrieves it.

Here, when the electronic mail has not arrived, the music is played at a speed A (for example, a fast tempo), and when the electronic mail arrives (the same), the music is played at a speed B (for example, a slow tempo). And

First, the electronic mail temporary storage unit 251 in the control unit 25 temporarily stores the electronic mail sent from the communication line via the input unit 1. The email management unit 252 monitors the storage state of emails in the email temporary storage unit 251.

The main control unit 253 is an electronic mail management unit 25.
2 is inquired as to whether or not an e-mail addressed to the user of the information processing device in FIG. 5 is stored in the e-mail temporary storage unit 251. If the inquiry confirms that the electronic mail has not arrived, the main control unit 253 selects the acoustic information of the speed A stored in the acoustic storage unit 3 (see FIG. 2C). Read out, and this information is sent to the sound reproducing section 4 to continue (play) the music of speed A.

The user can hear that the electronic mail addressed to him / herself has not arrived because the music of speed A is flowing. The main control unit 253 constantly (periodically) makes the above inquiry to the electronic mail management unit 252 to confirm that the electronic mail addressed to the user has arrived, and that the received electronic mail is read. I am trying to confirm (detect) that it was done.

If the inquiry to the electronic mail management unit 252 confirms that a new electronic mail addressed to the user has arrived, the main control unit 253 determines that the speed B stored in the acoustic storage unit 3 is B. Acoustic information (Fig. 2
(See (c)) is selectively read out, and this information is sent to the sound reproducing section 4, so that the music of speed B (although it is the same music) is played (reproduced) instead of the music of speed A. .

The user can hear that the electronic mail addressed to him / herself has arrived because the music of speed B is flowing. This speed B song continues to flow until an incoming email is read by the user, as described below. For this reason, the user
When switching from the music of No. 5 to the music of speed B, that is, when the e-mail arrives, even if the device of FIG. By doing so, you can immediately notice that the email has arrived.

The main control unit 253 keeps playing the music of speed B from the sound reproduction unit 4 while the electronic mail management unit 252 is in operation.
If it is confirmed that the arrival mail has been read by the user by repeating the above inquiry to
If the e-mails stored in the e-mail temporary storage unit 251 are exhausted), the currently playing music of speed B is switched to the music of speed A again.

Next, the switching of the acoustic output according to the state change in the information processing equipment as shown in FIG. 1 has a plurality of input modes such as Japanese input and English (English) input in the document editing system. The case of applying to the input environment will be described with reference to FIG. The same parts as those in FIG.

FIG. 6 is a block diagram showing the configuration of an information processing device that supports the document editing system. In the figure, the control unit 35 corresponds to the control unit 5 in FIG.
It is realized by a CPU or the like. The control unit 35 includes an input mode storage unit 351, an input mode management unit 352, and a main control unit 3.
It has 53 functional elements.

The input mode storage unit 351 stores the input mode of the document editing system at that time. The input mode management unit 352 includes an input mode storage unit 35.
1 is referred to, and the content of the input mode storage unit 351 is updated to the latest input mode.

The main control section 353 has an input mode management section 35.
2 is used to confirm the switching of the input mode, and according to the switching, a plurality of pieces of acoustic information stored in the acoustic storage unit 3 are selectively used, and one of them is selectively output to the acoustic reproduction unit 4. .

Next, the operation of the configuration shown in FIG. 6 will be described. First, in the input environment of a document editing system having a plurality of input modes, it is assumed that these input modes are used properly to create and edit a document. To switch modes, a user generally performs a specific input operation for mode switching (from the input unit 1) such as operating a specific key on the keyboard, and a corresponding mode switching signal is input to the control unit 35. It is realized by being done.

There are two input modes, a Japanese input mode and an English (English) input mode,
In the Japanese input mode, the music is played in the tone A (for example, low tone), and in the English input mode, the song is played in tone B (for example, the high tone).

First, the input mode storage unit 35 in the control unit 35
1 stores the input mode of the document editing system at that time. The control unit 35 uses the input mode storage unit 35.
While referring to 1 to determine the input mode at that time,
The input mode storage unit 351 receives an input mode change (mode switching) process given via the input unit 1.
Update the contents of.

The main control section 353 has an input mode management section 35.
2 is inquired about the input mode and the input mode at that time is confirmed. For example, if it is confirmed that the input mode is the Japanese input mode, the acoustic information of the tone A stored in the acoustic storage unit 3 is confirmed. (See FIG. 2B) is selectively read out, and this information is sent to the sound reproducing section 4 to continuously play (reproduce) the music of tone A.

The user can audibly recognize that the Japanese input mode is set because the music of tone A is played. By the way, the main control unit 353 constantly (periodically) makes the above inquiry to the input mode management unit 352 to confirm (detect) the input mode at that time.

If it is confirmed from the inquiry to the input mode management unit 352 that the input mode is changed from the Japanese input mode up to that time to the English input mode, the main control unit 353 causes the sound storage unit 3 to store the input mode. By selectively reading out the stored sound information of the tone B (see FIG. 2B) and sending this information to the sound reproducing unit 4, instead of the song of the tone A, this time (although it is the same song, ) Continue playing (playing back) the music of note B.

The user has switched the tone of the music played from the sound reproducing section 4 from tone A to tone B, so that (even if the eyes are away from the screen, the input mode is visually confirmed. It is possible to auditorily recognize that the input mode has been switched from the Japanese input mode to the English input mode. Therefore, even if the input mode is changed unknowingly by performing the mode switching operation, it is possible to prevent the input operation from being performed without noticing the state.

The present invention is not limited to the above embodiment. For example, in the above-described embodiment, the change of the input target window, the presence or absence of the arrival of the email, and the switching of the acoustic output when there is a change in the input mode switching have been described. It can also be applied to the acoustic output according to other state changes in the information processing device such as the state of, and the amount of main memory used.

Further, in the above-mentioned embodiment, the music is continuously played, but in the document editing system (or the multiple window system), for example, a period during which some input operation is performed (for example, the keyboard of the input section 1). The key may be played only during the period when the key is pressed). However, since the period of input operation is short, not a song (melody) but some sound is played at the type, tone or speed of the sound assigned to the input mode (input target window) at that time. It is preferable.

It is also possible to forcibly turn off the playing music (sound), for example, by the operation of the user (forcibly stop the reproduction output on the way). Even in this case, if a state change is confirmed thereafter, it is possible to perform acoustic output in a form corresponding to the new state.

Further, in the above embodiment, different acoustic information is prepared for each state in the acoustic storage unit 3 so that different acoustic output can be performed for each state.
It is also possible to prepare different types of acoustic information and perform acoustic processing on the acoustic information to perform acoustic output with different tones and speeds. In addition, a sound signal (for example, a broadcast signal) flowing in a wired or wireless manner may be received, and an acoustic process such as modulating the received signal may be performed to perform sound output with different tones. In this case, the acoustic storage unit 3 becomes unnecessary. In addition, the present invention is within the scope of the invention,
Various modifications can be implemented.

[0065]

As described in detail above, according to the present invention, a change in a predetermined type of state in an information processing device (change of an input target window in a multiple window system, switching of an input mode in a document editing system, electronic The arrival of e-mail in the mail system, etc.) can be known by the acoustic output different from that before the change.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of stored data in an acoustic storage unit 3.

FIG. 3 is a flowchart for explaining switching control of acoustic output according to a state change in the configuration of FIG.

FIG. 4 is a schematic configuration diagram showing an embodiment of an information processing device when the switching of the acoustic output according to the state change is applied to an environment using a multiple window system.

FIG. 5 is a schematic configuration diagram showing an embodiment of an information processing device in the case where switching of acoustic output due to a state change is applied to an environment using an electronic mail system.

FIG. 6 is a schematic configuration diagram showing an embodiment of an information processing device when the switching of the acoustic output according to the state change is applied to an input environment having a plurality of input modes.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input part, 2 ... Output part, 3 ... Sound storage part, 4 ... Sound reproduction part, 5, 15, 25, 35 ... Control part, 151 ... Window state storage part, 152 ... Window management part, 153.
253, 353 ... Main control unit, 251 ... E-mail temporary storage unit, 252 ... E-mail management unit, 351 ... Input mode storage unit, 352 ... Input mode management unit.

Claims (8)

[Claims] 1. A man-machine interface method applied to an information processing device for performing various processes, wherein a sound different from a sound output before the change according to a change of a predetermined type state in the information processing device. A man-machine interface method characterized by notifying a user of the change of the state by outputting. 2. A man-machine interface method applied to an information processing device supporting a multi-window environment, wherein the sound output before the change is different depending on a change of an input target window in the multi-window environment. A man-machine interface method characterized by notifying a user of the change of the input target window by outputting sound. 3. A man-machine interface method applied to an information processing device capable of receiving an electronic mail, wherein an acoustic output different from the acoustic output before the arrival is made according to the arrival of the electronic mail. , A man-machine interface method characterized by notifying a user of the arrival of the electronic mail. 4. A man-machine interface method applied to an information processing device that supports an input environment having a plurality of input modes, wherein the man-machine interface method is different from the acoustic output before the change depending on the switching of the input mode. By outputting sound, the user is notified of the switching of the input mode.
Machine interface method. 5. An information processing device for performing various processes, a sound output unit for outputting a sound, and a change in a predetermined type of state in the information processing device is detected, and the sound is detected according to the detected state change. An information processing apparatus comprising: a control unit that causes the output unit to output a sound different from that before the state change is detected. 6. An information processing device supporting a multi-window environment, an acoustic output means for performing acoustic output, a window state storage means for storing a state of each window handled in the multi-window environment, and an input target Window management means for discriminating an input target window from the position of a position indicator pointing to an arbitrary position of the window and the stored contents of the window state storage means, and when the input target window discriminated by the window management means is changed, An information processing apparatus, comprising: a control unit that causes the sound output unit to output a sound different from that before the change. 7. An information processing device capable of receiving an electronic mail, an acoustic output means for outputting an acoustic sound, an electronic mail temporary storage means for temporarily storing the received electronic mail, and an electronic mail temporary storage means. An information processing device, comprising: a control unit that causes the sound output unit to output a sound different from that before the arrival in response to the arrival of an electronic mail in the storage unit. 8. In an information processing device supporting an input environment having a plurality of input modes, a sound output means for outputting a sound, an input mode storage means for storing a set input mode, and an input mode Input means for inputting a switching instruction, input mode management means for accepting an input mode switching instruction from the input means, and changing the contents of the input mode storage means, and the input mode storage means for the input mode storage means. An information processing device comprising: a control unit that causes the sound output unit to output a sound different from that before the change when the content of the unit is changed.