JPH08305531A - Agent interface system for household appliance personal computer - Google Patents

Abstract

PURPOSE: To establish an agent communication interface between a household appliance AP(application program) and an agent by registering an AP event reference table to the house appliance AP and informing an AP event from the household appliance AP to an agent manager. CONSTITUTION: An AP event reference table 41 of an AP control manager 4 stores information representing an AP event to be information by an household appliance AP 2 to an agent manager 3 corresponding to the household appliance AP (e.g. CD reproduction AP) 2. The agent manager is provided with a table registration means 31 and an event notice means 21, the table registration means 31 registers an application program to the household appliance AP 2 via an AP event reference table 41 of an AP control manager 4, and the event notice means 21 of the house appliance AP 2 informs an AP event to be informed to the agent manager 3 on the basis of the information of the AP event reference table 41 to the agent manager 3.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an agent interface system for home electric personal computers, and in particular, a television receiver (hereinafter abbreviated as TV), a facsimile device (hereinafter abbreviated as FAX), a telephone, a compact disc (hereinafter The present invention relates to an agent interface method for home electric personal computers that provides a more realistic user interface environment in a multimedia personal computer (hereinafter simply referred to as home electric personal computer) having a home electric appliance function such as a reproducing device.

[0002]

2. Description of the Related Art In a conventional home electric personal computer, a home electric appliance application program (hereinafter referred to as home electric appliance
(Abbreviated as P) is installed, registered as an icon, and the home appliance AP is activated by clicking the icon.

Although a technique for enabling an anthropomorphic operation using an agent (a function of operating a request and a notification from a user to and to a user as if there is an agent on the computer) has been realized. There is no agent interposed between the home appliance AP and the user, and the interface between the user and the agent is only text display for output and only input from a mouse or keyboard for input.

[0004] Furthermore, a shell (hereinafter referred to as a room shell) which is an image of a room according to a user's usage pattern / target (children, business, family, etc.) is changed to a home appliance AP
Although it was possible to start, the current state of the home appliance AP can be known when the room shell is displayed in full screen or when the home appliance AP started from the room shell is no longer displayed in the background. Instead, the user had to switch the home appliance AP.

[0005]

In the above-mentioned conventional home electric personal computer, the home electric appliance AP is activated by registering the home electric appliance AP as an icon and clicking the icon. There is a problem that the operation is difficult to understand, especially for beginners.

[0006] Further, since the notification given to the user when the state of the home appliance AP is changed is only text display, and the response input from the user can be made only by the mouse or keyboard, the actual home appliance It is different from the operability of, and there is a problem that the operation is difficult to understand especially for a beginner.

Further, even when the home appliance AP can be activated from the room shell, the home appliance A activated from the room shell when the room shell is displayed in full screen.
There is a problem that the state of the home appliance AP is not displayed when P goes to the background.

In view of the above points, an object of the present invention is to register an AP event reference table in a home electric appliance AP and notify the agent manager of the AP event from the home electric appliance AP, so that the agent between the home electric appliance AP and the agent is notified. It is to provide an agent interface method for home electric appliances personal computers that establishes a communication interface.

Another object of the present invention is to enable the agent to notify the user of a message by active animation display and voice synthesis, and to enable the user to make a response and control the home appliance AP by voice input. Another object of the present invention is to provide an agent interface system for home electric personal computers that makes the interface between the home electric personal computer and human beings closer to humans.

Further, the state of the home electric appliance AP is displayed in the image of the home electric appliance in the room shell so that the state of the home electric appliance AP can be known with a feeling similar to that of the actual home electric appliance, and the convenience of the home electric appliance function is improved. The purpose is to provide an agent interface method for home appliances PCs.

[0011]

The agent interface method for home electric appliances personal computer according to the present invention is a multimedia personal computer in which home electric appliances AP controls home electric appliance functions. An operating agent manager and an AP control manager including an AP event reference table that holds information indicating AP events that correspond to the home electric appliances AP and that the home electric appliances AP should notify the agent manager, and an AP control manager that includes action information corresponding to the AP events. The agent manager is provided with table registration means for obtaining the AP event reference table from the AP control manager and registering it in the home electric appliance AP, and the home electric appliance AP is provided with the agent based on the information in the AP event reference table. The AP event to be notified to preparative manager comprises an event notification means for notifying the agent manager.

In the home appliance personal computer agent interface method of the present invention, the agent manager stores and learns AP events from the home appliance AP in an event DB, and stores and learns in the event DB. The AP based on the learned information
Message notification determining means for determining whether to notify the user of the message by obtaining the action information from the control manager, and an agent metaphor manager when the message notification determining means determines that there is a message to notify the user. And an AP control unit for controlling the home electric appliance AP by obtaining the action information from the AP control manager based on the response result of the user from the agent metaphor manager. The agent metaphor manager notifies the message by a synthetic voice, an agent notifying means, an animation displaying means for displaying the control of the home electric appliance AP by an animation of a personified agent, and a response for inputting a response from the user by voice recognition. And input means.

Further, the agent interface method for home electric appliance personal computer of the present invention is provided with a room shell which is an image of a room in which a home electric appliance image is arranged, and a home electric appliance AP activating means for activating the home electric appliance AP in the room shell,
An animation display processing unit that displays an animation according to the home appliance AP information from the home appliance AP, and a home appliance AP information notification unit that notifies the home appliance AP of the home appliance AP information. The agent metaphor manager includes animation display means for displaying an animation in which the agent operates the home appliance image in the room shell according to the response result of the user.

[0014]

In the agent interface system for home electric personal computer of the present invention, the home electric appliance AP (TV control AP, FAX control A) operated by the user is used in the interface between the home electric appliance function such as TV, FAX, telephone, CD reproducing device and the user.
P, telephone control AP, CD playback AP, etc.) and the agent are in the relationship between the client and the server, and the home appliance AP registers an AP event reference table holding AP events to be notified to the agent manager in the home appliance AP, The AP refers to the AP event reference table and sends the AP event to be notified to the agent manager.

In addition, when the agent manager needs to accumulate / learn AP events and notify the user of the message according to the result, the anthropomorphized agent uses a graphical interface to synthesize the message with voice and text. The display notifies the user, the response from the user is input by voice recognition, and the agent manager controls the home appliance AP according to the response result from the user.

Further, when the home appliance AP is activated from the room shell environment of the room image in which the home appliance image is placed, the AP event from the home appliance AP is notified to the agent manager and the room shell, and the agent manager notifies the user. When it is necessary to notify the message, the agent is displayed in a form suitable for the image of the room shell, and an animation is carried out in which the agent operates the home appliance AP in the room shell in response to the user's response to operate the home appliance AP. .

[0017]

The present invention will be described in detail with reference to the drawings.

FIG. 2 is a block diagram illustrating a hardware configuration of a home electric personal computer 100 equipped with an agent interface system for a home electric personal computer according to an embodiment of the present invention. The home electric appliance personal computer 100 includes a central processing unit (hereinafter abbreviated as CPU) 101 and a memory 10.
2, bus 103, pulse code modulation (hereinafter referred to as PCM
Sound codec 104 and CD-RO
M (read only memory) drive 105, FAX modem board 106, TV tuner board 107, sound mixer 108, microphone 109, speaker 11
0 and a telephone modular 111. In addition, the home appliance personal computer 100 has a display 11
2, the keyboard 113, and the mouse 114 are connected, and the telephone 115 can be selectively connected.

FIG. 1 is a block diagram showing the configuration of an agent interface system for home electric personal computers according to an embodiment of the present invention. The agent interface method for home electric appliances personal computer of the present embodiment includes a room shell 1, a CD reproducing AP (home electric appliances AP) 2, an agent manager 3,
AP control manager 4, agent metaphor manager 5, event database (hereinafter, event DB
6), a voice recognition engine 7, and a voice synthesis engine 8.

The room shell 1 is configured to include a home appliance AP activating means 11 for activating the home appliance AP, and an animation display processing means 12 for displaying an animation according to the home appliance AP information from the home appliance AP. Room shell 1
Is a shell in which, as illustrated in FIGS. 5 to 8, a home appliance image matching the image of the room is already registered in the image of the room. For example, in the case of a living room, an image of a home appliance such as a telephone or FAX is placed in the room.
If you click on the home appliance image with the mouse 114 etc.,
The home appliance AP associated with the home appliance image clicked by the home appliance AP activating means 11 is activated. For example, when the telephone image is clicked, the telephone control AP is activated.

CD playback AP2 as a home appliance AP is a CD
-A background management / control part for performing state management / control, etc. of the ROM drive 105, and an event notification means 21 for notifying the agent manager 3 of an AP event based on information in an AP event reference table 41 described later, and a home appliance. The home electric appliance AP information notifying means 22 for notifying the room shell 1 of the AP information is included.

The agent manager 3 has a memory 10
2 is a management / control portion that is resident on 2 and operates as a background to manage / control the agent, and acquires the AP event reference table 41 from the AP control manager 4 and registers the table in the home appliance AP; A
Event accumulating / learning means 32 for accumulating / learning AP events from P in the event DB 6, and action information 42 from the AP control manager 4 based on the learning information accumulated / learned in the event DB 6 to notify the user of the message. Message notification determination means 33 for determining whether or not to
And an agent display instruction means 34 for activating the agent metaphor manager 5 when the message notification determination means 33 determines that there is a message to be notified to the user, and an AP control means 35 for controlling the home appliance AP. Has been done.

The AP control manager 4 comprises an AP event reference table 41 and action information 42.

As shown in FIG. 3, the AP event reference table 41 is a table for holding information indicating AP events that the home appliance AP should notify the agent manager 3, and includes menu selection event, menu execution event,
A button selection event, file read information, file write information, mouse event, key event, AP-specific status notification, AP status control, and AP operation execution are held as AP events to be notified.

The action information 42 is information that describes, for each home appliance AP, how to control the home appliance AP or the agent based on a notification from the home appliance AP, a message to the user, a response from the user, and the like. The action information 42 is, for example, when the AP control manager 4 corresponds to the CD playback AP 2, the AP name (CDPLA
Y. EXE), notification from AP (notification of playback end), user notification message ("CD playback is finished. Do you want to play from the beginning?"), Response options ("Yes", "No") and AP control script ("Yes": PUSH
REPLAY, "No": TRAY OPEN &
SAVE DB).

The agent metaphor manager 5 is a foreground user interface portion for making a response / notification with an actual user, and an animation display means 51 for displaying the control of the home electric appliance AP by an animation of a personified agent, and a message. Agent notification means 52 for notifying the user with a synthetic voice through the voice synthesis engine 8 and response input means 53 for inputting a response from the user through the voice recognition engine 7 (or the keyboard 113 / mouse 114).

The event DB 6 is, for example, a CD playback AP 2
In the case of, as the learning information, the AP name (CD playing AP name: C
DPLAY. EXE), CD type (unique identifier for each CD: 1234343-334535), skip information (where the skip button was pressed: 1,
5, 7) and agent response information (how the agent responded to the question: yes).

Referring to FIG. 4, the processing on the home appliance AP side is as follows.
AP activation step S101, agent communication request (initialization) step S102, AP event reference table registration step S103, AP event notification step S104, request processing step S105, communication end notification step S106, and AP end Step S107
Consists of The home appliance AP side refers to the CD playback AP 2 and the room shell 1.

Similarly, referring to FIG. 4, the processing on the agent side is as follows: communication establishment step S201, AP control manager loading step S202, AP event reference table notification step S203, AP event accumulation step S204, AP control step. S205 and AP
Control manager unload step S206. The agent side means the agent manager 3 and the agent metaphor manager 5.

Next, the operation of the agent interface system for home-use personal computer of this embodiment having the above configuration will be described. Here, a case where the user activates the CD playback AP 2 from inside the room shell 1 will be described as an example with reference to FIGS.

FIG. 5 is a diagram showing an image of the room shell 1 on which the home appliance image is arranged. When the room shell 1 is activated, the agent manager 3 resides in the memory 102 and operates in the background.

When the user positions the mouse cursor on the image of the CD reproducing device in the room shell 1 and clicks the mouse 114, the room shell 1 activates the CD reproducing AP 2 by the home appliance AP activating means 11, as shown in FIG. , Enlarge the image (window) of the CD player (step S101).

When activated, the CD reproducing AP 2 requests the agent manager 3 to communicate via the agent communication interface (step S102), and requests the agent manager 3 for the AP event reference table 41.

The agent manager 3 establishes communication with the request of the AP event reference table 41 (step 201) and loads the AP control manager 4 corresponding to the CD reproducing AP 2 on the memory 102 (step S20).
2), pull out the AP event reference table 41 from the AP control manager 4, and use the table registration means 31 for the CD
The playback AP 2 is notified of the AP event reference table 41 (step S203).

The CD reproducing AP 2 registers the AP event reference table 41 notified from the agent manager 3 (step S103).

After that, the CD reproducing AP 2 uses the AP event reference table 41 to perform the AP event required by the event notifying means 21 (current reproducing CD type, reproducing position,
The agent manager 3 is notified of the end of reproduction, the skip information of the song by the user, etc. (step S104).
Further, the CD reproduction AP 2 notifies the room shell 1 of the reproduction position information by the home appliance AP information notification means 22.

When the room shell 1 receives the reproduction position information from the CD reproduction AP 2, the animation display processing means 12 displays the reproduction position in the image of the CD reproducing device. Here, from the state of the room shell 1 shown in FIG. 6, when the user clicks the CD playback device image minimize button to minimize the CD playback device image, or when the room shell 1 is clicked to activate it. Even if
As shown in FIG. 7, the room shell 1 causes the animation display processing means 12 to reduce and display the current CD track and time in the image of the CD reproducing device. As a result, the state of the CD playback AP 2 is always displayed in the room shell 1.

During reproduction of a CD, if the user operates the CD reproduction AP2 by clicking the enlarged CD reproduction device image and skips the tune of the CD being reproduced, the CD reproduction AP2 notifies the event. The means 21 notifies the agent manager 3 of the CD type and skip information as an AP event (step S10).
4).

The agent manager 3 causes the event storage / learning means 32 to store the CD type and skip information in the event DB 6 (step S204).

When the reproduction of the CD is completed, the CD reproduction AP2
Notifies the agent manager 3 that the reproduction of the CD is completed by the event notification means 21 (step S104).

Upon receiving the reproduction end notification, the agent manager 3 needs to take out the action information 42 for the CD reproduction end in the AP control manager 4 and notify the user of the message in the action information 42 by the message notification judging means 33. Determine if there is. In the case of the action information 42 for the reproduction end notification, it is determined that a message needs to be notified, and the agent manager 3 causes the agent display instruction means 34
To pass the access information 42 and activate the agent metaphor manager 5.

When the agent metaphor manager 5 is started, the agent is displayed in the room shell 1 by the animation display means 51 based on the passed action information 42 as shown in FIG. Then, the message "The playback of the CD is completed. Do you want to play it again from the beginning?" Is displayed in text, and the message is notified to the user by the agent notifying means 52 through the voice synthesizing engine 8 through the voice synthesis engine 8, and To wait for a response from.

When the user answers "Yes" by voice, the agent metaphor manager 5 inputs the response result from the voice recognition engine 7 through the response input means 53, notifies the agent manager 3 of the response result, and the animation display means. At 51, the agent displays an animation in the room shell 1 where the agent walks to the image of the CD player and presses the play button in the image of the CD player, and then the process ends.

In response to the response result, the agent manager 3 receives from the action information 42 the AP control script "PUSH REPLA" corresponding to the response option "Yes".
Y "is taken out, and the CD control A is performed by the AP control means 35.
Notify P2 as a CD playback command (step S2).
05).

Upon receiving the CD reproduction command, the CD reproduction AP 2 reproduces the CD from the beginning (step S10).
5).

On the other hand, when the user answers "No" by voice, the agent metaphor manager 5 inputs the response result from the voice recognition engine 7 through the response input means 53 and notifies the agent manager 3 of the response result.
The animation display means 51 displays an animation in which the agent takes out the CD from the image of the CD reproducing device in the room shell 1 and ends the processing.

The agent manager 3 receives the response result and, from the action information 42, the response option "No".
AP control script "TRAY OPEN" corresponding to
& SAVE DB "and the command for opening the CD tray by the AP control means 35 is issued to the CD playback AP.
2 is notified (step S205), and the event accumulation / learning means 32 accumulates in the event DB 6 the type of the CD currently being reproduced and the information indicating that the user did not reproduce again.

Upon receiving the command for opening the CD tray, the CD reproducing AP 2 receives the CD-ROM drive 105.
Open the CD tray of and prompt for replacement of the next CD.

Next time, when the user tries to reproduce the same CD, the CD reproducing AP 2 notifies the agent manager 3 of the type of the CD to be reproduced by the event notifying means 21 based on the AP event reference table 41 as an AP event ( Step S104).

Using the notified CD type as a key, the agent manager 3 searches the event DB 6 for learning information of the same CD using the event storage / learning means 32. If the learning information of the same CD exists and the skip information of the CD exists in the learning information, the agent manager 3 extracts the action information 42 for the same CD reproduction in the AP control manager 4, and the message notification determining means 33 causes the action. It is determined whether to notify the user of the message in the information 42. Same CD
In the case of reproduction, it is determined that the message is notified, and the agent manager 3 determines that the agent display instruction means 34
Then, the action information 42 is passed to activate the agent metaphor manager 5.

When the agent metaphor manager 5 is activated, it displays the agent in the room shell 1 by the animation display means 51 based on the passed action information 42, and the agent asks the user to "Listen to this CD before. Do you want to play them in the order that you want them to be played? "Is displayed in text, and the message is notified to the user by the agent notifying means 52 through the voice synthesizing engine 8 via the voice synthesizing engine 8 to wait for a response from the user.

When the user replies "Yes" by voice, the agent metaphor manager 5 inputs the response result from the voice recognition engine 7 through the response input means 53, notifies the agent manager 3 of the response result, and the animation display means. At 51, an animation is displayed in which the agent walks to the image of the CD player and presses the play button in the room shell 1, and the process ends.

In response to the response result, the agent manager 3 extracts the AP control script corresponding to the response option "Yes" from the action information 42, acquires the skip information from the event DB 6 by the event storage / learning means 32, and executes the AP control. C indicating the order of music to be reproduced by the means 35
The D reproduction command is notified to the CD reproduction AP 2 (step S205).

The CD playback AP2 is a CD indicating the order of songs to be played back.
When the reproduction command is received, the CD is reproduced in the order of the music indicated by the CD reproduction command (step S105).

On the other hand, when the user answers "No" by voice, the agent metaphor manager 5 inputs the response result from the voice recognition engine 7 through the response input means 53 and notifies the agent manager 3 of the response result.
The animation display means 51 displays an animation in the room shell 1 in which the agent walks to the image of the CD reproduction device and presses the reproduction button, and the process ends.

The agent manager 3 receives the response result and, from the action information 42, the response option "No".
The AP control script corresponding to is extracted, the type of the CD to be reproduced by the event accumulating / learning means 32 and the information indicating that the user did not reproduce the CDs in the order in which they were previously heard are accumulated in the event DB 6, and the AP controlling means A CD reproduction command for reproducing the music from the beginning is notified to the CD reproduction AP 2 (step S205).

Upon receiving the CD reproduction command, the CD reproduction AP 2 reproduces the CD from the beginning (step S10).
5).

On the other hand, to end the CD reproduction AP2, click the end button in the enlarged CD reproduction device image in the room shell 1. Then, the image of the CD player is reduced in the room shell 1 and displayed as C
The communication end notification is transmitted from the D reproduction AP 2 to the agent manager 3 (step S106), and the CD reproduction AP 2
Ends the process (step S107).

Upon receiving the communication end notification, the agent manager 3 unloads the AP control manager 4 corresponding to the CD reproducing AP 2 from the memory 102 (step S206).

In the description of the operation of the above embodiment, the case of the CD playback AP2 was described as an example of the home appliance AP, but the FAX control AP, the TV control AP, and the telephone control A.
It goes without saying that the operation is almost similar even in the case of P or the like.

[0061]

As described above, according to the present invention, the AP event reference table is registered in the home appliance AP by the table registration means of the agent manager, and the home appliance AP notifies the agent manager of the AP event by the event notification means of the home appliance AP. By doing so, home appliances A
The effect is that the agent communication interface between P and the agent manager can be easily established.

Further, the animation display means of the agent metaphor manager displays an active animation from the agent, the agent notification means notifies the user by voice synthesis, and the response input means outputs a voice from the user. By enabling the response input and the control of the home appliance AP, there is an effect that the interface between the home appliance personal computer and the human can be made closer to that of the human. In particular, the understanding level for beginners is improved.

Further, by displaying the state of the home electric appliance AP in the home electric appliance image in the room shell by the animation display processing means of the room shell, the state of the home electric appliance AP can be known with a feeling similar to that of an actual home electric appliance. There is an effect that the convenience of the agent metaphor manager and the home appliance function can be enhanced.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an agent interface system for home electric personal computers according to an embodiment of the present invention.

FIG. 2 is a block diagram showing an example of a hardware configuration of a home electric personal computer to which the agent interface system for home electric personal computers of this embodiment is applied.

FIG. 3 is a diagram showing an example of contents of an AP event reference table in FIG.

FIG. 4 is a diagram showing an example of a communication procedure of an agent communication interface in FIG.

5 is a diagram illustrating a state in which the mouse cursor is positioned on the image of the CD reproducing device in the room shell in FIG. 1. FIG.

FIG. 6 is a diagram illustrating a state in which an image of a CD reproducing device is enlarged in the room shell in FIG.

FIG. 7 is a diagram exemplifying a state in which the state of the CD playback AP is reduced and displayed even if the image of the CD playback device is reduced in the room shell in FIG.

8 is a diagram illustrating a state in which an agent is displayed as an animation in the room shell in FIG. 1. FIG.

[Explanation of symbols]

 1 Room Shell 2 CD Playback AP 3 Agent Manager 4 AP Control Manager 5 Agent Metaphor Manager 6 Event DB 7 Speech Recognition Engine 8 Speech Synthesis Engine 11 Home Appliance AP Starting Means 12 Animation Display Processing Means 21 Event Notifying Means 22 Home Appliance AP Information Notifying Means 31 Table registration means 32 Event storage / learning means 33 Message notification determination means 34 Agent display instruction means 35 AP control means 41 AP event reference table 42 Action information 51 Animation display means 52 Agent notification means 53 Response input means 100 Home electric personal computer 101 CPU 102 Memory 103 Bus 104 PCM Sound Codec 105 CD-ROM Drive 106 FAX Modem Board 107 TV Tuner Over de 108 Sound mixer 109 microphone 110 speaker 111 telephone outlet 112 display 113 keyboard 114 mouse 115 Telephone

Claims (5)

[Claims] 1. In a multimedia personal computer for controlling a home electric appliance function by a home electric appliance AP, in addition to the home electric appliance AP, an agent manager resident in a memory and operating in the background, and the home electric appliance AP corresponding to the electric home appliance AP. AP holding information indicating an AP event to be notified to the agent manager
An AP control manager including an event reference table and action information corresponding to an AP event is provided, and the agent manager obtains the AP event reference table from the AP control manager to obtain the home electric appliance A.
A table registration unit for registering with P is provided, and the home appliance AP is to be notified to the agent manager based on the information in the AP event reference table A
An agent interface system for a home electric appliance personal computer, comprising an event notifying means for notifying a P event to the agent manager. 2. The agent control means stores / learns AP events from the home appliance AP in an event DB, and the AP control manager based on learning information stored / learned in the event DB. Message notification determining means for determining whether or not to notify the user of the action information obtained from the above, and the agent metaphor manager is activated when the message notification determining means determines that there is a message to notify the user. The home electric appliance personal computer according to claim 1, further comprising: an agent display instructing means for controlling the home electric appliance AP, which obtains the action information from the AP control manager based on a response result of a user from the agent metaphor manager to control the home electric appliance AP. Agent interface method. 3. The agent metaphor manager includes an agent notifying means for notifying a message by a synthetic voice, an animation displaying means for displaying control of the home electric appliance AP by an animation of a personified agent, and a response from a user by voice. 3. The agent interface system for home electric appliances personal computer according to claim 2, further comprising a response input means for inputting by recognition. 4. An electric home appliance AP activating means for activating the electric home appliance AP in a room shell, which is an image of a room in which an electric home appliance image is arranged, and the electric home appliance AP.
And an animation display processing means for displaying an animation according to the home appliance AP information from the home appliance A for notifying the home appliance AP of the home appliance AP information to the room shell.
4. The home appliance personal computer agent interface system according to claim 3, further comprising P information notifying means. 5. The agent interface system for home electric appliance personal computer according to claim 4, wherein the agent metaphor manager includes animation display means for displaying an animation in which the agent operates an electric home appliance image in the room shell according to a response result of a user. .