JPH08106421A - Information processor - Google Patents

Abstract

PURPOSE: To obtain a graphical user interface which is suitable for a desired operation environment by changing a graphical user interface provided for a monitor when each information processor sends or receives a video mail. CONSTITUTION: This information processor consists of clients 100, a server 101, and a network 102. Each client 100 is equipped with a multi-operation- environment providing means which can change the graphical user interface provided for the monitor at the time of transmitting and receiving operation for the video mail. This multi-operation-environment providing means is realized actually by software. Then when a user inputs an instruction for selecting the kind of a desired operation environment through an instruction input means, the multi-operation environment providing means changes a display screen displayed on a display device at the time of the transmitting and receiving operation for video mails so that a display screen of a kind that the user selects is displayed on the display device.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus for transmitting and receiving a video mail including moving picture data to and from another information processing apparatus via a network, and more particularly to a video mail transmission / reception operation. The present invention relates to a technique for improving user friendliness.

[0002]

2. Description of the Related Art Conventionally, a plurality of information processing devices are connected via a network, and each information processing device transmits moving image data along with voice data, text data, graphic data, etc., and other information as video mail via the network. A video mail system is constructed so as to send and receive to and from a processing device.

In such a system, various techniques have been devised in order to improve the usability of the user during the operation of transmitting and receiving a video mail.

For example, as described in Japanese Patent Laid-Open No. 258056/1992, the information processing device of the transmission source of the video mail first makes a representative still image from the moving picture data of the video mail to be transmitted. Image data is selected and transmitted to the information processing device of the transmission destination, and the information processing device of the transmission destination displays the still image data on the display device to confirm that there is a video mail to be received and the video mail. The incoming call is displayed to show the user who sent the mail. Furthermore, the user of the information processing device at the destination is
A video mail reception operation is performed by selecting the displayed still image data. This improves the usability of the user during the operation of receiving the video mail.

Further, for example, as described in Japanese Patent Laid-Open No. 4-177449, the guidance message displayed at the time of operation is changed according to the level and proficiency level of the user who is using the information processing apparatus. I am trying.
As a result, for beginners, a kind and rich guidance message is displayed, and for a skilled person, the troublesome guidance message is omitted, and only the minimum necessary guidance message is displayed. Is improved.

[0006]

The above-mentioned prior art is a technology for improving the user interface and improving the usability of the user.

However, when a video mail system is constructed by connecting a variety of information processing devices to a network, the hardware and software environment of each information processing device is different, so the operating methods for sending and receiving video mail are unified. Is difficult.

Further, when moving image data is handled, not only the moving image data is taken in by a video camera one by one, but also already stored moving image data may be used. At this time, the user operates the operating system of the information processing apparatus. Since the operating environment of and the operating environment of the software related to the video mail system are used together, if the operating environments of the two are different, the operability of the user is rather deteriorated.

When the CPU of the information processing device compresses / decompresses the moving image data without the information processing device having a dedicated compression / decompression device, the CPUs of the individual information processing devices have different processing capacities. There is a difference in displayable moving image data between an information processing device having high processing capability and an information processing device having low processing capability. Therefore, in some information processing devices, there is a case where moving image data cannot be displayed, and in order to prevent this, all information processing up to a level at which the information processing device with the lowest CPU processing power can display is performed. In the device, it is necessary to reduce the quality of moving image data.

An object of the present invention is to improve the usability of a user during a video mail transmission / reception operation in an information processing apparatus that transmits / receives a video mail including moving image data to / from another information processing apparatus via a network. Is to let.

Specifically, among the plurality of types of display screens for giving instructions necessary for transmitting / receiving the video mail, the type of display screen desired by the user can be displayed on the display device. Another object of the present invention is to improve the usability of the user during the transmission / reception operation of video mail by changing the display screen displayed on the display device during the transmission / reception operation of.

In the present specification, moving image data is continuous image information capable of transmitting the motion of an object or the like, and is information that can be processed by being digitized and compressed. is there.

[0013]

In order to achieve the above object, the present invention provides an input device for receiving an input of moving image data, a display device for displaying a display screen, and an instruction input device for receiving an input of an instruction, In an information processing device that includes a processing device and transmits / receives a video mail including moving image data to / from another information processing device via a network, the instruction input device may include an instruction necessary for a video mail transmission / reception operation. An instruction to select an arbitrary type of display screen among multiple types of display screens in which a part of the video data included in the transmitted / received video mail is displayed so that the instruction input device can accept And the processing device causes the video device to display a display screen of the type selected by the instruction received by the instruction input device on the display device. Le when receiving operation is to have a multi-operating environment providing means for changing the display screen displayed on the display device.

The plurality of types of display screens have, for example, different positional relationships between moving image data and an instruction menu or an area for displaying the instruction content, which is an area showing an instruction necessary for transmitting and receiving a video mail. For example, an instruction menu, which is an area showing instructions necessary for transmitting and receiving a video mail, may be displayed on a display screen, or a controller of a different type of device (telephone set, video tape deck, intercom, video game console). etc)
The display screen may have a pseudo-shape.

Further, the instruction input device can be adapted to receive an input of information indicating the processing capacity of the processing device. In this case, the multi-operation environment providing means further can provide the instruction. A display form of the moving image data displayed on the display device by changing at least one of the resolution of the moving image data, the number of frames per second, and the number of colors according to the processing capacity indicated by the information received by the input device. Can be changed.

Further, the instruction input device can be made to accept the input of information indicating the processing capacity of the processing device of another information processing device to which the video mail should be transmitted. The multi-operation environment providing means further changes at least one of the resolution of the moving image data, the number of frames per second, and the number of colors according to the processing capacity indicated by the information received by the instruction input device, thereby The quality of the moving image data included in the video mail to be transmitted to the information processing device can be changed.

Further, the instruction input device receives an instruction to select an arbitrary type of display screen from a plurality of types of display screens for indicating the presence of a video mail transmitted from another information processing device. In such a case, the multi-operation environment providing means may further use the instruction received by the instruction input device to indicate the presence of the video mail transmitted from another information processing device. The display screen displayed on the display device may be changed so that the display screen of the selected type is displayed on the display device.

[0018]

For example, as a plurality of types of display screens for allowing the above-mentioned instruction input device to accept an instruction required for transmitting / receiving a video mail, (1) moving image data and a transmitting / receiving operation for a video mail A display screen in which the instruction menu is displayed inside the same window by dividing the window (2) A moving image window displaying moving image data, and
A display screen in which each instruction window displaying an instruction menu is displayed (3) An icon is displayed outside the moving image window, and when the icon is selected, the instruction window is displayed. Display screen (4) When four types of display screens such as a display screen in which an instruction menu is displayed inside the moving image window are prepared, the user gives an instruction to select the type of desired operating environment ( In fact, it is an instruction indicating the type of the desired display screen.) Is input from the instruction input device, the multi-operation environment providing means displays the type of display selected by the user among these display screens. The display screen displayed on the display device is changed when the video mail is transmitted / received so that the screen is displayed on the display device.

Therefore, the user can select a desired operating environment by selecting a display screen that is easy for the user to operate, which improves usability.

[0020]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a system configuration diagram of the video mail system of this embodiment.

In FIG. 1, 100 is a client, 1
Reference numeral 01 is a server, and 102 is a network.

In the client 100, the user
When transmitting a video mail including moving image data and audio data to another user, the information indicating the destination user and the video mail are transmitted to the server 101 via the network 102 to be stored in the server 101. Further, when a user receives a video mail sent from another user, the user sends the video mail stored in the server 101 together with the information showing the user of the transmission destination to the user via the network 102. Read from the server 101.

FIG. 2 is a block diagram of the client 100.

In FIG. 2A, 200 is a video camera, 201 is a microphone, 202 is an operation input device, 203 is a monitor, 204 is a speaker, 205 is an input / output interface device, 206 is a CPU, 207 is a main memory, and 208.
Is a storage device, and 209 is a network interface device.

The client 100 is equipped with an operation input device 202 such as a keyboard and a mouse, and the user can perform a video mail transmission / reception operation by inputting an instruction from the operation input device 202.

The client 100 also comprises a video camera 200 for inputting moving image data, a microphone 201 for inputting audio data, a monitor 203 for displaying at least moving image data, and a speaker 204 for outputting audio data.

The input / output interface device 205
2B, as shown in FIG. 2B, a video A / D conversion device 205a that digitally converts moving image data input by the video camera 200, and an audio A / D conversion device 205 that digitally converts audio data input by the microphone 201.
b, a video D / A conversion device 206 that converts the moving image data of the video mail to analog and outputs it to the monitor 302
c, an audio D / A conversion device 205d that converts the voice data of the video mail to analog and outputs it to the speaker 204.

Further, the configuration shown in FIG.
Shows the case of compressing / decompressing moving image data, but C
When the PU 206 does not compress / decompress moving image data, a dedicated compression / decompression device is provided.

In this embodiment, the client 100
Is equipped with a multi-operation environment providing means capable of changing the graphical user interface provided to the monitor 203 when transmitting / receiving a video mail. The multi-operation environment providing means can be actually realized by software, and the software configuration of the client 100 will be described below with reference to FIG.

In FIG. 3, 300 is a video mail system, 301 is an input control system, 302 is an output control system, 303 is a multi-operation environment providing system, 304.
Is a video mail basic system, 320 is a graphical user interface, and 330 is an operating system (OS).

The OS 330 controls the operation of the entire client 100, and the graphical user interface 32
0 is provided to the monitor 203. Here, the graphical user interface 320 is an aggregate of a plurality of types of graphic data for performing a plurality of types of graphic display, as shown in FIG. 4, and the OS 330 follows one of these graphic data. The graphical user interface 320 is provided to the monitor 203 by performing the graphic display.

The OS 330 and the graphical user interface 320 may differ in type depending on the type of hardware constituting the client 100 and the purpose of use of the client 100. Also, O
S330 may be operated by multitasking or single tasking. Further, the OS 330 may be included in the server 101, and the client 100 may include only the graphical user interface 320.

The video mail system 300 includes an input control system 301, an output control system 302, a multi-operation environment providing system 303, and a video mail basic system 3.
04, which are application programs running on the graphical user interface 320. The multi-operation environment providing system 303 of the video mail system 300 corresponds to a multi-operation environment providing means.

Incidentally, 310 is the video mail system 30.
An application program other than 0 is shown, and it may be operated in conjunction with the video mail system 300 if necessary.

All the software shown in FIG. 3 is stored in the storage device 208, and by the CPU 206,
It is loaded into the main memory 207 and executed. Further, these software are configured as modules having respective functions, and operate by exchanging messages between the modules.

Next, the operation of this embodiment will be described with reference to FIGS. 5 and 6.

In this embodiment, in the client 100, the multi-operation environment providing system 303 uses the OS 330.
Is to change the graphical user interface 320 provided to the monitor 203.

The OS 330 displays the graphic display of the type notified from the multi-operation environment providing system 303 among the plurality of types of graphic display such as the display screen examples shown in FIGS. 5 (a) to 5 (e). By doing so, the monitor 203 is provided with a graphical user interface 320.

In this embodiment, the OS 330 is especially used.
However, the case where the graphical user interface 320 that displays a window is provided will be described as an example, but the graphical user interface 320 that does not display a window may be used.

In FIG. 5A, moving image data and an instruction menu 500 for transmitting / receiving video mail are displayed on the display screen so as to divide the display screen.

Further, in FIG. 5B, the instruction window 50 displaying the instruction menu 500 is displayed on the display screen.
1 is displayed so as to overlap the moving picture window 502 displaying the moving picture data.

In FIG. 5C, a video mail transmission / reception operation menu 503 is displayed outside the moving picture window 502 on the display screen. When the menu 503 is selected, the instruction window 501 is displayed. Is displayed as a pull-down window.

In FIG. 5D, the display screen has an instruction menu 500 inside the moving image window 502.
Is displayed.

Further, in FIG. 5E, the instruction window 501 is displayed on the display screen so as to overlap the moving image window 502. This example is particularly suitable for an operation method of directly inputting an instruction from a keyboard or the like, not an operation method of selecting a desired instruction from the instruction menu 500.

The user inputs, from the operation input device 202, an instruction to select a desired type of operating environment (this is actually an instruction to indicate a desired type of graphic display). This instruction is accepted by the multi-operation environment providing system 303 and notified to the OS 330.

That is, as shown in FIG. 6, when the multi-operation environment providing system 303 receives the instruction indicating the type of operation environment input from the operation input device 202 (step 600), the received type is sent to the OS 330. By notifying (step 601), the OS 330 selects the graphic data corresponding to the notified type so as to be the graphic display (step 602), and performs the graphic display according to the selected graphic data.
Monitor the graphical user interface 320
3 (step 603).

As described above, since the OS 330 changes the graphical user interface 320 provided to the monitor 203 according to the operating environment desired by the user, the user can select the desired operating environment. This makes it possible to improve the usability when sending and receiving video mail.

By the way, moving image data can be processed by being digitized and data compressed. Especially, when the CPU 206 of the client 100 compresses / expands moving image data, the processing capacity of the CPU 206 is different. However, there is a difference in moving image data that can be displayed on the monitor 203. Also, the monitor 2 of the client 100
If the resolution of 03 is different, it is necessary to adjust the display form of the moving image data.

Therefore, an example in which the display form when displaying moving image data on the monitor 203 is changed in the client 100 according to its processing capability will be described with reference to FIGS. 7 to 9.

In addition, in the client 100, as shown in FIG.
Information indicating the corresponding display form is stored in the storage device 208.
It is stored in.

The OS 330 can display moving image data in a plurality of types of display forms, such as the display screen examples shown in FIGS. 8A to 8C, and the multi-operation environment providing system 303. The moving image data is displayed in a display form according to the type of the CPU 206 notified from.

In FIGS. 8A to 8C, the resolutions of the moving image data are different from each other.
Although FIG. 8 shows an example of the graphic display shown in FIG. 5A, the same applies to other graphic displays.

For example, when the CPU 206 has a sufficient processing capacity, as shown in FIG.
670 colors or more), full motion (30 frames per second), and operation data are displayed at a resolution of 640 × 480 dots. Further, for example, in the case where the processing capacity of the CPU 206 is half that in the case shown in FIG.
As shown in FIG. 8B, the size of the operation data is displayed with a resolution of 480 × 360 dots which is one half. Further, for example, when the processing capacity of the CPU 206 is 1/4 of that shown in FIG. 8A, the size of the operation data is set to 1/4 as shown in FIG. 8C. Of 320
Display with a resolution of × 240 dots.

In addition to the example described above, the number of frames per second can be reduced and the number of colors can be reduced, and by combining these, the CPU
The processing of 206 can be reduced.

In the above example, the moving image data is displayed according to the predetermined resolution.
It is also possible for the user to arbitrarily set the resolution value.

The user inputs information indicating the type of CPU 206 to be used (this is actually an instruction indicating the display form of moving image data) when the client 100 is installed or used. The instruction input from 202 is accepted by the multi-operation environment providing system 303 and notified to the OS 330.

That is, as shown in FIG. 9, when the multi-operation environment providing system 303 receives the information indicating the type of the CPU 206 input from the operation input device 202 (step 900), it notifies the OS 330 of the received type. Then (step 901), the OS 330 selects the display form corresponding to the notified type (step 902) and displays the moving image data on the monitor 203 in the selected display form (step 903).

As described above, since the display form of the moving image data on the monitor 203 is changed according to the processing capability of the client 100, the client 100
It is possible to provide the optimal environment for.

On the other hand, it is possible to change the display contents of the instruction menu when transmitting / receiving a video mail.
Hereinafter, an example in which the display content of the instruction menu is changed in the client 100 will be described with reference to FIGS. 10 and 11.

This may be achieved by allowing the graphic data forming the graphical user interface 320 to include a plurality of graphic data having different display contents of the instruction menu.

The OS 330 is shown in FIGS.
The graphical user interface 220 is provided to the monitor 203 by performing the graphic display of the type notified from the multi-operation environment providing system 303 among the multiple types of graphic display such as the display screen example shown in (d).

Although FIG. 10 shows an example of the graphic display shown in FIG. 5A, the same applies to the other graphic displays.

In FIGS. 10A to 10D, moving image data and instruction menu are displayed on the display screen so as to divide the display screen.

Then, the instruction menu in FIG. 10 (a) is a display such that the operation of transmitting and receiving the video mail can be performed by an operation method simulating the operation method of the telephone, and in FIG. 10 (b). The instruction menu is displayed so that video mail transmission / reception operations can be performed by an operation method that simulates the operation method of the video tape deck. The instruction menu in FIG. 10C simulates the operation method of the intercom. The display is such that the operation of transmitting / receiving the video mail can be performed by the operation method described above. The instruction menu in FIG. 10D is the operation of simulating the operation method of the controller of the video game console. The display is such that operations can be performed.

The user gives an instruction to select the type of desired operation method (this is actually an instruction indicating the type of desired graphic display).
This instruction is input by the multi-operation environment providing system 303 and is notified to the OS 330.

That is, as shown in FIG. 11, when the multi-operation environment providing system 303 receives an instruction input from the operation input device 202 and indicating the type of operating method (step 1100), the received type is sent to the OS 330. By notifying (step 1101), the OS 330 selects the graphic data corresponding to the notified type (step 1102), and performs the graphic display according to the selected graphic data to display the graphical user interface. 320 is provided to the monitor 203 (step 1103).

Therefore, for example, when the user selects an operation method simulating the operation method of the telephone, FIG.
Since the display screen shown in (a) is displayed, when a video mail is received on this display screen, an area 1000 imitating a handset is selected to input a video mail reception instruction. Also, when transmitting a video mail, by selecting the area 1001 simulating a push button, the destination information such as the telephone number indicating the destination user is input, and then by selecting the area 1000, the video Enter the instruction to send the email. The input destination information is displayed in the area 1002.

Further, for example, when the user selects an operation method simulating the operation method of the video tape deck,
Since the display screen shown in FIG. 10B is displayed, when a video mail is received on this display screen, an area 1005 simulating a video tape deck is selected to input a video mail reception instruction. Further, when transmitting a video mail, by selecting the area 1004 designated by the operation button of the TV tuner, the destination information such as the telephone number indicating the user of the destination is selected, and then the area where the video tape is simulated. By selecting 1005, a video mail transmission instruction is input. In addition,
The selected destination information is displayed in the area 1006.
In addition, the user selects the area 1003 (the area corresponding to “play”, “record”, “fast forward”, “rewind”, etc.) that simulates the operation button of the video tape deck to receive or send the received video mail. You can edit the video data of the video mail that should be sent.

Further, for example, when the user selects an operation method simulating the operation method of the intercom, FIG.
Since the display screen shown in (c) is displayed, when a video mail is received on this display screen, an area 1007 simulating an intercom is selected to input a video mail reception instruction. Further, at the time of transmitting the video mail, the switch of the monitor of the interphone is instructed to the simulated area 1008, and the image displayed in the simulated area 1009 of the monitor of the intercom and showing the user who can be the destination can be changed. Image is selected, and then the area 1007 is selected, thereby inputting a video mail transmission instruction. The image displayed in the area 1009 is registered in the storage device 208 of the client 100 in advance, and may be still image data or moving image data, or is a symbol indicating the user of the transmission destination. Is also good. Further, in the area 1010, destination information such as a telephone number indicating the user of the selected destination is displayed.

Also, for example, when the user selects an operation method that simulates the operation method of the controller of the video game machine, the display screen shown in FIG. 10 (d) is displayed. Area 1011 simulating the operation buttons of the controller when receiving mail
Select to enter a video mail reception instruction. In addition, when transmitting a video mail, the destination information displayed in a region 1013 for displaying the destination information such as a telephone number indicating a user who can be a destination by designating an area 1012 simulating a joystick of the controller. By switching, the desired destination information is selected, and then the area 1011 is selected to input the video mail transmission instruction. Note that the area 1013
The transmission destination information displayed in is registered in the storage device 208 of the client 100 in advance.

As described above, the graphical user interface 320 depends on the operation method desired by the user.
Since it is changed, it is possible to provide an optimum operating environment simulating an input device that the user is familiar with.

The display screen desired by the user is selected from both the graphical user interface 320 having the display screen shown in FIG. 5 and the graphical user interface 320 having the display screen shown in FIG. As such, the graphical user interface 320 may be modified.

In addition, from both the graphical user interface 320 having the display screen shown in FIG. 5 and the graphical user interface 320 having the display screen shown in FIG. It is also possible to change the graphical user interface 320 provided to the monitor 203.

That is, in the client 100,
Data for estimating the skill level of the user, such as the number of user operations, the operation speed, and the number of operation errors, is measured, and based on the measurement result, it is determined which display screen the graphical user interface 320 should be provided to. You may do it. For example, when the number of operation mistakes by the user exceeds a predetermined number in the state where the graphical user interface 320 serving as the display screen shown in FIG. A graphical user interface 320 can be provided that provides a display screen.

When the client 100 sends a video mail, if the processing capacity of the CPU 206 of the client (referred to as the destination client) 100 used by the destination user is lower than the processing capacity of its own CPU 206, In the client 100 of the transmission destination, the moving image data of the actually transmitted video mail may not be displayed as it is.

Therefore, an example in which the quality of the moving image data of the video mail to be transmitted is changed in the client 100 according to the processing capability of the destination client 100 will be described with reference to FIGS. 12 to 15. To do.

The OS 330, when sending the video mail,
First, a graphic display like the display screen example shown in FIG. 12 is performed.

In FIG. 12, on the display screen, instruction menus 1201 to 12 for setting the number of frames per second are set.
03 and instruction menu 1 for setting the resolution
204 to 1206 are displayed. For example, the instruction menu 1201 is an instruction menu corresponding to “10 frames per second”, the instruction menu 1202 is an instruction menu corresponding to “20 frames per second”, and the instruction menu 1203 is “full motion (30 frames per second). ) ”. Also, for example, the instruction menu 1204 displays “3
It is an instruction menu corresponding to "20 x 240 dots",
The instruction menu 1205 is an instruction menu corresponding to “480 × 360 dots”, and the instruction menu 1206
Can be an instruction menu corresponding to “640 × 480 dots”.

When transmitting a video mail, the user first displays the instruction menu 12 on the display screen shown in FIG.
The client 10 of the transmission destination from 01 to 1203
The instruction menu corresponding to the number of frames corresponding to 0 is selected, and the instruction menu corresponding to the resolution corresponding to the client 100 of the transmission destination is selected from the instruction menus 1204 to 1206. As a result, the video mail basic system 304 creates and transmits moving image data according to the selected frame number and resolution.

That is, as shown in FIG. 13, the multi-operation environment providing system 303 has the instruction menus 1201 to 1203, 120 input from the operation input device 202.
When the selection of 4 to 1206 is accepted (step 130)
0), and notifies the OS 330 of the number of frames and the resolution corresponding to the accepted instruction menu (step 1301),
The OS 330 notifies the video mail basic system 304 to create moving image data according to the notified number of frames and resolution (step 1302). The video mail basic system 304 creates moving image data according to the notified number of frames and resolution (step 130).
3) The video mail including the created moving image data is transmitted (step 1304).

The video mail basic system 304
Alternatively, the moving image data may be created once as usual, and then the moving image data may be converted into moving image data according to the notified number of frames and resolution.

As described above, the destination client 1
Since the quality of the moving image data in the video mail to be transmitted is changed according to the processing capacity of 00, the optimum video mail can be transmitted to the client 100 of the transmission destination.

In the above example, the moving image data is created and transmitted according to the predetermined number of frames and resolution, but it is also possible for the user to arbitrarily set these values. is there.

Further, in the client 100, as shown in FIG.
If the information indicating the number of frames and the corresponding resolution are stored in the storage device 208 for each type of the CPU 206, the user first of the client 100 of the transmission destination at the time of transmitting the video mail. CPU2
Information indicating the type 06 (in this case, an instruction indicating the number of frames and the resolution of moving image data is actually input) can be input from the operation input device 202.

That is, as shown in FIG. 15, the multi-operation environment providing system 303 includes the CPU 20 of the client 100 of the transmission destination, which is input from the operation input device 202.
When the information indicating the 6 types is received (step 150
0) and notifies the accepted type to the OS 330 (step 1
501), the OS 330 selects the number of frames and the resolution corresponding to the notified type (step 1502),
The video mail basic system 304 is notified to create moving image data according to the selected frame number and resolution (step 1503). The video mail basic system 304 creates moving image data according to the notified number of frames and resolution (step 1504), and sends a video mail including the created moving image data (step 15).
05).

Now, in the client 100, when a user receives a video mail transmitted from another user, the video indicating that the destination user is stored in the server 101 together with the information indicating himself / herself. Mail (video mail addressed to itself) is read from the server 101 via the network 102.
In practice, in the client 100, when a video mail addressed to itself is stored in the server 101, that fact is generally displayed on the monitor 203. Then, the user confirms the existence of the video mail addressed to himself by looking at the displayed contents, and performs the receiving operation of the video mail addressed to himself.

Therefore, in the client 100, the fact that the video mail addressed to the user who is using the client is stored in the server 101, that is, the display form when the incoming notification of the video mail is displayed on the monitor 203 is changed. An example of doing so will be described with reference to FIGS. 16 to 18.

This may be achieved by allowing the graphic data forming the graphical user interface 320 to include a plurality of graphic data having different contents of display of the incoming notification.

The display form may be changed according to the operation environment desired by the user or according to the processing capacity of the CPU 206 of the client 100. When the processing capacity of the CPU 206 is adapted, in the client 100, as shown in FIG. 17, information indicating a display form corresponding to each type of the CPU 206 is further stored in the storage device 208. To do so.

The OS 330 is shown in FIGS.
It is possible to display the incoming notification of the video mail in a plurality of types of display forms, such as the display screen example shown in (c), and in a display form according to the type notified from the multi-operation environment providing system 303. Display incoming call notification.

Although FIG. 16 shows an example of the graphic display shown in FIG. 5A, the same applies to other graphic displays.

When the video mail addressed to the user who is using the client 100 is stored in the server 101, the OS 330 first executes the operations shown in FIGS.
A graphic display such as the display screen example shown in any of (c) is performed.

In FIG. 16A, the display screen has an area 160 showing the user who is the sender of the incoming video mail.
An area 1601 indicating 0 and the number of video mails transmitted from the transmission source user is displayed. In addition,
In the area 1600, moving image data of the video mail transmitted from the transmission source user is displayed, a still image obtained by cutting a part of the moving image data is displayed, and a symbol indicating the transmission source user is displayed. It can be displayed.

Further, in FIG. 16B, moving image windows 1603 in which moving image data of the received video mail are displayed are displayed on the display screen by the number of incoming calls.

Further, in FIG. 16C, the display screen has a character string 1604 indicating the user who is the sender of the incoming video mail, and an area showing the number of video mails sent from the user of the sender. 1601 is displayed.

Hereinafter, a case where the display form of the incoming call notification is changed according to the operating environment desired by the user will be described as an example.

The user previously inputs information indicating a desired display form (this is actually an instruction indicating the display content of the incoming call notification) from the operation input device 202, and this instruction is multi-valued. The operating environment providing system 303 accepts the notification and notifies the OS 330 of it.

That is, as shown in FIG. 18, when the multi-operation environment providing system 303 receives the information indicating the display form input from the operation input device 202 (step 1800), it notifies the OS 330 of the received display form. Then, the OS 330 provides the graphical user interface 220 to the monitor 203 by selecting the graphic data corresponding to the notified display form (step 1802) and performing the graphic display according to the selected graphic data. (Step 1803).

As described above, the display form of the incoming call notification on the monitor 203 is changed according to the operation environment desired by the user, so that the optimum operation environment can be provided to the user.

The change of the display form can be changed by the client 1
It is also possible to carry out according to the skill level of the user who is using 00. That is, the client 100
In the above, even if the data for estimating the skill level of the user such as the number of times of operation of the user, the speed of operation, the number of times of operation error, etc. is measured, and in which display form the incoming call notification is to be made is determined based on the measurement result. good.

By the way, in the example described with reference to FIGS. 10 and 11, the display contents of the instruction menu at the time of the video mail transmission / reception operation are changed, which is used when the user performs the video mail transmission / reception operation. The operation input device 202 is actually a mouse.

An example in which various devices are prepared as the operation input device 202, and the user can perform a video mail transmission / reception operation using the desired device among these devices as the operation input device 202 This will be described with reference to FIGS. 19 to 21.

In the following example, a case of creating a video mail to be transmitted in a video mail transmission operation will be described.

As the operation input device 202, FIG.
When the keyboard 1900 shown in is used, an instruction necessary for a video mail transmission / reception operation is associated with an arbitrary key of the keyboard 1900. For example, when the user presses a key for creating a video mail, the multi-operation environment providing system 303 causes the video camera 200 and the microphone 201 to operate.
Is operated to take in the moving image data and the audio data via the input / output interface device 205 to create a video mail.

Further, as the operation input device 202, FIG.
When the controller 1901 of the video game machine shown in (b) is used, the operation buttons and joystick of the controller 1901 are associated with the instructions necessary for the video mail transmission / reception operation. In this example, the operation method shown in FIG. 10D is performed by actually pressing the operation button and the joystick. For example, when the user presses the operation button for creating the video mail, the multi-operation environment is displayed. The providing system 303 includes the video camera 20.
0 and the microphone 201 are operated, the moving image data and the audio data are taken in through the input / output interface device 205, and the video mail is created.

Further, as the operation input device 202, FIG.
When the touch panel 1902 shown in (c) is used, the instruction button displayed on the touch panel 1903 is associated with an instruction necessary for a video mail transmission / reception operation. For example, when the user touches the instruction button for creating a video mail with his / her hand, the multi-operation environment providing system 303 operates the video camera 200 and the microphone 201, and outputs the moving image data and the audio data via the input / output interface device 205. Capture and create video mail.

Further, as the operation input device 202, FIG.
Pen 1903 and digitalizer 19 shown in (d)
When 03 is used, the instruction button displayed on the display screen of the digitalizer 1904 is associated with the instruction necessary for the video mail transmission / reception operation. For example, when the user touches the instruction button for creating a video mail with the pen 1904, the multi-operation environment providing system 303 operates the video camera 200 and the microphone 201, and the moving image data and the audio data are input via the input / output interface device 205. Import and create a video mail.

In all the examples shown in FIG. 19, the operation input device 203 and the monitor 203 are linked, and the display form of the moving image data and the incoming call display to be displayed on the monitor 203 is as follows.
It is possible to adopt the display form of the moving image data and the display form of the incoming call notification described above. Moreover, in particular, the touch panel 1
903 can be provided on the monitor 203.

As the operation input device 202, FIG.
When the telephone 2000 shown in (a) is used, voice recognition processing is performed on the voice data input by the user from the receiver of the telephone 2000, and the instruction content is analyzed based on the result. In addition, the push button of the telephone 2000 may be associated with an instruction required for a video mail transmission / reception operation.

As the operation input device 202, FIG.
When the remote controller 2001 shown in (b) is used, an operation button of the remote controller 2001 is associated with an instruction required for a video mail transmission / reception operation, and reception of infrared rays or radio waves transmitted from the remote controller 2001 is received. The unit 2002 is provided, and the instruction content is analyzed based on the external power supply data and the wireless data received by the receiving unit 2002.

As the operation input device 202, FIG.
When the video camera 2003 shown in (c) is used,
Image processing is performed on the user's action taken by the video camera 2003, and the instruction content is analyzed based on the result. The video camera 2003 can be shared with the video camera 200 included in the client 100. In this case, while the video camera 200 is inputting the moving image data of the video mail, the video mail transmission / reception operation can be performed. It is necessary to input the necessary instructions by other means such as characters and graphics.

As the operation input device 202, FIG.
When the microphone 2004 shown in (d) is used, voice recognition processing is performed on the voice data input by the user from the microphone 2004, and the instruction content is analyzed based on the result. The microphone 2004 can be shared with the microphone 201 included in the client 100. In this case, while the microphone 201 is inputting the audio data of the video mail, the instruction necessary for the transmission / reception operation of the video mail is performed. Must be input by other means such as characters and graphics.

As the operation input device 202, FIG.
When the sensor 2005 shown in (e) is used, the instruction content is analyzed based on the movement of the user's finger, wrist or the like detected by the sensor 2005. Note that, similarly to the example of the remote controller 2001 shown in FIG. 20B, the sensor 2005 and the client 100 can be provided by providing a receiving unit for receiving infrared rays or radio waves transmitted from the sensor 2005.
It is not necessary to connect a cable between and.

As the operation input device 202, FIG.
When the sensor 2006 shown in (f) is used, based on the user's electroencephalogram or vocal cord detected by the sensor 2006,
Analyze the instructions. Note that, similarly to the example of the remote controller 2001 shown in FIG. 20B, a cable is provided between the sensor 2006 and the client 100 by providing a receiving unit that receives infrared rays or radio waves transmitted from the sensor 2006. You don't have to connect with.

In this example, the multi-operation environment providing means can be realized not only by the software of the multi-operation environment providing system 303 but also by the hardware of the multi-operation environment providing device.
As shown in (a), FIG. 20 (c), and FIG. 20 (d),
When performing voice recognition processing or image processing, it is preferable to implement it as hardware.

FIG. 21 is a hardware configuration diagram of the multi-operation environment providing device.

In FIG. 21, reference numeral 2100 is an analog interface device, 2101 is a digital interface device, 2102 is an image processing device, and 2103 is a voice recognition processing device.

For example, in the example shown in FIG. 19A, the keyboard 1900 is the digital interface device 2.
19B, and in the example shown in FIG. 19B, the controller 1901 is connected to the digital interface device 2101.
19D, the touch panel 1902 is connected to the analog interface device 2100 or the digital interface device 2101.
In the illustrated example, the digitalizer 1904 is connected to the digital interface device 2101.

Also, for example, in the example shown in FIG. 20 (a), the telephone 2000 is the analog interface device 2
100, a digital interface device 2101, a voice recognition processing device 2103, and
In the example shown in FIG. 20B, the receiving unit 2002 is connected to the analog interface device 2100 or the digital interface device 2101, and FIG.
20D, the video camera 2003 is connected to the image processing apparatus 2103, and in the example shown in FIG. 20D, the microphone 2004 is the voice recognition processing apparatus 210.
20 and FIG. 20 (e) and FIG.
In the example shown in (f), the sensors 2005 and 2006 are
The analog interface device 2100 or the digital interface device 210 is directly or via a receiving unit.
So that it is connected to 1.

As described above, since the equipment the user is accustomed to can be used as the operation input device 202,
It is possible to provide the user with an optimal operating environment.

[0122]

As described above, according to the present invention, when a plurality of information processing apparatuses are connected via a network to construct a video mail system, each information processing apparatus monitors at the time of transmitting / receiving video mail. Since the graphical user interface suitable for the operating environment desired by the user can be provided by changing the graphical user interface provided to the user, the usability for the user is improved.

Further, by changing the display form of the moving picture data in the video mail, the moving picture data suitable for the processing capacity of the information processing apparatus can be displayed, and the instruction necessary for the transmission / reception operation of the video mail can be performed. By changing the display content of the instruction menu for performing the operation, it is possible to provide an operating environment that simulates the device that the user is familiar with, and change the quality of the video data in the video mail to be sent. For example, it is possible to send a video mail suitable for the processing capability of the information processing device at the destination, and change the display form of the incoming notification to notify that the video mail has arrived. It becomes possible to provide an operating environment.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of a video mail system according to this embodiment.

FIG. 2 is a block diagram of a client.

FIG. 3 is a software configuration diagram of a client.

FIG. 4 is an explanatory diagram showing a graphical user interface.

FIG. 5 is an explanatory diagram showing an example of a display screen of a monitor.

FIG. 6 is an operation flowchart of the present embodiment.

FIG. 7 is an explanatory diagram showing an example of stored contents of a storage device.

FIG. 8 is an explanatory diagram showing a display screen example of a monitor.

FIG. 9 is an operation flowchart of the present embodiment.

FIG. 10 is an explanatory diagram showing a display screen example of a monitor.

FIG. 11 is an operation flowchart of the present embodiment.

FIG. 12 is an explanatory diagram showing an example of a display screen of a monitor.

FIG. 13 is an operation flowchart of the present embodiment.

FIG. 14 is an explanatory diagram showing an example of stored contents of a storage device.

FIG. 15 is an operation flowchart of the present embodiment.

FIG. 16 is an explanatory diagram showing a display screen example of a monitor.

FIG. 17 is an explanatory diagram showing an example of stored contents of a storage device.

FIG. 18 is an operation flowchart of the present embodiment.

FIG. 19 is an explanatory diagram showing an example of an operation input device.

FIG. 20 is an explanatory diagram showing an example of an operation input device.

FIG. 21 is a hardware configuration diagram of a multi-operation environment providing device.

[Explanation of symbols]

100 ... Client, 101 ... Server, 102 ... Network, 200 ... Video camera, 201 ... Microphone, 2
Reference numeral 02 ... Operation input device, 203 ... Monitor, 204 ... Speaker, 205 ... Input / output interface device, 205a ... Video A / D conversion device, 205b ... Audio A / D conversion device, 206c ... Video D / A conversion device 206d ... Audio D / A converter, 206 ... CPU, 207 ... Main memory, 208 ... Storage device, 209 ... Network interface device, 300 ... Video mail system, 301
... Input control system, 302 ... Output control system, 30
3 ... Multi-operation environment providing system, 304 ... Video mail basic system, 310 ... Application programs other than video mail system, 320 ... Graphical user interface, 330 ... Operating system (OS), 2100 ... Analog interface device,
2101 ... Digital interface device, 2102 ...
Image processing device 2103 ... Voice recognition processing device.

 ─────────────────────────────────────────────────── ─── Continued front page (72) Inventor Takehiro Yamada 1099 Ozenji, Aso-ku, Kawasaki-shi, Kanagawa Hitachi, Ltd. System Development Laboratory (72) Inventor Kazuhiro Fujisaki 5030 Totsuka-cho, Totsuka-ku, Yokohama-shi, Kanagawa Ceremony Company Hitachi Software Development Division

Claims (9)

[Claims] 1. An input device for receiving input of moving image data,
Information that includes a display device that displays a display screen, an instruction input device that receives an instruction input, and a processing device, and that transmits and receives a video mail including moving image data to and from another information processing device via a network. In the processing device, the instruction input device displays a part of the moving image data included in the transmitted / received video mail so that the instruction input device can receive the instruction necessary for the transmission / reception operation of the video mail. An instruction to select an arbitrary type of display screen among a plurality of types of display screens is received, and the processing device displays the type of display screen selected by the instruction received by the instruction input device on the display device. As described above, the multi-operation environment providing means for changing the display screen displayed on the display device at the time of transmitting and receiving the video mail is provided. Processing apparatus. 2. The information processing apparatus according to claim 1, wherein the plurality of types of display screens display moving image data and an instruction menu, which is an area showing an instruction necessary for a video mail transmission / reception operation, or the instruction content. An information processing apparatus, which is a display screen having a different positional relationship with each of the regions. 3. The information processing apparatus according to claim 1, wherein in the plurality of types of display screens, an instruction menu, which is an area showing an instruction necessary for transmitting and receiving a video mail, has a shape simulating different types of devices. An information processing device characterized by being a display screen. 4. The information processing apparatus according to claim 3, wherein the different types of devices include at least two of a telephone set, a video tape deck, an intercom, and a controller of a video game console. Processing equipment. 5. The information processing apparatus according to claim 1, wherein the instruction input device receives an input of information indicating a processing capacity of the processing device, and the multi-operation environment providing means further includes: By changing at least one of the resolution of the moving image data, the number of frames per second, and the number of colors according to the processing capacity indicated by the information received by the instruction input device, the moving image data displayed on the display device can be changed. An information processing device, characterized in that a display form is changed. 6. The information processing device according to claim 1, wherein the instruction input device receives an input of information indicating a processing capacity of a processing device of another information processing device to which a video mail is to be transmitted. The multi-operation environment providing means further changes at least one of the resolution of the moving image data, the number of frames per second, and the number of colors according to the processing capacity indicated by the information received by the instruction input device. An information processing device, characterized in that the quality of moving image data included in a video mail to be transmitted to another information processing device is changed. 7. The information processing device according to claim 1, wherein the instruction input device is one of a plurality of types of display screens for indicating the presence of a video mail transmitted from another information processing device. , Accepting an instruction to select an arbitrary type of display screen, the multi-operation environment providing means, when further indicating the presence of a video mail transmitted from another information processing device,
An information processing apparatus, characterized in that a display screen displayed on the display device is changed so that a display screen of a type selected by an instruction received by the instruction input device is displayed on the display device. 8. An input device for accepting input of moving image data,
A display device for displaying moving image data, and a processing device,
In an information processing device that sends and receives a video mail including moving image data to and from another information processing device via a network, a plurality of types of instruction input devices that accept input of instructions necessary for transmitting and receiving video mail At least one type of instruction input device is further provided, and the instruction input device is a telephone, a video tape deck, a microphone, a video camera, a sensor for detecting movement of a user,
At least one of a remote control device, a controller of a video game machine, and a touch panel, wherein the processing device analyzes the instruction received by the instruction input device according to the type of the instruction input device. An information processing device comprising: 9. An input device for accepting input of moving image data,
Information that includes a display device that displays moving image data, an instruction input device that receives an instruction input, and a processing device, and that transmits / receives a video mail including moving image data to / from another information processing device via a network. In the processing device, the processing device provides a graphical user interface of a type corresponding to an instruction received by the instruction input device, out of a plurality of types of graphical user interfaces that control an interface with a user when transmitting / receiving a video mail. An information processing apparatus, comprising: a multi-operation environment providing means to be provided, wherein the input device, the display device, and the instruction input device operate according to a graphical user interface provided by the multi-operation environment providing means.