JP2003228452A - Communication system, communication method, communication program and information processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve natural cooperation working conducted via a computer network among a plurality of users, without making them aware of the effects due to data delay. <P>SOLUTION: On the display screen of a computer system 10, images corresponding to each user are summarized and displayed, and a dialog area (reduced display window 120) is displayed, in which character data transmitted/received between respective users are displayed in a position corresponding to the image. In addition, a working area (file exchange area S160) is displayed in which each user conducts desired work using a character corresponding to the user. Transfer delays of transmission data occurred by the work are resolved by the animated display of the character. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention transmits and receives arbitrary data among image data, audio data, character data, and control data among a plurality of information processing devices connected to a computer network, The present invention relates to a communication system and a communication method for mutually communicating intentions and emotions between users of information processing devices. Further, the present invention relates to a communication program and an information processing device that realize such a communication system and communication method.

[0002]

2. Description of the Related Art The so-called Internet (The Internet) has been widely used as a computer network to which a large number of computer devices are connected. Internet is TCP / IP (Transmission Control)
It is possible to freely transmit and receive various information between computers by using various protocols (interconnection procedure) represented by Protocol / Internet Protocol).

By the way, a so-called chat program has been conventionally used to mutually communicate intentions and feelings between users of computer devices connected to the Internet.

The chat program is a program for immediately transmitting the character data input by one user to the other user while being activated on each of a plurality of computer devices connected to each other via the Internet. In this way, by exchanging the character data using the chat program, the users can communicate with each other.

[0005]

By the way, for example, in the above-mentioned chat program, a so-called "scribble" function in which each user can draw a figure and various files can be exchanged between each user. If such a file exchange function is added, the following problems occur.

That is, in the case of performing work such as sharing a figure drawn by each user with other users or exchanging various files between users, various data is transmitted and received between the users. Will be required. At this time,
If the data related to the drawn figure is sent and received in real time according to the user's drawing operation, the communication efficiency will decrease. Therefore, the data to be sent is temporarily stored and sent to the other user when the specified amount is reached. It is possible to take measures such as sending.

However, when data is temporarily stored on the transmission side, there is a time lag between the work on the side of the user who is the source of the data and the work on the side of the user who receives the data. However, there arises a problem that natural cooperation work cannot be performed.

Even when data is not temporarily stored, a similar time lag occurs due to a transmission delay that is inevitably caused when data is transmitted and received via a network. Further, for example, when the network between users is congested, when the user draws a graphic by a quick operation, the delay of the data to be transmitted / received increases and the data waiting for transmission is accumulated on the transmission side. There was a problem that it was done too much.

In view of the above, the present invention solves the above-mentioned conventional problems, and cooperates with a plurality of users through a computer network without making the user aware of the delay of transmitted / received data and the time lag of work operation. An object of the present invention is to provide a communication system, a communication method, a communication program, and an information processing device that can perform work extremely naturally.

[0010]

According to a first aspect of the present invention, there is provided a communication system in which image data, voice data, character data, and control data among a plurality of information processing devices connected to a computer network are selected. In a communication system in which users of each information processing apparatus mutually transmit intentions and emotions by transmitting and receiving arbitrary data, the information processing apparatus includes a storage unit that stores various information and a display that displays various information. Means, a transmitting / receiving means for transmitting / receiving various data to / from another information processing apparatus, a control means for controlling the operation of each part, and an input means for inputting an operation by a user, and the display means is provided for each user. The images corresponding to each are arranged in a list, and the character data transmitted and received between each user is arranged in a list. In addition to displaying the interactive area displayed at the position, the character having the above image corresponding to each user is displayed according to the operation by the user, and the work area for performing the work desired by each user is displayed. The control means causes the character of the user to be animated in the work area according to the content of the work performed by the user, and the data to be transmitted to the other user caused by the work is set in the storage means. The transmission / reception means stores the data in the transmission queue when the transmission queue stores a predetermined amount of data or when a predetermined time has elapsed after the data was stored in the transmission queue. The data is transmitted to the other user, and the control means further includes the operation performed by the other user included in the data transmitted from the other user. It is characterized in that for character animation display of the other user in accordance with the content.

According to a second aspect of the communication method of the present invention, any one of image data, voice data, character data, and control data is exchanged among a plurality of information processing devices connected to a computer network. In a communication method in which users of each information processing device mutually communicate intentions and emotions by transmitting and receiving, images corresponding to each user are arranged in a list, and character data transmitted and received between each user is arranged in a list. The dialogue area displayed at a position corresponding to the displayed image is displayed, and the character having the image corresponding to each user is displayed in accordance with the operation by the user, and the work desired by each user is performed. Depending on the display step for displaying the work area to be performed and the content of work performed by the user in the work area, In addition to animating the character, the work step of accumulating data to be transmitted to the other user in the transmission queue in the transmission queue, and when a predetermined amount of data is accumulated in the transmission queue or when the data is stored in the transmission queue. A data transmission step of transmitting the data accumulated in the transmission queue to the other user when a predetermined time has elapsed after the accumulation of
A partner character display step of displaying an animation of the character of the partner user according to the content of the work performed by the partner user included in the data transmitted from the partner user.

Further, a communication program according to a third aspect of the present invention transmits arbitrary data among image data, voice data, character data, and control data among a plurality of information processing devices connected to a computer network. In a communication program for transmitting and receiving intentions and emotions between users of each information processing device, images corresponding to each user are arranged in a list with respect to the information processing device. While displaying an interactive area displayed at a position corresponding to the image in which the character data to be transmitted and received are arranged in a list, a character having the image corresponding to each user is displayed in response to an operation by the user, Display processing for displaying a work area in which each user performs a desired work,
A work process of animating the character of the user according to the contents of work performed by the user in the work area and accumulating data to be transmitted to the other user caused by the work in the transmission queue, and the transmission queue. When a predetermined amount of data is accumulated, or when a predetermined time has elapsed after the data was accumulated in the transmission queue, the data transmission process of transmitting the data accumulated in the transmission queue to the partner user and the partner user It is characterized in that a partner character display process for displaying an animation of the character of the partner user is executed according to the content of work carried out by the partner user included in the transmitted data.

Further, according to a fourth aspect of the present invention, in an information processing apparatus, arbitrary data among image data, voice data, character data and control data is exchanged with another information processing apparatus via a computer network. In an information processing apparatus that mutually communicates intentions and emotions between users of each information processing apparatus by transmitting and receiving in the information processing apparatus, a storage unit that stores various information, a display unit that displays various information, and another information processing apparatus The display means includes a transmission / reception means for transmitting / receiving various data to / from each other, a control means for controlling the operation of each part, and an input means for inputting an operation by a user. The display means arranges images corresponding to each user in a list. The interactive area displayed at a position corresponding to the image in which the character data transmitted and received between the users is displayed in a list is displayed, and In accordance with the operation, the character having the above image is displayed corresponding to each user, and the work area for performing the work desired by each user is displayed, and the control means performs the work performed by the user in the work area. The character of the user is displayed in animation according to the contents, and the data to be transmitted to the other user caused by the work is accumulated in the transmission queue set in the storage means, and the transmission / reception means stores the data in the transmission queue. When a predetermined amount of data is accumulated, or when a predetermined time has elapsed after the data was accumulated in the transmission queue, the data accumulated in the transmission queue is transmitted to the other user, and the control means further Animating the character of the other user according to the work content of the other user included in the data sent from the user. It is characterized in that to.

In the present invention configured as described above, the work performed by each user is displayed in the work area as an animation of the character having an image associated with each user in the dialogue area for each character. This allows the user to easily determine which user performed the work performed in the work area. In addition, in the present invention, while the data related to the work performed by each user is temporarily stored in the transmission queue and then transmitted to the partner user side, the contents of the work performed by the partner user included in the data transmitted from the partner user are displayed. Accordingly, the character corresponding to the other user is displayed as an animation. Therefore, even if there is a delay in the transmission of data, it is possible to perform a natural cooperative work by displaying the animation of the character.

In the present specification, the term "character" refers to a display object that imitates a real or fictitious human or animal. The character may be a still image, a moving image, or an animation image (continuous display of still images).

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention transmits and receives arbitrary data among image data, audio data, character data, and control data among a plurality of information processing devices connected to a computer network, thereby enabling the information processing devices to be communicated between users. It is suitable to be applied when mutual communication (communication) of intentions and emotions. Therefore, first, a configuration of a basic system that realizes such communication will be briefly described below.

In the following, a so-called TCP / IP (Transmission Contr.
Description will be made assuming a network configuration in which a plurality of information processing devices can be mutually connected by using the ol Protcol / Internet Protocol) protocol group. However, the present invention is not limited to the application to such a network form, and can be widely applied to the case of using a computer network for exchanging various kinds of information between a plurality of information processing devices. Is.

In the following, description will be made on the assumption that a consumer-use personal computer device (hereinafter, simply referred to as a computer device) is used as an information processing device for exchanging various kinds of information. However, the present invention is not limited to the application to the case where such a computer device is used.
(Personal Digital Assistants) It can be widely applied to the case of using various information processing devices such as a device or a mobile phone equipped with a communication function.

(1) Basic Configuration of Communication System In the communication system 1 described in this example, for example, as shown in FIG. 1, a plurality of computer devices 10 mutually exchange various information via the Internet (The Internet) 11. It is connected so that it is possible.

Here, each computer device 10 may be directly connected to the Internet 11, or
The environment may be such that the Internet 11 can be connected via the public line network 15 using an ISP (Internet Service Provider) or the like. As the public network 15,
For example, the telephone line network 15a, the cable television network 15b, or the ADSL (Asymmetric Digital Subscriber Line) network 15c can be used. At this time, the computer device 10 may be wired connection or wireless connection as long as it can connect to the Internet 11. For example, the computer device 10 is connected via a so-called simple mobile phone (PHS: Personal Handyphone System),
It may be configured to connect to the Internet 11.

Each computer device 10 establishes a transmission path on the internet 11 by using the TCP / IP protocol group in a state where each computer device 10 is connected to the internet 11.
Various kinds of information such as image data, voice data, character data, and control data can be exchanged with each other.

(2) Configuration of User Terminal Next, the configuration of the computer device 10 constituting the communication system 1 will be described below.

In the following, for convenience of explanation, the case where the computer device 10 is equipped with a digital video camera will be described. However, a digital video camera configured as an external device may be connected to the computer device 10 by wire or wirelessly, for example, a LAN to which the computer device 10 is connected.
A digital video camera that can be directly connected to a computer network such as (Local Area Network) is used, and image data and audio data captured or recorded by the digital video camera are transmitted to the computer device 10 via the computer network. It may be configured to be taken in.

As shown in FIG. 2, the computer device 10 includes a CPU (Central Processing Unit) 20 that executes various arithmetic processes and controls each unit in an integrated manner, and a RAM (Ra that functions as a work area of the CPU 20).
ndom Access Memory) 21, a read-only ROM (Read Only Memory) 22 for storing information including various programs executed by the CPU 20, and an operating system (Operat) executed by the CPU 20.
ing system) and various programs such as application programs are recorded, and HDD (Hard Disk Drive) 23 for recording and reproducing various data and the like, a display section 24 for displaying various information, the display section 24 and the CPU 20. A display interface 25 for exchanging data between the operating unit 26, an operating unit 26 for inputting various information and instruction operations by a user, and exchanging data between the operating unit 26 and the CPU 20. Interface 27 for operation, a network interface 28 for exchanging data between the external device connected to the Internet 11 through the public line network 15 described above, and image data and audio for photographing a subject. A digital video camera 29 that obtains data and a so-called MPEG2 (Moving Pic)
The MPEG2 codec 30 that performs compression encoding and decoding based on the ture Experts Group phase 2) method.

The computer device 10 includes a CPU 20, a RAM 21, a ROM 22, and an HDD 2 among these units.
3, a display interface 25, an operation interface 27, a network interface 28, a digital video camera 29, and an MPEG2 codec 30 are connected via a bus 31.

The digital video camera 29 in the computer device 10 may not be mounted in the computer device 10 and may be connected to the bus 31 via, for example, a predetermined interface for connecting an external device or the network interface 28. . Further, in the computer device 10, if necessary, for example, a removable recording / reproducing device or the like for recording / reproducing a removable recording medium is mounted or connected in addition to the HDD 23, and various data for the recording / reproducing device are stored. Recording and reproduction may be possible.

The CPU 20 has a RAM via the bus 31.
21, the ROM 22, the HDD 23, the display interface 25, the operation interface 27, the network interface 28, the digital video camera 29, and the MPEG2 codec 30. CPU2
0 centrally controls each unit and, for example, an HDD
The operating system and various application programs recorded in 23 and the like are executed. In particular, the CPU 20 processes execution of a communication program configured as one of application programs. The details of this communication program will be described later.

The RAM 21 functions as a work area when the CPU 20 executes various programs.
Under the control of 0, various data are temporarily stored.

The ROM 22 stores various programs and setting information necessary for starting the computer device 10. Various programs and setting information stored in the ROM 22 are read out when the computer device 10 is activated and used by the CPU 20.

The HDD 23 records an operating system, application programs and the like, and also records and reproduces various programs and data under the control of the CPU 20.

The display unit 24 is, for example, an LCD (Liquid Cry).
stal display), and under the control of the CPU 20,
Various information such as data recorded in the HDD 23 is displayed on the display screen. In particular, the display unit 24, under the control of the CPU 20, displays a result of execution processing of a communication program, which will be described later, and a window for displaying buttons for performing various instruction operations on the communication program. Display a predetermined graphical user interface on the display screen.

The display interface 25 is the CPU 2
Data is exchanged between 0 and the display unit 24. That is, the display interface 25 supplies various information supplied from the CPU 20 via the bus 31 to the display unit 24.

The operation unit 26 accepts an operation by a user using a user interface such as a pointing device such as a keyboard and a mouse, or a so-called rotary operation switch such as a so-called jog dial, and outputs a control signal indicating the operation content to the operation interface. It is supplied to the CPU 20 via 27.

The operation interface 27 is the CPU 2
Data is exchanged between 0 and the operation unit 26. That is, the operation interface 27 supplies the control signal supplied from the operation unit 26 to the CPU 20 via the bus 31.

The network interface 28 is C
It functions as an interface for communicating with the outside under the control of the PU 20. That is, the network interface 28 is provided for exchanging various kinds of information with another computer device 10 connected to the Internet 11.

The digital video camera 29 includes a predetermined optical system for photographing a subject and a CCD (Charge Coupled).
Devices) and other devices for photoelectric conversion. The video data and audio data obtained by the digital video camera 29 are supplied to the MPEG2 codec 30 via the bus 31 under the control of the CPU 20.

The MPEG2 codec 30 uses the video data and the audio data supplied from the digital video camera 29 via the bus 31 as an MP under the control of the CPU 20.
The compression encoding based on the EG2 method is performed. At this time, MP
The EG2 codec 30 is under the control of the CPU 20.
Video and audio data are compressed and encoded in real time. The MPEG2 codec 30 can also decode data that is compression-encoded based on the MPEG2 system.

(3) Outline of Communication Program Next, a communication program executed by the computer device 10 described above will be described below.

The communication program is composed of a series of program groups in which a plurality of modules each realizing an individual function can be freely combined, and is recorded in the HDD 23 of the computer device 10, for example. By executing this communication program by the CPU 20, the computer device 10 transmits and receives various information such as image data, voice data, character data, etc. to and from other computer devices, so that the users of the respective computer devices can communicate with each other. It enables mutual communication (communication) of wills and feelings in the.
The communication program can also be provided by a predetermined recording medium such as a so-called compact disc or a transmission medium such as the Internet 11.

The communication program executed by the computer device 10 communicates with the communication program executed by another computer device by a so-called server-client method. That is, in the plurality of communication programs in which the mutual connection state is established, the function as the server is realized by the predetermined communication program, and the other communication programs operate as the clients. However, the communication program is operated in the virtual session mode at the time when the execution process is started in the computer device 10 and the interconnection state with other communication programs is not established, that is, in the initial activation state, and the server is operated in the virtual session mode. Alternatively, it is possible to establish the session by itself without distinguishing the client.

Here, when a session is established between the communication programs executed by the plurality of computer devices 10, connection setting information is exchanged between the communication programs. This connection setting information is, for example, generated by the computer device 10 at the time of starting the communication program, and is used in the IP address set in the computer device 10 that is the source of this connection setting information, and in the communication program. It is composed of a file that describes the port number and so on. The details of the connection setting information will be described later.

When the connection setting information is sent from the communication program to another communication program, the communication program which has acquired this connection setting information uses the IP address and port number described in the connection setting information. On the basis of this, a connection process is performed with respect to the computer device 10 that is the transmission source (and by extension the communication program executed by this computer device 10), and a session is established.

At this time, the file including the connection setting information is associated with the communication program by, for example, the extension, and when this file is selected on the computer device by performing a so-called double-click operation, it is automatically executed. The communication program is configured to be activated.

In the communication system 1, the connection setting information is generated at the time of start-up, and the communication program on the side that sends this connection setting information to another communication program functions as a server, and the acquired connection setting information It is assumed that the communication program on the side activated based on this operates as a client.

Here, when the connection setting information is exchanged between the computer devices as described above, for example, a message prompting the connection start from the computer device 10 as the server to the computer device as the client is described. It is realized by attaching a file containing connection setting information to an electronic mail and sending it.

In the communication system 1 described in this example, the connection setting information is sent using electronic mail. For example, so-called FTP is used.
The connection setting information may be sent in the form of a data file or an application program by using an application program such as software that realizes various file exchanges between computer devices connected to the Internet 11. . Further, for example, the user is made aware of the start of the connection (establishment of a session) by directly exchanging the connection setting information between the computer devices without notifying the user (user) of the computer device of the connection start. Alternatively, the communication program may be automatically started on the computer device on the client side without the need.

(4) Module Structure of Communication Program Here, an example of the module structure of the communication program will be described with reference to FIG. The communication program is, for example, as shown in FIG. 3, a core that provides the establishment of a session between an interface module 50 that controls the operation of the network interface 28 in the computer device 10 and a communication program that is executed by another computer device. A module 51, a basic module 52 that provides basic functions in a communication program, a plurality of application modules 53 that provide individual functions, and a graphical user interface (hereinafter referred to as GUI: Graphical User).
Interface. ) For managing GUI module 5
4 and.

The interface module 50 is, so to speak, configured as an API (Application Program Interface), and exchanges image data, audio data, or image data with a program executed by another computer device via a computer network such as the Internet 11. It is a module that establishes a transmission path for various information such as character data and enables easy processing of details of network communication by a simple command system. As the interface module 50, for example, "Direct Play" of Microsoft Corporation can be used.

The core module 51 has a session management function for establishing a session with another communication program and managing the established session. Specifically, for example, a connection setting information creating function for creating connection setting information, a session establishing function for establishing a session, a data sending / receiving function for sending and receiving data between communication programs, a session for managing players in the established session. An internal player management function and the like are provided by the core module 51 as a session management function.

Here, in the communication system 1, there are a communication program serving as a server and a communication program serving as a client. The communication program on the server side refers to the destination of this data and transfers the data sent from the communication program on the client side to another client side communication program designated as the destination. Therefore, in the communication system 1, it is necessary to establish a session when exchanging various information such as image data, voice data, or character data. Therefore, in the communication program, the session management function is provided by the core module 51 as an interface for establishing and managing such a session.

The core module 51 acquires the IP address, the port number and the like and creates a file in which the connection setting information is described. Also, this file is encrypted and decrypted. Further, when operating as a client, the core module 51 connects to the computer device on the server side based on the IP address and port number described in the acquired connection setting information. This establishes the session.

Further, the core module 51 manages the communication program (player) existing in the session. Specifically, for example, a list of players is generated or acquired, or unique identification information (player ID) assigned to each player is acquired or managed. Further, the core module 51 may establish a connection with a new player, disconnect a connection with a predetermined player, change player information including information such as a connection state or connection name for each player, and so on. Then, when an event occurs, the basic module 52 and each application module 53 are notified of this event.

The core module 51 also has an application module management function for controlling each of the plurality of application modules 53. Specifically, for example, activation management of each application module 53, data transmission / reception with each application module 53, and the like are performed.

Specifically, the core module 51 acquires, for example, module information about the application module 53 installed in the communication program from a predetermined storage area of the computer device 10 and lists the installed application modules 53. Turn into. This module information is, for example, module identification information unique to each application module, GU.
It is configured by GUI information that is information regarding I, or flag information that indicates whether or not the operation is started at the same time as the communication program is started. Then, the core module 51 manages the activation state of each application module 53 based on this module information.

Further, the core module 51 activates the application module 53 which has not been activated,
Display / non-display switching control for the display unit 24 of the computer device 10 is performed.

Here, as an example of the operation of the core module 51, a case where data is transmitted from one communication program on the client side to the other communication program via the communication program on the server side will be described with reference to FIG. It will be explained with reference to FIG.

In this case, the core module 51a operating on the data transmission side receives the data transmitted from the basic module 52 and the application module 53, adds a transmission header to this data, and communicates on the server side. Send to the program. In this way, the content of the received data is not involved in the transmission to the server side.

On the other hand, the core module 51b operating on the server side refers to the transmission header included in the data obtained from the data transmission side, and refers to the communication program on the data reception side described as the destination in this transmission header. , Send the data acquired from the data sending side.

Further, the core module 51c operating on the data receiving side refers to the transmission header included in the acquired data and transfers this data to a predetermined application module 53. At this time, the core module 51c activates this application module 53 when the corresponding application module 53 as a data transfer destination is not activated in the communication program on the data receiving side.

Further, when the application module 53 corresponding to the communication program on the data receiving side does not exist, the core module 51c transmits a message indicating this to the communication program on the data transmitting side. At this time, when all the application modules 53 are designated as the application modules 53 to which the acquired data is to be transferred, the core module 51c transfers this data only to the application module that is being activated. .

The core module 51 operates as described above to transfer data between the communication programs operating as clients.

On the other hand, the basic module 52 is a module having a function of preparing various windows used in the communication program. Further, the basic module 52 has a setting function for setting various kinds of information necessary for the execution processing of the communication program, and an electronic mail to which the connection setting information is attached to the electronic mail and transmitted to the client side when the session is established. It has a transmission function.

Further, the application module 53
Are installed in the communication program as needed, and each has its own function. In the communication program in this example, as the application module 53, a personal information management module, an image transmission module, a voice data transmission / reception module, a web function module, a chat content transfer module, a chat log module, an emotion expression module, an action module, a live appearance module. , Graffiti module, file exchange module, etc. are installed.

The personal information management module is a module for managing personal information such as image data and name information corresponding to each communication program existing in the session, that is, each user (player).

In this communication program, in the first activated state, the user is requested to input and set an image and a name corresponding to the user, and the setting is acquired. At this time, a display request is transmitted to the personal information management module via the core module 51. In this way, when receiving a display request from another module,
The personal information management module transmits a predetermined acquisition request to the GUI module 54, acquires the corresponding personal information, and displays the predetermined personal information in a predetermined area within the window displayed on the computer device 10. .

Further, when the personal information management module receives a player information update request from another module, the personal information management module sends the personal information to the personal information management module in another communication program to which the connection is established via the network. Send the acquisition request. At this time,
The personal information management module on the side that has acquired the personal information acquisition request acquires the personal information of itself and returns it as a display notification.

Such a player information update request is transmitted to the personal information management module by the core module 51 when a user newly enters the communication system 1, for example.

The image transmission module is a module that provides image data addition processing, deletion processing, selection processing, and the like. In addition, the image transmission module performs various controls such as on / off switching control of a shooting state for the digital video camera 29 mounted or connected to the computer device 10. When the shooting state of the digital video camera 29 is on, the transmission process of the image data is performed while monitoring the load of the communication state on the Internet 11. The image transmission module 53b can also perform non-guaranteed communication for transmission to another communication program in accordance with the setting made by the user. In this case, retransmission is not performed even if the transmitted image data is lost in the middle of the transmission path.

The voice transmitting / receiving module is equivalent to the image transmitting module, and is a module that provides a voice data addition process, a voice data deletion process, a selection process, and the like. In addition, the voice transmitting / receiving module uses the voice function implemented in the interface module 50,
It has the function of transmitting and receiving voice data between communication programs. In the communication system 1, the voice output can be turned on in the communication program on the client side only when the voice output is turned on in the communication program on the server side. The voice data sent from the communication program on the client side is mixed by the voice transmitting / receiving module mounted on the communication program on the server side, and is again transmitted to the communication program on each client side.

The Web function module acquires various kinds of information such as hypertext and image data held in the computer device 10 on which the communication program is executed, or another computer device connected to the Internet 11 to acquire the communication program. It is a module that provides a Web information display function of displaying various acquired information in a predetermined display area in the window. In addition, the Web function module is used to communicate with other communication programs via the Internet 11
It has a URL sharing function of sharing a URL (Uniform Resource Locator) indicating the location and acquisition method of various information (resources) existing above.

The chat content transfer module, when an event indicating that character data has been input to the GUI module 54 is notified from this GUI module 54, acquires the character data input based on this event. Then, the module sends a chat message notification including the acquired character data to all other communication programs with which a session has been established. Further, when the chat content transfer module receives the chat message notification, the chat content transfer module requests the GUI module 54 to display the character data included in the chat message notification. As a result, a so-called "balloon" character display area is secured at a predetermined position in the window of the communication program, and character data is displayed in this area.

The chat log module records the input or received character data based on the chat message notification or the like sent from the chat content transfer module and creates a chat log file. The chat log module stores character data of a predetermined storage capacity in the RAM 21 of the computer device 10, and if necessary, stores the character data stored in the RAM 21 in HD format.
Generate a chat log file by saving it to D23 or the like. Also, the chat log module has a function of acquiring character data stored in the chat log file and displaying it in a predetermined area in the window of the communication program when a request to display the chat log is made. ing.

The emotion expression module is a module for reading and displaying animation effects relating to emotion expressions, the details of which will be described later. In addition, the emotion expression module requests the GUI module 54 to display a button or the like selected when expressing an emotion.

Further, when the emotion expression module receives the notification that a predetermined button is selected by the GUI module 54, the emotion expression data (animation data) corresponding to this button is sent to all communication programs in which a session is established. Send to. On the other hand, when the emotional expression data is received, the GUI module 54 is requested to display the emotional expression data.

The action module is a module for reading and displaying action data, the details of which will be described later. In addition, the action module requests the GUI module 54 to display a button or the like selected when displaying the action.

When the button selected when displaying an action is selected by the user, the action module stores the action data (animation data) corresponding to the selected button in all the sessions established. Send to communication program. On the other hand, when the action data is received,
A request to display this action data is issued to the GUI module 54.

The live appearance module is a module that operates in cooperation with a live distribution program for live distribution of image data and audio data via the Internet 11. Since the communication program has the live appearance module installed, it is possible to exchange image data and audio data with an external live distribution program.

The graffiti module secures a work area for displaying a character representing a user of a communication program with which a session has been established, and realizes a function of sharing a figure drawn by the user between the users in this work area. Is. The details of the functions realized by this scribble module will be described.

The file exchange module secures a work area for displaying a character representing a user of a communication program with which a session has been established, and realizes a function of exchanging various files between users by using this work area. It is a module that Details of the functions realized by this file exchange module will be described later.

The application module 53 is composed of various modules as described above. It should be noted that the communication program is not limited to the number and functions of the application modules 53 to be mounted, and in addition to the various modules described above, a module that provides a unique function is one of the application modules 53. May be implemented. Further, in the communication program, the application module 53 can be added or deleted as needed.

The GUI module 54 is a module for providing screen display such as window display generated in the communication program. However, for basic drawing of various windows such as dialog box,
It is provided by the basic module 52. The GUI module 54 draws in the window in response to a screen display request made from another module, and displays a function selection button, image data, and the like.

The GUI module 54 is provided with the position and arrangement of function selection buttons, the display position of image data,
Although it has information about the overall arrangement and configuration in the window, the number and contents of the function selection buttons are displayed by referring to the data included in the request by the core module 51 or each application module 53.

Note that the application module 53 installed in the communication program can use the application display area in which the drawing process can be performed independently without depending on the GUI module 54. When a screen display is performed using such an application display area, the GUI module secures the application display area in response to a request from the application module 53, and the drawing process in the secured application display area is performed by the application. It can be performed on the module 53 side.

Further, when the user selects a function selection button or the like displayed in the window, the GUI module 54 sends an event indicating that the function selection button has been selected to the basic module 52 and the application module 53. It has a function to notify

The communication program is composed of a plurality of modules as described above,
Each module is configured to operate in cooperation with each other as needed.

(5) Connection Setting Information Next, connection setting information used when establishing a session between computer devices in the communication system 1 will be described. The connection setting information is information generated in a computer device that executes a communication program that serves as a server.

For example, as shown in FIG. 5, the connection setting information is used by an access key and a communication program for performing authentication when the communication program serving as a client establishes a session with the communication program serving as a server. Network interface 28 of computer device 10
Port number of I, which is set in the computer device 10 on which the communication program serving as the server is executed
It is composed of the number of P addresses, a series of IP addresses set in the computer 10 on which the communication program serving as a server is executed, and the like.

(6) Basic Processing by Communication Program Below, the basic series of processing when the above-mentioned communication program is executed in the computer device 10 will be described in order with reference to the flowcharts shown in FIGS. 6 and 7. I will explain later.

When the execution process of the communication program is started (started), step S10 shown in FIG. 6 is performed.
At, the module for which the activation flag is set is activated by referring to the function module list. The functional module list has a data structure as shown in FIG. 8, for example, and for each module that constitutes the communication program, identification information (ID) unique to the module, a module name unique to the module, and execution of the module. It is composed of a type indicating a form, a usage condition, and the like, and an activation flag indicating whether or not it is activated according to the condition at the time of activation. Although the details of the activation flag will be described later, the communication program can select and activate the module to be activated according to the condition at the time of activation by referring to the function module list.

Next, the communication program is
In step S11, it is determined whether the connection setting information is received from the communication program executed by another computer device. If the result of this determination is that it has been received, the process proceeds to step S12, and if it has not been received, the process proceeds to step S13.

Here, when the communication program receives the connection setting information, the communication program operates as a client,
Various kinds of information are transmitted / received to / from the communication program on the server side which is the transmission source of the connection setting information. On the other hand, if the connection setting information has not been received,
The communication program operates as a server.

In step S12, the communication program, based on the received connection setting information,
A process of establishing a session with the communication program on the server side which is the transmission source of the connection setting information is performed.

In step S13, the communication program is requested to operate as a server and determines whether to activate the server module that provides the server function. This determination corresponds to the determination in step S11, and is performed by determining whether or not the connection setting information is received from the communication program executed by another computer device. As a result of this determination, if the server module is activated, the process proceeds to step S14, and if the server module is not activated and the client operates as a client, the process proceeds to step S17.

In step S14, the communication program determines whether or not a session has been established with the server module started by itself and connection has been established. As a result of this determination, if the connection is not yet made, the process proceeds to step S15, and if the connection is made, the process proceeds to step S17.

In step S15, the communication program activates the server module that provides the server function. Next, in step S16, the communication program establishes a session and establishes a connection with the server module activated by itself. With this, in the communication program, the function as the server is realized by the server module started by itself, and other modules other than the server module are
So to speak, it becomes possible to operate as a client.

In the communication program, since the server function is realized as a module in this way, even if it operates as a server, the procedure other than that of a server module can be performed by the same procedure as that for operating as a client. Allows the module to access the server. For this reason,
The processing procedure in these other modules can be simplified. After the session with the server module is established in step S16, the communication program advances the process to step S17.

In step S17, the communication program displays a window on the screen of the computer device 10, and various instruction operations by the user can be input through the input area and various function selection buttons displayed in this window. It becomes a state. Then, in step S17, the communication program is
The above-described function selection button is selected by the user, and it is determined whether or not to activate the function module corresponding to this function selection button. As a result of this determination, if the functional module is activated, the process proceeds to step S18, and if not activated, the process proceeds to step S19.

In step S18, the communication program activates the function module corresponding to the function selection button selected in step S17.
Then, after activating the functional module, the communication program advances the process to step S19.

In step S19, the communication program determines whether or not there is a message to be transmitted in the message transmission queue. Then, if the message exists in the message transmission queue, the process proceeds to step S20, and if the message does not exist, the process proceeds to step S21 shown in FIG.

Here, when the communication program exchanges various information such as image data, voice data or character data with other communication programs, the information is divided into information units called messages. . Then, the message to be sent to the other communication program is in the message send queue, the message received from the other communication program is in the message receive queue,
Each is temporarily accumulated. It should be noted that the message transmission queue and the message reception queue are secured in advance in a predetermined capacity, for example, in a storage area in the RAM 21 of the computer device 10.

In step S20, the communication program transmits the message existing in the message transmission queue to the server with which the session is established. After the processing in step S20, the communication program advances the processing to step S21 shown in FIG.

In step S21, the communication program determines whether or not the message received from the server exists in the message reception queue. Then, if a message exists in the message reception queue, the process proceeds to step S22, and if no message exists, the process proceeds to step S25.

In step S22, the communication program determines whether or not the functional module that is the destination of the message, that is, the functional module that uses this message has been activated. As a result of this determination, if the corresponding functional module as the transmission destination is not yet activated, the process proceeds to step S23, and if it is activated, the process proceeds to step S24.

In step S23, the communication program activates the activation module which is the destination of the message. Then, after activating the corresponding functional module as the transmission destination, the communication program advances the process to step S24.

In step S24, the communication program transmits the message to the functional module corresponding to the destination of the message existing in the message transmission queue. After the processing in step S24, the communication program
The process proceeds to step S25.

In step S25, the communication program determines whether or not the user has requested to end the execution operation by performing a predetermined instruction operation. If the result of this determination is that it is requested to end, the process proceeds to step S26, and if it is not requested to end, the process proceeds to step S13 shown in FIG. A series of processes after step S13 is repeated.

In step S26, the communication program determines whether or not the server module which realizes the server function is activated by itself. That is, it is determined whether or not the communication program is operating as a server. As a result of this determination, if the server module is started by itself, the process is performed in step S27.
If the server module is not activated by itself and is operating as a client, various termination processes are performed to stop a series of processing operations.

In step S27, the communication program performs termination processing for the server module started by itself in step S15, and stops the operation of this server module. After this, the communication program performs various termination processes to stop the series of processing operations.

Next, a series of processes in the server module started in step S15 described above will be described step by step with reference to the flowcharts shown in FIGS.

When the execution process is started, the server module determines in step S50 shown in FIG. 9 whether a connection request (session establishment request) has been received from the client. At this time, the client may be another functional module that constitutes a communication program that activates the server module, or a functional module that constitutes a communication program executed by another computer device. Then, as a result of this determination, if the connection request is received, the process proceeds to step S51, and if not, the process proceeds to step S55.

In step S51, the server module determines whether or not the number of users currently connected has reached the preset maximum number. As a result of this determination, if the maximum number of people is not reached, the process proceeds to step S52, and if the maximum number of people is reached, step S52 is performed.
The process proceeds to 55.

In step S52, the server module generates a user ID, which is unique information for each user, for the user who newly made the connection request, and
A session is established with the communication program operating on the user side to establish a connection. As a result, the communication program operating on the side of the user who has issued the connection request acts as a client, establishes a communication state with the server module, and exchanges various information such as image data, voice data, or character data. Is possible.

Next, in step S53, the server module acquires the IP address of the computer device that executes the communication program on the side of the user who has newly made the connection request, and the user name of this user, and at the same time, acquires these IP addresses. And the user name and the user ID generated in step S52 are added to the user list.

Here, the user list has a data structure as shown in FIG. 11, for example, and the user I of the user who has established a session with the server module.
D, the user name of this user, and the IP address of the computer device that executes the communication program on this user side.

Next, in step S54, the server module notifies all the clients with which the session has been established, such as the user ID of the user added in step S53. This allows all clients connected to the server module to know that a new user has been connected. After the processing in step S54, the server module advances the processing to step S55.

In step S55, the server module determines whether the connection state with the client with which the session has been established has been disconnected. If the result of this determination is that the connection status is disconnected, step S5
The process proceeds to step S6, and if the connection state is not disconnected, the process proceeds to step S58 shown in FIG. At this time, examples of factors that cause the disconnection of the connection state include a defect that has occurred in the transmission path between the server module and the client, and the termination processing of the communication module by the user.

In step S56, the server module deletes from the user list the information regarding the user whose connection status is determined to be disconnected in step S55. Next, in step S57, the server module notifies all the clients with which the session is established of information such as the user ID regarding the user deleted from the user list in step S56. As a result, all clients connected to the server module can know that the connection of the user has been disconnected. After the processing in step S57,
The server module advances the process to step S58 shown in FIG.

In step S58, the server module determines whether a message has been sent from the connected client. If the result of this determination is that it has been transmitted, the process proceeds to step S59, and if it has not been transmitted, the process proceeds to step S61.

In step S59, the server module refers to the user ID designated as the destination of the message and acquires the IP address corresponding to the user ID based on the user list. Next, in step S60, the server module transmits a message via the computer network such as the Internet 11 to the computer device to which the IP address acquired in step S59 is set. As a result, the message is delivered to the destination communication program. After the processing in step S60, the server module advances the processing to step S61.

In step S61, the server module determines whether or not an end request from the communication program has been received. Then, as a result of this determination, when an end request is received, various end processes are performed and a series of processing operations are stopped. If the end request has not been received, the process proceeds to step S5 shown in FIG.
The process proceeds to 0, and the series of processes from step S50 onward is repeated. This termination request to the server module corresponds to the case where step S27 in the series of processes of the communication program shown in FIG. 7 is processed.

The communication program is an application program that carries out a series of processes as described above. As is clear from the above description of the series of processing, the communication program is
It is possible to operate as a server or a client as needed.

(7) Application Window Displayed by Communication Program Next, with reference to the drawings, an application window displayed on the screen of the display unit 24 by executing the above-described communication program in the computer 10 will be described. While explaining step by step.

The communication program is
As will be described later in detail, the window is configured to be displayed in a state according to the condition at the time of startup, but in the following description, an example of the case where the process is executed under the most basic condition will be described. I shall explain.

In the communication system 1, each computer device 10 is provided with a communication program in an executable state, and the communication program operates on each computer device 10 to exchange various information with each other. But,
In the following description, a window display when a communication program operating on a specific computer device 10 is executed and processed will be described.

In the following description, the user of the communication program to be focused on will be referred to as "user", and the user of the communication program connected to the communication program, that is, the other user will be referred to as the "client". ". However, the communication program described below with focus does not necessarily have to fulfill the server function, and the server function may be fulfilled by the communication program operating on the user (client) side of the other party.

When the execution process of the communication program is started, a user information setting window 100 as shown in FIG. 12 is displayed on the screen of the display section 24. The user information setting window 100 is a window for prompting the user to select a name and face image corresponding to the user when the communication program is started, and corresponds to the text input area S100 for text inputting the name and the face image. A face image selection area S101 for selecting the selected image file.

The text input area S100 is an area in which text can be input by selecting it with a mouse or the like connected to the computer device 10, and in this state, text input by a keyboard or the like is input. The text input in the text input area S100 is set as the user's name in the subsequent processing of the communication program.

The face image selection area S101 is an area in which the file names corresponding to the image data stored in advance in the computer 10 as face images are displayed in a list. When the user selects the file names listed in the face image display area S101, the image data corresponding to the selected file name is set as the user's face image in the subsequent processing of the communication program.

Further, the user information setting window 100 has a reference button S102 for referring to a file corresponding to the image data when the user sets arbitrary image data as a face image. When the reference button S102 is selected, a file selection window for selecting image data existing in the computer device 10 is displayed. Then, when the user selects a file in the file selection window, the image data corresponding to the selected file is set as the face image of the user. The location (path) of the file selected in this way in the computer device 10
Is the path display area S of the user information setting window 100.
It is displayed on 103. Note that arbitrary image data (file) may be selectable as a face image by directly inputting a text designating a path in the path display area S103.

Further, the user information setting window 100
Is a preview display area S1 for displaying a preview of the contents of the image data selected by the user as described above.
Has 04. Thereby, the communication program can easily and surely select the face image desired by the user.

Note that FIG. 12 shows an example of a case where a so-called default face image in a preselected state is displayed in the preview display area S104. In the following description, it is assumed that the face image is not selected by the user in the user information setting window 100 and the default face image is selected.

The user information setting window 100 has a check box S10 for setting whether or not to select the name and face image as described above at the next startup.
5 and OK to finish the selection operation of the name and face image
It has a button S106 and a cancel button S107 for canceling the selection operation of the name and face image and canceling the activation of the communication program.

When the check box S105 is set to "ON", the communication program
User information setting window 10 when it is started next time
Display 0. On the other hand, when the check box S105 is set to "OFF", the display of the user information setting window 100 is omitted at the next startup, and the name and face image previously set by the user are used for reference.

Here, the user information setting window 100
When the OK button S106 in is selected by the user, the communication program shifts to the basic display mode and the basic display window 1 as shown in FIG.
Display 10 If the check box S17 is set to "OFF" in the user information setting window 100 at the previous startup, the display of the user information setting window 100 is omitted when the communication program is started, and the basic display mode is set immediately after the startup. Then, the basic display window 110 is displayed.

(7-1) Basic Display Mode Here, the case where the communication program is shifted to the basic display mode will be described with reference to the basic display window 110 shown in FIG.

The basic display window 110 is a window displayed when the communication program shifts to the basic display mode, and as shown in FIG. 13, a user face image frame S110 in which a face image corresponding to the user is displayed. It has a plurality of client face image frames S111 in which face images corresponding to a plurality of clients are respectively displayed, and a plurality of function selection buttons S112 for performing a selection operation for executing various functions.

The user face image frame S110 is arranged in the center of the basic display window 110, and the face image display area S11 for displaying the face image selected by the user is displayed.
0a and a name display area S110b which is located below the face image display area S110a and displays the name set by the user.

The client face image frame S111 is
The user face image frames S110 are arranged at predetermined intervals on the circumference of a virtual circle. These client face image frames S111 are the user face image frames S1.
A frame for displaying information on the client side corresponding to 10, a face image display area S110a for displaying a face image selected by each client,
The name display area S110b is located below the face image display area S110a and displays the name set by each client.

Incidentally, FIG. 13 shows a state in which the client is not yet connected. In this state, a predetermined face image set in advance indicating that the client is not connected is displayed in the client face image frame S111.

Further, the client face image frame S11
Each of No. 1 is displayed while gently moving in a predetermined area centered on the initial display position. As a result, in the basic display window 110, each client face image frame S111 is displayed in a state of floating feeling.

The function selection buttons S112 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S112 is arranged is the same as the client face image frame S11.
It is set to be smaller than the radius of the virtual circle in which 1 is arranged. That is, the function selection button S112 is displayed inside the client face image frame S111.

A predetermined function is associated with each function selection button S112. The communication program uses the function selection button S112 by the user.
When any of the above is selected and operated, the operation mode shifts to an operation mode that realizes a function corresponding to the selected function selection button S112.

In the example shown in FIG. 13, as the function selection button S112, a "setting" button S112a, an "end" button S112b, a "help" button S112c,
"Friend" button S112d and "Tool" button S1
12e shows the displayed state.

The setting button S112a is a function selection button for making various settings necessary for the communication program. The communication program is
When the setting button S112a is selected by the user, for example, a setting window (not shown) that displays setting items such as whether or not to sound a sound effect when various operations are performed by the user is displayed. In the communication program, the items set by the setting window are stored in a predetermined storage area in the computer device 10 and reflected in the operation of the communication program itself.

The end button S112b is a function selection button for ending the execution process of the communication program. When the user selects the end button S112b, the communication program ends the entire execution process.

The help button S112c is a function selection button for displaying help information for explaining the operation of the communication program to the user. The communication program is executed by the help button S1 by the user.
When 12c is selected, help information in which operation guidance and a solution to a problem are described is displayed in a help window (not shown). Since it is possible to display help information in this way, in a communication program, a user who is unfamiliar with the operation can easily explain his / her own operation and function.

The friend button S112d is a button for urging another user (client) connected to the Internet 11 to connect to a communication program and participate in communication.
The communication program performs a series of processes for prompting the client to participate when the friend button S112d is selected by the user. The details of this processing will be described later.

The tool button S112e is a function selection button for shifting to a tool mode for realizing various operations by the user. The communication program is
When the tool button S112e is selected by the user, the tool mode is entered. The details of this tool mode will be described later.

The basic display window 110 is located at the top of the window, and the basic display window 110 is
Operation icons S11 for operating the display state of
3 are arranged adjacent to each other, and a status display area S114 for displaying the operating state (status) of the communication program and various messages is arranged at the bottom of the window as required.

Here, in the example shown in FIG. 13, the "end" icon S113 is used as the operation icon S113.
a, "maximize" icon S113b, "minimize" icon S113c, and "change display size" icon S11
The figure shows a case where 3d is arranged.

The end icon S113a is an operation icon for ending the execution process of the communication program. The communication program ends the entire execution process when the user selects the end icon S113a.

The maximized icon S113b is an operation icon for enlarging and displaying the basic display window 110 on the entire display screen of the computer device 10. When the user selects the maximize icon S113b, the communication program performs a process of enlarging and displaying the basic display window 110 on the entire display screen of the computer device 10.

The minimize icon S113c indicates that the display of the basic display window 110 is stopped and the computer device 1
It is an operation icon for deleting from the display screen of 0.
When the user selects the minimize icon S113c, the communication program stops the display of the basic display window 110 and erases it from the display screen of the computer device 10. In addition, like this,
Even when the basic display window 110 is deleted from the display screen, the execution process of the communication program is continued.

The display size change icon S113d is an operation icon for shifting to the reduced display mode in which the basic display window 110 is reduced and displayed. When the display size change icon S113d is selected by the user, the communication program shifts from the basic display mode to the reduced display mode. As a result, the display area of the basic display window 110 is reduced to a reduced display window 120 as shown in FIG. 14, for example.

(7-2) Reduced Display Mode Here, the case where the communication program is shifted to the reduced display mode will be described with reference to the reduced display window 120 shown in FIG.

The reduced display window 120 is a window displayed when the communication program shifts to the reduced display mode.
The display area is set smaller than 0, and the computer device 10
Has a window shape that is long in the horizontal direction.

Here, in the reduced display window 120 shown in FIG. 14, description of frames, buttons, and icons having the same functions as those of the basic display window 110 shown in FIG. 13 is omitted, and the same reference numerals are given. I will. In the following description, the frames, buttons, and icons with the same reference numerals in the figures are
Description will be made assuming that they correspond to the above-mentioned respective items.

In the reduced display window 120, a plurality of client face image frames S111 are arranged side by side on both sides of the user face image frame S110 arranged in the central portion. Below the client face image frame S111, function selection buttons S112 are arranged side by side in the horizontal direction. A plurality of operation icons S113 are arranged at the top of the reduced display window 120.

When the user selects the display size change icon S113d in the reduced display window 120, the communication program shifts from the reduced display mode to the basic display mode. As a result, the display area of the reduced display window 120 is enlarged, and FIG.
The basic display window 110 shown in FIG.

That is, in the communication program, the display size change icon S is selected by the user.
By selecting 113d, the operation mode can be freely switched between the basic display mode and the reduced display mode.

(7-3) Client Participation Here, the case where the above-mentioned friend button S112d is selected by the user will be described. The communication program is a friend button S112d by the user.
When is selected, a series of processing that prompts the client to participate is performed. At this time, the communication program transmits the connection setting information to the client designated by the user. As a result, a session is established from the client side to the user side based on the IP address included in the connection setting information, and the connection is completed.

When transmitting the connection setting information to the client side, the communication program attaches, for example, a file containing the connection setting information to an electronic mail and transmits the electronic mail to the computer device on the client side. At this time, for example, in FIG.
The electronic mail having the content shown in the electronic mail window 140 shown in is transmitted to the client side.

As shown in FIG. 15, the e-mail window 140 is a destination input area S140 in which the destination of this e-mail, that is, the e-mail address set in the computer device of the client urging participation is input and displayed.
And a subject input area S141 in which the subject of this e-mail is input and displayed, and an attached file display area S in which the file name of the file attached to this e-mail is displayed.
142, and a body display area S143 in which the body of this e-mail is input and displayed.

In the subject name input area S141, a text such as "Invitation to communication", for example, which prompts the user to connect to the communication program on the user side and participate in the communication is input. Further, in the attached file display area S142, the file name of the file including the connection setting information (for example, “Connect.qz
e ”) is displayed. In addition, the text display area S143
Prompts the user to launch a communication program on the computer device to which the email is sent by executing the file attached to this email and establish a session with the communication program on the user side. The message is described.

Then, for example, after the user inputs the e-mail address of the client urging participation in the destination input area S140, the e-mail transmission process is performed, whereby a file attached to the e-mail is obtained. , Connection setting information is sent to the client side.

The communication system 1 is not limited to transmitting the connection setting information to the client side by e-mail, but may be a computer device connected to the Internet 11, such as so-called FTP software. The connection setting information may be sent in the form of a data file or an application program by using an application program that realizes various file exchanges between the two. Further, for example, the user is made aware of the start of the connection (establishment of a session) by directly exchanging the connection setting information between the computer devices without notifying the user (user) of the computer device of the connection start. Alternatively, the communication program may be automatically started on the computer device on the client side without the need.

(7-4) Interaction with Client Here, when the connection setting information is transmitted to the client side as described above and a session is established with the client, for example, as shown in FIG. As shown, for example, in the client face image frame in the basic display window 110, the face image and name of the connected client are displayed.

In FIG. 16, two clients, a first client in which an image simulating a female half body is set and a second client in which an image simulating an animal face is set, are connected. , And the basic display window 110 in the state displayed in the first client face image frame S111a and the second client face image frame S111b, respectively. In the following description, it is assumed that the first and second clients are in a connected state.

By the way, when the user selects the user face image frame S110 by, for example, the cursor overlapping the user face image frame S110 on the screen by operating the mouse, as shown in FIG. The face image frame S110 is reduced and displayed, and a text input area S115 in which a user can input text (character data) is displayed at a position near the reduced user face image frame S110.

The text input area S115 is an area having a so-called "speech bubble" -like outer shape in general comics with respect to the user face image frame S110 displayed in a reduced size. Then, when the text is input to the text input area S115 by the user, the communication program transmits the input text (character data) to all the clients currently connected.

Also, the communication program is
Similarly, when the text (character data) transmitted from the client is received, as shown in FIG. 18, the client face image frame S11 corresponding to the client is received.
1 is reduced and displayed, and the text display area S116 in which the text transmitted from the client is displayed is displayed in the vicinity of the reduced client face image frame S111. This text display area S11
6 is a reduced size client face image frame S1
11 is a region having a so-called "blowout" outer shape in general comics.

[0172] It should be noted that, in FIG. 18 is a text which is "Hello!" From the first client is sent, together with the first client face image frame S111a is displayed reduction, of the first client face image frame S111a The figure shows a case where the text display area S116 is displayed in the vicinity position. Further, in the communication program, for example, when texts are simultaneously transmitted from a plurality of clients, the text display area S116 corresponding to each client is displayed. That is, when the texts are simultaneously transmitted from the four clients, the client face image frame S111 corresponding to each client is displayed in a reduced size, and the balloon-shaped text display area S is displayed in each of them.
116 will be displayed.

As described above, the communication program is capable of exchanging character data with each other between the user and the client, and at the same time, simultaneously with a plurality of clients, the text data is transmitted. It is possible to give and receive.

In the communication program, text exchange using the text input area S115 and the text display area S116 as described above is performed in the basic display window 1 in the basic display mode.
Not only within 10, but also within windows in other operating modes.

(7-5) Tool Mode Here, the case where the communication program is shifted to the tool mode will be described with reference to the tool display window 150 shown in FIG.

The tool display window 150 is a window displayed when the communication program shifts to the tool mode, and basically has the same configuration as the basic display window 110 shown in FIG. 13, as shown in FIG. It is said that. Therefore, in the tool display window 150 shown in FIG. 19, description of the same or equivalent frames, buttons, and icons as those of the basic display window 110 shown in FIG. 13 will be omitted and the same reference numerals will be given.

The tool display window 150 is different from the basic display window 110 in that it has a plurality of function selection buttons S150 instead of the function selection button S112 shown in FIG. Similar to the function selection button S112 shown in FIG. 13, the function selection buttons S150 are arranged at predetermined intervals on a virtual circle centered on the user face image frame S110. The radius of the virtual circle on which the function selection button S150 is arranged is smaller than the radius of the virtual circle on which the client face image frame S111 is arranged. That is, the function selection button S150 is displayed inside the client face image frame S111.

Predetermined functions are associated with the respective function selection buttons S150. The communication program uses the function selection button S150 by the user.
When any of the above is selected and operated, the operation mode shifts to an operation mode that realizes a function corresponding to the selected function selection button S150.

In the example shown in FIG. 19, a "scribble" button S150a is used as the function selection button S150.
"File exchange" button S150b, "Help" button S150c, "Back" button S150d, "Image / sound" button S150e, "Chat log" button S15
0f and a "Web browser" button S150g are displayed.

The scribble button S150a secures a work area for displaying a character representing the user of the communication program with which the session has been established, and uses this work area to realize a function of exchanging various files between the users. This is a function selection button for shifting to the writing mode. The communication program is
When the user selects the scribble button S150a, the scribble mode is entered. The details of the scribble mode will be described later.

The file exchange button S150b secures a work area for displaying a character representing a user of a communication program with which a session has been established, and uses this work area to exchange various files between users. It is a function selection button for shifting to the realized file exchange mode. The communication program is a file exchange button S150b by the user.
Is selected, the file exchange mode is entered. The details of this file exchange mode will be described later.

The help button S150c is the help button S1 in the basic display window 110 shown in FIG.
12c is a function selection button for displaying help information for explaining the operation of the communication program to the user. When the user selects the help button S150c, the communication program displays help information in which help guidance and a method for determining a problem are described in a help window (not shown).

The return button S150d is a function selection button for ending the tool mode and shifting to the basic display mode. When the user selects the return button S150d, the communication program ends the tool mode and shifts to the basic display mode.

The image / sound button S150e is a function selection button for shifting to an image / sound setting mode which realizes various setting operations concerning images and sounds by the user.
When the user selects the image / sound button 150e, the communication program shifts to the image / sound setting mode.

The chat log button S150f is a function selection button for shifting to the chat log display mode for displaying the chat log. The communication program allows the user to select a chat log button S150f.
When is selected, the mode shifts to the chat log display mode.

Web browser button S150g
b This is a function selection button for shifting to the browsing mode. The communication program, when the user selects the Web browser button S150g,
Move to Web browsing mode.

The communication program is
When the display size change icon S113d is selected by the user while the tool display window 150 is displayed, the reduced display window 12 shown in FIG.
It becomes 0. At this time, when the reduced display window 120 is displayed in the tool mode, each function selection button S11 is displayed in the reduced display window 120 shown in FIG.
Instead of 2, the function selection button S150 described above is displayed. Further, when the mode is changed to the tool mode in the state of the reduced display window 120 shown in FIG.
In the state of the reduced display window 120, instead of each function selection button S112, the function selection button S1 described above is used.
50 will be displayed.

That is, in the communication program, the maximizing icon S113b and the minimizing icon S113c are associated with each other without depending on the operation mode.
It is possible that the window is in a maximized state or the window is in a minimized state. Also, each time the display size change icon S113d is selected by the user, the display size change icon S113d is displayed in a standard size corresponding to the basic display window 110 or the tool display window 150, or a reduced size corresponding to the reduced display window 120. It is possible to be in a state.
In the communication program, such a window size change is also possible in the operation modes described below.

(7-6) Scribble Mode Here, the case where the communication program is shifted to the scribble mode will be described with reference to the scribble window 160 shown in FIG.

The graffiti window 160 is a window displayed when the communication program shifts to the scribble mode. As shown in FIG. 20, a new scribble area S160 is provided at the bottom of the reduced display window 120 shown in FIG. Is ensured.

[0191] A "pencil" button S is attached to a predetermined portion (the left half portion in the drawing) in the scribble area S160.
161, a “squeeze button” S162, a “stamp” button S163, a “color change” button S164, and a map display area S165 are provided. In addition, a work area S166 in which a figure or the like is drawn in accordance with a user's operation is set in a predetermined portion of the scribble area S160 (on the right side of the portion where the above-described buttons are arranged in the figure). There is. In addition, a save button S167 for saving a figure and the like drawn in the work area S166 as a file in the computer device 10 above the scribble area S160, and the current operation mode in which the graffiti mode has been completed. A mode end icon S168a for transitioning to the operation mode and a help icon S168b for displaying help information are provided.

Further, in the work area S166, a plurality of characters S169 are displayed corresponding to the user with which the session is currently established. Each character S169
Respectively have images equivalent to the face images displayed in a list corresponding to each user in the reduced display window 120. Note that in FIG. 20, the character (user character S169a) corresponding to the user of the communication program is the user face image frame S.
A character (other user character S169b) having an image corresponding to the face image displayed in 110 and corresponding to the first client (other user) is displayed in the first client face image frame S111a. The case where the image corresponding to the face image is included is illustrated.

The image set for each character is
The contents of the face image of each user are always reflected. For example, when the face image displayed in the reduced display window 120 is changed or updated, the face image is changed or updated at any time.

Here, when the user or the partner user does not perform any operation, the user character S169a and the partner user character S169b are, for example, "walking".
The work area S166 is randomly moved and displayed along with animations such as "sitting in" and "running around". At this time, the user character S169a may move toward the mouse cursor displayed in the work area S166 instead of moving randomly. Thereby, the user can easily imagine that the user character S169a can be operated.

When the user character S169a receives an operation from the user, for example, by using a mouse connected to the computer device 10, the user character S169a performs a predetermined work in the work area S166 according to the input operation. I do. The work performed at this time will be described below.

If the user character S169a is so-called dragged with the mouse under the state where the pencil button S161 is selected, the user character S169a moves within the work area S166 in accordance with the movement operation of the mouse performed by the user. Meanwhile, a line is drawn along the locus of this movement.

At this time, an upper limit is set for the moving speed of the user character S169a, and when the user drags the mouse at a speed exceeding this upper limit, a line is drawn as follows. .

That is, in this case, first, the mouse cursor is displayed following the drag operation of the mouse by the user, and the trajectory of the mouse cursor is changed to the work area S16.
6 is drawn. The locus drawn at this time is drawn in a less noticeable state than the line drawn by the user character S169a. Specifically, for example, a line having a line width narrower than that of the line finally drawn, or a line of a color whose brightness is lower than that of the line finally drawn is drawn.

Next, the user character S169a moves along the trajectory of the previously drawn mouse cursor, and a line is drawn along the trajectory of the user character S169a.

As described above, since the upper limit value is set for the moving speed of the user character S169a and the user character S169a moves while following the trajectory of the mouse cursor operated by the user, the user character S169a moves. It has an effect that it is possible to psychologically suppress performing a quick operation unnecessarily.

Here, in the communication system 1 according to the present example, the contents drawn in the work area S166 are transmitted to the partner user, and the contents are reflected on the display screen of the partner user, as will be described later in detail. Is configured. At this time, since the user's quick operation is psychologically suppressed as described above, it is possible to prevent a large amount of drawing data to be transmitted at one time from being accumulated when the user performs a large amount of drawing quickly. can do. As a result, it is possible to reduce the delay due to the time required for transmitting the drawing data and the like until the drawing content on the user side is reflected on the partner user side.

On the other hand, when the user character S169a is so-called dragged by the mouse under the condition that the squash button S162 is selected, the user character S169a is moved to the work area S166 in accordance with the user's mouse movement operation. Move in. Then, the previous drawing content included in the trajectory of the user character S169a is erased.

In addition, the user character S
When the so-called double-click operation is performed on 169a or when the stamp button S163 is selected, the current face image of the user is drawn at the position where the current user character S169a is present in the work area S166.

Further, the color change button S1 is selected by the user.
When 64 is selected, a window (not shown) for changing the color of the line drawn as the trajectory of the user character S169a is displayed. At this time, it may be possible to change not only the color of the line to be drawn but also the thickness and texture of the line.

The map display area S165 is provided for the purpose of grasping the entire work area S166.
The current state of the entire work area S166 is reduced and displayed.

In the above description, the case where the user operates the user character S169a via the mouse to draw in the work area S166 has been described. However, the user draws in this way. The content is also transmitted to all the users (other users) with whom the session has been established, and is reflected in the display content on the other user side.

The contents drawn by the other user are also transmitted to the user side in the same manner, and the work area S
Other user character S169b displayed in 166
Is similarly animated and reflected in the work area S166. The details of the transmission / reception of the drawing contents performed between the user and the other user in this manner will be described later.

(7-7) Processing in Scribble Mode In the communication program, various operations in the scribble mode are mainly realized by the scribble module. The processing performed in the scribble mode will be described below with reference to the flowchart. The process in the scribble mode includes a mouse event process performed in response to a mouse event generated by a user performing a mouse operation, a timer event process performed at a predetermined time interval (for example, every 100 msec), and a partner user. The process can be roughly divided into a data reception event process performed when the drawing data transmitted from the side is received and an animation execution process that executes an animation command described later.
Hereinafter, these processes will be described in order.

It should be noted that the processing described below is executed by the communication program for the sake of convenience of explanation, but in reality, various modules such as the scribble module are executed in close cooperation with each other. It will be realized.

First, the mouse event processing will be described. When the communication program detects that the user has operated the mouse, the communication program starts the mouse event process shown in FIG. By this, step S
At 170, the communication program determines whether the user character has been right-clicked (a selection operation by pressing the right mouse button) and dragged in this state. If the result of this determination is that a drag operation has been performed after right-clicking, the processing proceeds to step S17.
1; otherwise, the process proceeds to step S173.
Proceed to.

[0211] In step S171, the communication program generates drawing data for drawing a line along the locus of the mouse cursor operated by the user.
The data is stored in a predetermined memory area (transmission queue) set in the M21, the HDD 23, or the like. After the processing in step S171, the processing proceeds to step S172.

Here, the data structure of drawing data generated by the communication program will be described. As shown in FIG. 22, the drawing data includes a "type" indicating the type of content to be drawn, a "line starting point" indicating the coordinates of the starting point of the line to be drawn, and coordinates of the ending point of the line to be drawn. It is a data group composed of the "line end point" shown, the "line thickness" showing the thickness of the drawn line, and the "line color" showing the color of the drawn line. Here, the item of "type" is
When the value is "1", it indicates that this drawing data is data for drawing a line, and when this value is "2", this drawing data creates a face image at the current position of the character. Indicates that the data is for drawing (stamping). In addition, when the value of the item of "type" is "2", the coordinates for drawing the face image are set at the "starting point of the line", and meaningless values are set for the other items.

In step S172, the communication program generates an animation command for displaying the animation of the user character based on the accumulated drawing data, and the animation command is set in the RAM 21 or HDD 23 of the computer device 10, for example. It is stored in the memory area (transmission queue) of. After the processing in step S172, step S173
The process proceeds to.

The animation command is, for example, as shown in FIG.
As shown in, "action" that specifies the action of the character,
The data structure has a "state" that designates the state of the user character and a "destination" that designates target coordinates for moving the character.

Here, for example, when the value of "action" is "1", it indicates that a "walking" animation is added to the character, and when the value is "2", it indicates " This means that an animation of "behave" is given, and if the value is "3", it means that an animation of "behave at the current position" is given. The value of the "state" indicates the state of the character, that is, the state in which nothing is done, the state in which a line is drawn, the state in which a face image is drawn, and the like.

In step S171, for example, the value of "action" is set to "1", the "state" is set to "walking and moving state", and the value of "destination" is set to the line drawing start coordinate. Animation command, "action" value is "2", "state" is "line drawing state", "destination"
And a second animation command in which the value of is set to the line drawing end coordinates. As a result, after the character moves with the "walking" animation to the drawing start point of the line by the subsequent processing, the line moves while the "walking" animation moves from the drawing start point to the drawing end point. Will be drawn.

In step S173, the communication program determines whether the user character has been left-clicked (a selection operation by pressing the left mouse button) and dragged in this state. As a result of this determination, if the drag operation is performed after the left click, the process proceeds to step S174, and if not, the process proceeds to step S176.

[0218] In step S174, the communication program generates drawing data for erasing the drawing contents along the trajectory of the mouse cursor operated by the user, and stores the drawing data in a predetermined memory area. The drawing data generated at this time is, for example, "type".
Is set to "1", and the value of "line color" is set to a value indicating "white".

Then, in step S175, the communication program generates an animation command based on the accumulated drawing data and stores it in a predetermined memory area. After the process in step S175, the process proceeds to step S176.

In step S176, the communication program determines whether or not the user character has been double-clicked (the operation of continuously pressing the mouse button). As a result of this determination, if the double-click operation is performed, the process proceeds to step S177, and if the double-click operation is not performed, the mouse event process ends.

In step S177, the communication program generates drawing data for performing a drawing process (stamping process) on the face image at the current position of the user character, and stores the drawing data in a predetermined memory area. The drawing data generated at this time has, for example, a “type” value of “2”.
Then, the coordinates for drawing the face image are set to the value of the “starting point of the line”.

Next, in step S178, the communication program generates an animation command based on the stored drawing data and stores it in a predetermined memory area. After the processing in step S178, the mouse event processing ends.

In step S178, for example, the value of "action" is set to "1", the "state" is set to "nothing", and the value of "destination" is set to the drawing coordinate of the face image. And the second animation command in which the value of “action” is set to “3” and the “state” is set to “state of drawing face image”. As a result, after the character moves to the drawing position of the face image by the subsequent processing, after the character moves with the animation of "walking" from this drawing to the drawing end point, the character draws the face image at this drawing position. An animation (stamp) is displayed, and the current face image of the user is drawn at this position.

Next, the timer event process will be described. The timer event process is a process started at a predetermined time interval (for example, every 100 msec) set in advance. When this timer event process is started, FIG.
In step S180 shown in FIG. 4, the communication program executes steps S181 to S18.
A process of sequentially performing the processes up to 4 is started for all the users for whom the session has been established.

In step S181, the communication program sets a new face image as this face image when the face image corresponding to the predetermined user has been changed. Next, in step S182, by referring to the animation command of the character corresponding to the user, the animation of the character is advanced by one frame and displayed. Next, step S183.
At, it is determined whether the animation display of the character is completed, and if it is completed, the process proceeds to step S184. If not completed, the process proceeds to step S185.

In step S184, the drawing data corresponding to the character is referred to, and if necessary, the process of drawing a line or a face image is performed. At this time, of the drawing data stored in the predetermined memory area, the drawing data stored first is processed. That is, the drawing data is sequentially processed from the first accumulated data,
In other words, a FIFO (Fast in Fast out) process is performed. After the processing in step S184, the process proceeds to step S185.

In step S185, the communication program determines for all users whether or not the series of processes from step S181 to step S184 has been completed. If the result of this determination is that it is not complete, the process returns to step S181, the processes of steps S181 to S184 are repeated for the next user, and if it is complete, the process proceeds to step S186.

In step S186, the communication program determines whether or not a predetermined amount of data (that is, drawing data and animation command) to be transmitted to all the users (other users) with which the session has been established is accumulated in the transmission queue. Alternatively, even if the predetermined amount is not accumulated, it is determined whether or not the transmission data is transmitted to the partner user side by determining whether the predetermined time has elapsed after the accumulation. As a result of this determination, if the transmission data is to be transmitted, the process proceeds to step S187, and if not, the timer event process ends.

In step S187, the communication program collects the transmission data accumulated in the predetermined memory area into one communication data and transmits it to all the communication programs (other users) with which the session is established. After the processing in step S187, the communication program ends the timer event.

Next, the data reception event process will be described. When the communication program receives data used by the scribble module from the other user, the communication program starts the data reception event process shown in FIG.

In this data reception event process, first,
In step S190 shown in FIG. 25, the received drawing data is analyzed. Here, although the data transmitted from the other user includes a plurality of drawing data, the communication program analyzes and extracts the drawing data included in the received data in step S190, and extracts all drawing data in step S191. From step S1
The processing shown in 96 is performed.

In step S191, the communication program refers to whether or not the value of the "type" of this drawing data is "1", and whether this drawing data indicates drawing a line. Determine whether or not. As a result, if a line is to be drawn, the process proceeds to step S192, and if not, the process proceeds to step S194.

In step S192, the communication program stores this drawing data in a predetermined memory area. Next, in step S193, the communication program generates an animation command based on this drawing data and stores it in a predetermined memory area. After this processing, the communication program advances the processing to step S194.

In step S194, the communication program refers to whether or not the value of the "type" of the drawing data is "2", thereby indicating that this drawing data draws (stamps) a face image. It is determined whether it is a thing. As a result, if the stamp process is to be performed, the process proceeds to step S195, and if not, the process related to the drawing data is ended. If a series of processes has been completed for all the drawing data included in the received data, the data reception event process ends.

In step S195, the communication program stores the drawing data (and thus the face image included in the drawing data) in a predetermined memory area. Next, in step S196, the communication program generates an animation command based on this drawing data and stores it in a predetermined memory area. After this processing, the processing regarding this drawing data is ended. If a series of processes has been completed for all the drawing data included in the received data, the data reception event process ends.

Next, the animation execution processing will be described. The communication program performs the animation execution process shown in FIG. 26 when performing the process of advancing the animation one frame at step S182 in the above-mentioned timer event process, and the work area S166.
An animation is displayed for each character displayed inside.

When this animation execution processing is started, in step S200 shown in FIG. 26, the communication program is the first of the animation commands corresponding to the character to be processed among the animation commands stored in the predetermined memory area. Get the first accumulated animation command.

Next, in step S201, the communication program refers to the value of "action" of this animation command, and this value is "1" or "2".
Or not. If the value of “action” is “1” or “2”, it is necessary to move the character to be processed within the work area S166, so the process proceeds to step S202. If it is not necessary to move the character to be processed, the process proceeds to step S20.
Go to 5.

In step S202, the communication program moves and displays the character to be processed by one frame from the current display position toward the position of the coordinates designated by the animation command.
Next, in step S203, the communication program determines whether or not the display position of this character has reached the coordinates (target coordinates) designated by the value of "destination" in the animation command. As a result,
If so, the process proceeds to step S204,
If not, the process proceeds to step S205.

[0240] In step S204, the communication program sets the end flag to "on". Here, the end flag is a flag indicating whether or not the animation processing for the character to be processed specified by the animation command has ended,
When this is "ON", it indicates that the animation process specified by the animation command has ended. That is, in this step S204, the end flag is set to "ON" on the assumption that the character has completed moving to the coordinates designated by the animation command. After this process, the process proceeds to step S205.

In step S205, the communication program increments the value of the status counter by one.
Here, the state counter means the current state of the character,
That is, for example, when a "walking" animation is given, it indicates a state in which the right foot of the character is displayed in a forwardly projected state or the left foot is displayed in a forwardly projected state. By advancing this state counter, the display of the character is changed, and an animation effect can be given by this.

Next, in step S206, the value of the "action" of the animation command is "3", and the state counter corresponding to the character to be processed is
It is determined whether or not it has reached a predetermined value. Here, when the value of “action” is “3”, this corresponds to the process of displaying a predetermined animation without changing the display position of the character. It is judged whether all are completed. Then, if all are completed, the process proceeds to step S207, and if not completed, the process proceeds to step S208.

[0243] In step S207, the communication program sets the end flag to "on". As a result, the animation process for the specific character designated by the animation command to be processed is completed. After this process,
The process proceeds to step S208.

At step S208, the communication program determines whether or not the end flag is set to "ON". As a result, if the end flag is "ON", the process proceeds to step S209, and if not, the animation execution process ends.

In step S209, the communication program deletes the animation command to be processed from the memory area in which this animation command is stored. That is, in this animation execution processing, the accumulated animation commands are, so to speak, FIFO processed.

Next, in step S210, the communication program needs to perform drawing processing after this animation processing by referring to whether or not the value of "action" is "2" or "3". Determine if there is. As a result, when the drawing process is performed, the process proceeds to step S211, and when the drawing process is unnecessary, the animation execution process is ended.

In step S211, the communication program outputs a notification indicating that all the animation processing for the character to be processed is completed. This notification is used in the determination processing in step S183 in the timer event processing described above. That is, when the notification indicating the completion of the animation processing is output in this step S211, it is determined that the animation is completed in step S183 of the timer event processing, and thereafter, the drawing data is executed in step S184, whereby the work area S1
Drawing is performed on 66. It should be noted that the animation execution processing is ended after the processing in step S211.

(7-8) File Exchange Mode Here, the case where the communication program shifts to the file exchange mode will be described with reference to the file exchange window 220 shown in FIG.

The file exchange window 220 is a window displayed when the communication program shifts to the file exchange mode. As shown in FIG. 27, a file exchange window is newly added at the bottom of the reduced display window shown in FIG. The area S220 is ensured.

A guide area and a map area are set in a predetermined area (left half area in the figure) in the file exchange area S220, and "file arrangement" is set in the guide area.
A button S221 is displayed, and a map display area S222 having the same function as the map display area S165 in the scribble mode is displayed in the map area. . Also, in the guide area, a text explaining the operation in this file exchange mode, for example, an explanatory text such as "Select the file placement button to make your file available for download by others." Is displayed.

[0251] Further, a work for exchanging files with a predetermined user of the file exchange area S220 (the right half portion in the figure) with an arbitrary user whose session is established according to an operation by the user. Area S223 is set. Also, a mode end icon S224a for ending the file exchange mode which is the current operation mode and shifting to the previous operation mode and a help icon S224b for displaying help information are provided above the file exchange area S220. Is provided.

Further, in the work area S223, a plurality of characters S225 are displayed corresponding to the user with which the session is currently established. Each character S225
Respectively have images equivalent to the face images displayed in a list corresponding to each user in the reduced display window 120. Note that, in FIG. 27, the character (user character S225a) corresponding to the user of the communication program is the user face image frame S.
A character (other user character S225b) having an image corresponding to the face image displayed in 110 and corresponding to the first client (other user) is displayed in the first client face image frame S111a. The case where the image corresponding to the face image is included is illustrated.

The character S225 displayed in the work area S223 in the file exchange mode corresponds to the character S169 described above in the scribble mode, and operates similarly to the character S169. Therefore, in the following, only differences between the character S225 and the character S169 will be described.

The character S225 is subjected to the same animation processing as that of the character S169 in the scribble mode in a state where no operation is performed by the user, but the image and animation operation of the character itself are different from those in the scribble mode. It is desirable to be different. As a result, the user can easily understand in which operation mode the communication program is currently operating.

When the file placement button S221 is selected by the user in the state where the file exchange window 220 configured as above is displayed, the files stored in the user's computer device 10 (for example, the HDD 23) are stored. A file selection window (not shown) for selecting is displayed separately from the file exchange window 220. Then, when the user selects a file to be transmitted to another user, that is, a file to be transmitted, using this file selection window, the file selection window is hidden and
The file exchange window 220 is displayed as shown in FIG.

In this example, it is assumed that the user selects a file to be transmitted by using a file selection window displayed separately from the file exchange window 220. It is also possible to newly set an area for selecting a file to be transmitted in the file exchange window 220 and perform the operation in this area.

When a file to be transmitted is selected, the file shown in FIG.
As shown in FIG. 8, the user character S225a is displayed in a state that it is ready to exchange files. In this example, it is assumed that the user character S225a is displayed with a "green ball" at this time. That is, this "green ball" symbolizes a file transmitted from the user side to the partner user side.
At this time, the file arrangement button S221 is in a non-selectable state, for example, by being displayed in gray. Furthermore, in the guide area, a "put here" button S22
6 and a “return home” button S227 are newly displayed.

At this time, the "put here" button S226
Is selected by the user, or when the left button of the mouse is clicked by the user, the user character S225a animation-displays the action of "putting" a "green ball" on the work area S223.
A "green ball" icon S228 is placed at the current position of the user character S225a.

When the "return home" button S227 is selected by the user or the right mouse button is clicked by the user, the user character S225a is in a state of holding the "green ball". The work area S223 is moved to the outside of the screen as it is, and appears again in the work area S223 after a predetermined time has elapsed. When the user character S225a appears again in this way, the user character S225a is brought into a state not having a "green ball", and the state returns to the state shown in FIG. That is, the "return" button S22
The click operation of 7 or the right button corresponds to the cancel operation of the file exchange.

FIG. 29 shows the file exchange window 220 with the "green ball" icon S228 arranged in the work area S223 as described above. In this state, the file arrangement button S221 is made selectable again, and the “put here” button S226 and the “return button” S227 are hidden, and the guide area is the normal one shown in FIG. The display state is set.

When the "green ball" icon S228 is arranged in the work area S223 as described above, the information regarding the file to be transmitted / received by the user is transmitted to all the other users with whom the session has been established. Sent to Thereby, the work area S223 on the partner user side
A "yellow ball" icon indicating that there is a file targeted for transmission by another user is displayed therein.
In order to describe the “yellow ball” icon, the following description will be given with reference to FIG. 30, assuming that the file selection operation described above is performed on the partner user side.

In the same manner as described above, when the "green ball" icon is placed in the work area of the other user (client), the work area S223 in the file exchange window 220 on the user side is displayed. As shown in FIG. 30, a "yellow ball" icon S230 is displayed. The "yellow ball" icon S230 symbolizes a file that is a transmission target on the partner user side.

Further, in this state, when the user operates the mouse cursor to a position overlapping the "yellow ball" icon S230, the file to be transmitted by the other user corresponding to the "yellow ball" icon S230. Information related to the information is displayed in the guide area, as indicated by reference numeral S231 in the figure. Examples of the information regarding the transmission target file displayed at this time include the owner of the file (that is, the user name of the transmission source of the file), the file name, and the size of the file. In this example, when the mouse cursor is moved to a position overlapping the “yellow ball” icon S230, the information regarding the file to be transmitted by the other user is displayed in the guide area. S22
When 5a is moved to the vicinity of the "yellow ball" icon S230, information about the file may be displayed in the guide area.

As shown in FIG. 30, when the "yellow ball" icon S230 is placed in the work area S223 and the user selects the "yellow ball" icon S230 by clicking, The file exchange window 220 is in the state shown in FIG. That is, FIG.
As shown in FIG. 1, the user character S225a moves to a position near the “yellow ball” icon S230, and an animation of the user character S225a lifting the “yellow ball” is displayed as an animation. It will be displayed with a "yellow ball".

In this state, the file arrangement button S
221 is in a non-selectable state by, for example, being displayed in gray. Furthermore, in the guide area, a “download” button S232 and a “cancel” button S233 are provided.
And are newly displayed.

At this time, the "download" button S23
When 2 is selected by the user or when the left button of the mouse is clicked by the user, a process of acquiring the file corresponding to the “yellow ball” icon S230 from the other user side is performed.

When the "Cancel" button S233 is selected by the user or when the right button of the mouse is clicked by the user, the user character S225a sets the "yellow ball" in the work area S223.
An animation of the "place" action is displayed inside, and a "yellow ball" icon S230 is placed at the current position of the user character S225a. That is, the click operation of the “Cancel” button S233 or the right button in this state corresponds to the operation of canceling the file acquisition from the partner user.

[0268] Here, as described above, "yellow ball"
When performing the process of acquiring the file corresponding to the icon S230 from the partner user side, this file is stored in the user side computer device 10 (for example, in the HDD 23).
In the file exchange window 220, a save location selection window (not shown) for selecting where to save the file is displayed.
It is displayed separately from. Then, when the user selects the storage location of the file acquired from the other user using the storage location selection window, the storage location selection window is hidden and the file exchange window is displayed as shown in FIG. It becomes a display state.

In this example, the storage location selection window displayed separately from the file exchange window 220 is used to select the storage location of the file to be acquired. For example, an area for selecting a file to be acquired may be newly set in the file exchange window 220, and the processing may be performed in this area.

When the storage location of the file to be acquired is selected, as shown in FIG. 32, the "yellow ball" icon S230 is displayed horizontally toward the right edge of the work area S223, as shown in FIG. The arrow image S234 is displayed in the direction, and a message indicating that the file is being acquired from the other user is displayed at the top of the arrow image S234 (for example, "Downloading ... 202KB / 263KB 76% complete").
Message) is displayed. In addition, the user character S225a moves toward the right edge portion of the work area S223 along the arrow image S234 according to the file acquisition status while holding the “yellow ball”. When the file is completely acquired, the user character S22
5a disappears outside the screen of the work area S223. After that, when a predetermined time elapses, the user character S2
25a appears again in the work area S223 in a normal state where it does not have a "yellow ball".

Further, while the file is being obtained from the other user as described above, a "Cancel" button S235 in the guide area and a message indicating that the file is being obtained (for example, "Download file from other user"). Medium. 76% complete, about 5 seconds left "
An acquisition status display area S236 for displaying is displayed. When the "cancel" button S235 is selected by the user, the process of acquiring the file from the other user is stopped, and the normal state shown in FIG. 27 is restored.

By the way, in the file exchange mode, the user face image frame S110 displayed in the reduced display window 120 is selected, and the text is input by the user using the text input area S115 described above with reference to FIG. When input, as shown in FIG. 33, the input text can be placed in the work area S223 as the standing image S240.
Below, the case where the standing image S240 is arranged in this way will be described.

When the text is input by the user, the user character S225a is displayed as an animation with the standing bill and the file arrangement button S is displayed.
221 is displayed in gray, for example, and becomes unselectable. Further, in the guide area, a "stand up" button S241 and a "discard" button S242 are newly displayed.

At this time, the "stand up" button S24
When 1 is selected by the user, or when the left mouse button is clicked by the user,
A motion of raising the standing bill by the user character S225a is displayed in animation, and the standing bill image S2 is displayed at the current position of the user character S225a in the work area S223.
40 are arranged. Tatefuda image S240 is an image that previously entered using the text input area S115 text (for example, text such as "Hello!") Is displayed.

[0275] When the "discard" button S242 is selected by the user, or when the user clicks the right mouse button, the user character S225a displays an animation of the operation of discarding the standing card and displays the standing card. The image arranging operation is canceled to return to the normal state shown in FIG.

[0276] Also, the standing bill image S24 as described above.
When 0 is placed in the work area S223, the coordinates of the standing board image S240 in the work area S223, the text displayed in the standing board image S240, and the standing board image S240.
Information such as a user ID for identifying the user who has placed 240 is transmitted to all the users with whom the session has been established, and the standing tag image S240 is similarly displayed in the work area of the other user. It will be.

As described above, in the file exchange mode, the characters corresponding to each user are displayed in animation in the work area S223, and the "green ball" icon S228 and the "yellow ball" icon S230 are displayed in the work area. By displaying in S223, the files can be exchanged between the users with which the session is established. Further, since the standing image S240 arranged in the work area S223 is also reflected and displayed in the work area S223 of the other user side, communication can be achieved by exchanging messages using the work area S223. .

In the communication system 1 according to this example, the "green ball" icon S228, the "yellow ball" icon S230, or the standing image S240.
Can be displayed in a desired number in the work area S223 according to a user's operation, and the display number is not particularly limited.

Further, in the communication system 1 according to this example, the standing bill image S24 is executed as described above.
The operation of arranging 0 in the work area S223 can be performed in the same manner even in the previously described scribing mode.

(7-9) Processing in File Exchange Mode In the communication program, various operations in the file exchange mode described above are mainly realized by the file exchange module. The processing performed in the file exchange mode will be described below with reference to the flowchart. The process in the file exchange mode is performed according to an event that occurs when the user operates the mouse, or when data is transmitted / received to / from another user, or the state of each character. Therefore, these processes will be sequentially described below.

It should be noted that the processing described below is executed by the communication program for the sake of convenience of explanation, but in reality, various modules such as the scribble module are executed in close cooperation with each other. It will be realized.

First, the processing for determining whether or not the file arrangement button S221 displayed in the file exchange window 220 has been selected by the user will be described with reference to FIG.

When the processing in this case is started, in step S300 shown in FIG. 34, the communication program first determines whether or not the file arrangement button S221 has been selected by the user. As a result of this determination, if selected, the process proceeds to step S301, and if not selected, the file arrangement button S
The selection determination process of 221 is ended and another process is performed.

At step S301, the communication program causes the user to select a file to be transmitted to another user. At this time, the above-mentioned processing for displaying the file selection window is performed. Then, when the user selects the file to be transmitted, the process proceeds to step S302.

[0285] In step S302, the communication program generates an animation command for giving an animation process having a "green ball" to the user character S225a, and stores the animation command in a predetermined memory area (transmission queue).

Here, the animation command used in the file exchange mode has a data structure as shown in FIG. 23, like the animation command used in the scribble mode. If the value of the "action" of the animation command is "1", the items to be set as "state" are the normal state that you do not have, the state that you have a "green ball", The state of having a "yellow ball" can be mentioned. When the value of the "action" of the animation command is "3", the items to be set as "state" are the state of placing a "green ball", the state of having a "green ball", and the "yellow The state of placing a "ball", the state of having a "yellow ball", the state of placing (arranging) the "standing card", the state of discarding the "standing card", etc. can be mentioned.

Next, in step S303, the communication program creates file exchange information and stores it in a predetermined memory area (transmission queue). Here, the file exchange information is, for example, as shown in FIG. 35, a data group including a “data type”, a “target position”, and a “data part”.

In this file exchange information, the "data type" is the information held in the "data section", which is the file information regarding the file to be transmitted or received, or the comment information including the text displayed in the standing image S240. A value (in this example, a value of "1" and a value of "2", respectively) for identifying whether or not there is set. The "target position" is set with coordinates indicating the arrangement position of the "green ball" icon, the "yellow ball" icon, or the standing image. In the "data part", when the value of the "data type" is "1", information about the file to be transmitted / received is stored. The information about the file includes, for example, an owner ID indicating the owner of the file, a file path name indicating the location (path) where the file is held, the file name of the file, and the size of the file. Further, the “data part” stores a character string (text) displayed in the standing bill image S240 when the value of “data type” is “2”.

If the file exchange information accumulated in step S303 is accumulated in a predetermined amount set in advance, or if a preset predetermined time has elapsed since the first accumulation, the session is stored in step S304. Sent to all established users. After the processing in step S304, the selection determination processing of the file arrangement button S221 is ended and other processing is performed.

Next, a series of processing performed when the user character S225a is in the normal state where the user character S225a does not have anything will be described with reference to FIG.

When this process is started, the communication program determines in step S310 shown in FIG. 36 whether or not the left mouse button has been clicked by the user. As a result, if the left button has been clicked, the process proceeds to step S311. If the left button has not been clicked, a series of processes is terminated and another process is performed.

In step S311, the communication program determines whether or not a "green ball" is placed at the display position of the mouse cursor when the click operation is performed. As a result, if the "green ball" is placed, the process proceeds to step S312,
If not, the process proceeds to step S315.

At step S312, the communication program generates an animation command for giving the user character S225a an animation display having a "green ball" symbolizing a file existing on the user side, and generates this animation command in a predetermined memory area. Accumulate in.

Next, in step S313, the communication program generates file exchange information and stores it in a predetermined memory area. The session is established in step S314 when the file exchange information accumulated in step S313 is accumulated in a predetermined amount set in advance or when a preset time has elapsed since the file exchange information was first accumulated. Sent to all users. After the processing in step S304, the process proceeds to step S315.

[0295] In step S315, the communication program determines whether or not a "yellow ball" is placed at the display position of the mouse cursor when the click operation is performed. As a result, if “yellow balls” are arranged, the process proceeds to step S316,
If not, the series of processes is terminated and another process is performed.

[0296] In step S316, the communication program generates an animation command for giving the user character S225a an animation display having a "yellow ball" symbolizing a file existing on the other user's side, and stores this in a predetermined memory. Accumulate in the area.

Next, in step S317, the communication program generates file exchange information and stores it in a predetermined memory area. The session is established in step S318 when the file exchange information accumulated in step S317 is accumulated in a predetermined amount set in advance, or when a predetermined period of time elapses after the first accumulation. Sent to all users. After the processing in step S318, the series of processing is terminated and other processing is performed.

Next, a series of processing performed when the user character S225a is in a state of holding a "green ball" will be described with reference to FIG.

When this process is started, the communication program determines in step S320 shown in FIG. 37 whether or not the left button of the mouse has been clicked by the user. As a result, if the left button has been clicked, the process proceeds to step S321. If the left button has not been clicked, the process proceeds to step S324.

[0300] In step S321, the communication program generates an animation command for giving an animation display for placing the "green ball" in the work area S223 to the user character S225a, and stores this in a predetermined memory area.

Next, in step S322, the communication program generates file exchange information and stores it in a predetermined memory area. The session is established in step S323 when the file exchange information accumulated in step S322 is accumulated in a predetermined amount set in advance, or when a predetermined time set in advance has elapsed since the first exchange. Sent to all users. After the processing in step S323, the process proceeds to step S324.

In step S324, the communication program determines whether or not the user has clicked the right button of the mouse. As a result, if the right button is clicked, the process proceeds to step S325, and if the right button is not clicked, the series of processes is ended and another process is performed.

In step S325, the communication program keeps the work area S22 with respect to the user character S225a while holding the "green ball".
An animation command for giving an animation display for moving the inside of 3 to the outside of the screen is generated and stored in a predetermined memory area. After the processing in step S325 is completed, the series of processing is terminated and other processing is performed.

Next, a series of processing performed when the user character S225a is in a state of holding a "yellow ball" will be described with reference to FIG.

When this process is started, the communication program determines in step S330 shown in FIG. 38 whether or not the left button of the mouse has been clicked by the user. As a result, if the left button has been clicked, the process proceeds to step S331; if the left button has not been clicked, the process proceeds to step S334.

[0306] In step S331, the communication program causes the user to select the storage location of the file acquired from the other user. At this time, the communication program performs processing such as displaying the storage location selection window described above. Then, when the storage location is selected by the user, the process proceeds to step S33.
Proceed to 2.

[0307] In step S332, the communication program displays an animation showing that a "yellow ball" is carried to the user character S225a (Fig. 32).
An animation command that gives a reference) is generated, and this is stored in a predetermined memory area.

Next, in step S333, the communication program sends a file transfer request for requesting the start of the file transfer process to the user side who owns the file (acquisition target file) corresponding to the "yellow ball". To do. As a result, the transfer of the acquisition target file is started from the partner user side. After the process in step S333, the process is performed in step S33.
Go to 4.

[0309] In step S334, the communication program determines whether or not the right mouse button has been clicked by the user. As a result, if the right button is clicked, the process proceeds to step S335, and if the right button is not clicked, the series of processes is ended and another process is performed.

[0310] In step S335, the communication program generates an animation command which gives the user character S225a an animation process for placing a "yellow ball" in the work area S223, and stores the animation command in a predetermined memory area. This allows
Acquiring the file from the other user is canceled. After the processing in step S335, the series of processing is terminated and other processing is performed.

Next, regarding a series of processing performed in the state where the user character S225a holds the standing bill,
This will be described with reference to FIG.

When this process is started, in step S340 shown in FIG. 39, the communication program generates an animation command for giving an animation display for placing a standing bill (arranged in the work area S223), and sets this animation command in a predetermined manner. Store in memory area.

Next, in step S341, the communication program generates file exchange information regarding the standing image S240 arranged by the processing in step S340, and stores it in a predetermined memory area. The session is established in step S344 when the file exchange information accumulated in step S342 is accumulated in a predetermined amount set in advance, or when a predetermined period of time elapses after the first accumulation. Sent to all users. After the processing in step S343, the processing is performed in step S344.
Proceed to.

In step S344, the communication program determines whether or not the user has clicked the right button of the mouse. As a result, if the right button is clicked, the process proceeds to step S345, and if the right button is not clicked, the series of processes is ended and other processes are performed.

In step S345, the communication program generates an animation command for giving an animation display for discarding the standing bill to the user character S225a, and stores the animation command in a predetermined memory area. After the processing in step S345 is completed, the series of processing is terminated and other processing is performed.

Next, regarding a series of processing performed when the file transfer processing is canceled by, for example, the user selecting the cancel button S235 shown in FIG. 32 while acquiring the file from the other user, Figure 4
A description will be given with reference to 0.

When this process is started, the communication program determines whether or not the cancellation of the file transfer process is requested by the user selecting the cancel button S235 in step S350 shown in FIG. . As a result, if the cancellation is requested, the process proceeds to step S351, and if not, the series of processes is terminated and another process is performed.

In step S351, the communication program sends a file transfer cancellation notice requesting cancellation of the file transfer process to the other user side who is acquiring the file. As a result, the file transfer from the partner user is stopped. After the processing in step S351, the series of processing is terminated and other processing is performed.

Next, a predetermined time interval (for example, 100 m
Timer event processing performed every (sec) will be described. The timer event process is a process started at a predetermined time interval (for example, every 100 msec) set in advance. When this timer event process is started, in step S360 shown in FIG. 41, the communication program starts from step S361 to step S3.
The process up to 64 is started sequentially for all the users for whom the session has been established.

In step S361, the communication program sets a new face image as this face image when the face image corresponding to the predetermined user has been changed. Next, in step S362, by referring to the animation command of the character corresponding to the user, the animation of the character is advanced by one frame and displayed. Next, step S363.
In, it is determined whether the animation display of the character is completed, and if it is completed, the process proceeds to step S364. If not completed, the process proceeds to step S365.

In step S364, the contents included in the file exchange information are reflected in the actual data by referring to the file exchange information acquired from the user who has completed the animation process. After the processing in step S364, the process proceeds to step S365.

In step S365, the communication program determines whether or not the series of processes from step S361 to step S364 has been completed for all users. If the result of this determination is that it is not completed, the processing is returned to step S361, the processing from step S361 to step S364 is repeated for the next user, and if it is completed, the timer event processing is terminated. Perform other processing.

Further, the communication program is
When the data including the file exchange information is acquired from another user, each of the plurality of file exchange information included in this data is taken out and the analysis process is performed on each file exchange information. Then, an animation command corresponding to the opponent user character S225b corresponding to the transmission source user is generated corresponding to each file exchange information, and this is stored in a predetermined memory area.

Here, the animation command accumulated in the predetermined memory area by performing the above-mentioned respective processes is executed and processed by the same process as the animation executing process described above with reference to FIG. Each of the plurality of characters displayed in the area S223 is displayed as an animation.

The animation commands stored in the predetermined memory area (transmission queue) by the various processes as described above are stored in the transmission queue in a predetermined amount in the same manner as the processing in the handwriting mode described above. In the case, or when a predetermined time has passed after being accumulated, the session is transmitted to all the established users.

When the process in step S333 shown in FIG. 38 is performed and the process of acquiring the file existing on the partner user side is started, the process is performed between the user side and the partner user side (client side). The process of transferring the file is started, and this file transfer process is performed as shown in FIG.
It is performed as shown in. In addition, in FIG. 42,
A user who has a file to be transferred is shown as a file sender, and a user who gets a file from this file sender is shown as a file acquirer.

As shown in FIG. 42, for example, when the processing in step S333 shown in FIG. 38 is performed and a file transfer request is sent from the file acquirer side to the file owner side, communication on the file owner side occurs. The program reads the file existing on the file owner side and sends it to the file acquirer side. At this time, the communication program subdivides the data including the file to be transferred into a data group of a predetermined size and transmits the data group by data group. In FIG. 42, this data group is shown as a file information notification.

The communication program on the file acquirer side sends a file transfer response requesting that the file sender side send the next file information notification each time the received file information notification (data group) is correctly received. To do. When receiving the file transfer response, the communication program on the file sender side transmits the next file information notification.

The communication program on the file acquirer side and the communication program on the file sender side repeat the transmission / reception processing of the file information notification and the file transfer response as described above until all the files to be transferred are transferred. When all the files to be transferred have been transferred, the communication program on the file acquirer side finally sends a file transfer response to the file sender to notify that the files to be transferred have been correctly transferred. Also, the transfer target file included in the acquired file information notification is reconstructed and taken out, and is stored as a file in the storage location designated by the user.

If a file transfer stop notification is sent to the file sender side by the process in step S351 shown in FIG. 40 during the file transfer process, the communication program on the file sender side executes the file transfer. Stop processing.

The file transfer processing is performed as described above.

(8) Other Embodiments In the above description, the embodiment of the present invention has been described by focusing on the communication program executed on each information processing apparatus constituting the communication system 1. The present invention provides a communication system realized by executing such a communication program, a communication method realized by performing a procedure corresponding to the process executed by the communication program, or It goes without saying that the procedure corresponding to the processing executed by the communication program can be widely applied to the information processing apparatus realized by another software or hardware method.

[0333] Further, a software program for realizing the above-mentioned communication program or a function equivalent to the function realized by this communication program in various electronic devices is stored in various recording media and provided. Good.

[0334]

According to the present invention, the work performed by each user is displayed in the work area as an animation of the character having an image associated with each user in the dialogue area for each character. This allows the user to easily determine which user performed the work performed in the work area. In addition, in the present invention, while the data related to the work performed by each user is temporarily stored in the transmission queue and then transmitted to the partner user side, the contents of the work performed by the partner user included in the data transmitted from the partner user are displayed. Accordingly, the character corresponding to the other user is displayed as an animation. Therefore, even if there is a delay in the transmission of data, it is possible to perform a natural cooperative work by displaying the animation of the character.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing an overall basic configuration of a communication system shown as an embodiment of the present invention.

FIG. 2 is a functional block diagram showing a configuration of a computer device used in the communication system.

FIG. 3 is a schematic diagram showing a module structure of a communication program executed and executed on the computer device.

FIG. 4 is a schematic diagram illustrating a case where an application module forming the communication program is started by transmitting and receiving data by the communication program.

FIG. 5 is a schematic diagram showing a data structure of connection setting information used in the communication program.

FIG. 6 is a flowchart showing an overall processing flow due to execution of the communication program.

FIG. 7 is a schematic diagram showing a data structure of a functional module list used in the communication program.

FIG. 8 is a flowchart showing an overall flow of processing when the communication program is executed.

FIG. 9 is a flowchart showing a flow of processing by a server module activated in the communication program.

FIG. 10 is a flowchart showing a flow of processing by a server module activated in the communication program.

FIG. 11 is a schematic diagram showing a data structure of a user list used in a server module activated in the communication program.

FIG. 12 is a schematic diagram showing an example of a user information setting window displayed on the screen of the computer when the communication program is executed.

FIG. 13 is a schematic diagram showing an example of a basic display window displayed on the screen of the computer when the communication program is executed.

FIG. 14 is a schematic diagram showing an example of a reduced display window displayed on the screen of the computer when the communication program is executed.

FIG. 15 is a schematic diagram showing an example of an electronic mail window displayed on the screen of the computer when the communication program is executed.

FIG. 16 is a schematic diagram showing an example of a state in which a client is connected to the communication program and an image corresponding to the client is displayed in the basic display window.

[FIG. 17] In the communication program,
It is a schematic diagram which shows an example of a basic display window in the case of transmitting character data (text) from the user side.

[FIG. 18] In the communication program,
Character data (text) sent from the client side
FIG. 9 is a schematic diagram showing an example of a basic display window when is displayed.

FIG. 19 is a schematic diagram showing an example of a tool display window displayed on the screen of the computer when the communication program is executed.

FIG. 20 is a schematic diagram showing an example of a scribble window displayed on the screen of the computer when the communication program operates in the scribble mode.

FIG. 21 is a flowchart showing mouse event processing performed when the communication program operates in a scribble mode.

FIG. 22 is a schematic diagram showing a data structure of drawing data used when the communication program operates in a scribble mode.

FIG. 23 is a schematic diagram showing a data structure of an animation command used when the communication program operates in a scribble mode.

FIG. 24 is a flowchart showing timer event processing performed when the communication program operates in a scribble mode.

FIG. 25 is a flowchart showing a data reception event process performed when the communication program operates in a scribble mode.

FIG. 26 is a flowchart showing an animation execution process performed when the communication program operates in a scribble mode.

FIG. 27 is a schematic diagram showing an example of a file exchange window displayed on the screen of the computer when the communication program operates in the file exchange mode.

FIG. 28 is a schematic diagram showing an example of a file exchange window under a state in which a file to be transmitted to another user is selected when the communication program operates in a file exchange mode.

FIG. 29 is a schematic diagram showing an example of a file exchange window under a state where a “green ball” icon is arranged in the work area when the communication program operates in the file exchange mode.

FIG. 30 is a schematic diagram showing an example of a file exchange window under a state where the “yellow ball” icon arranged in the work area is selected when the communication program operates in the file exchange mode. .

FIG. 31 is a schematic diagram showing an example of a file exchange window under a state where a user character has a “yellow ball” when the communication program operates in a file exchange mode.

FIG. 32 is a schematic diagram showing an example of a file exchange window under a state where a file is being acquired from a partner user when the communication program operates in a file exchange mode.

FIG. 33 is a schematic diagram showing an example of a file exchange window under a state in which a standing image is placed in a work area when the communication program operates in a file exchange mode.

FIG. 34 is a flowchart showing a process of determining whether or not a user has selected a file arrangement button when the communication program operates in a file exchange mode.

FIG. 35 is a schematic diagram showing a data structure of file exchange information used when the communication program operates in a file exchange mode.

FIG. 36 is a flowchart showing a process performed when the user character is in a normal state when the communication program operates in the file exchange mode.

FIG. 37 is a flowchart showing a process performed when the communication program operates in a file exchange mode and a user character is in a state of having a “green ball”.

FIG. 38 is a flowchart showing a process performed when the communication program operates in a file exchange mode and a user character is in a state of having a “yellow ball”.

FIG. 39 is a flowchart showing processing performed when the communication program operates in the file exchange mode and the user character is in a state of holding a “standing card”.

FIG. 40 is a flowchart showing a process performed when the file transfer process is canceled when the communication program operates in the file exchange mode.

FIG. 41 is a flowchart showing timer event processing performed when the communication program operates in the file exchange mode.

FIG. 42 is a flowchart showing a file transfer process performed when the communication program operates in the file exchange mode.

[Explanation of symbols]

1 communication system, 10 computer equipment, 11 internet, 20 CPU, 21 R
AM, 50 interface module, 51 core module, 52 basic module, 53 application module, 54 GUI module, 110
Basic display window, S110 user face image frame, S111 client face image frame, S112
Function selection button, S113 operation icon, S114
Status display area, S115 text input area, S
116 text display area, 120 reduced display window, 150 tool display window, S150 function selection button, 160 graffiti window, S160 graffiti area, S166 work area, S169 character, 220 file exchange window, S220 file exchange area, S221 file arrangement button, S22
3 work area, S225 character, S228 "green ball" icon, S230 "yellow ball" icon

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Akira Tsuchiya             6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo Soni             -Inside the corporation (72) Inventor Junichiro Sakata             6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo Soni             -Inside the corporation (72) Inventor Mitsuo Okumura             6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo Soni             -Inside the corporation F-term (reference) 5E501 AA02 AC25 AC37 BA03 BA05                       CA02 CA08 CB02 CB09 CB14                       EA06 FA02 FA13 FA15 FA32                       FA47

Claims (4)

[Claims] 1. Image data, audio data, among a plurality of information processing devices connected to a computer network,
In a communication system for mutually transmitting intentions and emotions between users of each information processing device by transmitting and receiving arbitrary data among character data and control data, the information processing device is storage means for storing various information. A display unit for displaying various information, a transmission / reception unit for transmitting / receiving various data to / from other information processing apparatus, a control unit for controlling the operation of each unit, and an input unit for inputting an operation by a user. The display means displays a dialogue area in which images corresponding to the respective users are arranged in a list, and character data transmitted and received among the users is displayed in a position corresponding to the image in the list, In accordance with the operation by the user, the character having the above image is displayed corresponding to each user, and the work desired by each user is performed. The work area is displayed, and the control means displays an animation of the character of the user according to the content of the work performed by the user in the work area, and stores the data generated by the work to be transmitted to the other user. The transmission / reception means stores in the transmission queue set in the means, and the transmission / reception means transmits the The data stored in the queue is transmitted to the other user, and the control means further causes the other user's character to be displayed as an animation in accordance with the content of the work performed by the other user included in the data transmitted from the other user. A characteristic communication system. 2. Image data, audio data, among a plurality of information processing devices connected to a computer network,
In a communication method in which users of each information processing device mutually communicate their intentions and emotions by transmitting and receiving arbitrary data among character data and control data, images corresponding to each user are arranged in a list. A character having the image corresponding to each user in response to an operation by the user while displaying an interactive area displayed at a position corresponding to the image in which character data transmitted and received between users is arranged in a list. Is displayed, and a display step for displaying a work area in which each user performs a desired work, and an animation display of the character of the user according to the work content performed by the user in the work area The work step of accumulating the data to be sent to the other user in the send queue, and the above send key. If a predetermined amount of data is accumulated in the transmission queue, or if a predetermined time has elapsed after the data was accumulated in the transmission queue, a data transmission step of transmitting the data accumulated in the transmission queue to the other user, and And a partner character display step of displaying an animation of the character of the partner user according to the work content of the partner user included in the data transmitted from the user. 3. Image data, audio data, among a plurality of information processing devices connected to a computer network,
In a communication program for mutual communication of intentions and emotions between users of each information processing device by transmitting and receiving arbitrary data of character data and control data, each information processing device corresponds to each user. The displayed images are arranged in a list, and the character data transmitted and received among the users is displayed in a dialogue area at a position corresponding to the image in which the list is arranged. Correspondingly, a character having the above image is displayed, and a display process for displaying a work area in which each user performs a desired work, and an animation display of the user's character in accordance with the work content performed by the user in the work area In addition, the data to be sent to the other user caused by the work is stored in the send queue. Work process, and when a predetermined amount of data is accumulated in the transmission queue, or when a predetermined time has elapsed after the data was accumulated in the transmission queue, the data accumulated in the transmission queue is transmitted to the other user. A communication program for executing a data transmission process and a partner character display process for displaying an animation of a character of the partner user according to the work content of the partner user included in the data transmitted from the partner user. 4. Image data, audio data, character data,
In the information processing device, which transmits and receives arbitrary data among the control data and other information processing devices via the computer network to mutually communicate intentions and emotions between users of the information processing devices. Storage means for storing information, display means for displaying various information, transmission / reception means for transmitting / receiving various data to / from other information processing devices, control means for controlling operation of each part, and operation by user input The display means displays a list of images corresponding to each user, and the character data transmitted and received between the users is displayed at a position corresponding to the list. In addition to displaying the area, the character having the image corresponding to each user is displayed in accordance with the operation by the user, and each user desires. The work area for performing work is displayed, and the control means displays an animation of the character of the user according to the content of the work performed by the user in the work area, and data to be transmitted to the other user caused by the work. Is stored in the transmission queue set in the storage means, and the transmission / reception means stores the predetermined amount of data in the transmission queue, or when a predetermined time has elapsed after the data was stored in the transmission queue. , The data accumulated in the transmission queue is transmitted to the other user, and the control means further displays an animation of the other user's character according to the content of the work performed by the other user included in the data transmitted from the other user. An information processing device characterized by: