WO2016194856A1

WO2016194856A1 - Communication system, communication program, and communication processing method

Info

Publication number: WO2016194856A1
Application number: PCT/JP2016/065841
Authority: WO
Inventors: 浩一杉山
Original assignee: 株式会社ＨｉｇｈＬａｂ
Priority date: 2015-05-29
Filing date: 2016-05-28
Publication date: 2016-12-08
Also published as: JP6302869B2; JP2016224681A

Abstract

A communication system is equipped with multiple user terminals 50, a main server 10 that transmits and receives, in real time, drawing information with respect to two or more of the user terminals, and a call server 30 that transmits and receives, in real time, speech information with respect to two or more of the user terminals. The user terminals 50 are equipped with: a drawing functional unit 69 that shares with a communication partner in real time drawing information drawn by means of an operation input unit 53; a call functional unit 73 that shares with a communication partner in real time speech information input to a speech input unit 55; and a control unit 51 that performs parallel processing such that the real-time processing of the drawing functional unit 69 and the real-time processing of the call functional unit 73 are operating in parallel simultaneously, as perceived by a user. Thus is provided a system that enables smooth communication with rapid responsiveness through a wider variety of means.

Description

Communication system, communication program, and communication processing method

The present invention relates to a communication system, a communication program, and a communication processing method in which, for example, users communicate with each other using a user terminal.

Conventionally, a mobile phone is a terminal carried by a user. In recent years, a terminal carried by a user has shifted to a smartphone provided with various functions such as an Internet function and a payment function in addition to a telephone function. With this smartphone, in addition to communication by telephone, communication by e-mail is also possible, so the range of communication is expanding.

And there is also an application that can confirm the sent message and the received message along the timeline, and receive it immediately when the message is sent. In such an application, a message is often sent in a short text as compared to an email in which a relatively long text is used. And it is used to reply as soon as a small message arrives. For this reason, the response timing of communication is much earlier than before, and a quick response has been desired.

A message transmission / reception support system for exchanging messages using a chat server has been proposed as a technology related to communication using such a smartphone (see Patent Document 1). This message transmission / reception support system is intended to enable smooth communication using a variety of contents. And it is supposed that a content can be efficiently expanded | deployed to a message by providing the share part which identifies the resource information of the content instruct | indicated sharing, and the conversation view containing the said resource information.

However, since this message transmission / reception support system only transmits / receives content, it is not useful for real-time communication.

JP 2014-219767 A

In view of the above problems, an object of the present invention is to provide a communication system, a communication program, and a communication processing method capable of communicating smoothly through a wide range of means with a quick response, and to improve user satisfaction. .

The present invention includes a user terminal operated by a user having an input means for receiving an operation input of a user, a display means for displaying information, and a communication means for communicating information, and a plurality of the user terminals And a server that allows communication between the user terminals, and the server communicates with a real-time drawing management function unit that performs real-time transmission / reception of drawing information to two or more user terminals that communicate with each other. A real-time call management function unit that performs real-time transmission / reception of voice information to and from the two or more user terminals, and the user terminal displays drawing information drawn by the input unit between its own display unit and a communication partner user terminal. Display on the display means, The interactive real-time drawing function unit that displays the drawing information drawn by the input means of the terminal on its own display means and the voice information input to its own voice input means are output to the voice output means of the user terminal of the communication partner A bidirectional real-time voice call function unit for outputting voice information input to a voice input unit of a user terminal of a communication partner to a voice output unit of the user, the bidirectional real-time drawing function unit, and the bidirectional real-time voice call function unit The communication system, the communication program, and the communication processing method are provided with a control unit that performs parallel processing so that it can be felt that the user feels operating simultaneously in parallel.

According to the present invention, it is possible to provide a communication system, a communication program, and a communication processing method capable of communicating smoothly through a wide range of means with a quick response.

The block diagram which shows the system configuration | structure of a communication system. The functional block diagram of each server and user terminal by each program. Explanatory drawing explaining the screen structure of a user terminal. Explanatory drawing explaining the screen structure of a user terminal. Explanatory drawing explaining the screen structure of a user terminal.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a system configuration of the communication system 1.
The communication system 1 includes an application distribution server 5, a main server 10, a call server 30, and a user terminal 50 that are communicably connected to the Internet 3.

The main server 10 includes a control unit 11, a communication unit 12, an operation input unit 13, a display unit 14, and a storage unit 15.
The call server 30 includes a control unit 31, a communication unit 32, an operation input unit 33, a display unit 34, and a storage unit 35.
The user terminal 50 includes a control unit 51, a communication unit 52, an operation input unit 53, a display unit 54, a voice input unit 55, a voice output unit 56, a storage unit 57, and a photographing unit 58.

The main server 10 and the call server 30 are configured by server computers, and the user terminal 50 is configured by a mobile terminal such as a smartphone. These are all composed of a CPU, ROM, RAM, etc. as hardware elements, and are composed of a control unit (11, 31, 51) for executing various calculations and control operations, a LAN board, a WIFI unit, etc., wired or wireless. A communication unit (12, 32, 52) for performing communication at the touch panel, a touch panel, a keyboard, a mouse, a push button, and an operation input unit (13, 33, 53) configured to receive an input by a touch operation. A display unit (14, 34, 54) configured with a display, an organic EL display, or the like and displaying images such as characters and figures, and a storage unit (15) configured with a hard disk, a flash memory, etc. and allowing read / write of information , 35, 57).

In addition, the user terminal 50 further includes a voice input unit 55 that receives voice input by collecting voice by a microphone, a voice output unit 56 that emits sound from a speaker and outputs voice, and a digital camera that captures still images and moving images. Is provided.

The storage unit 15 of the main server 10 stores a management program 15a for managing the whole, a drawing management program 15b for managing drawing processing, a user terminal 50, and user-related data 15c related to the user. The user related data 15c includes, as appropriate, identification information (such as a MAC address) of the user terminal 50, user identification information that identifies the user (such as an ID or a telephone number), and communication partner information regarding the user's communication partner (friend). The information is memorized. The drawing management program 15b is not limited to being installed on the same main server 10 as the management program 15a, and may be installed on this drawing server by providing a separate drawing server.

The storage unit 35 of the call server 30 includes a call partner management program 35a for managing addresses by issuing addresses and the like, and an IP-PBX (Internet Protocol Private Branch eXchange) for exchanging lines of IP telephone terminals in the IP network. ) And the like, and call management information 35c that is configured by the identification information of the user terminal 50 and the like to realize a call.

The storage unit 57 of the user terminal 50 stores a communication application 57a which is a communication application, and communication partner data 57b such as identification information of the communication partner.

FIG. 2 shows the programs (15a, 15b, 35a, 35b, 57a) of the

control units

11, 31, 51 of the main server 10, the call server 30, and the user terminal 50 using the hardware described with reference to FIG. It is a functional block diagram showing the function performed by this.

3 to 5 are explanatory diagrams for explaining the configuration of each screen displayed on the display unit 54 of the user terminal 5. FIG. Each screen functions as an input element that receives an operation input when an input operation is performed on a transparent touch panel that is provided on the display unit 54 while being transmitted to the user by display.

The connection partner selection unit 65 displays the connection partner selection screen 110 shown in FIG. 3A and allows the user to select one of the connection partners 116a displayed as a list on the list display unit 116. The connection partner 116a may be a specific individual or a group created by a plurality of persons.

At the bottom of the connection partner selection screen 110, a contact button 117 that displays a screen for displaying a list of connection partners on the list display unit 116, a list of connection partners that have sent and received messages and a list of new connection partners are displayed. A message button 118 that enables transmission of a new message, a friend addition button 119 for adding a connection partner (friend), and other buttons 121 for shifting to a screen that enables downloading of icon images, games, and the like are provided.

In the upper part of the connection partner selection screen 110 in a state where the contact button 117 is selected, an edit button 111 for deleting the connection partner 116a in the list display unit 116 and all connection partners registered in the user terminal 50 are displayed. Connection partner selection tab 112 for displaying a connection partner selection screen 110 (screen shown in the figure) that can be selected by displaying a list, Favorites tab 113 for displaying a list of favorite connection partners, and registering in the phone book in the normal telephone function A contact tab 114 for displaying a list of contacts that are displayed and a group creation button 115 for creating a group in which a plurality of connection partners are grouped are arranged side by side.
With these elements, the connection partner selection unit 65 (see FIG. 2) accepts the selection of the connection partner by the user, and passes the connection partner to the message function unit 66 that communicates with the selected connection partner using a message.

The message function unit 66 displays the message display screen 130 of FIG. 3B, and transmits the input message to the connection partner and the timeline display of the transmitted message 135 transmitted and the received message 136 received from the connection partner. Display on the unit 134. In the timeline display unit 134, one of the left and right is the other party and the other is the other party, and the transmission and reception are displayed at a glance.

In the upper part of the message display screen 130, a return button 131 for transitioning to the connection partner selection screen 110, a connection partner display unit 132 for displaying the name (or nickname) of the connection partner, settings relating to the displayed message with the connection partner, etc. A setting button 133 for displaying a pop-up screen 140 (see FIG. 3C) is provided.

In this pop-up screen 140, as shown in FIG. 3C, an invitation button 141 for inviting other users to the timeline, a block button 142 for blocking a connection partner of the timeline, and a background of the timeline display unit 134 A background setting button 143 for changing (image, color, photo, etc.) is provided.

When the invite button 141 is selected, the connection partner adding unit 61 (see FIG. 2) functions to display the same screen as the above-described list display unit 116, accept the selection of the connection partner to be added, and select the selected connection. A connection with the other party is established and the subsequent input message is transmitted to the added connection partner, and a message received from the added connection partner is displayed on the timeline display unit 134.

At the bottom of the message display screen 130, a communication method selection unit 137 for selecting a communication method, an input content switching unit 138 for switching the input content to text or illustration and receiving the input, and transmitting the input content to the connection partner A send button 139 is provided.

When the communication method selection unit 137 is selected, the communication method list 150 is displayed in the lower half of the message display screen 130 as shown in FIG. This communication method list 150 includes a photo transmission button 151 for selecting and transmitting a photographed photo, a video transmission button 152 for selecting and transmitting a recorded video, and a camera button for transmitting a photo or video. 153, a drawing button 154 for sending a freehand drawing picture, a drawing talk button 155 for drawing a freehand interactively in real time with a connection partner, a contact for sending contact information A destination transmission button 156, a standard text transmission button 157 for selecting and transmitting a pre-registered standard text, and a card button 158 for selecting and transmitting a pre-registered greeting card are provided.

The message transfer unit 17 of the main server 10 (see FIG. 2) transfers the content of the transmission message 135 (see FIG. 3B) received from the user terminal 50 to the connected user terminal 50. This enables bidirectional exchange of messages that have been input.

When the drawing talk button 155 in the communication method list 150 (see FIG. 3D) is selected, the user terminal 50 (see FIG. 2) displays the drawing talk start notice 161 shown in FIG. 4A. Then, the cancel button 162 and the OK button 163 are displayed. When the OK button 163 is selected, the drawing start processing unit 67 (see FIG. 2) starts the drawing process.

At this time, the drawing start processing unit 67 activates the drawing function unit 69 to display the drawing talk screen 170 shown in FIG. 4B and at the same time starts the drawing talk with the connection partner. A start request signal is transmitted to the main server 10. At this time, the drawing talk screen 170 displays a connection waiting notification (not shown) “Waiting for the other party to connect”. The main server 10 that has received the drawing talk start request signal displays a drawing talk invitation message (not shown) by the drawing real-time processing unit 18 informing the connected party that there is a drawing talk start request. This message is preferably displayed, for example, “Invited to drawing talk. Do you want to start now? Cancel, OK”. Upon receiving this, the connection partner selects “OK” by his / her user terminal 50 and starts a drawing talk, or selects “Cancel” and replies “Wait a little” in the message. Can do. When “OK” is selected and the main server 10 receives this signal, the drawing real-time processing unit 18 sends information (packets) to the drawing function units 69 of two or more user terminals 50 that are the connection partners. Start interactive bi-directional real-time drawing processing.

The drawing function unit 69 of the user terminal 50 displays a drawing talk screen 170 (see FIG. 4B), accepts freehand drawing by the user, and the locus drawn by the user and the connection partner freehand. Is displayed on the display unit 54 (see FIG. 1) in real time. The drawing talk screen 170 includes a drawing unit 175 that occupies most of the screen and accepts and displays freehand drawing. At the top of the drawing talk screen 170 are an exit button 171 for terminating the drawing talk and returning to the message display screen 130, a connection partner display unit 172 for displaying the connection partner, a call operation button 173 for starting a voice call, A trash can button 174 for erasing the drawing contents of the drawing unit 175 on the screen and displaying a new solid canvas is provided. At the bottom of the drawing talk screen 170, a pen shape change button 176 for changing the shape (size, etc.) of the pen to be drawn, a pen color change button 177 for changing the color of the pen to be drawn, and the drawing contents are partially erased. Eraser button 178 for selecting an eraser to be drawn, and a drawing content transmitting unit (drawing content) for storing or transmitting (e-mail transmission, posting to a short text posting site, posting to SNS, etc.) to the storage unit 57 (see FIG. 1). (Storage unit) 179, a camera button 181 for taking a picture and displaying the picture on the drawing part 175 so that the picture can be drawn from above, selecting the photographed picture and displaying the picture on the drawing part 175 A photo selection button 182 that allows drawing from above is provided.

When the exit button 171 is selected, the drawing end processing unit 68 (see FIG. 2) sends a leaving signal to the main server 10 to end the drawing talk, and the message function unit 66 sends and receives a message. Return to the screen 130.

The drawing real-time processing unit 18 receives the information (packets) drawn by the drawing function unit 69 of the user terminal 50 in real time and transmits it to the connection partner in real time. Further, when drawing is performed simultaneously from both of the connection partners, a composition process for combining both of the drawing contents with the image before drawing is performed and then transmitted to the drawing function unit 69 of the connection partner. Therefore, a user who is having a drawing talk draws the drawing of the other party at the same time, even when he / she is drawing, and draws in real time as if he / she is drawing with one of the connected partners on one campus. Can be done.

The connection state confirmation unit 19 of the main server 10 (see FIG. 2) confirms the response state in which the drawing real-time processing unit 18 is bi-directionally communicating with the user terminal 50. The connection state confirmation unit 19 indicates that one of the user terminals 50 during the drawing talk has a poor radio wave condition such that the response from the other party is lost for a predetermined time or the response signal from the other party is an inappropriate signal. If it is determined that the response is not possible due to, for example, the connection is disconnected, the connection is disconnected to the other user terminal 50 (the user terminal 50 with the response) that is performing the drawing talk. To be notified.

The connection disconnection notification unit 62 receives the notification from the main server 10 and displays, for example, a message “XX has left the room” on the screen of the user terminal 50. By this notification, the real-time communication is cut off, and the user is informed that the drawing contents drawn by the drawing talk are not transmitted to the other party.

When the call operation button 173 is selected on the drawing talk screen 170 (see FIG. 4B), the call start processing unit 71 (see FIG. 2) calls the call server 30 provided separately from the main server 10. A request signal is transmitted, and the call function unit 73 shifts to a call state. At this time, a connection waiting message such as “Waiting for a response from the other party” is displayed on the screen until the connection partner permits the call and the call connection is completed.

The call server 30 uses the address assignment unit 37 to assign temporary addresses to the user terminal 50 that has requested the call and to the user terminal 50 that is the connection partner. By specifying the other party by this address, two-way communication is possible. That is, even if the telephone number of the other party is not known, the IP telephone call can be performed using the address assigned each time. In addition, the address assignment unit 37 notifies the connection partner user terminal 50 that there is a call request.

Upon receiving this notification, as shown in FIG. 4C, the user terminal 50 displays an incoming call message 191 on the drawing talk screen 170, indicating that the incoming call is being received (a call request is received and the call is in a call state). To the user) At this time, the user terminal 50 also displays an operation guidance message 192 and notifies the user that the call can be started by selecting the call operation button 173 and that the drawing talk can be used continuously during the call.

The call real-time processing unit 38 of the call server 30 transmits and receives a call signal (packet) to and from the user terminal 50 at the address assigned by the address assigning unit 37 to perform a call. The call real-time processing unit 38 has an IP-PBX (Internet Protocol Private Branch eXchange) function, and realizes call relaying.

The call function unit 73 of the user terminal 50 executes a call (telephone) with the user terminal 50 of the connection partner via the call server 30. During the call, the drawing talk screen 170 (see FIG. 4D) changes the shape and color of the call operation button 173 to notify the user that the call is in progress. At this time, since the drawing function unit 69 is also operating in parallel with the call function unit 73, the user terminal 50 can simultaneously transmit and receive both calls and drawing in real time. Therefore, as shown in FIG. 4D, it can be verbally explained while drawing on the drawing unit 175.

The radio wave state confirmation unit 39 of the call server 30 (see FIG. 2) confirms the radio wave state with the user terminal 50. That is, if the radio wave condition is good, the call is successfully established, but if the radio wave condition gets worse to some extent, a state in which the sound of the call is interrupted occurs, and if the radio wave condition gets worse, the call cannot be made. For this reason, the radio wave state of the user terminal 50 is constantly confirmed.

The call disconnecting unit 41 disconnects the call when the radio wave state confirmed by the radio wave state confirmation unit 39 becomes worse than a predetermined state. This predetermined state is not a state in which the call is completely disabled, but a radio wave state in which a previous call is somewhat difficult. In other words, even if the radio wave is not completely cut off, it is in a state where it has deteriorated to some extent (for example, the antenna display indicating the radio wave state due to the function of the smartphone is not full or zero, and is one or two of the three In such a case, packet loss or the like starts to occur, so that the voice may not reach even though the screen appears while the call is continuing. In the present embodiment, since a call is also made while having a drawing talk, it is difficult to notice that the voice has not arrived, unlike a telephone with only a normal voice call. That is, when a situation occurs in which the call voice does not arrive while the real-time processing of the drawing talk is operating normally, the user does not think that the voice has not arrived. For this reason, there may be a situation in which the other party ignores what is said here (no audio actually arrives) and continues drawing with a drawing talk. In order to avoid such a situation, when the radio wave state where the voice cannot reach due to packet loss or the like is generated, the call disconnecting unit 41 forcibly disconnects the call and temporarily gives it to the user terminal 50 Release the address.

At this time, by releasing the address, it is possible to prevent the address from being exhausted due to the unused address remaining unallocated. The call disconnecting unit 41 notifies the user terminals 50 of all the connected terminals (2 persons for a two-party call and all the groups for a group call) that the call has been disconnected.

In response to the notification from the call server 30, the call disconnection notification unit 63 of the user terminal 50 displays a message “Free call ended” on the screen of the user terminal 50 as shown in FIG. To do. This notification informs the user that the real-time call is disconnected and the conversation is not being transmitted to the other party, and the real-time drawing talk continues.

Further, the radio wave state confirmation unit 39 of the above-described call server 30 (see FIG. 2) indicates that one of the user terminals 50 that is in a call is If it is determined that the response is not possible due to badness or the like, the connection is disconnected and the connection of the call is disconnected with respect to the other user terminal 50 (the user terminal 50 with the response) that is making a call Notify that In this state, since the connection state confirmation unit 19 of the main server 10 also determines that the response is impossible and disconnects, both the drawing talk and the call are disconnected. For this reason, as shown in FIG. 5B, the user terminal 50 has a connection waiting message 196 such as “Waiting for connection of the other party” and “○○ indicating that the drawing talk and the call have ended. An all-real-time processing end message 197 is displayed, such as “Exiting the room and terminating the free call”. At this time, the shape and color of the call operation button 173 of the user terminal 50 that has been disconnected is also returned to the display indicating that no call is in progress. The example shown in the figure is an example in the case where a drawing talk and a telephone call are made in a group, and displays that one person in the group has been disconnected.

When the call operation button 173 (see FIG. 4D) is selected during a call on the user terminal 50, the call end processing unit 72 (see FIG. 2) ends the call and informs the user terminal 50 of the call partner. In addition to notifying the end of the call, the shape and color of the call operation button 173 is returned to the display indicating that no call is being made.

FIG. 5C shows a drawing talk screen 170 when the user of the connection partner is set not to allow a call on the user terminal 50. In this case, the call operation button 173 displays a message indicating that the call is not possible, such as displaying a cross (x).

With the above-described configuration and operation, it is possible to provide the communication system 1 that can perform smooth communication through a wide range of means with a quick response, and improve the user satisfaction.

Unlike the communication in which a message is entered and completed and then sent by pressing the send button in a drawing talk or a call, it is displayed in real time on the user terminal 50 on the other side along the drawing trajectory as the drawing starts. Because conversations reach the other party in real time, you can communicate very closely.

Since the call can be started after message transmission / reception or drawing talk, it is possible to shift to communication with sound after communication without sound. As a result, when a caller wants to make a call, for example, when the other party cannot speak aloud, the call request and call rejection can be performed silently, and the reason why the call cannot be made can be communicated. Thereby, the smooth communication according to the situation at the time of each other can be aimed at.

In addition, since you can add real-time communication with sound by calling from a state where you have a drawing talk and have silent real-time communication with the connection partner, even if there is a call request and you can not get out, it will be silent With Drawing Talk, you can tell that you can't talk now. In this way, the reason why the call cannot be made can be immediately communicated, so that smooth communication can be achieved.

In addition, when adding a call from a drawing talk, the user terminal 50 that has received a call request can determine whether or not the call can be made without making a sound in order to confirm whether or not to receive the call with a silent message. For this reason, for example, even if a call request arrives in a situation where you can not answer the call, such as during a conference, cancel the call request without making a sound with the operation at hand, and further silently tell you what is currently difficult with drawing talk, Alternatively, it is possible to return silently to the message display screen 130 and silently convey what is currently difficult with a message.

Also, if the radio wave condition deteriorates to some extent, the call is terminated while continuing the drawing talk, so it is possible to prevent a situation in which communication is continued without thinking that this conversation has not reached the other party.

In addition, since the address is temporarily assigned every time a call request is made and the address is released when the call is disconnected, there is no need to assign an address in advance for each user, and address depletion can be prevented. . Further, since the call is realized using a temporary address, the call can be made without knowing the other party's telephone number. So, for example, when two people are talking to a drawing talk and adding one person who knows but not the other person to the communication, invite the person who wants to add without telling the phone number. Can make a three-party call.

In addition, since the main server 10 and the call server 30 are separate servers, it is possible to avoid the concentration of the packet amount and prevent the real-time processing from being delayed.

In this way, it is possible to provide the communication system 1 with high real-time characteristics and wide communication means. In particular, the communication system 1 can simultaneously process tactile, visual, and auditory communication, and can be realized by a portable information terminal that has the palm.

In addition, since the communication system 1 can shift to a real-time drawing talk from the middle of exchanging messages for sending and receiving messages and photos that have been created, the communication system 1 can increase the response speed as a user sense for close communication. Can be migrated. In addition, since the conversation can be started at the same time as the drawing talk continues, real-time communication by drawing and real-time communication by speaking (voice) can be performed simultaneously, and the response of the other party is real-time using a wide range of means. You can get the very close communication you get.

The server according to the present invention corresponds to the main server 10 and the call server 30 of the embodiment, and similarly,
The drawing server corresponds to the main server 10,
The real-time drawing management function unit corresponds to the drawing real-time processing unit 18,
The call server corresponds to the call server 30;
The communication means corresponds to the communication unit 32,
The input means corresponds to the operation input unit 33,
The display means corresponds to the display unit 34,
The real-time call management function unit corresponds to the call real-time processing unit 38,
The control means corresponds to the control unit 51,
The wireless communication means corresponds to the communication unit 52,
The communication program corresponds to the communication application 57a,
The interactive real-time drawing function unit corresponds to the drawing function unit 69,
The call start function unit during drawing communication corresponds to the call start processing unit 71,
The interactive real-time voice call function unit corresponds to the call function unit 73.
The present invention is not limited to this embodiment, and can be various other embodiments.

The present invention can be used in industries related to systems in which a plurality of users communicate with each other using user terminals.

DESCRIPTION OF SYMBOLS 1 ... Communication system 10 ... Main server 19 ... Drawing real-time processing part 20 ... Call server 32 ... Communication part 33 ... Operation input part 34 ... Display part 37 ... Address assignment part 38 ... Call real-time processing part 39 ... Radio wave state confirmation part 41 ... Call disconnection unit 50 ... User terminal 51 ... Control unit 52 ... Communication unit 57a ... Communication app 69 ... Drawing function unit 71 ... Call start processing unit 73 ... Call function unit

Claims

A user terminal operated by the user, having an input means for receiving a user operation input, a display means for displaying information, and a communication means for communicating information;
A server that communicates with a plurality of the user terminals and allows communication between the user terminals,
The server
A real-time drawing management function unit that performs real-time transmission / reception of drawing information to two or more user terminals that communicate with each other;
A real-time call management function unit that performs real-time transmission and reception of voice information to and from two or more user terminals that communicate with each other;
The user terminal is
Both the drawing information drawn by the input means is displayed on its own display means and the display means of the communication partner user terminal, and the drawing information drawn by the input means of the communication partner user terminal is displayed on its own display means. Real-time rendering function,
Both voice information input to its own voice input means is output to the voice output means of the user terminal of the communication partner, and voice information input to the voice input means of the user terminal of the communication partner is output to its own voice output means. Real-time voice call function
A communication system comprising control means for performing parallel processing so that the interactive real-time rendering function unit and the interactive real-time voice call function unit are operated in parallel as a user feeling.
The user terminal is
The communication system according to claim 1, further comprising a drawing communication mid-call start function unit capable of starting transmission / reception of voice information by the bidirectional real-time voice call function unit in a state where the drawing information can be transmitted / received by the bidirectional real-time drawing function unit. .
The communication means of the user terminal is composed of wireless communication means for performing wireless communication using radio waves,
A radio wave state confirmation unit for confirming a state of a radio wave received by the wireless communication unit during a call by the bidirectional real-time voice call function unit to the server or the user terminal;
A call disconnecting unit for disconnecting a call by the bidirectional real-time voice call function unit when the radio wave state becomes worse than a predetermined state;
The communication system according to claim 1 or 2, wherein the real-time drawing by the bidirectional real-time drawing function unit is continuously executed even after the call is cut off by the call cutting unit.
The server
An address assignment unit that assigns a call address to a user terminal of a communication partner of the user terminal and the user terminal when receiving a call start request by the interactive real-time voice call function unit from the user terminal. The communication system according to 1, 2, or 3.
The server
A drawing server having the real-time drawing management function unit;
It is configured as separate hardware with a call server having the real-time call management function unit,
The drawing server is configured to process a packet transmitted from the bidirectional real-time drawing function unit of a plurality of the user terminals,
The call server is configured to process packets transmitted from the interactive real-time voice call function units of a plurality of user terminals.
The communication system according to any one of claims 1 to 4.
User terminal
A communication program that functions as an input unit that receives a user operation input, a display unit that displays information, and a communication unit that performs communication of information via a server,
The user terminal
Both the drawing information drawn by the input means is displayed on its own display means and the display means of the communication partner user terminal, and the drawing information drawn by the input means of the communication partner user terminal is displayed on its own display means. Real-time rendering function,
Both voice information input to its own voice input means is output to the voice output means of the user terminal of the communication partner, and voice information input to the voice input means of the user terminal of the communication partner is output to its own voice output means. Real-time voice call function
A communication program for causing the bidirectional real-time rendering function unit and the bidirectional real-time voice call function unit to function as a control unit that performs parallel processing so that it can be felt that the user is operating in parallel.
The plurality of users with respect to a plurality of user terminals operated by the user having an input means for receiving user operation input, a display means for displaying information, and a communication means for communicating information A communication processing method for allowing communication between the user terminals by a server communicating with a terminal,
Establishing a communication state in which information is transmitted and received between two or more user terminals;
Interactive real-time drawing processing for displaying drawing information drawn by the input means of a certain user terminal on the display means of another user terminal in communication with the display means of the user terminal;
Two-way real-time voice call processing for outputting voice information input to voice input means of a certain user terminal to voice output means of another user terminal in a communication state;
A communication processing method for executing the parallel real-time drawing processing and the parallel processing for allowing the user to feel that the two-way real-time voice call processing is simultaneously operated in a user sense.