JP6365732B2 - Client terminal, computer program, and information processing method - Google Patents

Description

The present invention relates to an information processing apparatus and a control program for the information processing apparatus, and more particularly to an offline notification method in the information processing apparatus.

In recent years, an online system has been proposed in which an information processing apparatus such as a PC (Personal Computer) is configured to display a screen according to screen information provided from a server by network communication via a wired LAN (Local Area Network) or a wireless LAN. Are known. Such an online system is, for example, a W
A web browser for browsing the eb page is provided, and the web browser
Screen information for displaying a Web page from the Web server is acquired by the network communication, and the Web page is displayed according to the acquired screen information.

An information processing apparatus that performs such network communication may be in an offline state in which the network connection is disconnected due to crosstalk of communication lines, a decrease in radio wave intensity, or the like, and communication with the server is not possible. Therefore, when the information processing apparatus that performs such network communication enters an offline state, the information processing apparatus cannot receive an operation that requires network communication. Therefore, an information processing apparatus that performs such network communication normally displays an offline notification screen for notifying the user that the offline state has been detected when it is detected that the offline state has been reached ( For example, Patent Document 1).

However, if an offline state frequently occurs in an information processing apparatus that performs such network communication, the information processing apparatus displays an offline notification screen each time, causing the user to feel bothered. It will end up. Therefore, an information processing apparatus that displays an offline notification screen for the first time when a user performs an operation that requires network communication has been proposed and already known for the purpose of preventing the user from feeling troublesome. Yes.

However, in the information processing apparatus that performs such network communication, as described above, the offline notification screen is not displayed until the user performs an operation that requires network communication. Until it is performed, it cannot be recognized that it is in an offline state, and it will be misunderstood that it remains in an online state.

As described above, in the conventional information processing apparatus that performs network communication, the offline state may cause the user to feel bothered or misunderstood that the online state remains in the offline state. There is a problem that the user cannot be notified at an appropriate timing.

The present invention has been made to solve such a problem, and an object of the present invention is to notify a user at an appropriate timing that an information processing apparatus that performs network communication is in an offline state.

In order to solve the above-described problem, a client terminal that communicates with a server via a network, the client terminal communicating with the server via a network, and another client terminal connected to the server, A real-time communication control unit that realizes real-time exchanges using voice and video, a first screen for selecting a partner for real-time exchange, and the selected counterpart in the real-time A display unit for displaying a second screen for sending a request for participation in the exchange and a third screen for notifying that communication via the network is not possible; The display unit displays the third screen when the network is disconnected while displaying the first screen. The second screen is displayed when the other party to be exchanged in real time is selected by the user operation performed on the first screen, and the user operation performed on the second screen. When it is determined to send the participation request to the other party, the third screen is displayed .

Further, another aspect of the present invention is installed in an information processing terminal or a portable information terminal, and causes the information processing terminal or the portable information terminal to perform communication via a network with a server. A computer program for executing real-time exchange between a terminal and another information processing terminal or other portable information terminal connected to the server using voice and moving images, the partner for performing real-time exchange A first screen display step for displaying a first screen for selection on the display unit, and when a partner to be exchanged in real time is selected by a user operation on the first screen, A second screen display step for displaying a second screen for sending a request to participate in the exchange of When it is determined that the participation request is to be sent to the other party by a user operation on the second screen, communication via the network is performed if communication via the network is not possible. A third screen displaying step for displaying a third screen for notifying that the first screen is in a state in which the first screen is not displayed. In the first screen displaying step, the first screen is displayed on the display unit. The third screen is not displayed when the network is disconnected during the operation. Another aspect of the present invention is an information processing method in a client terminal that performs real-time exchange using audio and video with other client terminals connected to the server by communicating with the server via a network. A first screen for selecting a partner to perform real-time exchange is displayed on the display unit, and when a partner to perform the real-time exchange is selected by a user operation on the first screen, When it is determined that a second screen for sending a request to participate in the real-time exchange to the other party is displayed on the display unit, and the participation request is sent to the other party by a user operation on the second screen If communication via the network is not possible, communication via the network is not possible. When the display unit displays a third screen for notifying that it is incapable of being displayed, and when the first screen is displayed on the display unit, the first screen is displayed on the display unit. If the network is disconnected while being displayed, the third screen is not displayed.

ADVANTAGE OF THE INVENTION According to this invention, in the information processing apparatus which performs network communication, it can notify a user at an appropriate timing that it was in an offline state.

It is a figure which shows the example of the operation | use form of the video conference system which concerns on embodiment of this invention. It is a block diagram which shows typically the hardware constitutions of the client terminal which concerns on embodiment of this invention. It is a block diagram which shows typically the function structure of the client terminal which concerns on embodiment of this invention. It is a figure which shows an example of the data structure of offline notification determination Tb which concerns on embodiment of this invention. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a figure which shows the example of a display of the display screen which the video conference application which concerns on embodiment of this invention displays on a display part. It is a flowchart for demonstrating a process when the client terminal which concerns on other embodiment of this invention becomes a offline state, when a network is cut | disconnected in an online state. Processing until a client terminal according to another embodiment of the present invention determines whether or not the offline notification determination unit displays an offline notification screen when the network is disconnected in an online state and becomes an offline state It is a sequence diagram for demonstrating. The processing after the client terminal according to the embodiment of the present invention determines whether or not the offline notification determination unit displays the offline notification screen when the network is disconnected in the online state and becomes the offline state. FIG. The processing after the client terminal according to the embodiment of the present invention determines whether or not the offline notification determination unit displays the offline notification screen when the network is disconnected in the online state and becomes the offline state. FIG. When the client terminal according to the embodiment of the present invention is in a standby state as an operation state in an online state and displays a standby screen as a display screen, the user is requested to participate after the network is disconnected and becomes an offline state. It is a sequence diagram for demonstrating the process when operation is performed. When the client terminal according to another embodiment of the present invention is in a standby state as an operation state in an online state and displays a standby screen as a display screen, the network is disconnected and the offline state is entered by the user. It is a figure which shows transition of the display screen of a display part when participation request | requirement operation is performed. When the client terminal according to the embodiment of the present invention is in a meeting as an operation state in the online state and the conference screen is displayed as a display screen, the display of the display unit when the network is disconnected and the offline state is displayed It is a figure which shows transition of a screen. When the client terminal according to the embodiment of the present invention is on standby as an operating state in the online state and displays the setting screen as a display screen, the display of the display unit when the network is disconnected and the offline state is entered It is a figure which shows transition of a screen. When the client terminal according to the embodiment of the present invention is in a conference as an operation state in the online state and the conference screen is displayed as the display screen, the network is disconnected and the offline state is set. It is a figure which shows the transition of the display screen of the display part at the time of having met. When the client terminal according to the embodiment of the present invention is in the participation request process as the operation state in the online state and the transition is made to the setting screen when the standby screen is displayed as the display screen, the network is disconnected and the offline state It is a figure which shows the transition of the display screen of the display part at the time of becoming. Even when the client terminal according to the embodiment of the present invention is in the offline state when it is “not displayed” as the determination element corresponding to the combination of the operation state and the display screen in the online state, a certain time has elapsed. FIG. 11 is a sequence diagram for explaining processing when an offline notification screen is displayed in the case.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment,
As an information processing device that communicates with a remote location in real time by communication via a network, users in remote locations have a video conference in real time via a network line such as a wired LAN (Local Area Network) or a wireless LAN. As an example, a client terminal connected to a video conference system management server that provides a video conference function for enabling the video conference function will be described. Therefore, the user can perform a video conference with a user in a remote place by operating the client terminal according to the present embodiment and performing network communication with the video conference system management server. Note that a video conference application (hereinafter referred to as “video conference application”), which is dedicated software for enabling the video conference, is installed in the client terminal according to the present embodiment. That is, in the present embodiment, the video conference application functions as a real-time communication control unit.

In addition, when the client terminal according to the present embodiment is disconnected from the network due to crosstalk of communication lines, a decrease in radio wave intensity, etc., and becomes in an offline state where network communication with the video conference system management server cannot be performed, An offline notification screen is displayed to notify the user that the user is offline. That is, in the present embodiment, the offline notification screen is displayed as the disconnection notification screen.

In such a client terminal, one of the gist according to the present embodiment is that when network communication is cut off in an online state and becomes an offline state, an offline notification is made according to the presence or absence of real-time communication with a remote place. Offline notification determination table (hereinafter referred to as “offline notification determination Tb”) in which criteria for determining whether to display a screen are set.
In other words, it is determined whether or not to display the offline notification screen based on the presence / absence of real-time communication with a remote place when the offline state is actually entered. Therefore,
According to the client terminal according to the present embodiment, it is possible to notify the user that the offline state has been reached at an appropriate timing. As will be described later, in the present embodiment, the presence / absence of real-time exchange with a remote place is distinguished by the operating state of the video conference application.

Further, in such a client terminal, one of the other gist according to the present embodiment is offline notification according to the combination of the presence / absence of real-time communication with a remote place and the display screen that can be displayed by the video conference application. With reference to the offline notification determination Tb in which the criterion for determining whether or not to display the screen is set, the presence / absence of real-time communication with a remote place when the actual offline state is displayed and the video conference application displays It is to determine whether or not to display the offline notification screen based on the combination with the existing display screen. Therefore, according to the client terminal according to the present embodiment, it is possible to notify the user of the offline state at a more appropriate timing. Hereinafter, it will be described in detail with reference to the drawings.

First, an operation mode of the video conference system according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of an operation mode of the video conference system according to the present embodiment. As shown in FIG. 1, in the video conference system according to the present embodiment, the network 3 to which the video conference system management server 1 is connected and the network 4 to which the client terminals 2a and 2b are connected are the Internet, telephone lines, and the like. It is configured to be connected via a public line 5. Hereinafter, only when it is not necessary to distinguish between the client terminals 2a and 2b, they are collectively referred to as the client terminal 2.

Note that the number of client terminals 2 connected to the network 4 is an example, and a large-scale system in which many of these are connected may be used. A plurality of networks to which different client terminals 2 are connected may be connected to the video conference system management server 1 via the public line 5, and the video conference system management server 1 and the client terminal 2 are the same. It may be configured to be connected on the network.

The video conference system management server 1 is a shared server for managing the video conference system according to the present embodiment. Therefore, the video conference system management server 1 manages users registered in the video conference system, performs login authentication based on authentication information such as ID and password transmitted from the client terminal 2, and the result of login authentication. The use of the video conference system is permitted depending on the situation.

The client terminal 2 is an information processing terminal operated by a user, and is a PC (Persona).
l Computer) or the like. The client terminal 2
PDAs (Personal Digital Assistants) and smartphones,
It may be realized by a portable information terminal such as a tablet terminal. As described above, the client terminal 2 according to the present embodiment is installed with the video conference application, which is dedicated software for enabling the video conference, and the client terminal 2 includes the video conference application. This function makes it possible to use the video conference system.

Further, the client terminal 2a and the client terminal 2b are installed at remote locations, and the client terminal 2a and the client terminal 2b exchange information in real time by the video conference function provided by the video conference system management server 1. Is configured to hold a video conference. Note that in the present embodiment, the real-time refers to a time lag due to communication via a network and a time lag due to processing speeds of the video conference system management server 1 and the client terminal 2.

Note that the networks 3 and 4 in FIG. 1 are, for example, office LANs (Local Ar
ea Network) and the video conference system management server 1 and the client terminal 2 are connected to the public line 5 through their respective LANs, but are connected directly to the public line 5. It is also possible.

Next, the hardware configuration of the video conference system management server 1 and the client terminal 2 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram schematically showing a hardware configuration of the client terminal 2 according to the present embodiment. In the following description, the hardware configuration of the client terminal 2 will be described as an example, but the same applies to the video conference system management server 1.

As shown in FIG. 2, the client terminal 2 according to the present embodiment includes the same configuration as that of a general server or PC. That is, the client terminal 2 according to the present embodiment has a CPU (Cent
real processing unit) 10, RAM (Random Access)
Memory) 20, ROM (Read Only Memory) 30, HDD (H
ard Disk Drive) 40 and I / F 50 are connected via a bus 80. The I / F 50 has an LCD (Liquid Crystal Display) 60.
And the operation part 70 is connected.

The CPU 10 is a calculation means and controls the operation of the entire client terminal 2. RAM20
Is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The HDD 40 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like.

The I / F 50 connects and controls the bus 80 and various hardware and networks. L
The CD 60 is a visual user interface for the user to check the state of the client terminal 2. The operation unit 70 is a user interface for the user to input information to the client terminal 2 such as a keyboard, a mouse, and a touch panel. As described in FIG. 1, the video conference system management server 1 according to this embodiment is operated as a shared server. Accordingly, with respect to the video conference system management server 1, the LCD 60 and the operation unit 7 are used.
A user interface such as 0 can be omitted.

In such a hardware configuration, a program stored in a storage medium such as the ROM 30, the HDD 40, or an optical disk (not shown) is read into the RAM 20, and the CPU 10
Performs a calculation according to a program loaded in the RAM 20 to configure a software control unit. A functional block that realizes the function of the client terminal 2 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

Next, the functional configuration of the client terminal 2 according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram schematically showing a functional configuration of the client terminal 2 according to the present embodiment. As shown in FIG. 3, the client terminal 2 according to the present embodiment includes a communication unit 201,
Offline notification determination unit 202, operation state management unit 203, display screen management unit 204, display unit 2
05. An offline notification determination Tb storage unit 206 is provided.

The communication unit 201 exchanges information with the video conference system management server 1 via the network 3, the network 4, and the public line 5. Further, the communication unit 201 detects that the network connection has been disconnected. That is, in the present embodiment, the communication unit 201 functions as a disconnection detection unit. Whether or not the offline notification determination unit 202 displays the offline notification screen with reference to the offline notification determination Tb stored in the offline notification determination Tb storage unit 206 when the network is disconnected and enters an offline state. Determine. That is,
In the present embodiment, the offline notification determination unit 202 functions as a disconnection notification determination unit. The operation state management unit 203 manages the operation state of the video conference application.

The display screen management unit 204 manages the display screen displayed on the display unit 205 by the video conference application. The display screen management unit 204 displays each display screen on the display unit 205. That is, in the present embodiment, the display screen management unit 204 functions as a display control unit. Display unit 20
Reference numeral 5 denotes an output interface that visually displays the state of the client terminal 2. The display unit 205 is realized by the LCD 60 shown in FIG. The offline notification determination Tb storage unit 206 stores the offline notification determination Tb.

Next, the offline notification determination Tb according to the present embodiment will be described with reference to FIG.
FIG. 4 is a diagram illustrating an example of a data structure of the offline notification determination Tb according to the present embodiment.
As shown in FIG. 4, in the offline notification determination Tb according to the present embodiment, whether or not an offline notification screen is displayed for each combination of the operation state of the video conference app and the display screen that can be displayed by the video conference app. It has been established. That is, in the present embodiment, the offline notification determination Tb is used as disconnection notification information.

Here, as an operation state of the video conference application according to the present embodiment, as shown in FIG. 4, “logout”, which is already logged out from the system, makes a login request to the video conference system management server 1, "Logging in process", which is waiting for the result, login to the video conference system has been completed, and the status does not belong to any other operating state.
"Waiting", requesting other users to join the meeting and waiting for the result, "Now joining" processing, "Conference" being in a video conference, Video conference There is a “logout process in progress” in which a logout request is made to the system management server 1 and the result is awaited.

In this embodiment, the client terminal 2 does not perform real-time exchange with a remote place when the video conference application is in the “logout”, “standby”, or “logout process” operation state, Since it is determined that a real-time exchange with a remote location is in progress during a “conference”, “login processing”, or “participation request processing”, the remote location is determined based on the operating status of the video conference app. It is possible to distinguish whether or not there is real-time interaction with the.

Further, in the present embodiment, for “login processing” and “participation request processing”
Although it is determined that a real-time exchange with a remote place is performed, it may be determined that a real-time exchange with a remote place is not performed, and may be determined according to specifications as appropriate. Further, in the present embodiment, the respective operation states are mutually exclusive, and the client terminal 2 according to the present embodiment is configured not to be able to take a plurality of operation states at the same time.

As the display screens displayed by the video conference application according to the present embodiment, there are a “login screen”, a “standby screen”, a “conference screen”, and a “setting screen” as shown in FIG. Details of each display screen will be described in detail with reference to FIGS.

In the present embodiment, as shown in FIG. 4, the purpose is to distinguish the presence or absence of real-time communication with a remote place based on the operation state of the video conference application. That is,
In the present embodiment, real-time communication with a remote location is performed based on whether the operation state requires real-time communication with the remote location or whether the operation status does not require real-time communication with the remote location. The purpose is to distinguish the presence or absence of exchanges.

Therefore, according to the client terminal 2 according to the present embodiment, it is possible to determine whether or not to display the offline notification screen based on the presence / absence of real-time exchange with a remote place, so that the offline state is entered. This can be notified to the user at an appropriate timing.

In this embodiment, as described with reference to FIG. 4, in addition to distinguishing the presence / absence of real-time communication with a remote place based on the operating state of the video conference app, the video conference app transmits it via the network. The presence or absence of real-time exchange with a remote place may be distinguished based on the content of the packet to be transmitted. This includes information for identifying whether or not the video conference application requires real-time communication with a remote place depending on the content of the packet that the video conference application intends to transmit via the network. Is to use that.

Next, each display screen displayed on the display unit 205 by the video conference application according to the present embodiment will be described with reference to FIGS. FIG. 5 is a diagram illustrating a display example of an offline notification screen displayed on the display unit 205 by the video conference application according to the present embodiment. FIG. 6 is a diagram illustrating a display example of a login screen displayed on the display unit 205 by the video conference application according to the present embodiment. FIG. 7 is a diagram illustrating a display example of a login screen displayed on the display unit 205 by the video conference application when the operation state of the video conference app according to the present embodiment is “login processing in progress”.
That is, FIG. 7 shows a display example of the login screen displayed on the display unit 205 by the video conference application when the user ID and password are input by the user operation on the login screen shown in FIG. 6 and the “OK” button is pressed. FIG.

FIG. 8 is a diagram illustrating a display example of a standby screen displayed on the display unit 205 by the video conference application according to the present embodiment. Note that a user who is displayed as “OFFLINE” on the standby screen indicates that he / she is not participating in the video conference according to the present embodiment, and a user who is displayed as “ONLINE” participates in the video conference according to the present embodiment. Represents that you are doing. FIG. 9 is a diagram illustrating a display example of a standby screen displayed on the display unit 205 by the video conference application when a user who displays “OFFLINE” is selected by a user operation on the standby screen illustrated in FIG. 8.

FIG. 10 is a diagram illustrating a display example of a standby screen that the video conference application displays on the display unit 205 when the operation state of the video conference application according to the present embodiment is “participation request processing”. That is, FIG. 10 is a diagram illustrating a display example of a login screen that the video conference application displays on the display unit 205 when the “OK” button is pressed on the standby screen illustrated in FIG. 9. FIG. 11 is a diagram illustrating a display example of a conference screen displayed on the display unit 205 by the video conference application according to the present embodiment. FIG. 12 is a diagram illustrating a display example of a setting screen displayed on the display unit 205 by the video conference application according to the present embodiment.

In the client terminal 2 configured as described above, one of the gist according to the present embodiment is
When the network communication is disconnected in the online state and goes offline,
With reference to the offline notification determination Tb in which the criterion for determining whether or not to display the offline notification screen according to the operation state of the video conference app is set, the operation state of the video conference app when the device actually enters the offline state is referred to. Based on this, it is determined whether to display an offline notification screen. Therefore, according to the client terminal 2 according to the present embodiment, it is possible to notify the user that the offline state has been reached at an appropriate timing.

Further, in the client terminal 2 configured as described above, one of the other gist according to the present embodiment is that offline notification is performed according to the combination of the operation state of the video conference app and the display screen that can be displayed by the video conference app. Referring to the offline notification determination Tb in which the criterion for determining whether or not to display the screen is set, the operation state of the video conference application when the screen is actually offline, the display screen displayed by the video conference application, and It is determined whether to display an offline notification screen based on the combination. Therefore, according to the client terminal 2 according to the present embodiment, it is possible to notify the user of the offline state at a more appropriate timing.

Next, processing when the client terminal 2 according to the present embodiment is in an offline state due to the network being disconnected will be described with reference to FIG.
FIG. 13 is a flowchart for explaining processing when the client terminal 2 according to the present embodiment enters an offline state because the network is disconnected in the online state.

As illustrated in FIG. 13, when the client terminal 2 according to the present embodiment is disconnected from the network in the online state to be in the offline state, the client terminal 2 first detects that the network is disconnected (S1301). When detecting that the network has been disconnected, the client terminal 2 according to the present embodiment has detected that the network has been disconnected with reference to the offline notification determination Tb stored in the offline notification determination Tb storage unit 206. Whether to display the offline notification screen is determined based on a determination element (display / not display / not display → display after screen transition) corresponding to the combination of the operation state and the display screen at the time (S1302).

When the client terminal 2 according to the present embodiment determines that the offline notification screen is not displayed in the determination process of S1302 (S1302 / not displayed), the client terminal 2 is in the offline state when the network is disconnected in the online state. The process ends.

On the other hand, when the client terminal 2 according to the present embodiment determines that the offline notification screen is to be displayed (S1302 / displayed) in the determination process of S1302, the client terminal 2 displays the offline notification screen (S1303), and in the online state Ends processing when the network is disconnected and goes offline.

In addition, when the client terminal 2 according to the present embodiment determines in S1302 that the offline notification screen is not displayed on the currently displayed display screen and the offline notification screen is displayed after the screen transition, the determination process of S1302 (S1302 / not display → display), the display screen displayed when the disconnection of the network is detected is changed to another display screen (S1304), and the offline notification screen is displayed (S1303). Then, the processing when the network is disconnected and becomes offline in the online state is terminated.

Next, processing when the client terminal 2 according to the present embodiment is in an offline state due to the network being disconnected will be described with reference to FIGS. 14 to 16. FIG. 14 shows the case where the offline notification determination unit 202 determines whether or not to display the offline notification screen when the client terminal 2 according to the present embodiment enters the offline state because the network is disconnected in the online state. It is a sequence diagram for demonstrating the process of. 15 and 16 show whether or not the offline notification determination unit 202 displays the offline notification screen when the client terminal 2 according to the present embodiment enters the offline state because the network is disconnected in the online state. It is a sequence diagram for demonstrating the process after determining.

As shown in FIG. 14, when the client terminal 2 according to the present embodiment is in an offline state because the network is disconnected, the communication unit 201 first detects that the network is disconnected. (S1401) The offline notification determination unit 202 is notified that the network has been disconnected (S1402).

When notified by the communication unit 201 that the network is disconnected, the offline notification determination unit 202 requests the operation state management unit 203 to notify the operation state (S1403).
At the same time, it requests the display screen management unit 204 to notify the display screen (S1404). When the operation state management unit 203 receives a request to notify the operation state from the offline notification determination unit 202, the operation state management unit 203 notifies the offline notification determination unit 202 of the operation state (S1405). Also,
When receiving a request to notify the display screen from the offline notification determination unit 202, the display screen management unit 204 notifies the offline notification determination unit 202 of the display screen (S1406).

When the offline notification determination unit 202 acquires the operation state and the display screen notified from the operation state management unit 203 and the display screen management unit 204 (S1407), the offline notification determination Tb.
With reference to the offline notification determination Tb stored in the storage unit 206, based on the determination element (display / not display / not display → display after screen transition) corresponding to the acquired operation state and display screen combination, It is determined whether to display the offline notification screen (S1).
408).

When the offline notification determination unit 202 determines that the offline notification screen is not displayed in the determination processing of S1408, the client terminal 2 according to the present embodiment is in an offline state because the network is disconnected in the online state. Terminate the process.

On the other hand, if it is determined in step S1408 that the offline notification screen is to be displayed, the offline notification determination unit 202 requests the display screen management unit 204 to display the offline notification screen as shown in FIG. (S1501). The display screen management unit 204
Upon receiving a request from the offline notification determination unit 202 to display an offline notification screen,
An offline notification screen is displayed on the display unit 205 (S1502). In this manner, the client terminal 2 according to the present embodiment ends the processing when the network is disconnected and becomes offline in the online state.

If the offline notification determination unit 202 determines in the determination process of S1408 that the offline notification screen is not displayed on the currently displayed display screen and the offline notification screen is displayed after the screen transition, FIG. As shown in FIG. 4, when the display screen management unit 204 is requested to notify the screen transition (S1601), and the display screen management unit 204 is requested to notify the screen transition, the display screen management unit It waits until it is notified from 204 that the screen has changed. After receiving the request to notify that the screen has changed, the display screen management unit 204 changes the screen of the display unit 205 (S1602), and notifies the offline notification determination unit 202 that the screen has changed. (S1603).

When notified of the screen transition from the display screen management unit 204, the offline notification determination unit 202 requests the display screen management unit 204 to display an offline notification screen (S1).
604). When receiving a request to display the offline notification screen from the offline notification determination unit 202, the display screen management unit 204 causes the display unit 205 to display the offline notification screen (
S1605). In this manner, the client terminal 2 according to the present embodiment ends the processing when the network is disconnected and becomes offline in the online state.

Next, when the client terminal 2 according to the present embodiment is in a standby state as an operation state in the online state and displays a standby screen as a display screen, the network is disconnected and the offline state is entered by the user. Processing when a participation request operation is performed will be described with reference to FIG. FIG. 17 shows a case where the client terminal 2 according to the present embodiment is in a standby state as an operation state in an online state, and displays a standby screen as a display screen. It is a sequence diagram for demonstrating the process when participation request operation is performed by (1).

As shown in FIG. 17, when the client terminal 2 according to the present embodiment is in a standby state as an operation state in an online state, and the standby screen is displayed as a display screen, the network is disconnected and the offline state is entered. Later, when the user performs a participation request operation, first, the client terminal 2 according to the present embodiment performs S140 described in FIG.
1 to S1404 are performed (S1701 to S1704).

Then, the operation state management unit 203 notifies the offline notification determination unit 202 of “standby” as the operation state (S1705), and the display screen management unit 204 displays “standby screen” as the display screen.
Is notified to the offline notification determination unit 202 (S1706). The offline notification unit 202
When an operation state (standby) and a display screen (standby screen) are acquired from the operation state management unit 203 (
S1707), referring to the offline notification determination Tb stored in the offline notification determination Tb storage unit 206, “display” is a determination element corresponding to the combination of the acquired operation state (standby) and display screen (standby screen). Based on “No”, it is determined not to display the offline notification screen (S1708).

During such processes of S1701 to S1708, the client terminal 2 according to the present embodiment.
When a user is selected from the standby screen by a user operation and a participation request is made, the display unit 2
05, after accepting the user selection, notifies the display screen management unit 204 of a participation request to the selected user (S1709, S1710). The display screen management unit 204 includes a display unit 205.
When the participation request is notified, the operation state management unit 203 is requested to change the operation state from standby to participation request processing (S1711), and the participation request notified from the display unit 205 is transmitted. To the communication unit 201 (S1712).

When the operation state management unit 203 receives a request from the display screen management unit 204 to change the operation state from standby to participation request processing, the operation state management unit 203 changes the operation state from standby to participation request processing according to the received request. (S1713).

On the other hand, when the communication unit 201 receives a request to transmit a participation request from the display screen management unit 204, the communication unit 201 performs the same processing as S1401 to S1404 described in FIG. 14 (S171).
4-S1717).

Then, the operation state management unit 203 notifies the offline notification determination unit 202 of “participation request processing” as the operation state (S1718), and the display screen management unit 204 sets “standby screen” as the display screen to the offline notification determination unit. 202 is notified (S1719). Offline notification unit 2
02 obtains the operation state (participation request processing) and the display screen (standby screen) from the operation state management unit 203 (S1720), and refers to the offline notification determination Tb stored in the offline notification determination Tb storage unit 206. If it is determined that the offline notification screen is to be displayed based on “display” as a determination element corresponding to the combination of the acquired operation state (participation request processing) and the display screen (standby screen) (S1721), the display The screen management unit 204 is requested to display an offline notification screen (S1722).

Upon receiving a request from the offline notification determination unit 202 to display the offline notification screen, the display screen management unit 204 causes the display unit 205 to display the offline notification screen (S172).
3). In this way, the client terminal 2 according to the present embodiment is in a standby state as an operation state in the online state, and after displaying the standby screen as a display screen, the network is disconnected and becomes an offline state. The process when the user performs a participation request operation is terminated.

Next, when the client terminal 2 according to the present embodiment is in a standby state as an operation state in the online state and displays a standby screen as a display screen, the network is disconnected and the offline state is entered by the user. Display unit 20 when participation request operation is performed
5 will be described with reference to FIG. That is, transition of the display screen of the display unit 205 when the processing described in FIG. 17 is performed will be described with reference to FIG. FIG. 18 shows a case where the client terminal 2 according to the present embodiment is in a standby state as an operation state in the online state and displays a standby screen as a display screen. It is a figure which shows the transition of the display screen of the display part 205 when participation request operation is performed by.

First, the display screen of the display unit 205 when the client terminal 2 is in an offline state is
As shown in (A) → (B) of FIG. 18, there is no particular change, and the user cannot recognize that the user is offline. Then, when the user B is selected from the standby screen by the user operation on the client terminal 2 according to the present embodiment, the display screen of the display unit 205 changes as shown in (B) → (C) of FIG. When the “OK” button is pressed in the standby screen of FIG. 18C and a participation request is made, the display screen of the display unit 205 transitions as shown in FIGS. 18C to 18D. The offline notification screen is displayed with the standby screen in the background.

When the “OK” button is pressed on the offline notification screen shown in FIG. 18D by a user operation on the client terminal 2 according to the present embodiment, the display screen of the display unit 205 is changed to (D ) → Transition as shown in (E), and “OFFLI” for all users.
NE "is displayed. Thereafter, when the network is connected and the offline state is restored to the online state, the display screen of the display unit 205 transitions as shown in FIGS. 18E to 18F, and a standby screen before the network is disconnected. Alternatively, the standby screen updated with the latest information is displayed.

Next, when the client terminal 2 according to the present embodiment is in a meeting as an operation state in the online state and the conference screen is displayed as a display screen, the display unit when the network is disconnected and the offline state is entered The transition of the display screen 205 will be described with reference to FIG. FIG. 19 is a display when the client terminal 2 according to the present embodiment is in a conference as an operation state in the online state and the network is disconnected and the offline state is displayed when the conference screen is displayed as a display screen. FIG. 6 is a diagram showing transition of a display screen of a unit 205.

First, the display screen of the display unit 205 when the client terminal 2 is in an offline state is
As shown in (A) → (B) of FIG. 19, the offline notification screen is displayed with the conference screen as the back. Then, by a user operation on the client terminal 2 according to the present embodiment, FIG.
When the “OK” button is pressed on the offline notification screen shown in (B) of FIG.
The display screen 5 is changed as shown in FIGS. 19B to 19C, and the standby screen is displayed, and “OFFLINE” is displayed for all users.

In addition, about the process performed at this time, ie, the client terminal 2 which concerns on this embodiment.
However, the processing described in FIG. 14 and FIG. 15 is performed when the network is disconnected when the conference screen is displayed as the display screen and the network is disconnected when the conference screen is displayed as the operation state in the online state. The same processing is performed.

Next, when the client terminal 2 according to the present embodiment is on standby as an operation state in the online state and displays the setting screen as a display screen, the display unit when the network is disconnected and the offline state is entered The transition of the display screen 205 will be described with reference to FIG. FIG. 20 is a display when the client terminal 2 according to the present embodiment is on standby as an operation state in the online state and the network is disconnected and the offline state is displayed when the setting screen is displayed as the display screen. FIG. 6 is a diagram showing transition of a display screen of a unit 205.

The display screen of the display unit 205 when the client terminal 2 is offline is shown in FIG.
(A) → (B), there is no particular change, and the user cannot recognize that the user is in the offline state. In addition, regarding the processing performed at this time, that is, when the client terminal 2 according to the present embodiment is on standby as an operation state in the online state and the setting screen is displayed as the display screen, the network is disconnected. In the case of the offline state, the same processing as that described in FIG. 14 is performed.

Next, when the client terminal 2 according to the present embodiment is in a meeting as an operation state in the online state and the conference screen is displayed as the display screen, the network is disconnected and the offline state The transition of the display screen of the display unit 205 in the case of becoming will be described with reference to FIG. FIG. 21 shows that the network is disconnected when the client terminal 2 according to the present embodiment is in a meeting as an operation state in the online state and the transition is made to the setting screen when the conference screen is displayed as a display screen. It is a figure which shows transition of the display screen of the display part 205 when it will be in a state.

First, when the “setting” button is pressed by a user operation on the conference screen as shown in FIG. 21A, the display screen of the display unit 205 transitions as shown in FIG. Then the setting screen is displayed. Then, in the setting screen as shown in FIG. 21B, when the client terminal 2 goes offline, the display screen of the display unit 205 is
(B) → (C) in FIG. 21, there is no particular change, and the user cannot recognize that the user is in an offline state.

When the “OK” button is pressed on the setting screen shown in FIG. 21C by a user operation on the client terminal 2 according to the present embodiment, the display screen of the display unit 205 is displayed as shown in FIG. → As shown in (D), the offline notification screen is displayed with the conference screen as the back. Thereafter, when the “OK” button is pressed on the offline notification screen shown in FIG. 21D by a user operation on the client terminal 2 according to the present embodiment, the display screen of the display unit 205 is changed to (D ) → (E) and the standby screen is displayed, and “OFFLINE” is displayed for all users.

In addition, about the process performed at this time, ie, the client terminal 2 which concerns on this embodiment.
However, FIG. 14 shows the processing when the network is disconnected and the offline state is entered when the operation screen in the online state is in a meeting and the screen is changed to the setting screen when the conference screen is displayed as the display screen. And the process similar to the process demonstrated in FIG. 16 is performed.

Next, when the client terminal 2 according to the present embodiment is in the participation request process as an operation state in the online state, and the transition is made to the setting screen when the standby screen is displayed as the display screen, the network is disconnected. Display unit 20 when in offline state
5 will be described with reference to FIG. FIG. 22 shows that the client terminal 2 according to the present embodiment is in the participation request process as the operating state in the online state.
It is a figure which shows the transition of the display screen of the display part 205 when a network is cut | disconnected and it will be in an offline state when it transfers to a setting screen when the standby screen is displayed as a display screen.

First, when the “set” button is pressed by a user operation on the standby screen as shown in FIG. 22A, the display screen of the display unit 205 changes as shown in FIG. Then the setting screen is displayed. Then, in the setting screen as shown in FIG. 22B, when the client terminal 2 goes offline, the display screen of the display unit 205 is
As shown in FIG. 22 (B) → (C), there is no particular change, and it is impossible for the user to recognize that the user is in an offline state.

When the “OK” button is pressed on the setting screen shown in FIG. 22C by a user operation on the client terminal 2 according to the present embodiment, the display screen of the display unit 205 is displayed as shown in FIG. → Transition as shown in (D) and the offline notification screen is displayed with the standby screen as the back. At this time, as shown in FIG. 22D, “OFFLINE” is displayed for all users on the standby screen displayed on the back of the offline notification screen.

In addition, about the process performed at this time, ie, the client terminal 2 which concerns on this embodiment.
However, regarding the processing when the network is disconnected and the offline state is entered when the transition to the setting screen is displayed while the standby screen is displayed as the display screen when the participation request is being processed as the operating state in the online state, Processing similar to the processing described in FIGS. 14 and 16 is performed.

Next, even when the client terminal 2 according to the present embodiment is in the offline state when it is “not displayed” as the determination element corresponding to the combination of the operation state and the display screen in the online state, a certain time Processing for displaying the offline notification screen after elapse will be described with reference to FIG. FIG. 23 shows the case where the client terminal 2 according to the present embodiment is in the offline state when it is “not displayed” as the determination element corresponding to the combination of the operation state and the display screen in the online state. It is a sequence diagram for demonstrating the process in the case of displaying an offline notification screen after time progress.

Note that with the configuration described in FIG. 23, in the case where it is determined that the offline notification screen is not displayed in the client terminal 2 according to the present embodiment, the user operation is not performed for a certain period of time. The offline notification screen can be displayed.
Therefore, according to the client terminal 2 according to the present embodiment, the offline notification screen can be displayed before the user feels uneasy that the user may be offline. In addition, according to the client terminal 2 according to the present embodiment, it is possible to prevent the device from being left for a long time in an offline state.

As shown in FIG. 23, the client terminal 2 according to the present embodiment is in the offline state when it is “not displayed” as the determination element corresponding to the combination of the operation state and the display screen in the online state. However, when the offline notification screen is displayed after a predetermined time has elapsed, the client terminal 2 according to the present embodiment first performs the same processing as S1401 to S1408 described in FIG. 14 (S2301 to S2308).

If the offline notification unit 202 determines that the offline notification screen is not displayed in the determination process of S2308, the offline notification unit 202 starts measuring elapsed time triggered by the determination that the offline notification screen is not displayed (S2309). . The offline notification unit 202 detects a timeout when the elapsed time when the measurement is started in S2309 exceeds a predetermined time (S2310), and requests the display screen management unit 204 to display the offline notification screen (S2311). Upon receiving a request from the offline notification determination unit 202 to display the offline notification screen, the display screen management unit 204 causes the display unit 205 to display the offline notification screen (S2312).

Thus, even when the client terminal 2 according to the present embodiment is in the offline state when it is “not displayed” as the determination element corresponding to the combination of the operation state and the display screen in the online state, The process for displaying the offline notification screen after a certain period of time ends.

As described above, in such a client terminal 2, one of the gist according to the present embodiment is that when the network communication is disconnected in the online state and the offline state is entered, the video conference application is in the operating state. The offline notification screen is displayed based on the operational state of the video conference application when the offline notification screen is actually set with reference to the offline notification determination Tb in which the criterion for determining whether or not to display the offline notification screen is set. It is to determine whether or not to do so. Therefore, according to the client terminal 2 according to the present embodiment, it is possible to notify the user that the offline state has been reached at an appropriate timing.

Moreover, in such a client terminal 2, one of the other points concerning this embodiment is as follows.
Refer to offline notification determination Tb in which a criterion for determining whether to display an offline notification screen according to a combination of the operation state of the video conference application and the display screen that can be displayed by the video conference application is actually offline. It is to determine whether or not to display the offline notification screen based on the combination of the operation state of the video conference app when the status is reached and the display screen displayed by the video conference app. Therefore, according to the client terminal 2 according to the present embodiment, it is possible to notify the user of the offline state at a more appropriate timing.

In this embodiment, the video conference application has been described as an application that enables real-time communication with a remote location. However, as another application that enables real-time communication with a remote location, for example, It can also be applied to messenger software, Internet live communication software, chat software, and the like.

1 Video conference system management server 2 Client terminal 3 Network 4 Network 5 Public line 10 CPU
20 RAM
30 ROM
40 HDD
50 I / F
60 LCD
70 operation unit 80 bus 201 communication unit 202 offline notification determination unit 203 operation state management unit 204 display screen management unit 205 display unit 206 offline notification determination table storage unit

JP 2011-198238 A

Claims (6)

A client terminal that performs communication via the server and the network,
A real-time communication control unit that realizes real-time communication using audio and video between the client terminal and another client terminal connected to the server by performing communication with the server via the network;
A first screen for selecting a partner for real-time exchange, a second screen for sending a request for participation in the real-time exchange to the selected partner, and via the network A display for displaying a third screen for notifying that communication is not possible;
With
The display unit
If the network is disconnected while the first screen is displayed, the third screen is not displayed, and the real-time exchange is performed by a user operation performed on the first screen. When the partner is selected, the second screen is displayed. When it is determined that the participation request is sent to the partner by a user operation performed on the second screen, the third screen is displayed. The client terminal to display . The client terminal according to claim 1, wherein the network is the Internet. Installed in the information processing terminal or the portable information terminal, and causes the information processing terminal or the portable information terminal to communicate with the server via the network and connect to the information processing terminal or the portable information terminal and the server. A computer program for executing real-time exchange using audio and video with an information processing terminal or another portable information terminal,
A first screen display step for displaying a first screen for selecting a partner for real-time communication on the display unit;
A second screen display that displays a second screen for sending a request to participate in the real-time exchange to the other party when a partner to perform the real-time exchange is selected by a user operation on the first screen Steps,
When it is determined that the participation request is to be sent to the other party by a user operation on the second screen, if the communication via the network is not possible, the communication via the network is performed. A third screen display step for displaying a third screen for notifying that the state cannot be performed;
Including
In the first screen display step, the third program is not displayed when the network is disconnected while the first screen is displayed on the display unit. The computer program according to claim 3, wherein the network is the Internet. An information processing method in a client terminal that performs real-time exchange using audio and video with other client terminals connected to the server by performing communication with a server via a network,
Display a first screen on the display unit for selecting a partner to exchange in real time,
When a partner to perform the real-time exchange is selected by a user operation on the first screen, a second screen for sending a request for participation in the real-time exchange to the partner is displayed on the display unit,
When it is determined that the participation request is to be sent to the other party by a user operation on the second screen, if the communication via the network is not possible, the communication via the network is performed. Display a third screen on the display unit for notifying that it is not possible to perform,
When displaying the first screen on the display unit, if the network is disconnected while the first screen is displayed on the display unit, the third screen is not displayed. Method. The information processing method according to claim 5, wherein the network is the Internet.